[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:09:58.851898 24113 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.23.140.126:32965
I20260709 13:09:58.853466 24113 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:09:58.854521 24113 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:58.871995 24119 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:58.871991 24122 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:58.871938 24120 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:00.061401 24121 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
I20260709 13:10:00.061429 24113 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260709 13:10:00.065341 24113 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:00.065593 24113 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:00.065835 24113 hybrid_clock.cc:648] HybridClock initialized: now 1783602600065803 us; error 0 us; skew 500 ppm
I20260709 13:10:00.066666 24113 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:00.072039 24113 webserver.cc:533] Webserver started at http://127.23.140.126:45829/ using document root <none> and password file <none>
I20260709 13:10:00.072906 24113 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:00.073137 24113 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:00.073688 24113 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:00.081851 24113 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602598684750-24113-0/minicluster-data/master-0-root/instance:
uuid: "061a97dd9776425a92613ba6ed47679d"
format_stamp: "Formatted at 2026-07-09 13:10:00 on dist-test-slave-1rs3"
I20260709 13:10:00.090608 24113 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:10:00.095717 24128 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:00.096861 24113 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.001s
I20260709 13:10:00.097229 24113 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602598684750-24113-0/minicluster-data/master-0-root
uuid: "061a97dd9776425a92613ba6ed47679d"
format_stamp: "Formatted at 2026-07-09 13:10:00 on dist-test-slave-1rs3"
I20260709 13:10:00.097573 24113 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602598684750-24113-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602598684750-24113-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602598684750-24113-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:00.148471 24113 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:00.150080 24113 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:10:00.150545 24113 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:00.222021 24113 rpc_server.cc:307] RPC server started. Bound to: 127.23.140.126:32965
I20260709 13:10:00.222100 24179 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.140.126:32965 every 8 connection(s)
I20260709 13:10:00.229990 24180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:00.251376 24180 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 061a97dd9776425a92613ba6ed47679d: Bootstrap starting.
I20260709 13:10:00.257210 24180 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 061a97dd9776425a92613ba6ed47679d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:00.259176 24180 log.cc:826] T 00000000000000000000000000000000 P 061a97dd9776425a92613ba6ed47679d: Log is configured to *not* fsync() on all Append() calls
I20260709 13:10:00.263643 24180 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 061a97dd9776425a92613ba6ed47679d: No bootstrap required, opened a new log
I20260709 13:10:00.284049 24180 raft_consensus.cc:359] T 00000000000000000000000000000000 P 061a97dd9776425a92613ba6ed47679d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "061a97dd9776425a92613ba6ed47679d" member_type: VOTER }
I20260709 13:10:00.284626 24180 raft_consensus.cc:385] T 00000000000000000000000000000000 P 061a97dd9776425a92613ba6ed47679d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:00.284909 24180 raft_consensus.cc:740] T 00000000000000000000000000000000 P 061a97dd9776425a92613ba6ed47679d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 061a97dd9776425a92613ba6ed47679d, State: Initialized, Role: FOLLOWER
I20260709 13:10:00.285862 24180 consensus_queue.cc:260] T 00000000000000000000000000000000 P 061a97dd9776425a92613ba6ed47679d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "061a97dd9776425a92613ba6ed47679d" member_type: VOTER }
I20260709 13:10:00.286365 24180 raft_consensus.cc:399] T 00000000000000000000000000000000 P 061a97dd9776425a92613ba6ed47679d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:10:00.286659 24180 raft_consensus.cc:493] T 00000000000000000000000000000000 P 061a97dd9776425a92613ba6ed47679d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:10:00.287005 24180 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 061a97dd9776425a92613ba6ed47679d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:00.291113 24180 raft_consensus.cc:515] T 00000000000000000000000000000000 P 061a97dd9776425a92613ba6ed47679d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "061a97dd9776425a92613ba6ed47679d" member_type: VOTER }
I20260709 13:10:00.291854 24180 leader_election.cc:304] T 00000000000000000000000000000000 P 061a97dd9776425a92613ba6ed47679d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 061a97dd9776425a92613ba6ed47679d; no voters: 
I20260709 13:10:00.293653 24180 leader_election.cc:290] T 00000000000000000000000000000000 P 061a97dd9776425a92613ba6ed47679d [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:10:00.294055 24183 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 061a97dd9776425a92613ba6ed47679d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:00.296825 24183 raft_consensus.cc:697] T 00000000000000000000000000000000 P 061a97dd9776425a92613ba6ed47679d [term 1 LEADER]: Becoming Leader. State: Replica: 061a97dd9776425a92613ba6ed47679d, State: Running, Role: LEADER
I20260709 13:10:00.297807 24183 consensus_queue.cc:237] T 00000000000000000000000000000000 P 061a97dd9776425a92613ba6ed47679d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "061a97dd9776425a92613ba6ed47679d" member_type: VOTER }
I20260709 13:10:00.298790 24180 sys_catalog.cc:565] T 00000000000000000000000000000000 P 061a97dd9776425a92613ba6ed47679d [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:10:00.308568 24184 sys_catalog.cc:455] T 00000000000000000000000000000000 P 061a97dd9776425a92613ba6ed47679d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "061a97dd9776425a92613ba6ed47679d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "061a97dd9776425a92613ba6ed47679d" member_type: VOTER } }
I20260709 13:10:00.309360 24184 sys_catalog.cc:458] T 00000000000000000000000000000000 P 061a97dd9776425a92613ba6ed47679d [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:00.309202 24185 sys_catalog.cc:455] T 00000000000000000000000000000000 P 061a97dd9776425a92613ba6ed47679d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 061a97dd9776425a92613ba6ed47679d. Latest consensus state: current_term: 1 leader_uuid: "061a97dd9776425a92613ba6ed47679d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "061a97dd9776425a92613ba6ed47679d" member_type: VOTER } }
I20260709 13:10:00.309894 24185 sys_catalog.cc:458] T 00000000000000000000000000000000 P 061a97dd9776425a92613ba6ed47679d [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:00.313331 24191 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:10:00.324882 24191 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:10:00.327313 24113 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:10:00.343425 24191 catalog_manager.cc:1383] Generated new cluster ID: 551a7c94b539488d9fbb2a3e76c371c3
I20260709 13:10:00.343740 24191 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:10:00.370916 24191 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:10:00.372454 24191 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:10:00.388324 24191 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 061a97dd9776425a92613ba6ed47679d: Generated new TSK 0
I20260709 13:10:00.389302 24191 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:10:00.458796 24113 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:00.468794 24202 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:00.469419 24203 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:00.474289 24113 server_base.cc:1061] running on GCE node
W20260709 13:10:00.474172 24206 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:00.475265 24113 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:00.475495 24113 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:00.475696 24113 hybrid_clock.cc:648] HybridClock initialized: now 1783602600475664 us; error 0 us; skew 500 ppm
I20260709 13:10:00.476293 24113 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:00.480768 24113 webserver.cc:533] Webserver started at http://127.23.140.65:42277/ using document root <none> and password file <none>
I20260709 13:10:00.481313 24113 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:00.481527 24113 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:00.481853 24113 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:00.482995 24113 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602598684750-24113-0/minicluster-data/ts-0-root/instance:
uuid: "89434398bef1483abb7170861c595c08"
format_stamp: "Formatted at 2026-07-09 13:10:00 on dist-test-slave-1rs3"
I20260709 13:10:00.488880 24113 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:10:00.493533 24210 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:00.494424 24113 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:10:00.494729 24113 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602598684750-24113-0/minicluster-data/ts-0-root
uuid: "89434398bef1483abb7170861c595c08"
format_stamp: "Formatted at 2026-07-09 13:10:00 on dist-test-slave-1rs3"
I20260709 13:10:00.495030 24113 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602598684750-24113-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602598684750-24113-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602598684750-24113-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:00.521970 24113 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:00.523415 24113 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:00.526203 24113 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:00.530791 24113 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:00.531008 24113 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:00.531333 24113 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:00.531550 24113 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:00.640496 24113 rpc_server.cc:307] RPC server started. Bound to: 127.23.140.65:42583
I20260709 13:10:00.640581 24272 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.140.65:42583 every 8 connection(s)
I20260709 13:10:00.648440 24113 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:00.662281 24277 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:00.663661 24278 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:00.668212 24280 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:00.668408 24113 server_base.cc:1061] running on GCE node
I20260709 13:10:00.669585 24113 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:00.669893 24113 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:00.670092 24113 hybrid_clock.cc:648] HybridClock initialized: now 1783602600670077 us; error 0 us; skew 500 ppm
I20260709 13:10:00.670886 24113 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:00.676126 24113 webserver.cc:533] Webserver started at http://127.23.140.66:38831/ using document root <none> and password file <none>
I20260709 13:10:00.676831 24113 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:00.677102 24113 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:00.677428 24113 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:00.678666 24273 heartbeater.cc:344] Connected to a master server at 127.23.140.126:32965
I20260709 13:10:00.678829 24113 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602598684750-24113-0/minicluster-data/ts-1-root/instance:
uuid: "f39804e3bc0e439286a172ab4c75e032"
format_stamp: "Formatted at 2026-07-09 13:10:00 on dist-test-slave-1rs3"
I20260709 13:10:00.679162 24273 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:00.680393 24273 heartbeater.cc:507] Master 127.23.140.126:32965 requested a full tablet report, sending...
I20260709 13:10:00.683893 24145 ts_manager.cc:194] Registered new tserver with Master: 89434398bef1483abb7170861c595c08 (127.23.140.65:42583)
I20260709 13:10:00.685740 24113 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:10:00.686993 24145 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50876
I20260709 13:10:00.689960 24285 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:00.690846 24113 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:10:00.691131 24113 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602598684750-24113-0/minicluster-data/ts-1-root
uuid: "f39804e3bc0e439286a172ab4c75e032"
format_stamp: "Formatted at 2026-07-09 13:10:00 on dist-test-slave-1rs3"
I20260709 13:10:00.691401 24113 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602598684750-24113-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602598684750-24113-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602598684750-24113-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:00.712925 24113 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:00.714286 24113 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:00.716748 24113 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:00.721215 24113 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:00.721410 24113 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:00.721715 24113 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:00.721946 24113 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:10:00.821122 24113 rpc_server.cc:307] RPC server started. Bound to: 127.23.140.66:37967
I20260709 13:10:00.821233 24347 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.140.66:37967 every 8 connection(s)
I20260709 13:10:00.831883 24113 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:00.839309 24351 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:00.840824 24352 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:00.845341 24348 heartbeater.cc:344] Connected to a master server at 127.23.140.126:32965
I20260709 13:10:00.845733 24348 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:00.846745 24348 heartbeater.cc:507] Master 127.23.140.126:32965 requested a full tablet report, sending...
W20260709 13:10:00.848343 24354 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:00.849138 24145 ts_manager.cc:194] Registered new tserver with Master: f39804e3bc0e439286a172ab4c75e032 (127.23.140.66:37967)
I20260709 13:10:00.851054 24145 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50892
I20260709 13:10:00.851763 24113 server_base.cc:1061] running on GCE node
I20260709 13:10:00.852895 24113 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:00.853195 24113 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:00.853449 24113 hybrid_clock.cc:648] HybridClock initialized: now 1783602600853418 us; error 0 us; skew 500 ppm
I20260709 13:10:00.854050 24113 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:00.856851 24113 webserver.cc:533] Webserver started at http://127.23.140.67:45257/ using document root <none> and password file <none>
I20260709 13:10:00.857316 24113 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:00.857534 24113 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:00.857851 24113 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:00.858876 24113 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602598684750-24113-0/minicluster-data/ts-2-root/instance:
uuid: "ba007af05f0f4fb3aa79a70a4ed62188"
format_stamp: "Formatted at 2026-07-09 13:10:00 on dist-test-slave-1rs3"
I20260709 13:10:00.863606 24113 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:10:00.867319 24359 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:00.868206 24113 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:10:00.868501 24113 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602598684750-24113-0/minicluster-data/ts-2-root
uuid: "ba007af05f0f4fb3aa79a70a4ed62188"
format_stamp: "Formatted at 2026-07-09 13:10:00 on dist-test-slave-1rs3"
I20260709 13:10:00.868745 24113 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602598684750-24113-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602598684750-24113-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602598684750-24113-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:00.887933 24113 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:00.889341 24113 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:00.890894 24113 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:00.893286 24113 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:00.893465 24113 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:00.893812 24113 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:00.893997 24113 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:00.996691 24113 rpc_server.cc:307] RPC server started. Bound to: 127.23.140.67:39155
I20260709 13:10:00.996873 24421 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.140.67:39155 every 8 connection(s)
I20260709 13:10:01.013463 24422 heartbeater.cc:344] Connected to a master server at 127.23.140.126:32965
I20260709 13:10:01.013988 24422 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:01.015142 24422 heartbeater.cc:507] Master 127.23.140.126:32965 requested a full tablet report, sending...
I20260709 13:10:01.017524 24145 ts_manager.cc:194] Registered new tserver with Master: ba007af05f0f4fb3aa79a70a4ed62188 (127.23.140.67:39155)
I20260709 13:10:01.017786 24113 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016187797s
I20260709 13:10:01.019601 24145 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50906
I20260709 13:10:01.071961 24145 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50916:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:01.075780 24145 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:01.200050 24310 tablet_service.cc:1511] Processing CreateTablet for tablet 57caa52201cc4aaba1de74ac8393a6a6 (DEFAULT_TABLE table=test-workload [id=84a0b9a6dffc40d0bc5b82c8befdb0d5]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:01.203020 24387 tablet_service.cc:1511] Processing CreateTablet for tablet fdb7ba4cacaf498d83b351d63a57aa7b (DEFAULT_TABLE table=test-workload [id=84a0b9a6dffc40d0bc5b82c8befdb0d5]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:01.198302 24311 tablet_service.cc:1511] Processing CreateTablet for tablet 072781c592984c6a9a6f3d8790809bd1 (DEFAULT_TABLE table=test-workload [id=84a0b9a6dffc40d0bc5b82c8befdb0d5]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:01.201377 24313 tablet_service.cc:1511] Processing CreateTablet for tablet fdb7ba4cacaf498d83b351d63a57aa7b (DEFAULT_TABLE table=test-workload [id=84a0b9a6dffc40d0bc5b82c8befdb0d5]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:01.199604 24386 tablet_service.cc:1511] Processing CreateTablet for tablet c4607544e6a241349a1a35df8aaca446 (DEFAULT_TABLE table=test-workload [id=84a0b9a6dffc40d0bc5b82c8befdb0d5]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:01.216367 24310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57caa52201cc4aaba1de74ac8393a6a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:01.217576 24385 tablet_service.cc:1511] Processing CreateTablet for tablet 072781c592984c6a9a6f3d8790809bd1 (DEFAULT_TABLE table=test-workload [id=84a0b9a6dffc40d0bc5b82c8befdb0d5]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:01.214445 24312 tablet_service.cc:1511] Processing CreateTablet for tablet c4607544e6a241349a1a35df8aaca446 (DEFAULT_TABLE table=test-workload [id=84a0b9a6dffc40d0bc5b82c8befdb0d5]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:01.211093 24309 tablet_service.cc:1511] Processing CreateTablet for tablet d3529531034c4da8ace2a1b8bcc7c934 (DEFAULT_TABLE table=test-workload [id=84a0b9a6dffc40d0bc5b82c8befdb0d5]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:01.223851 24313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdb7ba4cacaf498d83b351d63a57aa7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:01.215565 24383 tablet_service.cc:1511] Processing CreateTablet for tablet d3529531034c4da8ace2a1b8bcc7c934 (DEFAULT_TABLE table=test-workload [id=84a0b9a6dffc40d0bc5b82c8befdb0d5]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:01.217069 24307 tablet_service.cc:1511] Processing CreateTablet for tablet a2b8f465407049c093b74b89e0cc8fc3 (DEFAULT_TABLE table=test-workload [id=84a0b9a6dffc40d0bc5b82c8befdb0d5]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:01.227841 24381 tablet_service.cc:1511] Processing CreateTablet for tablet a2b8f465407049c093b74b89e0cc8fc3 (DEFAULT_TABLE table=test-workload [id=84a0b9a6dffc40d0bc5b82c8befdb0d5]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:01.220662 24382 tablet_service.cc:1511] Processing CreateTablet for tablet 5eb056e46f2d4ddbb45fdb665a6b3eaa (DEFAULT_TABLE table=test-workload [id=84a0b9a6dffc40d0bc5b82c8befdb0d5]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:01.228581 24305 tablet_service.cc:1511] Processing CreateTablet for tablet a14d80b5fd8747d3b44afc1fc32ecffa (DEFAULT_TABLE table=test-workload [id=84a0b9a6dffc40d0bc5b82c8befdb0d5]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:01.227072 24387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdb7ba4cacaf498d83b351d63a57aa7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:01.225435 24384 tablet_service.cc:1511] Processing CreateTablet for tablet 57caa52201cc4aaba1de74ac8393a6a6 (DEFAULT_TABLE table=test-workload [id=84a0b9a6dffc40d0bc5b82c8befdb0d5]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:01.230629 24311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 072781c592984c6a9a6f3d8790809bd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:01.229151 24308 tablet_service.cc:1511] Processing CreateTablet for tablet 5eb056e46f2d4ddbb45fdb665a6b3eaa (DEFAULT_TABLE table=test-workload [id=84a0b9a6dffc40d0bc5b82c8befdb0d5]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:01.235340 24380 tablet_service.cc:1511] Processing CreateTablet for tablet 2824545a6ec14281b292a9a80984e5d7 (DEFAULT_TABLE table=test-workload [id=84a0b9a6dffc40d0bc5b82c8befdb0d5]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:01.237092 24379 tablet_service.cc:1511] Processing CreateTablet for tablet a14d80b5fd8747d3b44afc1fc32ecffa (DEFAULT_TABLE table=test-workload [id=84a0b9a6dffc40d0bc5b82c8befdb0d5]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:01.233316 24306 tablet_service.cc:1511] Processing CreateTablet for tablet 2824545a6ec14281b292a9a80984e5d7 (DEFAULT_TABLE table=test-workload [id=84a0b9a6dffc40d0bc5b82c8befdb0d5]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:01.240800 24312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4607544e6a241349a1a35df8aaca446. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:01.241459 24306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2824545a6ec14281b292a9a80984e5d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:01.246474 24307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2b8f465407049c093b74b89e0cc8fc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:01.247200 24386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4607544e6a241349a1a35df8aaca446. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:01.247314 24308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5eb056e46f2d4ddbb45fdb665a6b3eaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:01.258591 24379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a14d80b5fd8747d3b44afc1fc32ecffa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:01.263502 24385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 072781c592984c6a9a6f3d8790809bd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:01.267091 24305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a14d80b5fd8747d3b44afc1fc32ecffa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:01.267915 24382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5eb056e46f2d4ddbb45fdb665a6b3eaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:01.282073 24309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3529531034c4da8ace2a1b8bcc7c934. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:01.283751 24238 tablet_service.cc:1511] Processing CreateTablet for tablet fdb7ba4cacaf498d83b351d63a57aa7b (DEFAULT_TABLE table=test-workload [id=84a0b9a6dffc40d0bc5b82c8befdb0d5]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:01.285204 24236 tablet_service.cc:1511] Processing CreateTablet for tablet 072781c592984c6a9a6f3d8790809bd1 (DEFAULT_TABLE table=test-workload [id=84a0b9a6dffc40d0bc5b82c8befdb0d5]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:01.288796 24383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3529531034c4da8ace2a1b8bcc7c934. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:01.289048 24235 tablet_service.cc:1511] Processing CreateTablet for tablet 57caa52201cc4aaba1de74ac8393a6a6 (DEFAULT_TABLE table=test-workload [id=84a0b9a6dffc40d0bc5b82c8befdb0d5]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:01.298067 24237 tablet_service.cc:1511] Processing CreateTablet for tablet c4607544e6a241349a1a35df8aaca446 (DEFAULT_TABLE table=test-workload [id=84a0b9a6dffc40d0bc5b82c8befdb0d5]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:01.303387 24234 tablet_service.cc:1511] Processing CreateTablet for tablet d3529531034c4da8ace2a1b8bcc7c934 (DEFAULT_TABLE table=test-workload [id=84a0b9a6dffc40d0bc5b82c8befdb0d5]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:01.308321 24238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdb7ba4cacaf498d83b351d63a57aa7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:01.311978 24230 tablet_service.cc:1511] Processing CreateTablet for tablet a14d80b5fd8747d3b44afc1fc32ecffa (DEFAULT_TABLE table=test-workload [id=84a0b9a6dffc40d0bc5b82c8befdb0d5]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:01.308768 24384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57caa52201cc4aaba1de74ac8393a6a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:01.307945 24231 tablet_service.cc:1511] Processing CreateTablet for tablet 2824545a6ec14281b292a9a80984e5d7 (DEFAULT_TABLE table=test-workload [id=84a0b9a6dffc40d0bc5b82c8befdb0d5]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:01.306589 24233 tablet_service.cc:1511] Processing CreateTablet for tablet 5eb056e46f2d4ddbb45fdb665a6b3eaa (DEFAULT_TABLE table=test-workload [id=84a0b9a6dffc40d0bc5b82c8befdb0d5]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:01.318172 24232 tablet_service.cc:1511] Processing CreateTablet for tablet a2b8f465407049c093b74b89e0cc8fc3 (DEFAULT_TABLE table=test-workload [id=84a0b9a6dffc40d0bc5b82c8befdb0d5]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
W20260709 13:10:01.324196 24193 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:01.326004 24234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3529531034c4da8ace2a1b8bcc7c934. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:01.327745 24233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5eb056e46f2d4ddbb45fdb665a6b3eaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:01.326989 24381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2b8f465407049c093b74b89e0cc8fc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:01.331741 24236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 072781c592984c6a9a6f3d8790809bd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:01.341128 24231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2824545a6ec14281b292a9a80984e5d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:01.371613 24440 tablet_bootstrap.cc:492] T c4607544e6a241349a1a35df8aaca446 P f39804e3bc0e439286a172ab4c75e032: Bootstrap starting.
I20260709 13:10:01.374053 24380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2824545a6ec14281b292a9a80984e5d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:01.390141 24230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a14d80b5fd8747d3b44afc1fc32ecffa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:01.392100 24232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2b8f465407049c093b74b89e0cc8fc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:01.412479 24235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57caa52201cc4aaba1de74ac8393a6a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:01.426697 24237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4607544e6a241349a1a35df8aaca446. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:01.481549 24441 tablet_bootstrap.cc:492] T fdb7ba4cacaf498d83b351d63a57aa7b P ba007af05f0f4fb3aa79a70a4ed62188: Bootstrap starting.
I20260709 13:10:01.524565 24442 tablet_bootstrap.cc:492] T fdb7ba4cacaf498d83b351d63a57aa7b P 89434398bef1483abb7170861c595c08: Bootstrap starting.
I20260709 13:10:01.568994 24440 tablet_bootstrap.cc:654] T c4607544e6a241349a1a35df8aaca446 P f39804e3bc0e439286a172ab4c75e032: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:01.582953 24441 tablet_bootstrap.cc:654] T fdb7ba4cacaf498d83b351d63a57aa7b P ba007af05f0f4fb3aa79a70a4ed62188: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:01.581516 24442 tablet_bootstrap.cc:654] T fdb7ba4cacaf498d83b351d63a57aa7b P 89434398bef1483abb7170861c595c08: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:01.596802 24441 tablet_bootstrap.cc:492] T fdb7ba4cacaf498d83b351d63a57aa7b P ba007af05f0f4fb3aa79a70a4ed62188: No bootstrap required, opened a new log
I20260709 13:10:01.597364 24441 ts_tablet_manager.cc:1403] T fdb7ba4cacaf498d83b351d63a57aa7b P ba007af05f0f4fb3aa79a70a4ed62188: Time spent bootstrapping tablet: real 0.119s	user 0.004s	sys 0.012s
I20260709 13:10:01.602998 24441 raft_consensus.cc:359] T fdb7ba4cacaf498d83b351d63a57aa7b P ba007af05f0f4fb3aa79a70a4ed62188 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } }
I20260709 13:10:01.604058 24441 raft_consensus.cc:385] T fdb7ba4cacaf498d83b351d63a57aa7b P ba007af05f0f4fb3aa79a70a4ed62188 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:01.604517 24442 tablet_bootstrap.cc:492] T fdb7ba4cacaf498d83b351d63a57aa7b P 89434398bef1483abb7170861c595c08: No bootstrap required, opened a new log
I20260709 13:10:01.604501 24441 raft_consensus.cc:740] T fdb7ba4cacaf498d83b351d63a57aa7b P ba007af05f0f4fb3aa79a70a4ed62188 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba007af05f0f4fb3aa79a70a4ed62188, State: Initialized, Role: FOLLOWER
I20260709 13:10:01.605168 24442 ts_tablet_manager.cc:1403] T fdb7ba4cacaf498d83b351d63a57aa7b P 89434398bef1483abb7170861c595c08: Time spent bootstrapping tablet: real 0.082s	user 0.010s	sys 0.009s
I20260709 13:10:01.605609 24441 consensus_queue.cc:260] T fdb7ba4cacaf498d83b351d63a57aa7b P ba007af05f0f4fb3aa79a70a4ed62188 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } }
I20260709 13:10:01.606736 24440 tablet_bootstrap.cc:492] T c4607544e6a241349a1a35df8aaca446 P f39804e3bc0e439286a172ab4c75e032: No bootstrap required, opened a new log
I20260709 13:10:01.607282 24440 ts_tablet_manager.cc:1403] T c4607544e6a241349a1a35df8aaca446 P f39804e3bc0e439286a172ab4c75e032: Time spent bootstrapping tablet: real 0.236s	user 0.017s	sys 0.008s
I20260709 13:10:01.608209 24442 raft_consensus.cc:359] T fdb7ba4cacaf498d83b351d63a57aa7b P 89434398bef1483abb7170861c595c08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } }
I20260709 13:10:01.608938 24442 raft_consensus.cc:385] T fdb7ba4cacaf498d83b351d63a57aa7b P 89434398bef1483abb7170861c595c08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:01.609242 24442 raft_consensus.cc:740] T fdb7ba4cacaf498d83b351d63a57aa7b P 89434398bef1483abb7170861c595c08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89434398bef1483abb7170861c595c08, State: Initialized, Role: FOLLOWER
I20260709 13:10:01.610038 24442 consensus_queue.cc:260] T fdb7ba4cacaf498d83b351d63a57aa7b P 89434398bef1483abb7170861c595c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } }
I20260709 13:10:01.611096 24440 raft_consensus.cc:359] T c4607544e6a241349a1a35df8aaca446 P f39804e3bc0e439286a172ab4c75e032 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:01.612023 24440 raft_consensus.cc:385] T c4607544e6a241349a1a35df8aaca446 P f39804e3bc0e439286a172ab4c75e032 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:01.612381 24440 raft_consensus.cc:740] T c4607544e6a241349a1a35df8aaca446 P f39804e3bc0e439286a172ab4c75e032 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f39804e3bc0e439286a172ab4c75e032, State: Initialized, Role: FOLLOWER
I20260709 13:10:01.614475 24422 heartbeater.cc:499] Master 127.23.140.126:32965 was elected leader, sending a full tablet report...
I20260709 13:10:01.615618 24441 ts_tablet_manager.cc:1434] T fdb7ba4cacaf498d83b351d63a57aa7b P ba007af05f0f4fb3aa79a70a4ed62188: Time spent starting tablet: real 0.018s	user 0.012s	sys 0.002s
I20260709 13:10:01.616528 24441 tablet_bootstrap.cc:492] T c4607544e6a241349a1a35df8aaca446 P ba007af05f0f4fb3aa79a70a4ed62188: Bootstrap starting.
I20260709 13:10:01.622928 24441 tablet_bootstrap.cc:654] T c4607544e6a241349a1a35df8aaca446 P ba007af05f0f4fb3aa79a70a4ed62188: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:01.613809 24440 consensus_queue.cc:260] T c4607544e6a241349a1a35df8aaca446 P f39804e3bc0e439286a172ab4c75e032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:01.634706 24441 tablet_bootstrap.cc:492] T c4607544e6a241349a1a35df8aaca446 P ba007af05f0f4fb3aa79a70a4ed62188: No bootstrap required, opened a new log
I20260709 13:10:01.635200 24441 ts_tablet_manager.cc:1403] T c4607544e6a241349a1a35df8aaca446 P ba007af05f0f4fb3aa79a70a4ed62188: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.008s
I20260709 13:10:01.638170 24441 raft_consensus.cc:359] T c4607544e6a241349a1a35df8aaca446 P ba007af05f0f4fb3aa79a70a4ed62188 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:01.638912 24441 raft_consensus.cc:385] T c4607544e6a241349a1a35df8aaca446 P ba007af05f0f4fb3aa79a70a4ed62188 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:01.639293 24441 raft_consensus.cc:740] T c4607544e6a241349a1a35df8aaca446 P ba007af05f0f4fb3aa79a70a4ed62188 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba007af05f0f4fb3aa79a70a4ed62188, State: Initialized, Role: FOLLOWER
I20260709 13:10:01.640142 24441 consensus_queue.cc:260] T c4607544e6a241349a1a35df8aaca446 P ba007af05f0f4fb3aa79a70a4ed62188 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:01.640990 24348 heartbeater.cc:499] Master 127.23.140.126:32965 was elected leader, sending a full tablet report...
I20260709 13:10:01.642004 24440 ts_tablet_manager.cc:1434] T c4607544e6a241349a1a35df8aaca446 P f39804e3bc0e439286a172ab4c75e032: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.004s
I20260709 13:10:01.642481 24441 ts_tablet_manager.cc:1434] T c4607544e6a241349a1a35df8aaca446 P ba007af05f0f4fb3aa79a70a4ed62188: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:10:01.642966 24440 tablet_bootstrap.cc:492] T a2b8f465407049c093b74b89e0cc8fc3 P f39804e3bc0e439286a172ab4c75e032: Bootstrap starting.
I20260709 13:10:01.643378 24441 tablet_bootstrap.cc:492] T a2b8f465407049c093b74b89e0cc8fc3 P ba007af05f0f4fb3aa79a70a4ed62188: Bootstrap starting.
I20260709 13:10:01.649120 24442 ts_tablet_manager.cc:1434] T fdb7ba4cacaf498d83b351d63a57aa7b P 89434398bef1483abb7170861c595c08: Time spent starting tablet: real 0.044s	user 0.012s	sys 0.030s
I20260709 13:10:01.650259 24442 tablet_bootstrap.cc:492] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P 89434398bef1483abb7170861c595c08: Bootstrap starting.
I20260709 13:10:01.654008 24273 heartbeater.cc:499] Master 127.23.140.126:32965 was elected leader, sending a full tablet report...
I20260709 13:10:01.656543 24440 tablet_bootstrap.cc:654] T a2b8f465407049c093b74b89e0cc8fc3 P f39804e3bc0e439286a172ab4c75e032: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:01.657217 24442 tablet_bootstrap.cc:654] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P 89434398bef1483abb7170861c595c08: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:01.658093 24274 tablet.cc:2406] T fdb7ba4cacaf498d83b351d63a57aa7b P 89434398bef1483abb7170861c595c08: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:10:01.670235 24441 tablet_bootstrap.cc:654] T a2b8f465407049c093b74b89e0cc8fc3 P ba007af05f0f4fb3aa79a70a4ed62188: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:01.676812 24446 raft_consensus.cc:493] T c4607544e6a241349a1a35df8aaca446 P ba007af05f0f4fb3aa79a70a4ed62188 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.677415 24446 raft_consensus.cc:515] T c4607544e6a241349a1a35df8aaca446 P ba007af05f0f4fb3aa79a70a4ed62188 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:01.678097 24442 tablet_bootstrap.cc:492] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P 89434398bef1483abb7170861c595c08: No bootstrap required, opened a new log
I20260709 13:10:01.678581 24442 ts_tablet_manager.cc:1403] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P 89434398bef1483abb7170861c595c08: Time spent bootstrapping tablet: real 0.029s	user 0.007s	sys 0.015s
I20260709 13:10:01.682723 24446 leader_election.cc:290] T c4607544e6a241349a1a35df8aaca446 P ba007af05f0f4fb3aa79a70a4ed62188 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89434398bef1483abb7170861c595c08 (127.23.140.65:42583), f39804e3bc0e439286a172ab4c75e032 (127.23.140.66:37967)
I20260709 13:10:01.682474 24442 raft_consensus.cc:359] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P 89434398bef1483abb7170861c595c08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:01.683352 24442 raft_consensus.cc:385] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P 89434398bef1483abb7170861c595c08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:01.683701 24442 raft_consensus.cc:740] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P 89434398bef1483abb7170861c595c08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89434398bef1483abb7170861c595c08, State: Initialized, Role: FOLLOWER
I20260709 13:10:01.684576 24442 consensus_queue.cc:260] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P 89434398bef1483abb7170861c595c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:01.688230 24447 raft_consensus.cc:493] T fdb7ba4cacaf498d83b351d63a57aa7b P 89434398bef1483abb7170861c595c08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.688879 24447 raft_consensus.cc:515] T fdb7ba4cacaf498d83b351d63a57aa7b P 89434398bef1483abb7170861c595c08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } }
I20260709 13:10:01.691157 24440 tablet_bootstrap.cc:492] T a2b8f465407049c093b74b89e0cc8fc3 P f39804e3bc0e439286a172ab4c75e032: No bootstrap required, opened a new log
I20260709 13:10:01.691617 24440 ts_tablet_manager.cc:1403] T a2b8f465407049c093b74b89e0cc8fc3 P f39804e3bc0e439286a172ab4c75e032: Time spent bootstrapping tablet: real 0.049s	user 0.004s	sys 0.013s
I20260709 13:10:01.692369 24447 leader_election.cc:290] T fdb7ba4cacaf498d83b351d63a57aa7b P 89434398bef1483abb7170861c595c08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba007af05f0f4fb3aa79a70a4ed62188 (127.23.140.67:39155), f39804e3bc0e439286a172ab4c75e032 (127.23.140.66:37967)
I20260709 13:10:01.694801 24442 ts_tablet_manager.cc:1434] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P 89434398bef1483abb7170861c595c08: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.003s
I20260709 13:10:01.694679 24440 raft_consensus.cc:359] T a2b8f465407049c093b74b89e0cc8fc3 P f39804e3bc0e439286a172ab4c75e032 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:01.695719 24440 raft_consensus.cc:385] T a2b8f465407049c093b74b89e0cc8fc3 P f39804e3bc0e439286a172ab4c75e032 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:01.696100 24440 raft_consensus.cc:740] T a2b8f465407049c093b74b89e0cc8fc3 P f39804e3bc0e439286a172ab4c75e032 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f39804e3bc0e439286a172ab4c75e032, State: Initialized, Role: FOLLOWER
I20260709 13:10:01.697244 24440 consensus_queue.cc:260] T a2b8f465407049c093b74b89e0cc8fc3 P f39804e3bc0e439286a172ab4c75e032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:01.700532 24440 ts_tablet_manager.cc:1434] T a2b8f465407049c093b74b89e0cc8fc3 P f39804e3bc0e439286a172ab4c75e032: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 13:10:01.701539 24440 tablet_bootstrap.cc:492] T 072781c592984c6a9a6f3d8790809bd1 P f39804e3bc0e439286a172ab4c75e032: Bootstrap starting.
I20260709 13:10:01.696261 24442 tablet_bootstrap.cc:492] T c4607544e6a241349a1a35df8aaca446 P 89434398bef1483abb7170861c595c08: Bootstrap starting.
I20260709 13:10:01.711509 24440 tablet_bootstrap.cc:654] T 072781c592984c6a9a6f3d8790809bd1 P f39804e3bc0e439286a172ab4c75e032: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:01.716312 24442 tablet_bootstrap.cc:654] T c4607544e6a241349a1a35df8aaca446 P 89434398bef1483abb7170861c595c08: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:01.722332 24441 tablet_bootstrap.cc:492] T a2b8f465407049c093b74b89e0cc8fc3 P ba007af05f0f4fb3aa79a70a4ed62188: No bootstrap required, opened a new log
I20260709 13:10:01.722997 24441 ts_tablet_manager.cc:1403] T a2b8f465407049c093b74b89e0cc8fc3 P ba007af05f0f4fb3aa79a70a4ed62188: Time spent bootstrapping tablet: real 0.080s	user 0.015s	sys 0.003s
I20260709 13:10:01.726919 24441 raft_consensus.cc:359] T a2b8f465407049c093b74b89e0cc8fc3 P ba007af05f0f4fb3aa79a70a4ed62188 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:01.728104 24441 raft_consensus.cc:385] T a2b8f465407049c093b74b89e0cc8fc3 P ba007af05f0f4fb3aa79a70a4ed62188 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:01.728591 24441 raft_consensus.cc:740] T a2b8f465407049c093b74b89e0cc8fc3 P ba007af05f0f4fb3aa79a70a4ed62188 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba007af05f0f4fb3aa79a70a4ed62188, State: Initialized, Role: FOLLOWER
I20260709 13:10:01.729561 24441 consensus_queue.cc:260] T a2b8f465407049c093b74b89e0cc8fc3 P ba007af05f0f4fb3aa79a70a4ed62188 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:01.730772 24442 tablet_bootstrap.cc:492] T c4607544e6a241349a1a35df8aaca446 P 89434398bef1483abb7170861c595c08: No bootstrap required, opened a new log
I20260709 13:10:01.731335 24442 ts_tablet_manager.cc:1403] T c4607544e6a241349a1a35df8aaca446 P 89434398bef1483abb7170861c595c08: Time spent bootstrapping tablet: real 0.035s	user 0.007s	sys 0.012s
I20260709 13:10:01.732594 24441 ts_tablet_manager.cc:1434] T a2b8f465407049c093b74b89e0cc8fc3 P ba007af05f0f4fb3aa79a70a4ed62188: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:10:01.733891 24449 raft_consensus.cc:493] T c4607544e6a241349a1a35df8aaca446 P f39804e3bc0e439286a172ab4c75e032 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.734076 24441 tablet_bootstrap.cc:492] T 072781c592984c6a9a6f3d8790809bd1 P ba007af05f0f4fb3aa79a70a4ed62188: Bootstrap starting.
I20260709 13:10:01.734380 24449 raft_consensus.cc:515] T c4607544e6a241349a1a35df8aaca446 P f39804e3bc0e439286a172ab4c75e032 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:01.735034 24442 raft_consensus.cc:359] T c4607544e6a241349a1a35df8aaca446 P 89434398bef1483abb7170861c595c08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:01.735908 24442 raft_consensus.cc:385] T c4607544e6a241349a1a35df8aaca446 P 89434398bef1483abb7170861c595c08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:01.736244 24442 raft_consensus.cc:740] T c4607544e6a241349a1a35df8aaca446 P 89434398bef1483abb7170861c595c08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89434398bef1483abb7170861c595c08, State: Initialized, Role: FOLLOWER
I20260709 13:10:01.736984 24449 leader_election.cc:290] T c4607544e6a241349a1a35df8aaca446 P f39804e3bc0e439286a172ab4c75e032 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89434398bef1483abb7170861c595c08 (127.23.140.65:42583), ba007af05f0f4fb3aa79a70a4ed62188 (127.23.140.67:39155)
I20260709 13:10:01.746625 24441 tablet_bootstrap.cc:654] T 072781c592984c6a9a6f3d8790809bd1 P ba007af05f0f4fb3aa79a70a4ed62188: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:01.754134 24442 consensus_queue.cc:260] T c4607544e6a241349a1a35df8aaca446 P 89434398bef1483abb7170861c595c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:01.759104 24442 ts_tablet_manager.cc:1434] T c4607544e6a241349a1a35df8aaca446 P 89434398bef1483abb7170861c595c08: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.002s
I20260709 13:10:01.760151 24442 tablet_bootstrap.cc:492] T a2b8f465407049c093b74b89e0cc8fc3 P 89434398bef1483abb7170861c595c08: Bootstrap starting.
I20260709 13:10:01.799458 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb7ba4cacaf498d83b351d63a57aa7b" candidate_uuid: "89434398bef1483abb7170861c595c08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f39804e3bc0e439286a172ab4c75e032" is_pre_election: true
I20260709 13:10:01.808117 24442 tablet_bootstrap.cc:654] T a2b8f465407049c093b74b89e0cc8fc3 P 89434398bef1483abb7170861c595c08: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:01.810627 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4607544e6a241349a1a35df8aaca446" candidate_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f39804e3bc0e439286a172ab4c75e032" is_pre_election: true
I20260709 13:10:01.811408 24322 raft_consensus.cc:2468] T c4607544e6a241349a1a35df8aaca446 P f39804e3bc0e439286a172ab4c75e032 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba007af05f0f4fb3aa79a70a4ed62188 in term 0.
W20260709 13:10:01.815016 24214 leader_election.cc:343] T fdb7ba4cacaf498d83b351d63a57aa7b P 89434398bef1483abb7170861c595c08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f39804e3bc0e439286a172ab4c75e032 (127.23.140.66:37967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:01.815152 24363 leader_election.cc:304] T c4607544e6a241349a1a35df8aaca446 P ba007af05f0f4fb3aa79a70a4ed62188 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba007af05f0f4fb3aa79a70a4ed62188, f39804e3bc0e439286a172ab4c75e032; no voters: 
I20260709 13:10:01.817461 24446 raft_consensus.cc:2804] T c4607544e6a241349a1a35df8aaca446 P ba007af05f0f4fb3aa79a70a4ed62188 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:01.817848 24446 raft_consensus.cc:493] T c4607544e6a241349a1a35df8aaca446 P ba007af05f0f4fb3aa79a70a4ed62188 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:01.818182 24446 raft_consensus.cc:3060] T c4607544e6a241349a1a35df8aaca446 P ba007af05f0f4fb3aa79a70a4ed62188 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:01.830426 24440 tablet_bootstrap.cc:492] T 072781c592984c6a9a6f3d8790809bd1 P f39804e3bc0e439286a172ab4c75e032: No bootstrap required, opened a new log
I20260709 13:10:01.831173 24441 tablet_bootstrap.cc:492] T 072781c592984c6a9a6f3d8790809bd1 P ba007af05f0f4fb3aa79a70a4ed62188: No bootstrap required, opened a new log
I20260709 13:10:01.832796 24440 ts_tablet_manager.cc:1403] T 072781c592984c6a9a6f3d8790809bd1 P f39804e3bc0e439286a172ab4c75e032: Time spent bootstrapping tablet: real 0.131s	user 0.029s	sys 0.032s
I20260709 13:10:01.834569 24467 raft_consensus.cc:493] T a2b8f465407049c093b74b89e0cc8fc3 P ba007af05f0f4fb3aa79a70a4ed62188 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.835852 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4607544e6a241349a1a35df8aaca446" candidate_uuid: "f39804e3bc0e439286a172ab4c75e032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" is_pre_election: true
I20260709 13:10:01.835606 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4607544e6a241349a1a35df8aaca446" candidate_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89434398bef1483abb7170861c595c08" is_pre_election: true
I20260709 13:10:01.835548 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb7ba4cacaf498d83b351d63a57aa7b" candidate_uuid: "89434398bef1483abb7170861c595c08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" is_pre_election: true
I20260709 13:10:01.836799 24248 raft_consensus.cc:2468] T c4607544e6a241349a1a35df8aaca446 P 89434398bef1483abb7170861c595c08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba007af05f0f4fb3aa79a70a4ed62188 in term 0.
I20260709 13:10:01.839409 24441 ts_tablet_manager.cc:1403] T 072781c592984c6a9a6f3d8790809bd1 P ba007af05f0f4fb3aa79a70a4ed62188: Time spent bootstrapping tablet: real 0.103s	user 0.035s	sys 0.021s
I20260709 13:10:01.838817 24440 raft_consensus.cc:359] T 072781c592984c6a9a6f3d8790809bd1 P f39804e3bc0e439286a172ab4c75e032 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:01.840121 24397 raft_consensus.cc:2468] T fdb7ba4cacaf498d83b351d63a57aa7b P ba007af05f0f4fb3aa79a70a4ed62188 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89434398bef1483abb7170861c595c08 in term 0.
I20260709 13:10:01.836339 24467 raft_consensus.cc:515] T a2b8f465407049c093b74b89e0cc8fc3 P ba007af05f0f4fb3aa79a70a4ed62188 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:01.840667 24446 raft_consensus.cc:515] T c4607544e6a241349a1a35df8aaca446 P ba007af05f0f4fb3aa79a70a4ed62188 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:01.843438 24440 raft_consensus.cc:385] T 072781c592984c6a9a6f3d8790809bd1 P f39804e3bc0e439286a172ab4c75e032 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:01.845069 24396 raft_consensus.cc:2393] T c4607544e6a241349a1a35df8aaca446 P ba007af05f0f4fb3aa79a70a4ed62188 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f39804e3bc0e439286a172ab4c75e032 in current term 1: Already voted for candidate ba007af05f0f4fb3aa79a70a4ed62188 in this term.
I20260709 13:10:01.844487 24440 raft_consensus.cc:740] T 072781c592984c6a9a6f3d8790809bd1 P f39804e3bc0e439286a172ab4c75e032 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f39804e3bc0e439286a172ab4c75e032, State: Initialized, Role: FOLLOWER
I20260709 13:10:01.847641 24213 leader_election.cc:304] T fdb7ba4cacaf498d83b351d63a57aa7b P 89434398bef1483abb7170861c595c08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89434398bef1483abb7170861c595c08, ba007af05f0f4fb3aa79a70a4ed62188; no voters: f39804e3bc0e439286a172ab4c75e032
I20260709 13:10:01.848723 24442 tablet_bootstrap.cc:492] T a2b8f465407049c093b74b89e0cc8fc3 P 89434398bef1483abb7170861c595c08: No bootstrap required, opened a new log
I20260709 13:10:01.849534 24447 raft_consensus.cc:2804] T fdb7ba4cacaf498d83b351d63a57aa7b P 89434398bef1483abb7170861c595c08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:01.849781 24442 ts_tablet_manager.cc:1403] T a2b8f465407049c093b74b89e0cc8fc3 P 89434398bef1483abb7170861c595c08: Time spent bootstrapping tablet: real 0.090s	user 0.007s	sys 0.008s
I20260709 13:10:01.849926 24447 raft_consensus.cc:493] T fdb7ba4cacaf498d83b351d63a57aa7b P 89434398bef1483abb7170861c595c08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:01.850294 24447 raft_consensus.cc:3060] T fdb7ba4cacaf498d83b351d63a57aa7b P 89434398bef1483abb7170861c595c08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:01.853888 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4607544e6a241349a1a35df8aaca446" candidate_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89434398bef1483abb7170861c595c08"
I20260709 13:10:01.854249 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4607544e6a241349a1a35df8aaca446" candidate_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f39804e3bc0e439286a172ab4c75e032"
I20260709 13:10:01.854569 24248 raft_consensus.cc:3060] T c4607544e6a241349a1a35df8aaca446 P 89434398bef1483abb7170861c595c08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:01.854851 24322 raft_consensus.cc:3060] T c4607544e6a241349a1a35df8aaca446 P f39804e3bc0e439286a172ab4c75e032 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:01.849236 24440 consensus_queue.cc:260] T 072781c592984c6a9a6f3d8790809bd1 P f39804e3bc0e439286a172ab4c75e032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:01.853425 24446 leader_election.cc:290] T c4607544e6a241349a1a35df8aaca446 P ba007af05f0f4fb3aa79a70a4ed62188 [CANDIDATE]: Term 1 election: Requested vote from peers 89434398bef1483abb7170861c595c08 (127.23.140.65:42583), f39804e3bc0e439286a172ab4c75e032 (127.23.140.66:37967)
I20260709 13:10:01.856235 24442 raft_consensus.cc:359] T a2b8f465407049c093b74b89e0cc8fc3 P 89434398bef1483abb7170861c595c08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:01.858373 24442 raft_consensus.cc:385] T a2b8f465407049c093b74b89e0cc8fc3 P 89434398bef1483abb7170861c595c08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:01.858660 24442 raft_consensus.cc:740] T a2b8f465407049c093b74b89e0cc8fc3 P 89434398bef1483abb7170861c595c08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89434398bef1483abb7170861c595c08, State: Initialized, Role: FOLLOWER
I20260709 13:10:01.861191 24440 ts_tablet_manager.cc:1434] T 072781c592984c6a9a6f3d8790809bd1 P f39804e3bc0e439286a172ab4c75e032: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.002s
I20260709 13:10:01.860351 24442 consensus_queue.cc:260] T a2b8f465407049c093b74b89e0cc8fc3 P 89434398bef1483abb7170861c595c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:01.863473 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8f465407049c093b74b89e0cc8fc3" candidate_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89434398bef1483abb7170861c595c08" is_pre_election: true
I20260709 13:10:01.871876 24441 raft_consensus.cc:359] T 072781c592984c6a9a6f3d8790809bd1 P ba007af05f0f4fb3aa79a70a4ed62188 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:01.870507 24247 raft_consensus.cc:2468] T a2b8f465407049c093b74b89e0cc8fc3 P 89434398bef1483abb7170861c595c08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba007af05f0f4fb3aa79a70a4ed62188 in term 0.
I20260709 13:10:01.872784 24441 raft_consensus.cc:385] T 072781c592984c6a9a6f3d8790809bd1 P ba007af05f0f4fb3aa79a70a4ed62188 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:01.876233 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4607544e6a241349a1a35df8aaca446" candidate_uuid: "f39804e3bc0e439286a172ab4c75e032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89434398bef1483abb7170861c595c08" is_pre_election: true
I20260709 13:10:01.873144 24441 raft_consensus.cc:740] T 072781c592984c6a9a6f3d8790809bd1 P ba007af05f0f4fb3aa79a70a4ed62188 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba007af05f0f4fb3aa79a70a4ed62188, State: Initialized, Role: FOLLOWER
I20260709 13:10:01.878175 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8f465407049c093b74b89e0cc8fc3" candidate_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f39804e3bc0e439286a172ab4c75e032" is_pre_election: true
I20260709 13:10:01.869395 24467 leader_election.cc:290] T a2b8f465407049c093b74b89e0cc8fc3 P ba007af05f0f4fb3aa79a70a4ed62188 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89434398bef1483abb7170861c595c08 (127.23.140.65:42583), f39804e3bc0e439286a172ab4c75e032 (127.23.140.66:37967)
I20260709 13:10:01.872852 24447 raft_consensus.cc:515] T fdb7ba4cacaf498d83b351d63a57aa7b P 89434398bef1483abb7170861c595c08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } }
I20260709 13:10:01.878858 24323 raft_consensus.cc:2468] T a2b8f465407049c093b74b89e0cc8fc3 P f39804e3bc0e439286a172ab4c75e032 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba007af05f0f4fb3aa79a70a4ed62188 in term 0.
I20260709 13:10:01.879648 24440 tablet_bootstrap.cc:492] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P f39804e3bc0e439286a172ab4c75e032: Bootstrap starting.
I20260709 13:10:01.882761 24360 leader_election.cc:304] T a2b8f465407049c093b74b89e0cc8fc3 P ba007af05f0f4fb3aa79a70a4ed62188 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89434398bef1483abb7170861c595c08, ba007af05f0f4fb3aa79a70a4ed62188; no voters: 
I20260709 13:10:01.878482 24441 consensus_queue.cc:260] T 072781c592984c6a9a6f3d8790809bd1 P ba007af05f0f4fb3aa79a70a4ed62188 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:01.884130 24322 raft_consensus.cc:2468] T c4607544e6a241349a1a35df8aaca446 P f39804e3bc0e439286a172ab4c75e032 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba007af05f0f4fb3aa79a70a4ed62188 in term 1.
I20260709 13:10:01.885607 24441 ts_tablet_manager.cc:1434] T 072781c592984c6a9a6f3d8790809bd1 P ba007af05f0f4fb3aa79a70a4ed62188: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.001s
I20260709 13:10:01.886323 24446 raft_consensus.cc:2804] T a2b8f465407049c093b74b89e0cc8fc3 P ba007af05f0f4fb3aa79a70a4ed62188 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:01.886662 24446 raft_consensus.cc:493] T a2b8f465407049c093b74b89e0cc8fc3 P ba007af05f0f4fb3aa79a70a4ed62188 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:01.883285 24468 raft_consensus.cc:493] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P 89434398bef1483abb7170861c595c08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.887073 24441 tablet_bootstrap.cc:492] T d3529531034c4da8ace2a1b8bcc7c934 P ba007af05f0f4fb3aa79a70a4ed62188: Bootstrap starting.
I20260709 13:10:01.887004 24446 raft_consensus.cc:3060] T a2b8f465407049c093b74b89e0cc8fc3 P ba007af05f0f4fb3aa79a70a4ed62188 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:01.888449 24248 raft_consensus.cc:2468] T c4607544e6a241349a1a35df8aaca446 P 89434398bef1483abb7170861c595c08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba007af05f0f4fb3aa79a70a4ed62188 in term 1.
I20260709 13:10:01.890038 24360 leader_election.cc:304] T c4607544e6a241349a1a35df8aaca446 P ba007af05f0f4fb3aa79a70a4ed62188 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89434398bef1483abb7170861c595c08, ba007af05f0f4fb3aa79a70a4ed62188; no voters: 
I20260709 13:10:01.887240 24468 raft_consensus.cc:515] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P 89434398bef1483abb7170861c595c08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:01.891759 24467 raft_consensus.cc:2804] T c4607544e6a241349a1a35df8aaca446 P ba007af05f0f4fb3aa79a70a4ed62188 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:01.892838 24447 leader_election.cc:290] T fdb7ba4cacaf498d83b351d63a57aa7b P 89434398bef1483abb7170861c595c08 [CANDIDATE]: Term 1 election: Requested vote from peers ba007af05f0f4fb3aa79a70a4ed62188 (127.23.140.67:39155), f39804e3bc0e439286a172ab4c75e032 (127.23.140.66:37967)
I20260709 13:10:01.895143 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb7ba4cacaf498d83b351d63a57aa7b" candidate_uuid: "89434398bef1483abb7170861c595c08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f39804e3bc0e439286a172ab4c75e032"
I20260709 13:10:01.893433 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb7ba4cacaf498d83b351d63a57aa7b" candidate_uuid: "89434398bef1483abb7170861c595c08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba007af05f0f4fb3aa79a70a4ed62188"
I20260709 13:10:01.901618 24446 raft_consensus.cc:515] T a2b8f465407049c093b74b89e0cc8fc3 P ba007af05f0f4fb3aa79a70a4ed62188 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:01.902446 24397 raft_consensus.cc:3060] T fdb7ba4cacaf498d83b351d63a57aa7b P ba007af05f0f4fb3aa79a70a4ed62188 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:01.900949 24214 leader_election.cc:343] T fdb7ba4cacaf498d83b351d63a57aa7b P 89434398bef1483abb7170861c595c08 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f39804e3bc0e439286a172ab4c75e032 (127.23.140.66:37967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:01.908108 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8f465407049c093b74b89e0cc8fc3" candidate_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89434398bef1483abb7170861c595c08"
I20260709 13:10:01.908561 24446 leader_election.cc:290] T a2b8f465407049c093b74b89e0cc8fc3 P ba007af05f0f4fb3aa79a70a4ed62188 [CANDIDATE]: Term 1 election: Requested vote from peers 89434398bef1483abb7170861c595c08 (127.23.140.65:42583), f39804e3bc0e439286a172ab4c75e032 (127.23.140.66:37967)
I20260709 13:10:01.908928 24248 raft_consensus.cc:3060] T a2b8f465407049c093b74b89e0cc8fc3 P 89434398bef1483abb7170861c595c08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:01.913960 24440 tablet_bootstrap.cc:654] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P f39804e3bc0e439286a172ab4c75e032: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:01.919148 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eb056e46f2d4ddbb45fdb665a6b3eaa" candidate_uuid: "89434398bef1483abb7170861c595c08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f39804e3bc0e439286a172ab4c75e032" is_pre_election: true
I20260709 13:10:01.919824 24468 leader_election.cc:290] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P 89434398bef1483abb7170861c595c08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f39804e3bc0e439286a172ab4c75e032 (127.23.140.66:37967), ba007af05f0f4fb3aa79a70a4ed62188 (127.23.140.67:39155)
I20260709 13:10:01.921054 24395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eb056e46f2d4ddbb45fdb665a6b3eaa" candidate_uuid: "89434398bef1483abb7170861c595c08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" is_pre_election: true
W20260709 13:10:01.921864 24214 leader_election.cc:343] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P 89434398bef1483abb7170861c595c08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f39804e3bc0e439286a172ab4c75e032 (127.23.140.66:37967): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:01.924507 24213 leader_election.cc:343] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P 89434398bef1483abb7170861c595c08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba007af05f0f4fb3aa79a70a4ed62188 (127.23.140.67:39155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:01.925089 24213 leader_election.cc:304] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P 89434398bef1483abb7170861c595c08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89434398bef1483abb7170861c595c08; no voters: ba007af05f0f4fb3aa79a70a4ed62188, f39804e3bc0e439286a172ab4c75e032
I20260709 13:10:01.926055 24468 raft_consensus.cc:2749] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P 89434398bef1483abb7170861c595c08 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:01.926046 24467 raft_consensus.cc:697] T c4607544e6a241349a1a35df8aaca446 P ba007af05f0f4fb3aa79a70a4ed62188 [term 1 LEADER]: Becoming Leader. State: Replica: ba007af05f0f4fb3aa79a70a4ed62188, State: Running, Role: LEADER
I20260709 13:10:01.927711 24248 raft_consensus.cc:2468] T a2b8f465407049c093b74b89e0cc8fc3 P 89434398bef1483abb7170861c595c08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba007af05f0f4fb3aa79a70a4ed62188 in term 1.
I20260709 13:10:01.928583 24441 tablet_bootstrap.cc:654] T d3529531034c4da8ace2a1b8bcc7c934 P ba007af05f0f4fb3aa79a70a4ed62188: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:01.928203 24467 consensus_queue.cc:237] T c4607544e6a241349a1a35df8aaca446 P ba007af05f0f4fb3aa79a70a4ed62188 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:01.930733 24360 leader_election.cc:304] T a2b8f465407049c093b74b89e0cc8fc3 P ba007af05f0f4fb3aa79a70a4ed62188 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89434398bef1483abb7170861c595c08, ba007af05f0f4fb3aa79a70a4ed62188; no voters: 
I20260709 13:10:01.931522 24397 raft_consensus.cc:2468] T fdb7ba4cacaf498d83b351d63a57aa7b P ba007af05f0f4fb3aa79a70a4ed62188 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89434398bef1483abb7170861c595c08 in term 1.
I20260709 13:10:01.934237 24469 raft_consensus.cc:2804] T a2b8f465407049c093b74b89e0cc8fc3 P ba007af05f0f4fb3aa79a70a4ed62188 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:01.934070 24213 leader_election.cc:304] T fdb7ba4cacaf498d83b351d63a57aa7b P 89434398bef1483abb7170861c595c08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89434398bef1483abb7170861c595c08, ba007af05f0f4fb3aa79a70a4ed62188; no voters: f39804e3bc0e439286a172ab4c75e032
I20260709 13:10:01.935081 24469 raft_consensus.cc:697] T a2b8f465407049c093b74b89e0cc8fc3 P ba007af05f0f4fb3aa79a70a4ed62188 [term 1 LEADER]: Becoming Leader. State: Replica: ba007af05f0f4fb3aa79a70a4ed62188, State: Running, Role: LEADER
I20260709 13:10:01.938386 24442 ts_tablet_manager.cc:1434] T a2b8f465407049c093b74b89e0cc8fc3 P 89434398bef1483abb7170861c595c08: Time spent starting tablet: real 0.088s	user 0.011s	sys 0.006s
I20260709 13:10:01.936721 24469 consensus_queue.cc:237] T a2b8f465407049c093b74b89e0cc8fc3 P ba007af05f0f4fb3aa79a70a4ed62188 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:01.939126 24470 raft_consensus.cc:2804] T fdb7ba4cacaf498d83b351d63a57aa7b P 89434398bef1483abb7170861c595c08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:01.941959 24442 tablet_bootstrap.cc:492] T 57caa52201cc4aaba1de74ac8393a6a6 P 89434398bef1483abb7170861c595c08: Bootstrap starting.
I20260709 13:10:01.942934 24470 raft_consensus.cc:697] T fdb7ba4cacaf498d83b351d63a57aa7b P 89434398bef1483abb7170861c595c08 [term 1 LEADER]: Becoming Leader. State: Replica: 89434398bef1483abb7170861c595c08, State: Running, Role: LEADER
I20260709 13:10:01.943909 24470 consensus_queue.cc:237] T fdb7ba4cacaf498d83b351d63a57aa7b P 89434398bef1483abb7170861c595c08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } }
I20260709 13:10:01.965365 24440 tablet_bootstrap.cc:492] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P f39804e3bc0e439286a172ab4c75e032: No bootstrap required, opened a new log
I20260709 13:10:01.966431 24440 ts_tablet_manager.cc:1403] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P f39804e3bc0e439286a172ab4c75e032: Time spent bootstrapping tablet: real 0.092s	user 0.012s	sys 0.010s
I20260709 13:10:01.968294 24441 tablet_bootstrap.cc:492] T d3529531034c4da8ace2a1b8bcc7c934 P ba007af05f0f4fb3aa79a70a4ed62188: No bootstrap required, opened a new log
I20260709 13:10:01.970193 24441 ts_tablet_manager.cc:1403] T d3529531034c4da8ace2a1b8bcc7c934 P ba007af05f0f4fb3aa79a70a4ed62188: Time spent bootstrapping tablet: real 0.083s	user 0.016s	sys 0.003s
I20260709 13:10:01.978018 24442 tablet_bootstrap.cc:654] T 57caa52201cc4aaba1de74ac8393a6a6 P 89434398bef1483abb7170861c595c08: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:01.978258 24440 raft_consensus.cc:359] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P f39804e3bc0e439286a172ab4c75e032 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:01.978425 24441 raft_consensus.cc:359] T d3529531034c4da8ace2a1b8bcc7c934 P ba007af05f0f4fb3aa79a70a4ed62188 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:01.988793 24441 raft_consensus.cc:385] T d3529531034c4da8ace2a1b8bcc7c934 P ba007af05f0f4fb3aa79a70a4ed62188 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:01.989300 24441 raft_consensus.cc:740] T d3529531034c4da8ace2a1b8bcc7c934 P ba007af05f0f4fb3aa79a70a4ed62188 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba007af05f0f4fb3aa79a70a4ed62188, State: Initialized, Role: FOLLOWER
I20260709 13:10:01.990329 24441 consensus_queue.cc:260] T d3529531034c4da8ace2a1b8bcc7c934 P ba007af05f0f4fb3aa79a70a4ed62188 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
W20260709 13:10:01.982127 24363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:37967, user_credentials={real_user=slave}} blocked reactor thread for 98845.8us
I20260709 13:10:01.994125 24441 ts_tablet_manager.cc:1434] T d3529531034c4da8ace2a1b8bcc7c934 P ba007af05f0f4fb3aa79a70a4ed62188: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.004s
I20260709 13:10:01.994663 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8f465407049c093b74b89e0cc8fc3" candidate_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f39804e3bc0e439286a172ab4c75e032"
I20260709 13:10:01.995260 24322 raft_consensus.cc:3060] T a2b8f465407049c093b74b89e0cc8fc3 P f39804e3bc0e439286a172ab4c75e032 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:01.995543 24441 tablet_bootstrap.cc:492] T a14d80b5fd8747d3b44afc1fc32ecffa P ba007af05f0f4fb3aa79a70a4ed62188: Bootstrap starting.
I20260709 13:10:01.997069 24440 raft_consensus.cc:385] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P f39804e3bc0e439286a172ab4c75e032 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:01.997586 24440 raft_consensus.cc:740] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P f39804e3bc0e439286a172ab4c75e032 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f39804e3bc0e439286a172ab4c75e032, State: Initialized, Role: FOLLOWER
I20260709 13:10:01.983292 24288 leader_election.cc:304] T c4607544e6a241349a1a35df8aaca446 P f39804e3bc0e439286a172ab4c75e032 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f39804e3bc0e439286a172ab4c75e032; no voters: 89434398bef1483abb7170861c595c08, ba007af05f0f4fb3aa79a70a4ed62188
I20260709 13:10:01.998914 24449 raft_consensus.cc:2749] T c4607544e6a241349a1a35df8aaca446 P f39804e3bc0e439286a172ab4c75e032 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:01.998623 24440 consensus_queue.cc:260] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P f39804e3bc0e439286a172ab4c75e032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:02.001936 24440 ts_tablet_manager.cc:1434] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P f39804e3bc0e439286a172ab4c75e032: Time spent starting tablet: real 0.034s	user 0.009s	sys 0.000s
I20260709 13:10:02.008330 24143 catalog_manager.cc:5697] T fdb7ba4cacaf498d83b351d63a57aa7b P 89434398bef1483abb7170861c595c08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89434398bef1483abb7170861c595c08 (127.23.140.65). New cstate: current_term: 1 leader_uuid: "89434398bef1483abb7170861c595c08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:02.010757 24440 tablet_bootstrap.cc:492] T 2824545a6ec14281b292a9a80984e5d7 P f39804e3bc0e439286a172ab4c75e032: Bootstrap starting.
I20260709 13:10:02.019603 24449 raft_consensus.cc:493] T 072781c592984c6a9a6f3d8790809bd1 P f39804e3bc0e439286a172ab4c75e032 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.020103 24449 raft_consensus.cc:515] T 072781c592984c6a9a6f3d8790809bd1 P f39804e3bc0e439286a172ab4c75e032 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:02.021718 24322 raft_consensus.cc:2468] T a2b8f465407049c093b74b89e0cc8fc3 P f39804e3bc0e439286a172ab4c75e032 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba007af05f0f4fb3aa79a70a4ed62188 in term 1.
I20260709 13:10:02.022286 24449 leader_election.cc:290] T 072781c592984c6a9a6f3d8790809bd1 P f39804e3bc0e439286a172ab4c75e032 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89434398bef1483abb7170861c595c08 (127.23.140.65:42583), ba007af05f0f4fb3aa79a70a4ed62188 (127.23.140.67:39155)
I20260709 13:10:02.023546 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "072781c592984c6a9a6f3d8790809bd1" candidate_uuid: "f39804e3bc0e439286a172ab4c75e032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89434398bef1483abb7170861c595c08" is_pre_election: true
W20260709 13:10:02.025123 24286 leader_election.cc:343] T 072781c592984c6a9a6f3d8790809bd1 P f39804e3bc0e439286a172ab4c75e032 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89434398bef1483abb7170861c595c08 (127.23.140.65:42583): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:02.026789 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "072781c592984c6a9a6f3d8790809bd1" candidate_uuid: "f39804e3bc0e439286a172ab4c75e032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" is_pre_election: true
I20260709 13:10:02.027395 24396 raft_consensus.cc:2468] T 072781c592984c6a9a6f3d8790809bd1 P ba007af05f0f4fb3aa79a70a4ed62188 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f39804e3bc0e439286a172ab4c75e032 in term 0.
I20260709 13:10:02.028609 24288 leader_election.cc:304] T 072781c592984c6a9a6f3d8790809bd1 P f39804e3bc0e439286a172ab4c75e032 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ba007af05f0f4fb3aa79a70a4ed62188, f39804e3bc0e439286a172ab4c75e032; no voters: 89434398bef1483abb7170861c595c08
I20260709 13:10:02.013020 24441 tablet_bootstrap.cc:654] T a14d80b5fd8747d3b44afc1fc32ecffa P ba007af05f0f4fb3aa79a70a4ed62188: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.013895 24442 tablet_bootstrap.cc:492] T 57caa52201cc4aaba1de74ac8393a6a6 P 89434398bef1483abb7170861c595c08: No bootstrap required, opened a new log
I20260709 13:10:02.030325 24442 ts_tablet_manager.cc:1403] T 57caa52201cc4aaba1de74ac8393a6a6 P 89434398bef1483abb7170861c595c08: Time spent bootstrapping tablet: real 0.089s	user 0.016s	sys 0.025s
I20260709 13:10:02.029475 24449 raft_consensus.cc:2804] T 072781c592984c6a9a6f3d8790809bd1 P f39804e3bc0e439286a172ab4c75e032 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:02.034016 24449 raft_consensus.cc:493] T 072781c592984c6a9a6f3d8790809bd1 P f39804e3bc0e439286a172ab4c75e032 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:02.034494 24449 raft_consensus.cc:3060] T 072781c592984c6a9a6f3d8790809bd1 P f39804e3bc0e439286a172ab4c75e032 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.038228 24442 raft_consensus.cc:359] T 57caa52201cc4aaba1de74ac8393a6a6 P 89434398bef1483abb7170861c595c08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:02.039222 24442 raft_consensus.cc:385] T 57caa52201cc4aaba1de74ac8393a6a6 P 89434398bef1483abb7170861c595c08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.039593 24442 raft_consensus.cc:740] T 57caa52201cc4aaba1de74ac8393a6a6 P 89434398bef1483abb7170861c595c08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89434398bef1483abb7170861c595c08, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.040560 24442 consensus_queue.cc:260] T 57caa52201cc4aaba1de74ac8393a6a6 P 89434398bef1483abb7170861c595c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:02.045315 24442 ts_tablet_manager.cc:1434] T 57caa52201cc4aaba1de74ac8393a6a6 P 89434398bef1483abb7170861c595c08: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:10:02.046577 24442 tablet_bootstrap.cc:492] T 2824545a6ec14281b292a9a80984e5d7 P 89434398bef1483abb7170861c595c08: Bootstrap starting.
I20260709 13:10:02.052557 24449 raft_consensus.cc:515] T 072781c592984c6a9a6f3d8790809bd1 P f39804e3bc0e439286a172ab4c75e032 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:02.056392 24442 tablet_bootstrap.cc:654] T 2824545a6ec14281b292a9a80984e5d7 P 89434398bef1483abb7170861c595c08: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.056712 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "072781c592984c6a9a6f3d8790809bd1" candidate_uuid: "f39804e3bc0e439286a172ab4c75e032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89434398bef1483abb7170861c595c08"
I20260709 13:10:02.054414 24440 tablet_bootstrap.cc:654] T 2824545a6ec14281b292a9a80984e5d7 P f39804e3bc0e439286a172ab4c75e032: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:02.058048 24286 leader_election.cc:343] T 072781c592984c6a9a6f3d8790809bd1 P f39804e3bc0e439286a172ab4c75e032 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89434398bef1483abb7170861c595c08 (127.23.140.65:42583): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:02.062139 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "072781c592984c6a9a6f3d8790809bd1" candidate_uuid: "f39804e3bc0e439286a172ab4c75e032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba007af05f0f4fb3aa79a70a4ed62188"
I20260709 13:10:02.062677 24396 raft_consensus.cc:3060] T 072781c592984c6a9a6f3d8790809bd1 P ba007af05f0f4fb3aa79a70a4ed62188 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.063576 24441 tablet_bootstrap.cc:492] T a14d80b5fd8747d3b44afc1fc32ecffa P ba007af05f0f4fb3aa79a70a4ed62188: No bootstrap required, opened a new log
I20260709 13:10:02.064071 24441 ts_tablet_manager.cc:1403] T a14d80b5fd8747d3b44afc1fc32ecffa P ba007af05f0f4fb3aa79a70a4ed62188: Time spent bootstrapping tablet: real 0.069s	user 0.010s	sys 0.003s
I20260709 13:10:02.067843 24441 raft_consensus.cc:359] T a14d80b5fd8747d3b44afc1fc32ecffa P ba007af05f0f4fb3aa79a70a4ed62188 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:02.068728 24441 raft_consensus.cc:385] T a14d80b5fd8747d3b44afc1fc32ecffa P ba007af05f0f4fb3aa79a70a4ed62188 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.069078 24441 raft_consensus.cc:740] T a14d80b5fd8747d3b44afc1fc32ecffa P ba007af05f0f4fb3aa79a70a4ed62188 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba007af05f0f4fb3aa79a70a4ed62188, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.070066 24396 raft_consensus.cc:2468] T 072781c592984c6a9a6f3d8790809bd1 P ba007af05f0f4fb3aa79a70a4ed62188 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f39804e3bc0e439286a172ab4c75e032 in term 1.
I20260709 13:10:02.071437 24288 leader_election.cc:304] T 072781c592984c6a9a6f3d8790809bd1 P f39804e3bc0e439286a172ab4c75e032 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ba007af05f0f4fb3aa79a70a4ed62188, f39804e3bc0e439286a172ab4c75e032; no voters: 89434398bef1483abb7170861c595c08
I20260709 13:10:02.072600 24442 tablet_bootstrap.cc:492] T 2824545a6ec14281b292a9a80984e5d7 P 89434398bef1483abb7170861c595c08: No bootstrap required, opened a new log
I20260709 13:10:02.073181 24442 ts_tablet_manager.cc:1403] T 2824545a6ec14281b292a9a80984e5d7 P 89434398bef1483abb7170861c595c08: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.000s
I20260709 13:10:02.074550 24449 leader_election.cc:290] T 072781c592984c6a9a6f3d8790809bd1 P f39804e3bc0e439286a172ab4c75e032 [CANDIDATE]: Term 1 election: Requested vote from peers 89434398bef1483abb7170861c595c08 (127.23.140.65:42583), ba007af05f0f4fb3aa79a70a4ed62188 (127.23.140.67:39155)
I20260709 13:10:02.070358 24441 consensus_queue.cc:260] T a14d80b5fd8747d3b44afc1fc32ecffa P ba007af05f0f4fb3aa79a70a4ed62188 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:02.076929 24442 raft_consensus.cc:359] T 2824545a6ec14281b292a9a80984e5d7 P 89434398bef1483abb7170861c595c08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:02.077914 24441 ts_tablet_manager.cc:1434] T a14d80b5fd8747d3b44afc1fc32ecffa P ba007af05f0f4fb3aa79a70a4ed62188: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.001s
I20260709 13:10:02.078063 24442 raft_consensus.cc:385] T 2824545a6ec14281b292a9a80984e5d7 P 89434398bef1483abb7170861c595c08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.078483 24442 raft_consensus.cc:740] T 2824545a6ec14281b292a9a80984e5d7 P 89434398bef1483abb7170861c595c08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89434398bef1483abb7170861c595c08, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.075750 24481 raft_consensus.cc:2804] T 072781c592984c6a9a6f3d8790809bd1 P f39804e3bc0e439286a172ab4c75e032 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:02.078948 24441 tablet_bootstrap.cc:492] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P ba007af05f0f4fb3aa79a70a4ed62188: Bootstrap starting.
I20260709 13:10:02.079396 24481 raft_consensus.cc:697] T 072781c592984c6a9a6f3d8790809bd1 P f39804e3bc0e439286a172ab4c75e032 [term 1 LEADER]: Becoming Leader. State: Replica: f39804e3bc0e439286a172ab4c75e032, State: Running, Role: LEADER
I20260709 13:10:02.080296 24440 tablet_bootstrap.cc:492] T 2824545a6ec14281b292a9a80984e5d7 P f39804e3bc0e439286a172ab4c75e032: No bootstrap required, opened a new log
I20260709 13:10:02.082185 24440 ts_tablet_manager.cc:1403] T 2824545a6ec14281b292a9a80984e5d7 P f39804e3bc0e439286a172ab4c75e032: Time spent bootstrapping tablet: real 0.072s	user 0.007s	sys 0.007s
I20260709 13:10:02.079640 24442 consensus_queue.cc:260] T 2824545a6ec14281b292a9a80984e5d7 P 89434398bef1483abb7170861c595c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:02.082535 24481 consensus_queue.cc:237] T 072781c592984c6a9a6f3d8790809bd1 P f39804e3bc0e439286a172ab4c75e032 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:02.085009 24442 ts_tablet_manager.cc:1434] T 2824545a6ec14281b292a9a80984e5d7 P 89434398bef1483abb7170861c595c08: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.004s
I20260709 13:10:02.093297 24441 tablet_bootstrap.cc:654] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P ba007af05f0f4fb3aa79a70a4ed62188: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.093717 24442 tablet_bootstrap.cc:492] T d3529531034c4da8ace2a1b8bcc7c934 P 89434398bef1483abb7170861c595c08: Bootstrap starting.
I20260709 13:10:02.098233 24440 raft_consensus.cc:359] T 2824545a6ec14281b292a9a80984e5d7 P f39804e3bc0e439286a172ab4c75e032 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:02.098891 24440 raft_consensus.cc:385] T 2824545a6ec14281b292a9a80984e5d7 P f39804e3bc0e439286a172ab4c75e032 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.099129 24440 raft_consensus.cc:740] T 2824545a6ec14281b292a9a80984e5d7 P f39804e3bc0e439286a172ab4c75e032 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f39804e3bc0e439286a172ab4c75e032, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.099741 24440 consensus_queue.cc:260] T 2824545a6ec14281b292a9a80984e5d7 P f39804e3bc0e439286a172ab4c75e032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:02.101572 24440 ts_tablet_manager.cc:1434] T 2824545a6ec14281b292a9a80984e5d7 P f39804e3bc0e439286a172ab4c75e032: Time spent starting tablet: real 0.019s	user 0.000s	sys 0.003s
I20260709 13:10:02.109290 24440 tablet_bootstrap.cc:492] T fdb7ba4cacaf498d83b351d63a57aa7b P f39804e3bc0e439286a172ab4c75e032: Bootstrap starting.
I20260709 13:10:02.116400 24442 tablet_bootstrap.cc:654] T d3529531034c4da8ace2a1b8bcc7c934 P 89434398bef1483abb7170861c595c08: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.116683 24441 tablet_bootstrap.cc:492] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P ba007af05f0f4fb3aa79a70a4ed62188: No bootstrap required, opened a new log
I20260709 13:10:02.117157 24441 ts_tablet_manager.cc:1403] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P ba007af05f0f4fb3aa79a70a4ed62188: Time spent bootstrapping tablet: real 0.038s	user 0.007s	sys 0.003s
I20260709 13:10:02.120230 24441 raft_consensus.cc:359] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P ba007af05f0f4fb3aa79a70a4ed62188 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:02.120958 24441 raft_consensus.cc:385] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P ba007af05f0f4fb3aa79a70a4ed62188 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.121261 24441 raft_consensus.cc:740] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P ba007af05f0f4fb3aa79a70a4ed62188 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba007af05f0f4fb3aa79a70a4ed62188, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.122094 24441 consensus_queue.cc:260] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P ba007af05f0f4fb3aa79a70a4ed62188 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:02.124670 24441 ts_tablet_manager.cc:1434] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P ba007af05f0f4fb3aa79a70a4ed62188: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.008s
I20260709 13:10:02.125943 24441 tablet_bootstrap.cc:492] T 2824545a6ec14281b292a9a80984e5d7 P ba007af05f0f4fb3aa79a70a4ed62188: Bootstrap starting.
I20260709 13:10:02.124740 24440 tablet_bootstrap.cc:654] T fdb7ba4cacaf498d83b351d63a57aa7b P f39804e3bc0e439286a172ab4c75e032: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.138366 24442 tablet_bootstrap.cc:492] T d3529531034c4da8ace2a1b8bcc7c934 P 89434398bef1483abb7170861c595c08: No bootstrap required, opened a new log
I20260709 13:10:02.140512 24442 ts_tablet_manager.cc:1403] T d3529531034c4da8ace2a1b8bcc7c934 P 89434398bef1483abb7170861c595c08: Time spent bootstrapping tablet: real 0.047s	user 0.012s	sys 0.002s
I20260709 13:10:02.142431 24440 tablet_bootstrap.cc:492] T fdb7ba4cacaf498d83b351d63a57aa7b P f39804e3bc0e439286a172ab4c75e032: No bootstrap required, opened a new log
I20260709 13:10:02.142899 24440 ts_tablet_manager.cc:1403] T fdb7ba4cacaf498d83b351d63a57aa7b P f39804e3bc0e439286a172ab4c75e032: Time spent bootstrapping tablet: real 0.034s	user 0.007s	sys 0.005s
I20260709 13:10:02.143726 24442 raft_consensus.cc:359] T d3529531034c4da8ace2a1b8bcc7c934 P 89434398bef1483abb7170861c595c08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:02.144464 24442 raft_consensus.cc:385] T d3529531034c4da8ace2a1b8bcc7c934 P 89434398bef1483abb7170861c595c08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.144752 24442 raft_consensus.cc:740] T d3529531034c4da8ace2a1b8bcc7c934 P 89434398bef1483abb7170861c595c08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89434398bef1483abb7170861c595c08, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.145013 24440 raft_consensus.cc:359] T fdb7ba4cacaf498d83b351d63a57aa7b P f39804e3bc0e439286a172ab4c75e032 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } }
I20260709 13:10:02.145474 24442 consensus_queue.cc:260] T d3529531034c4da8ace2a1b8bcc7c934 P 89434398bef1483abb7170861c595c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:02.145756 24440 raft_consensus.cc:385] T fdb7ba4cacaf498d83b351d63a57aa7b P f39804e3bc0e439286a172ab4c75e032 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.152917 24440 raft_consensus.cc:740] T fdb7ba4cacaf498d83b351d63a57aa7b P f39804e3bc0e439286a172ab4c75e032 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f39804e3bc0e439286a172ab4c75e032, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.146296 24441 tablet_bootstrap.cc:654] T 2824545a6ec14281b292a9a80984e5d7 P ba007af05f0f4fb3aa79a70a4ed62188: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.153564 24440 consensus_queue.cc:260] T fdb7ba4cacaf498d83b351d63a57aa7b P f39804e3bc0e439286a172ab4c75e032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } }
I20260709 13:10:02.155754 24440 ts_tablet_manager.cc:1434] T fdb7ba4cacaf498d83b351d63a57aa7b P f39804e3bc0e439286a172ab4c75e032: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:10:02.156661 24440 tablet_bootstrap.cc:492] T a14d80b5fd8747d3b44afc1fc32ecffa P f39804e3bc0e439286a172ab4c75e032: Bootstrap starting.
I20260709 13:10:02.149415 24442 ts_tablet_manager.cc:1434] T d3529531034c4da8ace2a1b8bcc7c934 P 89434398bef1483abb7170861c595c08: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.005s
I20260709 13:10:02.158687 24442 tablet_bootstrap.cc:492] T 072781c592984c6a9a6f3d8790809bd1 P 89434398bef1483abb7170861c595c08: Bootstrap starting.
I20260709 13:10:02.152117 24144 catalog_manager.cc:5697] T c4607544e6a241349a1a35df8aaca446 P ba007af05f0f4fb3aa79a70a4ed62188 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba007af05f0f4fb3aa79a70a4ed62188 (127.23.140.67). New cstate: current_term: 1 leader_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:02.160377 24144 catalog_manager.cc:5697] T a2b8f465407049c093b74b89e0cc8fc3 P ba007af05f0f4fb3aa79a70a4ed62188 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba007af05f0f4fb3aa79a70a4ed62188 (127.23.140.67). New cstate: current_term: 1 leader_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:02.166214 24470 raft_consensus.cc:493] T 2824545a6ec14281b292a9a80984e5d7 P 89434398bef1483abb7170861c595c08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.166735 24470 raft_consensus.cc:515] T 2824545a6ec14281b292a9a80984e5d7 P 89434398bef1483abb7170861c595c08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:02.168486 24441 tablet_bootstrap.cc:492] T 2824545a6ec14281b292a9a80984e5d7 P ba007af05f0f4fb3aa79a70a4ed62188: No bootstrap required, opened a new log
I20260709 13:10:02.168879 24470 leader_election.cc:290] T 2824545a6ec14281b292a9a80984e5d7 P 89434398bef1483abb7170861c595c08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f39804e3bc0e439286a172ab4c75e032 (127.23.140.66:37967), ba007af05f0f4fb3aa79a70a4ed62188 (127.23.140.67:39155)
I20260709 13:10:02.170238 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2824545a6ec14281b292a9a80984e5d7" candidate_uuid: "89434398bef1483abb7170861c595c08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" is_pre_election: true
I20260709 13:10:02.170589 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2824545a6ec14281b292a9a80984e5d7" candidate_uuid: "89434398bef1483abb7170861c595c08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f39804e3bc0e439286a172ab4c75e032" is_pre_election: true
I20260709 13:10:02.171175 24442 tablet_bootstrap.cc:654] T 072781c592984c6a9a6f3d8790809bd1 P 89434398bef1483abb7170861c595c08: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:02.171783 24213 leader_election.cc:343] T 2824545a6ec14281b292a9a80984e5d7 P 89434398bef1483abb7170861c595c08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba007af05f0f4fb3aa79a70a4ed62188 (127.23.140.67:39155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:02.172472 24441 ts_tablet_manager.cc:1403] T 2824545a6ec14281b292a9a80984e5d7 P ba007af05f0f4fb3aa79a70a4ed62188: Time spent bootstrapping tablet: real 0.047s	user 0.003s	sys 0.019s
I20260709 13:10:02.171168 24322 raft_consensus.cc:2468] T 2824545a6ec14281b292a9a80984e5d7 P f39804e3bc0e439286a172ab4c75e032 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89434398bef1483abb7170861c595c08 in term 0.
I20260709 13:10:02.174235 24214 leader_election.cc:304] T 2824545a6ec14281b292a9a80984e5d7 P 89434398bef1483abb7170861c595c08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89434398bef1483abb7170861c595c08, f39804e3bc0e439286a172ab4c75e032; no voters: ba007af05f0f4fb3aa79a70a4ed62188
I20260709 13:10:02.175323 24470 raft_consensus.cc:2804] T 2824545a6ec14281b292a9a80984e5d7 P 89434398bef1483abb7170861c595c08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:02.175684 24470 raft_consensus.cc:493] T 2824545a6ec14281b292a9a80984e5d7 P 89434398bef1483abb7170861c595c08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:02.175519 24441 raft_consensus.cc:359] T 2824545a6ec14281b292a9a80984e5d7 P ba007af05f0f4fb3aa79a70a4ed62188 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:02.176087 24470 raft_consensus.cc:3060] T 2824545a6ec14281b292a9a80984e5d7 P 89434398bef1483abb7170861c595c08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.176487 24441 raft_consensus.cc:385] T 2824545a6ec14281b292a9a80984e5d7 P ba007af05f0f4fb3aa79a70a4ed62188 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.175845 24145 catalog_manager.cc:5697] T 072781c592984c6a9a6f3d8790809bd1 P f39804e3bc0e439286a172ab4c75e032 reported cstate change: term changed from 0 to 1, leader changed from <none> to f39804e3bc0e439286a172ab4c75e032 (127.23.140.66). New cstate: current_term: 1 leader_uuid: "f39804e3bc0e439286a172ab4c75e032" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:02.176828 24441 raft_consensus.cc:740] T 2824545a6ec14281b292a9a80984e5d7 P ba007af05f0f4fb3aa79a70a4ed62188 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba007af05f0f4fb3aa79a70a4ed62188, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.177600 24441 consensus_queue.cc:260] T 2824545a6ec14281b292a9a80984e5d7 P ba007af05f0f4fb3aa79a70a4ed62188 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:02.179618 24441 ts_tablet_manager.cc:1434] T 2824545a6ec14281b292a9a80984e5d7 P ba007af05f0f4fb3aa79a70a4ed62188: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:10:02.180429 24441 tablet_bootstrap.cc:492] T 57caa52201cc4aaba1de74ac8393a6a6 P ba007af05f0f4fb3aa79a70a4ed62188: Bootstrap starting.
I20260709 13:10:02.183277 24470 raft_consensus.cc:515] T 2824545a6ec14281b292a9a80984e5d7 P 89434398bef1483abb7170861c595c08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:02.185915 24441 tablet_bootstrap.cc:654] T 57caa52201cc4aaba1de74ac8393a6a6 P ba007af05f0f4fb3aa79a70a4ed62188: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.185930 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2824545a6ec14281b292a9a80984e5d7" candidate_uuid: "89434398bef1483abb7170861c595c08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f39804e3bc0e439286a172ab4c75e032"
I20260709 13:10:02.186501 24470 leader_election.cc:290] T 2824545a6ec14281b292a9a80984e5d7 P 89434398bef1483abb7170861c595c08 [CANDIDATE]: Term 1 election: Requested vote from peers f39804e3bc0e439286a172ab4c75e032 (127.23.140.66:37967), ba007af05f0f4fb3aa79a70a4ed62188 (127.23.140.67:39155)
I20260709 13:10:02.186695 24322 raft_consensus.cc:3060] T 2824545a6ec14281b292a9a80984e5d7 P f39804e3bc0e439286a172ab4c75e032 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.187592 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2824545a6ec14281b292a9a80984e5d7" candidate_uuid: "89434398bef1483abb7170861c595c08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba007af05f0f4fb3aa79a70a4ed62188"
I20260709 13:10:02.188105 24396 raft_consensus.cc:3060] T 2824545a6ec14281b292a9a80984e5d7 P ba007af05f0f4fb3aa79a70a4ed62188 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.195219 24322 raft_consensus.cc:2468] T 2824545a6ec14281b292a9a80984e5d7 P f39804e3bc0e439286a172ab4c75e032 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89434398bef1483abb7170861c595c08 in term 1.
I20260709 13:10:02.196065 24396 raft_consensus.cc:2468] T 2824545a6ec14281b292a9a80984e5d7 P ba007af05f0f4fb3aa79a70a4ed62188 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89434398bef1483abb7170861c595c08 in term 1.
I20260709 13:10:02.199118 24442 tablet_bootstrap.cc:492] T 072781c592984c6a9a6f3d8790809bd1 P 89434398bef1483abb7170861c595c08: No bootstrap required, opened a new log
I20260709 13:10:02.206110 24213 leader_election.cc:304] T 2824545a6ec14281b292a9a80984e5d7 P 89434398bef1483abb7170861c595c08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89434398bef1483abb7170861c595c08, ba007af05f0f4fb3aa79a70a4ed62188; no voters: 
I20260709 13:10:02.206518 24442 ts_tablet_manager.cc:1403] T 072781c592984c6a9a6f3d8790809bd1 P 89434398bef1483abb7170861c595c08: Time spent bootstrapping tablet: real 0.048s	user 0.014s	sys 0.008s
I20260709 13:10:02.209152 24442 raft_consensus.cc:359] T 072781c592984c6a9a6f3d8790809bd1 P 89434398bef1483abb7170861c595c08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:02.209862 24442 raft_consensus.cc:385] T 072781c592984c6a9a6f3d8790809bd1 P 89434398bef1483abb7170861c595c08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.210127 24442 raft_consensus.cc:740] T 072781c592984c6a9a6f3d8790809bd1 P 89434398bef1483abb7170861c595c08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89434398bef1483abb7170861c595c08, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.210767 24442 consensus_queue.cc:260] T 072781c592984c6a9a6f3d8790809bd1 P 89434398bef1483abb7170861c595c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:02.211724 24468 raft_consensus.cc:2804] T 2824545a6ec14281b292a9a80984e5d7 P 89434398bef1483abb7170861c595c08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:02.212212 24468 raft_consensus.cc:697] T 2824545a6ec14281b292a9a80984e5d7 P 89434398bef1483abb7170861c595c08 [term 1 LEADER]: Becoming Leader. State: Replica: 89434398bef1483abb7170861c595c08, State: Running, Role: LEADER
I20260709 13:10:02.213160 24442 ts_tablet_manager.cc:1434] T 072781c592984c6a9a6f3d8790809bd1 P 89434398bef1483abb7170861c595c08: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.003s
I20260709 13:10:02.212984 24468 consensus_queue.cc:237] T 2824545a6ec14281b292a9a80984e5d7 P 89434398bef1483abb7170861c595c08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:02.215140 24442 tablet_bootstrap.cc:492] T a14d80b5fd8747d3b44afc1fc32ecffa P 89434398bef1483abb7170861c595c08: Bootstrap starting.
I20260709 13:10:02.201522 24441 tablet_bootstrap.cc:492] T 57caa52201cc4aaba1de74ac8393a6a6 P ba007af05f0f4fb3aa79a70a4ed62188: No bootstrap required, opened a new log
I20260709 13:10:02.219319 24440 tablet_bootstrap.cc:654] T a14d80b5fd8747d3b44afc1fc32ecffa P f39804e3bc0e439286a172ab4c75e032: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.219419 24441 ts_tablet_manager.cc:1403] T 57caa52201cc4aaba1de74ac8393a6a6 P ba007af05f0f4fb3aa79a70a4ed62188: Time spent bootstrapping tablet: real 0.039s	user 0.008s	sys 0.003s
I20260709 13:10:02.222056 24441 raft_consensus.cc:359] T 57caa52201cc4aaba1de74ac8393a6a6 P ba007af05f0f4fb3aa79a70a4ed62188 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:02.222707 24441 raft_consensus.cc:385] T 57caa52201cc4aaba1de74ac8393a6a6 P ba007af05f0f4fb3aa79a70a4ed62188 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.222975 24441 raft_consensus.cc:740] T 57caa52201cc4aaba1de74ac8393a6a6 P ba007af05f0f4fb3aa79a70a4ed62188 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba007af05f0f4fb3aa79a70a4ed62188, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.224635 24441 consensus_queue.cc:260] T 57caa52201cc4aaba1de74ac8393a6a6 P ba007af05f0f4fb3aa79a70a4ed62188 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:02.225306 24442 tablet_bootstrap.cc:654] T a14d80b5fd8747d3b44afc1fc32ecffa P 89434398bef1483abb7170861c595c08: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.228152 24441 ts_tablet_manager.cc:1434] T 57caa52201cc4aaba1de74ac8393a6a6 P ba007af05f0f4fb3aa79a70a4ed62188: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260709 13:10:02.242170 24143 catalog_manager.cc:5697] T 2824545a6ec14281b292a9a80984e5d7 P 89434398bef1483abb7170861c595c08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89434398bef1483abb7170861c595c08 (127.23.140.65). New cstate: current_term: 1 leader_uuid: "89434398bef1483abb7170861c595c08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:02.251603 24442 tablet_bootstrap.cc:492] T a14d80b5fd8747d3b44afc1fc32ecffa P 89434398bef1483abb7170861c595c08: No bootstrap required, opened a new log
I20260709 13:10:02.252144 24442 ts_tablet_manager.cc:1403] T a14d80b5fd8747d3b44afc1fc32ecffa P 89434398bef1483abb7170861c595c08: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.010s
I20260709 13:10:02.254908 24440 tablet_bootstrap.cc:492] T a14d80b5fd8747d3b44afc1fc32ecffa P f39804e3bc0e439286a172ab4c75e032: No bootstrap required, opened a new log
I20260709 13:10:02.255399 24440 ts_tablet_manager.cc:1403] T a14d80b5fd8747d3b44afc1fc32ecffa P f39804e3bc0e439286a172ab4c75e032: Time spent bootstrapping tablet: real 0.099s	user 0.012s	sys 0.012s
I20260709 13:10:02.256129 24442 raft_consensus.cc:359] T a14d80b5fd8747d3b44afc1fc32ecffa P 89434398bef1483abb7170861c595c08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:02.256845 24442 raft_consensus.cc:385] T a14d80b5fd8747d3b44afc1fc32ecffa P 89434398bef1483abb7170861c595c08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.257180 24442 raft_consensus.cc:740] T a14d80b5fd8747d3b44afc1fc32ecffa P 89434398bef1483abb7170861c595c08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89434398bef1483abb7170861c595c08, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.258255 24440 raft_consensus.cc:359] T a14d80b5fd8747d3b44afc1fc32ecffa P f39804e3bc0e439286a172ab4c75e032 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:02.258970 24440 raft_consensus.cc:385] T a14d80b5fd8747d3b44afc1fc32ecffa P f39804e3bc0e439286a172ab4c75e032 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.259238 24440 raft_consensus.cc:740] T a14d80b5fd8747d3b44afc1fc32ecffa P f39804e3bc0e439286a172ab4c75e032 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f39804e3bc0e439286a172ab4c75e032, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.260033 24467 raft_consensus.cc:493] T 57caa52201cc4aaba1de74ac8393a6a6 P ba007af05f0f4fb3aa79a70a4ed62188 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.260151 24440 consensus_queue.cc:260] T a14d80b5fd8747d3b44afc1fc32ecffa P f39804e3bc0e439286a172ab4c75e032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:02.260504 24467 raft_consensus.cc:515] T 57caa52201cc4aaba1de74ac8393a6a6 P ba007af05f0f4fb3aa79a70a4ed62188 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:02.261251 24442 consensus_queue.cc:260] T a14d80b5fd8747d3b44afc1fc32ecffa P 89434398bef1483abb7170861c595c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:02.263827 24442 ts_tablet_manager.cc:1434] T a14d80b5fd8747d3b44afc1fc32ecffa P 89434398bef1483abb7170861c595c08: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 13:10:02.264305 24467 leader_election.cc:290] T 57caa52201cc4aaba1de74ac8393a6a6 P ba007af05f0f4fb3aa79a70a4ed62188 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89434398bef1483abb7170861c595c08 (127.23.140.65:42583), f39804e3bc0e439286a172ab4c75e032 (127.23.140.66:37967)
I20260709 13:10:02.264788 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57caa52201cc4aaba1de74ac8393a6a6" candidate_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89434398bef1483abb7170861c595c08" is_pre_election: true
I20260709 13:10:02.265189 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57caa52201cc4aaba1de74ac8393a6a6" candidate_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f39804e3bc0e439286a172ab4c75e032" is_pre_election: true
I20260709 13:10:02.265410 24248 raft_consensus.cc:2468] T 57caa52201cc4aaba1de74ac8393a6a6 P 89434398bef1483abb7170861c595c08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba007af05f0f4fb3aa79a70a4ed62188 in term 0.
I20260709 13:10:02.266649 24360 leader_election.cc:304] T 57caa52201cc4aaba1de74ac8393a6a6 P ba007af05f0f4fb3aa79a70a4ed62188 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89434398bef1483abb7170861c595c08, ba007af05f0f4fb3aa79a70a4ed62188; no voters: 
W20260709 13:10:02.267493 24363 leader_election.cc:343] T 57caa52201cc4aaba1de74ac8393a6a6 P ba007af05f0f4fb3aa79a70a4ed62188 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f39804e3bc0e439286a172ab4c75e032 (127.23.140.66:37967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:02.271279 24440 ts_tablet_manager.cc:1434] T a14d80b5fd8747d3b44afc1fc32ecffa P f39804e3bc0e439286a172ab4c75e032: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.004s
I20260709 13:10:02.272315 24440 tablet_bootstrap.cc:492] T d3529531034c4da8ace2a1b8bcc7c934 P f39804e3bc0e439286a172ab4c75e032: Bootstrap starting.
I20260709 13:10:02.269579 24467 raft_consensus.cc:2804] T 57caa52201cc4aaba1de74ac8393a6a6 P ba007af05f0f4fb3aa79a70a4ed62188 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:02.272877 24467 raft_consensus.cc:493] T 57caa52201cc4aaba1de74ac8393a6a6 P ba007af05f0f4fb3aa79a70a4ed62188 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:02.273343 24467 raft_consensus.cc:3060] T 57caa52201cc4aaba1de74ac8393a6a6 P ba007af05f0f4fb3aa79a70a4ed62188 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.279917 24440 tablet_bootstrap.cc:654] T d3529531034c4da8ace2a1b8bcc7c934 P f39804e3bc0e439286a172ab4c75e032: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.280284 24467 raft_consensus.cc:515] T 57caa52201cc4aaba1de74ac8393a6a6 P ba007af05f0f4fb3aa79a70a4ed62188 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:02.283388 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57caa52201cc4aaba1de74ac8393a6a6" candidate_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f39804e3bc0e439286a172ab4c75e032"
I20260709 13:10:02.283458 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57caa52201cc4aaba1de74ac8393a6a6" candidate_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89434398bef1483abb7170861c595c08"
I20260709 13:10:02.284312 24248 raft_consensus.cc:3060] T 57caa52201cc4aaba1de74ac8393a6a6 P 89434398bef1483abb7170861c595c08 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:02.284749 24363 leader_election.cc:343] T 57caa52201cc4aaba1de74ac8393a6a6 P ba007af05f0f4fb3aa79a70a4ed62188 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f39804e3bc0e439286a172ab4c75e032 (127.23.140.66:37967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:02.285269 24467 leader_election.cc:290] T 57caa52201cc4aaba1de74ac8393a6a6 P ba007af05f0f4fb3aa79a70a4ed62188 [CANDIDATE]: Term 1 election: Requested vote from peers 89434398bef1483abb7170861c595c08 (127.23.140.65:42583), f39804e3bc0e439286a172ab4c75e032 (127.23.140.66:37967)
I20260709 13:10:02.290254 24248 raft_consensus.cc:2468] T 57caa52201cc4aaba1de74ac8393a6a6 P 89434398bef1483abb7170861c595c08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba007af05f0f4fb3aa79a70a4ed62188 in term 1.
I20260709 13:10:02.290439 24440 tablet_bootstrap.cc:492] T d3529531034c4da8ace2a1b8bcc7c934 P f39804e3bc0e439286a172ab4c75e032: No bootstrap required, opened a new log
I20260709 13:10:02.291044 24440 ts_tablet_manager.cc:1403] T d3529531034c4da8ace2a1b8bcc7c934 P f39804e3bc0e439286a172ab4c75e032: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.003s
I20260709 13:10:02.291375 24360 leader_election.cc:304] T 57caa52201cc4aaba1de74ac8393a6a6 P ba007af05f0f4fb3aa79a70a4ed62188 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89434398bef1483abb7170861c595c08, ba007af05f0f4fb3aa79a70a4ed62188; no voters: f39804e3bc0e439286a172ab4c75e032
I20260709 13:10:02.292131 24467 raft_consensus.cc:2804] T 57caa52201cc4aaba1de74ac8393a6a6 P ba007af05f0f4fb3aa79a70a4ed62188 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:02.293105 24467 raft_consensus.cc:697] T 57caa52201cc4aaba1de74ac8393a6a6 P ba007af05f0f4fb3aa79a70a4ed62188 [term 1 LEADER]: Becoming Leader. State: Replica: ba007af05f0f4fb3aa79a70a4ed62188, State: Running, Role: LEADER
I20260709 13:10:02.294171 24467 consensus_queue.cc:237] T 57caa52201cc4aaba1de74ac8393a6a6 P ba007af05f0f4fb3aa79a70a4ed62188 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:02.294343 24440 raft_consensus.cc:359] T d3529531034c4da8ace2a1b8bcc7c934 P f39804e3bc0e439286a172ab4c75e032 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:02.295090 24440 raft_consensus.cc:385] T d3529531034c4da8ace2a1b8bcc7c934 P f39804e3bc0e439286a172ab4c75e032 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.295409 24440 raft_consensus.cc:740] T d3529531034c4da8ace2a1b8bcc7c934 P f39804e3bc0e439286a172ab4c75e032 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f39804e3bc0e439286a172ab4c75e032, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.296020 24440 consensus_queue.cc:260] T d3529531034c4da8ace2a1b8bcc7c934 P f39804e3bc0e439286a172ab4c75e032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:02.297319 24481 raft_consensus.cc:493] T fdb7ba4cacaf498d83b351d63a57aa7b P f39804e3bc0e439286a172ab4c75e032 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.298310 24440 ts_tablet_manager.cc:1434] T d3529531034c4da8ace2a1b8bcc7c934 P f39804e3bc0e439286a172ab4c75e032: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:10:02.298050 24481 raft_consensus.cc:515] T fdb7ba4cacaf498d83b351d63a57aa7b P f39804e3bc0e439286a172ab4c75e032 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } }
I20260709 13:10:02.299301 24440 tablet_bootstrap.cc:492] T 57caa52201cc4aaba1de74ac8393a6a6 P f39804e3bc0e439286a172ab4c75e032: Bootstrap starting.
I20260709 13:10:02.302836 24481 leader_election.cc:290] T fdb7ba4cacaf498d83b351d63a57aa7b P f39804e3bc0e439286a172ab4c75e032 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba007af05f0f4fb3aa79a70a4ed62188 (127.23.140.67:39155), 89434398bef1483abb7170861c595c08 (127.23.140.65:42583)
I20260709 13:10:02.302775 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb7ba4cacaf498d83b351d63a57aa7b" candidate_uuid: "f39804e3bc0e439286a172ab4c75e032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" is_pre_election: true
I20260709 13:10:02.305227 24440 tablet_bootstrap.cc:654] T 57caa52201cc4aaba1de74ac8393a6a6 P f39804e3bc0e439286a172ab4c75e032: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.305660 24396 raft_consensus.cc:2393] T fdb7ba4cacaf498d83b351d63a57aa7b P ba007af05f0f4fb3aa79a70a4ed62188 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f39804e3bc0e439286a172ab4c75e032 in current term 1: Already voted for candidate 89434398bef1483abb7170861c595c08 in this term.
I20260709 13:10:02.307078 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb7ba4cacaf498d83b351d63a57aa7b" candidate_uuid: "f39804e3bc0e439286a172ab4c75e032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89434398bef1483abb7170861c595c08" is_pre_election: true
I20260709 13:10:02.308555 24286 leader_election.cc:304] T fdb7ba4cacaf498d83b351d63a57aa7b P f39804e3bc0e439286a172ab4c75e032 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f39804e3bc0e439286a172ab4c75e032; no voters: 89434398bef1483abb7170861c595c08, ba007af05f0f4fb3aa79a70a4ed62188
I20260709 13:10:02.310232 24481 raft_consensus.cc:3060] T fdb7ba4cacaf498d83b351d63a57aa7b P f39804e3bc0e439286a172ab4c75e032 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.316275 24440 tablet_bootstrap.cc:492] T 57caa52201cc4aaba1de74ac8393a6a6 P f39804e3bc0e439286a172ab4c75e032: No bootstrap required, opened a new log
I20260709 13:10:02.316720 24440 ts_tablet_manager.cc:1403] T 57caa52201cc4aaba1de74ac8393a6a6 P f39804e3bc0e439286a172ab4c75e032: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.007s
I20260709 13:10:02.319367 24144 catalog_manager.cc:5697] T 57caa52201cc4aaba1de74ac8393a6a6 P ba007af05f0f4fb3aa79a70a4ed62188 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba007af05f0f4fb3aa79a70a4ed62188 (127.23.140.67). New cstate: current_term: 1 leader_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:02.320106 24440 raft_consensus.cc:359] T 57caa52201cc4aaba1de74ac8393a6a6 P f39804e3bc0e439286a172ab4c75e032 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:02.320464 24481 raft_consensus.cc:2749] T fdb7ba4cacaf498d83b351d63a57aa7b P f39804e3bc0e439286a172ab4c75e032 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:02.320820 24440 raft_consensus.cc:385] T 57caa52201cc4aaba1de74ac8393a6a6 P f39804e3bc0e439286a172ab4c75e032 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.321138 24440 raft_consensus.cc:740] T 57caa52201cc4aaba1de74ac8393a6a6 P f39804e3bc0e439286a172ab4c75e032 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f39804e3bc0e439286a172ab4c75e032, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.321815 24440 consensus_queue.cc:260] T 57caa52201cc4aaba1de74ac8393a6a6 P f39804e3bc0e439286a172ab4c75e032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:02.323539 24440 ts_tablet_manager.cc:1434] T 57caa52201cc4aaba1de74ac8393a6a6 P f39804e3bc0e439286a172ab4c75e032: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
W20260709 13:10:02.330540 24193 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:02.332592 24468 raft_consensus.cc:493] T a14d80b5fd8747d3b44afc1fc32ecffa P 89434398bef1483abb7170861c595c08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.333101 24468 raft_consensus.cc:515] T a14d80b5fd8747d3b44afc1fc32ecffa P 89434398bef1483abb7170861c595c08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:02.335228 24468 leader_election.cc:290] T a14d80b5fd8747d3b44afc1fc32ecffa P 89434398bef1483abb7170861c595c08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f39804e3bc0e439286a172ab4c75e032 (127.23.140.66:37967), ba007af05f0f4fb3aa79a70a4ed62188 (127.23.140.67:39155)
I20260709 13:10:02.335872 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14d80b5fd8747d3b44afc1fc32ecffa" candidate_uuid: "89434398bef1483abb7170861c595c08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f39804e3bc0e439286a172ab4c75e032" is_pre_election: true
I20260709 13:10:02.336511 24322 raft_consensus.cc:2468] T a14d80b5fd8747d3b44afc1fc32ecffa P f39804e3bc0e439286a172ab4c75e032 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89434398bef1483abb7170861c595c08 in term 0.
I20260709 13:10:02.336673 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14d80b5fd8747d3b44afc1fc32ecffa" candidate_uuid: "89434398bef1483abb7170861c595c08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" is_pre_election: true
I20260709 13:10:02.337273 24396 raft_consensus.cc:2468] T a14d80b5fd8747d3b44afc1fc32ecffa P ba007af05f0f4fb3aa79a70a4ed62188 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89434398bef1483abb7170861c595c08 in term 0.
I20260709 13:10:02.337568 24214 leader_election.cc:304] T a14d80b5fd8747d3b44afc1fc32ecffa P 89434398bef1483abb7170861c595c08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89434398bef1483abb7170861c595c08, f39804e3bc0e439286a172ab4c75e032; no voters: 
I20260709 13:10:02.338479 24468 raft_consensus.cc:2804] T a14d80b5fd8747d3b44afc1fc32ecffa P 89434398bef1483abb7170861c595c08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:02.338809 24468 raft_consensus.cc:493] T a14d80b5fd8747d3b44afc1fc32ecffa P 89434398bef1483abb7170861c595c08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:02.339139 24468 raft_consensus.cc:3060] T a14d80b5fd8747d3b44afc1fc32ecffa P 89434398bef1483abb7170861c595c08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.341005 24467 consensus_queue.cc:1048] T a2b8f465407049c093b74b89e0cc8fc3 P ba007af05f0f4fb3aa79a70a4ed62188 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:02.362778 24446 consensus_queue.cc:1048] T a2b8f465407049c093b74b89e0cc8fc3 P ba007af05f0f4fb3aa79a70a4ed62188 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:02.366684 24446 raft_consensus.cc:493] T d3529531034c4da8ace2a1b8bcc7c934 P ba007af05f0f4fb3aa79a70a4ed62188 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.367131 24446 raft_consensus.cc:515] T d3529531034c4da8ace2a1b8bcc7c934 P ba007af05f0f4fb3aa79a70a4ed62188 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:02.369225 24446 leader_election.cc:290] T d3529531034c4da8ace2a1b8bcc7c934 P ba007af05f0f4fb3aa79a70a4ed62188 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89434398bef1483abb7170861c595c08 (127.23.140.65:42583), f39804e3bc0e439286a172ab4c75e032 (127.23.140.66:37967)
I20260709 13:10:02.370400 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3529531034c4da8ace2a1b8bcc7c934" candidate_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f39804e3bc0e439286a172ab4c75e032" is_pre_election: true
I20260709 13:10:02.370791 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3529531034c4da8ace2a1b8bcc7c934" candidate_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89434398bef1483abb7170861c595c08" is_pre_election: true
I20260709 13:10:02.371104 24322 raft_consensus.cc:2468] T d3529531034c4da8ace2a1b8bcc7c934 P f39804e3bc0e439286a172ab4c75e032 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba007af05f0f4fb3aa79a70a4ed62188 in term 0.
I20260709 13:10:02.371436 24247 raft_consensus.cc:2468] T d3529531034c4da8ace2a1b8bcc7c934 P 89434398bef1483abb7170861c595c08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba007af05f0f4fb3aa79a70a4ed62188 in term 0.
I20260709 13:10:02.372548 24363 leader_election.cc:304] T d3529531034c4da8ace2a1b8bcc7c934 P ba007af05f0f4fb3aa79a70a4ed62188 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba007af05f0f4fb3aa79a70a4ed62188, f39804e3bc0e439286a172ab4c75e032; no voters: 
I20260709 13:10:02.373976 24467 raft_consensus.cc:2804] T d3529531034c4da8ace2a1b8bcc7c934 P ba007af05f0f4fb3aa79a70a4ed62188 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:02.374502 24467 raft_consensus.cc:493] T d3529531034c4da8ace2a1b8bcc7c934 P ba007af05f0f4fb3aa79a70a4ed62188 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:02.374939 24467 raft_consensus.cc:3060] T d3529531034c4da8ace2a1b8bcc7c934 P ba007af05f0f4fb3aa79a70a4ed62188 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.382190 24469 consensus_queue.cc:1048] T c4607544e6a241349a1a35df8aaca446 P ba007af05f0f4fb3aa79a70a4ed62188 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:02.383049 24481 raft_consensus.cc:493] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P f39804e3bc0e439286a172ab4c75e032 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.383512 24481 raft_consensus.cc:515] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P f39804e3bc0e439286a172ab4c75e032 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:02.385533 24467 raft_consensus.cc:515] T d3529531034c4da8ace2a1b8bcc7c934 P ba007af05f0f4fb3aa79a70a4ed62188 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:02.385525 24481 leader_election.cc:290] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P f39804e3bc0e439286a172ab4c75e032 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89434398bef1483abb7170861c595c08 (127.23.140.65:42583), ba007af05f0f4fb3aa79a70a4ed62188 (127.23.140.67:39155)
I20260709 13:10:02.386189 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eb056e46f2d4ddbb45fdb665a6b3eaa" candidate_uuid: "f39804e3bc0e439286a172ab4c75e032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89434398bef1483abb7170861c595c08" is_pre_election: true
I20260709 13:10:02.386917 24248 raft_consensus.cc:2468] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P 89434398bef1483abb7170861c595c08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f39804e3bc0e439286a172ab4c75e032 in term 0.
I20260709 13:10:02.387952 24286 leader_election.cc:304] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P f39804e3bc0e439286a172ab4c75e032 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89434398bef1483abb7170861c595c08, f39804e3bc0e439286a172ab4c75e032; no voters: 
I20260709 13:10:02.388170 24467 leader_election.cc:290] T d3529531034c4da8ace2a1b8bcc7c934 P ba007af05f0f4fb3aa79a70a4ed62188 [CANDIDATE]: Term 1 election: Requested vote from peers 89434398bef1483abb7170861c595c08 (127.23.140.65:42583), f39804e3bc0e439286a172ab4c75e032 (127.23.140.66:37967)
I20260709 13:10:02.389145 24481 raft_consensus.cc:2804] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P f39804e3bc0e439286a172ab4c75e032 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:02.389294 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3529531034c4da8ace2a1b8bcc7c934" candidate_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f39804e3bc0e439286a172ab4c75e032"
I20260709 13:10:02.389513 24481 raft_consensus.cc:493] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P f39804e3bc0e439286a172ab4c75e032 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:02.389729 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3529531034c4da8ace2a1b8bcc7c934" candidate_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89434398bef1483abb7170861c595c08"
I20260709 13:10:02.389930 24323 raft_consensus.cc:3060] T d3529531034c4da8ace2a1b8bcc7c934 P f39804e3bc0e439286a172ab4c75e032 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.390429 24247 raft_consensus.cc:3060] T d3529531034c4da8ace2a1b8bcc7c934 P 89434398bef1483abb7170861c595c08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.397359 24247 raft_consensus.cc:2468] T d3529531034c4da8ace2a1b8bcc7c934 P 89434398bef1483abb7170861c595c08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba007af05f0f4fb3aa79a70a4ed62188 in term 1.
I20260709 13:10:02.398784 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eb056e46f2d4ddbb45fdb665a6b3eaa" candidate_uuid: "f39804e3bc0e439286a172ab4c75e032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" is_pre_election: true
I20260709 13:10:02.399159 24323 raft_consensus.cc:2468] T d3529531034c4da8ace2a1b8bcc7c934 P f39804e3bc0e439286a172ab4c75e032 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba007af05f0f4fb3aa79a70a4ed62188 in term 1.
I20260709 13:10:02.399479 24396 raft_consensus.cc:2468] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P ba007af05f0f4fb3aa79a70a4ed62188 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f39804e3bc0e439286a172ab4c75e032 in term 0.
I20260709 13:10:02.389876 24481 raft_consensus.cc:3060] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P f39804e3bc0e439286a172ab4c75e032 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.400593 24363 leader_election.cc:304] T d3529531034c4da8ace2a1b8bcc7c934 P ba007af05f0f4fb3aa79a70a4ed62188 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba007af05f0f4fb3aa79a70a4ed62188, f39804e3bc0e439286a172ab4c75e032; no voters: 
I20260709 13:10:02.401896 24467 raft_consensus.cc:2804] T d3529531034c4da8ace2a1b8bcc7c934 P ba007af05f0f4fb3aa79a70a4ed62188 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:02.415768 24446 consensus_queue.cc:1048] T c4607544e6a241349a1a35df8aaca446 P ba007af05f0f4fb3aa79a70a4ed62188 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:02.359195 24468 raft_consensus.cc:515] T a14d80b5fd8747d3b44afc1fc32ecffa P 89434398bef1483abb7170861c595c08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:02.423060 24467 raft_consensus.cc:697] T d3529531034c4da8ace2a1b8bcc7c934 P ba007af05f0f4fb3aa79a70a4ed62188 [term 1 LEADER]: Becoming Leader. State: Replica: ba007af05f0f4fb3aa79a70a4ed62188, State: Running, Role: LEADER
I20260709 13:10:02.424235 24467 consensus_queue.cc:237] T d3529531034c4da8ace2a1b8bcc7c934 P ba007af05f0f4fb3aa79a70a4ed62188 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:02.427280 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14d80b5fd8747d3b44afc1fc32ecffa" candidate_uuid: "89434398bef1483abb7170861c595c08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f39804e3bc0e439286a172ab4c75e032"
I20260709 13:10:02.427845 24322 raft_consensus.cc:3060] T a14d80b5fd8747d3b44afc1fc32ecffa P f39804e3bc0e439286a172ab4c75e032 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.436162 24481 raft_consensus.cc:515] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P f39804e3bc0e439286a172ab4c75e032 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:02.438978 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eb056e46f2d4ddbb45fdb665a6b3eaa" candidate_uuid: "f39804e3bc0e439286a172ab4c75e032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89434398bef1483abb7170861c595c08"
I20260709 13:10:02.439563 24246 raft_consensus.cc:3060] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P 89434398bef1483abb7170861c595c08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.440440 24468 leader_election.cc:290] T a14d80b5fd8747d3b44afc1fc32ecffa P 89434398bef1483abb7170861c595c08 [CANDIDATE]: Term 1 election: Requested vote from peers f39804e3bc0e439286a172ab4c75e032 (127.23.140.66:37967), ba007af05f0f4fb3aa79a70a4ed62188 (127.23.140.67:39155)
I20260709 13:10:02.441957 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14d80b5fd8747d3b44afc1fc32ecffa" candidate_uuid: "89434398bef1483abb7170861c595c08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba007af05f0f4fb3aa79a70a4ed62188"
I20260709 13:10:02.442492 24396 raft_consensus.cc:3060] T a14d80b5fd8747d3b44afc1fc32ecffa P ba007af05f0f4fb3aa79a70a4ed62188 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.446369 24481 leader_election.cc:290] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P f39804e3bc0e439286a172ab4c75e032 [CANDIDATE]: Term 1 election: Requested vote from peers 89434398bef1483abb7170861c595c08 (127.23.140.65:42583), ba007af05f0f4fb3aa79a70a4ed62188 (127.23.140.67:39155)
I20260709 13:10:02.446734 24143 catalog_manager.cc:5697] T d3529531034c4da8ace2a1b8bcc7c934 P ba007af05f0f4fb3aa79a70a4ed62188 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba007af05f0f4fb3aa79a70a4ed62188 (127.23.140.67). New cstate: current_term: 1 leader_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:02.447393 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eb056e46f2d4ddbb45fdb665a6b3eaa" candidate_uuid: "f39804e3bc0e439286a172ab4c75e032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba007af05f0f4fb3aa79a70a4ed62188"
I20260709 13:10:02.448035 24397 raft_consensus.cc:3060] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P ba007af05f0f4fb3aa79a70a4ed62188 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.451293 24322 raft_consensus.cc:2468] T a14d80b5fd8747d3b44afc1fc32ecffa P f39804e3bc0e439286a172ab4c75e032 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89434398bef1483abb7170861c595c08 in term 1.
I20260709 13:10:02.452458 24214 leader_election.cc:304] T a14d80b5fd8747d3b44afc1fc32ecffa P 89434398bef1483abb7170861c595c08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89434398bef1483abb7170861c595c08, f39804e3bc0e439286a172ab4c75e032; no voters: 
I20260709 13:10:02.453287 24468 raft_consensus.cc:2804] T a14d80b5fd8747d3b44afc1fc32ecffa P 89434398bef1483abb7170861c595c08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:02.453959 24468 raft_consensus.cc:697] T a14d80b5fd8747d3b44afc1fc32ecffa P 89434398bef1483abb7170861c595c08 [term 1 LEADER]: Becoming Leader. State: Replica: 89434398bef1483abb7170861c595c08, State: Running, Role: LEADER
I20260709 13:10:02.454746 24468 consensus_queue.cc:237] T a14d80b5fd8747d3b44afc1fc32ecffa P 89434398bef1483abb7170861c595c08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:02.456943 24246 raft_consensus.cc:2468] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P 89434398bef1483abb7170861c595c08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f39804e3bc0e439286a172ab4c75e032 in term 1.
I20260709 13:10:02.457943 24396 raft_consensus.cc:2468] T a14d80b5fd8747d3b44afc1fc32ecffa P ba007af05f0f4fb3aa79a70a4ed62188 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89434398bef1483abb7170861c595c08 in term 1.
I20260709 13:10:02.458099 24286 leader_election.cc:304] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P f39804e3bc0e439286a172ab4c75e032 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89434398bef1483abb7170861c595c08, f39804e3bc0e439286a172ab4c75e032; no voters: 
I20260709 13:10:02.458935 24481 raft_consensus.cc:2804] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P f39804e3bc0e439286a172ab4c75e032 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:02.459393 24481 raft_consensus.cc:697] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P f39804e3bc0e439286a172ab4c75e032 [term 1 LEADER]: Becoming Leader. State: Replica: f39804e3bc0e439286a172ab4c75e032, State: Running, Role: LEADER
I20260709 13:10:02.460170 24481 consensus_queue.cc:237] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P f39804e3bc0e439286a172ab4c75e032 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:02.462466 24397 raft_consensus.cc:2468] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P ba007af05f0f4fb3aa79a70a4ed62188 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f39804e3bc0e439286a172ab4c75e032 in term 1.
I20260709 13:10:02.473320 24145 catalog_manager.cc:5697] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P f39804e3bc0e439286a172ab4c75e032 reported cstate change: term changed from 0 to 1, leader changed from <none> to f39804e3bc0e439286a172ab4c75e032 (127.23.140.66). New cstate: current_term: 1 leader_uuid: "f39804e3bc0e439286a172ab4c75e032" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:02.487104 24145 catalog_manager.cc:5697] T a14d80b5fd8747d3b44afc1fc32ecffa P 89434398bef1483abb7170861c595c08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89434398bef1483abb7170861c595c08 (127.23.140.65). New cstate: current_term: 1 leader_uuid: "89434398bef1483abb7170861c595c08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:02.508097 24247 raft_consensus.cc:3060] T 072781c592984c6a9a6f3d8790809bd1 P 89434398bef1483abb7170861c595c08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.514070 24481 consensus_queue.cc:1048] T 072781c592984c6a9a6f3d8790809bd1 P f39804e3bc0e439286a172ab4c75e032 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:02.525429 24481 consensus_queue.cc:1048] T 072781c592984c6a9a6f3d8790809bd1 P f39804e3bc0e439286a172ab4c75e032 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:02.526268 24470 consensus_queue.cc:1048] T fdb7ba4cacaf498d83b351d63a57aa7b P 89434398bef1483abb7170861c595c08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:02.547940 24470 consensus_queue.cc:1048] T fdb7ba4cacaf498d83b351d63a57aa7b P 89434398bef1483abb7170861c595c08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:02.641815 24397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4607544e6a241349a1a35df8aaca446"
dest_uuid: "ba007af05f0f4fb3aa79a70a4ed62188"
mode: GRACEFUL
new_leader_uuid: "89434398bef1483abb7170861c595c08"
 from {username='slave'} at 127.0.0.1:48684
I20260709 13:10:02.642418 24397 raft_consensus.cc:606] T c4607544e6a241349a1a35df8aaca446 P ba007af05f0f4fb3aa79a70a4ed62188 [term 1 LEADER]: Received request to transfer leadership to TS 89434398bef1483abb7170861c595c08
I20260709 13:10:02.655728 24322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "072781c592984c6a9a6f3d8790809bd1"
dest_uuid: "f39804e3bc0e439286a172ab4c75e032"
mode: GRACEFUL
new_leader_uuid: "89434398bef1483abb7170861c595c08"
 from {username='slave'} at 127.0.0.1:34244
I20260709 13:10:02.656239 24322 raft_consensus.cc:606] T 072781c592984c6a9a6f3d8790809bd1 P f39804e3bc0e439286a172ab4c75e032 [term 1 LEADER]: Received request to transfer leadership to TS 89434398bef1483abb7170861c595c08
I20260709 13:10:02.661100 24397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57caa52201cc4aaba1de74ac8393a6a6"
dest_uuid: "ba007af05f0f4fb3aa79a70a4ed62188"
mode: GRACEFUL
new_leader_uuid: "89434398bef1483abb7170861c595c08"
 from {username='slave'} at 127.0.0.1:48684
I20260709 13:10:02.661576 24397 raft_consensus.cc:606] T 57caa52201cc4aaba1de74ac8393a6a6 P ba007af05f0f4fb3aa79a70a4ed62188 [term 1 LEADER]: Received request to transfer leadership to TS 89434398bef1483abb7170861c595c08
I20260709 13:10:02.663671 24481 raft_consensus.cc:493] T 57caa52201cc4aaba1de74ac8393a6a6 P f39804e3bc0e439286a172ab4c75e032 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.664110 24481 raft_consensus.cc:515] T 57caa52201cc4aaba1de74ac8393a6a6 P f39804e3bc0e439286a172ab4c75e032 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:02.666177 24481 leader_election.cc:290] T 57caa52201cc4aaba1de74ac8393a6a6 P f39804e3bc0e439286a172ab4c75e032 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89434398bef1483abb7170861c595c08 (127.23.140.65:42583), ba007af05f0f4fb3aa79a70a4ed62188 (127.23.140.67:39155)
I20260709 13:10:02.667575 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57caa52201cc4aaba1de74ac8393a6a6" candidate_uuid: "f39804e3bc0e439286a172ab4c75e032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" is_pre_election: true
I20260709 13:10:02.667784 24396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3529531034c4da8ace2a1b8bcc7c934"
dest_uuid: "ba007af05f0f4fb3aa79a70a4ed62188"
mode: GRACEFUL
new_leader_uuid: "f39804e3bc0e439286a172ab4c75e032"
 from {username='slave'} at 127.0.0.1:48684
I20260709 13:10:02.668335 24396 raft_consensus.cc:606] T d3529531034c4da8ace2a1b8bcc7c934 P ba007af05f0f4fb3aa79a70a4ed62188 [term 1 LEADER]: Received request to transfer leadership to TS f39804e3bc0e439286a172ab4c75e032
I20260709 13:10:02.669796 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57caa52201cc4aaba1de74ac8393a6a6" candidate_uuid: "f39804e3bc0e439286a172ab4c75e032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89434398bef1483abb7170861c595c08" is_pre_election: true
I20260709 13:10:02.670511 24247 raft_consensus.cc:2393] T 57caa52201cc4aaba1de74ac8393a6a6 P 89434398bef1483abb7170861c595c08 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f39804e3bc0e439286a172ab4c75e032 in current term 1: Already voted for candidate ba007af05f0f4fb3aa79a70a4ed62188 in this term.
I20260709 13:10:02.671605 24286 leader_election.cc:304] T 57caa52201cc4aaba1de74ac8393a6a6 P f39804e3bc0e439286a172ab4c75e032 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f39804e3bc0e439286a172ab4c75e032; no voters: 89434398bef1483abb7170861c595c08, ba007af05f0f4fb3aa79a70a4ed62188
I20260709 13:10:02.672446 24481 raft_consensus.cc:3060] T 57caa52201cc4aaba1de74ac8393a6a6 P f39804e3bc0e439286a172ab4c75e032 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.677342 24396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2b8f465407049c093b74b89e0cc8fc3"
dest_uuid: "ba007af05f0f4fb3aa79a70a4ed62188"
mode: GRACEFUL
new_leader_uuid: "f39804e3bc0e439286a172ab4c75e032"
 from {username='slave'} at 127.0.0.1:48684
I20260709 13:10:02.677950 24396 raft_consensus.cc:606] T a2b8f465407049c093b74b89e0cc8fc3 P ba007af05f0f4fb3aa79a70a4ed62188 [term 1 LEADER]: Received request to transfer leadership to TS f39804e3bc0e439286a172ab4c75e032
I20260709 13:10:02.678072 24481 raft_consensus.cc:2749] T 57caa52201cc4aaba1de74ac8393a6a6 P f39804e3bc0e439286a172ab4c75e032 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:02.682570 24470 consensus_queue.cc:1048] T 2824545a6ec14281b292a9a80984e5d7 P 89434398bef1483abb7170861c595c08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:02.702466 24447 consensus_queue.cc:1048] T 2824545a6ec14281b292a9a80984e5d7 P 89434398bef1483abb7170861c595c08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:02.703734 24247 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2824545a6ec14281b292a9a80984e5d7"
dest_uuid: "89434398bef1483abb7170861c595c08"
mode: GRACEFUL
new_leader_uuid: "f39804e3bc0e439286a172ab4c75e032"
 from {username='slave'} at 127.0.0.1:34914
I20260709 13:10:02.704310 24247 raft_consensus.cc:606] T 2824545a6ec14281b292a9a80984e5d7 P 89434398bef1483abb7170861c595c08 [term 1 LEADER]: Received request to transfer leadership to TS f39804e3bc0e439286a172ab4c75e032
I20260709 13:10:02.715395 24247 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a14d80b5fd8747d3b44afc1fc32ecffa"
dest_uuid: "89434398bef1483abb7170861c595c08"
mode: GRACEFUL
new_leader_uuid: "ba007af05f0f4fb3aa79a70a4ed62188"
 from {username='slave'} at 127.0.0.1:34914
I20260709 13:10:02.715873 24247 raft_consensus.cc:606] T a14d80b5fd8747d3b44afc1fc32ecffa P 89434398bef1483abb7170861c595c08 [term 1 LEADER]: Received request to transfer leadership to TS ba007af05f0f4fb3aa79a70a4ed62188
I20260709 13:10:02.762632 24500 raft_consensus.cc:993] T a2b8f465407049c093b74b89e0cc8fc3 P ba007af05f0f4fb3aa79a70a4ed62188: : Instructing follower f39804e3bc0e439286a172ab4c75e032 to start an election
I20260709 13:10:02.763132 24469 raft_consensus.cc:1081] T a2b8f465407049c093b74b89e0cc8fc3 P ba007af05f0f4fb3aa79a70a4ed62188 [term 1 LEADER]: Signalling peer f39804e3bc0e439286a172ab4c75e032 to start an election
I20260709 13:10:02.764987 24322 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a2b8f465407049c093b74b89e0cc8fc3"
dest_uuid: "f39804e3bc0e439286a172ab4c75e032"
 from {username='slave'} at 127.0.0.1:34224
I20260709 13:10:02.765583 24322 raft_consensus.cc:493] T a2b8f465407049c093b74b89e0cc8fc3 P f39804e3bc0e439286a172ab4c75e032 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:02.765976 24322 raft_consensus.cc:3060] T a2b8f465407049c093b74b89e0cc8fc3 P f39804e3bc0e439286a172ab4c75e032 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:02.770594 24322 raft_consensus.cc:515] T a2b8f465407049c093b74b89e0cc8fc3 P f39804e3bc0e439286a172ab4c75e032 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:02.772907 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8f465407049c093b74b89e0cc8fc3" candidate_uuid: "f39804e3bc0e439286a172ab4c75e032" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89434398bef1483abb7170861c595c08"
I20260709 13:10:02.773186 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8f465407049c093b74b89e0cc8fc3" candidate_uuid: "f39804e3bc0e439286a172ab4c75e032" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba007af05f0f4fb3aa79a70a4ed62188"
I20260709 13:10:02.773422 24247 raft_consensus.cc:3060] T a2b8f465407049c093b74b89e0cc8fc3 P 89434398bef1483abb7170861c595c08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:02.773324 24322 leader_election.cc:290] T a2b8f465407049c093b74b89e0cc8fc3 P f39804e3bc0e439286a172ab4c75e032 [CANDIDATE]: Term 2 election: Requested vote from peers 89434398bef1483abb7170861c595c08 (127.23.140.65:42583), ba007af05f0f4fb3aa79a70a4ed62188 (127.23.140.67:39155)
I20260709 13:10:02.773815 24396 raft_consensus.cc:3055] T a2b8f465407049c093b74b89e0cc8fc3 P ba007af05f0f4fb3aa79a70a4ed62188 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:02.774282 24396 raft_consensus.cc:740] T a2b8f465407049c093b74b89e0cc8fc3 P ba007af05f0f4fb3aa79a70a4ed62188 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ba007af05f0f4fb3aa79a70a4ed62188, State: Running, Role: LEADER
I20260709 13:10:02.775075 24396 consensus_queue.cc:260] T a2b8f465407049c093b74b89e0cc8fc3 P ba007af05f0f4fb3aa79a70a4ed62188 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:02.776397 24396 raft_consensus.cc:3060] T a2b8f465407049c093b74b89e0cc8fc3 P ba007af05f0f4fb3aa79a70a4ed62188 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:02.778221 24247 raft_consensus.cc:2468] T a2b8f465407049c093b74b89e0cc8fc3 P 89434398bef1483abb7170861c595c08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f39804e3bc0e439286a172ab4c75e032 in term 2.
I20260709 13:10:02.779204 24286 leader_election.cc:304] T a2b8f465407049c093b74b89e0cc8fc3 P f39804e3bc0e439286a172ab4c75e032 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89434398bef1483abb7170861c595c08, f39804e3bc0e439286a172ab4c75e032; no voters: 
I20260709 13:10:02.779857 24481 raft_consensus.cc:2804] T a2b8f465407049c093b74b89e0cc8fc3 P f39804e3bc0e439286a172ab4c75e032 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:02.780292 24481 raft_consensus.cc:697] T a2b8f465407049c093b74b89e0cc8fc3 P f39804e3bc0e439286a172ab4c75e032 [term 2 LEADER]: Becoming Leader. State: Replica: f39804e3bc0e439286a172ab4c75e032, State: Running, Role: LEADER
I20260709 13:10:02.780983 24481 consensus_queue.cc:237] T a2b8f465407049c093b74b89e0cc8fc3 P f39804e3bc0e439286a172ab4c75e032 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:02.782720 24396 raft_consensus.cc:2468] T a2b8f465407049c093b74b89e0cc8fc3 P ba007af05f0f4fb3aa79a70a4ed62188 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f39804e3bc0e439286a172ab4c75e032 in term 2.
I20260709 13:10:02.787621 24144 catalog_manager.cc:5697] T a2b8f465407049c093b74b89e0cc8fc3 P f39804e3bc0e439286a172ab4c75e032 reported cstate change: term changed from 1 to 2, leader changed from ba007af05f0f4fb3aa79a70a4ed62188 (127.23.140.67) to f39804e3bc0e439286a172ab4c75e032 (127.23.140.66). New cstate: current_term: 2 leader_uuid: "f39804e3bc0e439286a172ab4c75e032" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:02.818078 24469 consensus_queue.cc:1048] T 57caa52201cc4aaba1de74ac8393a6a6 P ba007af05f0f4fb3aa79a70a4ed62188 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:02.824540 24500 raft_consensus.cc:993] T 57caa52201cc4aaba1de74ac8393a6a6 P ba007af05f0f4fb3aa79a70a4ed62188: : Instructing follower 89434398bef1483abb7170861c595c08 to start an election
I20260709 13:10:02.824962 24500 raft_consensus.cc:1081] T 57caa52201cc4aaba1de74ac8393a6a6 P ba007af05f0f4fb3aa79a70a4ed62188 [term 1 LEADER]: Signalling peer 89434398bef1483abb7170861c595c08 to start an election
I20260709 13:10:02.826804 24246 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "57caa52201cc4aaba1de74ac8393a6a6"
dest_uuid: "89434398bef1483abb7170861c595c08"
 from {username='slave'} at 127.0.0.1:34906
I20260709 13:10:02.827982 24246 raft_consensus.cc:493] T 57caa52201cc4aaba1de74ac8393a6a6 P 89434398bef1483abb7170861c595c08 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:02.828400 24246 raft_consensus.cc:3060] T 57caa52201cc4aaba1de74ac8393a6a6 P 89434398bef1483abb7170861c595c08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:02.834275 24505 consensus_queue.cc:1048] T 57caa52201cc4aaba1de74ac8393a6a6 P ba007af05f0f4fb3aa79a70a4ed62188 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:02.835408 24246 raft_consensus.cc:515] T 57caa52201cc4aaba1de74ac8393a6a6 P 89434398bef1483abb7170861c595c08 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:02.840003 24246 leader_election.cc:290] T 57caa52201cc4aaba1de74ac8393a6a6 P 89434398bef1483abb7170861c595c08 [CANDIDATE]: Term 2 election: Requested vote from peers f39804e3bc0e439286a172ab4c75e032 (127.23.140.66:37967), ba007af05f0f4fb3aa79a70a4ed62188 (127.23.140.67:39155)
I20260709 13:10:02.844909 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57caa52201cc4aaba1de74ac8393a6a6" candidate_uuid: "89434398bef1483abb7170861c595c08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba007af05f0f4fb3aa79a70a4ed62188"
I20260709 13:10:02.845485 24397 raft_consensus.cc:3055] T 57caa52201cc4aaba1de74ac8393a6a6 P ba007af05f0f4fb3aa79a70a4ed62188 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:02.845818 24397 raft_consensus.cc:740] T 57caa52201cc4aaba1de74ac8393a6a6 P ba007af05f0f4fb3aa79a70a4ed62188 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ba007af05f0f4fb3aa79a70a4ed62188, State: Running, Role: LEADER
I20260709 13:10:02.846578 24397 consensus_queue.cc:260] T 57caa52201cc4aaba1de74ac8393a6a6 P ba007af05f0f4fb3aa79a70a4ed62188 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:02.847630 24397 raft_consensus.cc:3060] T 57caa52201cc4aaba1de74ac8393a6a6 P ba007af05f0f4fb3aa79a70a4ed62188 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:02.853180 24481 consensus_queue.cc:1048] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P f39804e3bc0e439286a172ab4c75e032 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:02.854182 24397 raft_consensus.cc:2468] T 57caa52201cc4aaba1de74ac8393a6a6 P ba007af05f0f4fb3aa79a70a4ed62188 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89434398bef1483abb7170861c595c08 in term 2.
I20260709 13:10:02.857090 24213 leader_election.cc:304] T 57caa52201cc4aaba1de74ac8393a6a6 P 89434398bef1483abb7170861c595c08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89434398bef1483abb7170861c595c08, ba007af05f0f4fb3aa79a70a4ed62188; no voters: 
I20260709 13:10:02.857935 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57caa52201cc4aaba1de74ac8393a6a6" candidate_uuid: "89434398bef1483abb7170861c595c08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f39804e3bc0e439286a172ab4c75e032"
I20260709 13:10:02.858311 24447 raft_consensus.cc:2804] T 57caa52201cc4aaba1de74ac8393a6a6 P 89434398bef1483abb7170861c595c08 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:02.860208 24322 raft_consensus.cc:3060] T 57caa52201cc4aaba1de74ac8393a6a6 P f39804e3bc0e439286a172ab4c75e032 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:02.860477 24447 raft_consensus.cc:697] T 57caa52201cc4aaba1de74ac8393a6a6 P 89434398bef1483abb7170861c595c08 [term 2 LEADER]: Becoming Leader. State: Replica: 89434398bef1483abb7170861c595c08, State: Running, Role: LEADER
I20260709 13:10:02.861672 24449 consensus_queue.cc:1048] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P f39804e3bc0e439286a172ab4c75e032 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:02.861347 24447 consensus_queue.cc:237] T 57caa52201cc4aaba1de74ac8393a6a6 P 89434398bef1483abb7170861c595c08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:02.862998 24505 consensus_queue.cc:1048] T d3529531034c4da8ace2a1b8bcc7c934 P ba007af05f0f4fb3aa79a70a4ed62188 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:02.873342 24322 raft_consensus.cc:2468] T 57caa52201cc4aaba1de74ac8393a6a6 P f39804e3bc0e439286a172ab4c75e032 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89434398bef1483abb7170861c595c08 in term 2.
I20260709 13:10:02.879055 24144 catalog_manager.cc:5697] T 57caa52201cc4aaba1de74ac8393a6a6 P 89434398bef1483abb7170861c595c08 reported cstate change: term changed from 1 to 2, leader changed from ba007af05f0f4fb3aa79a70a4ed62188 (127.23.140.67) to 89434398bef1483abb7170861c595c08 (127.23.140.65). New cstate: current_term: 2 leader_uuid: "89434398bef1483abb7170861c595c08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:02.901830 24500 consensus_queue.cc:1048] T d3529531034c4da8ace2a1b8bcc7c934 P ba007af05f0f4fb3aa79a70a4ed62188 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:02.922747 24500 raft_consensus.cc:993] T d3529531034c4da8ace2a1b8bcc7c934 P ba007af05f0f4fb3aa79a70a4ed62188: : Instructing follower f39804e3bc0e439286a172ab4c75e032 to start an election
I20260709 13:10:02.923296 24500 raft_consensus.cc:1081] T d3529531034c4da8ace2a1b8bcc7c934 P ba007af05f0f4fb3aa79a70a4ed62188 [term 1 LEADER]: Signalling peer f39804e3bc0e439286a172ab4c75e032 to start an election
I20260709 13:10:02.925052 24322 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d3529531034c4da8ace2a1b8bcc7c934"
dest_uuid: "f39804e3bc0e439286a172ab4c75e032"
 from {username='slave'} at 127.0.0.1:34224
I20260709 13:10:02.925654 24322 raft_consensus.cc:493] T d3529531034c4da8ace2a1b8bcc7c934 P f39804e3bc0e439286a172ab4c75e032 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:02.926090 24322 raft_consensus.cc:3060] T d3529531034c4da8ace2a1b8bcc7c934 P f39804e3bc0e439286a172ab4c75e032 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:02.928071 24469 raft_consensus.cc:993] T c4607544e6a241349a1a35df8aaca446 P ba007af05f0f4fb3aa79a70a4ed62188: : Instructing follower 89434398bef1483abb7170861c595c08 to start an election
I20260709 13:10:02.928478 24469 raft_consensus.cc:1081] T c4607544e6a241349a1a35df8aaca446 P ba007af05f0f4fb3aa79a70a4ed62188 [term 1 LEADER]: Signalling peer 89434398bef1483abb7170861c595c08 to start an election
I20260709 13:10:02.929991 24247 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c4607544e6a241349a1a35df8aaca446"
dest_uuid: "89434398bef1483abb7170861c595c08"
 from {username='slave'} at 127.0.0.1:34906
I20260709 13:10:02.930500 24247 raft_consensus.cc:493] T c4607544e6a241349a1a35df8aaca446 P 89434398bef1483abb7170861c595c08 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:02.930827 24247 raft_consensus.cc:3060] T c4607544e6a241349a1a35df8aaca446 P 89434398bef1483abb7170861c595c08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:02.933596 24322 raft_consensus.cc:515] T d3529531034c4da8ace2a1b8bcc7c934 P f39804e3bc0e439286a172ab4c75e032 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:02.936328 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3529531034c4da8ace2a1b8bcc7c934" candidate_uuid: "f39804e3bc0e439286a172ab4c75e032" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89434398bef1483abb7170861c595c08"
I20260709 13:10:02.936892 24248 raft_consensus.cc:3060] T d3529531034c4da8ace2a1b8bcc7c934 P 89434398bef1483abb7170861c595c08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:02.937189 24247 raft_consensus.cc:515] T c4607544e6a241349a1a35df8aaca446 P 89434398bef1483abb7170861c595c08 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:02.942651 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4607544e6a241349a1a35df8aaca446" candidate_uuid: "89434398bef1483abb7170861c595c08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f39804e3bc0e439286a172ab4c75e032"
I20260709 13:10:02.943200 24323 raft_consensus.cc:3060] T c4607544e6a241349a1a35df8aaca446 P f39804e3bc0e439286a172ab4c75e032 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:02.943323 24248 raft_consensus.cc:2468] T d3529531034c4da8ace2a1b8bcc7c934 P 89434398bef1483abb7170861c595c08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f39804e3bc0e439286a172ab4c75e032 in term 2.
I20260709 13:10:02.944593 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4607544e6a241349a1a35df8aaca446" candidate_uuid: "89434398bef1483abb7170861c595c08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba007af05f0f4fb3aa79a70a4ed62188"
I20260709 13:10:02.945118 24397 raft_consensus.cc:3055] T c4607544e6a241349a1a35df8aaca446 P ba007af05f0f4fb3aa79a70a4ed62188 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:02.945423 24397 raft_consensus.cc:740] T c4607544e6a241349a1a35df8aaca446 P ba007af05f0f4fb3aa79a70a4ed62188 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ba007af05f0f4fb3aa79a70a4ed62188, State: Running, Role: LEADER
I20260709 13:10:02.946179 24397 consensus_queue.cc:260] T c4607544e6a241349a1a35df8aaca446 P ba007af05f0f4fb3aa79a70a4ed62188 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:02.947176 24397 raft_consensus.cc:3060] T c4607544e6a241349a1a35df8aaca446 P ba007af05f0f4fb3aa79a70a4ed62188 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:02.948256 24286 leader_election.cc:304] T d3529531034c4da8ace2a1b8bcc7c934 P f39804e3bc0e439286a172ab4c75e032 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89434398bef1483abb7170861c595c08, f39804e3bc0e439286a172ab4c75e032; no voters: 
I20260709 13:10:02.949064 24481 raft_consensus.cc:2804] T d3529531034c4da8ace2a1b8bcc7c934 P f39804e3bc0e439286a172ab4c75e032 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:02.949532 24481 raft_consensus.cc:697] T d3529531034c4da8ace2a1b8bcc7c934 P f39804e3bc0e439286a172ab4c75e032 [term 2 LEADER]: Becoming Leader. State: Replica: f39804e3bc0e439286a172ab4c75e032, State: Running, Role: LEADER
I20260709 13:10:02.949673 24323 raft_consensus.cc:2468] T c4607544e6a241349a1a35df8aaca446 P f39804e3bc0e439286a172ab4c75e032 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89434398bef1483abb7170861c595c08 in term 2.
I20260709 13:10:02.950382 24481 consensus_queue.cc:237] T d3529531034c4da8ace2a1b8bcc7c934 P f39804e3bc0e439286a172ab4c75e032 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:02.953403 24397 raft_consensus.cc:2468] T c4607544e6a241349a1a35df8aaca446 P ba007af05f0f4fb3aa79a70a4ed62188 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89434398bef1483abb7170861c595c08 in term 2.
I20260709 13:10:02.954222 24247 leader_election.cc:290] T c4607544e6a241349a1a35df8aaca446 P 89434398bef1483abb7170861c595c08 [CANDIDATE]: Term 2 election: Requested vote from peers f39804e3bc0e439286a172ab4c75e032 (127.23.140.66:37967), ba007af05f0f4fb3aa79a70a4ed62188 (127.23.140.67:39155)
I20260709 13:10:02.954668 24213 leader_election.cc:304] T c4607544e6a241349a1a35df8aaca446 P 89434398bef1483abb7170861c595c08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89434398bef1483abb7170861c595c08, ba007af05f0f4fb3aa79a70a4ed62188; no voters: 
I20260709 13:10:02.955586 24322 leader_election.cc:290] T d3529531034c4da8ace2a1b8bcc7c934 P f39804e3bc0e439286a172ab4c75e032 [CANDIDATE]: Term 2 election: Requested vote from peers 89434398bef1483abb7170861c595c08 (127.23.140.65:42583), ba007af05f0f4fb3aa79a70a4ed62188 (127.23.140.67:39155)
I20260709 13:10:02.956164 24447 raft_consensus.cc:2804] T c4607544e6a241349a1a35df8aaca446 P 89434398bef1483abb7170861c595c08 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:02.956637 24447 raft_consensus.cc:697] T c4607544e6a241349a1a35df8aaca446 P 89434398bef1483abb7170861c595c08 [term 2 LEADER]: Becoming Leader. State: Replica: 89434398bef1483abb7170861c595c08, State: Running, Role: LEADER
I20260709 13:10:02.956714 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3529531034c4da8ace2a1b8bcc7c934" candidate_uuid: "f39804e3bc0e439286a172ab4c75e032" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba007af05f0f4fb3aa79a70a4ed62188"
I20260709 13:10:02.957267 24397 raft_consensus.cc:3055] T d3529531034c4da8ace2a1b8bcc7c934 P ba007af05f0f4fb3aa79a70a4ed62188 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:02.957619 24397 raft_consensus.cc:740] T d3529531034c4da8ace2a1b8bcc7c934 P ba007af05f0f4fb3aa79a70a4ed62188 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ba007af05f0f4fb3aa79a70a4ed62188, State: Running, Role: LEADER
I20260709 13:10:02.957469 24447 consensus_queue.cc:237] T c4607544e6a241349a1a35df8aaca446 P 89434398bef1483abb7170861c595c08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:02.958487 24397 consensus_queue.cc:260] T d3529531034c4da8ace2a1b8bcc7c934 P ba007af05f0f4fb3aa79a70a4ed62188 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:02.958595 24143 catalog_manager.cc:5697] T d3529531034c4da8ace2a1b8bcc7c934 P f39804e3bc0e439286a172ab4c75e032 reported cstate change: term changed from 1 to 2, leader changed from ba007af05f0f4fb3aa79a70a4ed62188 (127.23.140.67) to f39804e3bc0e439286a172ab4c75e032 (127.23.140.66). New cstate: current_term: 2 leader_uuid: "f39804e3bc0e439286a172ab4c75e032" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:02.959796 24397 raft_consensus.cc:3060] T d3529531034c4da8ace2a1b8bcc7c934 P ba007af05f0f4fb3aa79a70a4ed62188 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:02.965497 24144 catalog_manager.cc:5697] T c4607544e6a241349a1a35df8aaca446 P 89434398bef1483abb7170861c595c08 reported cstate change: term changed from 1 to 2, leader changed from ba007af05f0f4fb3aa79a70a4ed62188 (127.23.140.67) to 89434398bef1483abb7170861c595c08 (127.23.140.65). New cstate: current_term: 2 leader_uuid: "89434398bef1483abb7170861c595c08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:02.969184 24397 raft_consensus.cc:2468] T d3529531034c4da8ace2a1b8bcc7c934 P ba007af05f0f4fb3aa79a70a4ed62188 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f39804e3bc0e439286a172ab4c75e032 in term 2.
I20260709 13:10:03.010761 24481 raft_consensus.cc:993] T 072781c592984c6a9a6f3d8790809bd1 P f39804e3bc0e439286a172ab4c75e032: : Instructing follower 89434398bef1483abb7170861c595c08 to start an election
I20260709 13:10:03.011202 24449 raft_consensus.cc:1081] T 072781c592984c6a9a6f3d8790809bd1 P f39804e3bc0e439286a172ab4c75e032 [term 1 LEADER]: Signalling peer 89434398bef1483abb7170861c595c08 to start an election
I20260709 13:10:03.012770 24248 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "072781c592984c6a9a6f3d8790809bd1"
dest_uuid: "89434398bef1483abb7170861c595c08"
 from {username='slave'} at 127.0.0.1:34912
I20260709 13:10:03.013257 24248 raft_consensus.cc:493] T 072781c592984c6a9a6f3d8790809bd1 P 89434398bef1483abb7170861c595c08 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:03.013561 24248 raft_consensus.cc:3060] T 072781c592984c6a9a6f3d8790809bd1 P 89434398bef1483abb7170861c595c08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:03.018148 24248 raft_consensus.cc:515] T 072781c592984c6a9a6f3d8790809bd1 P 89434398bef1483abb7170861c595c08 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:03.020279 24248 leader_election.cc:290] T 072781c592984c6a9a6f3d8790809bd1 P 89434398bef1483abb7170861c595c08 [CANDIDATE]: Term 2 election: Requested vote from peers f39804e3bc0e439286a172ab4c75e032 (127.23.140.66:37967), ba007af05f0f4fb3aa79a70a4ed62188 (127.23.140.67:39155)
I20260709 13:10:03.020754 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "072781c592984c6a9a6f3d8790809bd1" candidate_uuid: "89434398bef1483abb7170861c595c08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f39804e3bc0e439286a172ab4c75e032"
I20260709 13:10:03.021469 24322 raft_consensus.cc:3055] T 072781c592984c6a9a6f3d8790809bd1 P f39804e3bc0e439286a172ab4c75e032 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:03.021800 24322 raft_consensus.cc:740] T 072781c592984c6a9a6f3d8790809bd1 P f39804e3bc0e439286a172ab4c75e032 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f39804e3bc0e439286a172ab4c75e032, State: Running, Role: LEADER
I20260709 13:10:03.022122 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "072781c592984c6a9a6f3d8790809bd1" candidate_uuid: "89434398bef1483abb7170861c595c08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba007af05f0f4fb3aa79a70a4ed62188"
I20260709 13:10:03.022668 24396 raft_consensus.cc:3060] T 072781c592984c6a9a6f3d8790809bd1 P ba007af05f0f4fb3aa79a70a4ed62188 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:03.022574 24322 consensus_queue.cc:260] T 072781c592984c6a9a6f3d8790809bd1 P f39804e3bc0e439286a172ab4c75e032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:03.023579 24468 consensus_queue.cc:1048] T a14d80b5fd8747d3b44afc1fc32ecffa P 89434398bef1483abb7170861c595c08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:03.023788 24322 raft_consensus.cc:3060] T 072781c592984c6a9a6f3d8790809bd1 P f39804e3bc0e439286a172ab4c75e032 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:03.030393 24322 raft_consensus.cc:2468] T 072781c592984c6a9a6f3d8790809bd1 P f39804e3bc0e439286a172ab4c75e032 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89434398bef1483abb7170861c595c08 in term 2.
I20260709 13:10:03.031522 24214 leader_election.cc:304] T 072781c592984c6a9a6f3d8790809bd1 P 89434398bef1483abb7170861c595c08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89434398bef1483abb7170861c595c08, f39804e3bc0e439286a172ab4c75e032; no voters: 
I20260709 13:10:03.031663 24396 raft_consensus.cc:2468] T 072781c592984c6a9a6f3d8790809bd1 P ba007af05f0f4fb3aa79a70a4ed62188 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89434398bef1483abb7170861c595c08 in term 2.
I20260709 13:10:03.032353 24468 raft_consensus.cc:2804] T 072781c592984c6a9a6f3d8790809bd1 P 89434398bef1483abb7170861c595c08 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:03.032827 24468 raft_consensus.cc:697] T 072781c592984c6a9a6f3d8790809bd1 P 89434398bef1483abb7170861c595c08 [term 2 LEADER]: Becoming Leader. State: Replica: 89434398bef1483abb7170861c595c08, State: Running, Role: LEADER
I20260709 13:10:03.033629 24468 consensus_queue.cc:237] T 072781c592984c6a9a6f3d8790809bd1 P 89434398bef1483abb7170861c595c08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:03.037891 24470 raft_consensus.cc:993] T a14d80b5fd8747d3b44afc1fc32ecffa P 89434398bef1483abb7170861c595c08: : Instructing follower ba007af05f0f4fb3aa79a70a4ed62188 to start an election
I20260709 13:10:03.038769 24447 raft_consensus.cc:1081] T a14d80b5fd8747d3b44afc1fc32ecffa P 89434398bef1483abb7170861c595c08 [term 1 LEADER]: Signalling peer ba007af05f0f4fb3aa79a70a4ed62188 to start an election
I20260709 13:10:03.041491 24396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a14d80b5fd8747d3b44afc1fc32ecffa"
dest_uuid: "ba007af05f0f4fb3aa79a70a4ed62188"
 from {username='slave'} at 127.0.0.1:48664
I20260709 13:10:03.042192 24143 catalog_manager.cc:5697] T 072781c592984c6a9a6f3d8790809bd1 P 89434398bef1483abb7170861c595c08 reported cstate change: term changed from 1 to 2, leader changed from f39804e3bc0e439286a172ab4c75e032 (127.23.140.66) to 89434398bef1483abb7170861c595c08 (127.23.140.65). New cstate: current_term: 2 leader_uuid: "89434398bef1483abb7170861c595c08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:03.042809 24396 raft_consensus.cc:493] T a14d80b5fd8747d3b44afc1fc32ecffa P ba007af05f0f4fb3aa79a70a4ed62188 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:03.043430 24396 raft_consensus.cc:3060] T a14d80b5fd8747d3b44afc1fc32ecffa P ba007af05f0f4fb3aa79a70a4ed62188 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:03.053275 24396 raft_consensus.cc:515] T a14d80b5fd8747d3b44afc1fc32ecffa P ba007af05f0f4fb3aa79a70a4ed62188 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:03.056653 24397 raft_consensus.cc:1240] T a14d80b5fd8747d3b44afc1fc32ecffa P ba007af05f0f4fb3aa79a70a4ed62188 [term 2 FOLLOWER]: Rejecting Update request from peer 89434398bef1483abb7170861c595c08 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:03.058274 24396 leader_election.cc:290] T a14d80b5fd8747d3b44afc1fc32ecffa P ba007af05f0f4fb3aa79a70a4ed62188 [CANDIDATE]: Term 2 election: Requested vote from peers 89434398bef1483abb7170861c595c08 (127.23.140.65:42583), f39804e3bc0e439286a172ab4c75e032 (127.23.140.66:37967)
I20260709 13:10:03.061553 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14d80b5fd8747d3b44afc1fc32ecffa" candidate_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89434398bef1483abb7170861c595c08"
I20260709 13:10:03.055558 24447 consensus_queue.cc:1048] T a14d80b5fd8747d3b44afc1fc32ecffa P 89434398bef1483abb7170861c595c08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:03.063148 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14d80b5fd8747d3b44afc1fc32ecffa" candidate_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f39804e3bc0e439286a172ab4c75e032"
I20260709 13:10:03.063798 24322 raft_consensus.cc:3060] T a14d80b5fd8747d3b44afc1fc32ecffa P f39804e3bc0e439286a172ab4c75e032 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:03.065706 24248 raft_consensus.cc:3055] T a14d80b5fd8747d3b44afc1fc32ecffa P 89434398bef1483abb7170861c595c08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:03.064177 24470 consensus_queue.cc:1059] T a14d80b5fd8747d3b44afc1fc32ecffa P 89434398bef1483abb7170861c595c08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:03.066130 24248 raft_consensus.cc:740] T a14d80b5fd8747d3b44afc1fc32ecffa P 89434398bef1483abb7170861c595c08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89434398bef1483abb7170861c595c08, State: Running, Role: LEADER
I20260709 13:10:03.069375 24248 consensus_queue.cc:260] T a14d80b5fd8747d3b44afc1fc32ecffa P 89434398bef1483abb7170861c595c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:03.070559 24248 raft_consensus.cc:3060] T a14d80b5fd8747d3b44afc1fc32ecffa P 89434398bef1483abb7170861c595c08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:03.074728 24322 raft_consensus.cc:2468] T a14d80b5fd8747d3b44afc1fc32ecffa P f39804e3bc0e439286a172ab4c75e032 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba007af05f0f4fb3aa79a70a4ed62188 in term 2.
I20260709 13:10:03.075513 24323 raft_consensus.cc:1240] T a14d80b5fd8747d3b44afc1fc32ecffa P f39804e3bc0e439286a172ab4c75e032 [term 2 FOLLOWER]: Rejecting Update request from peer 89434398bef1483abb7170861c595c08 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:10:03.076056 24248 raft_consensus.cc:2468] T a14d80b5fd8747d3b44afc1fc32ecffa P 89434398bef1483abb7170861c595c08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba007af05f0f4fb3aa79a70a4ed62188 in term 2.
I20260709 13:10:03.076808 24363 leader_election.cc:304] T a14d80b5fd8747d3b44afc1fc32ecffa P ba007af05f0f4fb3aa79a70a4ed62188 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba007af05f0f4fb3aa79a70a4ed62188, f39804e3bc0e439286a172ab4c75e032; no voters: 
I20260709 13:10:03.077885 24500 raft_consensus.cc:2804] T a14d80b5fd8747d3b44afc1fc32ecffa P ba007af05f0f4fb3aa79a70a4ed62188 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:03.078470 24500 raft_consensus.cc:697] T a14d80b5fd8747d3b44afc1fc32ecffa P ba007af05f0f4fb3aa79a70a4ed62188 [term 2 LEADER]: Becoming Leader. State: Replica: ba007af05f0f4fb3aa79a70a4ed62188, State: Running, Role: LEADER
I20260709 13:10:03.079267 24500 consensus_queue.cc:237] T a14d80b5fd8747d3b44afc1fc32ecffa P ba007af05f0f4fb3aa79a70a4ed62188 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:03.086722 24143 catalog_manager.cc:5697] T a14d80b5fd8747d3b44afc1fc32ecffa P ba007af05f0f4fb3aa79a70a4ed62188 reported cstate change: term changed from 1 to 2, leader changed from 89434398bef1483abb7170861c595c08 (127.23.140.65) to ba007af05f0f4fb3aa79a70a4ed62188 (127.23.140.67). New cstate: current_term: 2 leader_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:03.189322 24248 raft_consensus.cc:1275] T a2b8f465407049c093b74b89e0cc8fc3 P 89434398bef1483abb7170861c595c08 [term 2 FOLLOWER]: Refusing update from remote peer f39804e3bc0e439286a172ab4c75e032: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:03.190711 24449 consensus_queue.cc:1048] T a2b8f465407049c093b74b89e0cc8fc3 P f39804e3bc0e439286a172ab4c75e032 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:03.198664 24397 raft_consensus.cc:1275] T a2b8f465407049c093b74b89e0cc8fc3 P ba007af05f0f4fb3aa79a70a4ed62188 [term 2 FOLLOWER]: Refusing update from remote peer f39804e3bc0e439286a172ab4c75e032: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:03.200256 24528 consensus_queue.cc:1048] T a2b8f465407049c093b74b89e0cc8fc3 P f39804e3bc0e439286a172ab4c75e032 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:03.241984 24470 raft_consensus.cc:993] T 2824545a6ec14281b292a9a80984e5d7 P 89434398bef1483abb7170861c595c08: : Instructing follower f39804e3bc0e439286a172ab4c75e032 to start an election
I20260709 13:10:03.242457 24470 raft_consensus.cc:1081] T 2824545a6ec14281b292a9a80984e5d7 P 89434398bef1483abb7170861c595c08 [term 1 LEADER]: Signalling peer f39804e3bc0e439286a172ab4c75e032 to start an election
I20260709 13:10:03.243927 24322 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2824545a6ec14281b292a9a80984e5d7"
dest_uuid: "f39804e3bc0e439286a172ab4c75e032"
 from {username='slave'} at 127.0.0.1:34230
I20260709 13:10:03.244453 24322 raft_consensus.cc:493] T 2824545a6ec14281b292a9a80984e5d7 P f39804e3bc0e439286a172ab4c75e032 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:03.244786 24322 raft_consensus.cc:3060] T 2824545a6ec14281b292a9a80984e5d7 P f39804e3bc0e439286a172ab4c75e032 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:03.250952 24322 raft_consensus.cc:515] T 2824545a6ec14281b292a9a80984e5d7 P f39804e3bc0e439286a172ab4c75e032 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:03.252892 24322 leader_election.cc:290] T 2824545a6ec14281b292a9a80984e5d7 P f39804e3bc0e439286a172ab4c75e032 [CANDIDATE]: Term 2 election: Requested vote from peers 89434398bef1483abb7170861c595c08 (127.23.140.65:42583), ba007af05f0f4fb3aa79a70a4ed62188 (127.23.140.67:39155)
I20260709 13:10:03.253827 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2824545a6ec14281b292a9a80984e5d7" candidate_uuid: "f39804e3bc0e439286a172ab4c75e032" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89434398bef1483abb7170861c595c08"
I20260709 13:10:03.253955 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2824545a6ec14281b292a9a80984e5d7" candidate_uuid: "f39804e3bc0e439286a172ab4c75e032" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba007af05f0f4fb3aa79a70a4ed62188"
I20260709 13:10:03.254392 24248 raft_consensus.cc:3055] T 2824545a6ec14281b292a9a80984e5d7 P 89434398bef1483abb7170861c595c08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:03.254554 24397 raft_consensus.cc:3060] T 2824545a6ec14281b292a9a80984e5d7 P ba007af05f0f4fb3aa79a70a4ed62188 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:03.254738 24248 raft_consensus.cc:740] T 2824545a6ec14281b292a9a80984e5d7 P 89434398bef1483abb7170861c595c08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89434398bef1483abb7170861c595c08, State: Running, Role: LEADER
I20260709 13:10:03.255503 24248 consensus_queue.cc:260] T 2824545a6ec14281b292a9a80984e5d7 P 89434398bef1483abb7170861c595c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:03.256580 24248 raft_consensus.cc:3060] T 2824545a6ec14281b292a9a80984e5d7 P 89434398bef1483abb7170861c595c08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:03.259167 24397 raft_consensus.cc:2468] T 2824545a6ec14281b292a9a80984e5d7 P ba007af05f0f4fb3aa79a70a4ed62188 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f39804e3bc0e439286a172ab4c75e032 in term 2.
I20260709 13:10:03.260099 24288 leader_election.cc:304] T 2824545a6ec14281b292a9a80984e5d7 P f39804e3bc0e439286a172ab4c75e032 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba007af05f0f4fb3aa79a70a4ed62188, f39804e3bc0e439286a172ab4c75e032; no voters: 
I20260709 13:10:03.260797 24528 raft_consensus.cc:2804] T 2824545a6ec14281b292a9a80984e5d7 P f39804e3bc0e439286a172ab4c75e032 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:03.261195 24528 raft_consensus.cc:697] T 2824545a6ec14281b292a9a80984e5d7 P f39804e3bc0e439286a172ab4c75e032 [term 2 LEADER]: Becoming Leader. State: Replica: f39804e3bc0e439286a172ab4c75e032, State: Running, Role: LEADER
I20260709 13:10:03.261998 24528 consensus_queue.cc:237] T 2824545a6ec14281b292a9a80984e5d7 P f39804e3bc0e439286a172ab4c75e032 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:03.262485 24248 raft_consensus.cc:2468] T 2824545a6ec14281b292a9a80984e5d7 P 89434398bef1483abb7170861c595c08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f39804e3bc0e439286a172ab4c75e032 in term 2.
I20260709 13:10:03.267962 24143 catalog_manager.cc:5697] T 2824545a6ec14281b292a9a80984e5d7 P f39804e3bc0e439286a172ab4c75e032 reported cstate change: term changed from 1 to 2, leader changed from 89434398bef1483abb7170861c595c08 (127.23.140.65) to f39804e3bc0e439286a172ab4c75e032 (127.23.140.66). New cstate: current_term: 2 leader_uuid: "f39804e3bc0e439286a172ab4c75e032" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:03.323297 24323 raft_consensus.cc:1275] T 57caa52201cc4aaba1de74ac8393a6a6 P f39804e3bc0e439286a172ab4c75e032 [term 2 FOLLOWER]: Refusing update from remote peer 89434398bef1483abb7170861c595c08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:03.324529 24527 consensus_queue.cc:1048] T 57caa52201cc4aaba1de74ac8393a6a6 P 89434398bef1483abb7170861c595c08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:03.331391 24397 raft_consensus.cc:1275] T 57caa52201cc4aaba1de74ac8393a6a6 P ba007af05f0f4fb3aa79a70a4ed62188 [term 2 FOLLOWER]: Refusing update from remote peer 89434398bef1483abb7170861c595c08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:03.332873 24527 consensus_queue.cc:1048] T 57caa52201cc4aaba1de74ac8393a6a6 P 89434398bef1483abb7170861c595c08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:03.349324 24397 raft_consensus.cc:1275] T d3529531034c4da8ace2a1b8bcc7c934 P ba007af05f0f4fb3aa79a70a4ed62188 [term 2 FOLLOWER]: Refusing update from remote peer f39804e3bc0e439286a172ab4c75e032: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:03.350605 24528 consensus_queue.cc:1048] T d3529531034c4da8ace2a1b8bcc7c934 P f39804e3bc0e439286a172ab4c75e032 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:03.359294 24248 raft_consensus.cc:1275] T d3529531034c4da8ace2a1b8bcc7c934 P 89434398bef1483abb7170861c595c08 [term 2 FOLLOWER]: Refusing update from remote peer f39804e3bc0e439286a172ab4c75e032: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:03.360762 24481 consensus_queue.cc:1048] T d3529531034c4da8ace2a1b8bcc7c934 P f39804e3bc0e439286a172ab4c75e032 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:03.494166 24248 raft_consensus.cc:1275] T a14d80b5fd8747d3b44afc1fc32ecffa P 89434398bef1483abb7170861c595c08 [term 2 FOLLOWER]: Refusing update from remote peer ba007af05f0f4fb3aa79a70a4ed62188: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:03.495520 24500 consensus_queue.cc:1048] T a14d80b5fd8747d3b44afc1fc32ecffa P ba007af05f0f4fb3aa79a70a4ed62188 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:03.505731 24323 raft_consensus.cc:1275] T a14d80b5fd8747d3b44afc1fc32ecffa P f39804e3bc0e439286a172ab4c75e032 [term 2 FOLLOWER]: Refusing update from remote peer ba007af05f0f4fb3aa79a70a4ed62188: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:03.508028 24530 consensus_queue.cc:1048] T a14d80b5fd8747d3b44afc1fc32ecffa P ba007af05f0f4fb3aa79a70a4ed62188 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:03.509701 24397 raft_consensus.cc:1275] T 072781c592984c6a9a6f3d8790809bd1 P ba007af05f0f4fb3aa79a70a4ed62188 [term 2 FOLLOWER]: Refusing update from remote peer 89434398bef1483abb7170861c595c08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:03.511575 24527 consensus_queue.cc:1048] T 072781c592984c6a9a6f3d8790809bd1 P 89434398bef1483abb7170861c595c08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:03.523039 24323 raft_consensus.cc:1275] T c4607544e6a241349a1a35df8aaca446 P f39804e3bc0e439286a172ab4c75e032 [term 2 FOLLOWER]: Refusing update from remote peer 89434398bef1483abb7170861c595c08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:03.526253 24323 raft_consensus.cc:1275] T 072781c592984c6a9a6f3d8790809bd1 P f39804e3bc0e439286a172ab4c75e032 [term 2 FOLLOWER]: Refusing update from remote peer 89434398bef1483abb7170861c595c08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:03.528173 24447 consensus_queue.cc:1048] T c4607544e6a241349a1a35df8aaca446 P 89434398bef1483abb7170861c595c08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:03.529472 24447 consensus_queue.cc:1048] T 072781c592984c6a9a6f3d8790809bd1 P 89434398bef1483abb7170861c595c08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:03.538391 24397 raft_consensus.cc:1275] T c4607544e6a241349a1a35df8aaca446 P ba007af05f0f4fb3aa79a70a4ed62188 [term 2 FOLLOWER]: Refusing update from remote peer 89434398bef1483abb7170861c595c08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:03.540113 24527 consensus_queue.cc:1048] T c4607544e6a241349a1a35df8aaca446 P 89434398bef1483abb7170861c595c08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:03.737922 24397 raft_consensus.cc:1275] T 2824545a6ec14281b292a9a80984e5d7 P ba007af05f0f4fb3aa79a70a4ed62188 [term 2 FOLLOWER]: Refusing update from remote peer f39804e3bc0e439286a172ab4c75e032: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:03.738986 24481 consensus_queue.cc:1048] T 2824545a6ec14281b292a9a80984e5d7 P f39804e3bc0e439286a172ab4c75e032 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:03.748728 24248 raft_consensus.cc:1275] T 2824545a6ec14281b292a9a80984e5d7 P 89434398bef1483abb7170861c595c08 [term 2 FOLLOWER]: Refusing update from remote peer f39804e3bc0e439286a172ab4c75e032: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:03.749888 24449 consensus_queue.cc:1048] T 2824545a6ec14281b292a9a80984e5d7 P f39804e3bc0e439286a172ab4c75e032 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:05.743558 24113 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:10:05.744316 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:05.764218 24248 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "072781c592984c6a9a6f3d8790809bd1"
dest_uuid: "89434398bef1483abb7170861c595c08"
mode: GRACEFUL
new_leader_uuid: "ba007af05f0f4fb3aa79a70a4ed62188"
 from {username='slave'} at 127.0.0.1:34924
I20260709 13:10:05.764818 24248 raft_consensus.cc:606] T 072781c592984c6a9a6f3d8790809bd1 P 89434398bef1483abb7170861c595c08 [term 2 LEADER]: Received request to transfer leadership to TS ba007af05f0f4fb3aa79a70a4ed62188
I20260709 13:10:05.774786 24322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3529531034c4da8ace2a1b8bcc7c934"
dest_uuid: "f39804e3bc0e439286a172ab4c75e032"
mode: GRACEFUL
new_leader_uuid: "ba007af05f0f4fb3aa79a70a4ed62188"
 from {username='slave'} at 127.0.0.1:34250
I20260709 13:10:05.775256 24322 raft_consensus.cc:606] T d3529531034c4da8ace2a1b8bcc7c934 P f39804e3bc0e439286a172ab4c75e032 [term 2 LEADER]: Received request to transfer leadership to TS ba007af05f0f4fb3aa79a70a4ed62188
I20260709 13:10:05.776305 24113 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:10:05.776752 24113 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:06.096696 24449 raft_consensus.cc:993] T d3529531034c4da8ace2a1b8bcc7c934 P f39804e3bc0e439286a172ab4c75e032: : Instructing follower ba007af05f0f4fb3aa79a70a4ed62188 to start an election
I20260709 13:10:06.097163 24449 raft_consensus.cc:1081] T d3529531034c4da8ace2a1b8bcc7c934 P f39804e3bc0e439286a172ab4c75e032 [term 2 LEADER]: Signalling peer ba007af05f0f4fb3aa79a70a4ed62188 to start an election
I20260709 13:10:06.098541 24397 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d3529531034c4da8ace2a1b8bcc7c934"
dest_uuid: "ba007af05f0f4fb3aa79a70a4ed62188"
 from {username='slave'} at 127.0.0.1:48678
I20260709 13:10:06.099102 24397 raft_consensus.cc:493] T d3529531034c4da8ace2a1b8bcc7c934 P ba007af05f0f4fb3aa79a70a4ed62188 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:06.099511 24397 raft_consensus.cc:3060] T d3529531034c4da8ace2a1b8bcc7c934 P ba007af05f0f4fb3aa79a70a4ed62188 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:06.104023 24397 raft_consensus.cc:515] T d3529531034c4da8ace2a1b8bcc7c934 P ba007af05f0f4fb3aa79a70a4ed62188 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:06.105816 24397 leader_election.cc:290] T d3529531034c4da8ace2a1b8bcc7c934 P ba007af05f0f4fb3aa79a70a4ed62188 [CANDIDATE]: Term 3 election: Requested vote from peers 89434398bef1483abb7170861c595c08 (127.23.140.65:42583), f39804e3bc0e439286a172ab4c75e032 (127.23.140.66:37967)
I20260709 13:10:06.106516 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3529531034c4da8ace2a1b8bcc7c934" candidate_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "89434398bef1483abb7170861c595c08"
I20260709 13:10:06.106788 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3529531034c4da8ace2a1b8bcc7c934" candidate_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f39804e3bc0e439286a172ab4c75e032"
I20260709 13:10:06.107088 24248 raft_consensus.cc:3060] T d3529531034c4da8ace2a1b8bcc7c934 P 89434398bef1483abb7170861c595c08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:06.107249 24322 raft_consensus.cc:3055] T d3529531034c4da8ace2a1b8bcc7c934 P f39804e3bc0e439286a172ab4c75e032 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:06.107595 24322 raft_consensus.cc:740] T d3529531034c4da8ace2a1b8bcc7c934 P f39804e3bc0e439286a172ab4c75e032 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f39804e3bc0e439286a172ab4c75e032, State: Running, Role: LEADER
I20260709 13:10:06.108309 24322 consensus_queue.cc:260] T d3529531034c4da8ace2a1b8bcc7c934 P f39804e3bc0e439286a172ab4c75e032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:06.110394 24322 raft_consensus.cc:3060] T d3529531034c4da8ace2a1b8bcc7c934 P f39804e3bc0e439286a172ab4c75e032 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:06.113727 24248 raft_consensus.cc:2468] T d3529531034c4da8ace2a1b8bcc7c934 P 89434398bef1483abb7170861c595c08 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba007af05f0f4fb3aa79a70a4ed62188 in term 3.
I20260709 13:10:06.114974 24360 leader_election.cc:304] T d3529531034c4da8ace2a1b8bcc7c934 P ba007af05f0f4fb3aa79a70a4ed62188 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89434398bef1483abb7170861c595c08, ba007af05f0f4fb3aa79a70a4ed62188; no voters: 
I20260709 13:10:06.115731 24538 raft_consensus.cc:2804] T d3529531034c4da8ace2a1b8bcc7c934 P ba007af05f0f4fb3aa79a70a4ed62188 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:06.116719 24322 raft_consensus.cc:2468] T d3529531034c4da8ace2a1b8bcc7c934 P f39804e3bc0e439286a172ab4c75e032 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba007af05f0f4fb3aa79a70a4ed62188 in term 3.
I20260709 13:10:06.117049 24538 raft_consensus.cc:697] T d3529531034c4da8ace2a1b8bcc7c934 P ba007af05f0f4fb3aa79a70a4ed62188 [term 3 LEADER]: Becoming Leader. State: Replica: ba007af05f0f4fb3aa79a70a4ed62188, State: Running, Role: LEADER
I20260709 13:10:06.118844 24538 consensus_queue.cc:237] T d3529531034c4da8ace2a1b8bcc7c934 P ba007af05f0f4fb3aa79a70a4ed62188 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:06.125505 24144 catalog_manager.cc:5697] T d3529531034c4da8ace2a1b8bcc7c934 P ba007af05f0f4fb3aa79a70a4ed62188 reported cstate change: term changed from 2 to 3, leader changed from f39804e3bc0e439286a172ab4c75e032 (127.23.140.66) to ba007af05f0f4fb3aa79a70a4ed62188 (127.23.140.67). New cstate: current_term: 3 leader_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:06.134573 24549 raft_consensus.cc:993] T 072781c592984c6a9a6f3d8790809bd1 P 89434398bef1483abb7170861c595c08: : Instructing follower ba007af05f0f4fb3aa79a70a4ed62188 to start an election
I20260709 13:10:06.135058 24447 raft_consensus.cc:1081] T 072781c592984c6a9a6f3d8790809bd1 P 89434398bef1483abb7170861c595c08 [term 2 LEADER]: Signalling peer ba007af05f0f4fb3aa79a70a4ed62188 to start an election
I20260709 13:10:06.136519 24397 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "072781c592984c6a9a6f3d8790809bd1"
dest_uuid: "ba007af05f0f4fb3aa79a70a4ed62188"
 from {username='slave'} at 127.0.0.1:48664
I20260709 13:10:06.137034 24397 raft_consensus.cc:493] T 072781c592984c6a9a6f3d8790809bd1 P ba007af05f0f4fb3aa79a70a4ed62188 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:06.137377 24397 raft_consensus.cc:3060] T 072781c592984c6a9a6f3d8790809bd1 P ba007af05f0f4fb3aa79a70a4ed62188 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:06.141150 24397 raft_consensus.cc:515] T 072781c592984c6a9a6f3d8790809bd1 P ba007af05f0f4fb3aa79a70a4ed62188 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:06.142472 24397 leader_election.cc:290] T 072781c592984c6a9a6f3d8790809bd1 P ba007af05f0f4fb3aa79a70a4ed62188 [CANDIDATE]: Term 3 election: Requested vote from peers 89434398bef1483abb7170861c595c08 (127.23.140.65:42583), f39804e3bc0e439286a172ab4c75e032 (127.23.140.66:37967)
I20260709 13:10:06.143508 24322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "072781c592984c6a9a6f3d8790809bd1" candidate_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f39804e3bc0e439286a172ab4c75e032"
I20260709 13:10:06.143510 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "072781c592984c6a9a6f3d8790809bd1" candidate_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "89434398bef1483abb7170861c595c08"
I20260709 13:10:06.144197 24322 raft_consensus.cc:3060] T 072781c592984c6a9a6f3d8790809bd1 P f39804e3bc0e439286a172ab4c75e032 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:06.144294 24248 raft_consensus.cc:3055] T 072781c592984c6a9a6f3d8790809bd1 P 89434398bef1483abb7170861c595c08 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:06.144665 24248 raft_consensus.cc:740] T 072781c592984c6a9a6f3d8790809bd1 P 89434398bef1483abb7170861c595c08 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 89434398bef1483abb7170861c595c08, State: Running, Role: LEADER
I20260709 13:10:06.145361 24248 consensus_queue.cc:260] T 072781c592984c6a9a6f3d8790809bd1 P 89434398bef1483abb7170861c595c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:06.146281 24248 raft_consensus.cc:3060] T 072781c592984c6a9a6f3d8790809bd1 P 89434398bef1483abb7170861c595c08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:06.148221 24322 raft_consensus.cc:2468] T 072781c592984c6a9a6f3d8790809bd1 P f39804e3bc0e439286a172ab4c75e032 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba007af05f0f4fb3aa79a70a4ed62188 in term 3.
I20260709 13:10:06.149161 24363 leader_election.cc:304] T 072781c592984c6a9a6f3d8790809bd1 P ba007af05f0f4fb3aa79a70a4ed62188 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba007af05f0f4fb3aa79a70a4ed62188, f39804e3bc0e439286a172ab4c75e032; no voters: 
I20260709 13:10:06.149863 24538 raft_consensus.cc:2804] T 072781c592984c6a9a6f3d8790809bd1 P ba007af05f0f4fb3aa79a70a4ed62188 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:06.150342 24538 raft_consensus.cc:697] T 072781c592984c6a9a6f3d8790809bd1 P ba007af05f0f4fb3aa79a70a4ed62188 [term 3 LEADER]: Becoming Leader. State: Replica: ba007af05f0f4fb3aa79a70a4ed62188, State: Running, Role: LEADER
I20260709 13:10:06.151288 24248 raft_consensus.cc:2468] T 072781c592984c6a9a6f3d8790809bd1 P 89434398bef1483abb7170861c595c08 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba007af05f0f4fb3aa79a70a4ed62188 in term 3.
I20260709 13:10:06.151135 24538 consensus_queue.cc:237] T 072781c592984c6a9a6f3d8790809bd1 P ba007af05f0f4fb3aa79a70a4ed62188 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:06.157961 24144 catalog_manager.cc:5697] T 072781c592984c6a9a6f3d8790809bd1 P ba007af05f0f4fb3aa79a70a4ed62188 reported cstate change: term changed from 2 to 3, leader changed from 89434398bef1483abb7170861c595c08 (127.23.140.65) to ba007af05f0f4fb3aa79a70a4ed62188 (127.23.140.67). New cstate: current_term: 3 leader_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:06.550776 24248 raft_consensus.cc:1275] T 072781c592984c6a9a6f3d8790809bd1 P 89434398bef1483abb7170861c595c08 [term 3 FOLLOWER]: Refusing update from remote peer ba007af05f0f4fb3aa79a70a4ed62188: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:06.552062 24538 consensus_queue.cc:1048] T 072781c592984c6a9a6f3d8790809bd1 P ba007af05f0f4fb3aa79a70a4ed62188 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:06.560672 24322 raft_consensus.cc:1275] T 072781c592984c6a9a6f3d8790809bd1 P f39804e3bc0e439286a172ab4c75e032 [term 3 FOLLOWER]: Refusing update from remote peer ba007af05f0f4fb3aa79a70a4ed62188: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:06.562238 24554 consensus_queue.cc:1048] T 072781c592984c6a9a6f3d8790809bd1 P ba007af05f0f4fb3aa79a70a4ed62188 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:06.627694 24248 raft_consensus.cc:1275] T d3529531034c4da8ace2a1b8bcc7c934 P 89434398bef1483abb7170861c595c08 [term 3 FOLLOWER]: Refusing update from remote peer ba007af05f0f4fb3aa79a70a4ed62188: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:06.628930 24538 consensus_queue.cc:1048] T d3529531034c4da8ace2a1b8bcc7c934 P ba007af05f0f4fb3aa79a70a4ed62188 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:06.639420 24322 raft_consensus.cc:1275] T d3529531034c4da8ace2a1b8bcc7c934 P f39804e3bc0e439286a172ab4c75e032 [term 3 FOLLOWER]: Refusing update from remote peer ba007af05f0f4fb3aa79a70a4ed62188: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:06.640933 24559 consensus_queue.cc:1048] T d3529531034c4da8ace2a1b8bcc7c934 P ba007af05f0f4fb3aa79a70a4ed62188 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:06.777544 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:06.786876 24248 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fdb7ba4cacaf498d83b351d63a57aa7b"
dest_uuid: "89434398bef1483abb7170861c595c08"
mode: GRACEFUL
new_leader_uuid: "f39804e3bc0e439286a172ab4c75e032"
 from {username='slave'} at 127.0.0.1:34914
I20260709 13:10:06.787307 24248 raft_consensus.cc:606] T fdb7ba4cacaf498d83b351d63a57aa7b P 89434398bef1483abb7170861c595c08 [term 1 LEADER]: Received request to transfer leadership to TS f39804e3bc0e439286a172ab4c75e032
I20260709 13:10:06.791630 24248 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4607544e6a241349a1a35df8aaca446"
dest_uuid: "89434398bef1483abb7170861c595c08"
mode: GRACEFUL
new_leader_uuid: "f39804e3bc0e439286a172ab4c75e032"
 from {username='slave'} at 127.0.0.1:34914
I20260709 13:10:06.792023 24248 raft_consensus.cc:606] T c4607544e6a241349a1a35df8aaca446 P 89434398bef1483abb7170861c595c08 [term 2 LEADER]: Received request to transfer leadership to TS f39804e3bc0e439286a172ab4c75e032
I20260709 13:10:06.796211 24397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "072781c592984c6a9a6f3d8790809bd1"
dest_uuid: "ba007af05f0f4fb3aa79a70a4ed62188"
mode: GRACEFUL
new_leader_uuid: "f39804e3bc0e439286a172ab4c75e032"
 from {username='slave'} at 127.0.0.1:48684
I20260709 13:10:06.796653 24397 raft_consensus.cc:606] T 072781c592984c6a9a6f3d8790809bd1 P ba007af05f0f4fb3aa79a70a4ed62188 [term 3 LEADER]: Received request to transfer leadership to TS f39804e3bc0e439286a172ab4c75e032
I20260709 13:10:06.800776 24248 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57caa52201cc4aaba1de74ac8393a6a6"
dest_uuid: "89434398bef1483abb7170861c595c08"
mode: GRACEFUL
new_leader_uuid: "f39804e3bc0e439286a172ab4c75e032"
 from {username='slave'} at 127.0.0.1:34914
I20260709 13:10:06.801142 24248 raft_consensus.cc:606] T 57caa52201cc4aaba1de74ac8393a6a6 P 89434398bef1483abb7170861c595c08 [term 2 LEADER]: Received request to transfer leadership to TS f39804e3bc0e439286a172ab4c75e032
I20260709 13:10:06.805316 24397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3529531034c4da8ace2a1b8bcc7c934"
dest_uuid: "ba007af05f0f4fb3aa79a70a4ed62188"
mode: GRACEFUL
new_leader_uuid: "f39804e3bc0e439286a172ab4c75e032"
 from {username='slave'} at 127.0.0.1:48684
I20260709 13:10:06.805778 24397 raft_consensus.cc:606] T d3529531034c4da8ace2a1b8bcc7c934 P ba007af05f0f4fb3aa79a70a4ed62188 [term 3 LEADER]: Received request to transfer leadership to TS f39804e3bc0e439286a172ab4c75e032
I20260709 13:10:06.980469 24544 raft_consensus.cc:993] T 072781c592984c6a9a6f3d8790809bd1 P ba007af05f0f4fb3aa79a70a4ed62188: : Instructing follower f39804e3bc0e439286a172ab4c75e032 to start an election
I20260709 13:10:06.980934 24544 raft_consensus.cc:1081] T 072781c592984c6a9a6f3d8790809bd1 P ba007af05f0f4fb3aa79a70a4ed62188 [term 3 LEADER]: Signalling peer f39804e3bc0e439286a172ab4c75e032 to start an election
I20260709 13:10:06.981777 24447 raft_consensus.cc:993] T 57caa52201cc4aaba1de74ac8393a6a6 P 89434398bef1483abb7170861c595c08: : Instructing follower f39804e3bc0e439286a172ab4c75e032 to start an election
I20260709 13:10:06.982213 24549 raft_consensus.cc:1081] T 57caa52201cc4aaba1de74ac8393a6a6 P 89434398bef1483abb7170861c595c08 [term 2 LEADER]: Signalling peer f39804e3bc0e439286a172ab4c75e032 to start an election
I20260709 13:10:06.982559 24322 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "072781c592984c6a9a6f3d8790809bd1"
dest_uuid: "f39804e3bc0e439286a172ab4c75e032"
 from {username='slave'} at 127.0.0.1:34224
I20260709 13:10:06.983043 24322 raft_consensus.cc:493] T 072781c592984c6a9a6f3d8790809bd1 P f39804e3bc0e439286a172ab4c75e032 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:06.983438 24322 raft_consensus.cc:3060] T 072781c592984c6a9a6f3d8790809bd1 P f39804e3bc0e439286a172ab4c75e032 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:06.983839 24323 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "57caa52201cc4aaba1de74ac8393a6a6"
dest_uuid: "f39804e3bc0e439286a172ab4c75e032"
 from {username='slave'} at 127.0.0.1:34230
I20260709 13:10:06.984408 24323 raft_consensus.cc:493] T 57caa52201cc4aaba1de74ac8393a6a6 P f39804e3bc0e439286a172ab4c75e032 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:06.984777 24323 raft_consensus.cc:3060] T 57caa52201cc4aaba1de74ac8393a6a6 P f39804e3bc0e439286a172ab4c75e032 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:06.990306 24322 raft_consensus.cc:515] T 072781c592984c6a9a6f3d8790809bd1 P f39804e3bc0e439286a172ab4c75e032 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:06.990988 24323 raft_consensus.cc:515] T 57caa52201cc4aaba1de74ac8393a6a6 P f39804e3bc0e439286a172ab4c75e032 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:06.992363 24322 leader_election.cc:290] T 072781c592984c6a9a6f3d8790809bd1 P f39804e3bc0e439286a172ab4c75e032 [CANDIDATE]: Term 4 election: Requested vote from peers 89434398bef1483abb7170861c595c08 (127.23.140.65:42583), ba007af05f0f4fb3aa79a70a4ed62188 (127.23.140.67:39155)
I20260709 13:10:06.993253 24323 leader_election.cc:290] T 57caa52201cc4aaba1de74ac8393a6a6 P f39804e3bc0e439286a172ab4c75e032 [CANDIDATE]: Term 3 election: Requested vote from peers 89434398bef1483abb7170861c595c08 (127.23.140.65:42583), ba007af05f0f4fb3aa79a70a4ed62188 (127.23.140.67:39155)
I20260709 13:10:06.993669 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "072781c592984c6a9a6f3d8790809bd1" candidate_uuid: "f39804e3bc0e439286a172ab4c75e032" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ba007af05f0f4fb3aa79a70a4ed62188"
I20260709 13:10:06.994026 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57caa52201cc4aaba1de74ac8393a6a6" candidate_uuid: "f39804e3bc0e439286a172ab4c75e032" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "89434398bef1483abb7170861c595c08"
I20260709 13:10:06.994354 24397 raft_consensus.cc:3055] T 072781c592984c6a9a6f3d8790809bd1 P ba007af05f0f4fb3aa79a70a4ed62188 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:06.994629 24247 raft_consensus.cc:3055] T 57caa52201cc4aaba1de74ac8393a6a6 P 89434398bef1483abb7170861c595c08 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:06.994307 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "072781c592984c6a9a6f3d8790809bd1" candidate_uuid: "f39804e3bc0e439286a172ab4c75e032" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "89434398bef1483abb7170861c595c08"
I20260709 13:10:06.994849 24397 raft_consensus.cc:740] T 072781c592984c6a9a6f3d8790809bd1 P ba007af05f0f4fb3aa79a70a4ed62188 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ba007af05f0f4fb3aa79a70a4ed62188, State: Running, Role: LEADER
I20260709 13:10:06.995011 24247 raft_consensus.cc:740] T 57caa52201cc4aaba1de74ac8393a6a6 P 89434398bef1483abb7170861c595c08 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 89434398bef1483abb7170861c595c08, State: Running, Role: LEADER
I20260709 13:10:06.995177 24248 raft_consensus.cc:3060] T 072781c592984c6a9a6f3d8790809bd1 P 89434398bef1483abb7170861c595c08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:06.995491 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57caa52201cc4aaba1de74ac8393a6a6" candidate_uuid: "f39804e3bc0e439286a172ab4c75e032" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ba007af05f0f4fb3aa79a70a4ed62188"
I20260709 13:10:06.995683 24397 consensus_queue.cc:260] T 072781c592984c6a9a6f3d8790809bd1 P ba007af05f0f4fb3aa79a70a4ed62188 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:06.995865 24247 consensus_queue.cc:260] T 57caa52201cc4aaba1de74ac8393a6a6 P 89434398bef1483abb7170861c595c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:06.996807 24397 raft_consensus.cc:3060] T 072781c592984c6a9a6f3d8790809bd1 P ba007af05f0f4fb3aa79a70a4ed62188 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:06.997079 24247 raft_consensus.cc:3060] T 57caa52201cc4aaba1de74ac8393a6a6 P 89434398bef1483abb7170861c595c08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:06.996029 24396 raft_consensus.cc:3060] T 57caa52201cc4aaba1de74ac8393a6a6 P ba007af05f0f4fb3aa79a70a4ed62188 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:07.001623 24248 raft_consensus.cc:2468] T 072781c592984c6a9a6f3d8790809bd1 P 89434398bef1483abb7170861c595c08 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f39804e3bc0e439286a172ab4c75e032 in term 4.
I20260709 13:10:07.002874 24286 leader_election.cc:304] T 072781c592984c6a9a6f3d8790809bd1 P f39804e3bc0e439286a172ab4c75e032 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89434398bef1483abb7170861c595c08, f39804e3bc0e439286a172ab4c75e032; no voters: 
I20260709 13:10:07.003712 24449 raft_consensus.cc:2804] T 072781c592984c6a9a6f3d8790809bd1 P f39804e3bc0e439286a172ab4c75e032 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:07.004739 24397 raft_consensus.cc:2468] T 072781c592984c6a9a6f3d8790809bd1 P ba007af05f0f4fb3aa79a70a4ed62188 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f39804e3bc0e439286a172ab4c75e032 in term 4.
I20260709 13:10:07.005259 24247 raft_consensus.cc:2468] T 57caa52201cc4aaba1de74ac8393a6a6 P 89434398bef1483abb7170861c595c08 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f39804e3bc0e439286a172ab4c75e032 in term 3.
I20260709 13:10:07.006400 24449 raft_consensus.cc:697] T 072781c592984c6a9a6f3d8790809bd1 P f39804e3bc0e439286a172ab4c75e032 [term 4 LEADER]: Becoming Leader. State: Replica: f39804e3bc0e439286a172ab4c75e032, State: Running, Role: LEADER
I20260709 13:10:07.007336 24286 leader_election.cc:304] T 57caa52201cc4aaba1de74ac8393a6a6 P f39804e3bc0e439286a172ab4c75e032 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89434398bef1483abb7170861c595c08, f39804e3bc0e439286a172ab4c75e032; no voters: 
I20260709 13:10:07.007314 24449 consensus_queue.cc:237] T 072781c592984c6a9a6f3d8790809bd1 P f39804e3bc0e439286a172ab4c75e032 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:07.008364 24561 raft_consensus.cc:2804] T 57caa52201cc4aaba1de74ac8393a6a6 P f39804e3bc0e439286a172ab4c75e032 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:07.008298 24396 raft_consensus.cc:2468] T 57caa52201cc4aaba1de74ac8393a6a6 P ba007af05f0f4fb3aa79a70a4ed62188 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f39804e3bc0e439286a172ab4c75e032 in term 3.
I20260709 13:10:07.010067 24447 raft_consensus.cc:993] T c4607544e6a241349a1a35df8aaca446 P 89434398bef1483abb7170861c595c08: : Instructing follower f39804e3bc0e439286a172ab4c75e032 to start an election
I20260709 13:10:07.010507 24549 raft_consensus.cc:1081] T c4607544e6a241349a1a35df8aaca446 P 89434398bef1483abb7170861c595c08 [term 2 LEADER]: Signalling peer f39804e3bc0e439286a172ab4c75e032 to start an election
I20260709 13:10:07.013062 24561 raft_consensus.cc:697] T 57caa52201cc4aaba1de74ac8393a6a6 P f39804e3bc0e439286a172ab4c75e032 [term 3 LEADER]: Becoming Leader. State: Replica: f39804e3bc0e439286a172ab4c75e032, State: Running, Role: LEADER
I20260709 13:10:07.012027 24323 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c4607544e6a241349a1a35df8aaca446"
dest_uuid: "f39804e3bc0e439286a172ab4c75e032"
 from {username='slave'} at 127.0.0.1:34230
I20260709 13:10:07.013883 24323 raft_consensus.cc:493] T c4607544e6a241349a1a35df8aaca446 P f39804e3bc0e439286a172ab4c75e032 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:07.014423 24323 raft_consensus.cc:3060] T c4607544e6a241349a1a35df8aaca446 P f39804e3bc0e439286a172ab4c75e032 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:07.014086 24561 consensus_queue.cc:237] T 57caa52201cc4aaba1de74ac8393a6a6 P f39804e3bc0e439286a172ab4c75e032 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:07.016736 24144 catalog_manager.cc:5697] T 072781c592984c6a9a6f3d8790809bd1 P f39804e3bc0e439286a172ab4c75e032 reported cstate change: term changed from 3 to 4, leader changed from ba007af05f0f4fb3aa79a70a4ed62188 (127.23.140.67) to f39804e3bc0e439286a172ab4c75e032 (127.23.140.66). New cstate: current_term: 4 leader_uuid: "f39804e3bc0e439286a172ab4c75e032" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:07.020356 24323 raft_consensus.cc:515] T c4607544e6a241349a1a35df8aaca446 P f39804e3bc0e439286a172ab4c75e032 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:07.022485 24323 leader_election.cc:290] T c4607544e6a241349a1a35df8aaca446 P f39804e3bc0e439286a172ab4c75e032 [CANDIDATE]: Term 3 election: Requested vote from peers 89434398bef1483abb7170861c595c08 (127.23.140.65:42583), ba007af05f0f4fb3aa79a70a4ed62188 (127.23.140.67:39155)
I20260709 13:10:07.022874 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4607544e6a241349a1a35df8aaca446" candidate_uuid: "f39804e3bc0e439286a172ab4c75e032" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "89434398bef1483abb7170861c595c08"
I20260709 13:10:07.023440 24248 raft_consensus.cc:3055] T c4607544e6a241349a1a35df8aaca446 P 89434398bef1483abb7170861c595c08 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:07.023499 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4607544e6a241349a1a35df8aaca446" candidate_uuid: "f39804e3bc0e439286a172ab4c75e032" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ba007af05f0f4fb3aa79a70a4ed62188"
I20260709 13:10:07.023799 24248 raft_consensus.cc:740] T c4607544e6a241349a1a35df8aaca446 P 89434398bef1483abb7170861c595c08 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 89434398bef1483abb7170861c595c08, State: Running, Role: LEADER
I20260709 13:10:07.024245 24396 raft_consensus.cc:3060] T c4607544e6a241349a1a35df8aaca446 P ba007af05f0f4fb3aa79a70a4ed62188 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:07.024683 24248 consensus_queue.cc:260] T c4607544e6a241349a1a35df8aaca446 P 89434398bef1483abb7170861c595c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:07.025734 24248 raft_consensus.cc:3060] T c4607544e6a241349a1a35df8aaca446 P 89434398bef1483abb7170861c595c08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:07.030663 24396 raft_consensus.cc:2468] T c4607544e6a241349a1a35df8aaca446 P ba007af05f0f4fb3aa79a70a4ed62188 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f39804e3bc0e439286a172ab4c75e032 in term 3.
I20260709 13:10:07.031869 24288 leader_election.cc:304] T c4607544e6a241349a1a35df8aaca446 P f39804e3bc0e439286a172ab4c75e032 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba007af05f0f4fb3aa79a70a4ed62188, f39804e3bc0e439286a172ab4c75e032; no voters: 
I20260709 13:10:07.032200 24248 raft_consensus.cc:2468] T c4607544e6a241349a1a35df8aaca446 P 89434398bef1483abb7170861c595c08 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f39804e3bc0e439286a172ab4c75e032 in term 3.
I20260709 13:10:07.032783 24561 raft_consensus.cc:2804] T c4607544e6a241349a1a35df8aaca446 P f39804e3bc0e439286a172ab4c75e032 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:07.033288 24561 raft_consensus.cc:697] T c4607544e6a241349a1a35df8aaca446 P f39804e3bc0e439286a172ab4c75e032 [term 3 LEADER]: Becoming Leader. State: Replica: f39804e3bc0e439286a172ab4c75e032, State: Running, Role: LEADER
I20260709 13:10:07.034093 24561 consensus_queue.cc:237] T c4607544e6a241349a1a35df8aaca446 P f39804e3bc0e439286a172ab4c75e032 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:07.034068 24144 catalog_manager.cc:5697] T 57caa52201cc4aaba1de74ac8393a6a6 P f39804e3bc0e439286a172ab4c75e032 reported cstate change: term changed from 2 to 3, leader changed from 89434398bef1483abb7170861c595c08 (127.23.140.65) to f39804e3bc0e439286a172ab4c75e032 (127.23.140.66). New cstate: current_term: 3 leader_uuid: "f39804e3bc0e439286a172ab4c75e032" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:07.044441 24144 catalog_manager.cc:5697] T c4607544e6a241349a1a35df8aaca446 P f39804e3bc0e439286a172ab4c75e032 reported cstate change: term changed from 2 to 3, leader changed from 89434398bef1483abb7170861c595c08 (127.23.140.65) to f39804e3bc0e439286a172ab4c75e032 (127.23.140.66). New cstate: current_term: 3 leader_uuid: "f39804e3bc0e439286a172ab4c75e032" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:07.215580 24447 raft_consensus.cc:993] T fdb7ba4cacaf498d83b351d63a57aa7b P 89434398bef1483abb7170861c595c08: : Instructing follower f39804e3bc0e439286a172ab4c75e032 to start an election
I20260709 13:10:07.216013 24549 raft_consensus.cc:1081] T fdb7ba4cacaf498d83b351d63a57aa7b P 89434398bef1483abb7170861c595c08 [term 1 LEADER]: Signalling peer f39804e3bc0e439286a172ab4c75e032 to start an election
I20260709 13:10:07.217442 24323 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fdb7ba4cacaf498d83b351d63a57aa7b"
dest_uuid: "f39804e3bc0e439286a172ab4c75e032"
 from {username='slave'} at 127.0.0.1:34230
I20260709 13:10:07.217944 24323 raft_consensus.cc:493] T fdb7ba4cacaf498d83b351d63a57aa7b P f39804e3bc0e439286a172ab4c75e032 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:07.218195 24323 raft_consensus.cc:3060] T fdb7ba4cacaf498d83b351d63a57aa7b P f39804e3bc0e439286a172ab4c75e032 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:07.222525 24323 raft_consensus.cc:515] T fdb7ba4cacaf498d83b351d63a57aa7b P f39804e3bc0e439286a172ab4c75e032 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } }
I20260709 13:10:07.224049 24323 leader_election.cc:290] T fdb7ba4cacaf498d83b351d63a57aa7b P f39804e3bc0e439286a172ab4c75e032 [CANDIDATE]: Term 2 election: Requested vote from peers ba007af05f0f4fb3aa79a70a4ed62188 (127.23.140.67:39155), 89434398bef1483abb7170861c595c08 (127.23.140.65:42583)
I20260709 13:10:07.225049 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb7ba4cacaf498d83b351d63a57aa7b" candidate_uuid: "f39804e3bc0e439286a172ab4c75e032" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89434398bef1483abb7170861c595c08"
I20260709 13:10:07.225044 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb7ba4cacaf498d83b351d63a57aa7b" candidate_uuid: "f39804e3bc0e439286a172ab4c75e032" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba007af05f0f4fb3aa79a70a4ed62188"
I20260709 13:10:07.225666 24248 raft_consensus.cc:3055] T fdb7ba4cacaf498d83b351d63a57aa7b P 89434398bef1483abb7170861c595c08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:07.225685 24396 raft_consensus.cc:3060] T fdb7ba4cacaf498d83b351d63a57aa7b P ba007af05f0f4fb3aa79a70a4ed62188 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:07.226006 24248 raft_consensus.cc:740] T fdb7ba4cacaf498d83b351d63a57aa7b P 89434398bef1483abb7170861c595c08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89434398bef1483abb7170861c595c08, State: Running, Role: LEADER
I20260709 13:10:07.226745 24248 consensus_queue.cc:260] T fdb7ba4cacaf498d83b351d63a57aa7b P 89434398bef1483abb7170861c595c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } }
I20260709 13:10:07.227524 24248 raft_consensus.cc:3060] T fdb7ba4cacaf498d83b351d63a57aa7b P 89434398bef1483abb7170861c595c08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:07.230352 24396 raft_consensus.cc:2468] T fdb7ba4cacaf498d83b351d63a57aa7b P ba007af05f0f4fb3aa79a70a4ed62188 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f39804e3bc0e439286a172ab4c75e032 in term 2.
I20260709 13:10:07.231343 24288 leader_election.cc:304] T fdb7ba4cacaf498d83b351d63a57aa7b P f39804e3bc0e439286a172ab4c75e032 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba007af05f0f4fb3aa79a70a4ed62188, f39804e3bc0e439286a172ab4c75e032; no voters: 
I20260709 13:10:07.231528 24248 raft_consensus.cc:2468] T fdb7ba4cacaf498d83b351d63a57aa7b P 89434398bef1483abb7170861c595c08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f39804e3bc0e439286a172ab4c75e032 in term 2.
I20260709 13:10:07.232205 24561 raft_consensus.cc:2804] T fdb7ba4cacaf498d83b351d63a57aa7b P f39804e3bc0e439286a172ab4c75e032 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:07.232707 24561 raft_consensus.cc:697] T fdb7ba4cacaf498d83b351d63a57aa7b P f39804e3bc0e439286a172ab4c75e032 [term 2 LEADER]: Becoming Leader. State: Replica: f39804e3bc0e439286a172ab4c75e032, State: Running, Role: LEADER
I20260709 13:10:07.233489 24561 consensus_queue.cc:237] T fdb7ba4cacaf498d83b351d63a57aa7b P f39804e3bc0e439286a172ab4c75e032 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } }
I20260709 13:10:07.239228 24144 catalog_manager.cc:5697] T fdb7ba4cacaf498d83b351d63a57aa7b P f39804e3bc0e439286a172ab4c75e032 reported cstate change: term changed from 1 to 2, leader changed from 89434398bef1483abb7170861c595c08 (127.23.140.65) to f39804e3bc0e439286a172ab4c75e032 (127.23.140.66). New cstate: current_term: 2 leader_uuid: "f39804e3bc0e439286a172ab4c75e032" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:07.267350 24559 raft_consensus.cc:993] T d3529531034c4da8ace2a1b8bcc7c934 P ba007af05f0f4fb3aa79a70a4ed62188: : Instructing follower f39804e3bc0e439286a172ab4c75e032 to start an election
I20260709 13:10:07.267951 24544 raft_consensus.cc:1081] T d3529531034c4da8ace2a1b8bcc7c934 P ba007af05f0f4fb3aa79a70a4ed62188 [term 3 LEADER]: Signalling peer f39804e3bc0e439286a172ab4c75e032 to start an election
I20260709 13:10:07.269294 24323 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d3529531034c4da8ace2a1b8bcc7c934"
dest_uuid: "f39804e3bc0e439286a172ab4c75e032"
 from {username='slave'} at 127.0.0.1:34224
I20260709 13:10:07.269850 24323 raft_consensus.cc:493] T d3529531034c4da8ace2a1b8bcc7c934 P f39804e3bc0e439286a172ab4c75e032 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:07.270182 24323 raft_consensus.cc:3060] T d3529531034c4da8ace2a1b8bcc7c934 P f39804e3bc0e439286a172ab4c75e032 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:07.274665 24323 raft_consensus.cc:515] T d3529531034c4da8ace2a1b8bcc7c934 P f39804e3bc0e439286a172ab4c75e032 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:07.276326 24323 leader_election.cc:290] T d3529531034c4da8ace2a1b8bcc7c934 P f39804e3bc0e439286a172ab4c75e032 [CANDIDATE]: Term 4 election: Requested vote from peers 89434398bef1483abb7170861c595c08 (127.23.140.65:42583), ba007af05f0f4fb3aa79a70a4ed62188 (127.23.140.67:39155)
I20260709 13:10:07.277055 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3529531034c4da8ace2a1b8bcc7c934" candidate_uuid: "f39804e3bc0e439286a172ab4c75e032" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "89434398bef1483abb7170861c595c08"
I20260709 13:10:07.277359 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3529531034c4da8ace2a1b8bcc7c934" candidate_uuid: "f39804e3bc0e439286a172ab4c75e032" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ba007af05f0f4fb3aa79a70a4ed62188"
I20260709 13:10:07.277547 24248 raft_consensus.cc:3060] T d3529531034c4da8ace2a1b8bcc7c934 P 89434398bef1483abb7170861c595c08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:07.277928 24396 raft_consensus.cc:3055] T d3529531034c4da8ace2a1b8bcc7c934 P ba007af05f0f4fb3aa79a70a4ed62188 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:07.278204 24396 raft_consensus.cc:740] T d3529531034c4da8ace2a1b8bcc7c934 P ba007af05f0f4fb3aa79a70a4ed62188 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ba007af05f0f4fb3aa79a70a4ed62188, State: Running, Role: LEADER
I20260709 13:10:07.278815 24396 consensus_queue.cc:260] T d3529531034c4da8ace2a1b8bcc7c934 P ba007af05f0f4fb3aa79a70a4ed62188 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:07.279654 24396 raft_consensus.cc:3060] T d3529531034c4da8ace2a1b8bcc7c934 P ba007af05f0f4fb3aa79a70a4ed62188 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:07.281674 24248 raft_consensus.cc:2468] T d3529531034c4da8ace2a1b8bcc7c934 P 89434398bef1483abb7170861c595c08 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f39804e3bc0e439286a172ab4c75e032 in term 4.
I20260709 13:10:07.282649 24286 leader_election.cc:304] T d3529531034c4da8ace2a1b8bcc7c934 P f39804e3bc0e439286a172ab4c75e032 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89434398bef1483abb7170861c595c08, f39804e3bc0e439286a172ab4c75e032; no voters: 
I20260709 13:10:07.283408 24561 raft_consensus.cc:2804] T d3529531034c4da8ace2a1b8bcc7c934 P f39804e3bc0e439286a172ab4c75e032 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:07.283870 24561 raft_consensus.cc:697] T d3529531034c4da8ace2a1b8bcc7c934 P f39804e3bc0e439286a172ab4c75e032 [term 4 LEADER]: Becoming Leader. State: Replica: f39804e3bc0e439286a172ab4c75e032, State: Running, Role: LEADER
I20260709 13:10:07.284502 24396 raft_consensus.cc:2468] T d3529531034c4da8ace2a1b8bcc7c934 P ba007af05f0f4fb3aa79a70a4ed62188 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f39804e3bc0e439286a172ab4c75e032 in term 4.
I20260709 13:10:07.284581 24561 consensus_queue.cc:237] T d3529531034c4da8ace2a1b8bcc7c934 P f39804e3bc0e439286a172ab4c75e032 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:07.290091 24144 catalog_manager.cc:5697] T d3529531034c4da8ace2a1b8bcc7c934 P f39804e3bc0e439286a172ab4c75e032 reported cstate change: term changed from 3 to 4, leader changed from ba007af05f0f4fb3aa79a70a4ed62188 (127.23.140.67) to f39804e3bc0e439286a172ab4c75e032 (127.23.140.66). New cstate: current_term: 4 leader_uuid: "f39804e3bc0e439286a172ab4c75e032" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:07.405565 24248 raft_consensus.cc:1275] T 072781c592984c6a9a6f3d8790809bd1 P 89434398bef1483abb7170861c595c08 [term 4 FOLLOWER]: Refusing update from remote peer f39804e3bc0e439286a172ab4c75e032: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:07.406724 24561 consensus_queue.cc:1048] T 072781c592984c6a9a6f3d8790809bd1 P f39804e3bc0e439286a172ab4c75e032 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:07.414583 24396 raft_consensus.cc:1275] T 072781c592984c6a9a6f3d8790809bd1 P ba007af05f0f4fb3aa79a70a4ed62188 [term 4 FOLLOWER]: Refusing update from remote peer f39804e3bc0e439286a172ab4c75e032: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:07.416301 24561 consensus_queue.cc:1048] T 072781c592984c6a9a6f3d8790809bd1 P f39804e3bc0e439286a172ab4c75e032 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:07.452028 24396 raft_consensus.cc:1275] T c4607544e6a241349a1a35df8aaca446 P ba007af05f0f4fb3aa79a70a4ed62188 [term 3 FOLLOWER]: Refusing update from remote peer f39804e3bc0e439286a172ab4c75e032: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:07.453359 24561 consensus_queue.cc:1048] T c4607544e6a241349a1a35df8aaca446 P f39804e3bc0e439286a172ab4c75e032 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:07.461596 24248 raft_consensus.cc:1275] T c4607544e6a241349a1a35df8aaca446 P 89434398bef1483abb7170861c595c08 [term 3 FOLLOWER]: Refusing update from remote peer f39804e3bc0e439286a172ab4c75e032: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:07.463162 24449 consensus_queue.cc:1048] T c4607544e6a241349a1a35df8aaca446 P f39804e3bc0e439286a172ab4c75e032 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:07.591292 24248 raft_consensus.cc:1275] T 57caa52201cc4aaba1de74ac8393a6a6 P 89434398bef1483abb7170861c595c08 [term 3 FOLLOWER]: Refusing update from remote peer f39804e3bc0e439286a172ab4c75e032: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:07.592442 24449 consensus_queue.cc:1048] T 57caa52201cc4aaba1de74ac8393a6a6 P f39804e3bc0e439286a172ab4c75e032 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:07.600739 24396 raft_consensus.cc:1275] T 57caa52201cc4aaba1de74ac8393a6a6 P ba007af05f0f4fb3aa79a70a4ed62188 [term 3 FOLLOWER]: Refusing update from remote peer f39804e3bc0e439286a172ab4c75e032: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:07.602497 24573 consensus_queue.cc:1048] T 57caa52201cc4aaba1de74ac8393a6a6 P f39804e3bc0e439286a172ab4c75e032 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:07.795022 24248 raft_consensus.cc:1275] T fdb7ba4cacaf498d83b351d63a57aa7b P 89434398bef1483abb7170861c595c08 [term 2 FOLLOWER]: Refusing update from remote peer f39804e3bc0e439286a172ab4c75e032: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:07.796872 24573 consensus_queue.cc:1048] T fdb7ba4cacaf498d83b351d63a57aa7b P f39804e3bc0e439286a172ab4c75e032 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:07.801985 24396 raft_consensus.cc:1275] T d3529531034c4da8ace2a1b8bcc7c934 P ba007af05f0f4fb3aa79a70a4ed62188 [term 4 FOLLOWER]: Refusing update from remote peer f39804e3bc0e439286a172ab4c75e032: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:07.803560 24573 consensus_queue.cc:1048] T d3529531034c4da8ace2a1b8bcc7c934 P f39804e3bc0e439286a172ab4c75e032 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:07.808624 24397 raft_consensus.cc:1275] T fdb7ba4cacaf498d83b351d63a57aa7b P ba007af05f0f4fb3aa79a70a4ed62188 [term 2 FOLLOWER]: Refusing update from remote peer f39804e3bc0e439286a172ab4c75e032: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:07.810444 24562 consensus_queue.cc:1048] T fdb7ba4cacaf498d83b351d63a57aa7b P f39804e3bc0e439286a172ab4c75e032 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:07.824524 24248 raft_consensus.cc:1275] T d3529531034c4da8ace2a1b8bcc7c934 P 89434398bef1483abb7170861c595c08 [term 4 FOLLOWER]: Refusing update from remote peer f39804e3bc0e439286a172ab4c75e032: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:07.825791 24562 consensus_queue.cc:1048] T d3529531034c4da8ace2a1b8bcc7c934 P f39804e3bc0e439286a172ab4c75e032 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:09.816773 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:09.824288 24323 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "072781c592984c6a9a6f3d8790809bd1"
dest_uuid: "f39804e3bc0e439286a172ab4c75e032"
mode: GRACEFUL
new_leader_uuid: "ba007af05f0f4fb3aa79a70a4ed62188"
 from {username='slave'} at 127.0.0.1:34250
I20260709 13:10:09.825040 24323 raft_consensus.cc:606] T 072781c592984c6a9a6f3d8790809bd1 P f39804e3bc0e439286a172ab4c75e032 [term 4 LEADER]: Received request to transfer leadership to TS ba007af05f0f4fb3aa79a70a4ed62188
I20260709 13:10:09.827509 24323 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2824545a6ec14281b292a9a80984e5d7"
dest_uuid: "f39804e3bc0e439286a172ab4c75e032"
mode: GRACEFUL
new_leader_uuid: "89434398bef1483abb7170861c595c08"
 from {username='slave'} at 127.0.0.1:34250
I20260709 13:10:09.827951 24323 raft_consensus.cc:606] T 2824545a6ec14281b292a9a80984e5d7 P f39804e3bc0e439286a172ab4c75e032 [term 2 LEADER]: Received request to transfer leadership to TS 89434398bef1483abb7170861c595c08
I20260709 13:10:09.830171 24323 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2b8f465407049c093b74b89e0cc8fc3"
dest_uuid: "f39804e3bc0e439286a172ab4c75e032"
mode: GRACEFUL
new_leader_uuid: "ba007af05f0f4fb3aa79a70a4ed62188"
 from {username='slave'} at 127.0.0.1:34250
I20260709 13:10:09.830597 24323 raft_consensus.cc:606] T a2b8f465407049c093b74b89e0cc8fc3 P f39804e3bc0e439286a172ab4c75e032 [term 2 LEADER]: Received request to transfer leadership to TS ba007af05f0f4fb3aa79a70a4ed62188
I20260709 13:10:09.832644 24323 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4607544e6a241349a1a35df8aaca446"
dest_uuid: "f39804e3bc0e439286a172ab4c75e032"
mode: GRACEFUL
new_leader_uuid: "89434398bef1483abb7170861c595c08"
 from {username='slave'} at 127.0.0.1:34250
I20260709 13:10:09.833081 24323 raft_consensus.cc:606] T c4607544e6a241349a1a35df8aaca446 P f39804e3bc0e439286a172ab4c75e032 [term 3 LEADER]: Received request to transfer leadership to TS 89434398bef1483abb7170861c595c08
I20260709 13:10:09.835278 24323 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fdb7ba4cacaf498d83b351d63a57aa7b"
dest_uuid: "f39804e3bc0e439286a172ab4c75e032"
mode: GRACEFUL
new_leader_uuid: "89434398bef1483abb7170861c595c08"
 from {username='slave'} at 127.0.0.1:34250
I20260709 13:10:09.835716 24323 raft_consensus.cc:606] T fdb7ba4cacaf498d83b351d63a57aa7b P f39804e3bc0e439286a172ab4c75e032 [term 2 LEADER]: Received request to transfer leadership to TS 89434398bef1483abb7170861c595c08
I20260709 13:10:09.836643 24113 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:09.837039 24113 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:09.888864 24561 raft_consensus.cc:993] T a2b8f465407049c093b74b89e0cc8fc3 P f39804e3bc0e439286a172ab4c75e032: : Instructing follower ba007af05f0f4fb3aa79a70a4ed62188 to start an election
I20260709 13:10:09.889426 24573 raft_consensus.cc:1081] T a2b8f465407049c093b74b89e0cc8fc3 P f39804e3bc0e439286a172ab4c75e032 [term 2 LEADER]: Signalling peer ba007af05f0f4fb3aa79a70a4ed62188 to start an election
I20260709 13:10:09.890853 24396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a2b8f465407049c093b74b89e0cc8fc3"
dest_uuid: "ba007af05f0f4fb3aa79a70a4ed62188"
 from {username='slave'} at 127.0.0.1:48678
I20260709 13:10:09.891330 24396 raft_consensus.cc:493] T a2b8f465407049c093b74b89e0cc8fc3 P ba007af05f0f4fb3aa79a70a4ed62188 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:09.891650 24396 raft_consensus.cc:3060] T a2b8f465407049c093b74b89e0cc8fc3 P ba007af05f0f4fb3aa79a70a4ed62188 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:09.896284 24396 raft_consensus.cc:515] T a2b8f465407049c093b74b89e0cc8fc3 P ba007af05f0f4fb3aa79a70a4ed62188 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:09.897933 24396 leader_election.cc:290] T a2b8f465407049c093b74b89e0cc8fc3 P ba007af05f0f4fb3aa79a70a4ed62188 [CANDIDATE]: Term 3 election: Requested vote from peers 89434398bef1483abb7170861c595c08 (127.23.140.65:42583), f39804e3bc0e439286a172ab4c75e032 (127.23.140.66:37967)
I20260709 13:10:09.898927 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8f465407049c093b74b89e0cc8fc3" candidate_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "89434398bef1483abb7170861c595c08"
I20260709 13:10:09.898993 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2b8f465407049c093b74b89e0cc8fc3" candidate_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f39804e3bc0e439286a172ab4c75e032"
I20260709 13:10:09.899645 24248 raft_consensus.cc:3060] T a2b8f465407049c093b74b89e0cc8fc3 P 89434398bef1483abb7170861c595c08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:09.899683 24323 raft_consensus.cc:3055] T a2b8f465407049c093b74b89e0cc8fc3 P f39804e3bc0e439286a172ab4c75e032 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:09.900074 24323 raft_consensus.cc:740] T a2b8f465407049c093b74b89e0cc8fc3 P f39804e3bc0e439286a172ab4c75e032 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f39804e3bc0e439286a172ab4c75e032, State: Running, Role: LEADER
I20260709 13:10:09.900899 24323 consensus_queue.cc:260] T a2b8f465407049c093b74b89e0cc8fc3 P f39804e3bc0e439286a172ab4c75e032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:09.902004 24323 raft_consensus.cc:3060] T a2b8f465407049c093b74b89e0cc8fc3 P f39804e3bc0e439286a172ab4c75e032 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:09.904155 24248 raft_consensus.cc:2468] T a2b8f465407049c093b74b89e0cc8fc3 P 89434398bef1483abb7170861c595c08 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba007af05f0f4fb3aa79a70a4ed62188 in term 3.
I20260709 13:10:09.905292 24360 leader_election.cc:304] T a2b8f465407049c093b74b89e0cc8fc3 P ba007af05f0f4fb3aa79a70a4ed62188 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89434398bef1483abb7170861c595c08, ba007af05f0f4fb3aa79a70a4ed62188; no voters: 
I20260709 13:10:09.906198 24544 raft_consensus.cc:2804] T a2b8f465407049c093b74b89e0cc8fc3 P ba007af05f0f4fb3aa79a70a4ed62188 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:09.907171 24544 raft_consensus.cc:697] T a2b8f465407049c093b74b89e0cc8fc3 P ba007af05f0f4fb3aa79a70a4ed62188 [term 3 LEADER]: Becoming Leader. State: Replica: ba007af05f0f4fb3aa79a70a4ed62188, State: Running, Role: LEADER
I20260709 13:10:09.907169 24323 raft_consensus.cc:2468] T a2b8f465407049c093b74b89e0cc8fc3 P f39804e3bc0e439286a172ab4c75e032 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba007af05f0f4fb3aa79a70a4ed62188 in term 3.
I20260709 13:10:09.908221 24544 consensus_queue.cc:237] T a2b8f465407049c093b74b89e0cc8fc3 P ba007af05f0f4fb3aa79a70a4ed62188 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:09.915009 24145 catalog_manager.cc:5697] T a2b8f465407049c093b74b89e0cc8fc3 P ba007af05f0f4fb3aa79a70a4ed62188 reported cstate change: term changed from 2 to 3, leader changed from f39804e3bc0e439286a172ab4c75e032 (127.23.140.66) to ba007af05f0f4fb3aa79a70a4ed62188 (127.23.140.67). New cstate: current_term: 3 leader_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:10.189590 24561 raft_consensus.cc:993] T fdb7ba4cacaf498d83b351d63a57aa7b P f39804e3bc0e439286a172ab4c75e032: : Instructing follower 89434398bef1483abb7170861c595c08 to start an election
I20260709 13:10:10.190052 24573 raft_consensus.cc:1081] T fdb7ba4cacaf498d83b351d63a57aa7b P f39804e3bc0e439286a172ab4c75e032 [term 2 LEADER]: Signalling peer 89434398bef1483abb7170861c595c08 to start an election
I20260709 13:10:10.191311 24248 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fdb7ba4cacaf498d83b351d63a57aa7b"
dest_uuid: "89434398bef1483abb7170861c595c08"
 from {username='slave'} at 127.0.0.1:34912
I20260709 13:10:10.191664 24248 raft_consensus.cc:493] T fdb7ba4cacaf498d83b351d63a57aa7b P 89434398bef1483abb7170861c595c08 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:10.191869 24248 raft_consensus.cc:3060] T fdb7ba4cacaf498d83b351d63a57aa7b P 89434398bef1483abb7170861c595c08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:10.195781 24248 raft_consensus.cc:515] T fdb7ba4cacaf498d83b351d63a57aa7b P 89434398bef1483abb7170861c595c08 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } }
I20260709 13:10:10.197415 24248 leader_election.cc:290] T fdb7ba4cacaf498d83b351d63a57aa7b P 89434398bef1483abb7170861c595c08 [CANDIDATE]: Term 3 election: Requested vote from peers ba007af05f0f4fb3aa79a70a4ed62188 (127.23.140.67:39155), f39804e3bc0e439286a172ab4c75e032 (127.23.140.66:37967)
I20260709 13:10:10.198158 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb7ba4cacaf498d83b351d63a57aa7b" candidate_uuid: "89434398bef1483abb7170861c595c08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ba007af05f0f4fb3aa79a70a4ed62188"
I20260709 13:10:10.198416 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb7ba4cacaf498d83b351d63a57aa7b" candidate_uuid: "89434398bef1483abb7170861c595c08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f39804e3bc0e439286a172ab4c75e032"
I20260709 13:10:10.198678 24396 raft_consensus.cc:3060] T fdb7ba4cacaf498d83b351d63a57aa7b P ba007af05f0f4fb3aa79a70a4ed62188 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:10.198945 24323 raft_consensus.cc:3055] T fdb7ba4cacaf498d83b351d63a57aa7b P f39804e3bc0e439286a172ab4c75e032 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:10.199252 24323 raft_consensus.cc:740] T fdb7ba4cacaf498d83b351d63a57aa7b P f39804e3bc0e439286a172ab4c75e032 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f39804e3bc0e439286a172ab4c75e032, State: Running, Role: LEADER
I20260709 13:10:10.199921 24323 consensus_queue.cc:260] T fdb7ba4cacaf498d83b351d63a57aa7b P f39804e3bc0e439286a172ab4c75e032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } }
I20260709 13:10:10.200822 24323 raft_consensus.cc:3060] T fdb7ba4cacaf498d83b351d63a57aa7b P f39804e3bc0e439286a172ab4c75e032 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:10.202950 24396 raft_consensus.cc:2468] T fdb7ba4cacaf498d83b351d63a57aa7b P ba007af05f0f4fb3aa79a70a4ed62188 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89434398bef1483abb7170861c595c08 in term 3.
I20260709 13:10:10.204092 24213 leader_election.cc:304] T fdb7ba4cacaf498d83b351d63a57aa7b P 89434398bef1483abb7170861c595c08 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89434398bef1483abb7170861c595c08, ba007af05f0f4fb3aa79a70a4ed62188; no voters: 
I20260709 13:10:10.205868 24588 raft_consensus.cc:2804] T fdb7ba4cacaf498d83b351d63a57aa7b P 89434398bef1483abb7170861c595c08 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:10.206210 24323 raft_consensus.cc:2468] T fdb7ba4cacaf498d83b351d63a57aa7b P f39804e3bc0e439286a172ab4c75e032 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89434398bef1483abb7170861c595c08 in term 3.
I20260709 13:10:10.207202 24588 raft_consensus.cc:697] T fdb7ba4cacaf498d83b351d63a57aa7b P 89434398bef1483abb7170861c595c08 [term 3 LEADER]: Becoming Leader. State: Replica: 89434398bef1483abb7170861c595c08, State: Running, Role: LEADER
I20260709 13:10:10.208089 24588 consensus_queue.cc:237] T fdb7ba4cacaf498d83b351d63a57aa7b P 89434398bef1483abb7170861c595c08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } }
I20260709 13:10:10.214377 24145 catalog_manager.cc:5697] T fdb7ba4cacaf498d83b351d63a57aa7b P 89434398bef1483abb7170861c595c08 reported cstate change: term changed from 2 to 3, leader changed from f39804e3bc0e439286a172ab4c75e032 (127.23.140.66) to 89434398bef1483abb7170861c595c08 (127.23.140.65). New cstate: current_term: 3 leader_uuid: "89434398bef1483abb7170861c595c08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:10.222666 24561 raft_consensus.cc:993] T 2824545a6ec14281b292a9a80984e5d7 P f39804e3bc0e439286a172ab4c75e032: : Instructing follower 89434398bef1483abb7170861c595c08 to start an election
I20260709 13:10:10.223099 24573 raft_consensus.cc:1081] T 2824545a6ec14281b292a9a80984e5d7 P f39804e3bc0e439286a172ab4c75e032 [term 2 LEADER]: Signalling peer 89434398bef1483abb7170861c595c08 to start an election
I20260709 13:10:10.224524 24248 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2824545a6ec14281b292a9a80984e5d7"
dest_uuid: "89434398bef1483abb7170861c595c08"
 from {username='slave'} at 127.0.0.1:34912
I20260709 13:10:10.224880 24248 raft_consensus.cc:493] T 2824545a6ec14281b292a9a80984e5d7 P 89434398bef1483abb7170861c595c08 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:10.225091 24248 raft_consensus.cc:3060] T 2824545a6ec14281b292a9a80984e5d7 P 89434398bef1483abb7170861c595c08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:10.228858 24248 raft_consensus.cc:515] T 2824545a6ec14281b292a9a80984e5d7 P 89434398bef1483abb7170861c595c08 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:10.230170 24248 leader_election.cc:290] T 2824545a6ec14281b292a9a80984e5d7 P 89434398bef1483abb7170861c595c08 [CANDIDATE]: Term 3 election: Requested vote from peers f39804e3bc0e439286a172ab4c75e032 (127.23.140.66:37967), ba007af05f0f4fb3aa79a70a4ed62188 (127.23.140.67:39155)
I20260709 13:10:10.230792 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2824545a6ec14281b292a9a80984e5d7" candidate_uuid: "89434398bef1483abb7170861c595c08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f39804e3bc0e439286a172ab4c75e032"
I20260709 13:10:10.231087 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2824545a6ec14281b292a9a80984e5d7" candidate_uuid: "89434398bef1483abb7170861c595c08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ba007af05f0f4fb3aa79a70a4ed62188"
I20260709 13:10:10.231268 24323 raft_consensus.cc:3055] T 2824545a6ec14281b292a9a80984e5d7 P f39804e3bc0e439286a172ab4c75e032 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:10.231675 24396 raft_consensus.cc:3060] T 2824545a6ec14281b292a9a80984e5d7 P ba007af05f0f4fb3aa79a70a4ed62188 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:10.231627 24323 raft_consensus.cc:740] T 2824545a6ec14281b292a9a80984e5d7 P f39804e3bc0e439286a172ab4c75e032 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f39804e3bc0e439286a172ab4c75e032, State: Running, Role: LEADER
I20260709 13:10:10.232604 24323 consensus_queue.cc:260] T 2824545a6ec14281b292a9a80984e5d7 P f39804e3bc0e439286a172ab4c75e032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:10.233831 24323 raft_consensus.cc:3060] T 2824545a6ec14281b292a9a80984e5d7 P f39804e3bc0e439286a172ab4c75e032 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:10.234977 24561 raft_consensus.cc:993] T c4607544e6a241349a1a35df8aaca446 P f39804e3bc0e439286a172ab4c75e032: : Instructing follower 89434398bef1483abb7170861c595c08 to start an election
I20260709 13:10:10.235354 24573 raft_consensus.cc:1081] T c4607544e6a241349a1a35df8aaca446 P f39804e3bc0e439286a172ab4c75e032 [term 3 LEADER]: Signalling peer 89434398bef1483abb7170861c595c08 to start an election
I20260709 13:10:10.236605 24248 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c4607544e6a241349a1a35df8aaca446"
dest_uuid: "89434398bef1483abb7170861c595c08"
 from {username='slave'} at 127.0.0.1:34912
I20260709 13:10:10.237020 24248 raft_consensus.cc:493] T c4607544e6a241349a1a35df8aaca446 P 89434398bef1483abb7170861c595c08 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:10.237309 24248 raft_consensus.cc:3060] T c4607544e6a241349a1a35df8aaca446 P 89434398bef1483abb7170861c595c08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:10.237773 24396 raft_consensus.cc:2468] T 2824545a6ec14281b292a9a80984e5d7 P ba007af05f0f4fb3aa79a70a4ed62188 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89434398bef1483abb7170861c595c08 in term 3.
I20260709 13:10:10.239097 24213 leader_election.cc:304] T 2824545a6ec14281b292a9a80984e5d7 P 89434398bef1483abb7170861c595c08 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89434398bef1483abb7170861c595c08, ba007af05f0f4fb3aa79a70a4ed62188; no voters: 
I20260709 13:10:10.239853 24588 raft_consensus.cc:2804] T 2824545a6ec14281b292a9a80984e5d7 P 89434398bef1483abb7170861c595c08 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:10.240278 24588 raft_consensus.cc:697] T 2824545a6ec14281b292a9a80984e5d7 P 89434398bef1483abb7170861c595c08 [term 3 LEADER]: Becoming Leader. State: Replica: 89434398bef1483abb7170861c595c08, State: Running, Role: LEADER
I20260709 13:10:10.241150 24588 consensus_queue.cc:237] T 2824545a6ec14281b292a9a80984e5d7 P 89434398bef1483abb7170861c595c08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:10.241696 24323 raft_consensus.cc:2468] T 2824545a6ec14281b292a9a80984e5d7 P f39804e3bc0e439286a172ab4c75e032 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89434398bef1483abb7170861c595c08 in term 3.
I20260709 13:10:10.243167 24248 raft_consensus.cc:515] T c4607544e6a241349a1a35df8aaca446 P 89434398bef1483abb7170861c595c08 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:10.245795 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4607544e6a241349a1a35df8aaca446" candidate_uuid: "89434398bef1483abb7170861c595c08" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f39804e3bc0e439286a172ab4c75e032"
I20260709 13:10:10.246097 24248 leader_election.cc:290] T c4607544e6a241349a1a35df8aaca446 P 89434398bef1483abb7170861c595c08 [CANDIDATE]: Term 4 election: Requested vote from peers f39804e3bc0e439286a172ab4c75e032 (127.23.140.66:37967), ba007af05f0f4fb3aa79a70a4ed62188 (127.23.140.67:39155)
I20260709 13:10:10.246462 24561 raft_consensus.cc:993] T 072781c592984c6a9a6f3d8790809bd1 P f39804e3bc0e439286a172ab4c75e032: : Instructing follower ba007af05f0f4fb3aa79a70a4ed62188 to start an election
I20260709 13:10:10.246941 24561 raft_consensus.cc:1081] T 072781c592984c6a9a6f3d8790809bd1 P f39804e3bc0e439286a172ab4c75e032 [term 4 LEADER]: Signalling peer ba007af05f0f4fb3aa79a70a4ed62188 to start an election
I20260709 13:10:10.247212 24396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4607544e6a241349a1a35df8aaca446" candidate_uuid: "89434398bef1483abb7170861c595c08" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ba007af05f0f4fb3aa79a70a4ed62188"
I20260709 13:10:10.247741 24396 raft_consensus.cc:3060] T c4607544e6a241349a1a35df8aaca446 P ba007af05f0f4fb3aa79a70a4ed62188 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:10.248582 24323 raft_consensus.cc:3055] T c4607544e6a241349a1a35df8aaca446 P f39804e3bc0e439286a172ab4c75e032 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:10.248567 24397 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "072781c592984c6a9a6f3d8790809bd1"
dest_uuid: "ba007af05f0f4fb3aa79a70a4ed62188"
 from {username='slave'} at 127.0.0.1:48678
I20260709 13:10:10.249063 24323 raft_consensus.cc:740] T c4607544e6a241349a1a35df8aaca446 P f39804e3bc0e439286a172ab4c75e032 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f39804e3bc0e439286a172ab4c75e032, State: Running, Role: LEADER
I20260709 13:10:10.249228 24397 raft_consensus.cc:493] T 072781c592984c6a9a6f3d8790809bd1 P ba007af05f0f4fb3aa79a70a4ed62188 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:10.249588 24397 raft_consensus.cc:3060] T 072781c592984c6a9a6f3d8790809bd1 P ba007af05f0f4fb3aa79a70a4ed62188 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:10.249996 24323 consensus_queue.cc:260] T c4607544e6a241349a1a35df8aaca446 P f39804e3bc0e439286a172ab4c75e032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:10.250108 24145 catalog_manager.cc:5697] T 2824545a6ec14281b292a9a80984e5d7 P 89434398bef1483abb7170861c595c08 reported cstate change: term changed from 2 to 3, leader changed from f39804e3bc0e439286a172ab4c75e032 (127.23.140.66) to 89434398bef1483abb7170861c595c08 (127.23.140.65). New cstate: current_term: 3 leader_uuid: "89434398bef1483abb7170861c595c08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:10.251173 24323 raft_consensus.cc:3060] T c4607544e6a241349a1a35df8aaca446 P f39804e3bc0e439286a172ab4c75e032 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:10.253662 24396 raft_consensus.cc:2468] T c4607544e6a241349a1a35df8aaca446 P ba007af05f0f4fb3aa79a70a4ed62188 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89434398bef1483abb7170861c595c08 in term 4.
I20260709 13:10:10.254715 24213 leader_election.cc:304] T c4607544e6a241349a1a35df8aaca446 P 89434398bef1483abb7170861c595c08 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89434398bef1483abb7170861c595c08, ba007af05f0f4fb3aa79a70a4ed62188; no voters: 
I20260709 13:10:10.255522 24588 raft_consensus.cc:2804] T c4607544e6a241349a1a35df8aaca446 P 89434398bef1483abb7170861c595c08 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:10.255729 24397 raft_consensus.cc:515] T 072781c592984c6a9a6f3d8790809bd1 P ba007af05f0f4fb3aa79a70a4ed62188 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:10.256178 24588 raft_consensus.cc:697] T c4607544e6a241349a1a35df8aaca446 P 89434398bef1483abb7170861c595c08 [term 4 LEADER]: Becoming Leader. State: Replica: 89434398bef1483abb7170861c595c08, State: Running, Role: LEADER
I20260709 13:10:10.257445 24323 raft_consensus.cc:2468] T c4607544e6a241349a1a35df8aaca446 P f39804e3bc0e439286a172ab4c75e032 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89434398bef1483abb7170861c595c08 in term 4.
I20260709 13:10:10.257037 24588 consensus_queue.cc:237] T c4607544e6a241349a1a35df8aaca446 P 89434398bef1483abb7170861c595c08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:10.258324 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "072781c592984c6a9a6f3d8790809bd1" candidate_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "89434398bef1483abb7170861c595c08"
I20260709 13:10:10.258898 24248 raft_consensus.cc:3060] T 072781c592984c6a9a6f3d8790809bd1 P 89434398bef1483abb7170861c595c08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:10.258948 24323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "072781c592984c6a9a6f3d8790809bd1" candidate_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "f39804e3bc0e439286a172ab4c75e032"
I20260709 13:10:10.259579 24397 leader_election.cc:290] T 072781c592984c6a9a6f3d8790809bd1 P ba007af05f0f4fb3aa79a70a4ed62188 [CANDIDATE]: Term 5 election: Requested vote from peers 89434398bef1483abb7170861c595c08 (127.23.140.65:42583), f39804e3bc0e439286a172ab4c75e032 (127.23.140.66:37967)
I20260709 13:10:10.259985 24323 raft_consensus.cc:3055] T 072781c592984c6a9a6f3d8790809bd1 P f39804e3bc0e439286a172ab4c75e032 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:10.261091 24323 raft_consensus.cc:740] T 072781c592984c6a9a6f3d8790809bd1 P f39804e3bc0e439286a172ab4c75e032 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f39804e3bc0e439286a172ab4c75e032, State: Running, Role: LEADER
I20260709 13:10:10.261884 24323 consensus_queue.cc:260] T 072781c592984c6a9a6f3d8790809bd1 P f39804e3bc0e439286a172ab4c75e032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:10.263275 24323 raft_consensus.cc:3060] T 072781c592984c6a9a6f3d8790809bd1 P f39804e3bc0e439286a172ab4c75e032 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:10.265136 24248 raft_consensus.cc:2468] T 072781c592984c6a9a6f3d8790809bd1 P 89434398bef1483abb7170861c595c08 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba007af05f0f4fb3aa79a70a4ed62188 in term 5.
I20260709 13:10:10.266124 24360 leader_election.cc:304] T 072781c592984c6a9a6f3d8790809bd1 P ba007af05f0f4fb3aa79a70a4ed62188 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89434398bef1483abb7170861c595c08, ba007af05f0f4fb3aa79a70a4ed62188; no voters: 
I20260709 13:10:10.266798 24544 raft_consensus.cc:2804] T 072781c592984c6a9a6f3d8790809bd1 P ba007af05f0f4fb3aa79a70a4ed62188 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:10.267361 24544 raft_consensus.cc:697] T 072781c592984c6a9a6f3d8790809bd1 P ba007af05f0f4fb3aa79a70a4ed62188 [term 5 LEADER]: Becoming Leader. State: Replica: ba007af05f0f4fb3aa79a70a4ed62188, State: Running, Role: LEADER
I20260709 13:10:10.266758 24145 catalog_manager.cc:5697] T c4607544e6a241349a1a35df8aaca446 P 89434398bef1483abb7170861c595c08 reported cstate change: term changed from 3 to 4, leader changed from f39804e3bc0e439286a172ab4c75e032 (127.23.140.66) to 89434398bef1483abb7170861c595c08 (127.23.140.65). New cstate: current_term: 4 leader_uuid: "89434398bef1483abb7170861c595c08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:10.268132 24544 consensus_queue.cc:237] T 072781c592984c6a9a6f3d8790809bd1 P ba007af05f0f4fb3aa79a70a4ed62188 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } }
I20260709 13:10:10.269361 24323 raft_consensus.cc:2468] T 072781c592984c6a9a6f3d8790809bd1 P f39804e3bc0e439286a172ab4c75e032 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba007af05f0f4fb3aa79a70a4ed62188 in term 5.
I20260709 13:10:10.276285 24143 catalog_manager.cc:5697] T 072781c592984c6a9a6f3d8790809bd1 P ba007af05f0f4fb3aa79a70a4ed62188 reported cstate change: term changed from 4 to 5, leader changed from f39804e3bc0e439286a172ab4c75e032 (127.23.140.66) to ba007af05f0f4fb3aa79a70a4ed62188 (127.23.140.67). New cstate: current_term: 5 leader_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:10.324287 24323 raft_consensus.cc:1275] T a2b8f465407049c093b74b89e0cc8fc3 P f39804e3bc0e439286a172ab4c75e032 [term 3 FOLLOWER]: Refusing update from remote peer ba007af05f0f4fb3aa79a70a4ed62188: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:10.325397 24544 consensus_queue.cc:1048] T a2b8f465407049c093b74b89e0cc8fc3 P ba007af05f0f4fb3aa79a70a4ed62188 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:10.334483 24248 raft_consensus.cc:1275] T a2b8f465407049c093b74b89e0cc8fc3 P 89434398bef1483abb7170861c595c08 [term 3 FOLLOWER]: Refusing update from remote peer ba007af05f0f4fb3aa79a70a4ed62188: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:10.335862 24544 consensus_queue.cc:1048] T a2b8f465407049c093b74b89e0cc8fc3 P ba007af05f0f4fb3aa79a70a4ed62188 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:10.645424 24396 raft_consensus.cc:1275] T 2824545a6ec14281b292a9a80984e5d7 P ba007af05f0f4fb3aa79a70a4ed62188 [term 3 FOLLOWER]: Refusing update from remote peer 89434398bef1483abb7170861c595c08: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:10.645964 24323 raft_consensus.cc:1275] T fdb7ba4cacaf498d83b351d63a57aa7b P f39804e3bc0e439286a172ab4c75e032 [term 3 FOLLOWER]: Refusing update from remote peer 89434398bef1483abb7170861c595c08: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:10.646934 24589 consensus_queue.cc:1048] T 2824545a6ec14281b292a9a80984e5d7 P 89434398bef1483abb7170861c595c08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:10.647182 24588 consensus_queue.cc:1048] T fdb7ba4cacaf498d83b351d63a57aa7b P 89434398bef1483abb7170861c595c08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:10.651714 24322 raft_consensus.cc:1275] T 072781c592984c6a9a6f3d8790809bd1 P f39804e3bc0e439286a172ab4c75e032 [term 5 FOLLOWER]: Refusing update from remote peer ba007af05f0f4fb3aa79a70a4ed62188: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:10:10.653502 24582 consensus_queue.cc:1048] T 072781c592984c6a9a6f3d8790809bd1 P ba007af05f0f4fb3aa79a70a4ed62188 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:10.674118 24248 raft_consensus.cc:1275] T 072781c592984c6a9a6f3d8790809bd1 P 89434398bef1483abb7170861c595c08 [term 5 FOLLOWER]: Refusing update from remote peer ba007af05f0f4fb3aa79a70a4ed62188: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:10:10.675833 24544 consensus_queue.cc:1048] T 072781c592984c6a9a6f3d8790809bd1 P ba007af05f0f4fb3aa79a70a4ed62188 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89434398bef1483abb7170861c595c08" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 42583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:10.676731 24396 raft_consensus.cc:1275] T fdb7ba4cacaf498d83b351d63a57aa7b P ba007af05f0f4fb3aa79a70a4ed62188 [term 3 FOLLOWER]: Refusing update from remote peer 89434398bef1483abb7170861c595c08: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:10.676731 24323 raft_consensus.cc:1275] T 2824545a6ec14281b292a9a80984e5d7 P f39804e3bc0e439286a172ab4c75e032 [term 3 FOLLOWER]: Refusing update from remote peer 89434398bef1483abb7170861c595c08: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:10.681217 24602 consensus_queue.cc:1048] T fdb7ba4cacaf498d83b351d63a57aa7b P 89434398bef1483abb7170861c595c08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:10.692214 24601 consensus_queue.cc:1048] T 2824545a6ec14281b292a9a80984e5d7 P 89434398bef1483abb7170861c595c08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:10.781266 24396 raft_consensus.cc:1275] T c4607544e6a241349a1a35df8aaca446 P ba007af05f0f4fb3aa79a70a4ed62188 [term 4 FOLLOWER]: Refusing update from remote peer 89434398bef1483abb7170861c595c08: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:10.782627 24602 consensus_queue.cc:1048] T c4607544e6a241349a1a35df8aaca446 P 89434398bef1483abb7170861c595c08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba007af05f0f4fb3aa79a70a4ed62188" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:10.790557 24323 raft_consensus.cc:1275] T c4607544e6a241349a1a35df8aaca446 P f39804e3bc0e439286a172ab4c75e032 [term 4 FOLLOWER]: Refusing update from remote peer 89434398bef1483abb7170861c595c08: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:10.792553 24601 consensus_queue.cc:1048] T c4607544e6a241349a1a35df8aaca446 P 89434398bef1483abb7170861c595c08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f39804e3bc0e439286a172ab4c75e032" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:10.837918 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:10.843780 24113 tablet_server.cc:179] TabletServer@127.23.140.65:0 shutting down...
I20260709 13:10:10.871441 24113 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:10.872258 24113 tablet_replica.cc:333] T a14d80b5fd8747d3b44afc1fc32ecffa P 89434398bef1483abb7170861c595c08: stopping tablet replica
I20260709 13:10:10.873071 24113 raft_consensus.cc:2243] T a14d80b5fd8747d3b44afc1fc32ecffa P 89434398bef1483abb7170861c595c08 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:10.873587 24113 raft_consensus.cc:2272] T a14d80b5fd8747d3b44afc1fc32ecffa P 89434398bef1483abb7170861c595c08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:10.875728 24113 tablet_replica.cc:333] T 072781c592984c6a9a6f3d8790809bd1 P 89434398bef1483abb7170861c595c08: stopping tablet replica
I20260709 13:10:10.876238 24113 raft_consensus.cc:2243] T 072781c592984c6a9a6f3d8790809bd1 P 89434398bef1483abb7170861c595c08 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:10.876653 24113 raft_consensus.cc:2272] T 072781c592984c6a9a6f3d8790809bd1 P 89434398bef1483abb7170861c595c08 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:10.878546 24113 tablet_replica.cc:333] T d3529531034c4da8ace2a1b8bcc7c934 P 89434398bef1483abb7170861c595c08: stopping tablet replica
I20260709 13:10:10.879033 24113 raft_consensus.cc:2243] T d3529531034c4da8ace2a1b8bcc7c934 P 89434398bef1483abb7170861c595c08 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:10.879451 24113 raft_consensus.cc:2272] T d3529531034c4da8ace2a1b8bcc7c934 P 89434398bef1483abb7170861c595c08 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:10.880900 24113 tablet_replica.cc:333] T 2824545a6ec14281b292a9a80984e5d7 P 89434398bef1483abb7170861c595c08: stopping tablet replica
I20260709 13:10:10.881362 24113 raft_consensus.cc:2243] T 2824545a6ec14281b292a9a80984e5d7 P 89434398bef1483abb7170861c595c08 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:10.882102 24113 raft_consensus.cc:2272] T 2824545a6ec14281b292a9a80984e5d7 P 89434398bef1483abb7170861c595c08 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:10.884493 24113 tablet_replica.cc:333] T 57caa52201cc4aaba1de74ac8393a6a6 P 89434398bef1483abb7170861c595c08: stopping tablet replica
I20260709 13:10:10.884953 24113 raft_consensus.cc:2243] T 57caa52201cc4aaba1de74ac8393a6a6 P 89434398bef1483abb7170861c595c08 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:10.885332 24113 raft_consensus.cc:2272] T 57caa52201cc4aaba1de74ac8393a6a6 P 89434398bef1483abb7170861c595c08 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:10.886828 24113 tablet_replica.cc:333] T a2b8f465407049c093b74b89e0cc8fc3 P 89434398bef1483abb7170861c595c08: stopping tablet replica
I20260709 13:10:10.887279 24113 raft_consensus.cc:2243] T a2b8f465407049c093b74b89e0cc8fc3 P 89434398bef1483abb7170861c595c08 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:10.887674 24113 raft_consensus.cc:2272] T a2b8f465407049c093b74b89e0cc8fc3 P 89434398bef1483abb7170861c595c08 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:10.889659 24113 tablet_replica.cc:333] T c4607544e6a241349a1a35df8aaca446 P 89434398bef1483abb7170861c595c08: stopping tablet replica
I20260709 13:10:10.890194 24113 raft_consensus.cc:2243] T c4607544e6a241349a1a35df8aaca446 P 89434398bef1483abb7170861c595c08 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:10:10.890872 24113 raft_consensus.cc:2272] T c4607544e6a241349a1a35df8aaca446 P 89434398bef1483abb7170861c595c08 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:10.892798 24113 tablet_replica.cc:333] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P 89434398bef1483abb7170861c595c08: stopping tablet replica
I20260709 13:10:10.893401 24113 raft_consensus.cc:2243] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P 89434398bef1483abb7170861c595c08 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:10.893890 24113 raft_consensus.cc:2272] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P 89434398bef1483abb7170861c595c08 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:10.895417 24113 tablet_replica.cc:333] T fdb7ba4cacaf498d83b351d63a57aa7b P 89434398bef1483abb7170861c595c08: stopping tablet replica
I20260709 13:10:10.895864 24113 raft_consensus.cc:2243] T fdb7ba4cacaf498d83b351d63a57aa7b P 89434398bef1483abb7170861c595c08 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:10.896644 24113 raft_consensus.cc:2272] T fdb7ba4cacaf498d83b351d63a57aa7b P 89434398bef1483abb7170861c595c08 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:11.022114 24286 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.140.65:42583: connect: Connection refused (error 111)
I20260709 13:10:11.024580 24113 tablet_server.cc:196] TabletServer@127.23.140.65:0 shutdown complete.
W20260709 13:10:11.026674 24286 consensus_peers.cc:597] T d3529531034c4da8ace2a1b8bcc7c934 P f39804e3bc0e439286a172ab4c75e032 -> Peer 89434398bef1483abb7170861c595c08 (127.23.140.65:42583): Couldn't send request to peer 89434398bef1483abb7170861c595c08. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:42583: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:11.028498 24360 consensus_peers.cc:597] T a2b8f465407049c093b74b89e0cc8fc3 P ba007af05f0f4fb3aa79a70a4ed62188 -> Peer 89434398bef1483abb7170861c595c08 (127.23.140.65:42583): Couldn't send request to peer 89434398bef1483abb7170861c595c08. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:42583: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:11.041414 24286 consensus_peers.cc:597] T 57caa52201cc4aaba1de74ac8393a6a6 P f39804e3bc0e439286a172ab4c75e032 -> Peer 89434398bef1483abb7170861c595c08 (127.23.140.65:42583): Couldn't send request to peer 89434398bef1483abb7170861c595c08. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:42583: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:11.045497 24113 tablet_server.cc:179] TabletServer@127.23.140.66:0 shutting down...
I20260709 13:10:11.068176 24113 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:11.068840 24113 tablet_replica.cc:333] T a14d80b5fd8747d3b44afc1fc32ecffa P f39804e3bc0e439286a172ab4c75e032: stopping tablet replica
I20260709 13:10:11.069386 24113 raft_consensus.cc:2243] T a14d80b5fd8747d3b44afc1fc32ecffa P f39804e3bc0e439286a172ab4c75e032 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:11.069867 24113 raft_consensus.cc:2272] T a14d80b5fd8747d3b44afc1fc32ecffa P f39804e3bc0e439286a172ab4c75e032 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:11.071624 24113 tablet_replica.cc:333] T fdb7ba4cacaf498d83b351d63a57aa7b P f39804e3bc0e439286a172ab4c75e032: stopping tablet replica
I20260709 13:10:11.072068 24113 raft_consensus.cc:2243] T fdb7ba4cacaf498d83b351d63a57aa7b P f39804e3bc0e439286a172ab4c75e032 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:11.072398 24113 raft_consensus.cc:2272] T fdb7ba4cacaf498d83b351d63a57aa7b P f39804e3bc0e439286a172ab4c75e032 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:11.074365 24113 tablet_replica.cc:333] T d3529531034c4da8ace2a1b8bcc7c934 P f39804e3bc0e439286a172ab4c75e032: stopping tablet replica
I20260709 13:10:11.074795 24113 raft_consensus.cc:2243] T d3529531034c4da8ace2a1b8bcc7c934 P f39804e3bc0e439286a172ab4c75e032 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:10:11.075476 24113 raft_consensus.cc:2272] T d3529531034c4da8ace2a1b8bcc7c934 P f39804e3bc0e439286a172ab4c75e032 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:11.077015 24113 tablet_replica.cc:333] T 2824545a6ec14281b292a9a80984e5d7 P f39804e3bc0e439286a172ab4c75e032: stopping tablet replica
I20260709 13:10:11.077435 24113 raft_consensus.cc:2243] T 2824545a6ec14281b292a9a80984e5d7 P f39804e3bc0e439286a172ab4c75e032 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:11.077816 24113 raft_consensus.cc:2272] T 2824545a6ec14281b292a9a80984e5d7 P f39804e3bc0e439286a172ab4c75e032 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:11.080309 24113 tablet_replica.cc:333] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P f39804e3bc0e439286a172ab4c75e032: stopping tablet replica
I20260709 13:10:11.080844 24113 raft_consensus.cc:2243] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P f39804e3bc0e439286a172ab4c75e032 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:11.081525 24113 raft_consensus.cc:2272] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P f39804e3bc0e439286a172ab4c75e032 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:11.083355 24113 tablet_replica.cc:333] T 072781c592984c6a9a6f3d8790809bd1 P f39804e3bc0e439286a172ab4c75e032: stopping tablet replica
I20260709 13:10:11.083809 24113 raft_consensus.cc:2243] T 072781c592984c6a9a6f3d8790809bd1 P f39804e3bc0e439286a172ab4c75e032 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:11.084172 24113 raft_consensus.cc:2272] T 072781c592984c6a9a6f3d8790809bd1 P f39804e3bc0e439286a172ab4c75e032 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:11.085975 24113 tablet_replica.cc:333] T 57caa52201cc4aaba1de74ac8393a6a6 P f39804e3bc0e439286a172ab4c75e032: stopping tablet replica
I20260709 13:10:11.086438 24113 raft_consensus.cc:2243] T 57caa52201cc4aaba1de74ac8393a6a6 P f39804e3bc0e439286a172ab4c75e032 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:11.087153 24113 raft_consensus.cc:2272] T 57caa52201cc4aaba1de74ac8393a6a6 P f39804e3bc0e439286a172ab4c75e032 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:11.088625 24113 tablet_replica.cc:333] T a2b8f465407049c093b74b89e0cc8fc3 P f39804e3bc0e439286a172ab4c75e032: stopping tablet replica
I20260709 13:10:11.089093 24113 raft_consensus.cc:2243] T a2b8f465407049c093b74b89e0cc8fc3 P f39804e3bc0e439286a172ab4c75e032 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:11.089454 24113 raft_consensus.cc:2272] T a2b8f465407049c093b74b89e0cc8fc3 P f39804e3bc0e439286a172ab4c75e032 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:11.091379 24113 tablet_replica.cc:333] T c4607544e6a241349a1a35df8aaca446 P f39804e3bc0e439286a172ab4c75e032: stopping tablet replica
I20260709 13:10:11.091812 24113 raft_consensus.cc:2243] T c4607544e6a241349a1a35df8aaca446 P f39804e3bc0e439286a172ab4c75e032 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:11.092172 24113 raft_consensus.cc:2272] T c4607544e6a241349a1a35df8aaca446 P f39804e3bc0e439286a172ab4c75e032 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:11.098114 24363 consensus_peers.cc:597] T a14d80b5fd8747d3b44afc1fc32ecffa P ba007af05f0f4fb3aa79a70a4ed62188 -> Peer f39804e3bc0e439286a172ab4c75e032 (127.23.140.66:37967): Couldn't send request to peer f39804e3bc0e439286a172ab4c75e032. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:11.120863 24113 tablet_server.cc:196] TabletServer@127.23.140.66:0 shutdown complete.
I20260709 13:10:11.136972 24113 tablet_server.cc:179] TabletServer@127.23.140.67:0 shutting down...
I20260709 13:10:11.159200 24113 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:11.159840 24113 tablet_replica.cc:333] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P ba007af05f0f4fb3aa79a70a4ed62188: stopping tablet replica
I20260709 13:10:11.160440 24113 raft_consensus.cc:2243] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P ba007af05f0f4fb3aa79a70a4ed62188 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:11.160862 24113 raft_consensus.cc:2272] T 5eb056e46f2d4ddbb45fdb665a6b3eaa P ba007af05f0f4fb3aa79a70a4ed62188 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:11.162667 24113 tablet_replica.cc:333] T a14d80b5fd8747d3b44afc1fc32ecffa P ba007af05f0f4fb3aa79a70a4ed62188: stopping tablet replica
I20260709 13:10:11.163164 24113 raft_consensus.cc:2243] T a14d80b5fd8747d3b44afc1fc32ecffa P ba007af05f0f4fb3aa79a70a4ed62188 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:11.163867 24113 raft_consensus.cc:2272] T a14d80b5fd8747d3b44afc1fc32ecffa P ba007af05f0f4fb3aa79a70a4ed62188 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:11.165414 24113 tablet_replica.cc:333] T 2824545a6ec14281b292a9a80984e5d7 P ba007af05f0f4fb3aa79a70a4ed62188: stopping tablet replica
I20260709 13:10:11.165958 24113 raft_consensus.cc:2243] T 2824545a6ec14281b292a9a80984e5d7 P ba007af05f0f4fb3aa79a70a4ed62188 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:11.166355 24113 raft_consensus.cc:2272] T 2824545a6ec14281b292a9a80984e5d7 P ba007af05f0f4fb3aa79a70a4ed62188 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:11.168857 24113 tablet_replica.cc:333] T d3529531034c4da8ace2a1b8bcc7c934 P ba007af05f0f4fb3aa79a70a4ed62188: stopping tablet replica
I20260709 13:10:11.169340 24113 raft_consensus.cc:2243] T d3529531034c4da8ace2a1b8bcc7c934 P ba007af05f0f4fb3aa79a70a4ed62188 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:11.169727 24113 raft_consensus.cc:2272] T d3529531034c4da8ace2a1b8bcc7c934 P ba007af05f0f4fb3aa79a70a4ed62188 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:11.171442 24113 tablet_replica.cc:333] T 072781c592984c6a9a6f3d8790809bd1 P ba007af05f0f4fb3aa79a70a4ed62188: stopping tablet replica
I20260709 13:10:11.171926 24113 raft_consensus.cc:2243] T 072781c592984c6a9a6f3d8790809bd1 P ba007af05f0f4fb3aa79a70a4ed62188 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:10:11.172591 24113 raft_consensus.cc:2272] T 072781c592984c6a9a6f3d8790809bd1 P ba007af05f0f4fb3aa79a70a4ed62188 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:11.174465 24113 tablet_replica.cc:333] T 57caa52201cc4aaba1de74ac8393a6a6 P ba007af05f0f4fb3aa79a70a4ed62188: stopping tablet replica
I20260709 13:10:11.174953 24113 raft_consensus.cc:2243] T 57caa52201cc4aaba1de74ac8393a6a6 P ba007af05f0f4fb3aa79a70a4ed62188 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:11.175351 24113 raft_consensus.cc:2272] T 57caa52201cc4aaba1de74ac8393a6a6 P ba007af05f0f4fb3aa79a70a4ed62188 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:11.176843 24113 tablet_replica.cc:333] T a2b8f465407049c093b74b89e0cc8fc3 P ba007af05f0f4fb3aa79a70a4ed62188: stopping tablet replica
I20260709 13:10:11.177277 24113 raft_consensus.cc:2243] T a2b8f465407049c093b74b89e0cc8fc3 P ba007af05f0f4fb3aa79a70a4ed62188 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:11.178030 24113 raft_consensus.cc:2272] T a2b8f465407049c093b74b89e0cc8fc3 P ba007af05f0f4fb3aa79a70a4ed62188 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:11.179659 24113 tablet_replica.cc:333] T c4607544e6a241349a1a35df8aaca446 P ba007af05f0f4fb3aa79a70a4ed62188: stopping tablet replica
I20260709 13:10:11.180130 24113 raft_consensus.cc:2243] T c4607544e6a241349a1a35df8aaca446 P ba007af05f0f4fb3aa79a70a4ed62188 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:11.180521 24113 raft_consensus.cc:2272] T c4607544e6a241349a1a35df8aaca446 P ba007af05f0f4fb3aa79a70a4ed62188 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:11.182418 24113 tablet_replica.cc:333] T fdb7ba4cacaf498d83b351d63a57aa7b P ba007af05f0f4fb3aa79a70a4ed62188: stopping tablet replica
I20260709 13:10:11.182842 24113 raft_consensus.cc:2243] T fdb7ba4cacaf498d83b351d63a57aa7b P ba007af05f0f4fb3aa79a70a4ed62188 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:11.183223 24113 raft_consensus.cc:2272] T fdb7ba4cacaf498d83b351d63a57aa7b P ba007af05f0f4fb3aa79a70a4ed62188 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:11.208876 24113 tablet_server.cc:196] TabletServer@127.23.140.67:0 shutdown complete.
I20260709 13:10:11.225881 24113 master.cc:562] Master@127.23.140.126:32965 shutting down...
I20260709 13:10:11.329232 24113 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 061a97dd9776425a92613ba6ed47679d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:11.329849 24113 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 061a97dd9776425a92613ba6ed47679d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:11.330194 24113 tablet_replica.cc:333] T 00000000000000000000000000000000 P 061a97dd9776425a92613ba6ed47679d: stopping tablet replica
I20260709 13:10:11.349893 24113 master.cc:584] Master@127.23.140.126:32965 shutdown complete.
89434398bef1483abb7170861c595c08  4
ba007af05f0f4fb3aa79a70a4ed62188  1
f39804e3bc0e439286a172ab4c75e032  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (12540 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:10:11.388902 24113 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.23.140.126:32897
I20260709 13:10:11.390087 24113 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:11.395221 24618 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:11.396150 24619 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:11.398048 24113 server_base.cc:1061] running on GCE node
W20260709 13:10:11.398101 24621 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:11.399080 24113 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:11.399257 24113 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:11.399367 24113 hybrid_clock.cc:648] HybridClock initialized: now 1783602611399356 us; error 0 us; skew 500 ppm
I20260709 13:10:11.399809 24113 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:11.402294 24113 webserver.cc:533] Webserver started at http://127.23.140.126:35769/ using document root <none> and password file <none>
I20260709 13:10:11.402757 24113 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:11.402909 24113 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:11.403127 24113 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:11.404152 24113 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602598684750-24113-0/minicluster-data/master-0-root/instance:
uuid: "f1f9dcc6621147dea9d9b34ce23f6a16"
format_stamp: "Formatted at 2026-07-09 13:10:11 on dist-test-slave-1rs3"
I20260709 13:10:11.408300 24113 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.002s
I20260709 13:10:11.411476 24626 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:11.412195 24113 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:10:11.412487 24113 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602598684750-24113-0/minicluster-data/master-0-root
uuid: "f1f9dcc6621147dea9d9b34ce23f6a16"
format_stamp: "Formatted at 2026-07-09 13:10:11 on dist-test-slave-1rs3"
I20260709 13:10:11.412777 24113 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602598684750-24113-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602598684750-24113-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602598684750-24113-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:11.433892 24113 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:11.435104 24113 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:11.472138 24113 rpc_server.cc:307] RPC server started. Bound to: 127.23.140.126:32897
I20260709 13:10:11.472221 24677 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.140.126:32897 every 8 connection(s)
I20260709 13:10:11.476153 24678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:11.486230 24678 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1f9dcc6621147dea9d9b34ce23f6a16: Bootstrap starting.
I20260709 13:10:11.491098 24678 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f1f9dcc6621147dea9d9b34ce23f6a16: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.495462 24678 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1f9dcc6621147dea9d9b34ce23f6a16: No bootstrap required, opened a new log
I20260709 13:10:11.497629 24678 raft_consensus.cc:359] T 00000000000000000000000000000000 P f1f9dcc6621147dea9d9b34ce23f6a16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1f9dcc6621147dea9d9b34ce23f6a16" member_type: VOTER }
I20260709 13:10:11.498041 24678 raft_consensus.cc:385] T 00000000000000000000000000000000 P f1f9dcc6621147dea9d9b34ce23f6a16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.498342 24678 raft_consensus.cc:740] T 00000000000000000000000000000000 P f1f9dcc6621147dea9d9b34ce23f6a16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1f9dcc6621147dea9d9b34ce23f6a16, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.499035 24678 consensus_queue.cc:260] T 00000000000000000000000000000000 P f1f9dcc6621147dea9d9b34ce23f6a16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1f9dcc6621147dea9d9b34ce23f6a16" member_type: VOTER }
I20260709 13:10:11.499524 24678 raft_consensus.cc:399] T 00000000000000000000000000000000 P f1f9dcc6621147dea9d9b34ce23f6a16 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:10:11.499784 24678 raft_consensus.cc:493] T 00000000000000000000000000000000 P f1f9dcc6621147dea9d9b34ce23f6a16 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:10:11.500089 24678 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f1f9dcc6621147dea9d9b34ce23f6a16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.504300 24678 raft_consensus.cc:515] T 00000000000000000000000000000000 P f1f9dcc6621147dea9d9b34ce23f6a16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1f9dcc6621147dea9d9b34ce23f6a16" member_type: VOTER }
I20260709 13:10:11.504845 24678 leader_election.cc:304] T 00000000000000000000000000000000 P f1f9dcc6621147dea9d9b34ce23f6a16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f1f9dcc6621147dea9d9b34ce23f6a16; no voters: 
I20260709 13:10:11.506079 24678 leader_election.cc:290] T 00000000000000000000000000000000 P f1f9dcc6621147dea9d9b34ce23f6a16 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:10:11.506379 24681 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f1f9dcc6621147dea9d9b34ce23f6a16 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:11.507794 24681 raft_consensus.cc:697] T 00000000000000000000000000000000 P f1f9dcc6621147dea9d9b34ce23f6a16 [term 1 LEADER]: Becoming Leader. State: Replica: f1f9dcc6621147dea9d9b34ce23f6a16, State: Running, Role: LEADER
I20260709 13:10:11.508445 24681 consensus_queue.cc:237] T 00000000000000000000000000000000 P f1f9dcc6621147dea9d9b34ce23f6a16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1f9dcc6621147dea9d9b34ce23f6a16" member_type: VOTER }
I20260709 13:10:11.509232 24678 sys_catalog.cc:565] T 00000000000000000000000000000000 P f1f9dcc6621147dea9d9b34ce23f6a16 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:10:11.513559 24682 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1f9dcc6621147dea9d9b34ce23f6a16 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f1f9dcc6621147dea9d9b34ce23f6a16" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1f9dcc6621147dea9d9b34ce23f6a16" member_type: VOTER } }
I20260709 13:10:11.514477 24682 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1f9dcc6621147dea9d9b34ce23f6a16 [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:11.513525 24683 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1f9dcc6621147dea9d9b34ce23f6a16 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f1f9dcc6621147dea9d9b34ce23f6a16. Latest consensus state: current_term: 1 leader_uuid: "f1f9dcc6621147dea9d9b34ce23f6a16" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1f9dcc6621147dea9d9b34ce23f6a16" member_type: VOTER } }
I20260709 13:10:11.515723 24683 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1f9dcc6621147dea9d9b34ce23f6a16 [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:11.519632 24687 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:10:11.524637 24687 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:10:11.528834 24113 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:10:11.533639 24687 catalog_manager.cc:1383] Generated new cluster ID: de4629dccb2440ceb6fb0e7da71cac96
I20260709 13:10:11.534087 24687 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:10:11.564376 24687 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:10:11.565609 24687 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:10:11.581022 24687 catalog_manager.cc:6070] T 00000000000000000000000000000000 P f1f9dcc6621147dea9d9b34ce23f6a16: Generated new TSK 0
I20260709 13:10:11.581627 24687 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:10:11.595376 24113 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:11.601579 24699 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:11.602442 24700 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:11.604745 24113 server_base.cc:1061] running on GCE node
W20260709 13:10:11.605072 24702 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:11.605985 24113 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:11.606192 24113 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:11.606374 24113 hybrid_clock.cc:648] HybridClock initialized: now 1783602611606328 us; error 0 us; skew 500 ppm
I20260709 13:10:11.606899 24113 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:11.609191 24113 webserver.cc:533] Webserver started at http://127.23.140.65:35901/ using document root <none> and password file <none>
I20260709 13:10:11.609680 24113 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:11.609922 24113 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:11.610208 24113 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:11.611297 24113 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602598684750-24113-0/minicluster-data/ts-0-root/instance:
uuid: "92512576e6bc4561830a180ea4737d86"
format_stamp: "Formatted at 2026-07-09 13:10:11 on dist-test-slave-1rs3"
I20260709 13:10:11.615882 24113 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:10:11.619084 24707 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:11.619840 24113 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:10:11.620122 24113 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602598684750-24113-0/minicluster-data/ts-0-root
uuid: "92512576e6bc4561830a180ea4737d86"
format_stamp: "Formatted at 2026-07-09 13:10:11 on dist-test-slave-1rs3"
I20260709 13:10:11.620406 24113 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602598684750-24113-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602598684750-24113-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602598684750-24113-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:11.644439 24113 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:11.645715 24113 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:11.647254 24113 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:11.649511 24113 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:11.649739 24113 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:11.650040 24113 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:11.650226 24113 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:11.689361 24113 rpc_server.cc:307] RPC server started. Bound to: 127.23.140.65:41489
I20260709 13:10:11.689455 24769 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.140.65:41489 every 8 connection(s)
I20260709 13:10:11.693840 24113 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:11.701313 24774 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:11.704499 24775 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:11.704783 24777 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:11.705699 24113 server_base.cc:1061] running on GCE node
I20260709 13:10:11.706881 24113 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:11.707131 24113 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:11.707367 24113 hybrid_clock.cc:648] HybridClock initialized: now 1783602611707347 us; error 0 us; skew 500 ppm
I20260709 13:10:11.708019 24113 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:11.710208 24770 heartbeater.cc:344] Connected to a master server at 127.23.140.126:32897
I20260709 13:10:11.710554 24770 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:11.711089 24113 webserver.cc:533] Webserver started at http://127.23.140.66:39587/ using document root <none> and password file <none>
I20260709 13:10:11.711429 24770 heartbeater.cc:507] Master 127.23.140.126:32897 requested a full tablet report, sending...
I20260709 13:10:11.711596 24113 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:11.711884 24113 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:11.712174 24113 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:11.713605 24113 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602598684750-24113-0/minicluster-data/ts-1-root/instance:
uuid: "41f9a4e2214e4382bb2fad82711a2472"
format_stamp: "Formatted at 2026-07-09 13:10:11 on dist-test-slave-1rs3"
I20260709 13:10:11.713718 24643 ts_manager.cc:194] Registered new tserver with Master: 92512576e6bc4561830a180ea4737d86 (127.23.140.65:41489)
I20260709 13:10:11.716166 24643 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59612
I20260709 13:10:11.719177 24113 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:10:11.722452 24782 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:11.723407 24113 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:10:11.723675 24113 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602598684750-24113-0/minicluster-data/ts-1-root
uuid: "41f9a4e2214e4382bb2fad82711a2472"
format_stamp: "Formatted at 2026-07-09 13:10:11 on dist-test-slave-1rs3"
I20260709 13:10:11.723937 24113 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602598684750-24113-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602598684750-24113-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602598684750-24113-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:11.755275 24113 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:11.756927 24113 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:11.758672 24113 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:11.760881 24113 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:11.761101 24113 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:11.761358 24113 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:11.761525 24113 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:11.800329 24113 rpc_server.cc:307] RPC server started. Bound to: 127.23.140.66:42587
I20260709 13:10:11.800448 24844 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.140.66:42587 every 8 connection(s)
I20260709 13:10:11.805051 24113 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:11.811796 24848 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:11.813519 24849 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:11.817327 24851 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:11.817405 24113 server_base.cc:1061] running on GCE node
I20260709 13:10:11.817431 24845 heartbeater.cc:344] Connected to a master server at 127.23.140.126:32897
I20260709 13:10:11.818182 24845 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:11.818744 24113 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:11.819031 24113 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:11.819115 24845 heartbeater.cc:507] Master 127.23.140.126:32897 requested a full tablet report, sending...
I20260709 13:10:11.819290 24113 hybrid_clock.cc:648] HybridClock initialized: now 1783602611819260 us; error 0 us; skew 500 ppm
I20260709 13:10:11.820142 24113 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:11.821352 24643 ts_manager.cc:194] Registered new tserver with Master: 41f9a4e2214e4382bb2fad82711a2472 (127.23.140.66:42587)
I20260709 13:10:11.822921 24113 webserver.cc:533] Webserver started at http://127.23.140.67:35545/ using document root <none> and password file <none>
I20260709 13:10:11.823089 24643 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59614
I20260709 13:10:11.823546 24113 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:11.823796 24113 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:11.824088 24113 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:11.825731 24113 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602598684750-24113-0/minicluster-data/ts-2-root/instance:
uuid: "f0788fe60e4d4891b51e6f092e50bb10"
format_stamp: "Formatted at 2026-07-09 13:10:11 on dist-test-slave-1rs3"
I20260709 13:10:11.830452 24113 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:10:11.833887 24856 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:11.834759 24113 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:10:11.835009 24113 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602598684750-24113-0/minicluster-data/ts-2-root
uuid: "f0788fe60e4d4891b51e6f092e50bb10"
format_stamp: "Formatted at 2026-07-09 13:10:11 on dist-test-slave-1rs3"
I20260709 13:10:11.835238 24113 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602598684750-24113-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602598684750-24113-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602598684750-24113-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:11.863555 24113 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:11.864686 24113 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:11.866140 24113 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:11.868274 24113 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:11.868444 24113 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:11.868741 24113 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:11.868893 24113 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:11.907215 24113 rpc_server.cc:307] RPC server started. Bound to: 127.23.140.67:43673
I20260709 13:10:11.907298 24918 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.140.67:43673 every 8 connection(s)
I20260709 13:10:11.920207 24919 heartbeater.cc:344] Connected to a master server at 127.23.140.126:32897
I20260709 13:10:11.920576 24919 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:11.921322 24919 heartbeater.cc:507] Master 127.23.140.126:32897 requested a full tablet report, sending...
I20260709 13:10:11.923447 24643 ts_manager.cc:194] Registered new tserver with Master: f0788fe60e4d4891b51e6f092e50bb10 (127.23.140.67:43673)
I20260709 13:10:11.923588 24113 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013437847s
I20260709 13:10:11.924763 24643 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59628
I20260709 13:10:11.947656 24643 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59638:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:11.950346 24643 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:12.022732 24809 tablet_service.cc:1511] Processing CreateTablet for tablet fdad60a3620c40daa67e9436d4d5d174 (DEFAULT_TABLE table=test-workload [id=3025dd3fc250479bb8f9311ad3239817]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:10:12.024219 24809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdad60a3620c40daa67e9436d4d5d174. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:12.023910 24808 tablet_service.cc:1511] Processing CreateTablet for tablet 6c309103ab794ba7a09dedd040db10d7 (DEFAULT_TABLE table=test-workload [id=3025dd3fc250479bb8f9311ad3239817]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:10:12.025316 24808 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c309103ab794ba7a09dedd040db10d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:12.025122 24806 tablet_service.cc:1511] Processing CreateTablet for tablet 8ab8d9cd192348f09921ada29f04e55d (DEFAULT_TABLE table=test-workload [id=3025dd3fc250479bb8f9311ad3239817]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:10:12.026479 24806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ab8d9cd192348f09921ada29f04e55d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:12.026373 24810 tablet_service.cc:1511] Processing CreateTablet for tablet 23eeb369895744038073e959747f6f13 (DEFAULT_TABLE table=test-workload [id=3025dd3fc250479bb8f9311ad3239817]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:10:12.028228 24810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23eeb369895744038073e959747f6f13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:12.027961 24805 tablet_service.cc:1511] Processing CreateTablet for tablet a354f2f44e1c42e7a605864651a66beb (DEFAULT_TABLE table=test-workload [id=3025dd3fc250479bb8f9311ad3239817]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:10:12.029253 24805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a354f2f44e1c42e7a605864651a66beb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:12.031028 24807 tablet_service.cc:1511] Processing CreateTablet for tablet edb957f6330c46abab225a43aa102b4e (DEFAULT_TABLE table=test-workload [id=3025dd3fc250479bb8f9311ad3239817]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:10:12.032255 24807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edb957f6330c46abab225a43aa102b4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:12.035313 24804 tablet_service.cc:1511] Processing CreateTablet for tablet 3e8dbf03cb5e4334a7231c02b4f45bee (DEFAULT_TABLE table=test-workload [id=3025dd3fc250479bb8f9311ad3239817]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:10:12.036564 24804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e8dbf03cb5e4334a7231c02b4f45bee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:12.039407 24803 tablet_service.cc:1511] Processing CreateTablet for tablet 7ad37a53739d49499dc91aa56c61feb5 (DEFAULT_TABLE table=test-workload [id=3025dd3fc250479bb8f9311ad3239817]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:10:12.040673 24803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ad37a53739d49499dc91aa56c61feb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:12.054991 24802 tablet_service.cc:1511] Processing CreateTablet for tablet e1552504f8884142b4ccc09f539a6998 (DEFAULT_TABLE table=test-workload [id=3025dd3fc250479bb8f9311ad3239817]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:10:12.056298 24802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1552504f8884142b4ccc09f539a6998. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:12.058458 24735 tablet_service.cc:1511] Processing CreateTablet for tablet 23eeb369895744038073e959747f6f13 (DEFAULT_TABLE table=test-workload [id=3025dd3fc250479bb8f9311ad3239817]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:10:12.059739 24735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23eeb369895744038073e959747f6f13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:12.060278 24730 tablet_service.cc:1511] Processing CreateTablet for tablet a354f2f44e1c42e7a605864651a66beb (DEFAULT_TABLE table=test-workload [id=3025dd3fc250479bb8f9311ad3239817]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:10:12.061509 24730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a354f2f44e1c42e7a605864651a66beb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:12.062889 24734 tablet_service.cc:1511] Processing CreateTablet for tablet fdad60a3620c40daa67e9436d4d5d174 (DEFAULT_TABLE table=test-workload [id=3025dd3fc250479bb8f9311ad3239817]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:10:12.063887 24728 tablet_service.cc:1511] Processing CreateTablet for tablet 7ad37a53739d49499dc91aa56c61feb5 (DEFAULT_TABLE table=test-workload [id=3025dd3fc250479bb8f9311ad3239817]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:10:12.065094 24733 tablet_service.cc:1511] Processing CreateTablet for tablet 6c309103ab794ba7a09dedd040db10d7 (DEFAULT_TABLE table=test-workload [id=3025dd3fc250479bb8f9311ad3239817]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:10:12.065946 24727 tablet_service.cc:1511] Processing CreateTablet for tablet e1552504f8884142b4ccc09f539a6998 (DEFAULT_TABLE table=test-workload [id=3025dd3fc250479bb8f9311ad3239817]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:10:12.067276 24732 tablet_service.cc:1511] Processing CreateTablet for tablet edb957f6330c46abab225a43aa102b4e (DEFAULT_TABLE table=test-workload [id=3025dd3fc250479bb8f9311ad3239817]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:10:12.068113 24726 tablet_service.cc:1511] Processing CreateTablet for tablet 344ea3140811457ebf5f36122fd88e52 (DEFAULT_TABLE table=test-workload [id=3025dd3fc250479bb8f9311ad3239817]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:10:12.062891 24729 tablet_service.cc:1511] Processing CreateTablet for tablet 3e8dbf03cb5e4334a7231c02b4f45bee (DEFAULT_TABLE table=test-workload [id=3025dd3fc250479bb8f9311ad3239817]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:10:12.069341 24731 tablet_service.cc:1511] Processing CreateTablet for tablet 8ab8d9cd192348f09921ada29f04e55d (DEFAULT_TABLE table=test-workload [id=3025dd3fc250479bb8f9311ad3239817]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:10:12.072666 24733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c309103ab794ba7a09dedd040db10d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:12.074110 24728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ad37a53739d49499dc91aa56c61feb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:12.074869 24732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edb957f6330c46abab225a43aa102b4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:12.075444 24731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ab8d9cd192348f09921ada29f04e55d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:12.078766 24810 tablet_service.cc:1511] Processing CreateTablet for tablet 344ea3140811457ebf5f36122fd88e52 (DEFAULT_TABLE table=test-workload [id=3025dd3fc250479bb8f9311ad3239817]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:10:12.080344 24810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 344ea3140811457ebf5f36122fd88e52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:12.097832 24734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdad60a3620c40daa67e9436d4d5d174. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:12.098909 24727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1552504f8884142b4ccc09f539a6998. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:12.101040 24726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 344ea3140811457ebf5f36122fd88e52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:12.101805 24729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e8dbf03cb5e4334a7231c02b4f45bee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:12.138988 24880 tablet_service.cc:1511] Processing CreateTablet for tablet 8ab8d9cd192348f09921ada29f04e55d (DEFAULT_TABLE table=test-workload [id=3025dd3fc250479bb8f9311ad3239817]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:10:12.139469 24884 tablet_service.cc:1511] Processing CreateTablet for tablet 23eeb369895744038073e959747f6f13 (DEFAULT_TABLE table=test-workload [id=3025dd3fc250479bb8f9311ad3239817]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:10:12.140812 24880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ab8d9cd192348f09921ada29f04e55d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:12.144238 24881 tablet_service.cc:1511] Processing CreateTablet for tablet edb957f6330c46abab225a43aa102b4e (DEFAULT_TABLE table=test-workload [id=3025dd3fc250479bb8f9311ad3239817]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:10:12.146217 24878 tablet_service.cc:1511] Processing CreateTablet for tablet 3e8dbf03cb5e4334a7231c02b4f45bee (DEFAULT_TABLE table=test-workload [id=3025dd3fc250479bb8f9311ad3239817]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:10:12.147938 24882 tablet_service.cc:1511] Processing CreateTablet for tablet 6c309103ab794ba7a09dedd040db10d7 (DEFAULT_TABLE table=test-workload [id=3025dd3fc250479bb8f9311ad3239817]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:10:12.149797 24877 tablet_service.cc:1511] Processing CreateTablet for tablet 7ad37a53739d49499dc91aa56c61feb5 (DEFAULT_TABLE table=test-workload [id=3025dd3fc250479bb8f9311ad3239817]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:10:12.152045 24876 tablet_service.cc:1511] Processing CreateTablet for tablet e1552504f8884142b4ccc09f539a6998 (DEFAULT_TABLE table=test-workload [id=3025dd3fc250479bb8f9311ad3239817]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:10:12.154377 24875 tablet_service.cc:1511] Processing CreateTablet for tablet 344ea3140811457ebf5f36122fd88e52 (DEFAULT_TABLE table=test-workload [id=3025dd3fc250479bb8f9311ad3239817]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:10:12.142843 24879 tablet_service.cc:1511] Processing CreateTablet for tablet a354f2f44e1c42e7a605864651a66beb (DEFAULT_TABLE table=test-workload [id=3025dd3fc250479bb8f9311ad3239817]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:10:12.141284 24883 tablet_service.cc:1511] Processing CreateTablet for tablet fdad60a3620c40daa67e9436d4d5d174 (DEFAULT_TABLE table=test-workload [id=3025dd3fc250479bb8f9311ad3239817]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:10:12.158217 24881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edb957f6330c46abab225a43aa102b4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:12.160619 24884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23eeb369895744038073e959747f6f13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:12.162312 24882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c309103ab794ba7a09dedd040db10d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:12.163915 24877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ad37a53739d49499dc91aa56c61feb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:12.165583 24876 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1552504f8884142b4ccc09f539a6998. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:12.166414 24875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 344ea3140811457ebf5f36122fd88e52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:12.168005 24879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a354f2f44e1c42e7a605864651a66beb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:12.169369 24883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdad60a3620c40daa67e9436d4d5d174. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:12.170719 24878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e8dbf03cb5e4334a7231c02b4f45bee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:12.240397 24934 tablet_bootstrap.cc:492] T fdad60a3620c40daa67e9436d4d5d174 P 41f9a4e2214e4382bb2fad82711a2472: Bootstrap starting.
W20260709 13:10:12.253872 24627 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.23.140.66:42587, user_credentials={real_user=slave}} blocked reactor thread for 78887.3us
I20260709 13:10:12.306918 24936 tablet_bootstrap.cc:492] T a354f2f44e1c42e7a605864651a66beb P 92512576e6bc4561830a180ea4737d86: Bootstrap starting.
I20260709 13:10:12.307711 24934 tablet_bootstrap.cc:654] T fdad60a3620c40daa67e9436d4d5d174 P 41f9a4e2214e4382bb2fad82711a2472: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.317237 24936 tablet_bootstrap.cc:654] T a354f2f44e1c42e7a605864651a66beb P 92512576e6bc4561830a180ea4737d86: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.324903 24935 tablet_bootstrap.cc:492] T 3e8dbf03cb5e4334a7231c02b4f45bee P f0788fe60e4d4891b51e6f092e50bb10: Bootstrap starting.
I20260709 13:10:12.327366 24934 tablet_bootstrap.cc:492] T fdad60a3620c40daa67e9436d4d5d174 P 41f9a4e2214e4382bb2fad82711a2472: No bootstrap required, opened a new log
I20260709 13:10:12.327924 24934 ts_tablet_manager.cc:1403] T fdad60a3620c40daa67e9436d4d5d174 P 41f9a4e2214e4382bb2fad82711a2472: Time spent bootstrapping tablet: real 0.088s	user 0.015s	sys 0.004s
I20260709 13:10:12.327389 24936 tablet_bootstrap.cc:492] T a354f2f44e1c42e7a605864651a66beb P 92512576e6bc4561830a180ea4737d86: No bootstrap required, opened a new log
I20260709 13:10:12.328677 24936 ts_tablet_manager.cc:1403] T a354f2f44e1c42e7a605864651a66beb P 92512576e6bc4561830a180ea4737d86: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.000s
I20260709 13:10:12.329978 24934 raft_consensus.cc:359] T fdad60a3620c40daa67e9436d4d5d174 P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.330475 24934 raft_consensus.cc:385] T fdad60a3620c40daa67e9436d4d5d174 P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.330660 24934 raft_consensus.cc:740] T fdad60a3620c40daa67e9436d4d5d174 P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41f9a4e2214e4382bb2fad82711a2472, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.331140 24934 consensus_queue.cc:260] T fdad60a3620c40daa67e9436d4d5d174 P 41f9a4e2214e4382bb2fad82711a2472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.331629 24936 raft_consensus.cc:359] T a354f2f44e1c42e7a605864651a66beb P 92512576e6bc4561830a180ea4737d86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.332378 24936 raft_consensus.cc:385] T a354f2f44e1c42e7a605864651a66beb P 92512576e6bc4561830a180ea4737d86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.332945 24845 heartbeater.cc:499] Master 127.23.140.126:32897 was elected leader, sending a full tablet report...
I20260709 13:10:12.332683 24936 raft_consensus.cc:740] T a354f2f44e1c42e7a605864651a66beb P 92512576e6bc4561830a180ea4737d86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92512576e6bc4561830a180ea4737d86, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.333550 24934 ts_tablet_manager.cc:1434] T fdad60a3620c40daa67e9436d4d5d174 P 41f9a4e2214e4382bb2fad82711a2472: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:10:12.334004 24936 consensus_queue.cc:260] T a354f2f44e1c42e7a605864651a66beb P 92512576e6bc4561830a180ea4737d86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.334506 24934 tablet_bootstrap.cc:492] T 23eeb369895744038073e959747f6f13 P 41f9a4e2214e4382bb2fad82711a2472: Bootstrap starting.
I20260709 13:10:12.334461 24935 tablet_bootstrap.cc:654] T 3e8dbf03cb5e4334a7231c02b4f45bee P f0788fe60e4d4891b51e6f092e50bb10: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.341037 24934 tablet_bootstrap.cc:654] T 23eeb369895744038073e959747f6f13 P 41f9a4e2214e4382bb2fad82711a2472: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.343670 24936 ts_tablet_manager.cc:1434] T a354f2f44e1c42e7a605864651a66beb P 92512576e6bc4561830a180ea4737d86: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.012s
I20260709 13:10:12.344525 24770 heartbeater.cc:499] Master 127.23.140.126:32897 was elected leader, sending a full tablet report...
I20260709 13:10:12.350776 24935 tablet_bootstrap.cc:492] T 3e8dbf03cb5e4334a7231c02b4f45bee P f0788fe60e4d4891b51e6f092e50bb10: No bootstrap required, opened a new log
I20260709 13:10:12.351302 24935 ts_tablet_manager.cc:1403] T 3e8dbf03cb5e4334a7231c02b4f45bee P f0788fe60e4d4891b51e6f092e50bb10: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.004s
I20260709 13:10:12.354400 24936 tablet_bootstrap.cc:492] T 3e8dbf03cb5e4334a7231c02b4f45bee P 92512576e6bc4561830a180ea4737d86: Bootstrap starting.
I20260709 13:10:12.354400 24935 raft_consensus.cc:359] T 3e8dbf03cb5e4334a7231c02b4f45bee P f0788fe60e4d4891b51e6f092e50bb10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.355264 24935 raft_consensus.cc:385] T 3e8dbf03cb5e4334a7231c02b4f45bee P f0788fe60e4d4891b51e6f092e50bb10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.355618 24935 raft_consensus.cc:740] T 3e8dbf03cb5e4334a7231c02b4f45bee P f0788fe60e4d4891b51e6f092e50bb10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0788fe60e4d4891b51e6f092e50bb10, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.356525 24935 consensus_queue.cc:260] T 3e8dbf03cb5e4334a7231c02b4f45bee P f0788fe60e4d4891b51e6f092e50bb10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.362775 24936 tablet_bootstrap.cc:654] T 3e8dbf03cb5e4334a7231c02b4f45bee P 92512576e6bc4561830a180ea4737d86: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.365245 24940 raft_consensus.cc:493] T a354f2f44e1c42e7a605864651a66beb P 92512576e6bc4561830a180ea4737d86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.365883 24940 raft_consensus.cc:515] T a354f2f44e1c42e7a605864651a66beb P 92512576e6bc4561830a180ea4737d86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.379264 24940 leader_election.cc:290] T a354f2f44e1c42e7a605864651a66beb P 92512576e6bc4561830a180ea4737d86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41f9a4e2214e4382bb2fad82711a2472 (127.23.140.66:42587), f0788fe60e4d4891b51e6f092e50bb10 (127.23.140.67:43673)
I20260709 13:10:12.386971 24935 ts_tablet_manager.cc:1434] T 3e8dbf03cb5e4334a7231c02b4f45bee P f0788fe60e4d4891b51e6f092e50bb10: Time spent starting tablet: real 0.035s	user 0.018s	sys 0.012s
I20260709 13:10:12.387300 24919 heartbeater.cc:499] Master 127.23.140.126:32897 was elected leader, sending a full tablet report...
I20260709 13:10:12.388180 24935 tablet_bootstrap.cc:492] T 344ea3140811457ebf5f36122fd88e52 P f0788fe60e4d4891b51e6f092e50bb10: Bootstrap starting.
I20260709 13:10:12.389605 24934 tablet_bootstrap.cc:492] T 23eeb369895744038073e959747f6f13 P 41f9a4e2214e4382bb2fad82711a2472: No bootstrap required, opened a new log
I20260709 13:10:12.390237 24934 ts_tablet_manager.cc:1403] T 23eeb369895744038073e959747f6f13 P 41f9a4e2214e4382bb2fad82711a2472: Time spent bootstrapping tablet: real 0.056s	user 0.025s	sys 0.027s
I20260709 13:10:12.394800 24935 tablet_bootstrap.cc:654] T 344ea3140811457ebf5f36122fd88e52 P f0788fe60e4d4891b51e6f092e50bb10: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.404856 24934 raft_consensus.cc:359] T 23eeb369895744038073e959747f6f13 P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.405882 24934 raft_consensus.cc:385] T 23eeb369895744038073e959747f6f13 P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.406270 24934 raft_consensus.cc:740] T 23eeb369895744038073e959747f6f13 P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41f9a4e2214e4382bb2fad82711a2472, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.406705 24935 tablet_bootstrap.cc:492] T 344ea3140811457ebf5f36122fd88e52 P f0788fe60e4d4891b51e6f092e50bb10: No bootstrap required, opened a new log
I20260709 13:10:12.406464 24894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a354f2f44e1c42e7a605864651a66beb" candidate_uuid: "92512576e6bc4561830a180ea4737d86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0788fe60e4d4891b51e6f092e50bb10" is_pre_election: true
I20260709 13:10:12.407235 24934 consensus_queue.cc:260] T 23eeb369895744038073e959747f6f13 P 41f9a4e2214e4382bb2fad82711a2472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
W20260709 13:10:12.408113 24709 leader_election.cc:343] T a354f2f44e1c42e7a605864651a66beb P 92512576e6bc4561830a180ea4737d86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0788fe60e4d4891b51e6f092e50bb10 (127.23.140.67:43673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:12.409090 24935 ts_tablet_manager.cc:1403] T 344ea3140811457ebf5f36122fd88e52 P f0788fe60e4d4891b51e6f092e50bb10: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.008s
I20260709 13:10:12.413074 24935 raft_consensus.cc:359] T 344ea3140811457ebf5f36122fd88e52 P f0788fe60e4d4891b51e6f092e50bb10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.413895 24935 raft_consensus.cc:385] T 344ea3140811457ebf5f36122fd88e52 P f0788fe60e4d4891b51e6f092e50bb10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.414230 24935 raft_consensus.cc:740] T 344ea3140811457ebf5f36122fd88e52 P f0788fe60e4d4891b51e6f092e50bb10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0788fe60e4d4891b51e6f092e50bb10, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.414470 24934 ts_tablet_manager.cc:1434] T 23eeb369895744038073e959747f6f13 P 41f9a4e2214e4382bb2fad82711a2472: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.003s
I20260709 13:10:12.415169 24935 consensus_queue.cc:260] T 344ea3140811457ebf5f36122fd88e52 P f0788fe60e4d4891b51e6f092e50bb10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.415782 24934 tablet_bootstrap.cc:492] T a354f2f44e1c42e7a605864651a66beb P 41f9a4e2214e4382bb2fad82711a2472: Bootstrap starting.
I20260709 13:10:12.417595 24935 ts_tablet_manager.cc:1434] T 344ea3140811457ebf5f36122fd88e52 P f0788fe60e4d4891b51e6f092e50bb10: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:10:12.418995 24935 tablet_bootstrap.cc:492] T e1552504f8884142b4ccc09f539a6998 P f0788fe60e4d4891b51e6f092e50bb10: Bootstrap starting.
I20260709 13:10:12.424224 24934 tablet_bootstrap.cc:654] T a354f2f44e1c42e7a605864651a66beb P 41f9a4e2214e4382bb2fad82711a2472: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.425454 24935 tablet_bootstrap.cc:654] T e1552504f8884142b4ccc09f539a6998 P f0788fe60e4d4891b51e6f092e50bb10: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.436909 24820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a354f2f44e1c42e7a605864651a66beb" candidate_uuid: "92512576e6bc4561830a180ea4737d86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41f9a4e2214e4382bb2fad82711a2472" is_pre_election: true
W20260709 13:10:12.438586 24708 leader_election.cc:343] T a354f2f44e1c42e7a605864651a66beb P 92512576e6bc4561830a180ea4737d86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41f9a4e2214e4382bb2fad82711a2472 (127.23.140.66:42587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:12.439019 24708 leader_election.cc:304] T a354f2f44e1c42e7a605864651a66beb P 92512576e6bc4561830a180ea4737d86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92512576e6bc4561830a180ea4737d86; no voters: 41f9a4e2214e4382bb2fad82711a2472, f0788fe60e4d4891b51e6f092e50bb10
I20260709 13:10:12.439647 24936 tablet_bootstrap.cc:492] T 3e8dbf03cb5e4334a7231c02b4f45bee P 92512576e6bc4561830a180ea4737d86: No bootstrap required, opened a new log
I20260709 13:10:12.440114 24940 raft_consensus.cc:2749] T a354f2f44e1c42e7a605864651a66beb P 92512576e6bc4561830a180ea4737d86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:12.440112 24936 ts_tablet_manager.cc:1403] T 3e8dbf03cb5e4334a7231c02b4f45bee P 92512576e6bc4561830a180ea4737d86: Time spent bootstrapping tablet: real 0.086s	user 0.037s	sys 0.025s
I20260709 13:10:12.441056 24934 tablet_bootstrap.cc:492] T a354f2f44e1c42e7a605864651a66beb P 41f9a4e2214e4382bb2fad82711a2472: No bootstrap required, opened a new log
I20260709 13:10:12.441449 24934 ts_tablet_manager.cc:1403] T a354f2f44e1c42e7a605864651a66beb P 41f9a4e2214e4382bb2fad82711a2472: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.009s
I20260709 13:10:12.442183 24935 tablet_bootstrap.cc:492] T e1552504f8884142b4ccc09f539a6998 P f0788fe60e4d4891b51e6f092e50bb10: No bootstrap required, opened a new log
I20260709 13:10:12.442624 24935 ts_tablet_manager.cc:1403] T e1552504f8884142b4ccc09f539a6998 P f0788fe60e4d4891b51e6f092e50bb10: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.004s
I20260709 13:10:12.443697 24934 raft_consensus.cc:359] T a354f2f44e1c42e7a605864651a66beb P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.443759 24936 raft_consensus.cc:359] T 3e8dbf03cb5e4334a7231c02b4f45bee P 92512576e6bc4561830a180ea4737d86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.444419 24934 raft_consensus.cc:385] T a354f2f44e1c42e7a605864651a66beb P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.444566 24936 raft_consensus.cc:385] T 3e8dbf03cb5e4334a7231c02b4f45bee P 92512576e6bc4561830a180ea4737d86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.444765 24934 raft_consensus.cc:740] T a354f2f44e1c42e7a605864651a66beb P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41f9a4e2214e4382bb2fad82711a2472, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.444934 24936 raft_consensus.cc:740] T 3e8dbf03cb5e4334a7231c02b4f45bee P 92512576e6bc4561830a180ea4737d86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92512576e6bc4561830a180ea4737d86, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.445396 24935 raft_consensus.cc:359] T e1552504f8884142b4ccc09f539a6998 P f0788fe60e4d4891b51e6f092e50bb10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.445609 24934 consensus_queue.cc:260] T a354f2f44e1c42e7a605864651a66beb P 41f9a4e2214e4382bb2fad82711a2472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.446130 24935 raft_consensus.cc:385] T e1552504f8884142b4ccc09f539a6998 P f0788fe60e4d4891b51e6f092e50bb10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.445714 24936 consensus_queue.cc:260] T 3e8dbf03cb5e4334a7231c02b4f45bee P 92512576e6bc4561830a180ea4737d86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.446456 24935 raft_consensus.cc:740] T e1552504f8884142b4ccc09f539a6998 P f0788fe60e4d4891b51e6f092e50bb10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0788fe60e4d4891b51e6f092e50bb10, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.447280 24935 consensus_queue.cc:260] T e1552504f8884142b4ccc09f539a6998 P f0788fe60e4d4891b51e6f092e50bb10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.447747 24934 ts_tablet_manager.cc:1434] T a354f2f44e1c42e7a605864651a66beb P 41f9a4e2214e4382bb2fad82711a2472: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:10:12.447841 24936 ts_tablet_manager.cc:1434] T 3e8dbf03cb5e4334a7231c02b4f45bee P 92512576e6bc4561830a180ea4737d86: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:10:12.448753 24934 tablet_bootstrap.cc:492] T edb957f6330c46abab225a43aa102b4e P 41f9a4e2214e4382bb2fad82711a2472: Bootstrap starting.
I20260709 13:10:12.450224 24936 tablet_bootstrap.cc:492] T e1552504f8884142b4ccc09f539a6998 P 92512576e6bc4561830a180ea4737d86: Bootstrap starting.
I20260709 13:10:12.452761 24935 ts_tablet_manager.cc:1434] T e1552504f8884142b4ccc09f539a6998 P f0788fe60e4d4891b51e6f092e50bb10: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:10:12.453783 24935 tablet_bootstrap.cc:492] T 23eeb369895744038073e959747f6f13 P f0788fe60e4d4891b51e6f092e50bb10: Bootstrap starting.
I20260709 13:10:12.455252 24934 tablet_bootstrap.cc:654] T edb957f6330c46abab225a43aa102b4e P 41f9a4e2214e4382bb2fad82711a2472: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.456786 24936 tablet_bootstrap.cc:654] T e1552504f8884142b4ccc09f539a6998 P 92512576e6bc4561830a180ea4737d86: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.464078 24935 tablet_bootstrap.cc:654] T 23eeb369895744038073e959747f6f13 P f0788fe60e4d4891b51e6f092e50bb10: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.466346 24934 tablet_bootstrap.cc:492] T edb957f6330c46abab225a43aa102b4e P 41f9a4e2214e4382bb2fad82711a2472: No bootstrap required, opened a new log
I20260709 13:10:12.466784 24934 ts_tablet_manager.cc:1403] T edb957f6330c46abab225a43aa102b4e P 41f9a4e2214e4382bb2fad82711a2472: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.009s
I20260709 13:10:12.469547 24934 raft_consensus.cc:359] T edb957f6330c46abab225a43aa102b4e P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.471347 24934 raft_consensus.cc:385] T edb957f6330c46abab225a43aa102b4e P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.471621 24934 raft_consensus.cc:740] T edb957f6330c46abab225a43aa102b4e P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41f9a4e2214e4382bb2fad82711a2472, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.472777 24936 tablet_bootstrap.cc:492] T e1552504f8884142b4ccc09f539a6998 P 92512576e6bc4561830a180ea4737d86: No bootstrap required, opened a new log
I20260709 13:10:12.472429 24934 consensus_queue.cc:260] T edb957f6330c46abab225a43aa102b4e P 41f9a4e2214e4382bb2fad82711a2472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.473353 24936 ts_tablet_manager.cc:1403] T e1552504f8884142b4ccc09f539a6998 P 92512576e6bc4561830a180ea4737d86: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.010s
I20260709 13:10:12.476394 24934 ts_tablet_manager.cc:1434] T edb957f6330c46abab225a43aa102b4e P 41f9a4e2214e4382bb2fad82711a2472: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:10:12.476728 24936 raft_consensus.cc:359] T e1552504f8884142b4ccc09f539a6998 P 92512576e6bc4561830a180ea4737d86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.477372 24934 tablet_bootstrap.cc:492] T 3e8dbf03cb5e4334a7231c02b4f45bee P 41f9a4e2214e4382bb2fad82711a2472: Bootstrap starting.
I20260709 13:10:12.477592 24936 raft_consensus.cc:385] T e1552504f8884142b4ccc09f539a6998 P 92512576e6bc4561830a180ea4737d86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.478039 24936 raft_consensus.cc:740] T e1552504f8884142b4ccc09f539a6998 P 92512576e6bc4561830a180ea4737d86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92512576e6bc4561830a180ea4737d86, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.478933 24936 consensus_queue.cc:260] T e1552504f8884142b4ccc09f539a6998 P 92512576e6bc4561830a180ea4737d86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.481698 24936 ts_tablet_manager.cc:1434] T e1552504f8884142b4ccc09f539a6998 P 92512576e6bc4561830a180ea4737d86: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:10:12.483044 24936 tablet_bootstrap.cc:492] T 7ad37a53739d49499dc91aa56c61feb5 P 92512576e6bc4561830a180ea4737d86: Bootstrap starting.
I20260709 13:10:12.483942 24934 tablet_bootstrap.cc:654] T 3e8dbf03cb5e4334a7231c02b4f45bee P 41f9a4e2214e4382bb2fad82711a2472: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.488369 24935 tablet_bootstrap.cc:492] T 23eeb369895744038073e959747f6f13 P f0788fe60e4d4891b51e6f092e50bb10: No bootstrap required, opened a new log
I20260709 13:10:12.488826 24935 ts_tablet_manager.cc:1403] T 23eeb369895744038073e959747f6f13 P f0788fe60e4d4891b51e6f092e50bb10: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.015s
I20260709 13:10:12.489817 24936 tablet_bootstrap.cc:654] T 7ad37a53739d49499dc91aa56c61feb5 P 92512576e6bc4561830a180ea4737d86: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.491688 24935 raft_consensus.cc:359] T 23eeb369895744038073e959747f6f13 P f0788fe60e4d4891b51e6f092e50bb10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.492471 24935 raft_consensus.cc:385] T 23eeb369895744038073e959747f6f13 P f0788fe60e4d4891b51e6f092e50bb10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.492813 24935 raft_consensus.cc:740] T 23eeb369895744038073e959747f6f13 P f0788fe60e4d4891b51e6f092e50bb10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0788fe60e4d4891b51e6f092e50bb10, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.496335 24943 raft_consensus.cc:493] T 344ea3140811457ebf5f36122fd88e52 P f0788fe60e4d4891b51e6f092e50bb10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.496670 24934 tablet_bootstrap.cc:492] T 3e8dbf03cb5e4334a7231c02b4f45bee P 41f9a4e2214e4382bb2fad82711a2472: No bootstrap required, opened a new log
I20260709 13:10:12.497164 24934 ts_tablet_manager.cc:1403] T 3e8dbf03cb5e4334a7231c02b4f45bee P 41f9a4e2214e4382bb2fad82711a2472: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.006s
I20260709 13:10:12.496939 24943 raft_consensus.cc:515] T 344ea3140811457ebf5f36122fd88e52 P f0788fe60e4d4891b51e6f092e50bb10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.500042 24934 raft_consensus.cc:359] T 3e8dbf03cb5e4334a7231c02b4f45bee P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.500738 24934 raft_consensus.cc:385] T 3e8dbf03cb5e4334a7231c02b4f45bee P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.501057 24934 raft_consensus.cc:740] T 3e8dbf03cb5e4334a7231c02b4f45bee P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41f9a4e2214e4382bb2fad82711a2472, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.501966 24934 consensus_queue.cc:260] T 3e8dbf03cb5e4334a7231c02b4f45bee P 41f9a4e2214e4382bb2fad82711a2472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.504349 24934 ts_tablet_manager.cc:1434] T 3e8dbf03cb5e4334a7231c02b4f45bee P 41f9a4e2214e4382bb2fad82711a2472: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:10:12.505251 24934 tablet_bootstrap.cc:492] T 344ea3140811457ebf5f36122fd88e52 P 41f9a4e2214e4382bb2fad82711a2472: Bootstrap starting.
I20260709 13:10:12.510282 24934 tablet_bootstrap.cc:654] T 344ea3140811457ebf5f36122fd88e52 P 41f9a4e2214e4382bb2fad82711a2472: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.512213 24939 raft_consensus.cc:493] T a354f2f44e1c42e7a605864651a66beb P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.512858 24939 raft_consensus.cc:515] T a354f2f44e1c42e7a605864651a66beb P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.514921 24943 leader_election.cc:290] T 344ea3140811457ebf5f36122fd88e52 P f0788fe60e4d4891b51e6f092e50bb10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92512576e6bc4561830a180ea4737d86 (127.23.140.65:41489), 41f9a4e2214e4382bb2fad82711a2472 (127.23.140.66:42587)
I20260709 13:10:12.517074 24934 tablet_bootstrap.cc:492] T 344ea3140811457ebf5f36122fd88e52 P 41f9a4e2214e4382bb2fad82711a2472: No bootstrap required, opened a new log
I20260709 13:10:12.517726 24934 ts_tablet_manager.cc:1403] T 344ea3140811457ebf5f36122fd88e52 P 41f9a4e2214e4382bb2fad82711a2472: Time spent bootstrapping tablet: real 0.013s	user 0.004s	sys 0.008s
I20260709 13:10:12.521093 24934 raft_consensus.cc:359] T 344ea3140811457ebf5f36122fd88e52 P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.522279 24934 raft_consensus.cc:385] T 344ea3140811457ebf5f36122fd88e52 P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.522723 24934 raft_consensus.cc:740] T 344ea3140811457ebf5f36122fd88e52 P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41f9a4e2214e4382bb2fad82711a2472, State: Initialized, Role: FOLLOWER
W20260709 13:10:12.523342 24691 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:12.523619 24934 consensus_queue.cc:260] T 344ea3140811457ebf5f36122fd88e52 P 41f9a4e2214e4382bb2fad82711a2472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.495587 24935 consensus_queue.cc:260] T 23eeb369895744038073e959747f6f13 P f0788fe60e4d4891b51e6f092e50bb10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.530606 24935 ts_tablet_manager.cc:1434] T 23eeb369895744038073e959747f6f13 P f0788fe60e4d4891b51e6f092e50bb10: Time spent starting tablet: real 0.041s	user 0.003s	sys 0.006s
I20260709 13:10:12.531859 24935 tablet_bootstrap.cc:492] T edb957f6330c46abab225a43aa102b4e P f0788fe60e4d4891b51e6f092e50bb10: Bootstrap starting.
I20260709 13:10:12.539716 24939 leader_election.cc:290] T a354f2f44e1c42e7a605864651a66beb P 41f9a4e2214e4382bb2fad82711a2472 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92512576e6bc4561830a180ea4737d86 (127.23.140.65:41489), f0788fe60e4d4891b51e6f092e50bb10 (127.23.140.67:43673)
I20260709 13:10:12.543040 24943 raft_consensus.cc:493] T 3e8dbf03cb5e4334a7231c02b4f45bee P f0788fe60e4d4891b51e6f092e50bb10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.543661 24943 raft_consensus.cc:515] T 3e8dbf03cb5e4334a7231c02b4f45bee P f0788fe60e4d4891b51e6f092e50bb10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.550173 24943 leader_election.cc:290] T 3e8dbf03cb5e4334a7231c02b4f45bee P f0788fe60e4d4891b51e6f092e50bb10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92512576e6bc4561830a180ea4737d86 (127.23.140.65:41489), 41f9a4e2214e4382bb2fad82711a2472 (127.23.140.66:42587)
I20260709 13:10:12.571075 24935 tablet_bootstrap.cc:654] T edb957f6330c46abab225a43aa102b4e P f0788fe60e4d4891b51e6f092e50bb10: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.575412 24936 tablet_bootstrap.cc:492] T 7ad37a53739d49499dc91aa56c61feb5 P 92512576e6bc4561830a180ea4737d86: No bootstrap required, opened a new log
I20260709 13:10:12.575906 24936 ts_tablet_manager.cc:1403] T 7ad37a53739d49499dc91aa56c61feb5 P 92512576e6bc4561830a180ea4737d86: Time spent bootstrapping tablet: real 0.093s	user 0.024s	sys 0.057s
I20260709 13:10:12.577445 24745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "344ea3140811457ebf5f36122fd88e52" candidate_uuid: "f0788fe60e4d4891b51e6f092e50bb10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92512576e6bc4561830a180ea4737d86" is_pre_election: true
I20260709 13:10:12.578619 24936 raft_consensus.cc:359] T 7ad37a53739d49499dc91aa56c61feb5 P 92512576e6bc4561830a180ea4737d86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.579385 24936 raft_consensus.cc:385] T 7ad37a53739d49499dc91aa56c61feb5 P 92512576e6bc4561830a180ea4737d86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.579154 24744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8dbf03cb5e4334a7231c02b4f45bee" candidate_uuid: "f0788fe60e4d4891b51e6f092e50bb10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92512576e6bc4561830a180ea4737d86" is_pre_election: true
I20260709 13:10:12.580322 24744 raft_consensus.cc:2468] T 3e8dbf03cb5e4334a7231c02b4f45bee P 92512576e6bc4561830a180ea4737d86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0788fe60e4d4891b51e6f092e50bb10 in term 0.
W20260709 13:10:12.581990 24858 leader_election.cc:343] T 344ea3140811457ebf5f36122fd88e52 P f0788fe60e4d4891b51e6f092e50bb10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92512576e6bc4561830a180ea4737d86 (127.23.140.65:41489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:12.582854 24858 leader_election.cc:304] T 3e8dbf03cb5e4334a7231c02b4f45bee P f0788fe60e4d4891b51e6f092e50bb10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92512576e6bc4561830a180ea4737d86, f0788fe60e4d4891b51e6f092e50bb10; no voters: 
I20260709 13:10:12.579720 24936 raft_consensus.cc:740] T 7ad37a53739d49499dc91aa56c61feb5 P 92512576e6bc4561830a180ea4737d86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92512576e6bc4561830a180ea4737d86, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.583833 24943 raft_consensus.cc:2804] T 3e8dbf03cb5e4334a7231c02b4f45bee P f0788fe60e4d4891b51e6f092e50bb10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:12.584337 24943 raft_consensus.cc:493] T 3e8dbf03cb5e4334a7231c02b4f45bee P f0788fe60e4d4891b51e6f092e50bb10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:12.584756 24943 raft_consensus.cc:3060] T 3e8dbf03cb5e4334a7231c02b4f45bee P f0788fe60e4d4891b51e6f092e50bb10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.584744 24936 consensus_queue.cc:260] T 7ad37a53739d49499dc91aa56c61feb5 P 92512576e6bc4561830a180ea4737d86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.587450 24936 ts_tablet_manager.cc:1434] T 7ad37a53739d49499dc91aa56c61feb5 P 92512576e6bc4561830a180ea4737d86: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:10:12.588405 24936 tablet_bootstrap.cc:492] T fdad60a3620c40daa67e9436d4d5d174 P 92512576e6bc4561830a180ea4737d86: Bootstrap starting.
I20260709 13:10:12.594617 24936 tablet_bootstrap.cc:654] T fdad60a3620c40daa67e9436d4d5d174 P 92512576e6bc4561830a180ea4737d86: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.596309 24939 raft_consensus.cc:493] T fdad60a3620c40daa67e9436d4d5d174 P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.604091 24939 raft_consensus.cc:515] T fdad60a3620c40daa67e9436d4d5d174 P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.606187 24820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "344ea3140811457ebf5f36122fd88e52" candidate_uuid: "f0788fe60e4d4891b51e6f092e50bb10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41f9a4e2214e4382bb2fad82711a2472" is_pre_election: true
I20260709 13:10:12.607048 24820 raft_consensus.cc:2468] T 344ea3140811457ebf5f36122fd88e52 P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0788fe60e4d4891b51e6f092e50bb10 in term 0.
I20260709 13:10:12.608503 24819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8dbf03cb5e4334a7231c02b4f45bee" candidate_uuid: "f0788fe60e4d4891b51e6f092e50bb10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41f9a4e2214e4382bb2fad82711a2472" is_pre_election: true
I20260709 13:10:12.609333 24819 raft_consensus.cc:2468] T 3e8dbf03cb5e4334a7231c02b4f45bee P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0788fe60e4d4891b51e6f092e50bb10 in term 0.
I20260709 13:10:12.611258 24857 leader_election.cc:304] T 344ea3140811457ebf5f36122fd88e52 P f0788fe60e4d4891b51e6f092e50bb10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41f9a4e2214e4382bb2fad82711a2472, f0788fe60e4d4891b51e6f092e50bb10; no voters: 92512576e6bc4561830a180ea4737d86
I20260709 13:10:12.613605 24939 leader_election.cc:290] T fdad60a3620c40daa67e9436d4d5d174 P 41f9a4e2214e4382bb2fad82711a2472 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92512576e6bc4561830a180ea4737d86 (127.23.140.65:41489), f0788fe60e4d4891b51e6f092e50bb10 (127.23.140.67:43673)
I20260709 13:10:12.613508 24965 raft_consensus.cc:2804] T 344ea3140811457ebf5f36122fd88e52 P f0788fe60e4d4891b51e6f092e50bb10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:12.614225 24939 raft_consensus.cc:493] T edb957f6330c46abab225a43aa102b4e P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.614311 24965 raft_consensus.cc:493] T 344ea3140811457ebf5f36122fd88e52 P f0788fe60e4d4891b51e6f092e50bb10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:12.614701 24939 raft_consensus.cc:515] T edb957f6330c46abab225a43aa102b4e P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.616897 24939 leader_election.cc:290] T edb957f6330c46abab225a43aa102b4e P 41f9a4e2214e4382bb2fad82711a2472 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92512576e6bc4561830a180ea4737d86 (127.23.140.65:41489), f0788fe60e4d4891b51e6f092e50bb10 (127.23.140.67:43673)
I20260709 13:10:12.614689 24965 raft_consensus.cc:3060] T 344ea3140811457ebf5f36122fd88e52 P f0788fe60e4d4891b51e6f092e50bb10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.621734 24744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a354f2f44e1c42e7a605864651a66beb" candidate_uuid: "41f9a4e2214e4382bb2fad82711a2472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92512576e6bc4561830a180ea4737d86" is_pre_election: true
I20260709 13:10:12.622406 24744 raft_consensus.cc:2468] T a354f2f44e1c42e7a605864651a66beb P 92512576e6bc4561830a180ea4737d86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41f9a4e2214e4382bb2fad82711a2472 in term 0.
I20260709 13:10:12.624630 24745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb957f6330c46abab225a43aa102b4e" candidate_uuid: "41f9a4e2214e4382bb2fad82711a2472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92512576e6bc4561830a180ea4737d86" is_pre_election: true
I20260709 13:10:12.626148 24744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdad60a3620c40daa67e9436d4d5d174" candidate_uuid: "41f9a4e2214e4382bb2fad82711a2472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92512576e6bc4561830a180ea4737d86" is_pre_election: true
I20260709 13:10:12.627373 24784 leader_election.cc:304] T a354f2f44e1c42e7a605864651a66beb P 41f9a4e2214e4382bb2fad82711a2472 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41f9a4e2214e4382bb2fad82711a2472, 92512576e6bc4561830a180ea4737d86; no voters: 
W20260709 13:10:12.628367 24784 leader_election.cc:343] T edb957f6330c46abab225a43aa102b4e P 41f9a4e2214e4382bb2fad82711a2472 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92512576e6bc4561830a180ea4737d86 (127.23.140.65:41489): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:12.629009 24784 leader_election.cc:343] T fdad60a3620c40daa67e9436d4d5d174 P 41f9a4e2214e4382bb2fad82711a2472 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92512576e6bc4561830a180ea4737d86 (127.23.140.65:41489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:12.629587 24939 raft_consensus.cc:2804] T a354f2f44e1c42e7a605864651a66beb P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:12.629989 24939 raft_consensus.cc:493] T a354f2f44e1c42e7a605864651a66beb P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:12.630333 24939 raft_consensus.cc:3060] T a354f2f44e1c42e7a605864651a66beb P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.631729 24963 raft_consensus.cc:493] T e1552504f8884142b4ccc09f539a6998 P f0788fe60e4d4891b51e6f092e50bb10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.632211 24963 raft_consensus.cc:515] T e1552504f8884142b4ccc09f539a6998 P f0788fe60e4d4891b51e6f092e50bb10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.633556 24934 ts_tablet_manager.cc:1434] T 344ea3140811457ebf5f36122fd88e52 P 41f9a4e2214e4382bb2fad82711a2472: Time spent starting tablet: real 0.115s	user 0.036s	sys 0.058s
I20260709 13:10:12.635130 24744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1552504f8884142b4ccc09f539a6998" candidate_uuid: "f0788fe60e4d4891b51e6f092e50bb10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92512576e6bc4561830a180ea4737d86" is_pre_election: true
I20260709 13:10:12.635721 24744 raft_consensus.cc:2468] T e1552504f8884142b4ccc09f539a6998 P 92512576e6bc4561830a180ea4737d86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0788fe60e4d4891b51e6f092e50bb10 in term 0.
I20260709 13:10:12.636901 24858 leader_election.cc:304] T e1552504f8884142b4ccc09f539a6998 P f0788fe60e4d4891b51e6f092e50bb10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92512576e6bc4561830a180ea4737d86, f0788fe60e4d4891b51e6f092e50bb10; no voters: 
I20260709 13:10:12.637271 24939 raft_consensus.cc:515] T a354f2f44e1c42e7a605864651a66beb P 41f9a4e2214e4382bb2fad82711a2472 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.640420 24744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a354f2f44e1c42e7a605864651a66beb" candidate_uuid: "41f9a4e2214e4382bb2fad82711a2472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92512576e6bc4561830a180ea4737d86"
I20260709 13:10:12.641114 24744 raft_consensus.cc:3060] T a354f2f44e1c42e7a605864651a66beb P 92512576e6bc4561830a180ea4737d86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.643494 24934 tablet_bootstrap.cc:492] T 6c309103ab794ba7a09dedd040db10d7 P 41f9a4e2214e4382bb2fad82711a2472: Bootstrap starting.
I20260709 13:10:12.643479 24943 raft_consensus.cc:515] T 3e8dbf03cb5e4334a7231c02b4f45bee P f0788fe60e4d4891b51e6f092e50bb10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.646595 24819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8dbf03cb5e4334a7231c02b4f45bee" candidate_uuid: "f0788fe60e4d4891b51e6f092e50bb10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41f9a4e2214e4382bb2fad82711a2472"
I20260709 13:10:12.647133 24819 raft_consensus.cc:3060] T 3e8dbf03cb5e4334a7231c02b4f45bee P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.648356 24744 raft_consensus.cc:2468] T a354f2f44e1c42e7a605864651a66beb P 92512576e6bc4561830a180ea4737d86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41f9a4e2214e4382bb2fad82711a2472 in term 1.
I20260709 13:10:12.649514 24784 leader_election.cc:304] T a354f2f44e1c42e7a605864651a66beb P 41f9a4e2214e4382bb2fad82711a2472 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41f9a4e2214e4382bb2fad82711a2472, 92512576e6bc4561830a180ea4737d86; no voters: 
I20260709 13:10:12.651010 24966 raft_consensus.cc:2804] T e1552504f8884142b4ccc09f539a6998 P f0788fe60e4d4891b51e6f092e50bb10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:12.651407 24966 raft_consensus.cc:493] T e1552504f8884142b4ccc09f539a6998 P f0788fe60e4d4891b51e6f092e50bb10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:12.651728 24966 raft_consensus.cc:3060] T e1552504f8884142b4ccc09f539a6998 P f0788fe60e4d4891b51e6f092e50bb10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.653097 24934 tablet_bootstrap.cc:654] T 6c309103ab794ba7a09dedd040db10d7 P 41f9a4e2214e4382bb2fad82711a2472: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.653828 24819 raft_consensus.cc:2468] T 3e8dbf03cb5e4334a7231c02b4f45bee P 41f9a4e2214e4382bb2fad82711a2472 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0788fe60e4d4891b51e6f092e50bb10 in term 1.
I20260709 13:10:12.654814 24939 leader_election.cc:290] T a354f2f44e1c42e7a605864651a66beb P 41f9a4e2214e4382bb2fad82711a2472 [CANDIDATE]: Term 1 election: Requested vote from peers 92512576e6bc4561830a180ea4737d86 (127.23.140.65:41489), f0788fe60e4d4891b51e6f092e50bb10 (127.23.140.67:43673)
I20260709 13:10:12.654987 24857 leader_election.cc:304] T 3e8dbf03cb5e4334a7231c02b4f45bee P f0788fe60e4d4891b51e6f092e50bb10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41f9a4e2214e4382bb2fad82711a2472, f0788fe60e4d4891b51e6f092e50bb10; no voters: 
I20260709 13:10:12.655370 24939 raft_consensus.cc:2804] T a354f2f44e1c42e7a605864651a66beb P 41f9a4e2214e4382bb2fad82711a2472 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:12.655839 24939 raft_consensus.cc:697] T a354f2f44e1c42e7a605864651a66beb P 41f9a4e2214e4382bb2fad82711a2472 [term 1 LEADER]: Becoming Leader. State: Replica: 41f9a4e2214e4382bb2fad82711a2472, State: Running, Role: LEADER
I20260709 13:10:12.656644 24939 consensus_queue.cc:237] T a354f2f44e1c42e7a605864651a66beb P 41f9a4e2214e4382bb2fad82711a2472 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.658926 24744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8dbf03cb5e4334a7231c02b4f45bee" candidate_uuid: "f0788fe60e4d4891b51e6f092e50bb10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92512576e6bc4561830a180ea4737d86"
I20260709 13:10:12.659492 24744 raft_consensus.cc:3060] T 3e8dbf03cb5e4334a7231c02b4f45bee P 92512576e6bc4561830a180ea4737d86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.663566 24958 raft_consensus.cc:493] T 23eeb369895744038073e959747f6f13 P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.664008 24958 raft_consensus.cc:515] T 23eeb369895744038073e959747f6f13 P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.665064 24935 tablet_bootstrap.cc:492] T edb957f6330c46abab225a43aa102b4e P f0788fe60e4d4891b51e6f092e50bb10: No bootstrap required, opened a new log
I20260709 13:10:12.665565 24935 ts_tablet_manager.cc:1403] T edb957f6330c46abab225a43aa102b4e P f0788fe60e4d4891b51e6f092e50bb10: Time spent bootstrapping tablet: real 0.134s	user 0.021s	sys 0.026s
I20260709 13:10:12.668591 24935 raft_consensus.cc:359] T edb957f6330c46abab225a43aa102b4e P f0788fe60e4d4891b51e6f092e50bb10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.669250 24935 raft_consensus.cc:385] T edb957f6330c46abab225a43aa102b4e P f0788fe60e4d4891b51e6f092e50bb10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.672904 24967 raft_consensus.cc:2804] T 3e8dbf03cb5e4334a7231c02b4f45bee P f0788fe60e4d4891b51e6f092e50bb10 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:12.675020 24934 tablet_bootstrap.cc:492] T 6c309103ab794ba7a09dedd040db10d7 P 41f9a4e2214e4382bb2fad82711a2472: No bootstrap required, opened a new log
I20260709 13:10:12.676340 24965 raft_consensus.cc:515] T 344ea3140811457ebf5f36122fd88e52 P f0788fe60e4d4891b51e6f092e50bb10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.676765 24934 ts_tablet_manager.cc:1403] T 6c309103ab794ba7a09dedd040db10d7 P 41f9a4e2214e4382bb2fad82711a2472: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.006s
I20260709 13:10:12.679118 24745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "344ea3140811457ebf5f36122fd88e52" candidate_uuid: "f0788fe60e4d4891b51e6f092e50bb10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92512576e6bc4561830a180ea4737d86"
I20260709 13:10:12.680368 24744 raft_consensus.cc:2468] T 3e8dbf03cb5e4334a7231c02b4f45bee P 92512576e6bc4561830a180ea4737d86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0788fe60e4d4891b51e6f092e50bb10 in term 1.
W20260709 13:10:12.680545 24858 leader_election.cc:343] T 344ea3140811457ebf5f36122fd88e52 P f0788fe60e4d4891b51e6f092e50bb10 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 92512576e6bc4561830a180ea4737d86 (127.23.140.65:41489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:12.681586 24963 leader_election.cc:290] T e1552504f8884142b4ccc09f539a6998 P f0788fe60e4d4891b51e6f092e50bb10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92512576e6bc4561830a180ea4737d86 (127.23.140.65:41489), 41f9a4e2214e4382bb2fad82711a2472 (127.23.140.66:42587)
I20260709 13:10:12.682706 24958 leader_election.cc:290] T 23eeb369895744038073e959747f6f13 P 41f9a4e2214e4382bb2fad82711a2472 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92512576e6bc4561830a180ea4737d86 (127.23.140.65:41489), f0788fe60e4d4891b51e6f092e50bb10 (127.23.140.67:43673)
I20260709 13:10:12.683192 24943 leader_election.cc:290] T 3e8dbf03cb5e4334a7231c02b4f45bee P f0788fe60e4d4891b51e6f092e50bb10 [CANDIDATE]: Term 1 election: Requested vote from peers 92512576e6bc4561830a180ea4737d86 (127.23.140.65:41489), 41f9a4e2214e4382bb2fad82711a2472 (127.23.140.66:42587)
I20260709 13:10:12.683604 24745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eeb369895744038073e959747f6f13" candidate_uuid: "41f9a4e2214e4382bb2fad82711a2472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92512576e6bc4561830a180ea4737d86" is_pre_election: true
W20260709 13:10:12.684916 24784 leader_election.cc:343] T 23eeb369895744038073e959747f6f13 P 41f9a4e2214e4382bb2fad82711a2472 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92512576e6bc4561830a180ea4737d86 (127.23.140.65:41489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:12.684569 24934 raft_consensus.cc:359] T 6c309103ab794ba7a09dedd040db10d7 P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.686612 24965 leader_election.cc:290] T 344ea3140811457ebf5f36122fd88e52 P f0788fe60e4d4891b51e6f092e50bb10 [CANDIDATE]: Term 1 election: Requested vote from peers 92512576e6bc4561830a180ea4737d86 (127.23.140.65:41489), 41f9a4e2214e4382bb2fad82711a2472 (127.23.140.66:42587)
I20260709 13:10:12.686743 24820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "344ea3140811457ebf5f36122fd88e52" candidate_uuid: "f0788fe60e4d4891b51e6f092e50bb10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41f9a4e2214e4382bb2fad82711a2472"
I20260709 13:10:12.686841 24934 raft_consensus.cc:385] T 6c309103ab794ba7a09dedd040db10d7 P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.669546 24935 raft_consensus.cc:740] T edb957f6330c46abab225a43aa102b4e P f0788fe60e4d4891b51e6f092e50bb10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0788fe60e4d4891b51e6f092e50bb10, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.675710 24819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1552504f8884142b4ccc09f539a6998" candidate_uuid: "f0788fe60e4d4891b51e6f092e50bb10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41f9a4e2214e4382bb2fad82711a2472" is_pre_election: true
I20260709 13:10:12.687439 24820 raft_consensus.cc:3060] T 344ea3140811457ebf5f36122fd88e52 P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.675242 24966 raft_consensus.cc:515] T e1552504f8884142b4ccc09f539a6998 P f0788fe60e4d4891b51e6f092e50bb10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.688271 24934 raft_consensus.cc:740] T 6c309103ab794ba7a09dedd040db10d7 P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41f9a4e2214e4382bb2fad82711a2472, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.692529 24892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb957f6330c46abab225a43aa102b4e" candidate_uuid: "41f9a4e2214e4382bb2fad82711a2472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0788fe60e4d4891b51e6f092e50bb10" is_pre_election: true
I20260709 13:10:12.692468 24934 consensus_queue.cc:260] T 6c309103ab794ba7a09dedd040db10d7 P 41f9a4e2214e4382bb2fad82711a2472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.693648 24891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a354f2f44e1c42e7a605864651a66beb" candidate_uuid: "41f9a4e2214e4382bb2fad82711a2472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0788fe60e4d4891b51e6f092e50bb10"
I20260709 13:10:12.698320 24891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eeb369895744038073e959747f6f13" candidate_uuid: "41f9a4e2214e4382bb2fad82711a2472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0788fe60e4d4891b51e6f092e50bb10" is_pre_election: true
I20260709 13:10:12.698645 24893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdad60a3620c40daa67e9436d4d5d174" candidate_uuid: "41f9a4e2214e4382bb2fad82711a2472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0788fe60e4d4891b51e6f092e50bb10" is_pre_election: true
I20260709 13:10:12.698935 24891 raft_consensus.cc:2468] T 23eeb369895744038073e959747f6f13 P f0788fe60e4d4891b51e6f092e50bb10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41f9a4e2214e4382bb2fad82711a2472 in term 0.
I20260709 13:10:12.699512 24966 leader_election.cc:290] T e1552504f8884142b4ccc09f539a6998 P f0788fe60e4d4891b51e6f092e50bb10 [CANDIDATE]: Term 1 election: Requested vote from peers 92512576e6bc4561830a180ea4737d86 (127.23.140.65:41489), 41f9a4e2214e4382bb2fad82711a2472 (127.23.140.66:42587)
I20260709 13:10:12.700117 24934 ts_tablet_manager.cc:1434] T 6c309103ab794ba7a09dedd040db10d7 P 41f9a4e2214e4382bb2fad82711a2472: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.000s
I20260709 13:10:12.700405 24940 raft_consensus.cc:493] T 7ad37a53739d49499dc91aa56c61feb5 P 92512576e6bc4561830a180ea4737d86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.700842 24818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1552504f8884142b4ccc09f539a6998" candidate_uuid: "f0788fe60e4d4891b51e6f092e50bb10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41f9a4e2214e4382bb2fad82711a2472"
I20260709 13:10:12.700947 24940 raft_consensus.cc:515] T 7ad37a53739d49499dc91aa56c61feb5 P 92512576e6bc4561830a180ea4737d86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.701956 24934 tablet_bootstrap.cc:492] T 8ab8d9cd192348f09921ada29f04e55d P 41f9a4e2214e4382bb2fad82711a2472: Bootstrap starting.
W20260709 13:10:12.702021 24857 leader_election.cc:343] T e1552504f8884142b4ccc09f539a6998 P f0788fe60e4d4891b51e6f092e50bb10 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 41f9a4e2214e4382bb2fad82711a2472 (127.23.140.66:42587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:12.702939 24940 leader_election.cc:290] T 7ad37a53739d49499dc91aa56c61feb5 P 92512576e6bc4561830a180ea4737d86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41f9a4e2214e4382bb2fad82711a2472 (127.23.140.66:42587), f0788fe60e4d4891b51e6f092e50bb10 (127.23.140.67:43673)
I20260709 13:10:12.705080 24894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a354f2f44e1c42e7a605864651a66beb" candidate_uuid: "41f9a4e2214e4382bb2fad82711a2472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0788fe60e4d4891b51e6f092e50bb10" is_pre_election: true
W20260709 13:10:12.707307 24784 leader_election.cc:343] T a354f2f44e1c42e7a605864651a66beb P 41f9a4e2214e4382bb2fad82711a2472 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0788fe60e4d4891b51e6f092e50bb10 (127.23.140.67:43673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:12.708532 24784 leader_election.cc:304] T 23eeb369895744038073e959747f6f13 P 41f9a4e2214e4382bb2fad82711a2472 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41f9a4e2214e4382bb2fad82711a2472, f0788fe60e4d4891b51e6f092e50bb10; no voters: 92512576e6bc4561830a180ea4737d86
I20260709 13:10:12.709899 24958 raft_consensus.cc:2804] T 23eeb369895744038073e959747f6f13 P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:12.710263 24958 raft_consensus.cc:493] T 23eeb369895744038073e959747f6f13 P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:12.710608 24958 raft_consensus.cc:3060] T 23eeb369895744038073e959747f6f13 P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.711557 24934 tablet_bootstrap.cc:654] T 8ab8d9cd192348f09921ada29f04e55d P 41f9a4e2214e4382bb2fad82711a2472: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.687894 24967 raft_consensus.cc:697] T 3e8dbf03cb5e4334a7231c02b4f45bee P f0788fe60e4d4891b51e6f092e50bb10 [term 1 LEADER]: Becoming Leader. State: Replica: f0788fe60e4d4891b51e6f092e50bb10, State: Running, Role: LEADER
I20260709 13:10:12.712661 24967 consensus_queue.cc:237] T 3e8dbf03cb5e4334a7231c02b4f45bee P f0788fe60e4d4891b51e6f092e50bb10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.716475 24744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1552504f8884142b4ccc09f539a6998" candidate_uuid: "f0788fe60e4d4891b51e6f092e50bb10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92512576e6bc4561830a180ea4737d86"
I20260709 13:10:12.716617 24818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ad37a53739d49499dc91aa56c61feb5" candidate_uuid: "92512576e6bc4561830a180ea4737d86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41f9a4e2214e4382bb2fad82711a2472" is_pre_election: true
I20260709 13:10:12.717109 24744 raft_consensus.cc:3060] T e1552504f8884142b4ccc09f539a6998 P 92512576e6bc4561830a180ea4737d86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.717984 24893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ad37a53739d49499dc91aa56c61feb5" candidate_uuid: "92512576e6bc4561830a180ea4737d86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0788fe60e4d4891b51e6f092e50bb10" is_pre_election: true
W20260709 13:10:12.718313 24857 leader_election.cc:343] T e1552504f8884142b4ccc09f539a6998 P f0788fe60e4d4891b51e6f092e50bb10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41f9a4e2214e4382bb2fad82711a2472 (127.23.140.66:42587): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:12.719282 24784 leader_election.cc:343] T fdad60a3620c40daa67e9436d4d5d174 P 41f9a4e2214e4382bb2fad82711a2472 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0788fe60e4d4891b51e6f092e50bb10 (127.23.140.67:43673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:12.719928 24784 leader_election.cc:304] T fdad60a3620c40daa67e9436d4d5d174 P 41f9a4e2214e4382bb2fad82711a2472 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41f9a4e2214e4382bb2fad82711a2472; no voters: 92512576e6bc4561830a180ea4737d86, f0788fe60e4d4891b51e6f092e50bb10
W20260709 13:10:12.721567 24708 leader_election.cc:343] T 7ad37a53739d49499dc91aa56c61feb5 P 92512576e6bc4561830a180ea4737d86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41f9a4e2214e4382bb2fad82711a2472 (127.23.140.66:42587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:12.724211 24820 raft_consensus.cc:2468] T 344ea3140811457ebf5f36122fd88e52 P 41f9a4e2214e4382bb2fad82711a2472 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0788fe60e4d4891b51e6f092e50bb10 in term 1.
I20260709 13:10:12.725283 24857 leader_election.cc:304] T 344ea3140811457ebf5f36122fd88e52 P f0788fe60e4d4891b51e6f092e50bb10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41f9a4e2214e4382bb2fad82711a2472, f0788fe60e4d4891b51e6f092e50bb10; no voters: 92512576e6bc4561830a180ea4737d86
I20260709 13:10:12.724797 24935 consensus_queue.cc:260] T edb957f6330c46abab225a43aa102b4e P f0788fe60e4d4891b51e6f092e50bb10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
W20260709 13:10:12.726720 24784 leader_election.cc:343] T a354f2f44e1c42e7a605864651a66beb P 41f9a4e2214e4382bb2fad82711a2472 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0788fe60e4d4891b51e6f092e50bb10 (127.23.140.67:43673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:12.726958 24892 raft_consensus.cc:2468] T edb957f6330c46abab225a43aa102b4e P f0788fe60e4d4891b51e6f092e50bb10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41f9a4e2214e4382bb2fad82711a2472 in term 0.
I20260709 13:10:12.727571 24970 raft_consensus.cc:2804] T 344ea3140811457ebf5f36122fd88e52 P f0788fe60e4d4891b51e6f092e50bb10 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:12.728657 24970 raft_consensus.cc:697] T 344ea3140811457ebf5f36122fd88e52 P f0788fe60e4d4891b51e6f092e50bb10 [term 1 LEADER]: Becoming Leader. State: Replica: f0788fe60e4d4891b51e6f092e50bb10, State: Running, Role: LEADER
I20260709 13:10:12.729844 24935 ts_tablet_manager.cc:1434] T edb957f6330c46abab225a43aa102b4e P f0788fe60e4d4891b51e6f092e50bb10: Time spent starting tablet: real 0.064s	user 0.007s	sys 0.000s
I20260709 13:10:12.730101 24936 tablet_bootstrap.cc:492] T fdad60a3620c40daa67e9436d4d5d174 P 92512576e6bc4561830a180ea4737d86: No bootstrap required, opened a new log
I20260709 13:10:12.729589 24970 consensus_queue.cc:237] T 344ea3140811457ebf5f36122fd88e52 P f0788fe60e4d4891b51e6f092e50bb10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.730585 24936 ts_tablet_manager.cc:1403] T fdad60a3620c40daa67e9436d4d5d174 P 92512576e6bc4561830a180ea4737d86: Time spent bootstrapping tablet: real 0.142s	user 0.067s	sys 0.054s
I20260709 13:10:12.730881 24935 tablet_bootstrap.cc:492] T fdad60a3620c40daa67e9436d4d5d174 P f0788fe60e4d4891b51e6f092e50bb10: Bootstrap starting.
I20260709 13:10:12.731151 24958 raft_consensus.cc:515] T 23eeb369895744038073e959747f6f13 P 41f9a4e2214e4382bb2fad82711a2472 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
W20260709 13:10:12.732606 24709 leader_election.cc:343] T 7ad37a53739d49499dc91aa56c61feb5 P 92512576e6bc4561830a180ea4737d86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0788fe60e4d4891b51e6f092e50bb10 (127.23.140.67:43673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:12.734182 24709 leader_election.cc:304] T 7ad37a53739d49499dc91aa56c61feb5 P 92512576e6bc4561830a180ea4737d86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92512576e6bc4561830a180ea4737d86; no voters: 41f9a4e2214e4382bb2fad82711a2472, f0788fe60e4d4891b51e6f092e50bb10
I20260709 13:10:12.735992 24940 raft_consensus.cc:2749] T 7ad37a53739d49499dc91aa56c61feb5 P 92512576e6bc4561830a180ea4737d86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:12.729398 24642 catalog_manager.cc:5697] T a354f2f44e1c42e7a605864651a66beb P 41f9a4e2214e4382bb2fad82711a2472 reported cstate change: term changed from 0 to 1, leader changed from <none> to 41f9a4e2214e4382bb2fad82711a2472 (127.23.140.66). New cstate: current_term: 1 leader_uuid: "41f9a4e2214e4382bb2fad82711a2472" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:12.737356 24784 leader_election.cc:304] T edb957f6330c46abab225a43aa102b4e P 41f9a4e2214e4382bb2fad82711a2472 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41f9a4e2214e4382bb2fad82711a2472, f0788fe60e4d4891b51e6f092e50bb10; no voters: 92512576e6bc4561830a180ea4737d86
I20260709 13:10:12.725876 24939 raft_consensus.cc:2749] T fdad60a3620c40daa67e9436d4d5d174 P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:12.738956 24968 raft_consensus.cc:2804] T edb957f6330c46abab225a43aa102b4e P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:12.739403 24968 raft_consensus.cc:493] T edb957f6330c46abab225a43aa102b4e P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:12.739732 24968 raft_consensus.cc:3060] T edb957f6330c46abab225a43aa102b4e P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.743870 24936 raft_consensus.cc:359] T fdad60a3620c40daa67e9436d4d5d174 P 92512576e6bc4561830a180ea4737d86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.745595 24958 leader_election.cc:290] T 23eeb369895744038073e959747f6f13 P 41f9a4e2214e4382bb2fad82711a2472 [CANDIDATE]: Term 1 election: Requested vote from peers 92512576e6bc4561830a180ea4737d86 (127.23.140.65:41489), f0788fe60e4d4891b51e6f092e50bb10 (127.23.140.67:43673)
I20260709 13:10:12.745808 24936 raft_consensus.cc:385] T fdad60a3620c40daa67e9436d4d5d174 P 92512576e6bc4561830a180ea4737d86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.746120 24936 raft_consensus.cc:740] T fdad60a3620c40daa67e9436d4d5d174 P 92512576e6bc4561830a180ea4737d86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92512576e6bc4561830a180ea4737d86, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.746815 24936 consensus_queue.cc:260] T fdad60a3620c40daa67e9436d4d5d174 P 92512576e6bc4561830a180ea4737d86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.747434 24745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eeb369895744038073e959747f6f13" candidate_uuid: "41f9a4e2214e4382bb2fad82711a2472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92512576e6bc4561830a180ea4737d86"
I20260709 13:10:12.748888 24936 ts_tablet_manager.cc:1434] T fdad60a3620c40daa67e9436d4d5d174 P 92512576e6bc4561830a180ea4737d86: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.000s
I20260709 13:10:12.749550 24892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eeb369895744038073e959747f6f13" candidate_uuid: "41f9a4e2214e4382bb2fad82711a2472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0788fe60e4d4891b51e6f092e50bb10"
I20260709 13:10:12.749905 24936 tablet_bootstrap.cc:492] T edb957f6330c46abab225a43aa102b4e P 92512576e6bc4561830a180ea4737d86: Bootstrap starting.
I20260709 13:10:12.750118 24892 raft_consensus.cc:3060] T 23eeb369895744038073e959747f6f13 P f0788fe60e4d4891b51e6f092e50bb10 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:12.748829 24784 leader_election.cc:343] T 23eeb369895744038073e959747f6f13 P 41f9a4e2214e4382bb2fad82711a2472 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 92512576e6bc4561830a180ea4737d86 (127.23.140.65:41489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:12.750686 24968 raft_consensus.cc:515] T edb957f6330c46abab225a43aa102b4e P 41f9a4e2214e4382bb2fad82711a2472 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.756003 24744 raft_consensus.cc:2468] T e1552504f8884142b4ccc09f539a6998 P 92512576e6bc4561830a180ea4737d86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0788fe60e4d4891b51e6f092e50bb10 in term 1.
I20260709 13:10:12.757488 24968 leader_election.cc:290] T edb957f6330c46abab225a43aa102b4e P 41f9a4e2214e4382bb2fad82711a2472 [CANDIDATE]: Term 1 election: Requested vote from peers 92512576e6bc4561830a180ea4737d86 (127.23.140.65:41489), f0788fe60e4d4891b51e6f092e50bb10 (127.23.140.67:43673)
I20260709 13:10:12.757282 24858 leader_election.cc:304] T e1552504f8884142b4ccc09f539a6998 P f0788fe60e4d4891b51e6f092e50bb10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92512576e6bc4561830a180ea4737d86, f0788fe60e4d4891b51e6f092e50bb10; no voters: 41f9a4e2214e4382bb2fad82711a2472
I20260709 13:10:12.761129 24967 raft_consensus.cc:2804] T e1552504f8884142b4ccc09f539a6998 P f0788fe60e4d4891b51e6f092e50bb10 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:12.755283 24643 catalog_manager.cc:5697] T 3e8dbf03cb5e4334a7231c02b4f45bee P f0788fe60e4d4891b51e6f092e50bb10 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0788fe60e4d4891b51e6f092e50bb10 (127.23.140.67). New cstate: current_term: 1 leader_uuid: "f0788fe60e4d4891b51e6f092e50bb10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:12.762171 24967 raft_consensus.cc:697] T e1552504f8884142b4ccc09f539a6998 P f0788fe60e4d4891b51e6f092e50bb10 [term 1 LEADER]: Becoming Leader. State: Replica: f0788fe60e4d4891b51e6f092e50bb10, State: Running, Role: LEADER
I20260709 13:10:12.763316 24893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb957f6330c46abab225a43aa102b4e" candidate_uuid: "41f9a4e2214e4382bb2fad82711a2472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0788fe60e4d4891b51e6f092e50bb10"
I20260709 13:10:12.763635 24936 tablet_bootstrap.cc:654] T edb957f6330c46abab225a43aa102b4e P 92512576e6bc4561830a180ea4737d86: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.766312 24893 raft_consensus.cc:3060] T edb957f6330c46abab225a43aa102b4e P f0788fe60e4d4891b51e6f092e50bb10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.763981 24744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb957f6330c46abab225a43aa102b4e" candidate_uuid: "41f9a4e2214e4382bb2fad82711a2472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92512576e6bc4561830a180ea4737d86"
I20260709 13:10:12.764994 24935 tablet_bootstrap.cc:654] T fdad60a3620c40daa67e9436d4d5d174 P f0788fe60e4d4891b51e6f092e50bb10: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.767721 24934 tablet_bootstrap.cc:492] T 8ab8d9cd192348f09921ada29f04e55d P 41f9a4e2214e4382bb2fad82711a2472: No bootstrap required, opened a new log
I20260709 13:10:12.771251 24934 ts_tablet_manager.cc:1403] T 8ab8d9cd192348f09921ada29f04e55d P 41f9a4e2214e4382bb2fad82711a2472: Time spent bootstrapping tablet: real 0.070s	user 0.017s	sys 0.005s
W20260709 13:10:12.772262 24784 leader_election.cc:343] T edb957f6330c46abab225a43aa102b4e P 41f9a4e2214e4382bb2fad82711a2472 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 92512576e6bc4561830a180ea4737d86 (127.23.140.65:41489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:12.769371 24892 raft_consensus.cc:2468] T 23eeb369895744038073e959747f6f13 P f0788fe60e4d4891b51e6f092e50bb10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41f9a4e2214e4382bb2fad82711a2472 in term 1.
I20260709 13:10:12.773524 24784 leader_election.cc:304] T 23eeb369895744038073e959747f6f13 P 41f9a4e2214e4382bb2fad82711a2472 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41f9a4e2214e4382bb2fad82711a2472, f0788fe60e4d4891b51e6f092e50bb10; no voters: 92512576e6bc4561830a180ea4737d86
I20260709 13:10:12.773793 24934 raft_consensus.cc:359] T 8ab8d9cd192348f09921ada29f04e55d P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.774400 24934 raft_consensus.cc:385] T 8ab8d9cd192348f09921ada29f04e55d P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.774573 24968 raft_consensus.cc:2804] T 23eeb369895744038073e959747f6f13 P 41f9a4e2214e4382bb2fad82711a2472 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:12.774665 24934 raft_consensus.cc:740] T 8ab8d9cd192348f09921ada29f04e55d P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41f9a4e2214e4382bb2fad82711a2472, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.775068 24968 raft_consensus.cc:697] T 23eeb369895744038073e959747f6f13 P 41f9a4e2214e4382bb2fad82711a2472 [term 1 LEADER]: Becoming Leader. State: Replica: 41f9a4e2214e4382bb2fad82711a2472, State: Running, Role: LEADER
I20260709 13:10:12.766593 24967 consensus_queue.cc:237] T e1552504f8884142b4ccc09f539a6998 P f0788fe60e4d4891b51e6f092e50bb10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.775345 24934 consensus_queue.cc:260] T 8ab8d9cd192348f09921ada29f04e55d P 41f9a4e2214e4382bb2fad82711a2472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.775836 24968 consensus_queue.cc:237] T 23eeb369895744038073e959747f6f13 P 41f9a4e2214e4382bb2fad82711a2472 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.777365 24934 ts_tablet_manager.cc:1434] T 8ab8d9cd192348f09921ada29f04e55d P 41f9a4e2214e4382bb2fad82711a2472: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:10:12.778187 24934 tablet_bootstrap.cc:492] T 7ad37a53739d49499dc91aa56c61feb5 P 41f9a4e2214e4382bb2fad82711a2472: Bootstrap starting.
I20260709 13:10:12.778786 24893 raft_consensus.cc:2468] T edb957f6330c46abab225a43aa102b4e P f0788fe60e4d4891b51e6f092e50bb10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41f9a4e2214e4382bb2fad82711a2472 in term 1.
I20260709 13:10:12.780519 24784 leader_election.cc:304] T edb957f6330c46abab225a43aa102b4e P 41f9a4e2214e4382bb2fad82711a2472 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41f9a4e2214e4382bb2fad82711a2472, f0788fe60e4d4891b51e6f092e50bb10; no voters: 92512576e6bc4561830a180ea4737d86
I20260709 13:10:12.781661 24939 raft_consensus.cc:2804] T edb957f6330c46abab225a43aa102b4e P 41f9a4e2214e4382bb2fad82711a2472 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:12.782266 24939 raft_consensus.cc:697] T edb957f6330c46abab225a43aa102b4e P 41f9a4e2214e4382bb2fad82711a2472 [term 1 LEADER]: Becoming Leader. State: Replica: 41f9a4e2214e4382bb2fad82711a2472, State: Running, Role: LEADER
I20260709 13:10:12.787593 24934 tablet_bootstrap.cc:654] T 7ad37a53739d49499dc91aa56c61feb5 P 41f9a4e2214e4382bb2fad82711a2472: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.788004 24939 consensus_queue.cc:237] T edb957f6330c46abab225a43aa102b4e P 41f9a4e2214e4382bb2fad82711a2472 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.798966 24934 tablet_bootstrap.cc:492] T 7ad37a53739d49499dc91aa56c61feb5 P 41f9a4e2214e4382bb2fad82711a2472: No bootstrap required, opened a new log
I20260709 13:10:12.800304 24934 ts_tablet_manager.cc:1403] T 7ad37a53739d49499dc91aa56c61feb5 P 41f9a4e2214e4382bb2fad82711a2472: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.001s
I20260709 13:10:12.811542 24936 tablet_bootstrap.cc:492] T edb957f6330c46abab225a43aa102b4e P 92512576e6bc4561830a180ea4737d86: No bootstrap required, opened a new log
I20260709 13:10:12.813602 24936 ts_tablet_manager.cc:1403] T edb957f6330c46abab225a43aa102b4e P 92512576e6bc4561830a180ea4737d86: Time spent bootstrapping tablet: real 0.064s	user 0.015s	sys 0.008s
I20260709 13:10:12.814567 24934 raft_consensus.cc:359] T 7ad37a53739d49499dc91aa56c61feb5 P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.815258 24934 raft_consensus.cc:385] T 7ad37a53739d49499dc91aa56c61feb5 P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.815536 24934 raft_consensus.cc:740] T 7ad37a53739d49499dc91aa56c61feb5 P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41f9a4e2214e4382bb2fad82711a2472, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.816375 24934 consensus_queue.cc:260] T 7ad37a53739d49499dc91aa56c61feb5 P 41f9a4e2214e4382bb2fad82711a2472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.816807 24936 raft_consensus.cc:359] T edb957f6330c46abab225a43aa102b4e P 92512576e6bc4561830a180ea4737d86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.817453 24936 raft_consensus.cc:385] T edb957f6330c46abab225a43aa102b4e P 92512576e6bc4561830a180ea4737d86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.817520 24935 tablet_bootstrap.cc:492] T fdad60a3620c40daa67e9436d4d5d174 P f0788fe60e4d4891b51e6f092e50bb10: No bootstrap required, opened a new log
I20260709 13:10:12.817806 24936 raft_consensus.cc:740] T edb957f6330c46abab225a43aa102b4e P 92512576e6bc4561830a180ea4737d86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92512576e6bc4561830a180ea4737d86, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.818398 24935 ts_tablet_manager.cc:1403] T fdad60a3620c40daa67e9436d4d5d174 P f0788fe60e4d4891b51e6f092e50bb10: Time spent bootstrapping tablet: real 0.088s	user 0.014s	sys 0.011s
I20260709 13:10:12.818496 24934 ts_tablet_manager.cc:1434] T 7ad37a53739d49499dc91aa56c61feb5 P 41f9a4e2214e4382bb2fad82711a2472: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:10:12.818608 24936 consensus_queue.cc:260] T edb957f6330c46abab225a43aa102b4e P 92512576e6bc4561830a180ea4737d86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.819480 24934 tablet_bootstrap.cc:492] T e1552504f8884142b4ccc09f539a6998 P 41f9a4e2214e4382bb2fad82711a2472: Bootstrap starting.
I20260709 13:10:12.820804 24936 ts_tablet_manager.cc:1434] T edb957f6330c46abab225a43aa102b4e P 92512576e6bc4561830a180ea4737d86: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:10:12.821707 24936 tablet_bootstrap.cc:492] T 23eeb369895744038073e959747f6f13 P 92512576e6bc4561830a180ea4737d86: Bootstrap starting.
I20260709 13:10:12.824070 24935 raft_consensus.cc:359] T fdad60a3620c40daa67e9436d4d5d174 P f0788fe60e4d4891b51e6f092e50bb10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.824941 24935 raft_consensus.cc:385] T fdad60a3620c40daa67e9436d4d5d174 P f0788fe60e4d4891b51e6f092e50bb10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.825611 24934 tablet_bootstrap.cc:654] T e1552504f8884142b4ccc09f539a6998 P 41f9a4e2214e4382bb2fad82711a2472: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.825332 24935 raft_consensus.cc:740] T fdad60a3620c40daa67e9436d4d5d174 P f0788fe60e4d4891b51e6f092e50bb10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0788fe60e4d4891b51e6f092e50bb10, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.829823 24936 tablet_bootstrap.cc:654] T 23eeb369895744038073e959747f6f13 P 92512576e6bc4561830a180ea4737d86: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.829849 24935 consensus_queue.cc:260] T fdad60a3620c40daa67e9436d4d5d174 P f0788fe60e4d4891b51e6f092e50bb10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.832940 24940 raft_consensus.cc:493] T edb957f6330c46abab225a43aa102b4e P 92512576e6bc4561830a180ea4737d86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.833457 24940 raft_consensus.cc:515] T edb957f6330c46abab225a43aa102b4e P 92512576e6bc4561830a180ea4737d86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.835529 24940 leader_election.cc:290] T edb957f6330c46abab225a43aa102b4e P 92512576e6bc4561830a180ea4737d86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41f9a4e2214e4382bb2fad82711a2472 (127.23.140.66:42587), f0788fe60e4d4891b51e6f092e50bb10 (127.23.140.67:43673)
I20260709 13:10:12.837033 24893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb957f6330c46abab225a43aa102b4e" candidate_uuid: "92512576e6bc4561830a180ea4737d86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0788fe60e4d4891b51e6f092e50bb10" is_pre_election: true
I20260709 13:10:12.837807 24893 raft_consensus.cc:2393] T edb957f6330c46abab225a43aa102b4e P f0788fe60e4d4891b51e6f092e50bb10 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92512576e6bc4561830a180ea4737d86 in current term 1: Already voted for candidate 41f9a4e2214e4382bb2fad82711a2472 in this term.
I20260709 13:10:12.839165 24820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb957f6330c46abab225a43aa102b4e" candidate_uuid: "92512576e6bc4561830a180ea4737d86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41f9a4e2214e4382bb2fad82711a2472" is_pre_election: true
I20260709 13:10:12.840580 24935 ts_tablet_manager.cc:1434] T fdad60a3620c40daa67e9436d4d5d174 P f0788fe60e4d4891b51e6f092e50bb10: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.001s
I20260709 13:10:12.841568 24935 tablet_bootstrap.cc:492] T 7ad37a53739d49499dc91aa56c61feb5 P f0788fe60e4d4891b51e6f092e50bb10: Bootstrap starting.
I20260709 13:10:12.841338 24708 leader_election.cc:304] T edb957f6330c46abab225a43aa102b4e P 92512576e6bc4561830a180ea4737d86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92512576e6bc4561830a180ea4737d86; no voters: 41f9a4e2214e4382bb2fad82711a2472, f0788fe60e4d4891b51e6f092e50bb10
I20260709 13:10:12.842932 24940 raft_consensus.cc:3060] T edb957f6330c46abab225a43aa102b4e P 92512576e6bc4561830a180ea4737d86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.848384 24935 tablet_bootstrap.cc:654] T 7ad37a53739d49499dc91aa56c61feb5 P f0788fe60e4d4891b51e6f092e50bb10: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.852087 24939 raft_consensus.cc:493] T 7ad37a53739d49499dc91aa56c61feb5 P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.852689 24939 raft_consensus.cc:515] T 7ad37a53739d49499dc91aa56c61feb5 P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.854274 24936 tablet_bootstrap.cc:492] T 23eeb369895744038073e959747f6f13 P 92512576e6bc4561830a180ea4737d86: No bootstrap required, opened a new log
I20260709 13:10:12.854897 24936 ts_tablet_manager.cc:1403] T 23eeb369895744038073e959747f6f13 P 92512576e6bc4561830a180ea4737d86: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.001s
I20260709 13:10:12.855134 24939 leader_election.cc:290] T 7ad37a53739d49499dc91aa56c61feb5 P 41f9a4e2214e4382bb2fad82711a2472 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92512576e6bc4561830a180ea4737d86 (127.23.140.65:41489), f0788fe60e4d4891b51e6f092e50bb10 (127.23.140.67:43673)
I20260709 13:10:12.857054 24744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ad37a53739d49499dc91aa56c61feb5" candidate_uuid: "41f9a4e2214e4382bb2fad82711a2472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92512576e6bc4561830a180ea4737d86" is_pre_election: true
I20260709 13:10:12.857467 24893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ad37a53739d49499dc91aa56c61feb5" candidate_uuid: "41f9a4e2214e4382bb2fad82711a2472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0788fe60e4d4891b51e6f092e50bb10" is_pre_election: true
I20260709 13:10:12.857681 24744 raft_consensus.cc:2468] T 7ad37a53739d49499dc91aa56c61feb5 P 92512576e6bc4561830a180ea4737d86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41f9a4e2214e4382bb2fad82711a2472 in term 0.
I20260709 13:10:12.858901 24784 leader_election.cc:304] T 7ad37a53739d49499dc91aa56c61feb5 P 41f9a4e2214e4382bb2fad82711a2472 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41f9a4e2214e4382bb2fad82711a2472, 92512576e6bc4561830a180ea4737d86; no voters: 
I20260709 13:10:12.858745 24936 raft_consensus.cc:359] T 23eeb369895744038073e959747f6f13 P 92512576e6bc4561830a180ea4737d86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.859740 24936 raft_consensus.cc:385] T 23eeb369895744038073e959747f6f13 P 92512576e6bc4561830a180ea4737d86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:10:12.859937 24784 leader_election.cc:343] T 7ad37a53739d49499dc91aa56c61feb5 P 41f9a4e2214e4382bb2fad82711a2472 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0788fe60e4d4891b51e6f092e50bb10 (127.23.140.67:43673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:12.860184 24936 raft_consensus.cc:740] T 23eeb369895744038073e959747f6f13 P 92512576e6bc4561830a180ea4737d86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92512576e6bc4561830a180ea4737d86, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.860903 24939 raft_consensus.cc:2804] T 7ad37a53739d49499dc91aa56c61feb5 P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:12.861294 24939 raft_consensus.cc:493] T 7ad37a53739d49499dc91aa56c61feb5 P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:12.861836 24939 raft_consensus.cc:3060] T 7ad37a53739d49499dc91aa56c61feb5 P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.861219 24936 consensus_queue.cc:260] T 23eeb369895744038073e959747f6f13 P 92512576e6bc4561830a180ea4737d86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.862582 24940 raft_consensus.cc:2749] T edb957f6330c46abab225a43aa102b4e P 92512576e6bc4561830a180ea4737d86 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:12.869449 24939 raft_consensus.cc:515] T 7ad37a53739d49499dc91aa56c61feb5 P 41f9a4e2214e4382bb2fad82711a2472 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.870754 24643 catalog_manager.cc:5697] T e1552504f8884142b4ccc09f539a6998 P f0788fe60e4d4891b51e6f092e50bb10 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0788fe60e4d4891b51e6f092e50bb10 (127.23.140.67). New cstate: current_term: 1 leader_uuid: "f0788fe60e4d4891b51e6f092e50bb10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:12.873428 24643 catalog_manager.cc:5697] T 344ea3140811457ebf5f36122fd88e52 P f0788fe60e4d4891b51e6f092e50bb10 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0788fe60e4d4891b51e6f092e50bb10 (127.23.140.67). New cstate: current_term: 1 leader_uuid: "f0788fe60e4d4891b51e6f092e50bb10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:12.874629 24940 raft_consensus.cc:493] T fdad60a3620c40daa67e9436d4d5d174 P 92512576e6bc4561830a180ea4737d86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.875221 24940 raft_consensus.cc:515] T fdad60a3620c40daa67e9436d4d5d174 P 92512576e6bc4561830a180ea4737d86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.875988 24744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ad37a53739d49499dc91aa56c61feb5" candidate_uuid: "41f9a4e2214e4382bb2fad82711a2472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92512576e6bc4561830a180ea4737d86"
I20260709 13:10:12.876523 24744 raft_consensus.cc:3060] T 7ad37a53739d49499dc91aa56c61feb5 P 92512576e6bc4561830a180ea4737d86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.882463 24940 leader_election.cc:290] T fdad60a3620c40daa67e9436d4d5d174 P 92512576e6bc4561830a180ea4737d86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41f9a4e2214e4382bb2fad82711a2472 (127.23.140.66:42587), f0788fe60e4d4891b51e6f092e50bb10 (127.23.140.67:43673)
I20260709 13:10:12.883598 24893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdad60a3620c40daa67e9436d4d5d174" candidate_uuid: "92512576e6bc4561830a180ea4737d86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0788fe60e4d4891b51e6f092e50bb10" is_pre_election: true
I20260709 13:10:12.884400 24893 raft_consensus.cc:2468] T fdad60a3620c40daa67e9436d4d5d174 P f0788fe60e4d4891b51e6f092e50bb10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92512576e6bc4561830a180ea4737d86 in term 0.
I20260709 13:10:12.885625 24820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdad60a3620c40daa67e9436d4d5d174" candidate_uuid: "92512576e6bc4561830a180ea4737d86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41f9a4e2214e4382bb2fad82711a2472" is_pre_election: true
I20260709 13:10:12.886406 24820 raft_consensus.cc:2468] T fdad60a3620c40daa67e9436d4d5d174 P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92512576e6bc4561830a180ea4737d86 in term 0.
I20260709 13:10:12.887980 24709 leader_election.cc:304] T fdad60a3620c40daa67e9436d4d5d174 P 92512576e6bc4561830a180ea4737d86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92512576e6bc4561830a180ea4737d86, f0788fe60e4d4891b51e6f092e50bb10; no voters: 
I20260709 13:10:12.890162 24940 raft_consensus.cc:2804] T fdad60a3620c40daa67e9436d4d5d174 P 92512576e6bc4561830a180ea4737d86 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:12.890633 24940 raft_consensus.cc:493] T fdad60a3620c40daa67e9436d4d5d174 P 92512576e6bc4561830a180ea4737d86 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:12.891088 24940 raft_consensus.cc:3060] T fdad60a3620c40daa67e9436d4d5d174 P 92512576e6bc4561830a180ea4737d86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.890888 24641 catalog_manager.cc:5697] T edb957f6330c46abab225a43aa102b4e P 41f9a4e2214e4382bb2fad82711a2472 reported cstate change: term changed from 0 to 1, leader changed from <none> to 41f9a4e2214e4382bb2fad82711a2472 (127.23.140.66). New cstate: current_term: 1 leader_uuid: "41f9a4e2214e4382bb2fad82711a2472" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:12.893306 24641 catalog_manager.cc:5697] T 23eeb369895744038073e959747f6f13 P 41f9a4e2214e4382bb2fad82711a2472 reported cstate change: term changed from 0 to 1, leader changed from <none> to 41f9a4e2214e4382bb2fad82711a2472 (127.23.140.66). New cstate: current_term: 1 leader_uuid: "41f9a4e2214e4382bb2fad82711a2472" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:12.896116 24744 raft_consensus.cc:2468] T 7ad37a53739d49499dc91aa56c61feb5 P 92512576e6bc4561830a180ea4737d86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41f9a4e2214e4382bb2fad82711a2472 in term 1.
I20260709 13:10:12.897651 24784 leader_election.cc:304] T 7ad37a53739d49499dc91aa56c61feb5 P 41f9a4e2214e4382bb2fad82711a2472 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41f9a4e2214e4382bb2fad82711a2472, 92512576e6bc4561830a180ea4737d86; no voters: 
I20260709 13:10:12.898779 24968 raft_consensus.cc:2804] T 7ad37a53739d49499dc91aa56c61feb5 P 41f9a4e2214e4382bb2fad82711a2472 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:12.899379 24968 raft_consensus.cc:697] T 7ad37a53739d49499dc91aa56c61feb5 P 41f9a4e2214e4382bb2fad82711a2472 [term 1 LEADER]: Becoming Leader. State: Replica: 41f9a4e2214e4382bb2fad82711a2472, State: Running, Role: LEADER
I20260709 13:10:12.900413 24968 consensus_queue.cc:237] T 7ad37a53739d49499dc91aa56c61feb5 P 41f9a4e2214e4382bb2fad82711a2472 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.912942 24893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ad37a53739d49499dc91aa56c61feb5" candidate_uuid: "41f9a4e2214e4382bb2fad82711a2472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0788fe60e4d4891b51e6f092e50bb10"
I20260709 13:10:12.913726 24939 leader_election.cc:290] T 7ad37a53739d49499dc91aa56c61feb5 P 41f9a4e2214e4382bb2fad82711a2472 [CANDIDATE]: Term 1 election: Requested vote from peers 92512576e6bc4561830a180ea4737d86 (127.23.140.65:41489), f0788fe60e4d4891b51e6f092e50bb10 (127.23.140.67:43673)
W20260709 13:10:12.914865 24784 leader_election.cc:343] T 7ad37a53739d49499dc91aa56c61feb5 P 41f9a4e2214e4382bb2fad82711a2472 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0788fe60e4d4891b51e6f092e50bb10 (127.23.140.67:43673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:12.916791 24936 ts_tablet_manager.cc:1434] T 23eeb369895744038073e959747f6f13 P 92512576e6bc4561830a180ea4737d86: Time spent starting tablet: real 0.062s	user 0.013s	sys 0.021s
I20260709 13:10:12.917366 24934 tablet_bootstrap.cc:492] T e1552504f8884142b4ccc09f539a6998 P 41f9a4e2214e4382bb2fad82711a2472: No bootstrap required, opened a new log
I20260709 13:10:12.917951 24934 ts_tablet_manager.cc:1403] T e1552504f8884142b4ccc09f539a6998 P 41f9a4e2214e4382bb2fad82711a2472: Time spent bootstrapping tablet: real 0.099s	user 0.025s	sys 0.018s
I20260709 13:10:12.919765 24935 tablet_bootstrap.cc:492] T 7ad37a53739d49499dc91aa56c61feb5 P f0788fe60e4d4891b51e6f092e50bb10: No bootstrap required, opened a new log
I20260709 13:10:12.920204 24935 ts_tablet_manager.cc:1403] T 7ad37a53739d49499dc91aa56c61feb5 P f0788fe60e4d4891b51e6f092e50bb10: Time spent bootstrapping tablet: real 0.079s	user 0.026s	sys 0.009s
I20260709 13:10:12.920601 24934 raft_consensus.cc:359] T e1552504f8884142b4ccc09f539a6998 P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.921304 24934 raft_consensus.cc:385] T e1552504f8884142b4ccc09f539a6998 P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.921620 24934 raft_consensus.cc:740] T e1552504f8884142b4ccc09f539a6998 P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41f9a4e2214e4382bb2fad82711a2472, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.922427 24934 consensus_queue.cc:260] T e1552504f8884142b4ccc09f539a6998 P 41f9a4e2214e4382bb2fad82711a2472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.922979 24935 raft_consensus.cc:359] T 7ad37a53739d49499dc91aa56c61feb5 P f0788fe60e4d4891b51e6f092e50bb10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.923689 24935 raft_consensus.cc:385] T 7ad37a53739d49499dc91aa56c61feb5 P f0788fe60e4d4891b51e6f092e50bb10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.923979 24935 raft_consensus.cc:740] T 7ad37a53739d49499dc91aa56c61feb5 P f0788fe60e4d4891b51e6f092e50bb10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0788fe60e4d4891b51e6f092e50bb10, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.924583 24934 ts_tablet_manager.cc:1434] T e1552504f8884142b4ccc09f539a6998 P 41f9a4e2214e4382bb2fad82711a2472: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:10:12.924714 24935 consensus_queue.cc:260] T 7ad37a53739d49499dc91aa56c61feb5 P f0788fe60e4d4891b51e6f092e50bb10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.924407 24643 catalog_manager.cc:5697] T 7ad37a53739d49499dc91aa56c61feb5 P 41f9a4e2214e4382bb2fad82711a2472 reported cstate change: term changed from 0 to 1, leader changed from <none> to 41f9a4e2214e4382bb2fad82711a2472 (127.23.140.66). New cstate: current_term: 1 leader_uuid: "41f9a4e2214e4382bb2fad82711a2472" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:12.925846 24936 tablet_bootstrap.cc:492] T 8ab8d9cd192348f09921ada29f04e55d P 92512576e6bc4561830a180ea4737d86: Bootstrap starting.
I20260709 13:10:12.929261 24935 ts_tablet_manager.cc:1434] T 7ad37a53739d49499dc91aa56c61feb5 P f0788fe60e4d4891b51e6f092e50bb10: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:10:12.929204 24940 raft_consensus.cc:515] T fdad60a3620c40daa67e9436d4d5d174 P 92512576e6bc4561830a180ea4737d86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.934226 24936 tablet_bootstrap.cc:654] T 8ab8d9cd192348f09921ada29f04e55d P 92512576e6bc4561830a180ea4737d86: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.934540 24820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdad60a3620c40daa67e9436d4d5d174" candidate_uuid: "92512576e6bc4561830a180ea4737d86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41f9a4e2214e4382bb2fad82711a2472"
I20260709 13:10:12.935137 24820 raft_consensus.cc:3060] T fdad60a3620c40daa67e9436d4d5d174 P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.937392 24935 tablet_bootstrap.cc:492] T a354f2f44e1c42e7a605864651a66beb P f0788fe60e4d4891b51e6f092e50bb10: Bootstrap starting.
I20260709 13:10:12.941604 24820 raft_consensus.cc:2468] T fdad60a3620c40daa67e9436d4d5d174 P 41f9a4e2214e4382bb2fad82711a2472 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92512576e6bc4561830a180ea4737d86 in term 1.
I20260709 13:10:12.943409 24708 leader_election.cc:304] T fdad60a3620c40daa67e9436d4d5d174 P 92512576e6bc4561830a180ea4737d86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41f9a4e2214e4382bb2fad82711a2472, 92512576e6bc4561830a180ea4737d86; no voters: 
I20260709 13:10:12.943733 24935 tablet_bootstrap.cc:654] T a354f2f44e1c42e7a605864651a66beb P f0788fe60e4d4891b51e6f092e50bb10: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.944355 24986 raft_consensus.cc:2804] T fdad60a3620c40daa67e9436d4d5d174 P 92512576e6bc4561830a180ea4737d86 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:12.945484 24986 raft_consensus.cc:697] T fdad60a3620c40daa67e9436d4d5d174 P 92512576e6bc4561830a180ea4737d86 [term 1 LEADER]: Becoming Leader. State: Replica: 92512576e6bc4561830a180ea4737d86, State: Running, Role: LEADER
I20260709 13:10:12.946367 24986 consensus_queue.cc:237] T fdad60a3620c40daa67e9436d4d5d174 P 92512576e6bc4561830a180ea4737d86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.948104 24936 tablet_bootstrap.cc:492] T 8ab8d9cd192348f09921ada29f04e55d P 92512576e6bc4561830a180ea4737d86: No bootstrap required, opened a new log
I20260709 13:10:12.948431 24936 ts_tablet_manager.cc:1403] T 8ab8d9cd192348f09921ada29f04e55d P 92512576e6bc4561830a180ea4737d86: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.001s
I20260709 13:10:12.949709 24940 leader_election.cc:290] T fdad60a3620c40daa67e9436d4d5d174 P 92512576e6bc4561830a180ea4737d86 [CANDIDATE]: Term 1 election: Requested vote from peers 41f9a4e2214e4382bb2fad82711a2472 (127.23.140.66:42587), f0788fe60e4d4891b51e6f092e50bb10 (127.23.140.67:43673)
I20260709 13:10:12.950655 24936 raft_consensus.cc:359] T 8ab8d9cd192348f09921ada29f04e55d P 92512576e6bc4561830a180ea4737d86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.950903 24893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdad60a3620c40daa67e9436d4d5d174" candidate_uuid: "92512576e6bc4561830a180ea4737d86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0788fe60e4d4891b51e6f092e50bb10"
I20260709 13:10:12.951500 24893 raft_consensus.cc:3060] T fdad60a3620c40daa67e9436d4d5d174 P f0788fe60e4d4891b51e6f092e50bb10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.953896 24936 raft_consensus.cc:385] T 8ab8d9cd192348f09921ada29f04e55d P 92512576e6bc4561830a180ea4737d86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.954197 24936 raft_consensus.cc:740] T 8ab8d9cd192348f09921ada29f04e55d P 92512576e6bc4561830a180ea4737d86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92512576e6bc4561830a180ea4737d86, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.954936 24936 consensus_queue.cc:260] T 8ab8d9cd192348f09921ada29f04e55d P 92512576e6bc4561830a180ea4737d86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.954831 24643 catalog_manager.cc:5697] T fdad60a3620c40daa67e9436d4d5d174 P 92512576e6bc4561830a180ea4737d86 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92512576e6bc4561830a180ea4737d86 (127.23.140.65). New cstate: current_term: 1 leader_uuid: "92512576e6bc4561830a180ea4737d86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:12.956058 24935 tablet_bootstrap.cc:492] T a354f2f44e1c42e7a605864651a66beb P f0788fe60e4d4891b51e6f092e50bb10: No bootstrap required, opened a new log
I20260709 13:10:12.956508 24935 ts_tablet_manager.cc:1403] T a354f2f44e1c42e7a605864651a66beb P f0788fe60e4d4891b51e6f092e50bb10: Time spent bootstrapping tablet: real 0.019s	user 0.004s	sys 0.006s
I20260709 13:10:12.958052 24936 ts_tablet_manager.cc:1434] T 8ab8d9cd192348f09921ada29f04e55d P 92512576e6bc4561830a180ea4737d86: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:10:12.958199 24893 raft_consensus.cc:2468] T fdad60a3620c40daa67e9436d4d5d174 P f0788fe60e4d4891b51e6f092e50bb10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92512576e6bc4561830a180ea4737d86 in term 1.
I20260709 13:10:12.958935 24936 tablet_bootstrap.cc:492] T 344ea3140811457ebf5f36122fd88e52 P 92512576e6bc4561830a180ea4737d86: Bootstrap starting.
I20260709 13:10:12.959436 24935 raft_consensus.cc:359] T a354f2f44e1c42e7a605864651a66beb P f0788fe60e4d4891b51e6f092e50bb10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.960074 24935 raft_consensus.cc:385] T a354f2f44e1c42e7a605864651a66beb P f0788fe60e4d4891b51e6f092e50bb10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.960330 24935 raft_consensus.cc:740] T a354f2f44e1c42e7a605864651a66beb P f0788fe60e4d4891b51e6f092e50bb10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0788fe60e4d4891b51e6f092e50bb10, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.960968 24935 consensus_queue.cc:260] T a354f2f44e1c42e7a605864651a66beb P f0788fe60e4d4891b51e6f092e50bb10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.962826 24935 ts_tablet_manager.cc:1434] T a354f2f44e1c42e7a605864651a66beb P f0788fe60e4d4891b51e6f092e50bb10: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:10:12.963193 24968 raft_consensus.cc:493] T 6c309103ab794ba7a09dedd040db10d7 P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.963593 24968 raft_consensus.cc:515] T 6c309103ab794ba7a09dedd040db10d7 P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.964576 24935 tablet_bootstrap.cc:492] T 8ab8d9cd192348f09921ada29f04e55d P f0788fe60e4d4891b51e6f092e50bb10: Bootstrap starting.
I20260709 13:10:12.964826 24936 tablet_bootstrap.cc:654] T 344ea3140811457ebf5f36122fd88e52 P 92512576e6bc4561830a180ea4737d86: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.966173 24744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c309103ab794ba7a09dedd040db10d7" candidate_uuid: "41f9a4e2214e4382bb2fad82711a2472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92512576e6bc4561830a180ea4737d86" is_pre_election: true
W20260709 13:10:12.967522 24784 leader_election.cc:343] T 6c309103ab794ba7a09dedd040db10d7 P 41f9a4e2214e4382bb2fad82711a2472 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92512576e6bc4561830a180ea4737d86 (127.23.140.65:41489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:12.968437 24968 leader_election.cc:290] T 6c309103ab794ba7a09dedd040db10d7 P 41f9a4e2214e4382bb2fad82711a2472 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92512576e6bc4561830a180ea4737d86 (127.23.140.65:41489), f0788fe60e4d4891b51e6f092e50bb10 (127.23.140.67:43673)
I20260709 13:10:12.971742 24893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c309103ab794ba7a09dedd040db10d7" candidate_uuid: "41f9a4e2214e4382bb2fad82711a2472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0788fe60e4d4891b51e6f092e50bb10" is_pre_election: true
I20260709 13:10:12.973276 24936 tablet_bootstrap.cc:492] T 344ea3140811457ebf5f36122fd88e52 P 92512576e6bc4561830a180ea4737d86: No bootstrap required, opened a new log
I20260709 13:10:12.973685 24936 ts_tablet_manager.cc:1403] T 344ea3140811457ebf5f36122fd88e52 P 92512576e6bc4561830a180ea4737d86: Time spent bootstrapping tablet: real 0.015s	user 0.001s	sys 0.012s
W20260709 13:10:12.974516 24784 leader_election.cc:343] T 6c309103ab794ba7a09dedd040db10d7 P 41f9a4e2214e4382bb2fad82711a2472 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0788fe60e4d4891b51e6f092e50bb10 (127.23.140.67:43673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:12.974916 24784 leader_election.cc:304] T 6c309103ab794ba7a09dedd040db10d7 P 41f9a4e2214e4382bb2fad82711a2472 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41f9a4e2214e4382bb2fad82711a2472; no voters: 92512576e6bc4561830a180ea4737d86, f0788fe60e4d4891b51e6f092e50bb10
I20260709 13:10:12.975116 24935 tablet_bootstrap.cc:654] T 8ab8d9cd192348f09921ada29f04e55d P f0788fe60e4d4891b51e6f092e50bb10: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.975876 24968 raft_consensus.cc:2749] T 6c309103ab794ba7a09dedd040db10d7 P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:12.976588 24936 raft_consensus.cc:359] T 344ea3140811457ebf5f36122fd88e52 P 92512576e6bc4561830a180ea4737d86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.977231 24936 raft_consensus.cc:385] T 344ea3140811457ebf5f36122fd88e52 P 92512576e6bc4561830a180ea4737d86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.977494 24936 raft_consensus.cc:740] T 344ea3140811457ebf5f36122fd88e52 P 92512576e6bc4561830a180ea4737d86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92512576e6bc4561830a180ea4737d86, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.978236 24936 consensus_queue.cc:260] T 344ea3140811457ebf5f36122fd88e52 P 92512576e6bc4561830a180ea4737d86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.979565 24935 tablet_bootstrap.cc:492] T 8ab8d9cd192348f09921ada29f04e55d P f0788fe60e4d4891b51e6f092e50bb10: No bootstrap required, opened a new log
I20260709 13:10:12.979928 24935 ts_tablet_manager.cc:1403] T 8ab8d9cd192348f09921ada29f04e55d P f0788fe60e4d4891b51e6f092e50bb10: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 13:10:12.980217 24936 ts_tablet_manager.cc:1434] T 344ea3140811457ebf5f36122fd88e52 P 92512576e6bc4561830a180ea4737d86: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:10:12.980975 24936 tablet_bootstrap.cc:492] T 6c309103ab794ba7a09dedd040db10d7 P 92512576e6bc4561830a180ea4737d86: Bootstrap starting.
I20260709 13:10:12.982302 24935 raft_consensus.cc:359] T 8ab8d9cd192348f09921ada29f04e55d P f0788fe60e4d4891b51e6f092e50bb10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.982897 24935 raft_consensus.cc:385] T 8ab8d9cd192348f09921ada29f04e55d P f0788fe60e4d4891b51e6f092e50bb10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.983156 24935 raft_consensus.cc:740] T 8ab8d9cd192348f09921ada29f04e55d P f0788fe60e4d4891b51e6f092e50bb10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0788fe60e4d4891b51e6f092e50bb10, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.983816 24935 consensus_queue.cc:260] T 8ab8d9cd192348f09921ada29f04e55d P f0788fe60e4d4891b51e6f092e50bb10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:12.985590 24936 tablet_bootstrap.cc:654] T 6c309103ab794ba7a09dedd040db10d7 P 92512576e6bc4561830a180ea4737d86: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.985891 24935 ts_tablet_manager.cc:1434] T 8ab8d9cd192348f09921ada29f04e55d P f0788fe60e4d4891b51e6f092e50bb10: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:10:12.986624 24935 tablet_bootstrap.cc:492] T 6c309103ab794ba7a09dedd040db10d7 P f0788fe60e4d4891b51e6f092e50bb10: Bootstrap starting.
I20260709 13:10:12.992599 24935 tablet_bootstrap.cc:654] T 6c309103ab794ba7a09dedd040db10d7 P f0788fe60e4d4891b51e6f092e50bb10: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.997433 24936 tablet_bootstrap.cc:492] T 6c309103ab794ba7a09dedd040db10d7 P 92512576e6bc4561830a180ea4737d86: No bootstrap required, opened a new log
I20260709 13:10:12.997931 24936 ts_tablet_manager.cc:1403] T 6c309103ab794ba7a09dedd040db10d7 P 92512576e6bc4561830a180ea4737d86: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.003s
I20260709 13:10:12.998098 24935 tablet_bootstrap.cc:492] T 6c309103ab794ba7a09dedd040db10d7 P f0788fe60e4d4891b51e6f092e50bb10: No bootstrap required, opened a new log
I20260709 13:10:12.998492 24935 ts_tablet_manager.cc:1403] T 6c309103ab794ba7a09dedd040db10d7 P f0788fe60e4d4891b51e6f092e50bb10: Time spent bootstrapping tablet: real 0.012s	user 0.003s	sys 0.006s
I20260709 13:10:13.000275 24936 raft_consensus.cc:359] T 6c309103ab794ba7a09dedd040db10d7 P 92512576e6bc4561830a180ea4737d86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:13.000824 24936 raft_consensus.cc:385] T 6c309103ab794ba7a09dedd040db10d7 P 92512576e6bc4561830a180ea4737d86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:13.000648 24935 raft_consensus.cc:359] T 6c309103ab794ba7a09dedd040db10d7 P f0788fe60e4d4891b51e6f092e50bb10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:13.001071 24936 raft_consensus.cc:740] T 6c309103ab794ba7a09dedd040db10d7 P 92512576e6bc4561830a180ea4737d86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92512576e6bc4561830a180ea4737d86, State: Initialized, Role: FOLLOWER
I20260709 13:10:13.001216 24935 raft_consensus.cc:385] T 6c309103ab794ba7a09dedd040db10d7 P f0788fe60e4d4891b51e6f092e50bb10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:13.001504 24935 raft_consensus.cc:740] T 6c309103ab794ba7a09dedd040db10d7 P f0788fe60e4d4891b51e6f092e50bb10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0788fe60e4d4891b51e6f092e50bb10, State: Initialized, Role: FOLLOWER
I20260709 13:10:13.001726 24936 consensus_queue.cc:260] T 6c309103ab794ba7a09dedd040db10d7 P 92512576e6bc4561830a180ea4737d86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:13.002197 24935 consensus_queue.cc:260] T 6c309103ab794ba7a09dedd040db10d7 P f0788fe60e4d4891b51e6f092e50bb10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:13.003716 24936 ts_tablet_manager.cc:1434] T 6c309103ab794ba7a09dedd040db10d7 P 92512576e6bc4561830a180ea4737d86: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 13:10:13.003980 24935 ts_tablet_manager.cc:1434] T 6c309103ab794ba7a09dedd040db10d7 P f0788fe60e4d4891b51e6f092e50bb10: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:10:13.055217 24968 consensus_queue.cc:1048] T a354f2f44e1c42e7a605864651a66beb P 41f9a4e2214e4382bb2fad82711a2472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:13.064652 24893 raft_consensus.cc:3060] T a354f2f44e1c42e7a605864651a66beb P f0788fe60e4d4891b51e6f092e50bb10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:13.072398 24968 consensus_queue.cc:1048] T a354f2f44e1c42e7a605864651a66beb P 41f9a4e2214e4382bb2fad82711a2472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:13.073210 24986 raft_consensus.cc:493] T 6c309103ab794ba7a09dedd040db10d7 P 92512576e6bc4561830a180ea4737d86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.073720 24986 raft_consensus.cc:515] T 6c309103ab794ba7a09dedd040db10d7 P 92512576e6bc4561830a180ea4737d86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:13.075783 24986 leader_election.cc:290] T 6c309103ab794ba7a09dedd040db10d7 P 92512576e6bc4561830a180ea4737d86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41f9a4e2214e4382bb2fad82711a2472 (127.23.140.66:42587), f0788fe60e4d4891b51e6f092e50bb10 (127.23.140.67:43673)
I20260709 13:10:13.076372 24820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c309103ab794ba7a09dedd040db10d7" candidate_uuid: "92512576e6bc4561830a180ea4737d86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41f9a4e2214e4382bb2fad82711a2472" is_pre_election: true
I20260709 13:10:13.076781 24892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c309103ab794ba7a09dedd040db10d7" candidate_uuid: "92512576e6bc4561830a180ea4737d86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0788fe60e4d4891b51e6f092e50bb10" is_pre_election: true
I20260709 13:10:13.077033 24820 raft_consensus.cc:2468] T 6c309103ab794ba7a09dedd040db10d7 P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92512576e6bc4561830a180ea4737d86 in term 0.
I20260709 13:10:13.077351 24892 raft_consensus.cc:2468] T 6c309103ab794ba7a09dedd040db10d7 P f0788fe60e4d4891b51e6f092e50bb10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92512576e6bc4561830a180ea4737d86 in term 0.
I20260709 13:10:13.078248 24708 leader_election.cc:304] T 6c309103ab794ba7a09dedd040db10d7 P 92512576e6bc4561830a180ea4737d86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41f9a4e2214e4382bb2fad82711a2472, 92512576e6bc4561830a180ea4737d86; no voters: 
I20260709 13:10:13.079376 24986 raft_consensus.cc:2804] T 6c309103ab794ba7a09dedd040db10d7 P 92512576e6bc4561830a180ea4737d86 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:13.079752 24986 raft_consensus.cc:493] T 6c309103ab794ba7a09dedd040db10d7 P 92512576e6bc4561830a180ea4737d86 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:13.080101 24986 raft_consensus.cc:3060] T 6c309103ab794ba7a09dedd040db10d7 P 92512576e6bc4561830a180ea4737d86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:13.086515 24986 raft_consensus.cc:515] T 6c309103ab794ba7a09dedd040db10d7 P 92512576e6bc4561830a180ea4737d86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:13.088768 24820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c309103ab794ba7a09dedd040db10d7" candidate_uuid: "92512576e6bc4561830a180ea4737d86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41f9a4e2214e4382bb2fad82711a2472"
I20260709 13:10:13.089366 24820 raft_consensus.cc:3060] T 6c309103ab794ba7a09dedd040db10d7 P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:13.090322 24893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c309103ab794ba7a09dedd040db10d7" candidate_uuid: "92512576e6bc4561830a180ea4737d86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0788fe60e4d4891b51e6f092e50bb10"
I20260709 13:10:13.090889 24893 raft_consensus.cc:3060] T 6c309103ab794ba7a09dedd040db10d7 P f0788fe60e4d4891b51e6f092e50bb10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:13.093891 24986 leader_election.cc:290] T 6c309103ab794ba7a09dedd040db10d7 P 92512576e6bc4561830a180ea4737d86 [CANDIDATE]: Term 1 election: Requested vote from peers 41f9a4e2214e4382bb2fad82711a2472 (127.23.140.66:42587), f0788fe60e4d4891b51e6f092e50bb10 (127.23.140.67:43673)
I20260709 13:10:13.094488 24820 raft_consensus.cc:2468] T 6c309103ab794ba7a09dedd040db10d7 P 41f9a4e2214e4382bb2fad82711a2472 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92512576e6bc4561830a180ea4737d86 in term 1.
I20260709 13:10:13.095373 24708 leader_election.cc:304] T 6c309103ab794ba7a09dedd040db10d7 P 92512576e6bc4561830a180ea4737d86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41f9a4e2214e4382bb2fad82711a2472, 92512576e6bc4561830a180ea4737d86; no voters: 
I20260709 13:10:13.096007 24986 raft_consensus.cc:2804] T 6c309103ab794ba7a09dedd040db10d7 P 92512576e6bc4561830a180ea4737d86 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:13.096438 24893 raft_consensus.cc:2468] T 6c309103ab794ba7a09dedd040db10d7 P f0788fe60e4d4891b51e6f092e50bb10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92512576e6bc4561830a180ea4737d86 in term 1.
I20260709 13:10:13.096513 24986 raft_consensus.cc:697] T 6c309103ab794ba7a09dedd040db10d7 P 92512576e6bc4561830a180ea4737d86 [term 1 LEADER]: Becoming Leader. State: Replica: 92512576e6bc4561830a180ea4737d86, State: Running, Role: LEADER
I20260709 13:10:13.097579 24986 consensus_queue.cc:237] T 6c309103ab794ba7a09dedd040db10d7 P 92512576e6bc4561830a180ea4737d86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:13.104719 24640 catalog_manager.cc:5697] T 6c309103ab794ba7a09dedd040db10d7 P 92512576e6bc4561830a180ea4737d86 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92512576e6bc4561830a180ea4737d86 (127.23.140.65). New cstate: current_term: 1 leader_uuid: "92512576e6bc4561830a180ea4737d86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:13.127907 24968 raft_consensus.cc:493] T 8ab8d9cd192348f09921ada29f04e55d P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.128382 24968 raft_consensus.cc:515] T 8ab8d9cd192348f09921ada29f04e55d P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:13.130126 24968 leader_election.cc:290] T 8ab8d9cd192348f09921ada29f04e55d P 41f9a4e2214e4382bb2fad82711a2472 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92512576e6bc4561830a180ea4737d86 (127.23.140.65:41489), f0788fe60e4d4891b51e6f092e50bb10 (127.23.140.67:43673)
I20260709 13:10:13.130903 24744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab8d9cd192348f09921ada29f04e55d" candidate_uuid: "41f9a4e2214e4382bb2fad82711a2472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92512576e6bc4561830a180ea4737d86" is_pre_election: true
I20260709 13:10:13.131057 24893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab8d9cd192348f09921ada29f04e55d" candidate_uuid: "41f9a4e2214e4382bb2fad82711a2472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0788fe60e4d4891b51e6f092e50bb10" is_pre_election: true
I20260709 13:10:13.131450 24744 raft_consensus.cc:2468] T 8ab8d9cd192348f09921ada29f04e55d P 92512576e6bc4561830a180ea4737d86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41f9a4e2214e4382bb2fad82711a2472 in term 0.
I20260709 13:10:13.131624 24893 raft_consensus.cc:2468] T 8ab8d9cd192348f09921ada29f04e55d P f0788fe60e4d4891b51e6f092e50bb10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41f9a4e2214e4382bb2fad82711a2472 in term 0.
I20260709 13:10:13.132360 24784 leader_election.cc:304] T 8ab8d9cd192348f09921ada29f04e55d P 41f9a4e2214e4382bb2fad82711a2472 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41f9a4e2214e4382bb2fad82711a2472, 92512576e6bc4561830a180ea4737d86; no voters: 
I20260709 13:10:13.133045 24968 raft_consensus.cc:2804] T 8ab8d9cd192348f09921ada29f04e55d P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:13.133291 24968 raft_consensus.cc:493] T 8ab8d9cd192348f09921ada29f04e55d P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:13.133594 24968 raft_consensus.cc:3060] T 8ab8d9cd192348f09921ada29f04e55d P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:13.137950 24968 raft_consensus.cc:515] T 8ab8d9cd192348f09921ada29f04e55d P 41f9a4e2214e4382bb2fad82711a2472 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:13.139446 24968 leader_election.cc:290] T 8ab8d9cd192348f09921ada29f04e55d P 41f9a4e2214e4382bb2fad82711a2472 [CANDIDATE]: Term 1 election: Requested vote from peers 92512576e6bc4561830a180ea4737d86 (127.23.140.65:41489), f0788fe60e4d4891b51e6f092e50bb10 (127.23.140.67:43673)
I20260709 13:10:13.140151 24744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab8d9cd192348f09921ada29f04e55d" candidate_uuid: "41f9a4e2214e4382bb2fad82711a2472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92512576e6bc4561830a180ea4737d86"
I20260709 13:10:13.140290 24893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab8d9cd192348f09921ada29f04e55d" candidate_uuid: "41f9a4e2214e4382bb2fad82711a2472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0788fe60e4d4891b51e6f092e50bb10"
I20260709 13:10:13.140640 24744 raft_consensus.cc:3060] T 8ab8d9cd192348f09921ada29f04e55d P 92512576e6bc4561830a180ea4737d86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:13.140805 24893 raft_consensus.cc:3060] T 8ab8d9cd192348f09921ada29f04e55d P f0788fe60e4d4891b51e6f092e50bb10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:13.145071 24893 raft_consensus.cc:2468] T 8ab8d9cd192348f09921ada29f04e55d P f0788fe60e4d4891b51e6f092e50bb10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41f9a4e2214e4382bb2fad82711a2472 in term 1.
I20260709 13:10:13.145082 24744 raft_consensus.cc:2468] T 8ab8d9cd192348f09921ada29f04e55d P 92512576e6bc4561830a180ea4737d86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41f9a4e2214e4382bb2fad82711a2472 in term 1.
I20260709 13:10:13.146219 24784 leader_election.cc:304] T 8ab8d9cd192348f09921ada29f04e55d P 41f9a4e2214e4382bb2fad82711a2472 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41f9a4e2214e4382bb2fad82711a2472, f0788fe60e4d4891b51e6f092e50bb10; no voters: 
I20260709 13:10:13.146868 24968 raft_consensus.cc:2804] T 8ab8d9cd192348f09921ada29f04e55d P 41f9a4e2214e4382bb2fad82711a2472 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:13.147338 24968 raft_consensus.cc:697] T 8ab8d9cd192348f09921ada29f04e55d P 41f9a4e2214e4382bb2fad82711a2472 [term 1 LEADER]: Becoming Leader. State: Replica: 41f9a4e2214e4382bb2fad82711a2472, State: Running, Role: LEADER
I20260709 13:10:13.148102 24968 consensus_queue.cc:237] T 8ab8d9cd192348f09921ada29f04e55d P 41f9a4e2214e4382bb2fad82711a2472 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:13.154438 24640 catalog_manager.cc:5697] T 8ab8d9cd192348f09921ada29f04e55d P 41f9a4e2214e4382bb2fad82711a2472 reported cstate change: term changed from 0 to 1, leader changed from <none> to 41f9a4e2214e4382bb2fad82711a2472 (127.23.140.66). New cstate: current_term: 1 leader_uuid: "41f9a4e2214e4382bb2fad82711a2472" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:13.182094 24967 consensus_queue.cc:1048] T 3e8dbf03cb5e4334a7231c02b4f45bee P f0788fe60e4d4891b51e6f092e50bb10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:13.192600 24970 consensus_queue.cc:1048] T 3e8dbf03cb5e4334a7231c02b4f45bee P f0788fe60e4d4891b51e6f092e50bb10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:13.200206 24970 raft_consensus.cc:493] T 7ad37a53739d49499dc91aa56c61feb5 P f0788fe60e4d4891b51e6f092e50bb10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.200727 24970 raft_consensus.cc:515] T 7ad37a53739d49499dc91aa56c61feb5 P f0788fe60e4d4891b51e6f092e50bb10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:13.201624 24968 consensus_queue.cc:1048] T 23eeb369895744038073e959747f6f13 P 41f9a4e2214e4382bb2fad82711a2472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:13.203446 24970 leader_election.cc:290] T 7ad37a53739d49499dc91aa56c61feb5 P f0788fe60e4d4891b51e6f092e50bb10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92512576e6bc4561830a180ea4737d86 (127.23.140.65:41489), 41f9a4e2214e4382bb2fad82711a2472 (127.23.140.66:42587)
I20260709 13:10:13.204017 24958 raft_consensus.cc:493] T e1552504f8884142b4ccc09f539a6998 P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.204556 24958 raft_consensus.cc:515] T e1552504f8884142b4ccc09f539a6998 P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:13.204952 24820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ad37a53739d49499dc91aa56c61feb5" candidate_uuid: "f0788fe60e4d4891b51e6f092e50bb10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41f9a4e2214e4382bb2fad82711a2472" is_pre_election: true
I20260709 13:10:13.206525 24958 leader_election.cc:290] T e1552504f8884142b4ccc09f539a6998 P 41f9a4e2214e4382bb2fad82711a2472 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92512576e6bc4561830a180ea4737d86 (127.23.140.65:41489), f0788fe60e4d4891b51e6f092e50bb10 (127.23.140.67:43673)
I20260709 13:10:13.207183 24745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1552504f8884142b4ccc09f539a6998" candidate_uuid: "41f9a4e2214e4382bb2fad82711a2472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92512576e6bc4561830a180ea4737d86" is_pre_election: true
I20260709 13:10:13.207270 24744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ad37a53739d49499dc91aa56c61feb5" candidate_uuid: "f0788fe60e4d4891b51e6f092e50bb10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92512576e6bc4561830a180ea4737d86" is_pre_election: true
I20260709 13:10:13.207510 24892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1552504f8884142b4ccc09f539a6998" candidate_uuid: "41f9a4e2214e4382bb2fad82711a2472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0788fe60e4d4891b51e6f092e50bb10" is_pre_election: true
I20260709 13:10:13.208000 24745 raft_consensus.cc:2393] T e1552504f8884142b4ccc09f539a6998 P 92512576e6bc4561830a180ea4737d86 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 41f9a4e2214e4382bb2fad82711a2472 in current term 1: Already voted for candidate f0788fe60e4d4891b51e6f092e50bb10 in this term.
I20260709 13:10:13.208071 24744 raft_consensus.cc:2393] T 7ad37a53739d49499dc91aa56c61feb5 P 92512576e6bc4561830a180ea4737d86 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f0788fe60e4d4891b51e6f092e50bb10 in current term 1: Already voted for candidate 41f9a4e2214e4382bb2fad82711a2472 in this term.
I20260709 13:10:13.209251 24784 leader_election.cc:304] T e1552504f8884142b4ccc09f539a6998 P 41f9a4e2214e4382bb2fad82711a2472 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41f9a4e2214e4382bb2fad82711a2472; no voters: 92512576e6bc4561830a180ea4737d86, f0788fe60e4d4891b51e6f092e50bb10
I20260709 13:10:13.209640 24858 leader_election.cc:304] T 7ad37a53739d49499dc91aa56c61feb5 P f0788fe60e4d4891b51e6f092e50bb10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0788fe60e4d4891b51e6f092e50bb10; no voters: 41f9a4e2214e4382bb2fad82711a2472, 92512576e6bc4561830a180ea4737d86
I20260709 13:10:13.210815 24970 raft_consensus.cc:3060] T 7ad37a53739d49499dc91aa56c61feb5 P f0788fe60e4d4891b51e6f092e50bb10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:13.211501 24968 raft_consensus.cc:3060] T e1552504f8884142b4ccc09f539a6998 P 41f9a4e2214e4382bb2fad82711a2472 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:13.218981 24970 raft_consensus.cc:2749] T 7ad37a53739d49499dc91aa56c61feb5 P f0788fe60e4d4891b51e6f092e50bb10 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:13.223526 24968 raft_consensus.cc:2749] T e1552504f8884142b4ccc09f539a6998 P 41f9a4e2214e4382bb2fad82711a2472 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:13.224314 24744 raft_consensus.cc:3060] T 23eeb369895744038073e959747f6f13 P 92512576e6bc4561830a180ea4737d86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:13.228015 24970 consensus_queue.cc:1048] T e1552504f8884142b4ccc09f539a6998 P f0788fe60e4d4891b51e6f092e50bb10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:13.230993 24939 consensus_queue.cc:1048] T 23eeb369895744038073e959747f6f13 P 41f9a4e2214e4382bb2fad82711a2472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:13.238988 24967 consensus_queue.cc:1048] T e1552504f8884142b4ccc09f539a6998 P f0788fe60e4d4891b51e6f092e50bb10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:13.256892 24939 consensus_queue.cc:1048] T edb957f6330c46abab225a43aa102b4e P 41f9a4e2214e4382bb2fad82711a2472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:13.266408 25008 consensus_queue.cc:1048] T edb957f6330c46abab225a43aa102b4e P 41f9a4e2214e4382bb2fad82711a2472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:13.323180 24986 raft_consensus.cc:493] T 344ea3140811457ebf5f36122fd88e52 P 92512576e6bc4561830a180ea4737d86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.323645 24986 raft_consensus.cc:515] T 344ea3140811457ebf5f36122fd88e52 P 92512576e6bc4561830a180ea4737d86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:13.325434 24986 leader_election.cc:290] T 344ea3140811457ebf5f36122fd88e52 P 92512576e6bc4561830a180ea4737d86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41f9a4e2214e4382bb2fad82711a2472 (127.23.140.66:42587), f0788fe60e4d4891b51e6f092e50bb10 (127.23.140.67:43673)
I20260709 13:10:13.326153 24820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "344ea3140811457ebf5f36122fd88e52" candidate_uuid: "92512576e6bc4561830a180ea4737d86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41f9a4e2214e4382bb2fad82711a2472" is_pre_election: true
I20260709 13:10:13.326395 24893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "344ea3140811457ebf5f36122fd88e52" candidate_uuid: "92512576e6bc4561830a180ea4737d86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0788fe60e4d4891b51e6f092e50bb10" is_pre_election: true
I20260709 13:10:13.326864 24820 raft_consensus.cc:2393] T 344ea3140811457ebf5f36122fd88e52 P 41f9a4e2214e4382bb2fad82711a2472 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92512576e6bc4561830a180ea4737d86 in current term 1: Already voted for candidate f0788fe60e4d4891b51e6f092e50bb10 in this term.
I20260709 13:10:13.327940 24709 leader_election.cc:304] T 344ea3140811457ebf5f36122fd88e52 P 92512576e6bc4561830a180ea4737d86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92512576e6bc4561830a180ea4737d86; no voters: 41f9a4e2214e4382bb2fad82711a2472, f0788fe60e4d4891b51e6f092e50bb10
I20260709 13:10:13.328653 24986 raft_consensus.cc:3060] T 344ea3140811457ebf5f36122fd88e52 P 92512576e6bc4561830a180ea4737d86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:13.329353 24940 consensus_queue.cc:1048] T fdad60a3620c40daa67e9436d4d5d174 P 92512576e6bc4561830a180ea4737d86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:13.334738 24986 raft_consensus.cc:2749] T 344ea3140811457ebf5f36122fd88e52 P 92512576e6bc4561830a180ea4737d86 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:13.336308 25008 consensus_queue.cc:1048] T 7ad37a53739d49499dc91aa56c61feb5 P 41f9a4e2214e4382bb2fad82711a2472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:13.344530 24940 consensus_queue.cc:1048] T fdad60a3620c40daa67e9436d4d5d174 P 92512576e6bc4561830a180ea4737d86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:13.355036 24966 consensus_queue.cc:1048] T 344ea3140811457ebf5f36122fd88e52 P f0788fe60e4d4891b51e6f092e50bb10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:13.358588 25008 consensus_queue.cc:1048] T 7ad37a53739d49499dc91aa56c61feb5 P 41f9a4e2214e4382bb2fad82711a2472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:13.360188 24966 consensus_queue.cc:1048] T 344ea3140811457ebf5f36122fd88e52 P f0788fe60e4d4891b51e6f092e50bb10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:13.428081 24818 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23eeb369895744038073e959747f6f13"
dest_uuid: "41f9a4e2214e4382bb2fad82711a2472"
mode: GRACEFUL
new_leader_uuid: "92512576e6bc4561830a180ea4737d86"
 from {username='slave'} at 127.0.0.1:41260
I20260709 13:10:13.428673 24818 raft_consensus.cc:606] T 23eeb369895744038073e959747f6f13 P 41f9a4e2214e4382bb2fad82711a2472 [term 1 LEADER]: Received request to transfer leadership to TS 92512576e6bc4561830a180ea4737d86
I20260709 13:10:13.437196 24818 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "edb957f6330c46abab225a43aa102b4e"
dest_uuid: "41f9a4e2214e4382bb2fad82711a2472"
mode: GRACEFUL
new_leader_uuid: "92512576e6bc4561830a180ea4737d86"
 from {username='slave'} at 127.0.0.1:41260
I20260709 13:10:13.437664 24818 raft_consensus.cc:606] T edb957f6330c46abab225a43aa102b4e P 41f9a4e2214e4382bb2fad82711a2472 [term 1 LEADER]: Received request to transfer leadership to TS 92512576e6bc4561830a180ea4737d86
I20260709 13:10:13.441776 24818 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ab8d9cd192348f09921ada29f04e55d"
dest_uuid: "41f9a4e2214e4382bb2fad82711a2472"
mode: GRACEFUL
new_leader_uuid: "92512576e6bc4561830a180ea4737d86"
 from {username='slave'} at 127.0.0.1:41260
I20260709 13:10:13.442242 24818 raft_consensus.cc:606] T 8ab8d9cd192348f09921ada29f04e55d P 41f9a4e2214e4382bb2fad82711a2472 [term 1 LEADER]: Received request to transfer leadership to TS 92512576e6bc4561830a180ea4737d86
I20260709 13:10:13.456422 24893 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e8dbf03cb5e4334a7231c02b4f45bee"
dest_uuid: "f0788fe60e4d4891b51e6f092e50bb10"
mode: GRACEFUL
new_leader_uuid: "41f9a4e2214e4382bb2fad82711a2472"
 from {username='slave'} at 127.0.0.1:42780
I20260709 13:10:13.456931 24893 raft_consensus.cc:606] T 3e8dbf03cb5e4334a7231c02b4f45bee P f0788fe60e4d4891b51e6f092e50bb10 [term 1 LEADER]: Received request to transfer leadership to TS 41f9a4e2214e4382bb2fad82711a2472
I20260709 13:10:13.463583 24893 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1552504f8884142b4ccc09f539a6998"
dest_uuid: "f0788fe60e4d4891b51e6f092e50bb10"
mode: GRACEFUL
new_leader_uuid: "41f9a4e2214e4382bb2fad82711a2472"
 from {username='slave'} at 127.0.0.1:42780
I20260709 13:10:13.464058 24893 raft_consensus.cc:606] T e1552504f8884142b4ccc09f539a6998 P f0788fe60e4d4891b51e6f092e50bb10 [term 1 LEADER]: Received request to transfer leadership to TS 41f9a4e2214e4382bb2fad82711a2472
I20260709 13:10:13.546377 24991 consensus_queue.cc:1048] T 6c309103ab794ba7a09dedd040db10d7 P 92512576e6bc4561830a180ea4737d86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:13.547688 25008 consensus_queue.cc:1048] T 8ab8d9cd192348f09921ada29f04e55d P 41f9a4e2214e4382bb2fad82711a2472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:13.554788 24958 raft_consensus.cc:993] T 8ab8d9cd192348f09921ada29f04e55d P 41f9a4e2214e4382bb2fad82711a2472: : Instructing follower 92512576e6bc4561830a180ea4737d86 to start an election
I20260709 13:10:13.555191 24958 raft_consensus.cc:1081] T 8ab8d9cd192348f09921ada29f04e55d P 41f9a4e2214e4382bb2fad82711a2472 [term 1 LEADER]: Signalling peer 92512576e6bc4561830a180ea4737d86 to start an election
I20260709 13:10:13.558509 24743 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8ab8d9cd192348f09921ada29f04e55d"
dest_uuid: "92512576e6bc4561830a180ea4737d86"
 from {username='slave'} at 127.0.0.1:49432
I20260709 13:10:13.559031 24743 raft_consensus.cc:493] T 8ab8d9cd192348f09921ada29f04e55d P 92512576e6bc4561830a180ea4737d86 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:13.559401 24743 raft_consensus.cc:3060] T 8ab8d9cd192348f09921ada29f04e55d P 92512576e6bc4561830a180ea4737d86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:13.559566 24986 consensus_queue.cc:1048] T 6c309103ab794ba7a09dedd040db10d7 P 92512576e6bc4561830a180ea4737d86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:13.565783 24958 consensus_queue.cc:1048] T 8ab8d9cd192348f09921ada29f04e55d P 41f9a4e2214e4382bb2fad82711a2472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:13.566310 24743 raft_consensus.cc:515] T 8ab8d9cd192348f09921ada29f04e55d P 92512576e6bc4561830a180ea4737d86 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:13.573096 24743 leader_election.cc:290] T 8ab8d9cd192348f09921ada29f04e55d P 92512576e6bc4561830a180ea4737d86 [CANDIDATE]: Term 2 election: Requested vote from peers 41f9a4e2214e4382bb2fad82711a2472 (127.23.140.66:42587), f0788fe60e4d4891b51e6f092e50bb10 (127.23.140.67:43673)
I20260709 13:10:13.573688 24820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab8d9cd192348f09921ada29f04e55d" candidate_uuid: "92512576e6bc4561830a180ea4737d86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "41f9a4e2214e4382bb2fad82711a2472"
I20260709 13:10:13.574295 24820 raft_consensus.cc:3055] T 8ab8d9cd192348f09921ada29f04e55d P 41f9a4e2214e4382bb2fad82711a2472 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:13.574610 24820 raft_consensus.cc:740] T 8ab8d9cd192348f09921ada29f04e55d P 41f9a4e2214e4382bb2fad82711a2472 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 41f9a4e2214e4382bb2fad82711a2472, State: Running, Role: LEADER
I20260709 13:10:13.575462 24820 consensus_queue.cc:260] T 8ab8d9cd192348f09921ada29f04e55d P 41f9a4e2214e4382bb2fad82711a2472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:13.576504 24820 raft_consensus.cc:3060] T 8ab8d9cd192348f09921ada29f04e55d P 41f9a4e2214e4382bb2fad82711a2472 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:13.574621 24894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab8d9cd192348f09921ada29f04e55d" candidate_uuid: "92512576e6bc4561830a180ea4737d86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0788fe60e4d4891b51e6f092e50bb10"
I20260709 13:10:13.583699 24894 raft_consensus.cc:3060] T 8ab8d9cd192348f09921ada29f04e55d P f0788fe60e4d4891b51e6f092e50bb10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:13.584285 24820 raft_consensus.cc:2468] T 8ab8d9cd192348f09921ada29f04e55d P 41f9a4e2214e4382bb2fad82711a2472 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92512576e6bc4561830a180ea4737d86 in term 2.
I20260709 13:10:13.585404 24708 leader_election.cc:304] T 8ab8d9cd192348f09921ada29f04e55d P 92512576e6bc4561830a180ea4737d86 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41f9a4e2214e4382bb2fad82711a2472, 92512576e6bc4561830a180ea4737d86; no voters: 
I20260709 13:10:13.586300 24986 raft_consensus.cc:2804] T 8ab8d9cd192348f09921ada29f04e55d P 92512576e6bc4561830a180ea4737d86 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:13.586745 24986 raft_consensus.cc:697] T 8ab8d9cd192348f09921ada29f04e55d P 92512576e6bc4561830a180ea4737d86 [term 2 LEADER]: Becoming Leader. State: Replica: 92512576e6bc4561830a180ea4737d86, State: Running, Role: LEADER
I20260709 13:10:13.587543 24986 consensus_queue.cc:237] T 8ab8d9cd192348f09921ada29f04e55d P 92512576e6bc4561830a180ea4737d86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:13.590780 24894 raft_consensus.cc:2468] T 8ab8d9cd192348f09921ada29f04e55d P f0788fe60e4d4891b51e6f092e50bb10 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92512576e6bc4561830a180ea4737d86 in term 2.
I20260709 13:10:13.595153 24643 catalog_manager.cc:5697] T 8ab8d9cd192348f09921ada29f04e55d P 92512576e6bc4561830a180ea4737d86 reported cstate change: term changed from 1 to 2, leader changed from 41f9a4e2214e4382bb2fad82711a2472 (127.23.140.66) to 92512576e6bc4561830a180ea4737d86 (127.23.140.65). New cstate: current_term: 2 leader_uuid: "92512576e6bc4561830a180ea4737d86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:13.664469 24968 raft_consensus.cc:993] T 23eeb369895744038073e959747f6f13 P 41f9a4e2214e4382bb2fad82711a2472: : Instructing follower 92512576e6bc4561830a180ea4737d86 to start an election
I20260709 13:10:13.664944 24958 raft_consensus.cc:1081] T 23eeb369895744038073e959747f6f13 P 41f9a4e2214e4382bb2fad82711a2472 [term 1 LEADER]: Signalling peer 92512576e6bc4561830a180ea4737d86 to start an election
I20260709 13:10:13.666417 24743 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "23eeb369895744038073e959747f6f13"
dest_uuid: "92512576e6bc4561830a180ea4737d86"
 from {username='slave'} at 127.0.0.1:49432
I20260709 13:10:13.666966 24743 raft_consensus.cc:493] T 23eeb369895744038073e959747f6f13 P 92512576e6bc4561830a180ea4737d86 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:13.667320 24743 raft_consensus.cc:3060] T 23eeb369895744038073e959747f6f13 P 92512576e6bc4561830a180ea4737d86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:13.671861 24743 raft_consensus.cc:515] T 23eeb369895744038073e959747f6f13 P 92512576e6bc4561830a180ea4737d86 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:13.674598 24743 leader_election.cc:290] T 23eeb369895744038073e959747f6f13 P 92512576e6bc4561830a180ea4737d86 [CANDIDATE]: Term 2 election: Requested vote from peers 41f9a4e2214e4382bb2fad82711a2472 (127.23.140.66:42587), f0788fe60e4d4891b51e6f092e50bb10 (127.23.140.67:43673)
I20260709 13:10:13.676098 24892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eeb369895744038073e959747f6f13" candidate_uuid: "92512576e6bc4561830a180ea4737d86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0788fe60e4d4891b51e6f092e50bb10"
I20260709 13:10:13.676263 24820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eeb369895744038073e959747f6f13" candidate_uuid: "92512576e6bc4561830a180ea4737d86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "41f9a4e2214e4382bb2fad82711a2472"
I20260709 13:10:13.676663 24892 raft_consensus.cc:3060] T 23eeb369895744038073e959747f6f13 P f0788fe60e4d4891b51e6f092e50bb10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:13.676826 24820 raft_consensus.cc:3055] T 23eeb369895744038073e959747f6f13 P 41f9a4e2214e4382bb2fad82711a2472 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:13.677175 24820 raft_consensus.cc:740] T 23eeb369895744038073e959747f6f13 P 41f9a4e2214e4382bb2fad82711a2472 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 41f9a4e2214e4382bb2fad82711a2472, State: Running, Role: LEADER
I20260709 13:10:13.677973 24820 consensus_queue.cc:260] T 23eeb369895744038073e959747f6f13 P 41f9a4e2214e4382bb2fad82711a2472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:13.679229 24820 raft_consensus.cc:3060] T 23eeb369895744038073e959747f6f13 P 41f9a4e2214e4382bb2fad82711a2472 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:13.682156 24892 raft_consensus.cc:2468] T 23eeb369895744038073e959747f6f13 P f0788fe60e4d4891b51e6f092e50bb10 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92512576e6bc4561830a180ea4737d86 in term 2.
I20260709 13:10:13.683167 24709 leader_election.cc:304] T 23eeb369895744038073e959747f6f13 P 92512576e6bc4561830a180ea4737d86 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92512576e6bc4561830a180ea4737d86, f0788fe60e4d4891b51e6f092e50bb10; no voters: 
I20260709 13:10:13.683764 24966 raft_consensus.cc:993] T 3e8dbf03cb5e4334a7231c02b4f45bee P f0788fe60e4d4891b51e6f092e50bb10: : Instructing follower 41f9a4e2214e4382bb2fad82711a2472 to start an election
I20260709 13:10:13.683941 24986 raft_consensus.cc:2804] T 23eeb369895744038073e959747f6f13 P 92512576e6bc4561830a180ea4737d86 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:13.684198 24970 raft_consensus.cc:1081] T 3e8dbf03cb5e4334a7231c02b4f45bee P f0788fe60e4d4891b51e6f092e50bb10 [term 1 LEADER]: Signalling peer 41f9a4e2214e4382bb2fad82711a2472 to start an election
I20260709 13:10:13.684988 24820 raft_consensus.cc:2468] T 23eeb369895744038073e959747f6f13 P 41f9a4e2214e4382bb2fad82711a2472 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92512576e6bc4561830a180ea4737d86 in term 2.
I20260709 13:10:13.684486 24986 raft_consensus.cc:697] T 23eeb369895744038073e959747f6f13 P 92512576e6bc4561830a180ea4737d86 [term 2 LEADER]: Becoming Leader. State: Replica: 92512576e6bc4561830a180ea4737d86, State: Running, Role: LEADER
I20260709 13:10:13.685812 24818 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3e8dbf03cb5e4334a7231c02b4f45bee"
dest_uuid: "41f9a4e2214e4382bb2fad82711a2472"
 from {username='slave'} at 127.0.0.1:41254
I20260709 13:10:13.685824 24986 consensus_queue.cc:237] T 23eeb369895744038073e959747f6f13 P 92512576e6bc4561830a180ea4737d86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:13.686426 24818 raft_consensus.cc:493] T 3e8dbf03cb5e4334a7231c02b4f45bee P 41f9a4e2214e4382bb2fad82711a2472 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:13.686815 24818 raft_consensus.cc:3060] T 3e8dbf03cb5e4334a7231c02b4f45bee P 41f9a4e2214e4382bb2fad82711a2472 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:13.692718 24818 raft_consensus.cc:515] T 3e8dbf03cb5e4334a7231c02b4f45bee P 41f9a4e2214e4382bb2fad82711a2472 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:13.692891 24643 catalog_manager.cc:5697] T 23eeb369895744038073e959747f6f13 P 92512576e6bc4561830a180ea4737d86 reported cstate change: term changed from 1 to 2, leader changed from 41f9a4e2214e4382bb2fad82711a2472 (127.23.140.66) to 92512576e6bc4561830a180ea4737d86 (127.23.140.65). New cstate: current_term: 2 leader_uuid: "92512576e6bc4561830a180ea4737d86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:13.695418 24970 raft_consensus.cc:993] T e1552504f8884142b4ccc09f539a6998 P f0788fe60e4d4891b51e6f092e50bb10: : Instructing follower 41f9a4e2214e4382bb2fad82711a2472 to start an election
I20260709 13:10:13.695276 24743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8dbf03cb5e4334a7231c02b4f45bee" candidate_uuid: "41f9a4e2214e4382bb2fad82711a2472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "92512576e6bc4561830a180ea4737d86"
I20260709 13:10:13.695820 24743 raft_consensus.cc:3060] T 3e8dbf03cb5e4334a7231c02b4f45bee P 92512576e6bc4561830a180ea4737d86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:13.695889 24967 raft_consensus.cc:1081] T e1552504f8884142b4ccc09f539a6998 P f0788fe60e4d4891b51e6f092e50bb10 [term 1 LEADER]: Signalling peer 41f9a4e2214e4382bb2fad82711a2472 to start an election
I20260709 13:10:13.696079 24892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8dbf03cb5e4334a7231c02b4f45bee" candidate_uuid: "41f9a4e2214e4382bb2fad82711a2472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0788fe60e4d4891b51e6f092e50bb10"
I20260709 13:10:13.696631 24892 raft_consensus.cc:3055] T 3e8dbf03cb5e4334a7231c02b4f45bee P f0788fe60e4d4891b51e6f092e50bb10 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:13.696926 24892 raft_consensus.cc:740] T 3e8dbf03cb5e4334a7231c02b4f45bee P f0788fe60e4d4891b51e6f092e50bb10 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f0788fe60e4d4891b51e6f092e50bb10, State: Running, Role: LEADER
I20260709 13:10:13.697911 24818 leader_election.cc:290] T 3e8dbf03cb5e4334a7231c02b4f45bee P 41f9a4e2214e4382bb2fad82711a2472 [CANDIDATE]: Term 2 election: Requested vote from peers 92512576e6bc4561830a180ea4737d86 (127.23.140.65:41489), f0788fe60e4d4891b51e6f092e50bb10 (127.23.140.67:43673)
I20260709 13:10:13.697805 24892 consensus_queue.cc:260] T 3e8dbf03cb5e4334a7231c02b4f45bee P f0788fe60e4d4891b51e6f092e50bb10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:13.698902 24892 raft_consensus.cc:3060] T 3e8dbf03cb5e4334a7231c02b4f45bee P f0788fe60e4d4891b51e6f092e50bb10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:13.697820 24820 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e1552504f8884142b4ccc09f539a6998"
dest_uuid: "41f9a4e2214e4382bb2fad82711a2472"
 from {username='slave'} at 127.0.0.1:41254
I20260709 13:10:13.700062 24820 raft_consensus.cc:493] T e1552504f8884142b4ccc09f539a6998 P 41f9a4e2214e4382bb2fad82711a2472 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:13.700461 24820 raft_consensus.cc:3060] T e1552504f8884142b4ccc09f539a6998 P 41f9a4e2214e4382bb2fad82711a2472 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:13.702651 24743 raft_consensus.cc:2468] T 3e8dbf03cb5e4334a7231c02b4f45bee P 92512576e6bc4561830a180ea4737d86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41f9a4e2214e4382bb2fad82711a2472 in term 2.
I20260709 13:10:13.703697 24784 leader_election.cc:304] T 3e8dbf03cb5e4334a7231c02b4f45bee P 41f9a4e2214e4382bb2fad82711a2472 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41f9a4e2214e4382bb2fad82711a2472, 92512576e6bc4561830a180ea4737d86; no voters: 
I20260709 13:10:13.704464 24958 raft_consensus.cc:2804] T 3e8dbf03cb5e4334a7231c02b4f45bee P 41f9a4e2214e4382bb2fad82711a2472 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:13.704926 24958 raft_consensus.cc:697] T 3e8dbf03cb5e4334a7231c02b4f45bee P 41f9a4e2214e4382bb2fad82711a2472 [term 2 LEADER]: Becoming Leader. State: Replica: 41f9a4e2214e4382bb2fad82711a2472, State: Running, Role: LEADER
I20260709 13:10:13.705686 24958 consensus_queue.cc:237] T 3e8dbf03cb5e4334a7231c02b4f45bee P 41f9a4e2214e4382bb2fad82711a2472 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:13.706115 24892 raft_consensus.cc:2468] T 3e8dbf03cb5e4334a7231c02b4f45bee P f0788fe60e4d4891b51e6f092e50bb10 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41f9a4e2214e4382bb2fad82711a2472 in term 2.
I20260709 13:10:13.707036 24820 raft_consensus.cc:515] T e1552504f8884142b4ccc09f539a6998 P 41f9a4e2214e4382bb2fad82711a2472 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:13.708945 24820 leader_election.cc:290] T e1552504f8884142b4ccc09f539a6998 P 41f9a4e2214e4382bb2fad82711a2472 [CANDIDATE]: Term 2 election: Requested vote from peers 92512576e6bc4561830a180ea4737d86 (127.23.140.65:41489), f0788fe60e4d4891b51e6f092e50bb10 (127.23.140.67:43673)
I20260709 13:10:13.710274 24743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1552504f8884142b4ccc09f539a6998" candidate_uuid: "41f9a4e2214e4382bb2fad82711a2472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "92512576e6bc4561830a180ea4737d86"
I20260709 13:10:13.710289 24892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1552504f8884142b4ccc09f539a6998" candidate_uuid: "41f9a4e2214e4382bb2fad82711a2472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0788fe60e4d4891b51e6f092e50bb10"
I20260709 13:10:13.710906 24743 raft_consensus.cc:3060] T e1552504f8884142b4ccc09f539a6998 P 92512576e6bc4561830a180ea4737d86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:13.710961 24892 raft_consensus.cc:3055] T e1552504f8884142b4ccc09f539a6998 P f0788fe60e4d4891b51e6f092e50bb10 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:13.711374 24892 raft_consensus.cc:740] T e1552504f8884142b4ccc09f539a6998 P f0788fe60e4d4891b51e6f092e50bb10 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f0788fe60e4d4891b51e6f092e50bb10, State: Running, Role: LEADER
I20260709 13:10:13.712158 24892 consensus_queue.cc:260] T e1552504f8884142b4ccc09f539a6998 P f0788fe60e4d4891b51e6f092e50bb10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:13.713310 24892 raft_consensus.cc:3060] T e1552504f8884142b4ccc09f539a6998 P f0788fe60e4d4891b51e6f092e50bb10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:13.713917 24643 catalog_manager.cc:5697] T 3e8dbf03cb5e4334a7231c02b4f45bee P 41f9a4e2214e4382bb2fad82711a2472 reported cstate change: term changed from 1 to 2, leader changed from f0788fe60e4d4891b51e6f092e50bb10 (127.23.140.67) to 41f9a4e2214e4382bb2fad82711a2472 (127.23.140.66). New cstate: current_term: 2 leader_uuid: "41f9a4e2214e4382bb2fad82711a2472" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:13.715924 24743 raft_consensus.cc:2468] T e1552504f8884142b4ccc09f539a6998 P 92512576e6bc4561830a180ea4737d86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41f9a4e2214e4382bb2fad82711a2472 in term 2.
I20260709 13:10:13.716928 24784 leader_election.cc:304] T e1552504f8884142b4ccc09f539a6998 P 41f9a4e2214e4382bb2fad82711a2472 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41f9a4e2214e4382bb2fad82711a2472, 92512576e6bc4561830a180ea4737d86; no voters: 
I20260709 13:10:13.717691 24958 raft_consensus.cc:2804] T e1552504f8884142b4ccc09f539a6998 P 41f9a4e2214e4382bb2fad82711a2472 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:13.718173 24958 raft_consensus.cc:697] T e1552504f8884142b4ccc09f539a6998 P 41f9a4e2214e4382bb2fad82711a2472 [term 2 LEADER]: Becoming Leader. State: Replica: 41f9a4e2214e4382bb2fad82711a2472, State: Running, Role: LEADER
I20260709 13:10:13.718916 24958 consensus_queue.cc:237] T e1552504f8884142b4ccc09f539a6998 P 41f9a4e2214e4382bb2fad82711a2472 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:13.719681 24892 raft_consensus.cc:2468] T e1552504f8884142b4ccc09f539a6998 P f0788fe60e4d4891b51e6f092e50bb10 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41f9a4e2214e4382bb2fad82711a2472 in term 2.
I20260709 13:10:13.726279 24643 catalog_manager.cc:5697] T e1552504f8884142b4ccc09f539a6998 P 41f9a4e2214e4382bb2fad82711a2472 reported cstate change: term changed from 1 to 2, leader changed from f0788fe60e4d4891b51e6f092e50bb10 (127.23.140.67) to 41f9a4e2214e4382bb2fad82711a2472 (127.23.140.66). New cstate: current_term: 2 leader_uuid: "41f9a4e2214e4382bb2fad82711a2472" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:13.787604 25008 raft_consensus.cc:993] T edb957f6330c46abab225a43aa102b4e P 41f9a4e2214e4382bb2fad82711a2472: : Instructing follower 92512576e6bc4561830a180ea4737d86 to start an election
I20260709 13:10:13.787956 25008 raft_consensus.cc:1081] T edb957f6330c46abab225a43aa102b4e P 41f9a4e2214e4382bb2fad82711a2472 [term 1 LEADER]: Signalling peer 92512576e6bc4561830a180ea4737d86 to start an election
I20260709 13:10:13.789180 24743 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "edb957f6330c46abab225a43aa102b4e"
dest_uuid: "92512576e6bc4561830a180ea4737d86"
 from {username='slave'} at 127.0.0.1:49432
I20260709 13:10:13.789598 24743 raft_consensus.cc:493] T edb957f6330c46abab225a43aa102b4e P 92512576e6bc4561830a180ea4737d86 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:13.789911 24743 raft_consensus.cc:3060] T edb957f6330c46abab225a43aa102b4e P 92512576e6bc4561830a180ea4737d86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:13.794515 24743 raft_consensus.cc:515] T edb957f6330c46abab225a43aa102b4e P 92512576e6bc4561830a180ea4737d86 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:13.796247 24743 leader_election.cc:290] T edb957f6330c46abab225a43aa102b4e P 92512576e6bc4561830a180ea4737d86 [CANDIDATE]: Term 2 election: Requested vote from peers 41f9a4e2214e4382bb2fad82711a2472 (127.23.140.66:42587), f0788fe60e4d4891b51e6f092e50bb10 (127.23.140.67:43673)
I20260709 13:10:13.797101 24820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb957f6330c46abab225a43aa102b4e" candidate_uuid: "92512576e6bc4561830a180ea4737d86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "41f9a4e2214e4382bb2fad82711a2472"
I20260709 13:10:13.797364 24892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb957f6330c46abab225a43aa102b4e" candidate_uuid: "92512576e6bc4561830a180ea4737d86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0788fe60e4d4891b51e6f092e50bb10"
I20260709 13:10:13.797576 24820 raft_consensus.cc:3055] T edb957f6330c46abab225a43aa102b4e P 41f9a4e2214e4382bb2fad82711a2472 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:13.797931 24892 raft_consensus.cc:3060] T edb957f6330c46abab225a43aa102b4e P f0788fe60e4d4891b51e6f092e50bb10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:13.797914 24820 raft_consensus.cc:740] T edb957f6330c46abab225a43aa102b4e P 41f9a4e2214e4382bb2fad82711a2472 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 41f9a4e2214e4382bb2fad82711a2472, State: Running, Role: LEADER
I20260709 13:10:13.798906 24820 consensus_queue.cc:260] T edb957f6330c46abab225a43aa102b4e P 41f9a4e2214e4382bb2fad82711a2472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:13.799829 24820 raft_consensus.cc:3060] T edb957f6330c46abab225a43aa102b4e P 41f9a4e2214e4382bb2fad82711a2472 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:13.802731 24892 raft_consensus.cc:2468] T edb957f6330c46abab225a43aa102b4e P f0788fe60e4d4891b51e6f092e50bb10 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92512576e6bc4561830a180ea4737d86 in term 2.
I20260709 13:10:13.803696 24709 leader_election.cc:304] T edb957f6330c46abab225a43aa102b4e P 92512576e6bc4561830a180ea4737d86 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92512576e6bc4561830a180ea4737d86, f0788fe60e4d4891b51e6f092e50bb10; no voters: 
I20260709 13:10:13.804502 24986 raft_consensus.cc:2804] T edb957f6330c46abab225a43aa102b4e P 92512576e6bc4561830a180ea4737d86 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:13.804704 24820 raft_consensus.cc:2468] T edb957f6330c46abab225a43aa102b4e P 41f9a4e2214e4382bb2fad82711a2472 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92512576e6bc4561830a180ea4737d86 in term 2.
I20260709 13:10:13.804984 24986 raft_consensus.cc:697] T edb957f6330c46abab225a43aa102b4e P 92512576e6bc4561830a180ea4737d86 [term 2 LEADER]: Becoming Leader. State: Replica: 92512576e6bc4561830a180ea4737d86, State: Running, Role: LEADER
I20260709 13:10:13.805861 24986 consensus_queue.cc:237] T edb957f6330c46abab225a43aa102b4e P 92512576e6bc4561830a180ea4737d86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:13.811724 24643 catalog_manager.cc:5697] T edb957f6330c46abab225a43aa102b4e P 92512576e6bc4561830a180ea4737d86 reported cstate change: term changed from 1 to 2, leader changed from 41f9a4e2214e4382bb2fad82711a2472 (127.23.140.66) to 92512576e6bc4561830a180ea4737d86 (127.23.140.65). New cstate: current_term: 2 leader_uuid: "92512576e6bc4561830a180ea4737d86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:14.091940 24892 raft_consensus.cc:1275] T 23eeb369895744038073e959747f6f13 P f0788fe60e4d4891b51e6f092e50bb10 [term 2 FOLLOWER]: Refusing update from remote peer 92512576e6bc4561830a180ea4737d86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:14.093248 24986 consensus_queue.cc:1048] T 23eeb369895744038073e959747f6f13 P 92512576e6bc4561830a180ea4737d86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:14.101019 24820 raft_consensus.cc:1275] T 23eeb369895744038073e959747f6f13 P 41f9a4e2214e4382bb2fad82711a2472 [term 2 FOLLOWER]: Refusing update from remote peer 92512576e6bc4561830a180ea4737d86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:14.103053 24986 consensus_queue.cc:1048] T 23eeb369895744038073e959747f6f13 P 92512576e6bc4561830a180ea4737d86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:14.108367 24894 raft_consensus.cc:1275] T 8ab8d9cd192348f09921ada29f04e55d P f0788fe60e4d4891b51e6f092e50bb10 [term 2 FOLLOWER]: Refusing update from remote peer 92512576e6bc4561830a180ea4737d86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:14.109932 24940 consensus_queue.cc:1048] T 8ab8d9cd192348f09921ada29f04e55d P 92512576e6bc4561830a180ea4737d86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:14.121876 24743 raft_consensus.cc:1275] T 3e8dbf03cb5e4334a7231c02b4f45bee P 92512576e6bc4561830a180ea4737d86 [term 2 FOLLOWER]: Refusing update from remote peer 41f9a4e2214e4382bb2fad82711a2472: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:14.123905 25008 consensus_queue.cc:1048] T 3e8dbf03cb5e4334a7231c02b4f45bee P 41f9a4e2214e4382bb2fad82711a2472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:14.127357 24820 raft_consensus.cc:1275] T 8ab8d9cd192348f09921ada29f04e55d P 41f9a4e2214e4382bb2fad82711a2472 [term 2 FOLLOWER]: Refusing update from remote peer 92512576e6bc4561830a180ea4737d86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:14.128726 24986 consensus_queue.cc:1048] T 8ab8d9cd192348f09921ada29f04e55d P 92512576e6bc4561830a180ea4737d86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:14.133431 24894 raft_consensus.cc:1275] T 3e8dbf03cb5e4334a7231c02b4f45bee P f0788fe60e4d4891b51e6f092e50bb10 [term 2 FOLLOWER]: Refusing update from remote peer 41f9a4e2214e4382bb2fad82711a2472: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:14.134907 24968 consensus_queue.cc:1048] T 3e8dbf03cb5e4334a7231c02b4f45bee P 41f9a4e2214e4382bb2fad82711a2472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:14.215860 24894 raft_consensus.cc:1275] T edb957f6330c46abab225a43aa102b4e P f0788fe60e4d4891b51e6f092e50bb10 [term 2 FOLLOWER]: Refusing update from remote peer 92512576e6bc4561830a180ea4737d86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:14.217026 25015 consensus_queue.cc:1048] T edb957f6330c46abab225a43aa102b4e P 92512576e6bc4561830a180ea4737d86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:14.223999 24820 raft_consensus.cc:1275] T edb957f6330c46abab225a43aa102b4e P 41f9a4e2214e4382bb2fad82711a2472 [term 2 FOLLOWER]: Refusing update from remote peer 92512576e6bc4561830a180ea4737d86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:14.225610 25032 consensus_queue.cc:1048] T edb957f6330c46abab225a43aa102b4e P 92512576e6bc4561830a180ea4737d86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:14.283327 24743 raft_consensus.cc:1275] T e1552504f8884142b4ccc09f539a6998 P 92512576e6bc4561830a180ea4737d86 [term 2 FOLLOWER]: Refusing update from remote peer 41f9a4e2214e4382bb2fad82711a2472: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:14.284521 24958 consensus_queue.cc:1048] T e1552504f8884142b4ccc09f539a6998 P 41f9a4e2214e4382bb2fad82711a2472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:14.292894 24894 raft_consensus.cc:1275] T e1552504f8884142b4ccc09f539a6998 P f0788fe60e4d4891b51e6f092e50bb10 [term 2 FOLLOWER]: Refusing update from remote peer 41f9a4e2214e4382bb2fad82711a2472: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:14.294253 24958 consensus_queue.cc:1048] T e1552504f8884142b4ccc09f539a6998 P 41f9a4e2214e4382bb2fad82711a2472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:16.496376 24113 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:10:16.497084 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:16.512667 24743 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23eeb369895744038073e959747f6f13"
dest_uuid: "92512576e6bc4561830a180ea4737d86"
mode: GRACEFUL
new_leader_uuid: "f0788fe60e4d4891b51e6f092e50bb10"
 from {username='slave'} at 127.0.0.1:49442
I20260709 13:10:16.513195 24743 raft_consensus.cc:606] T 23eeb369895744038073e959747f6f13 P 92512576e6bc4561830a180ea4737d86 [term 2 LEADER]: Received request to transfer leadership to TS f0788fe60e4d4891b51e6f092e50bb10
I20260709 13:10:16.515579 24743 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fdad60a3620c40daa67e9436d4d5d174"
dest_uuid: "92512576e6bc4561830a180ea4737d86"
mode: GRACEFUL
new_leader_uuid: "f0788fe60e4d4891b51e6f092e50bb10"
 from {username='slave'} at 127.0.0.1:49442
I20260709 13:10:16.516036 24743 raft_consensus.cc:606] T fdad60a3620c40daa67e9436d4d5d174 P 92512576e6bc4561830a180ea4737d86 [term 1 LEADER]: Received request to transfer leadership to TS f0788fe60e4d4891b51e6f092e50bb10
I20260709 13:10:16.517158 24113 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:10:16.517580 24113 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:16.695245 25038 raft_consensus.cc:993] T fdad60a3620c40daa67e9436d4d5d174 P 92512576e6bc4561830a180ea4737d86: : Instructing follower f0788fe60e4d4891b51e6f092e50bb10 to start an election
I20260709 13:10:16.695739 25015 raft_consensus.cc:1081] T fdad60a3620c40daa67e9436d4d5d174 P 92512576e6bc4561830a180ea4737d86 [term 1 LEADER]: Signalling peer f0788fe60e4d4891b51e6f092e50bb10 to start an election
I20260709 13:10:16.697103 24894 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fdad60a3620c40daa67e9436d4d5d174"
dest_uuid: "f0788fe60e4d4891b51e6f092e50bb10"
 from {username='slave'} at 127.0.0.1:42762
I20260709 13:10:16.697559 24894 raft_consensus.cc:493] T fdad60a3620c40daa67e9436d4d5d174 P f0788fe60e4d4891b51e6f092e50bb10 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:16.697911 24894 raft_consensus.cc:3060] T fdad60a3620c40daa67e9436d4d5d174 P f0788fe60e4d4891b51e6f092e50bb10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.703310 24894 raft_consensus.cc:515] T fdad60a3620c40daa67e9436d4d5d174 P f0788fe60e4d4891b51e6f092e50bb10 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:16.704942 24894 leader_election.cc:290] T fdad60a3620c40daa67e9436d4d5d174 P f0788fe60e4d4891b51e6f092e50bb10 [CANDIDATE]: Term 2 election: Requested vote from peers 92512576e6bc4561830a180ea4737d86 (127.23.140.65:41489), 41f9a4e2214e4382bb2fad82711a2472 (127.23.140.66:42587)
I20260709 13:10:16.705911 24743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdad60a3620c40daa67e9436d4d5d174" candidate_uuid: "f0788fe60e4d4891b51e6f092e50bb10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "92512576e6bc4561830a180ea4737d86"
I20260709 13:10:16.706519 24743 raft_consensus.cc:3055] T fdad60a3620c40daa67e9436d4d5d174 P 92512576e6bc4561830a180ea4737d86 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:16.706427 24820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdad60a3620c40daa67e9436d4d5d174" candidate_uuid: "f0788fe60e4d4891b51e6f092e50bb10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "41f9a4e2214e4382bb2fad82711a2472"
I20260709 13:10:16.706890 24743 raft_consensus.cc:740] T fdad60a3620c40daa67e9436d4d5d174 P 92512576e6bc4561830a180ea4737d86 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 92512576e6bc4561830a180ea4737d86, State: Running, Role: LEADER
I20260709 13:10:16.707034 24820 raft_consensus.cc:3060] T fdad60a3620c40daa67e9436d4d5d174 P 41f9a4e2214e4382bb2fad82711a2472 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.707721 24743 consensus_queue.cc:260] T fdad60a3620c40daa67e9436d4d5d174 P 92512576e6bc4561830a180ea4737d86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:16.708905 24743 raft_consensus.cc:3060] T fdad60a3620c40daa67e9436d4d5d174 P 92512576e6bc4561830a180ea4737d86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.714061 24820 raft_consensus.cc:2468] T fdad60a3620c40daa67e9436d4d5d174 P 41f9a4e2214e4382bb2fad82711a2472 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0788fe60e4d4891b51e6f092e50bb10 in term 2.
I20260709 13:10:16.715356 24857 leader_election.cc:304] T fdad60a3620c40daa67e9436d4d5d174 P f0788fe60e4d4891b51e6f092e50bb10 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41f9a4e2214e4382bb2fad82711a2472, f0788fe60e4d4891b51e6f092e50bb10; no voters: 
I20260709 13:10:16.715575 24743 raft_consensus.cc:2468] T fdad60a3620c40daa67e9436d4d5d174 P 92512576e6bc4561830a180ea4737d86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0788fe60e4d4891b51e6f092e50bb10 in term 2.
I20260709 13:10:16.716096 24970 raft_consensus.cc:2804] T fdad60a3620c40daa67e9436d4d5d174 P f0788fe60e4d4891b51e6f092e50bb10 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:16.717233 24970 raft_consensus.cc:697] T fdad60a3620c40daa67e9436d4d5d174 P f0788fe60e4d4891b51e6f092e50bb10 [term 2 LEADER]: Becoming Leader. State: Replica: f0788fe60e4d4891b51e6f092e50bb10, State: Running, Role: LEADER
I20260709 13:10:16.718123 24970 consensus_queue.cc:237] T fdad60a3620c40daa67e9436d4d5d174 P f0788fe60e4d4891b51e6f092e50bb10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:16.726634 24642 catalog_manager.cc:5697] T fdad60a3620c40daa67e9436d4d5d174 P f0788fe60e4d4891b51e6f092e50bb10 reported cstate change: term changed from 1 to 2, leader changed from 92512576e6bc4561830a180ea4737d86 (127.23.140.65) to f0788fe60e4d4891b51e6f092e50bb10 (127.23.140.67). New cstate: current_term: 2 leader_uuid: "f0788fe60e4d4891b51e6f092e50bb10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:16.918970 25015 raft_consensus.cc:993] T 23eeb369895744038073e959747f6f13 P 92512576e6bc4561830a180ea4737d86: : Instructing follower f0788fe60e4d4891b51e6f092e50bb10 to start an election
I20260709 13:10:16.919396 25038 raft_consensus.cc:1081] T 23eeb369895744038073e959747f6f13 P 92512576e6bc4561830a180ea4737d86 [term 2 LEADER]: Signalling peer f0788fe60e4d4891b51e6f092e50bb10 to start an election
I20260709 13:10:16.920739 24894 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "23eeb369895744038073e959747f6f13"
dest_uuid: "f0788fe60e4d4891b51e6f092e50bb10"
 from {username='slave'} at 127.0.0.1:42762
I20260709 13:10:16.921221 24894 raft_consensus.cc:493] T 23eeb369895744038073e959747f6f13 P f0788fe60e4d4891b51e6f092e50bb10 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:16.921535 24894 raft_consensus.cc:3060] T 23eeb369895744038073e959747f6f13 P f0788fe60e4d4891b51e6f092e50bb10 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:16.926168 24894 raft_consensus.cc:515] T 23eeb369895744038073e959747f6f13 P f0788fe60e4d4891b51e6f092e50bb10 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:16.927712 24894 leader_election.cc:290] T 23eeb369895744038073e959747f6f13 P f0788fe60e4d4891b51e6f092e50bb10 [CANDIDATE]: Term 3 election: Requested vote from peers 41f9a4e2214e4382bb2fad82711a2472 (127.23.140.66:42587), 92512576e6bc4561830a180ea4737d86 (127.23.140.65:41489)
I20260709 13:10:16.928435 24820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eeb369895744038073e959747f6f13" candidate_uuid: "f0788fe60e4d4891b51e6f092e50bb10" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "41f9a4e2214e4382bb2fad82711a2472"
I20260709 13:10:16.929013 24820 raft_consensus.cc:3060] T 23eeb369895744038073e959747f6f13 P 41f9a4e2214e4382bb2fad82711a2472 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:16.929227 24743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eeb369895744038073e959747f6f13" candidate_uuid: "f0788fe60e4d4891b51e6f092e50bb10" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "92512576e6bc4561830a180ea4737d86"
I20260709 13:10:16.929788 24743 raft_consensus.cc:3055] T 23eeb369895744038073e959747f6f13 P 92512576e6bc4561830a180ea4737d86 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:16.930112 24743 raft_consensus.cc:740] T 23eeb369895744038073e959747f6f13 P 92512576e6bc4561830a180ea4737d86 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 92512576e6bc4561830a180ea4737d86, State: Running, Role: LEADER
I20260709 13:10:16.930889 24743 consensus_queue.cc:260] T 23eeb369895744038073e959747f6f13 P 92512576e6bc4561830a180ea4737d86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:16.932085 24743 raft_consensus.cc:3060] T 23eeb369895744038073e959747f6f13 P 92512576e6bc4561830a180ea4737d86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:16.935721 24820 raft_consensus.cc:2468] T 23eeb369895744038073e959747f6f13 P 41f9a4e2214e4382bb2fad82711a2472 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0788fe60e4d4891b51e6f092e50bb10 in term 3.
I20260709 13:10:16.936920 24857 leader_election.cc:304] T 23eeb369895744038073e959747f6f13 P f0788fe60e4d4891b51e6f092e50bb10 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41f9a4e2214e4382bb2fad82711a2472, f0788fe60e4d4891b51e6f092e50bb10; no voters: 
I20260709 13:10:16.937695 24970 raft_consensus.cc:2804] T 23eeb369895744038073e959747f6f13 P f0788fe60e4d4891b51e6f092e50bb10 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:16.938190 24970 raft_consensus.cc:697] T 23eeb369895744038073e959747f6f13 P f0788fe60e4d4891b51e6f092e50bb10 [term 3 LEADER]: Becoming Leader. State: Replica: f0788fe60e4d4891b51e6f092e50bb10, State: Running, Role: LEADER
I20260709 13:10:16.938725 24743 raft_consensus.cc:2468] T 23eeb369895744038073e959747f6f13 P 92512576e6bc4561830a180ea4737d86 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0788fe60e4d4891b51e6f092e50bb10 in term 3.
I20260709 13:10:16.938984 24970 consensus_queue.cc:237] T 23eeb369895744038073e959747f6f13 P f0788fe60e4d4891b51e6f092e50bb10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:16.947336 24642 catalog_manager.cc:5697] T 23eeb369895744038073e959747f6f13 P f0788fe60e4d4891b51e6f092e50bb10 reported cstate change: term changed from 2 to 3, leader changed from 92512576e6bc4561830a180ea4737d86 (127.23.140.65) to f0788fe60e4d4891b51e6f092e50bb10 (127.23.140.67). New cstate: current_term: 3 leader_uuid: "f0788fe60e4d4891b51e6f092e50bb10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:17.141883 24743 raft_consensus.cc:1275] T fdad60a3620c40daa67e9436d4d5d174 P 92512576e6bc4561830a180ea4737d86 [term 2 FOLLOWER]: Refusing update from remote peer f0788fe60e4d4891b51e6f092e50bb10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:17.143139 24970 consensus_queue.cc:1048] T fdad60a3620c40daa67e9436d4d5d174 P f0788fe60e4d4891b51e6f092e50bb10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:17.151800 24820 raft_consensus.cc:1275] T fdad60a3620c40daa67e9436d4d5d174 P 41f9a4e2214e4382bb2fad82711a2472 [term 2 FOLLOWER]: Refusing update from remote peer f0788fe60e4d4891b51e6f092e50bb10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:17.153319 24970 consensus_queue.cc:1048] T fdad60a3620c40daa67e9436d4d5d174 P f0788fe60e4d4891b51e6f092e50bb10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:17.366961 24743 raft_consensus.cc:1275] T 23eeb369895744038073e959747f6f13 P 92512576e6bc4561830a180ea4737d86 [term 3 FOLLOWER]: Refusing update from remote peer f0788fe60e4d4891b51e6f092e50bb10: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:17.368230 24970 consensus_queue.cc:1048] T 23eeb369895744038073e959747f6f13 P f0788fe60e4d4891b51e6f092e50bb10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:17.378461 24820 raft_consensus.cc:1275] T 23eeb369895744038073e959747f6f13 P 41f9a4e2214e4382bb2fad82711a2472 [term 3 FOLLOWER]: Refusing update from remote peer f0788fe60e4d4891b51e6f092e50bb10: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:17.380278 24970 consensus_queue.cc:1048] T 23eeb369895744038073e959747f6f13 P f0788fe60e4d4891b51e6f092e50bb10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:17.518401 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:17.528916 24894 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23eeb369895744038073e959747f6f13"
dest_uuid: "f0788fe60e4d4891b51e6f092e50bb10"
mode: GRACEFUL
new_leader_uuid: "92512576e6bc4561830a180ea4737d86"
 from {username='slave'} at 127.0.0.1:42780
I20260709 13:10:17.529477 24894 raft_consensus.cc:606] T 23eeb369895744038073e959747f6f13 P f0788fe60e4d4891b51e6f092e50bb10 [term 3 LEADER]: Received request to transfer leadership to TS 92512576e6bc4561830a180ea4737d86
I20260709 13:10:17.534246 24894 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fdad60a3620c40daa67e9436d4d5d174"
dest_uuid: "f0788fe60e4d4891b51e6f092e50bb10"
mode: GRACEFUL
new_leader_uuid: "92512576e6bc4561830a180ea4737d86"
 from {username='slave'} at 127.0.0.1:42780
I20260709 13:10:17.534727 24894 raft_consensus.cc:606] T fdad60a3620c40daa67e9436d4d5d174 P f0788fe60e4d4891b51e6f092e50bb10 [term 2 LEADER]: Received request to transfer leadership to TS 92512576e6bc4561830a180ea4737d86
I20260709 13:10:17.546958 24820 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a354f2f44e1c42e7a605864651a66beb"
dest_uuid: "41f9a4e2214e4382bb2fad82711a2472"
mode: GRACEFUL
new_leader_uuid: "92512576e6bc4561830a180ea4737d86"
 from {username='slave'} at 127.0.0.1:41260
I20260709 13:10:17.547438 24820 raft_consensus.cc:606] T a354f2f44e1c42e7a605864651a66beb P 41f9a4e2214e4382bb2fad82711a2472 [term 1 LEADER]: Received request to transfer leadership to TS 92512576e6bc4561830a180ea4737d86
I20260709 13:10:17.551971 24820 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e8dbf03cb5e4334a7231c02b4f45bee"
dest_uuid: "41f9a4e2214e4382bb2fad82711a2472"
mode: GRACEFUL
new_leader_uuid: "92512576e6bc4561830a180ea4737d86"
 from {username='slave'} at 127.0.0.1:41260
I20260709 13:10:17.552436 24820 raft_consensus.cc:606] T 3e8dbf03cb5e4334a7231c02b4f45bee P 41f9a4e2214e4382bb2fad82711a2472 [term 2 LEADER]: Received request to transfer leadership to TS 92512576e6bc4561830a180ea4737d86
I20260709 13:10:17.557528 24820 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7ad37a53739d49499dc91aa56c61feb5"
dest_uuid: "41f9a4e2214e4382bb2fad82711a2472"
mode: GRACEFUL
new_leader_uuid: "92512576e6bc4561830a180ea4737d86"
 from {username='slave'} at 127.0.0.1:41260
I20260709 13:10:17.557993 24820 raft_consensus.cc:606] T 7ad37a53739d49499dc91aa56c61feb5 P 41f9a4e2214e4382bb2fad82711a2472 [term 1 LEADER]: Received request to transfer leadership to TS 92512576e6bc4561830a180ea4737d86
I20260709 13:10:17.656400 25052 raft_consensus.cc:993] T fdad60a3620c40daa67e9436d4d5d174 P f0788fe60e4d4891b51e6f092e50bb10: : Instructing follower 92512576e6bc4561830a180ea4737d86 to start an election
I20260709 13:10:17.656857 24970 raft_consensus.cc:1081] T fdad60a3620c40daa67e9436d4d5d174 P f0788fe60e4d4891b51e6f092e50bb10 [term 2 LEADER]: Signalling peer 92512576e6bc4561830a180ea4737d86 to start an election
I20260709 13:10:17.658291 24744 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fdad60a3620c40daa67e9436d4d5d174"
dest_uuid: "92512576e6bc4561830a180ea4737d86"
 from {username='slave'} at 127.0.0.1:49422
I20260709 13:10:17.658763 24744 raft_consensus.cc:493] T fdad60a3620c40daa67e9436d4d5d174 P 92512576e6bc4561830a180ea4737d86 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:17.659057 24744 raft_consensus.cc:3060] T fdad60a3620c40daa67e9436d4d5d174 P 92512576e6bc4561830a180ea4737d86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:17.663304 24744 raft_consensus.cc:515] T fdad60a3620c40daa67e9436d4d5d174 P 92512576e6bc4561830a180ea4737d86 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:17.664748 24744 leader_election.cc:290] T fdad60a3620c40daa67e9436d4d5d174 P 92512576e6bc4561830a180ea4737d86 [CANDIDATE]: Term 3 election: Requested vote from peers 41f9a4e2214e4382bb2fad82711a2472 (127.23.140.66:42587), f0788fe60e4d4891b51e6f092e50bb10 (127.23.140.67:43673)
I20260709 13:10:17.665531 24820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdad60a3620c40daa67e9436d4d5d174" candidate_uuid: "92512576e6bc4561830a180ea4737d86" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "41f9a4e2214e4382bb2fad82711a2472"
I20260709 13:10:17.665721 24894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdad60a3620c40daa67e9436d4d5d174" candidate_uuid: "92512576e6bc4561830a180ea4737d86" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f0788fe60e4d4891b51e6f092e50bb10"
I20260709 13:10:17.666117 24820 raft_consensus.cc:3060] T fdad60a3620c40daa67e9436d4d5d174 P 41f9a4e2214e4382bb2fad82711a2472 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:17.666285 24894 raft_consensus.cc:3055] T fdad60a3620c40daa67e9436d4d5d174 P f0788fe60e4d4891b51e6f092e50bb10 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:17.666643 24894 raft_consensus.cc:740] T fdad60a3620c40daa67e9436d4d5d174 P f0788fe60e4d4891b51e6f092e50bb10 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f0788fe60e4d4891b51e6f092e50bb10, State: Running, Role: LEADER
I20260709 13:10:17.667258 24894 consensus_queue.cc:260] T fdad60a3620c40daa67e9436d4d5d174 P f0788fe60e4d4891b51e6f092e50bb10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:17.668103 24894 raft_consensus.cc:3060] T fdad60a3620c40daa67e9436d4d5d174 P f0788fe60e4d4891b51e6f092e50bb10 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:17.670301 24820 raft_consensus.cc:2468] T fdad60a3620c40daa67e9436d4d5d174 P 41f9a4e2214e4382bb2fad82711a2472 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92512576e6bc4561830a180ea4737d86 in term 3.
I20260709 13:10:17.671141 24708 leader_election.cc:304] T fdad60a3620c40daa67e9436d4d5d174 P 92512576e6bc4561830a180ea4737d86 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41f9a4e2214e4382bb2fad82711a2472, 92512576e6bc4561830a180ea4737d86; no voters: 
I20260709 13:10:17.671841 25038 raft_consensus.cc:2804] T fdad60a3620c40daa67e9436d4d5d174 P 92512576e6bc4561830a180ea4737d86 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:17.672755 24894 raft_consensus.cc:2468] T fdad60a3620c40daa67e9436d4d5d174 P f0788fe60e4d4891b51e6f092e50bb10 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92512576e6bc4561830a180ea4737d86 in term 3.
I20260709 13:10:17.672881 25038 raft_consensus.cc:697] T fdad60a3620c40daa67e9436d4d5d174 P 92512576e6bc4561830a180ea4737d86 [term 3 LEADER]: Becoming Leader. State: Replica: 92512576e6bc4561830a180ea4737d86, State: Running, Role: LEADER
I20260709 13:10:17.673847 25038 consensus_queue.cc:237] T fdad60a3620c40daa67e9436d4d5d174 P 92512576e6bc4561830a180ea4737d86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:17.679560 24642 catalog_manager.cc:5697] T fdad60a3620c40daa67e9436d4d5d174 P 92512576e6bc4561830a180ea4737d86 reported cstate change: term changed from 2 to 3, leader changed from f0788fe60e4d4891b51e6f092e50bb10 (127.23.140.67) to 92512576e6bc4561830a180ea4737d86 (127.23.140.65). New cstate: current_term: 3 leader_uuid: "92512576e6bc4561830a180ea4737d86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:17.838492 24958 raft_consensus.cc:993] T a354f2f44e1c42e7a605864651a66beb P 41f9a4e2214e4382bb2fad82711a2472: : Instructing follower 92512576e6bc4561830a180ea4737d86 to start an election
I20260709 13:10:17.839102 25058 raft_consensus.cc:1081] T a354f2f44e1c42e7a605864651a66beb P 41f9a4e2214e4382bb2fad82711a2472 [term 1 LEADER]: Signalling peer 92512576e6bc4561830a180ea4737d86 to start an election
I20260709 13:10:17.840705 24744 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a354f2f44e1c42e7a605864651a66beb"
dest_uuid: "92512576e6bc4561830a180ea4737d86"
 from {username='slave'} at 127.0.0.1:49432
I20260709 13:10:17.841264 24744 raft_consensus.cc:493] T a354f2f44e1c42e7a605864651a66beb P 92512576e6bc4561830a180ea4737d86 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:17.841652 24744 raft_consensus.cc:3060] T a354f2f44e1c42e7a605864651a66beb P 92512576e6bc4561830a180ea4737d86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:17.848742 24744 raft_consensus.cc:515] T a354f2f44e1c42e7a605864651a66beb P 92512576e6bc4561830a180ea4737d86 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:17.851449 24820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a354f2f44e1c42e7a605864651a66beb" candidate_uuid: "92512576e6bc4561830a180ea4737d86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "41f9a4e2214e4382bb2fad82711a2472"
I20260709 13:10:17.851972 24820 raft_consensus.cc:3055] T a354f2f44e1c42e7a605864651a66beb P 41f9a4e2214e4382bb2fad82711a2472 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:17.852115 24744 leader_election.cc:290] T a354f2f44e1c42e7a605864651a66beb P 92512576e6bc4561830a180ea4737d86 [CANDIDATE]: Term 2 election: Requested vote from peers 41f9a4e2214e4382bb2fad82711a2472 (127.23.140.66:42587), f0788fe60e4d4891b51e6f092e50bb10 (127.23.140.67:43673)
I20260709 13:10:17.852301 24820 raft_consensus.cc:740] T a354f2f44e1c42e7a605864651a66beb P 41f9a4e2214e4382bb2fad82711a2472 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 41f9a4e2214e4382bb2fad82711a2472, State: Running, Role: LEADER
I20260709 13:10:17.853190 24820 consensus_queue.cc:260] T a354f2f44e1c42e7a605864651a66beb P 41f9a4e2214e4382bb2fad82711a2472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:17.854283 24820 raft_consensus.cc:3060] T a354f2f44e1c42e7a605864651a66beb P 41f9a4e2214e4382bb2fad82711a2472 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:17.854720 24958 raft_consensus.cc:993] T 3e8dbf03cb5e4334a7231c02b4f45bee P 41f9a4e2214e4382bb2fad82711a2472: : Instructing follower 92512576e6bc4561830a180ea4737d86 to start an election
I20260709 13:10:17.855149 25058 raft_consensus.cc:1081] T 3e8dbf03cb5e4334a7231c02b4f45bee P 41f9a4e2214e4382bb2fad82711a2472 [term 2 LEADER]: Signalling peer 92512576e6bc4561830a180ea4737d86 to start an election
I20260709 13:10:17.856931 24744 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3e8dbf03cb5e4334a7231c02b4f45bee"
dest_uuid: "92512576e6bc4561830a180ea4737d86"
 from {username='slave'} at 127.0.0.1:49432
I20260709 13:10:17.857442 24744 raft_consensus.cc:493] T 3e8dbf03cb5e4334a7231c02b4f45bee P 92512576e6bc4561830a180ea4737d86 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:17.857803 24744 raft_consensus.cc:3060] T 3e8dbf03cb5e4334a7231c02b4f45bee P 92512576e6bc4561830a180ea4737d86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:17.853127 24894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a354f2f44e1c42e7a605864651a66beb" candidate_uuid: "92512576e6bc4561830a180ea4737d86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0788fe60e4d4891b51e6f092e50bb10"
I20260709 13:10:17.859517 24894 raft_consensus.cc:3060] T a354f2f44e1c42e7a605864651a66beb P f0788fe60e4d4891b51e6f092e50bb10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:17.864935 24744 raft_consensus.cc:515] T 3e8dbf03cb5e4334a7231c02b4f45bee P 92512576e6bc4561830a180ea4737d86 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:17.866070 24894 raft_consensus.cc:2468] T a354f2f44e1c42e7a605864651a66beb P f0788fe60e4d4891b51e6f092e50bb10 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92512576e6bc4561830a180ea4737d86 in term 2.
I20260709 13:10:17.867108 24744 leader_election.cc:290] T 3e8dbf03cb5e4334a7231c02b4f45bee P 92512576e6bc4561830a180ea4737d86 [CANDIDATE]: Term 3 election: Requested vote from peers 41f9a4e2214e4382bb2fad82711a2472 (127.23.140.66:42587), f0788fe60e4d4891b51e6f092e50bb10 (127.23.140.67:43673)
I20260709 13:10:17.867261 24709 leader_election.cc:304] T a354f2f44e1c42e7a605864651a66beb P 92512576e6bc4561830a180ea4737d86 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92512576e6bc4561830a180ea4737d86, f0788fe60e4d4891b51e6f092e50bb10; no voters: 
I20260709 13:10:17.868455 25038 raft_consensus.cc:2804] T a354f2f44e1c42e7a605864651a66beb P 92512576e6bc4561830a180ea4737d86 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:17.868942 25038 raft_consensus.cc:697] T a354f2f44e1c42e7a605864651a66beb P 92512576e6bc4561830a180ea4737d86 [term 2 LEADER]: Becoming Leader. State: Replica: 92512576e6bc4561830a180ea4737d86, State: Running, Role: LEADER
I20260709 13:10:17.868993 24892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8dbf03cb5e4334a7231c02b4f45bee" candidate_uuid: "92512576e6bc4561830a180ea4737d86" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f0788fe60e4d4891b51e6f092e50bb10"
I20260709 13:10:17.869807 24892 raft_consensus.cc:3060] T 3e8dbf03cb5e4334a7231c02b4f45bee P f0788fe60e4d4891b51e6f092e50bb10 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:17.869818 25038 consensus_queue.cc:237] T a354f2f44e1c42e7a605864651a66beb P 92512576e6bc4561830a180ea4737d86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:17.870568 24818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8dbf03cb5e4334a7231c02b4f45bee" candidate_uuid: "92512576e6bc4561830a180ea4737d86" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "41f9a4e2214e4382bb2fad82711a2472"
I20260709 13:10:17.871076 24818 raft_consensus.cc:3055] T 3e8dbf03cb5e4334a7231c02b4f45bee P 41f9a4e2214e4382bb2fad82711a2472 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:17.871373 24818 raft_consensus.cc:740] T 3e8dbf03cb5e4334a7231c02b4f45bee P 41f9a4e2214e4382bb2fad82711a2472 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 41f9a4e2214e4382bb2fad82711a2472, State: Running, Role: LEADER
I20260709 13:10:17.872151 24818 consensus_queue.cc:260] T 3e8dbf03cb5e4334a7231c02b4f45bee P 41f9a4e2214e4382bb2fad82711a2472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:17.873418 24818 raft_consensus.cc:3060] T 3e8dbf03cb5e4334a7231c02b4f45bee P 41f9a4e2214e4382bb2fad82711a2472 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:17.876806 24892 raft_consensus.cc:2468] T 3e8dbf03cb5e4334a7231c02b4f45bee P f0788fe60e4d4891b51e6f092e50bb10 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92512576e6bc4561830a180ea4737d86 in term 3.
I20260709 13:10:17.878118 24709 leader_election.cc:304] T 3e8dbf03cb5e4334a7231c02b4f45bee P 92512576e6bc4561830a180ea4737d86 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92512576e6bc4561830a180ea4737d86, f0788fe60e4d4891b51e6f092e50bb10; no voters: 
I20260709 13:10:17.879004 25038 raft_consensus.cc:2804] T 3e8dbf03cb5e4334a7231c02b4f45bee P 92512576e6bc4561830a180ea4737d86 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:17.879009 24642 catalog_manager.cc:5697] T a354f2f44e1c42e7a605864651a66beb P 92512576e6bc4561830a180ea4737d86 reported cstate change: term changed from 1 to 2, leader changed from 41f9a4e2214e4382bb2fad82711a2472 (127.23.140.66) to 92512576e6bc4561830a180ea4737d86 (127.23.140.65). New cstate: current_term: 2 leader_uuid: "92512576e6bc4561830a180ea4737d86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:17.879671 25038 raft_consensus.cc:697] T 3e8dbf03cb5e4334a7231c02b4f45bee P 92512576e6bc4561830a180ea4737d86 [term 3 LEADER]: Becoming Leader. State: Replica: 92512576e6bc4561830a180ea4737d86, State: Running, Role: LEADER
I20260709 13:10:17.880041 24818 raft_consensus.cc:2468] T 3e8dbf03cb5e4334a7231c02b4f45bee P 41f9a4e2214e4382bb2fad82711a2472 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92512576e6bc4561830a180ea4737d86 in term 3.
I20260709 13:10:17.880712 25038 consensus_queue.cc:237] T 3e8dbf03cb5e4334a7231c02b4f45bee P 92512576e6bc4561830a180ea4737d86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:17.884977 24820 raft_consensus.cc:2468] T a354f2f44e1c42e7a605864651a66beb P 41f9a4e2214e4382bb2fad82711a2472 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92512576e6bc4561830a180ea4737d86 in term 2.
I20260709 13:10:17.891175 24642 catalog_manager.cc:5697] T 3e8dbf03cb5e4334a7231c02b4f45bee P 92512576e6bc4561830a180ea4737d86 reported cstate change: term changed from 2 to 3, leader changed from 41f9a4e2214e4382bb2fad82711a2472 (127.23.140.66) to 92512576e6bc4561830a180ea4737d86 (127.23.140.65). New cstate: current_term: 3 leader_uuid: "92512576e6bc4561830a180ea4737d86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:17.942098 25052 raft_consensus.cc:993] T 23eeb369895744038073e959747f6f13 P f0788fe60e4d4891b51e6f092e50bb10: : Instructing follower 92512576e6bc4561830a180ea4737d86 to start an election
I20260709 13:10:17.942509 24970 raft_consensus.cc:1081] T 23eeb369895744038073e959747f6f13 P f0788fe60e4d4891b51e6f092e50bb10 [term 3 LEADER]: Signalling peer 92512576e6bc4561830a180ea4737d86 to start an election
I20260709 13:10:17.943847 24744 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "23eeb369895744038073e959747f6f13"
dest_uuid: "92512576e6bc4561830a180ea4737d86"
 from {username='slave'} at 127.0.0.1:49422
I20260709 13:10:17.944322 24744 raft_consensus.cc:493] T 23eeb369895744038073e959747f6f13 P 92512576e6bc4561830a180ea4737d86 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:17.944609 24744 raft_consensus.cc:3060] T 23eeb369895744038073e959747f6f13 P 92512576e6bc4561830a180ea4737d86 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:17.949003 24744 raft_consensus.cc:515] T 23eeb369895744038073e959747f6f13 P 92512576e6bc4561830a180ea4737d86 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:17.950656 24744 leader_election.cc:290] T 23eeb369895744038073e959747f6f13 P 92512576e6bc4561830a180ea4737d86 [CANDIDATE]: Term 4 election: Requested vote from peers 41f9a4e2214e4382bb2fad82711a2472 (127.23.140.66:42587), f0788fe60e4d4891b51e6f092e50bb10 (127.23.140.67:43673)
I20260709 13:10:17.951400 24820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eeb369895744038073e959747f6f13" candidate_uuid: "92512576e6bc4561830a180ea4737d86" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "41f9a4e2214e4382bb2fad82711a2472"
I20260709 13:10:17.951678 24894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eeb369895744038073e959747f6f13" candidate_uuid: "92512576e6bc4561830a180ea4737d86" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f0788fe60e4d4891b51e6f092e50bb10"
I20260709 13:10:17.951879 24820 raft_consensus.cc:3060] T 23eeb369895744038073e959747f6f13 P 41f9a4e2214e4382bb2fad82711a2472 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:17.952207 24894 raft_consensus.cc:3055] T 23eeb369895744038073e959747f6f13 P f0788fe60e4d4891b51e6f092e50bb10 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:17.952488 24894 raft_consensus.cc:740] T 23eeb369895744038073e959747f6f13 P f0788fe60e4d4891b51e6f092e50bb10 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f0788fe60e4d4891b51e6f092e50bb10, State: Running, Role: LEADER
I20260709 13:10:17.953087 24894 consensus_queue.cc:260] T 23eeb369895744038073e959747f6f13 P f0788fe60e4d4891b51e6f092e50bb10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:17.954006 24894 raft_consensus.cc:3060] T 23eeb369895744038073e959747f6f13 P f0788fe60e4d4891b51e6f092e50bb10 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:17.956248 24820 raft_consensus.cc:2468] T 23eeb369895744038073e959747f6f13 P 41f9a4e2214e4382bb2fad82711a2472 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92512576e6bc4561830a180ea4737d86 in term 4.
I20260709 13:10:17.957221 24708 leader_election.cc:304] T 23eeb369895744038073e959747f6f13 P 92512576e6bc4561830a180ea4737d86 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41f9a4e2214e4382bb2fad82711a2472, 92512576e6bc4561830a180ea4737d86; no voters: 
I20260709 13:10:17.957907 25038 raft_consensus.cc:2804] T 23eeb369895744038073e959747f6f13 P 92512576e6bc4561830a180ea4737d86 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:17.958380 25038 raft_consensus.cc:697] T 23eeb369895744038073e959747f6f13 P 92512576e6bc4561830a180ea4737d86 [term 4 LEADER]: Becoming Leader. State: Replica: 92512576e6bc4561830a180ea4737d86, State: Running, Role: LEADER
I20260709 13:10:17.958909 24894 raft_consensus.cc:2468] T 23eeb369895744038073e959747f6f13 P f0788fe60e4d4891b51e6f092e50bb10 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92512576e6bc4561830a180ea4737d86 in term 4.
I20260709 13:10:17.959218 25038 consensus_queue.cc:237] T 23eeb369895744038073e959747f6f13 P 92512576e6bc4561830a180ea4737d86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:17.964712 24642 catalog_manager.cc:5697] T 23eeb369895744038073e959747f6f13 P 92512576e6bc4561830a180ea4737d86 reported cstate change: term changed from 3 to 4, leader changed from f0788fe60e4d4891b51e6f092e50bb10 (127.23.140.67) to 92512576e6bc4561830a180ea4737d86 (127.23.140.65). New cstate: current_term: 4 leader_uuid: "92512576e6bc4561830a180ea4737d86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:18.091910 24958 raft_consensus.cc:993] T 7ad37a53739d49499dc91aa56c61feb5 P 41f9a4e2214e4382bb2fad82711a2472: : Instructing follower 92512576e6bc4561830a180ea4737d86 to start an election
I20260709 13:10:18.092335 25058 raft_consensus.cc:1081] T 7ad37a53739d49499dc91aa56c61feb5 P 41f9a4e2214e4382bb2fad82711a2472 [term 1 LEADER]: Signalling peer 92512576e6bc4561830a180ea4737d86 to start an election
I20260709 13:10:18.093581 24744 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7ad37a53739d49499dc91aa56c61feb5"
dest_uuid: "92512576e6bc4561830a180ea4737d86"
 from {username='slave'} at 127.0.0.1:49432
I20260709 13:10:18.094120 24744 raft_consensus.cc:493] T 7ad37a53739d49499dc91aa56c61feb5 P 92512576e6bc4561830a180ea4737d86 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:18.094419 24744 raft_consensus.cc:3060] T 7ad37a53739d49499dc91aa56c61feb5 P 92512576e6bc4561830a180ea4737d86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:18.098755 24744 raft_consensus.cc:515] T 7ad37a53739d49499dc91aa56c61feb5 P 92512576e6bc4561830a180ea4737d86 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:18.100288 24744 leader_election.cc:290] T 7ad37a53739d49499dc91aa56c61feb5 P 92512576e6bc4561830a180ea4737d86 [CANDIDATE]: Term 2 election: Requested vote from peers 41f9a4e2214e4382bb2fad82711a2472 (127.23.140.66:42587), f0788fe60e4d4891b51e6f092e50bb10 (127.23.140.67:43673)
I20260709 13:10:18.100963 24820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ad37a53739d49499dc91aa56c61feb5" candidate_uuid: "92512576e6bc4561830a180ea4737d86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "41f9a4e2214e4382bb2fad82711a2472"
I20260709 13:10:18.101317 24894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ad37a53739d49499dc91aa56c61feb5" candidate_uuid: "92512576e6bc4561830a180ea4737d86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0788fe60e4d4891b51e6f092e50bb10"
I20260709 13:10:18.101500 24820 raft_consensus.cc:3055] T 7ad37a53739d49499dc91aa56c61feb5 P 41f9a4e2214e4382bb2fad82711a2472 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:18.101867 24820 raft_consensus.cc:740] T 7ad37a53739d49499dc91aa56c61feb5 P 41f9a4e2214e4382bb2fad82711a2472 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 41f9a4e2214e4382bb2fad82711a2472, State: Running, Role: LEADER
I20260709 13:10:18.101887 24894 raft_consensus.cc:3060] T 7ad37a53739d49499dc91aa56c61feb5 P f0788fe60e4d4891b51e6f092e50bb10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:18.102512 24820 consensus_queue.cc:260] T 7ad37a53739d49499dc91aa56c61feb5 P 41f9a4e2214e4382bb2fad82711a2472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:18.103309 24820 raft_consensus.cc:3060] T 7ad37a53739d49499dc91aa56c61feb5 P 41f9a4e2214e4382bb2fad82711a2472 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:18.106540 24894 raft_consensus.cc:2468] T 7ad37a53739d49499dc91aa56c61feb5 P f0788fe60e4d4891b51e6f092e50bb10 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92512576e6bc4561830a180ea4737d86 in term 2.
I20260709 13:10:18.107250 24820 raft_consensus.cc:2468] T 7ad37a53739d49499dc91aa56c61feb5 P 41f9a4e2214e4382bb2fad82711a2472 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92512576e6bc4561830a180ea4737d86 in term 2.
I20260709 13:10:18.107532 24709 leader_election.cc:304] T 7ad37a53739d49499dc91aa56c61feb5 P 92512576e6bc4561830a180ea4737d86 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92512576e6bc4561830a180ea4737d86, f0788fe60e4d4891b51e6f092e50bb10; no voters: 
I20260709 13:10:18.108309 25038 raft_consensus.cc:2804] T 7ad37a53739d49499dc91aa56c61feb5 P 92512576e6bc4561830a180ea4737d86 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:18.108768 25038 raft_consensus.cc:697] T 7ad37a53739d49499dc91aa56c61feb5 P 92512576e6bc4561830a180ea4737d86 [term 2 LEADER]: Becoming Leader. State: Replica: 92512576e6bc4561830a180ea4737d86, State: Running, Role: LEADER
I20260709 13:10:18.109475 25038 consensus_queue.cc:237] T 7ad37a53739d49499dc91aa56c61feb5 P 92512576e6bc4561830a180ea4737d86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:18.115321 24642 catalog_manager.cc:5697] T 7ad37a53739d49499dc91aa56c61feb5 P 92512576e6bc4561830a180ea4737d86 reported cstate change: term changed from 1 to 2, leader changed from 41f9a4e2214e4382bb2fad82711a2472 (127.23.140.66) to 92512576e6bc4561830a180ea4737d86 (127.23.140.65). New cstate: current_term: 2 leader_uuid: "92512576e6bc4561830a180ea4737d86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:18.170531 24820 raft_consensus.cc:1275] T fdad60a3620c40daa67e9436d4d5d174 P 41f9a4e2214e4382bb2fad82711a2472 [term 3 FOLLOWER]: Refusing update from remote peer 92512576e6bc4561830a180ea4737d86: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:18.171635 25038 consensus_queue.cc:1048] T fdad60a3620c40daa67e9436d4d5d174 P 92512576e6bc4561830a180ea4737d86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:18.179970 24894 raft_consensus.cc:1275] T fdad60a3620c40daa67e9436d4d5d174 P f0788fe60e4d4891b51e6f092e50bb10 [term 3 FOLLOWER]: Refusing update from remote peer 92512576e6bc4561830a180ea4737d86: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:18.181331 25038 consensus_queue.cc:1048] T fdad60a3620c40daa67e9436d4d5d174 P 92512576e6bc4561830a180ea4737d86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:18.434172 24894 raft_consensus.cc:1275] T a354f2f44e1c42e7a605864651a66beb P f0788fe60e4d4891b51e6f092e50bb10 [term 2 FOLLOWER]: Refusing update from remote peer 92512576e6bc4561830a180ea4737d86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:18.435298 25038 consensus_queue.cc:1048] T a354f2f44e1c42e7a605864651a66beb P 92512576e6bc4561830a180ea4737d86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:18.436607 24894 raft_consensus.cc:1275] T 3e8dbf03cb5e4334a7231c02b4f45bee P f0788fe60e4d4891b51e6f092e50bb10 [term 3 FOLLOWER]: Refusing update from remote peer 92512576e6bc4561830a180ea4737d86: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:18.437671 25038 consensus_queue.cc:1048] T 3e8dbf03cb5e4334a7231c02b4f45bee P 92512576e6bc4561830a180ea4737d86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:18.447477 24820 raft_consensus.cc:1275] T a354f2f44e1c42e7a605864651a66beb P 41f9a4e2214e4382bb2fad82711a2472 [term 2 FOLLOWER]: Refusing update from remote peer 92512576e6bc4561830a180ea4737d86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:18.449698 25064 consensus_queue.cc:1048] T a354f2f44e1c42e7a605864651a66beb P 92512576e6bc4561830a180ea4737d86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:18.454869 24820 raft_consensus.cc:1275] T 3e8dbf03cb5e4334a7231c02b4f45bee P 41f9a4e2214e4382bb2fad82711a2472 [term 3 FOLLOWER]: Refusing update from remote peer 92512576e6bc4561830a180ea4737d86: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:18.456248 25064 consensus_queue.cc:1048] T 3e8dbf03cb5e4334a7231c02b4f45bee P 92512576e6bc4561830a180ea4737d86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:18.465932 24818 raft_consensus.cc:1275] T 23eeb369895744038073e959747f6f13 P 41f9a4e2214e4382bb2fad82711a2472 [term 4 FOLLOWER]: Refusing update from remote peer 92512576e6bc4561830a180ea4737d86: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:18.467175 25064 consensus_queue.cc:1048] T 23eeb369895744038073e959747f6f13 P 92512576e6bc4561830a180ea4737d86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:18.476780 24894 raft_consensus.cc:1275] T 23eeb369895744038073e959747f6f13 P f0788fe60e4d4891b51e6f092e50bb10 [term 4 FOLLOWER]: Refusing update from remote peer 92512576e6bc4561830a180ea4737d86: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:18.478236 25070 consensus_queue.cc:1048] T 23eeb369895744038073e959747f6f13 P 92512576e6bc4561830a180ea4737d86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:18.539996 24818 raft_consensus.cc:1275] T 7ad37a53739d49499dc91aa56c61feb5 P 41f9a4e2214e4382bb2fad82711a2472 [term 2 FOLLOWER]: Refusing update from remote peer 92512576e6bc4561830a180ea4737d86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:18.541551 25070 consensus_queue.cc:1048] T 7ad37a53739d49499dc91aa56c61feb5 P 92512576e6bc4561830a180ea4737d86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:18.542824 24894 raft_consensus.cc:1275] T 7ad37a53739d49499dc91aa56c61feb5 P f0788fe60e4d4891b51e6f092e50bb10 [term 2 FOLLOWER]: Refusing update from remote peer 92512576e6bc4561830a180ea4737d86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:18.544041 25070 consensus_queue.cc:1048] T 7ad37a53739d49499dc91aa56c61feb5 P 92512576e6bc4561830a180ea4737d86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:20.565623 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:20.575381 24744 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e8dbf03cb5e4334a7231c02b4f45bee"
dest_uuid: "92512576e6bc4561830a180ea4737d86"
mode: GRACEFUL
new_leader_uuid: "41f9a4e2214e4382bb2fad82711a2472"
 from {username='slave'} at 127.0.0.1:49442
I20260709 13:10:20.576004 24744 raft_consensus.cc:606] T 3e8dbf03cb5e4334a7231c02b4f45bee P 92512576e6bc4561830a180ea4737d86 [term 3 LEADER]: Received request to transfer leadership to TS 41f9a4e2214e4382bb2fad82711a2472
I20260709 13:10:20.578331 24744 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ab8d9cd192348f09921ada29f04e55d"
dest_uuid: "92512576e6bc4561830a180ea4737d86"
mode: GRACEFUL
new_leader_uuid: "41f9a4e2214e4382bb2fad82711a2472"
 from {username='slave'} at 127.0.0.1:49442
I20260709 13:10:20.578713 24744 raft_consensus.cc:606] T 8ab8d9cd192348f09921ada29f04e55d P 92512576e6bc4561830a180ea4737d86 [term 2 LEADER]: Received request to transfer leadership to TS 41f9a4e2214e4382bb2fad82711a2472
I20260709 13:10:20.580623 24744 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a354f2f44e1c42e7a605864651a66beb"
dest_uuid: "92512576e6bc4561830a180ea4737d86"
mode: GRACEFUL
new_leader_uuid: "f0788fe60e4d4891b51e6f092e50bb10"
 from {username='slave'} at 127.0.0.1:49442
I20260709 13:10:20.580974 24744 raft_consensus.cc:606] T a354f2f44e1c42e7a605864651a66beb P 92512576e6bc4561830a180ea4737d86 [term 2 LEADER]: Received request to transfer leadership to TS f0788fe60e4d4891b51e6f092e50bb10
I20260709 13:10:20.582834 24744 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fdad60a3620c40daa67e9436d4d5d174"
dest_uuid: "92512576e6bc4561830a180ea4737d86"
mode: GRACEFUL
new_leader_uuid: "f0788fe60e4d4891b51e6f092e50bb10"
 from {username='slave'} at 127.0.0.1:49442
I20260709 13:10:20.583180 24744 raft_consensus.cc:606] T fdad60a3620c40daa67e9436d4d5d174 P 92512576e6bc4561830a180ea4737d86 [term 3 LEADER]: Received request to transfer leadership to TS f0788fe60e4d4891b51e6f092e50bb10
I20260709 13:10:20.584070 24113 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:10:20.584439 24113 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:20.643725 25064 raft_consensus.cc:993] T 8ab8d9cd192348f09921ada29f04e55d P 92512576e6bc4561830a180ea4737d86: : Instructing follower 41f9a4e2214e4382bb2fad82711a2472 to start an election
I20260709 13:10:20.644263 25071 raft_consensus.cc:1081] T 8ab8d9cd192348f09921ada29f04e55d P 92512576e6bc4561830a180ea4737d86 [term 2 LEADER]: Signalling peer 41f9a4e2214e4382bb2fad82711a2472 to start an election
I20260709 13:10:20.645903 24820 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8ab8d9cd192348f09921ada29f04e55d"
dest_uuid: "41f9a4e2214e4382bb2fad82711a2472"
 from {username='slave'} at 127.0.0.1:41246
I20260709 13:10:20.646492 24820 raft_consensus.cc:493] T 8ab8d9cd192348f09921ada29f04e55d P 41f9a4e2214e4382bb2fad82711a2472 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:20.646812 24820 raft_consensus.cc:3060] T 8ab8d9cd192348f09921ada29f04e55d P 41f9a4e2214e4382bb2fad82711a2472 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:20.651912 24820 raft_consensus.cc:515] T 8ab8d9cd192348f09921ada29f04e55d P 41f9a4e2214e4382bb2fad82711a2472 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:20.653620 24820 leader_election.cc:290] T 8ab8d9cd192348f09921ada29f04e55d P 41f9a4e2214e4382bb2fad82711a2472 [CANDIDATE]: Term 3 election: Requested vote from peers 92512576e6bc4561830a180ea4737d86 (127.23.140.65:41489), f0788fe60e4d4891b51e6f092e50bb10 (127.23.140.67:43673)
I20260709 13:10:20.654690 24744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab8d9cd192348f09921ada29f04e55d" candidate_uuid: "41f9a4e2214e4382bb2fad82711a2472" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "92512576e6bc4561830a180ea4737d86"
I20260709 13:10:20.655272 24894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab8d9cd192348f09921ada29f04e55d" candidate_uuid: "41f9a4e2214e4382bb2fad82711a2472" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f0788fe60e4d4891b51e6f092e50bb10"
I20260709 13:10:20.655503 24744 raft_consensus.cc:3055] T 8ab8d9cd192348f09921ada29f04e55d P 92512576e6bc4561830a180ea4737d86 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:20.655961 24894 raft_consensus.cc:3060] T 8ab8d9cd192348f09921ada29f04e55d P f0788fe60e4d4891b51e6f092e50bb10 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:20.655944 24744 raft_consensus.cc:740] T 8ab8d9cd192348f09921ada29f04e55d P 92512576e6bc4561830a180ea4737d86 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 92512576e6bc4561830a180ea4737d86, State: Running, Role: LEADER
I20260709 13:10:20.657285 24744 consensus_queue.cc:260] T 8ab8d9cd192348f09921ada29f04e55d P 92512576e6bc4561830a180ea4737d86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:20.658825 24744 raft_consensus.cc:3060] T 8ab8d9cd192348f09921ada29f04e55d P 92512576e6bc4561830a180ea4737d86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:20.663993 24894 raft_consensus.cc:2468] T 8ab8d9cd192348f09921ada29f04e55d P f0788fe60e4d4891b51e6f092e50bb10 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41f9a4e2214e4382bb2fad82711a2472 in term 3.
I20260709 13:10:20.665557 24784 leader_election.cc:304] T 8ab8d9cd192348f09921ada29f04e55d P 41f9a4e2214e4382bb2fad82711a2472 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41f9a4e2214e4382bb2fad82711a2472, f0788fe60e4d4891b51e6f092e50bb10; no voters: 
I20260709 13:10:20.666251 24744 raft_consensus.cc:2468] T 8ab8d9cd192348f09921ada29f04e55d P 92512576e6bc4561830a180ea4737d86 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41f9a4e2214e4382bb2fad82711a2472 in term 3.
I20260709 13:10:20.666838 25058 raft_consensus.cc:2804] T 8ab8d9cd192348f09921ada29f04e55d P 41f9a4e2214e4382bb2fad82711a2472 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:20.668118 25058 raft_consensus.cc:697] T 8ab8d9cd192348f09921ada29f04e55d P 41f9a4e2214e4382bb2fad82711a2472 [term 3 LEADER]: Becoming Leader. State: Replica: 41f9a4e2214e4382bb2fad82711a2472, State: Running, Role: LEADER
I20260709 13:10:20.669034 25064 raft_consensus.cc:993] T 3e8dbf03cb5e4334a7231c02b4f45bee P 92512576e6bc4561830a180ea4737d86: : Instructing follower 41f9a4e2214e4382bb2fad82711a2472 to start an election
I20260709 13:10:20.669117 25058 consensus_queue.cc:237] T 8ab8d9cd192348f09921ada29f04e55d P 41f9a4e2214e4382bb2fad82711a2472 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:20.669574 25071 raft_consensus.cc:1081] T 3e8dbf03cb5e4334a7231c02b4f45bee P 92512576e6bc4561830a180ea4737d86 [term 3 LEADER]: Signalling peer 41f9a4e2214e4382bb2fad82711a2472 to start an election
I20260709 13:10:20.671298 24820 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3e8dbf03cb5e4334a7231c02b4f45bee"
dest_uuid: "41f9a4e2214e4382bb2fad82711a2472"
 from {username='slave'} at 127.0.0.1:41246
I20260709 13:10:20.671849 24820 raft_consensus.cc:493] T 3e8dbf03cb5e4334a7231c02b4f45bee P 41f9a4e2214e4382bb2fad82711a2472 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:20.672261 24820 raft_consensus.cc:3060] T 3e8dbf03cb5e4334a7231c02b4f45bee P 41f9a4e2214e4382bb2fad82711a2472 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:20.677219 24640 catalog_manager.cc:5697] T 8ab8d9cd192348f09921ada29f04e55d P 41f9a4e2214e4382bb2fad82711a2472 reported cstate change: term changed from 2 to 3, leader changed from 92512576e6bc4561830a180ea4737d86 (127.23.140.65) to 41f9a4e2214e4382bb2fad82711a2472 (127.23.140.66). New cstate: current_term: 3 leader_uuid: "41f9a4e2214e4382bb2fad82711a2472" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:20.678409 24820 raft_consensus.cc:515] T 3e8dbf03cb5e4334a7231c02b4f45bee P 41f9a4e2214e4382bb2fad82711a2472 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:20.680370 24820 leader_election.cc:290] T 3e8dbf03cb5e4334a7231c02b4f45bee P 41f9a4e2214e4382bb2fad82711a2472 [CANDIDATE]: Term 4 election: Requested vote from peers 92512576e6bc4561830a180ea4737d86 (127.23.140.65:41489), f0788fe60e4d4891b51e6f092e50bb10 (127.23.140.67:43673)
I20260709 13:10:20.681099 24744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8dbf03cb5e4334a7231c02b4f45bee" candidate_uuid: "41f9a4e2214e4382bb2fad82711a2472" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "92512576e6bc4561830a180ea4737d86"
I20260709 13:10:20.681349 24894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8dbf03cb5e4334a7231c02b4f45bee" candidate_uuid: "41f9a4e2214e4382bb2fad82711a2472" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f0788fe60e4d4891b51e6f092e50bb10"
I20260709 13:10:20.681833 24894 raft_consensus.cc:3060] T 3e8dbf03cb5e4334a7231c02b4f45bee P f0788fe60e4d4891b51e6f092e50bb10 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:20.681681 24744 raft_consensus.cc:3055] T 3e8dbf03cb5e4334a7231c02b4f45bee P 92512576e6bc4561830a180ea4737d86 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:20.682550 24744 raft_consensus.cc:740] T 3e8dbf03cb5e4334a7231c02b4f45bee P 92512576e6bc4561830a180ea4737d86 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 92512576e6bc4561830a180ea4737d86, State: Running, Role: LEADER
I20260709 13:10:20.683331 24744 consensus_queue.cc:260] T 3e8dbf03cb5e4334a7231c02b4f45bee P 92512576e6bc4561830a180ea4737d86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:20.684536 24744 raft_consensus.cc:3060] T 3e8dbf03cb5e4334a7231c02b4f45bee P 92512576e6bc4561830a180ea4737d86 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:20.688549 24894 raft_consensus.cc:2468] T 3e8dbf03cb5e4334a7231c02b4f45bee P f0788fe60e4d4891b51e6f092e50bb10 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41f9a4e2214e4382bb2fad82711a2472 in term 4.
I20260709 13:10:20.689853 24784 leader_election.cc:304] T 3e8dbf03cb5e4334a7231c02b4f45bee P 41f9a4e2214e4382bb2fad82711a2472 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41f9a4e2214e4382bb2fad82711a2472, f0788fe60e4d4891b51e6f092e50bb10; no voters: 
I20260709 13:10:20.690686 25058 raft_consensus.cc:2804] T 3e8dbf03cb5e4334a7231c02b4f45bee P 41f9a4e2214e4382bb2fad82711a2472 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:20.690948 24744 raft_consensus.cc:2468] T 3e8dbf03cb5e4334a7231c02b4f45bee P 92512576e6bc4561830a180ea4737d86 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41f9a4e2214e4382bb2fad82711a2472 in term 4.
I20260709 13:10:20.691529 25058 raft_consensus.cc:697] T 3e8dbf03cb5e4334a7231c02b4f45bee P 41f9a4e2214e4382bb2fad82711a2472 [term 4 LEADER]: Becoming Leader. State: Replica: 41f9a4e2214e4382bb2fad82711a2472, State: Running, Role: LEADER
I20260709 13:10:20.692382 25058 consensus_queue.cc:237] T 3e8dbf03cb5e4334a7231c02b4f45bee P 41f9a4e2214e4382bb2fad82711a2472 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:20.699522 24640 catalog_manager.cc:5697] T 3e8dbf03cb5e4334a7231c02b4f45bee P 41f9a4e2214e4382bb2fad82711a2472 reported cstate change: term changed from 3 to 4, leader changed from 92512576e6bc4561830a180ea4737d86 (127.23.140.65) to 41f9a4e2214e4382bb2fad82711a2472 (127.23.140.66). New cstate: current_term: 4 leader_uuid: "41f9a4e2214e4382bb2fad82711a2472" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:21.002311 25071 raft_consensus.cc:993] T fdad60a3620c40daa67e9436d4d5d174 P 92512576e6bc4561830a180ea4737d86: : Instructing follower f0788fe60e4d4891b51e6f092e50bb10 to start an election
I20260709 13:10:21.002730 25064 raft_consensus.cc:1081] T fdad60a3620c40daa67e9436d4d5d174 P 92512576e6bc4561830a180ea4737d86 [term 3 LEADER]: Signalling peer f0788fe60e4d4891b51e6f092e50bb10 to start an election
I20260709 13:10:21.004009 24894 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fdad60a3620c40daa67e9436d4d5d174"
dest_uuid: "f0788fe60e4d4891b51e6f092e50bb10"
 from {username='slave'} at 127.0.0.1:42762
I20260709 13:10:21.004367 24894 raft_consensus.cc:493] T fdad60a3620c40daa67e9436d4d5d174 P f0788fe60e4d4891b51e6f092e50bb10 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:21.004575 24894 raft_consensus.cc:3060] T fdad60a3620c40daa67e9436d4d5d174 P f0788fe60e4d4891b51e6f092e50bb10 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:21.008445 24894 raft_consensus.cc:515] T fdad60a3620c40daa67e9436d4d5d174 P f0788fe60e4d4891b51e6f092e50bb10 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:21.009956 24894 leader_election.cc:290] T fdad60a3620c40daa67e9436d4d5d174 P f0788fe60e4d4891b51e6f092e50bb10 [CANDIDATE]: Term 4 election: Requested vote from peers 92512576e6bc4561830a180ea4737d86 (127.23.140.65:41489), 41f9a4e2214e4382bb2fad82711a2472 (127.23.140.66:42587)
I20260709 13:10:21.011009 24820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdad60a3620c40daa67e9436d4d5d174" candidate_uuid: "f0788fe60e4d4891b51e6f092e50bb10" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "41f9a4e2214e4382bb2fad82711a2472"
I20260709 13:10:21.010673 24744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdad60a3620c40daa67e9436d4d5d174" candidate_uuid: "f0788fe60e4d4891b51e6f092e50bb10" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "92512576e6bc4561830a180ea4737d86"
I20260709 13:10:21.011580 24820 raft_consensus.cc:3060] T fdad60a3620c40daa67e9436d4d5d174 P 41f9a4e2214e4382bb2fad82711a2472 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:21.011647 24744 raft_consensus.cc:3055] T fdad60a3620c40daa67e9436d4d5d174 P 92512576e6bc4561830a180ea4737d86 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:21.011982 24744 raft_consensus.cc:740] T fdad60a3620c40daa67e9436d4d5d174 P 92512576e6bc4561830a180ea4737d86 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 92512576e6bc4561830a180ea4737d86, State: Running, Role: LEADER
I20260709 13:10:21.012560 24744 consensus_queue.cc:260] T fdad60a3620c40daa67e9436d4d5d174 P 92512576e6bc4561830a180ea4737d86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:21.013504 24744 raft_consensus.cc:3060] T fdad60a3620c40daa67e9436d4d5d174 P 92512576e6bc4561830a180ea4737d86 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:21.016042 24820 raft_consensus.cc:2468] T fdad60a3620c40daa67e9436d4d5d174 P 41f9a4e2214e4382bb2fad82711a2472 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0788fe60e4d4891b51e6f092e50bb10 in term 4.
I20260709 13:10:21.017191 24857 leader_election.cc:304] T fdad60a3620c40daa67e9436d4d5d174 P f0788fe60e4d4891b51e6f092e50bb10 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41f9a4e2214e4382bb2fad82711a2472, f0788fe60e4d4891b51e6f092e50bb10; no voters: 
I20260709 13:10:21.018111 24970 raft_consensus.cc:2804] T fdad60a3620c40daa67e9436d4d5d174 P f0788fe60e4d4891b51e6f092e50bb10 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:21.018406 24744 raft_consensus.cc:2468] T fdad60a3620c40daa67e9436d4d5d174 P 92512576e6bc4561830a180ea4737d86 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0788fe60e4d4891b51e6f092e50bb10 in term 4.
I20260709 13:10:21.019606 24970 raft_consensus.cc:697] T fdad60a3620c40daa67e9436d4d5d174 P f0788fe60e4d4891b51e6f092e50bb10 [term 4 LEADER]: Becoming Leader. State: Replica: f0788fe60e4d4891b51e6f092e50bb10, State: Running, Role: LEADER
I20260709 13:10:21.020483 24970 consensus_queue.cc:237] T fdad60a3620c40daa67e9436d4d5d174 P f0788fe60e4d4891b51e6f092e50bb10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:21.027925 24640 catalog_manager.cc:5697] T fdad60a3620c40daa67e9436d4d5d174 P f0788fe60e4d4891b51e6f092e50bb10 reported cstate change: term changed from 3 to 4, leader changed from 92512576e6bc4561830a180ea4737d86 (127.23.140.65) to f0788fe60e4d4891b51e6f092e50bb10 (127.23.140.67). New cstate: current_term: 4 leader_uuid: "f0788fe60e4d4891b51e6f092e50bb10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:21.050247 24894 raft_consensus.cc:1275] T 8ab8d9cd192348f09921ada29f04e55d P f0788fe60e4d4891b51e6f092e50bb10 [term 3 FOLLOWER]: Refusing update from remote peer 41f9a4e2214e4382bb2fad82711a2472: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:21.051337 25058 consensus_queue.cc:1048] T 8ab8d9cd192348f09921ada29f04e55d P 41f9a4e2214e4382bb2fad82711a2472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:21.062610 24744 raft_consensus.cc:1275] T 8ab8d9cd192348f09921ada29f04e55d P 92512576e6bc4561830a180ea4737d86 [term 3 FOLLOWER]: Refusing update from remote peer 41f9a4e2214e4382bb2fad82711a2472: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:21.065337 25079 consensus_queue.cc:1048] T 8ab8d9cd192348f09921ada29f04e55d P 41f9a4e2214e4382bb2fad82711a2472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:21.110189 25071 raft_consensus.cc:993] T a354f2f44e1c42e7a605864651a66beb P 92512576e6bc4561830a180ea4737d86: : Instructing follower f0788fe60e4d4891b51e6f092e50bb10 to start an election
I20260709 13:10:21.110644 25064 raft_consensus.cc:1081] T a354f2f44e1c42e7a605864651a66beb P 92512576e6bc4561830a180ea4737d86 [term 2 LEADER]: Signalling peer f0788fe60e4d4891b51e6f092e50bb10 to start an election
I20260709 13:10:21.112082 24894 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a354f2f44e1c42e7a605864651a66beb"
dest_uuid: "f0788fe60e4d4891b51e6f092e50bb10"
 from {username='slave'} at 127.0.0.1:42762
I20260709 13:10:21.112526 24894 raft_consensus.cc:493] T a354f2f44e1c42e7a605864651a66beb P f0788fe60e4d4891b51e6f092e50bb10 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:21.112854 24894 raft_consensus.cc:3060] T a354f2f44e1c42e7a605864651a66beb P f0788fe60e4d4891b51e6f092e50bb10 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:21.117202 24894 raft_consensus.cc:515] T a354f2f44e1c42e7a605864651a66beb P f0788fe60e4d4891b51e6f092e50bb10 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:21.118577 24894 leader_election.cc:290] T a354f2f44e1c42e7a605864651a66beb P f0788fe60e4d4891b51e6f092e50bb10 [CANDIDATE]: Term 3 election: Requested vote from peers 92512576e6bc4561830a180ea4737d86 (127.23.140.65:41489), 41f9a4e2214e4382bb2fad82711a2472 (127.23.140.66:42587)
I20260709 13:10:21.119398 24744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a354f2f44e1c42e7a605864651a66beb" candidate_uuid: "f0788fe60e4d4891b51e6f092e50bb10" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "92512576e6bc4561830a180ea4737d86"
I20260709 13:10:21.119590 24820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a354f2f44e1c42e7a605864651a66beb" candidate_uuid: "f0788fe60e4d4891b51e6f092e50bb10" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "41f9a4e2214e4382bb2fad82711a2472"
I20260709 13:10:21.119951 24744 raft_consensus.cc:3055] T a354f2f44e1c42e7a605864651a66beb P 92512576e6bc4561830a180ea4737d86 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:21.120033 24820 raft_consensus.cc:3060] T a354f2f44e1c42e7a605864651a66beb P 41f9a4e2214e4382bb2fad82711a2472 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:21.120292 24744 raft_consensus.cc:740] T a354f2f44e1c42e7a605864651a66beb P 92512576e6bc4561830a180ea4737d86 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 92512576e6bc4561830a180ea4737d86, State: Running, Role: LEADER
I20260709 13:10:21.120999 24744 consensus_queue.cc:260] T a354f2f44e1c42e7a605864651a66beb P 92512576e6bc4561830a180ea4737d86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:21.122180 24744 raft_consensus.cc:3060] T a354f2f44e1c42e7a605864651a66beb P 92512576e6bc4561830a180ea4737d86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:21.126191 24820 raft_consensus.cc:2468] T a354f2f44e1c42e7a605864651a66beb P 41f9a4e2214e4382bb2fad82711a2472 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0788fe60e4d4891b51e6f092e50bb10 in term 3.
I20260709 13:10:21.127312 24857 leader_election.cc:304] T a354f2f44e1c42e7a605864651a66beb P f0788fe60e4d4891b51e6f092e50bb10 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41f9a4e2214e4382bb2fad82711a2472, f0788fe60e4d4891b51e6f092e50bb10; no voters: 
I20260709 13:10:21.127995 24744 raft_consensus.cc:2468] T a354f2f44e1c42e7a605864651a66beb P 92512576e6bc4561830a180ea4737d86 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0788fe60e4d4891b51e6f092e50bb10 in term 3.
I20260709 13:10:21.128099 24970 raft_consensus.cc:2804] T a354f2f44e1c42e7a605864651a66beb P f0788fe60e4d4891b51e6f092e50bb10 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:21.128655 24970 raft_consensus.cc:697] T a354f2f44e1c42e7a605864651a66beb P f0788fe60e4d4891b51e6f092e50bb10 [term 3 LEADER]: Becoming Leader. State: Replica: f0788fe60e4d4891b51e6f092e50bb10, State: Running, Role: LEADER
I20260709 13:10:21.129431 24970 consensus_queue.cc:237] T a354f2f44e1c42e7a605864651a66beb P f0788fe60e4d4891b51e6f092e50bb10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } }
I20260709 13:10:21.136482 24641 catalog_manager.cc:5697] T a354f2f44e1c42e7a605864651a66beb P f0788fe60e4d4891b51e6f092e50bb10 reported cstate change: term changed from 2 to 3, leader changed from 92512576e6bc4561830a180ea4737d86 (127.23.140.65) to f0788fe60e4d4891b51e6f092e50bb10 (127.23.140.67). New cstate: current_term: 3 leader_uuid: "f0788fe60e4d4891b51e6f092e50bb10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:21.245275 24894 raft_consensus.cc:1275] T 3e8dbf03cb5e4334a7231c02b4f45bee P f0788fe60e4d4891b51e6f092e50bb10 [term 4 FOLLOWER]: Refusing update from remote peer 41f9a4e2214e4382bb2fad82711a2472: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:21.246609 25090 consensus_queue.cc:1048] T 3e8dbf03cb5e4334a7231c02b4f45bee P 41f9a4e2214e4382bb2fad82711a2472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0788fe60e4d4891b51e6f092e50bb10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:21.254781 24744 raft_consensus.cc:1275] T 3e8dbf03cb5e4334a7231c02b4f45bee P 92512576e6bc4561830a180ea4737d86 [term 4 FOLLOWER]: Refusing update from remote peer 41f9a4e2214e4382bb2fad82711a2472: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:21.256219 25058 consensus_queue.cc:1048] T 3e8dbf03cb5e4334a7231c02b4f45bee P 41f9a4e2214e4382bb2fad82711a2472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:21.468477 24820 raft_consensus.cc:1275] T fdad60a3620c40daa67e9436d4d5d174 P 41f9a4e2214e4382bb2fad82711a2472 [term 4 FOLLOWER]: Refusing update from remote peer f0788fe60e4d4891b51e6f092e50bb10: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:21.469795 24970 consensus_queue.cc:1048] T fdad60a3620c40daa67e9436d4d5d174 P f0788fe60e4d4891b51e6f092e50bb10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:21.478436 24744 raft_consensus.cc:1275] T fdad60a3620c40daa67e9436d4d5d174 P 92512576e6bc4561830a180ea4737d86 [term 4 FOLLOWER]: Refusing update from remote peer f0788fe60e4d4891b51e6f092e50bb10: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:21.479941 25098 consensus_queue.cc:1048] T fdad60a3620c40daa67e9436d4d5d174 P f0788fe60e4d4891b51e6f092e50bb10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:21.536002 24744 raft_consensus.cc:1275] T a354f2f44e1c42e7a605864651a66beb P 92512576e6bc4561830a180ea4737d86 [term 3 FOLLOWER]: Refusing update from remote peer f0788fe60e4d4891b51e6f092e50bb10: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:21.537356 25098 consensus_queue.cc:1048] T a354f2f44e1c42e7a605864651a66beb P f0788fe60e4d4891b51e6f092e50bb10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92512576e6bc4561830a180ea4737d86" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:21.546063 24818 raft_consensus.cc:1275] T a354f2f44e1c42e7a605864651a66beb P 41f9a4e2214e4382bb2fad82711a2472 [term 3 FOLLOWER]: Refusing update from remote peer f0788fe60e4d4891b51e6f092e50bb10: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:21.547863 24970 consensus_queue.cc:1048] T a354f2f44e1c42e7a605864651a66beb P f0788fe60e4d4891b51e6f092e50bb10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41f9a4e2214e4382bb2fad82711a2472" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 42587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:21.585278 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:21.591106 24113 tablet_server.cc:179] TabletServer@127.23.140.65:0 shutting down...
I20260709 13:10:21.613718 24113 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:21.614511 24113 tablet_replica.cc:333] T 6c309103ab794ba7a09dedd040db10d7 P 92512576e6bc4561830a180ea4737d86: stopping tablet replica
I20260709 13:10:21.615345 24113 raft_consensus.cc:2243] T 6c309103ab794ba7a09dedd040db10d7 P 92512576e6bc4561830a180ea4737d86 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:21.616227 24113 raft_consensus.cc:2272] T 6c309103ab794ba7a09dedd040db10d7 P 92512576e6bc4561830a180ea4737d86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.618331 24113 tablet_replica.cc:333] T 344ea3140811457ebf5f36122fd88e52 P 92512576e6bc4561830a180ea4737d86: stopping tablet replica
I20260709 13:10:21.618937 24113 raft_consensus.cc:2243] T 344ea3140811457ebf5f36122fd88e52 P 92512576e6bc4561830a180ea4737d86 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.619333 24113 raft_consensus.cc:2272] T 344ea3140811457ebf5f36122fd88e52 P 92512576e6bc4561830a180ea4737d86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.621271 24113 tablet_replica.cc:333] T 8ab8d9cd192348f09921ada29f04e55d P 92512576e6bc4561830a180ea4737d86: stopping tablet replica
I20260709 13:10:21.621912 24113 raft_consensus.cc:2243] T 8ab8d9cd192348f09921ada29f04e55d P 92512576e6bc4561830a180ea4737d86 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.622362 24113 raft_consensus.cc:2272] T 8ab8d9cd192348f09921ada29f04e55d P 92512576e6bc4561830a180ea4737d86 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.625524 24113 tablet_replica.cc:333] T edb957f6330c46abab225a43aa102b4e P 92512576e6bc4561830a180ea4737d86: stopping tablet replica
I20260709 13:10:21.626183 24113 raft_consensus.cc:2243] T edb957f6330c46abab225a43aa102b4e P 92512576e6bc4561830a180ea4737d86 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:21.626921 24113 raft_consensus.cc:2272] T edb957f6330c46abab225a43aa102b4e P 92512576e6bc4561830a180ea4737d86 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.628705 24113 tablet_replica.cc:333] T a354f2f44e1c42e7a605864651a66beb P 92512576e6bc4561830a180ea4737d86: stopping tablet replica
I20260709 13:10:21.629184 24113 raft_consensus.cc:2243] T a354f2f44e1c42e7a605864651a66beb P 92512576e6bc4561830a180ea4737d86 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.629558 24113 raft_consensus.cc:2272] T a354f2f44e1c42e7a605864651a66beb P 92512576e6bc4561830a180ea4737d86 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.631533 24113 tablet_replica.cc:333] T 7ad37a53739d49499dc91aa56c61feb5 P 92512576e6bc4561830a180ea4737d86: stopping tablet replica
I20260709 13:10:21.632031 24113 raft_consensus.cc:2243] T 7ad37a53739d49499dc91aa56c61feb5 P 92512576e6bc4561830a180ea4737d86 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:21.632742 24113 raft_consensus.cc:2272] T 7ad37a53739d49499dc91aa56c61feb5 P 92512576e6bc4561830a180ea4737d86 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.634476 24113 tablet_replica.cc:333] T 23eeb369895744038073e959747f6f13 P 92512576e6bc4561830a180ea4737d86: stopping tablet replica
I20260709 13:10:21.635005 24113 raft_consensus.cc:2243] T 23eeb369895744038073e959747f6f13 P 92512576e6bc4561830a180ea4737d86 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:10:21.635738 24113 raft_consensus.cc:2272] T 23eeb369895744038073e959747f6f13 P 92512576e6bc4561830a180ea4737d86 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.637502 24113 tablet_replica.cc:333] T 3e8dbf03cb5e4334a7231c02b4f45bee P 92512576e6bc4561830a180ea4737d86: stopping tablet replica
I20260709 13:10:21.638017 24113 raft_consensus.cc:2243] T 3e8dbf03cb5e4334a7231c02b4f45bee P 92512576e6bc4561830a180ea4737d86 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.638419 24113 raft_consensus.cc:2272] T 3e8dbf03cb5e4334a7231c02b4f45bee P 92512576e6bc4561830a180ea4737d86 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:21.640753 24784 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 3 similar messages]
I20260709 13:10:21.641496 24113 tablet_replica.cc:333] T fdad60a3620c40daa67e9436d4d5d174 P 92512576e6bc4561830a180ea4737d86: stopping tablet replica
I20260709 13:10:21.642494 24113 raft_consensus.cc:2243] T fdad60a3620c40daa67e9436d4d5d174 P 92512576e6bc4561830a180ea4737d86 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.642946 24113 raft_consensus.cc:2272] T fdad60a3620c40daa67e9436d4d5d174 P 92512576e6bc4561830a180ea4737d86 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:21.644604 24784 consensus_peers.cc:597] T 8ab8d9cd192348f09921ada29f04e55d P 41f9a4e2214e4382bb2fad82711a2472 -> Peer 92512576e6bc4561830a180ea4737d86 (127.23.140.65:41489): Couldn't send request to peer 92512576e6bc4561830a180ea4737d86. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:21.645998 24113 tablet_replica.cc:333] T e1552504f8884142b4ccc09f539a6998 P 92512576e6bc4561830a180ea4737d86: stopping tablet replica
I20260709 13:10:21.646494 24113 raft_consensus.cc:2243] T e1552504f8884142b4ccc09f539a6998 P 92512576e6bc4561830a180ea4737d86 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.646911 24113 raft_consensus.cc:2272] T e1552504f8884142b4ccc09f539a6998 P 92512576e6bc4561830a180ea4737d86 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.675239 24113 tablet_server.cc:196] TabletServer@127.23.140.65:0 shutdown complete.
I20260709 13:10:21.693173 24113 tablet_server.cc:179] TabletServer@127.23.140.66:0 shutting down...
I20260709 13:10:21.719946 24113 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:21.720660 24113 tablet_replica.cc:333] T e1552504f8884142b4ccc09f539a6998 P 41f9a4e2214e4382bb2fad82711a2472: stopping tablet replica
I20260709 13:10:21.721517 24113 raft_consensus.cc:2243] T e1552504f8884142b4ccc09f539a6998 P 41f9a4e2214e4382bb2fad82711a2472 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:21.722304 24113 raft_consensus.cc:2272] T e1552504f8884142b4ccc09f539a6998 P 41f9a4e2214e4382bb2fad82711a2472 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.724154 24113 tablet_replica.cc:333] T 6c309103ab794ba7a09dedd040db10d7 P 41f9a4e2214e4382bb2fad82711a2472: stopping tablet replica
I20260709 13:10:21.724682 24113 raft_consensus.cc:2243] T 6c309103ab794ba7a09dedd040db10d7 P 41f9a4e2214e4382bb2fad82711a2472 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.725162 24113 raft_consensus.cc:2272] T 6c309103ab794ba7a09dedd040db10d7 P 41f9a4e2214e4382bb2fad82711a2472 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.726854 24113 tablet_replica.cc:333] T 344ea3140811457ebf5f36122fd88e52 P 41f9a4e2214e4382bb2fad82711a2472: stopping tablet replica
I20260709 13:10:21.727344 24113 raft_consensus.cc:2243] T 344ea3140811457ebf5f36122fd88e52 P 41f9a4e2214e4382bb2fad82711a2472 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.727751 24113 raft_consensus.cc:2272] T 344ea3140811457ebf5f36122fd88e52 P 41f9a4e2214e4382bb2fad82711a2472 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.729429 24113 tablet_replica.cc:333] T fdad60a3620c40daa67e9436d4d5d174 P 41f9a4e2214e4382bb2fad82711a2472: stopping tablet replica
I20260709 13:10:21.730029 24113 raft_consensus.cc:2243] T fdad60a3620c40daa67e9436d4d5d174 P 41f9a4e2214e4382bb2fad82711a2472 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.730449 24113 raft_consensus.cc:2272] T fdad60a3620c40daa67e9436d4d5d174 P 41f9a4e2214e4382bb2fad82711a2472 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.733002 24113 tablet_replica.cc:333] T 3e8dbf03cb5e4334a7231c02b4f45bee P 41f9a4e2214e4382bb2fad82711a2472: stopping tablet replica
I20260709 13:10:21.733502 24113 raft_consensus.cc:2243] T 3e8dbf03cb5e4334a7231c02b4f45bee P 41f9a4e2214e4382bb2fad82711a2472 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:10:21.734236 24113 raft_consensus.cc:2272] T 3e8dbf03cb5e4334a7231c02b4f45bee P 41f9a4e2214e4382bb2fad82711a2472 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.736150 24113 tablet_replica.cc:333] T 23eeb369895744038073e959747f6f13 P 41f9a4e2214e4382bb2fad82711a2472: stopping tablet replica
I20260709 13:10:21.736678 24113 raft_consensus.cc:2243] T 23eeb369895744038073e959747f6f13 P 41f9a4e2214e4382bb2fad82711a2472 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.737175 24113 raft_consensus.cc:2272] T 23eeb369895744038073e959747f6f13 P 41f9a4e2214e4382bb2fad82711a2472 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.738857 24113 tablet_replica.cc:333] T 8ab8d9cd192348f09921ada29f04e55d P 41f9a4e2214e4382bb2fad82711a2472: stopping tablet replica
I20260709 13:10:21.739315 24113 raft_consensus.cc:2243] T 8ab8d9cd192348f09921ada29f04e55d P 41f9a4e2214e4382bb2fad82711a2472 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:21.740024 24113 raft_consensus.cc:2272] T 8ab8d9cd192348f09921ada29f04e55d P 41f9a4e2214e4382bb2fad82711a2472 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.741719 24113 tablet_replica.cc:333] T edb957f6330c46abab225a43aa102b4e P 41f9a4e2214e4382bb2fad82711a2472: stopping tablet replica
I20260709 13:10:21.742237 24113 raft_consensus.cc:2243] T edb957f6330c46abab225a43aa102b4e P 41f9a4e2214e4382bb2fad82711a2472 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.742654 24113 raft_consensus.cc:2272] T edb957f6330c46abab225a43aa102b4e P 41f9a4e2214e4382bb2fad82711a2472 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.744175 24113 tablet_replica.cc:333] T 7ad37a53739d49499dc91aa56c61feb5 P 41f9a4e2214e4382bb2fad82711a2472: stopping tablet replica
I20260709 13:10:21.744642 24113 raft_consensus.cc:2243] T 7ad37a53739d49499dc91aa56c61feb5 P 41f9a4e2214e4382bb2fad82711a2472 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.745036 24113 raft_consensus.cc:2272] T 7ad37a53739d49499dc91aa56c61feb5 P 41f9a4e2214e4382bb2fad82711a2472 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.746570 24113 tablet_replica.cc:333] T a354f2f44e1c42e7a605864651a66beb P 41f9a4e2214e4382bb2fad82711a2472: stopping tablet replica
I20260709 13:10:21.746994 24113 raft_consensus.cc:2243] T a354f2f44e1c42e7a605864651a66beb P 41f9a4e2214e4382bb2fad82711a2472 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.747380 24113 raft_consensus.cc:2272] T a354f2f44e1c42e7a605864651a66beb P 41f9a4e2214e4382bb2fad82711a2472 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.767297 24113 tablet_server.cc:196] TabletServer@127.23.140.66:0 shutdown complete.
I20260709 13:10:21.784842 24113 tablet_server.cc:179] TabletServer@127.23.140.67:0 shutting down...
I20260709 13:10:21.809908 24113 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:21.810745 24113 tablet_replica.cc:333] T 6c309103ab794ba7a09dedd040db10d7 P f0788fe60e4d4891b51e6f092e50bb10: stopping tablet replica
I20260709 13:10:21.811370 24113 raft_consensus.cc:2243] T 6c309103ab794ba7a09dedd040db10d7 P f0788fe60e4d4891b51e6f092e50bb10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.811890 24113 raft_consensus.cc:2272] T 6c309103ab794ba7a09dedd040db10d7 P f0788fe60e4d4891b51e6f092e50bb10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.813661 24113 tablet_replica.cc:333] T a354f2f44e1c42e7a605864651a66beb P f0788fe60e4d4891b51e6f092e50bb10: stopping tablet replica
I20260709 13:10:21.814260 24113 raft_consensus.cc:2243] T a354f2f44e1c42e7a605864651a66beb P f0788fe60e4d4891b51e6f092e50bb10 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:21.815078 24113 raft_consensus.cc:2272] T a354f2f44e1c42e7a605864651a66beb P f0788fe60e4d4891b51e6f092e50bb10 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.817082 24113 tablet_replica.cc:333] T 7ad37a53739d49499dc91aa56c61feb5 P f0788fe60e4d4891b51e6f092e50bb10: stopping tablet replica
I20260709 13:10:21.817611 24113 raft_consensus.cc:2243] T 7ad37a53739d49499dc91aa56c61feb5 P f0788fe60e4d4891b51e6f092e50bb10 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.818048 24113 raft_consensus.cc:2272] T 7ad37a53739d49499dc91aa56c61feb5 P f0788fe60e4d4891b51e6f092e50bb10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.819536 24113 tablet_replica.cc:333] T 8ab8d9cd192348f09921ada29f04e55d P f0788fe60e4d4891b51e6f092e50bb10: stopping tablet replica
I20260709 13:10:21.819978 24113 raft_consensus.cc:2243] T 8ab8d9cd192348f09921ada29f04e55d P f0788fe60e4d4891b51e6f092e50bb10 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.820361 24113 raft_consensus.cc:2272] T 8ab8d9cd192348f09921ada29f04e55d P f0788fe60e4d4891b51e6f092e50bb10 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.822783 24113 tablet_replica.cc:333] T edb957f6330c46abab225a43aa102b4e P f0788fe60e4d4891b51e6f092e50bb10: stopping tablet replica
I20260709 13:10:21.823272 24113 raft_consensus.cc:2243] T edb957f6330c46abab225a43aa102b4e P f0788fe60e4d4891b51e6f092e50bb10 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.823678 24113 raft_consensus.cc:2272] T edb957f6330c46abab225a43aa102b4e P f0788fe60e4d4891b51e6f092e50bb10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.825321 24113 tablet_replica.cc:333] T e1552504f8884142b4ccc09f539a6998 P f0788fe60e4d4891b51e6f092e50bb10: stopping tablet replica
I20260709 13:10:21.825858 24113 raft_consensus.cc:2243] T e1552504f8884142b4ccc09f539a6998 P f0788fe60e4d4891b51e6f092e50bb10 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.826280 24113 raft_consensus.cc:2272] T e1552504f8884142b4ccc09f539a6998 P f0788fe60e4d4891b51e6f092e50bb10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.827999 24113 tablet_replica.cc:333] T 344ea3140811457ebf5f36122fd88e52 P f0788fe60e4d4891b51e6f092e50bb10: stopping tablet replica
I20260709 13:10:21.828469 24113 raft_consensus.cc:2243] T 344ea3140811457ebf5f36122fd88e52 P f0788fe60e4d4891b51e6f092e50bb10 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:21.829164 24113 raft_consensus.cc:2272] T 344ea3140811457ebf5f36122fd88e52 P f0788fe60e4d4891b51e6f092e50bb10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.830744 24113 tablet_replica.cc:333] T fdad60a3620c40daa67e9436d4d5d174 P f0788fe60e4d4891b51e6f092e50bb10: stopping tablet replica
I20260709 13:10:21.831210 24113 raft_consensus.cc:2243] T fdad60a3620c40daa67e9436d4d5d174 P f0788fe60e4d4891b51e6f092e50bb10 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:10:21.831950 24113 raft_consensus.cc:2272] T fdad60a3620c40daa67e9436d4d5d174 P f0788fe60e4d4891b51e6f092e50bb10 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.833734 24113 tablet_replica.cc:333] T 23eeb369895744038073e959747f6f13 P f0788fe60e4d4891b51e6f092e50bb10: stopping tablet replica
I20260709 13:10:21.834261 24113 raft_consensus.cc:2243] T 23eeb369895744038073e959747f6f13 P f0788fe60e4d4891b51e6f092e50bb10 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.834679 24113 raft_consensus.cc:2272] T 23eeb369895744038073e959747f6f13 P f0788fe60e4d4891b51e6f092e50bb10 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.836278 24113 tablet_replica.cc:333] T 3e8dbf03cb5e4334a7231c02b4f45bee P f0788fe60e4d4891b51e6f092e50bb10: stopping tablet replica
I20260709 13:10:21.836714 24113 raft_consensus.cc:2243] T 3e8dbf03cb5e4334a7231c02b4f45bee P f0788fe60e4d4891b51e6f092e50bb10 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.837252 24113 raft_consensus.cc:2272] T 3e8dbf03cb5e4334a7231c02b4f45bee P f0788fe60e4d4891b51e6f092e50bb10 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.865355 24113 tablet_server.cc:196] TabletServer@127.23.140.67:0 shutdown complete.
I20260709 13:10:21.883229 24113 master.cc:562] Master@127.23.140.126:32897 shutting down...
I20260709 13:10:21.902767 24113 raft_consensus.cc:2243] T 00000000000000000000000000000000 P f1f9dcc6621147dea9d9b34ce23f6a16 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:21.903307 24113 raft_consensus.cc:2272] T 00000000000000000000000000000000 P f1f9dcc6621147dea9d9b34ce23f6a16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.903632 24113 tablet_replica.cc:333] T 00000000000000000000000000000000 P f1f9dcc6621147dea9d9b34ce23f6a16: stopping tablet replica
I20260709 13:10:21.923897 24113 master.cc:584] Master@127.23.140.126:32897 shutdown complete.
41f9a4e2214e4382bb2fad82711a2472  4
92512576e6bc4561830a180ea4737d86  5
f0788fe60e4d4891b51e6f092e50bb10  1
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10574 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:10:21.963176 24113 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.23.140.126:37145
I20260709 13:10:21.964320 24113 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:21.969890 25103 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:21.970052 25104 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:21.971351 25106 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:21.972399 24113 server_base.cc:1061] running on GCE node
I20260709 13:10:21.973160 24113 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:21.973331 24113 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:21.973444 24113 hybrid_clock.cc:648] HybridClock initialized: now 1783602621973434 us; error 0 us; skew 500 ppm
I20260709 13:10:21.973985 24113 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:21.976338 24113 webserver.cc:533] Webserver started at http://127.23.140.126:33587/ using document root <none> and password file <none>
I20260709 13:10:21.976754 24113 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:21.976912 24113 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:21.977126 24113 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:21.978250 24113 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602598684750-24113-0/minicluster-data/master-0-root/instance:
uuid: "5140a3161b944724a989995efdc4a818"
format_stamp: "Formatted at 2026-07-09 13:10:21 on dist-test-slave-1rs3"
I20260709 13:10:21.982777 24113 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:10:21.986078 25111 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:21.987219 24113 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 13:10:21.987509 24113 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602598684750-24113-0/minicluster-data/master-0-root
uuid: "5140a3161b944724a989995efdc4a818"
format_stamp: "Formatted at 2026-07-09 13:10:21 on dist-test-slave-1rs3"
I20260709 13:10:21.988035 24113 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602598684750-24113-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602598684750-24113-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602598684750-24113-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:22.003010 24113 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:22.004469 24113 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:22.042866 24113 rpc_server.cc:307] RPC server started. Bound to: 127.23.140.126:37145
I20260709 13:10:22.042987 25162 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.140.126:37145 every 8 connection(s)
I20260709 13:10:22.046917 25163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.056198 25163 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5140a3161b944724a989995efdc4a818: Bootstrap starting.
I20260709 13:10:22.060613 25163 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5140a3161b944724a989995efdc4a818: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:22.064728 25163 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5140a3161b944724a989995efdc4a818: No bootstrap required, opened a new log
I20260709 13:10:22.066741 25163 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5140a3161b944724a989995efdc4a818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5140a3161b944724a989995efdc4a818" member_type: VOTER }
I20260709 13:10:22.067112 25163 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5140a3161b944724a989995efdc4a818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:22.067382 25163 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5140a3161b944724a989995efdc4a818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5140a3161b944724a989995efdc4a818, State: Initialized, Role: FOLLOWER
I20260709 13:10:22.068037 25163 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5140a3161b944724a989995efdc4a818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5140a3161b944724a989995efdc4a818" member_type: VOTER }
I20260709 13:10:22.068482 25163 raft_consensus.cc:399] T 00000000000000000000000000000000 P 5140a3161b944724a989995efdc4a818 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:10:22.068681 25163 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5140a3161b944724a989995efdc4a818 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:10:22.068987 25163 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5140a3161b944724a989995efdc4a818 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:22.073122 25163 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5140a3161b944724a989995efdc4a818 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5140a3161b944724a989995efdc4a818" member_type: VOTER }
I20260709 13:10:22.073609 25163 leader_election.cc:304] T 00000000000000000000000000000000 P 5140a3161b944724a989995efdc4a818 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5140a3161b944724a989995efdc4a818; no voters: 
I20260709 13:10:22.074762 25163 leader_election.cc:290] T 00000000000000000000000000000000 P 5140a3161b944724a989995efdc4a818 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:10:22.075222 25166 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5140a3161b944724a989995efdc4a818 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:22.076692 25166 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5140a3161b944724a989995efdc4a818 [term 1 LEADER]: Becoming Leader. State: Replica: 5140a3161b944724a989995efdc4a818, State: Running, Role: LEADER
I20260709 13:10:22.077672 25166 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5140a3161b944724a989995efdc4a818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5140a3161b944724a989995efdc4a818" member_type: VOTER }
I20260709 13:10:22.078205 25163 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5140a3161b944724a989995efdc4a818 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:10:22.084935 25167 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5140a3161b944724a989995efdc4a818 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5140a3161b944724a989995efdc4a818" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5140a3161b944724a989995efdc4a818" member_type: VOTER } }
I20260709 13:10:22.085562 25167 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5140a3161b944724a989995efdc4a818 [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:22.090476 25168 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5140a3161b944724a989995efdc4a818 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5140a3161b944724a989995efdc4a818. Latest consensus state: current_term: 1 leader_uuid: "5140a3161b944724a989995efdc4a818" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5140a3161b944724a989995efdc4a818" member_type: VOTER } }
I20260709 13:10:22.091004 25174 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:10:22.091046 25168 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5140a3161b944724a989995efdc4a818 [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:22.098481 25174 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:10:22.099428 24113 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:10:22.106619 25174 catalog_manager.cc:1383] Generated new cluster ID: 167cccf27474429e9fbd49cfd93592dd
I20260709 13:10:22.106884 25174 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:10:22.152093 25174 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:10:22.153330 25174 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:10:22.164047 25174 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 5140a3161b944724a989995efdc4a818: Generated new TSK 0
I20260709 13:10:22.164624 25174 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:10:22.230265 24113 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:22.236127 25184 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:22.237123 25185 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:22.239697 25187 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:22.239777 24113 server_base.cc:1061] running on GCE node
I20260709 13:10:22.241050 24113 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:22.241225 24113 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:22.241343 24113 hybrid_clock.cc:648] HybridClock initialized: now 1783602622241331 us; error 0 us; skew 500 ppm
I20260709 13:10:22.241878 24113 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:22.244355 24113 webserver.cc:533] Webserver started at http://127.23.140.65:43075/ using document root <none> and password file <none>
I20260709 13:10:22.244794 24113 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:22.244956 24113 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:22.245159 24113 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:22.246236 24113 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602598684750-24113-0/minicluster-data/ts-0-root/instance:
uuid: "1f539ba21487460085b837e7529a78ce"
format_stamp: "Formatted at 2026-07-09 13:10:22 on dist-test-slave-1rs3"
I20260709 13:10:22.250651 24113 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 13:10:22.253651 25192 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:22.254419 24113 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:10:22.254700 24113 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602598684750-24113-0/minicluster-data/ts-0-root
uuid: "1f539ba21487460085b837e7529a78ce"
format_stamp: "Formatted at 2026-07-09 13:10:22 on dist-test-slave-1rs3"
I20260709 13:10:22.254968 24113 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602598684750-24113-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602598684750-24113-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602598684750-24113-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:22.268879 24113 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:22.270077 24113 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:22.271607 24113 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:22.273797 24113 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:22.274010 24113 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:22.274248 24113 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:22.274438 24113 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:22.313172 24113 rpc_server.cc:307] RPC server started. Bound to: 127.23.140.65:39361
I20260709 13:10:22.313275 25254 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.140.65:39361 every 8 connection(s)
I20260709 13:10:22.318146 24113 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:22.327122 25260 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:22.328678 25259 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:22.328787 25262 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:22.331825 24113 server_base.cc:1061] running on GCE node
I20260709 13:10:22.332896 24113 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:22.333200 24113 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:22.333609 24113 hybrid_clock.cc:648] HybridClock initialized: now 1783602622333586 us; error 0 us; skew 500 ppm
I20260709 13:10:22.334132 25255 heartbeater.cc:344] Connected to a master server at 127.23.140.126:37145
I20260709 13:10:22.334550 25255 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:22.334602 24113 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:22.335495 25255 heartbeater.cc:507] Master 127.23.140.126:37145 requested a full tablet report, sending...
I20260709 13:10:22.337589 24113 webserver.cc:533] Webserver started at http://127.23.140.66:38799/ using document root <none> and password file <none>
I20260709 13:10:22.338256 24113 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:22.338228 25128 ts_manager.cc:194] Registered new tserver with Master: 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361)
I20260709 13:10:22.338650 24113 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:22.338991 24113 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:22.340478 24113 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602598684750-24113-0/minicluster-data/ts-1-root/instance:
uuid: "da445ce82dc4467f95f4fa52297eaa19"
format_stamp: "Formatted at 2026-07-09 13:10:22 on dist-test-slave-1rs3"
I20260709 13:10:22.340780 25128 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40020
I20260709 13:10:22.346266 24113 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.005s
I20260709 13:10:22.349649 25267 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:22.350567 24113 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:10:22.350910 24113 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602598684750-24113-0/minicluster-data/ts-1-root
uuid: "da445ce82dc4467f95f4fa52297eaa19"
format_stamp: "Formatted at 2026-07-09 13:10:22 on dist-test-slave-1rs3"
I20260709 13:10:22.351209 24113 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602598684750-24113-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602598684750-24113-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602598684750-24113-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:22.361256 24113 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:22.362530 24113 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:22.364037 24113 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:22.366313 24113 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:22.366539 24113 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:22.366788 24113 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:22.366959 24113 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:22.406615 24113 rpc_server.cc:307] RPC server started. Bound to: 127.23.140.66:33127
I20260709 13:10:22.406708 25329 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.140.66:33127 every 8 connection(s)
I20260709 13:10:22.411301 24113 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:22.417548 25333 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:22.420213 25334 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:22.420360 24113 server_base.cc:1061] running on GCE node
W20260709 13:10:22.421267 25336 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:22.422330 24113 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:22.422533 24113 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:22.422785 24113 hybrid_clock.cc:648] HybridClock initialized: now 1783602622422764 us; error 0 us; skew 500 ppm
I20260709 13:10:22.423017 25330 heartbeater.cc:344] Connected to a master server at 127.23.140.126:37145
I20260709 13:10:22.423321 25330 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:22.423321 24113 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:22.424002 25330 heartbeater.cc:507] Master 127.23.140.126:37145 requested a full tablet report, sending...
I20260709 13:10:22.425984 24113 webserver.cc:533] Webserver started at http://127.23.140.67:35157/ using document root <none> and password file <none>
I20260709 13:10:22.426316 25128 ts_manager.cc:194] Registered new tserver with Master: da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:22.426472 24113 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:22.426777 24113 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:22.427043 24113 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:22.427860 25128 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40026
I20260709 13:10:22.428095 24113 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602598684750-24113-0/minicluster-data/ts-2-root/instance:
uuid: "79d99c0e498349bda74127365219e468"
format_stamp: "Formatted at 2026-07-09 13:10:22 on dist-test-slave-1rs3"
I20260709 13:10:22.432536 24113 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 13:10:22.436348 25341 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:22.437237 24113 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:10:22.437482 24113 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602598684750-24113-0/minicluster-data/ts-2-root
uuid: "79d99c0e498349bda74127365219e468"
format_stamp: "Formatted at 2026-07-09 13:10:22 on dist-test-slave-1rs3"
I20260709 13:10:22.437711 24113 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602598684750-24113-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602598684750-24113-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602598684750-24113-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:22.453389 24113 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:22.454608 24113 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:22.456100 24113 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:22.458325 24113 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:22.458510 24113 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:22.458803 24113 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:22.458943 24113 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:22.500335 24113 rpc_server.cc:307] RPC server started. Bound to: 127.23.140.67:34091
I20260709 13:10:22.500427 25403 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.140.67:34091 every 8 connection(s)
I20260709 13:10:22.513890 25404 heartbeater.cc:344] Connected to a master server at 127.23.140.126:37145
I20260709 13:10:22.514302 25404 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:22.515012 25404 heartbeater.cc:507] Master 127.23.140.126:37145 requested a full tablet report, sending...
I20260709 13:10:22.516906 25128 ts_manager.cc:194] Registered new tserver with Master: 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:22.518023 24113 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014505312s
I20260709 13:10:22.518288 25128 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40034
I20260709 13:10:22.543426 25128 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40038:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:22.549568 25128 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:22.745975 25369 tablet_service.cc:1511] Processing CreateTablet for tablet 5e0cf1df707d42a3834bac46dc045119 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:10:22.746294 25368 tablet_service.cc:1511] Processing CreateTablet for tablet 9b49f61c49ae486392588c88e34a32d0 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:10:22.747466 25369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e0cf1df707d42a3834bac46dc045119. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.749418 25367 tablet_service.cc:1511] Processing CreateTablet for tablet d7fb167d72a441418dc3c55148746e87 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:10:22.750716 25367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7fb167d72a441418dc3c55148746e87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.755468 25366 tablet_service.cc:1511] Processing CreateTablet for tablet 52a83f35ff124418bd9c19dca631e017 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:10:22.757236 25366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52a83f35ff124418bd9c19dca631e017. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.758296 25368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b49f61c49ae486392588c88e34a32d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.765976 25365 tablet_service.cc:1511] Processing CreateTablet for tablet e8da265131524ca9bbf94bd69438fc22 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:10:22.767268 25365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8da265131524ca9bbf94bd69438fc22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.773190 25419 tablet_bootstrap.cc:492] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468: Bootstrap starting.
I20260709 13:10:22.773109 25364 tablet_service.cc:1511] Processing CreateTablet for tablet ca881f8516e046c99da202e9d9ea00a1 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:10:22.774055 25220 tablet_service.cc:1511] Processing CreateTablet for tablet 5e0cf1df707d42a3834bac46dc045119 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:10:22.774515 25364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca881f8516e046c99da202e9d9ea00a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.775462 25220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e0cf1df707d42a3834bac46dc045119. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.779109 25219 tablet_service.cc:1511] Processing CreateTablet for tablet 9b49f61c49ae486392588c88e34a32d0 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:10:22.780534 25419 tablet_bootstrap.cc:654] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:22.781010 25363 tablet_service.cc:1511] Processing CreateTablet for tablet ff04ee47fb3f40b2b2354a8d4f665483 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:10:22.782261 25363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff04ee47fb3f40b2b2354a8d4f665483. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.780596 25219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b49f61c49ae486392588c88e34a32d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.784991 25362 tablet_service.cc:1511] Processing CreateTablet for tablet f616a884a8284b1f8fd7c51549e8a211 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:10:22.785477 25217 tablet_service.cc:1511] Processing CreateTablet for tablet 52a83f35ff124418bd9c19dca631e017 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:10:22.786357 25362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f616a884a8284b1f8fd7c51549e8a211. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.786412 25216 tablet_service.cc:1511] Processing CreateTablet for tablet e8da265131524ca9bbf94bd69438fc22 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:10:22.788169 25214 tablet_service.cc:1511] Processing CreateTablet for tablet ff04ee47fb3f40b2b2354a8d4f665483 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:10:22.789062 25215 tablet_service.cc:1511] Processing CreateTablet for tablet ca881f8516e046c99da202e9d9ea00a1 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:10:22.783092 25218 tablet_service.cc:1511] Processing CreateTablet for tablet d7fb167d72a441418dc3c55148746e87 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:10:22.790664 25215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca881f8516e046c99da202e9d9ea00a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.790782 25361 tablet_service.cc:1511] Processing CreateTablet for tablet 25e0218933774b319104f23505937179 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:10:22.792116 25361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25e0218933774b319104f23505937179. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.794345 25218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7fb167d72a441418dc3c55148746e87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.800135 25212 tablet_service.cc:1511] Processing CreateTablet for tablet 25e0218933774b319104f23505937179 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:10:22.803093 25213 tablet_service.cc:1511] Processing CreateTablet for tablet f616a884a8284b1f8fd7c51549e8a211 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:10:22.801615 25212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25e0218933774b319104f23505937179. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.806393 25211 tablet_service.cc:1511] Processing CreateTablet for tablet d56909a48cf841eb99365741e9e29e93 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:10:22.807726 25211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d56909a48cf841eb99365741e9e29e93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.810220 25217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52a83f35ff124418bd9c19dca631e017. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.814213 25216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8da265131524ca9bbf94bd69438fc22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.822222 25214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff04ee47fb3f40b2b2354a8d4f665483. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.826234 25213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f616a884a8284b1f8fd7c51549e8a211. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.836465 25363 tablet_service.cc:1511] Processing CreateTablet for tablet d56909a48cf841eb99365741e9e29e93 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:10:22.837826 25363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d56909a48cf841eb99365741e9e29e93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.841118 25369 tablet_service.cc:1511] Processing CreateTablet for tablet 56a9fdb76a7d494e81629b861acc1489 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:10:22.841401 25360 tablet_service.cc:1511] Processing CreateTablet for tablet 0cf595e68eca43728a4957ce8c8f5b69 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:10:22.842625 25369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56a9fdb76a7d494e81629b861acc1489. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.850476 25360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cf595e68eca43728a4957ce8c8f5b69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.881935 25360 tablet_service.cc:1511] Processing CreateTablet for tablet 35ae6d72e4154149b3d1721e2214570a (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:10:22.883190 25360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35ae6d72e4154149b3d1721e2214570a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.887893 25369 tablet_service.cc:1511] Processing CreateTablet for tablet c6d3131e75284c0eb555c937d1c619cb (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:10:22.889134 25369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6d3131e75284c0eb555c937d1c619cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.901165 25295 tablet_service.cc:1511] Processing CreateTablet for tablet 5e0cf1df707d42a3834bac46dc045119 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:10:22.902478 25295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e0cf1df707d42a3834bac46dc045119. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.911306 25294 tablet_service.cc:1511] Processing CreateTablet for tablet 9b49f61c49ae486392588c88e34a32d0 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:10:22.912606 25294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b49f61c49ae486392588c88e34a32d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.934110 25293 tablet_service.cc:1511] Processing CreateTablet for tablet d7fb167d72a441418dc3c55148746e87 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:10:22.937017 25293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7fb167d72a441418dc3c55148746e87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.944188 25289 tablet_service.cc:1511] Processing CreateTablet for tablet ff04ee47fb3f40b2b2354a8d4f665483 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:10:22.945570 25289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff04ee47fb3f40b2b2354a8d4f665483. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.946949 25287 tablet_service.cc:1511] Processing CreateTablet for tablet 25e0218933774b319104f23505937179 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:10:22.948091 25291 tablet_service.cc:1511] Processing CreateTablet for tablet e8da265131524ca9bbf94bd69438fc22 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:10:22.948608 25286 tablet_service.cc:1511] Processing CreateTablet for tablet d56909a48cf841eb99365741e9e29e93 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:10:22.949831 25290 tablet_service.cc:1511] Processing CreateTablet for tablet ca881f8516e046c99da202e9d9ea00a1 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:10:22.951515 25288 tablet_service.cc:1511] Processing CreateTablet for tablet f616a884a8284b1f8fd7c51549e8a211 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:10:22.946959 25292 tablet_service.cc:1511] Processing CreateTablet for tablet 52a83f35ff124418bd9c19dca631e017 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:10:22.976543 25362 tablet_service.cc:1511] Processing CreateTablet for tablet f78697097cd14345b6a749c7aad4f696 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:10:22.978915 25287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25e0218933774b319104f23505937179. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.981559 25292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52a83f35ff124418bd9c19dca631e017. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.962304 25421 tablet_bootstrap.cc:492] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce: Bootstrap starting.
I20260709 13:10:22.968415 25360 tablet_service.cc:1511] Processing CreateTablet for tablet 87095494ab7d40b7a42f4b05732acbf5 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:10:22.961056 25419 tablet_bootstrap.cc:492] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468: No bootstrap required, opened a new log
I20260709 13:10:22.990353 25369 tablet_service.cc:1511] Processing CreateTablet for tablet 8d0f43a786a846b49924a589e4a36f2f (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:10:22.991525 25367 tablet_service.cc:1511] Processing CreateTablet for tablet c8f924da5ba24241866fed885eb63eff (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:10:22.965480 25366 tablet_service.cc:1511] Processing CreateTablet for tablet 47228487a74240e9bc9bcd2e1d966ed6 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:10:22.996711 25368 tablet_service.cc:1511] Processing CreateTablet for tablet 682caa57052f4e698c0ad75fb393ae75 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:10:22.998198 25288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f616a884a8284b1f8fd7c51549e8a211. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.004290 25295 tablet_service.cc:1511] Processing CreateTablet for tablet 35ae6d72e4154149b3d1721e2214570a (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:10:22.986423 25361 tablet_service.cc:1511] Processing CreateTablet for tablet 0eaedd90995b476890a2ea23d7089759 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:10:23.005890 25363 tablet_service.cc:1511] Processing CreateTablet for tablet b1dbd9bfdb4f4ed582b5d84e9cc7602a (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:10:23.023402 25286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d56909a48cf841eb99365741e9e29e93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.027408 25215 tablet_service.cc:1511] Processing CreateTablet for tablet c6d3131e75284c0eb555c937d1c619cb (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:10:23.030105 25290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca881f8516e046c99da202e9d9ea00a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.021332 25211 tablet_service.cc:1511] Processing CreateTablet for tablet 56a9fdb76a7d494e81629b861acc1489 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:10:23.031447 25214 tablet_service.cc:1511] Processing CreateTablet for tablet 47228487a74240e9bc9bcd2e1d966ed6 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:10:23.010955 25365 tablet_service.cc:1511] Processing CreateTablet for tablet 51ecc4484385405c857b3bee1077c36a (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:10:22.984846 25364 tablet_service.cc:1511] Processing CreateTablet for tablet cf070d83a5904025bb0d390a39ebae05 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:10:23.007130 25362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f78697097cd14345b6a749c7aad4f696. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.024448 25220 tablet_service.cc:1511] Processing CreateTablet for tablet 0cf595e68eca43728a4957ce8c8f5b69 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:10:23.040673 25295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35ae6d72e4154149b3d1721e2214570a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.042352 25291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8da265131524ca9bbf94bd69438fc22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.043324 25212 tablet_service.cc:1511] Processing CreateTablet for tablet 35ae6d72e4154149b3d1721e2214570a (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:10:23.046240 25213 tablet_service.cc:1511] Processing CreateTablet for tablet 87095494ab7d40b7a42f4b05732acbf5 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:10:23.036314 25419 ts_tablet_manager.cc:1403] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468: Time spent bootstrapping tablet: real 0.264s	user 0.019s	sys 0.007s
I20260709 13:10:23.048893 25368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 682caa57052f4e698c0ad75fb393ae75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.053683 25361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0eaedd90995b476890a2ea23d7089759. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.041733 25215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6d3131e75284c0eb555c937d1c619cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.054275 25364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf070d83a5904025bb0d390a39ebae05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.054878 25367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8f924da5ba24241866fed885eb63eff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.055457 25366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47228487a74240e9bc9bcd2e1d966ed6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.057150 25369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d0f43a786a846b49924a589e4a36f2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.058012 25360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87095494ab7d40b7a42f4b05732acbf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.059147 25365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51ecc4484385405c857b3bee1077c36a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.060415 25294 tablet_service.cc:1511] Processing CreateTablet for tablet 56a9fdb76a7d494e81629b861acc1489 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:10:23.061743 25294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56a9fdb76a7d494e81629b861acc1489. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.065675 25219 tablet_service.cc:1511] Processing CreateTablet for tablet f78697097cd14345b6a749c7aad4f696 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:10:23.067818 25218 tablet_service.cc:1511] Processing CreateTablet for tablet 0eaedd90995b476890a2ea23d7089759 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:10:23.073920 25216 tablet_service.cc:1511] Processing CreateTablet for tablet 8d0f43a786a846b49924a589e4a36f2f (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:10:23.074699 25419 raft_consensus.cc:359] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:10:23.075419 25419 raft_consensus.cc:385] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:23.075704 25419 raft_consensus.cc:740] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Initialized, Role: FOLLOWER
I20260709 13:10:23.076783 25217 tablet_service.cc:1511] Processing CreateTablet for tablet cf070d83a5904025bb0d390a39ebae05 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:10:23.077684 25212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35ae6d72e4154149b3d1721e2214570a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.093293 25216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d0f43a786a846b49924a589e4a36f2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.078397 25422 tablet_bootstrap.cc:492] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19: Bootstrap starting.
I20260709 13:10:23.097824 25213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87095494ab7d40b7a42f4b05732acbf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.099334 25220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cf595e68eca43728a4957ce8c8f5b69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.079010 25363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1dbd9bfdb4f4ed582b5d84e9cc7602a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.102725 25219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f78697097cd14345b6a749c7aad4f696. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.105029 25211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56a9fdb76a7d494e81629b861acc1489. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.091492 25419 consensus_queue.cc:260] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:10:23.110109 25218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0eaedd90995b476890a2ea23d7089759. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.114140 25214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47228487a74240e9bc9bcd2e1d966ed6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.122063 25217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf070d83a5904025bb0d390a39ebae05. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:10:23.128793 25175 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:23.134032 25288 tablet_service.cc:1511] Processing CreateTablet for tablet 0cf595e68eca43728a4957ce8c8f5b69 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:10:23.138515 25215 tablet_service.cc:1511] Processing CreateTablet for tablet c8f924da5ba24241866fed885eb63eff (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:10:23.140022 25422 tablet_bootstrap.cc:654] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:23.140559 25288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cf595e68eca43728a4957ce8c8f5b69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.140022 25215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8f924da5ba24241866fed885eb63eff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.140014 25286 tablet_service.cc:1511] Processing CreateTablet for tablet c6d3131e75284c0eb555c937d1c619cb (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:10:23.143597 25286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6d3131e75284c0eb555c937d1c619cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.144129 25289 tablet_service.cc:1511] Processing CreateTablet for tablet 47228487a74240e9bc9bcd2e1d966ed6 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:10:23.153980 25289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47228487a74240e9bc9bcd2e1d966ed6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.129462 25361 tablet_service.cc:1511] Processing CreateTablet for tablet ca662cfcc5084384a1da94266546eabc (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:10:23.155334 25361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca662cfcc5084384a1da94266546eabc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.156065 25419 ts_tablet_manager.cc:1434] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468: Time spent starting tablet: real 0.108s	user 0.006s	sys 0.004s
I20260709 13:10:23.164758 25404 heartbeater.cc:499] Master 127.23.140.126:37145 was elected leader, sending a full tablet report...
I20260709 13:10:23.165153 25419 tablet_bootstrap.cc:492] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468: Bootstrap starting.
I20260709 13:10:23.156888 25291 tablet_service.cc:1511] Processing CreateTablet for tablet 87095494ab7d40b7a42f4b05732acbf5 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:10:23.159767 25295 tablet_service.cc:1511] Processing CreateTablet for tablet f78697097cd14345b6a749c7aad4f696 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:10:23.161389 25287 tablet_service.cc:1511] Processing CreateTablet for tablet 0eaedd90995b476890a2ea23d7089759 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:10:23.171191 25295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f78697097cd14345b6a749c7aad4f696. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.175261 25291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87095494ab7d40b7a42f4b05732acbf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.192119 25287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0eaedd90995b476890a2ea23d7089759. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.201979 25362 tablet_service.cc:1511] Processing CreateTablet for tablet 3e6da6f96d4a4409be6b8e2b09c861c4 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:10:23.203341 25362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e6da6f96d4a4409be6b8e2b09c861c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.203835 25292 tablet_service.cc:1511] Processing CreateTablet for tablet 8d0f43a786a846b49924a589e4a36f2f (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:10:23.205032 25292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d0f43a786a846b49924a589e4a36f2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.204814 25217 tablet_service.cc:1511] Processing CreateTablet for tablet b1dbd9bfdb4f4ed582b5d84e9cc7602a (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:10:23.206116 25217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1dbd9bfdb4f4ed582b5d84e9cc7602a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.227952 25367 tablet_service.cc:1511] Processing CreateTablet for tablet 275226661cc840559134f8c9e5b15719 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:10:23.234475 25293 tablet_service.cc:1511] Processing CreateTablet for tablet ca662cfcc5084384a1da94266546eabc (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:10:23.235733 25293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca662cfcc5084384a1da94266546eabc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.236533 25213 tablet_service.cc:1511] Processing CreateTablet for tablet 51ecc4484385405c857b3bee1077c36a (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:10:23.237274 25367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 275226661cc840559134f8c9e5b15719. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.238015 25295 tablet_service.cc:1511] Processing CreateTablet for tablet c8f924da5ba24241866fed885eb63eff (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:10:23.240075 25369 tablet_service.cc:1511] Processing CreateTablet for tablet 92f679df8187472794ba8595642f63f9 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:10:23.220734 25365 tablet_service.cc:1511] Processing CreateTablet for tablet a5a4e5911cd2414daf6cc0bc2a692a69 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:10:23.235733 25421 tablet_bootstrap.cc:654] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:23.258880 25294 tablet_service.cc:1511] Processing CreateTablet for tablet 51ecc4484385405c857b3bee1077c36a (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:10:23.261092 25286 tablet_service.cc:1511] Processing CreateTablet for tablet cf070d83a5904025bb0d390a39ebae05 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:10:23.261555 25369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92f679df8187472794ba8595642f63f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.260123 25422 tablet_bootstrap.cc:492] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19: No bootstrap required, opened a new log
I20260709 13:10:23.266853 25422 ts_tablet_manager.cc:1403] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19: Time spent bootstrapping tablet: real 0.189s	user 0.015s	sys 0.009s
I20260709 13:10:23.276568 25295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8f924da5ba24241866fed885eb63eff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.277675 25419 tablet_bootstrap.cc:654] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:23.286664 25366 tablet_service.cc:1511] Processing CreateTablet for tablet 08c29bb25d6947ddaa43c22713738514 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:10:23.287943 25366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08c29bb25d6947ddaa43c22713738514. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.291800 25216 tablet_service.cc:1511] Processing CreateTablet for tablet ca662cfcc5084384a1da94266546eabc (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:10:23.293771 25423 raft_consensus.cc:493] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.294216 25423 raft_consensus.cc:515] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:10:23.296356 25365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5a4e5911cd2414daf6cc0bc2a692a69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.298476 25294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51ecc4484385405c857b3bee1077c36a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.299188 25213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51ecc4484385405c857b3bee1077c36a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.299549 25292 tablet_service.cc:1511] Processing CreateTablet for tablet 682caa57052f4e698c0ad75fb393ae75 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:10:23.300741 25292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 682caa57052f4e698c0ad75fb393ae75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.293174 25363 tablet_service.cc:1511] Processing CreateTablet for tablet 0945649a5d1348c6b17e9dd0b67766c9 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:10:23.310420 25363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0945649a5d1348c6b17e9dd0b67766c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.314304 25212 tablet_service.cc:1511] Processing CreateTablet for tablet 682caa57052f4e698c0ad75fb393ae75 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:10:23.316049 25212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 682caa57052f4e698c0ad75fb393ae75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.324756 25423 leader_election.cc:290] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:23.332523 25421 tablet_bootstrap.cc:492] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce: No bootstrap required, opened a new log
I20260709 13:10:23.333084 25421 ts_tablet_manager.cc:1403] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce: Time spent bootstrapping tablet: real 0.371s	user 0.022s	sys 0.009s
I20260709 13:10:23.343966 25255 heartbeater.cc:499] Master 127.23.140.126:37145 was elected leader, sending a full tablet report...
I20260709 13:10:23.354465 25289 tablet_service.cc:1511] Processing CreateTablet for tablet 275226661cc840559134f8c9e5b15719 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:10:23.357276 25364 tablet_service.cc:1511] Processing CreateTablet for tablet e7b1f3db9d83491b8ef3a82b77afbae2 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:10:23.358206 25215 tablet_service.cc:1511] Processing CreateTablet for tablet 3e6da6f96d4a4409be6b8e2b09c861c4 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:10:23.358917 25364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7b1f3db9d83491b8ef3a82b77afbae2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.360298 25361 tablet_service.cc:1511] Processing CreateTablet for tablet 7fd182e135fd4b4db8700ed3173fd000 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:10:23.362476 25218 tablet_service.cc:1511] Processing CreateTablet for tablet a5a4e5911cd2414daf6cc0bc2a692a69 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:10:23.363060 25361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fd182e135fd4b4db8700ed3173fd000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.274060 25290 tablet_service.cc:1511] Processing CreateTablet for tablet b1dbd9bfdb4f4ed582b5d84e9cc7602a (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:10:23.336223 25421 raft_consensus.cc:359] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:10:23.369652 25422 raft_consensus.cc:359] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:23.417783 25422 raft_consensus.cc:385] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:23.417987 25216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca662cfcc5084384a1da94266546eabc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.418231 25422 raft_consensus.cc:740] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Initialized, Role: FOLLOWER
I20260709 13:10:23.419028 25422 consensus_queue.cc:260] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:23.419874 25419 tablet_bootstrap.cc:492] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468: No bootstrap required, opened a new log
I20260709 13:10:23.424211 25419 ts_tablet_manager.cc:1403] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468: Time spent bootstrapping tablet: real 0.259s	user 0.030s	sys 0.023s
I20260709 13:10:23.424702 25287 tablet_service.cc:1511] Processing CreateTablet for tablet 92f679df8187472794ba8595642f63f9 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:10:23.428205 25419 raft_consensus.cc:359] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:23.429191 25419 raft_consensus.cc:385] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:23.429044 25220 tablet_service.cc:1511] Processing CreateTablet for tablet 92f679df8187472794ba8595642f63f9 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:10:23.430181 25215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e6da6f96d4a4409be6b8e2b09c861c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.430276 25330 heartbeater.cc:499] Master 127.23.140.126:37145 was elected leader, sending a full tablet report...
I20260709 13:10:23.413355 25286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf070d83a5904025bb0d390a39ebae05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.429584 25419 raft_consensus.cc:740] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Initialized, Role: FOLLOWER
I20260709 13:10:23.411971 25421 raft_consensus.cc:385] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:23.479821 25421 raft_consensus.cc:740] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Initialized, Role: FOLLOWER
I20260709 13:10:23.481088 25421 consensus_queue.cc:260] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:10:23.444216 25368 tablet_service.cc:1511] Processing CreateTablet for tablet f5c9116c92454e2ab270a148a8c5c4ea (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:10:23.400637 25291 tablet_service.cc:1511] Processing CreateTablet for tablet 3e6da6f96d4a4409be6b8e2b09c861c4 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:10:23.349452 25288 tablet_service.cc:1511] Processing CreateTablet for tablet a5a4e5911cd2414daf6cc0bc2a692a69 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:10:23.472551 25217 tablet_service.cc:1511] Processing CreateTablet for tablet 275226661cc840559134f8c9e5b15719 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:10:23.478102 25220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92f679df8187472794ba8595642f63f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.479499 25290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1dbd9bfdb4f4ed582b5d84e9cc7602a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.489624 25287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92f679df8187472794ba8595642f63f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.489817 25368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5c9116c92454e2ab270a148a8c5c4ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.491739 25291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e6da6f96d4a4409be6b8e2b09c861c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.494793 25217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 275226661cc840559134f8c9e5b15719. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.481822 25360 tablet_service.cc:1511] Processing CreateTablet for tablet 4e23aac97b6742dab615f0d6e9087e8f (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:10:23.496776 25288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5a4e5911cd2414daf6cc0bc2a692a69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.496992 25360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e23aac97b6742dab615f0d6e9087e8f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:10:23.498507 25113 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 80965.9us
W20260709 13:10:23.500384 25114 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 57586.1us
I20260709 13:10:23.502027 25419 consensus_queue.cc:260] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:23.504366 25419 ts_tablet_manager.cc:1434] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468: Time spent starting tablet: real 0.080s	user 0.008s	sys 0.000s
I20260709 13:10:23.505307 25419 tablet_bootstrap.cc:492] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468: Bootstrap starting.
I20260709 13:10:23.512910 25218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5a4e5911cd2414daf6cc0bc2a692a69. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:10:23.522117 25115 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 59184.5us
I20260709 13:10:23.530211 25219 tablet_service.cc:1511] Processing CreateTablet for tablet 0945649a5d1348c6b17e9dd0b67766c9 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:10:23.532099 25219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0945649a5d1348c6b17e9dd0b67766c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.544214 25289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 275226661cc840559134f8c9e5b15719. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.541608 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:23.546415 25230 raft_consensus.cc:2468] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 0.
I20260709 13:10:23.549263 25345 leader_election.cc:304] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:10:23.550058 25421 ts_tablet_manager.cc:1434] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce: Time spent starting tablet: real 0.217s	user 0.011s	sys 0.000s
I20260709 13:10:23.550173 25423 raft_consensus.cc:2804] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:23.550573 25423 raft_consensus.cc:493] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:23.550911 25423 raft_consensus.cc:3060] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:23.558657 25422 ts_tablet_manager.cc:1434] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19: Time spent starting tablet: real 0.291s	user 0.019s	sys 0.031s
I20260709 13:10:23.559659 25422 tablet_bootstrap.cc:492] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19: Bootstrap starting.
I20260709 13:10:23.584324 25369 tablet_service.cc:1511] Processing CreateTablet for tablet 57009a57e25248a39037d8922bf47bf2 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:10:23.585711 25369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57009a57e25248a39037d8922bf47bf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.596517 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:23.597606 25218 tablet_service.cc:1511] Processing CreateTablet for tablet e7b1f3db9d83491b8ef3a82b77afbae2 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
W20260709 13:10:23.598238 25343 leader_election.cc:343] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:23.598903 25218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7b1f3db9d83491b8ef3a82b77afbae2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.556770 25421 tablet_bootstrap.cc:492] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce: Bootstrap starting.
I20260709 13:10:23.604856 25362 tablet_service.cc:1511] Processing CreateTablet for tablet 88997763405742ee8b8e6b43d7392c1f (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:10:23.608771 25422 tablet_bootstrap.cc:654] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:23.611399 25361 tablet_service.cc:1511] Processing CreateTablet for tablet 9cae37d53acd4bcdbe2fa0bd91b36cc4 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:10:23.621392 25423 raft_consensus.cc:515] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:10:23.622577 25289 tablet_service.cc:1511] Processing CreateTablet for tablet 0945649a5d1348c6b17e9dd0b67766c9 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:10:23.625388 25211 tablet_service.cc:1511] Processing CreateTablet for tablet 08c29bb25d6947ddaa43c22713738514 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:10:23.625638 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:10:23.626462 25230 raft_consensus.cc:3060] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:23.626744 25211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08c29bb25d6947ddaa43c22713738514. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.632112 25292 tablet_service.cc:1511] Processing CreateTablet for tablet 08c29bb25d6947ddaa43c22713738514 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:10:23.633466 25230 raft_consensus.cc:2468] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 1.
I20260709 13:10:23.634621 25345 leader_election.cc:304] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:10:23.638411 25212 tablet_service.cc:1511] Processing CreateTablet for tablet f5c9116c92454e2ab270a148a8c5c4ea (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:10:23.639681 25212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5c9116c92454e2ab270a148a8c5c4ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.639815 25368 tablet_service.cc:1511] Processing CreateTablet for tablet 80b4c44a28264d36a06c367b324ac4b4 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:10:23.641625 25216 tablet_service.cc:1511] Processing CreateTablet for tablet 4e23aac97b6742dab615f0d6e9087e8f (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:10:23.642731 25368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80b4c44a28264d36a06c367b324ac4b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.642817 25216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e23aac97b6742dab615f0d6e9087e8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.645606 25423 leader_election.cc:290] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:23.646198 25423 raft_consensus.cc:2804] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:23.646770 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:10:23.647425 25419 tablet_bootstrap.cc:654] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:23.648116 25343 leader_election.cc:343] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:23.646634 25423 raft_consensus.cc:697] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:10:23.650458 25423 consensus_queue.cc:237] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:10:23.655606 25293 tablet_service.cc:1511] Processing CreateTablet for tablet e7b1f3db9d83491b8ef3a82b77afbae2 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:10:23.635447 25289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0945649a5d1348c6b17e9dd0b67766c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.658259 25293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7b1f3db9d83491b8ef3a82b77afbae2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.660084 25421 tablet_bootstrap.cc:654] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:23.656559 25362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88997763405742ee8b8e6b43d7392c1f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:10:23.692142 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 57608.5us
I20260709 13:10:23.693626 25219 tablet_service.cc:1511] Processing CreateTablet for tablet 9cae37d53acd4bcdbe2fa0bd91b36cc4 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:10:23.635965 25218 tablet_service.cc:1511] Processing CreateTablet for tablet 7fd182e135fd4b4db8700ed3173fd000 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:10:23.663385 25214 tablet_service.cc:1511] Processing CreateTablet for tablet 57009a57e25248a39037d8922bf47bf2 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:10:23.705816 25214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57009a57e25248a39037d8922bf47bf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.709110 25286 tablet_service.cc:1511] Processing CreateTablet for tablet 57009a57e25248a39037d8922bf47bf2 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:10:23.698120 25294 tablet_service.cc:1511] Processing CreateTablet for tablet 4e23aac97b6742dab615f0d6e9087e8f (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:10:23.666306 25364 tablet_service.cc:1511] Processing CreateTablet for tablet af9115771e334c95a7dec25c698514dc (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:10:23.699366 25215 tablet_service.cc:1511] Processing CreateTablet for tablet 88997763405742ee8b8e6b43d7392c1f (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:10:23.673451 25365 tablet_service.cc:1511] Processing CreateTablet for tablet ea5abc7f78c6412885cf5a12e2a9ee6c (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:10:23.711040 25218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fd182e135fd4b4db8700ed3173fd000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.711807 25215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88997763405742ee8b8e6b43d7392c1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.713171 25219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cae37d53acd4bcdbe2fa0bd91b36cc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.718040 25360 tablet_service.cc:1511] Processing CreateTablet for tablet 7ef45c031fc345b2917194ea453a14e3 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:10:23.719084 25213 tablet_service.cc:1511] Processing CreateTablet for tablet 80b4c44a28264d36a06c367b324ac4b4 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:10:23.722259 25213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80b4c44a28264d36a06c367b324ac4b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.691349 25292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08c29bb25d6947ddaa43c22713738514. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.720049 25365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea5abc7f78c6412885cf5a12e2a9ee6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.726907 25212 tablet_service.cc:1511] Processing CreateTablet for tablet af9115771e334c95a7dec25c698514dc (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:10:23.731148 25295 tablet_service.cc:1511] Processing CreateTablet for tablet 7fd182e135fd4b4db8700ed3173fd000 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:10:23.731762 25287 tablet_service.cc:1511] Processing CreateTablet for tablet 88997763405742ee8b8e6b43d7392c1f (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:10:23.738656 25422 tablet_bootstrap.cc:492] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19: No bootstrap required, opened a new log
I20260709 13:10:23.748240 25422 ts_tablet_manager.cc:1403] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19: Time spent bootstrapping tablet: real 0.188s	user 0.021s	sys 0.024s
I20260709 13:10:23.748968 25367 tablet_service.cc:1511] Processing CreateTablet for tablet 6e2ea64fbf1c4f6db8eda01c8d9ac433 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:10:23.749158 25290 tablet_service.cc:1511] Processing CreateTablet for tablet f5c9116c92454e2ab270a148a8c5c4ea (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:10:23.757282 25294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e23aac97b6742dab615f0d6e9087e8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.758165 25217 tablet_service.cc:1511] Processing CreateTablet for tablet ea5abc7f78c6412885cf5a12e2a9ee6c (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:10:23.759867 25212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af9115771e334c95a7dec25c698514dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.760190 25287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88997763405742ee8b8e6b43d7392c1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.762036 25286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57009a57e25248a39037d8922bf47bf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.751348 25422 raft_consensus.cc:359] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:10:23.723888 25366 tablet_service.cc:1511] Processing CreateTablet for tablet 477bcdc75e8c43318d410716549fefd7 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:10:23.773893 25290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5c9116c92454e2ab270a148a8c5c4ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.774586 25295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fd182e135fd4b4db8700ed3173fd000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.765834 25361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cae37d53acd4bcdbe2fa0bd91b36cc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.777432 25220 tablet_service.cc:1511] Processing CreateTablet for tablet 7ef45c031fc345b2917194ea453a14e3 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:10:23.778357 25360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ef45c031fc345b2917194ea453a14e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.751276 25216 tablet_service.cc:1511] Processing CreateTablet for tablet 477bcdc75e8c43318d410716549fefd7 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:10:23.780987 25366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 477bcdc75e8c43318d410716549fefd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.781054 25291 tablet_service.cc:1511] Processing CreateTablet for tablet 9cae37d53acd4bcdbe2fa0bd91b36cc4 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:10:23.783054 25125 catalog_manager.cc:5697] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 1 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:23.785713 25367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e2ea64fbf1c4f6db8eda01c8d9ac433. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.791955 25421 tablet_bootstrap.cc:492] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce: No bootstrap required, opened a new log
I20260709 13:10:23.792454 25421 ts_tablet_manager.cc:1403] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce: Time spent bootstrapping tablet: real 0.241s	user 0.011s	sys 0.023s
I20260709 13:10:23.794809 25291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cae37d53acd4bcdbe2fa0bd91b36cc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.799548 25421 raft_consensus.cc:359] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:23.800297 25421 raft_consensus.cc:385] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:23.800580 25421 raft_consensus.cc:740] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Initialized, Role: FOLLOWER
I20260709 13:10:23.802677 25363 tablet_service.cc:1511] Processing CreateTablet for tablet c279dfc4b0d248a4a884e78a33fd437c (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:10:23.804445 25369 tablet_service.cc:1511] Processing CreateTablet for tablet e39a4f04fbfc4fb3a4b2057ad9cb8c88 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:10:23.807091 25368 tablet_service.cc:1511] Processing CreateTablet for tablet 87fad5b7d561432b9e669ef42e8b145b (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:10:23.820407 25293 tablet_service.cc:1511] Processing CreateTablet for tablet 477bcdc75e8c43318d410716549fefd7 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:10:23.784464 25422 raft_consensus.cc:385] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:23.844894 25422 raft_consensus.cc:740] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Initialized, Role: FOLLOWER
I20260709 13:10:23.845839 25422 consensus_queue.cc:260] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:10:23.829721 25288 tablet_service.cc:1511] Processing CreateTablet for tablet 80b4c44a28264d36a06c367b324ac4b4 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:10:23.831291 25218 tablet_service.cc:1511] Processing CreateTablet for tablet c279dfc4b0d248a4a884e78a33fd437c (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:10:23.831661 25431 raft_consensus.cc:493] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.848297 25431 raft_consensus.cc:515] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:23.832451 25419 tablet_bootstrap.cc:492] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468: No bootstrap required, opened a new log
I20260709 13:10:23.833706 25289 tablet_service.cc:1511] Processing CreateTablet for tablet af9115771e334c95a7dec25c698514dc (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:10:23.834412 25364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af9115771e334c95a7dec25c698514dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.835497 25211 tablet_service.cc:1511] Processing CreateTablet for tablet e39a4f04fbfc4fb3a4b2057ad9cb8c88 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:10:23.801296 25421 consensus_queue.cc:260] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:23.838124 25293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 477bcdc75e8c43318d410716549fefd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.823657 25217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea5abc7f78c6412885cf5a12e2a9ee6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.865763 25432 raft_consensus.cc:493] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.865564 25215 tablet_service.cc:1511] Processing CreateTablet for tablet 87fad5b7d561432b9e669ef42e8b145b (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:10:23.866257 25432 raft_consensus.cc:515] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:23.858275 25419 ts_tablet_manager.cc:1403] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468: Time spent bootstrapping tablet: real 0.353s	user 0.011s	sys 0.022s
I20260709 13:10:23.872622 25419 raft_consensus.cc:359] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:23.873338 25419 raft_consensus.cc:385] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:23.874042 25423 raft_consensus.cc:493] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.873631 25419 raft_consensus.cc:740] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Initialized, Role: FOLLOWER
I20260709 13:10:23.876701 25423 raft_consensus.cc:515] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:23.881870 25369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e39a4f04fbfc4fb3a4b2057ad9cb8c88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.885192 25423 leader_election.cc:290] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:23.885507 25216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 477bcdc75e8c43318d410716549fefd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.886200 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:23.886467 25360 tablet_service.cc:1511] Processing CreateTablet for tablet 11892dffe99a496ebf3d98773631357c (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:10:23.887050 25220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ef45c031fc345b2917194ea453a14e3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:10:23.887557 25345 leader_election.cc:343] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:23.887830 25360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11892dffe99a496ebf3d98773631357c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.888255 25431 leader_election.cc:290] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:23.893158 25422 ts_tablet_manager.cc:1434] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19: Time spent starting tablet: real 0.145s	user 0.020s	sys 0.008s
I20260709 13:10:23.890650 25288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80b4c44a28264d36a06c367b324ac4b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.900102 25363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c279dfc4b0d248a4a884e78a33fd437c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.900645 25419 consensus_queue.cc:260] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:23.902854 25419 ts_tablet_manager.cc:1434] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 13:10:23.903789 25419 tablet_bootstrap.cc:492] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468: Bootstrap starting.
I20260709 13:10:23.905282 25361 tablet_service.cc:1511] Processing CreateTablet for tablet e74320a7302d4cd8b705dce5d385079a (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:10:23.906524 25432 leader_election.cc:290] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:23.906503 25361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e74320a7302d4cd8b705dce5d385079a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.907740 25422 tablet_bootstrap.cc:492] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19: Bootstrap starting.
I20260709 13:10:23.917021 25211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e39a4f04fbfc4fb3a4b2057ad9cb8c88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.921162 25289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af9115771e334c95a7dec25c698514dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.931496 25290 tablet_service.cc:1511] Processing CreateTablet for tablet 7ef45c031fc345b2917194ea453a14e3 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:10:23.939828 25219 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:58402 (request call id 37) took 1030 ms. Trace:
I20260709 13:10:23.940302 25219 rpcz_store.cc:276] 0709 13:10:22.909902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.692752 (+782850us) service_pool.cc:224] Handling call
0709 13:10:23.712340 (+ 19588us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:10:23.712534 (+   194us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:10:23.803908 (+ 91374us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:23.929896 (+125988us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:23.939455 (+  9559us) spinlock_profiling.cc:243] Waited 6.48 ms on lock 0x7b5800002a98. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72cb4ab71 00007fd72cb4b1a2 00007fd735a8cbb9 00007fd734bbdd88 00007fd734c84973 00007fd734c8070f 00007fd734c80ecd 00007fd734c2f400 00007fd72e0b4af4 00007fd72e0b4a82
0709 13:10:23.939763 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14909312}
I20260709 13:10:23.945966 25366 tablet_service.cc:1511] Processing CreateTablet for tablet 135bcb58ad5b4506a12d94ef2b0d824c (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:10:23.946519 25369 tablet_service.cc:1511] Processing CreateTablet for tablet a1eeb9f9696c44b9b744d926cf3312ff (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:10:23.948069 25219 tablet_service.cc:1511] Processing CreateTablet for tablet 11892dffe99a496ebf3d98773631357c (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:10:23.891690 25214 tablet_service.cc:1511] Processing CreateTablet for tablet 6e2ea64fbf1c4f6db8eda01c8d9ac433 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:10:23.950811 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:23.958012 25215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87fad5b7d561432b9e669ef42e8b145b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.958719 25214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e2ea64fbf1c4f6db8eda01c8d9ac433. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.960726 25421 ts_tablet_manager.cc:1434] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce: Time spent starting tablet: real 0.168s	user 0.015s	sys 0.001s
I20260709 13:10:23.961817 25290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ef45c031fc345b2917194ea453a14e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.963526 25439 raft_consensus.cc:493] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.964010 25439 raft_consensus.cc:515] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:10:23.966461 25218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c279dfc4b0d248a4a884e78a33fd437c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.967857 25439 leader_election.cc:290] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361)
I20260709 13:10:23.969381 25421 tablet_bootstrap.cc:492] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce: Bootstrap starting.
I20260709 13:10:23.970466 25367 tablet_service.cc:1511] Processing CreateTablet for tablet 7e85321bc6774ed28bf79ebfd5eae6e0 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:10:23.973572 25368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87fad5b7d561432b9e669ef42e8b145b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.973301 25362 tablet_service.cc:1511] Processing CreateTablet for tablet 67fb9a2520c542d38f72828988ddc804 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
W20260709 13:10:23.976620 25343 leader_election.cc:343] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:23.916534 25287 tablet_service.cc:1511] Processing CreateTablet for tablet ea5abc7f78c6412885cf5a12e2a9ee6c (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:10:23.977113 25343 leader_election.cc:304] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:10:23.977618 25362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67fb9a2520c542d38f72828988ddc804. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.983166 25366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 135bcb58ad5b4506a12d94ef2b0d824c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.982941 25286 tablet_service.cc:1511] Processing CreateTablet for tablet 6e2ea64fbf1c4f6db8eda01c8d9ac433 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:10:23.979619 25423 raft_consensus.cc:2749] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:23.984750 25287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea5abc7f78c6412885cf5a12e2a9ee6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.985432 25367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e85321bc6774ed28bf79ebfd5eae6e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.985653 25286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e2ea64fbf1c4f6db8eda01c8d9ac433. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.987100 25294 tablet_service.cc:1511] Processing CreateTablet for tablet 87fad5b7d561432b9e669ef42e8b145b (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:10:23.987834 25369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1eeb9f9696c44b9b744d926cf3312ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.988255 25219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11892dffe99a496ebf3d98773631357c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.988335 25294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87fad5b7d561432b9e669ef42e8b145b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.985273 25291 tablet_service.cc:1511] Processing CreateTablet for tablet e39a4f04fbfc4fb3a4b2057ad9cb8c88 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:10:24.000324 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:24.010896 25422 tablet_bootstrap.cc:654] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:24.014216 25291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e39a4f04fbfc4fb3a4b2057ad9cb8c88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.021890 25367 tablet_service.cc:1511] Processing CreateTablet for tablet ec256e9cce1249a995955c75b0c977cc (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:10:24.022338 25290 tablet_service.cc:1511] Processing CreateTablet for tablet 11892dffe99a496ebf3d98773631357c (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:10:24.030182 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:24.034224 25229 raft_consensus.cc:2393] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 1: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:10:24.035841 25290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11892dffe99a496ebf3d98773631357c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.039652 25215 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:58402 (request call id 46) took 1086 ms. Trace:
I20260709 13:10:24.040087 25215 rpcz_store.cc:276] 0709 13:10:22.953550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.848997 (+895447us) service_pool.cc:224] Handling call
0709 13:10:23.900160 (+ 51163us) spinlock_profiling.cc:243] Waited 9.56 ms on lock 0x7b5800002a98. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72cb4ab71 00007fd72cb4aa22 00007fd735a63c09 00007fd734bbdee0 00007fd734ca3831 00007fd734c80ac3 00007fd734c2f400 00007fd72e0b4af4 00007fd72e0b4a82 00007fd72e0b49b1
0709 13:10:23.900307 (+   147us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:10:23.900394 (+    87us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:10:24.032312 (+131918us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:24.039095 (+  6783us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:24.039590 (+   495us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21985024}
I20260709 13:10:24.042906 25292 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:57250 (request call id 30) took 1053 ms. Trace:
I20260709 13:10:24.043267 25215 tablet_service.cc:1511] Processing CreateTablet for tablet 67fb9a2520c542d38f72828988ddc804 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:10:24.043315 25292 rpcz_store.cc:276] 0709 13:10:22.989737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.631180 (+641443us) service_pool.cc:224] Handling call
0709 13:10:23.632988 (+  1808us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:10:23.633079 (+    91us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:10:23.944691 (+311612us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:24.042439 (+ 97748us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:24.042850 (+   411us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.044749 25215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67fb9a2520c542d38f72828988ddc804. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.995754 25295 tablet_service.cc:1511] Processing CreateTablet for tablet c279dfc4b0d248a4a884e78a33fd437c (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:10:24.046674 25295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c279dfc4b0d248a4a884e78a33fd437c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.045306 25292 tablet_service.cc:1511] Processing CreateTablet for tablet 67fb9a2520c542d38f72828988ddc804 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:10:24.065299 25419 tablet_bootstrap.cc:654] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:24.066444 25367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec256e9cce1249a995955c75b0c977cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.085491 25290 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:57250 (request call id 47) took 1030 ms. Trace:
I20260709 13:10:24.085903 25290 rpcz_store.cc:276] 0709 13:10:23.055527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.021316 (+965789us) service_pool.cc:224] Handling call
0709 13:10:24.035379 (+ 14063us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:10:24.035497 (+   118us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:10:24.051171 (+ 15674us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:24.084998 (+ 33827us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:24.085430 (+   432us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.087807 25290 tablet_service.cc:1511] Processing CreateTablet for tablet e74320a7302d4cd8b705dce5d385079a (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:10:24.073105 25217 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:58402 (request call id 41) took 1135 ms. Trace:
I20260709 13:10:24.089164 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:24.089082 25217 rpcz_store.cc:276] 0709 13:10:22.937630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.756823 (+819193us) service_pool.cc:224] Handling call
0709 13:10:23.759268 (+  2445us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:10:23.759381 (+   113us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:10:24.050832 (+291451us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:24.057720 (+  6888us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:24.071843 (+ 14123us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:24.091004 25195 leader_election.cc:343] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:24.091778 25217 tablet_service.cc:1511] Processing CreateTablet for tablet e74320a7302d4cd8b705dce5d385079a (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:10:24.096175 25217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e74320a7302d4cd8b705dce5d385079a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.101991 25369 tablet_service.cc:1511] Processing CreateTablet for tablet 60f74f1604ed4390892e271c77fd0f07 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:10:24.103068 25369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60f74f1604ed4390892e271c77fd0f07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.116365 25213 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:58402 (request call id 38) took 1202 ms. Trace:
I20260709 13:10:24.116792 25213 rpcz_store.cc:276] 0709 13:10:22.914367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.718211 (+803844us) service_pool.cc:224] Handling call
0709 13:10:23.719903 (+  1692us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:10:23.719990 (+    87us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:10:24.055828 (+335838us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:24.115867 (+ 60039us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:24.116292 (+   425us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.119407 25213 tablet_service.cc:1511] Processing CreateTablet for tablet 7e85321bc6774ed28bf79ebfd5eae6e0 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:10:24.124220 25213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e85321bc6774ed28bf79ebfd5eae6e0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:10:24.125043 25271 leader_election.cc:343] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:24.125546 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 118638us
I20260709 13:10:24.127038 25305 raft_consensus.cc:3060] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:24.128026 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:24.128789 25212 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:58402 (request call id 39) took 1210 ms. Trace:
I20260709 13:10:24.129154 25212 rpcz_store.cc:276] 0709 13:10:22.918816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.726065 (+807249us) service_pool.cc:224] Handling call
0709 13:10:23.751718 (+ 25653us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:10:23.752570 (+   852us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:10:23.819573 (+ 67003us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:24.075664 (+256091us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:24.128735 (+ 53071us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.131036 25212 tablet_service.cc:1511] Processing CreateTablet for tablet 135bcb58ad5b4506a12d94ef2b0d824c (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
W20260709 13:10:24.131794 25175 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:24.132167 25212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 135bcb58ad5b4506a12d94ef2b0d824c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.135310 25360 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36248 (request call id 47) took 1090 ms. Trace:
I20260709 13:10:24.135996 25360 rpcz_store.cc:276] 0709 13:10:23.045338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.874071 (+828733us) service_pool.cc:224] Handling call
0709 13:10:23.887358 (+ 13287us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:10:23.887468 (+   110us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:10:24.124082 (+236614us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:24.134390 (+ 10308us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:24.135222 (+   832us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.137107 25421 tablet_bootstrap.cc:654] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:24.142856 25364 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36248 (request call id 39) took 1182 ms. Trace:
I20260709 13:10:24.143236 25364 rpcz_store.cc:276] 0709 13:10:22.960343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.664774 (+704431us) service_pool.cc:224] Handling call
0709 13:10:23.710177 (+ 45403us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:10:23.710259 (+    82us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:10:24.109099 (+398840us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:24.142316 (+ 33217us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:24.142798 (+   482us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.144052 25288 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:57250 (request call id 38) took 1124 ms. Trace:
I20260709 13:10:24.146876 25364 tablet_service.cc:1511] Processing CreateTablet for tablet 0adcdb50fe9647b0abfa936e9cb73727 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:10:24.148065 25364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0adcdb50fe9647b0abfa936e9cb73727. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.150514 25293 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:57250 (request call id 40) took 1130 ms. Trace:
I20260709 13:10:24.150871 25293 rpcz_store.cc:276] 0709 13:10:23.020429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.819449 (+799020us) service_pool.cc:224] Handling call
0709 13:10:23.822742 (+  3293us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:10:23.826049 (+  3307us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:10:24.098345 (+272296us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:24.150060 (+ 51715us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:24.150461 (+   401us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.154289 25216 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:58402 (request call id 40) took 1217 ms. Trace:
I20260709 13:10:24.154449 25218 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:58402 (request call id 44) took 1201 ms. Trace:
I20260709 13:10:24.154681 25216 rpcz_store.cc:276] 0709 13:10:22.937228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.750428 (+813200us) service_pool.cc:224] Handling call
0709 13:10:23.778978 (+ 28550us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:10:23.779074 (+    96us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:10:24.055823 (+276749us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:24.153822 (+ 97999us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:24.154234 (+   412us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.154853 25218 rpcz_store.cc:276] 0709 13:10:22.952910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.830419 (+877509us) service_pool.cc:224] Handling call
0709 13:10:23.847762 (+ 17343us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:10:23.847864 (+   102us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:10:24.037714 (+189850us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:24.153965 (+116251us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:24.154393 (+   428us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.164475 25220 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:58402 (request call id 42) took 1212 ms. Trace:
I20260709 13:10:24.164856 25220 rpcz_store.cc:276] 0709 13:10:22.952273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.776489 (+824216us) service_pool.cc:224] Handling call
0709 13:10:23.778282 (+  1793us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:10:23.778370 (+    88us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:10:24.086526 (+308156us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:24.163992 (+ 77466us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:24.164417 (+   425us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:24.166030 25194 leader_election.cc:343] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:24.166527 25194 leader_election.cc:304] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:10:24.167788 25441 raft_consensus.cc:2749] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:24.159319 25292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67fb9a2520c542d38f72828988ddc804. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.169086 25291 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:57250 (request call id 45) took 1114 ms. Trace:
I20260709 13:10:24.170053 25290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e74320a7302d4cd8b705dce5d385079a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.144440 25288 rpcz_store.cc:276] 0709 13:10:23.019788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.827014 (+807226us) service_pool.cc:224] Handling call
0709 13:10:23.859249 (+ 32235us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:10:23.874767 (+ 15518us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:10:24.060794 (+186027us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:24.143614 (+ 82820us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:24.143996 (+   382us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.179963 25423 raft_consensus.cc:493] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.180413 25423 raft_consensus.cc:515] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.160243 25289 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:57250 (request call id 39) took 1139 ms. Trace:
I20260709 13:10:24.186188 25423 leader_election.cc:290] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:24.187039 25295 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:57250 (request call id 44) took 1165 ms. Trace:
I20260709 13:10:24.182408 25369 tablet_service.cc:1511] Processing CreateTablet for tablet cc7fda8ece3144099df1f442c8012dfd (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:10:24.169456 25291 rpcz_store.cc:276] 0709 13:10:23.054736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.984327 (+929591us) service_pool.cc:224] Handling call
0709 13:10:24.002245 (+ 17918us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:10:24.006040 (+  3795us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:10:24.162320 (+156280us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:24.168577 (+  6257us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:24.169028 (+   451us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.192368 25369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc7fda8ece3144099df1f442c8012dfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.187374 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:24.177211 25368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36248 (request call id 46) took 1203 ms. Trace:
I20260709 13:10:24.177673 25363 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36248 (request call id 44) took 1216 ms. Trace:
W20260709 13:10:24.200477 25343 leader_election.cc:343] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:24.204413 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:24.200709 25423 consensus_queue.cc:1048] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
W20260709 13:10:24.206959 25345 leader_election.cc:343] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:24.207216 25211 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:58402 (request call id 45) took 1254 ms. Trace:
I20260709 13:10:24.207579 25345 leader_election.cc:304] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:10:24.207619 25211 rpcz_store.cc:276] 0709 13:10:22.953197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.834635 (+881438us) service_pool.cc:224] Handling call
0709 13:10:23.874736 (+ 40101us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:10:23.877903 (+  3167us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:10:24.151429 (+273526us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:24.206699 (+ 55270us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:24.207160 (+   461us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.187780 25289 rpcz_store.cc:276] 0709 13:10:23.020138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.832845 (+812707us) service_pool.cc:224] Handling call
0709 13:10:23.876806 (+ 43961us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:10:23.879324 (+  2518us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:10:24.000571 (+121247us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:24.141421 (+140850us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:24.159442 (+ 18021us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.175860 25361 tablet_service.cc:1511] Processing CreateTablet for tablet 0bcff15b40224dcaa2c76d2c4fd3b27b (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:10:24.218791 25361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bcff15b40224dcaa2c76d2c4fd3b27b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.222282 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:24.222569 25220 tablet_service.cc:1511] Processing CreateTablet for tablet ec256e9cce1249a995955c75b0c977cc (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:10:24.222832 25423 raft_consensus.cc:2749] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:24.222322 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:24.223821 25220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec256e9cce1249a995955c75b0c977cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.225167 25270 leader_election.cc:304] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:10:24.226302 25214 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:58402 (request call id 43) took 1273 ms. Trace:
W20260709 13:10:24.226414 25270 leader_election.cc:343] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:24.227032 25270 leader_election.cc:304] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:10:24.227422 25439 raft_consensus.cc:2749] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:24.227923 25431 raft_consensus.cc:2749] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:24.228514 25423 consensus_queue.cc:1048] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:24.160640 25360 tablet_service.cc:1511] Processing CreateTablet for tablet ad01a612dc964dd3ae0b3f179ac0ad9e (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:10:24.229076 25286 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:57250 (request call id 43) took 1207 ms. Trace:
I20260709 13:10:24.228788 25289 tablet_service.cc:1511] Processing CreateTablet for tablet a1eeb9f9696c44b9b744d926cf3312ff (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:10:24.229434 25286 rpcz_store.cc:276] 0709 13:10:23.021299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.981997 (+960698us) service_pool.cc:224] Handling call
0709 13:10:23.983750 (+  1753us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:10:23.983839 (+    89us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:10:24.091394 (+107555us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:24.195924 (+104530us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:24.228736 (+ 32812us) spinlock_profiling.cc:243] Waited 3.35 ms on lock 0x7b5800114098. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72cb4ab71 00007fd72cb4b1a2 00007fd735a8cbb9 00007fd734bbdd88 00007fd734c84973 00007fd734c8070f 00007fd734c80ecd 00007fd734c2f400 00007fd72e0b4af4 00007fd72e0b4a82
0709 13:10:24.229016 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7710080}
I20260709 13:10:24.231580 25286 tablet_service.cc:1511] Processing CreateTablet for tablet 60f74f1604ed4390892e271c77fd0f07 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:10:24.231992 25422 tablet_bootstrap.cc:492] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19: No bootstrap required, opened a new log
I20260709 13:10:24.229692 25360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad01a612dc964dd3ae0b3f179ac0ad9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.232738 25294 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:57250 (request call id 46) took 1157 ms. Trace:
I20260709 13:10:24.199822 25368 rpcz_store.cc:276] 0709 13:10:22.974244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.806201 (+831957us) service_pool.cc:224] Handling call
0709 13:10:23.822044 (+ 15843us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:10:23.822137 (+    93us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:10:24.124726 (+302589us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:24.158326 (+ 33600us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:24.176229 (+ 17903us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.238787 25215 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:58402 (request call id 48) took 1151 ms. Trace:
I20260709 13:10:24.239620 25216 tablet_service.cc:1511] Processing CreateTablet for tablet 60f74f1604ed4390892e271c77fd0f07 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:10:24.230248 25289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1eeb9f9696c44b9b744d926cf3312ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.232591 25422 ts_tablet_manager.cc:1403] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19: Time spent bootstrapping tablet: real 0.339s	user 0.021s	sys 0.022s
I20260709 13:10:24.233333 25294 rpcz_store.cc:276] 0709 13:10:23.055130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.986241 (+931111us) service_pool.cc:224] Handling call
0709 13:10:23.987890 (+  1649us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:10:23.987992 (+   102us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:10:24.035435 (+ 47443us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:24.179136 (+143701us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:24.212121 (+ 32985us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.239161 25215 rpcz_store.cc:276] 0709 13:10:23.087031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.042282 (+955251us) service_pool.cc:224] Handling call
0709 13:10:24.044260 (+  1978us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:10:24.044370 (+   110us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:10:24.053246 (+  8876us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:24.238183 (+184937us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:24.238733 (+   550us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.187400 25295 rpcz_store.cc:276] 0709 13:10:23.036112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.983661 (+947549us) service_pool.cc:224] Handling call
0709 13:10:24.046239 (+ 62578us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:10:24.046325 (+    86us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:10:24.116286 (+ 69961us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:24.186569 (+ 70283us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:24.186983 (+   414us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.267191 25295 tablet_service.cc:1511] Processing CreateTablet for tablet 0adcdb50fe9647b0abfa936e9cb73727 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:10:24.267493 25215 tablet_service.cc:1511] Processing CreateTablet for tablet 0adcdb50fe9647b0abfa936e9cb73727 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:10:24.268457 25295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0adcdb50fe9647b0abfa936e9cb73727. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.272909 25366 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36248 (request call id 51) took 1044 ms. Trace:
I20260709 13:10:24.234673 25214 rpcz_store.cc:276] 0709 13:10:22.952577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.829223 (+876646us) service_pool.cc:224] Handling call
0709 13:10:23.958283 (+129060us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:10:23.958373 (+    90us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:10:24.161316 (+202943us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:24.225655 (+ 64339us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:24.226229 (+   574us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.275961 25292 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:57250 (request call id 48) took 1187 ms. Trace:
I20260709 13:10:24.275831 25214 tablet_service.cc:1511] Processing CreateTablet for tablet 0bcff15b40224dcaa2c76d2c4fd3b27b (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:10:24.257266 25291 tablet_service.cc:1511] Processing CreateTablet for tablet ec256e9cce1249a995955c75b0c977cc (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:10:24.276299 25292 rpcz_store.cc:276] 0709 13:10:23.088902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.044435 (+955533us) service_pool.cc:224] Handling call
0709 13:10:24.070515 (+ 26080us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:10:24.075274 (+  4759us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:10:24.231319 (+156045us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:24.275360 (+ 44041us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:24.275901 (+   541us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.274116 25293 tablet_service.cc:1511] Processing CreateTablet for tablet 7e85321bc6774ed28bf79ebfd5eae6e0 (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:10:24.277362 25291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec256e9cce1249a995955c75b0c977cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.259081 25294 tablet_service.cc:1511] Processing CreateTablet for tablet ad01a612dc964dd3ae0b3f179ac0ad9e (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:10:24.278113 25293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e85321bc6774ed28bf79ebfd5eae6e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.259433 25213 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:58402 (request call id 50) took 1105 ms. Trace:
I20260709 13:10:24.278524 25213 rpcz_store.cc:276] 0709 13:10:23.153987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.118496 (+964509us) service_pool.cc:224] Handling call
0709 13:10:24.120159 (+  1663us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:10:24.122931 (+  2772us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:10:24.136303 (+ 13372us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:24.203648 (+ 67345us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:24.259376 (+ 55728us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.205091 25288 tablet_service.cc:1511] Processing CreateTablet for tablet 135bcb58ad5b4506a12d94ef2b0d824c (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:10:24.280099 25288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 135bcb58ad5b4506a12d94ef2b0d824c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.280912 25287 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:57250 (request call id 41) took 1260 ms. Trace:
I20260709 13:10:24.282912 25213 tablet_service.cc:1511] Processing CreateTablet for tablet cc7fda8ece3144099df1f442c8012dfd (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:10:24.288275 25422 raft_consensus.cc:359] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.289004 25422 raft_consensus.cc:385] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:24.273283 25366 rpcz_store.cc:276] 0709 13:10:23.228909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.944321 (+715412us) service_pool.cc:224] Handling call
0709 13:10:23.946790 (+  2469us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:10:23.946878 (+    88us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:10:24.157701 (+210823us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:24.272366 (+114665us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:24.272851 (+   485us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.289281 25422 raft_consensus.cc:740] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Initialized, Role: FOLLOWER
I20260709 13:10:24.290050 25365 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36248 (request call id 41) took 1329 ms. Trace:
I20260709 13:10:24.290421 25365 rpcz_store.cc:276] 0709 13:10:22.960880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.672547 (+711667us) service_pool.cc:224] Handling call
0709 13:10:23.710926 (+ 38379us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:10:23.711000 (+    74us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:10:24.168014 (+457014us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:24.200679 (+ 32665us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:24.289988 (+ 89309us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.292624 25362 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36248 (request call id 48) took 1164 ms. Trace:
I20260709 13:10:24.292508 25292 tablet_service.cc:1511] Processing CreateTablet for tablet 0bcff15b40224dcaa2c76d2c4fd3b27b (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:10:24.292989 25362 rpcz_store.cc:276] 0709 13:10:23.128323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.875839 (+747516us) service_pool.cc:224] Handling call
0709 13:10:23.977053 (+101214us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:10:23.977158 (+   105us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:10:24.090599 (+113441us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:24.292165 (+201566us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:24.292570 (+   405us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.293812 25292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bcff15b40224dcaa2c76d2c4fd3b27b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.200418 25363 rpcz_store.cc:276] 0709 13:10:22.961660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.754418 (+792758us) service_pool.cc:224] Handling call
0709 13:10:23.803469 (+ 49051us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:10:23.803554 (+    85us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:10:24.079724 (+276170us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:24.163806 (+ 84082us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:24.176689 (+ 12883us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10600}
I20260709 13:10:24.298919 25211 tablet_service.cc:1511] Processing CreateTablet for tablet ad01a612dc964dd3ae0b3f179ac0ad9e (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:10:24.299461 25212 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:58402 (request call id 51) took 1078 ms. Trace:
I20260709 13:10:24.300192 25216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60f74f1604ed4390892e271c77fd0f07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.299853 25212 rpcz_store.cc:276] 0709 13:10:23.220599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.130127 (+909528us) service_pool.cc:224] Handling call
0709 13:10:24.131737 (+  1610us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:10:24.131831 (+    94us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:10:24.267830 (+135999us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:24.298975 (+ 31145us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:24.299403 (+   428us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.281265 25287 rpcz_store.cc:276] 0709 13:10:23.020697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.880276 (+859579us) service_pool.cc:224] Handling call
0709 13:10:23.978391 (+ 98115us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:10:23.978476 (+    85us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:10:24.154218 (+175742us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:24.280430 (+126212us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:24.280855 (+   425us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.308864 25286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60f74f1604ed4390892e271c77fd0f07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.274112 25218 tablet_service.cc:1511] Processing CreateTablet for tablet a1eeb9f9696c44b9b744d926cf3312ff (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:10:24.322199 25287 tablet_service.cc:1511] Processing CreateTablet for tablet cc7fda8ece3144099df1f442c8012dfd (DEFAULT_TABLE table=test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:10:24.316126 25289 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:57250 (request call id 52) took 1064 ms. Trace:
I20260709 13:10:24.316983 25419 tablet_bootstrap.cc:492] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468: No bootstrap required, opened a new log
I20260709 13:10:24.323769 25287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc7fda8ece3144099df1f442c8012dfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.323915 25419 ts_tablet_manager.cc:1403] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468: Time spent bootstrapping tablet: real 0.420s	user 0.012s	sys 0.008s
I20260709 13:10:24.326782 25419 raft_consensus.cc:359] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.327484 25419 raft_consensus.cc:385] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:24.327762 25419 raft_consensus.cc:740] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Initialized, Role: FOLLOWER
I20260709 13:10:24.328838 25422 consensus_queue.cc:260] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.328909 25419 consensus_queue.cc:260] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.310387 25211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad01a612dc964dd3ae0b3f179ac0ad9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.330210 25289 rpcz_store.cc:276] 0709 13:10:23.251944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.211642 (+959698us) service_pool.cc:224] Handling call
0709 13:10:24.229816 (+ 18174us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:10:24.229902 (+    86us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:10:24.292009 (+ 62107us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:24.315572 (+ 23563us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:24.316069 (+   497us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.330150 25294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad01a612dc964dd3ae0b3f179ac0ad9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.312199 25219 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:58402 (request call id 47) took 1323 ms. Trace:
I20260709 13:10:24.348408 25288 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:57250 (request call id 51) took 1120 ms. Trace:
I20260709 13:10:24.348789 25288 rpcz_store.cc:276] 0709 13:10:23.227806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.196403 (+968597us) service_pool.cc:224] Handling call
0709 13:10:24.279680 (+ 83277us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:10:24.279767 (+    87us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:10:24.304414 (+ 24647us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:24.347942 (+ 43528us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:24.348349 (+   407us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.349931 25360 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36248 (request call id 55) took 1040 ms. Trace:
I20260709 13:10:24.350618 25213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc7fda8ece3144099df1f442c8012dfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.353094 25214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bcff15b40224dcaa2c76d2c4fd3b27b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.354115 25218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1eeb9f9696c44b9b744d926cf3312ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.354854 25215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0adcdb50fe9647b0abfa936e9cb73727. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.350306 25360 rpcz_store.cc:276] 0709 13:10:23.309122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.141488 (+832366us) service_pool.cc:224] Handling call
0709 13:10:24.229251 (+ 87763us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:10:24.229342 (+    91us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:10:24.296057 (+ 66715us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:24.341067 (+ 45010us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:24.345440 (+  4373us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.358289 25217 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:58402 (request call id 49) took 1226 ms. Trace:
I20260709 13:10:24.358688 25217 rpcz_store.cc:276] 0709 13:10:23.131757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.090827 (+959070us) service_pool.cc:224] Handling call
0709 13:10:24.095482 (+  4655us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:10:24.095721 (+   239us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:10:24.177506 (+ 81785us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:24.344608 (+167102us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:24.358231 (+ 13623us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.371376 25422 ts_tablet_manager.cc:1434] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19: Time spent starting tablet: real 0.117s	user 0.006s	sys 0.000s
I20260709 13:10:24.372417 25422 tablet_bootstrap.cc:492] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19: Bootstrap starting.
I20260709 13:10:24.346120 25219 rpcz_store.cc:276] 0709 13:10:22.989024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.947186 (+958162us) service_pool.cc:224] Handling call
0709 13:10:23.948821 (+  1635us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:10:23.948921 (+   100us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:10:24.148839 (+199918us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:24.293569 (+144730us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:24.310661 (+ 17092us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.396322 25218 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:58402 (request call id 52) took 1146 ms. Trace:
I20260709 13:10:24.396664 25218 rpcz_store.cc:276] 0709 13:10:23.249681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.159478 (+909797us) service_pool.cc:224] Handling call
0709 13:10:24.322720 (+163242us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:10:24.322853 (+   133us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:10:24.390581 (+ 67728us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:24.395981 (+  5400us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:24.396274 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:24.366077 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 48542.8us
I20260709 13:10:24.405009 25290 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:57250 (request call id 49) took 1254 ms. Trace:
I20260709 13:10:24.405408 25290 rpcz_store.cc:276] 0709 13:10:23.150842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.086860 (+936018us) service_pool.cc:224] Handling call
0709 13:10:24.088598 (+  1738us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:10:24.088772 (+   174us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:10:24.285561 (+196789us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:24.404519 (+118958us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:24.404950 (+   431us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.414626 25421 tablet_bootstrap.cc:492] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce: No bootstrap required, opened a new log
I20260709 13:10:24.415126 25421 ts_tablet_manager.cc:1403] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce: Time spent bootstrapping tablet: real 0.446s	user 0.013s	sys 0.016s
I20260709 13:10:24.421695 25367 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36248 (request call id 53) took 1158 ms. Trace:
I20260709 13:10:24.422873 25367 rpcz_store.cc:276] 0709 13:10:23.262560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.020815 (+758255us) service_pool.cc:224] Handling call
0709 13:10:24.022737 (+  1922us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:10:24.022824 (+    87us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:10:24.191276 (+168452us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:24.405507 (+214231us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:24.420668 (+ 15161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.424880 25421 raft_consensus.cc:359] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.425571 25421 raft_consensus.cc:385] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:24.425894 25421 raft_consensus.cc:740] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Initialized, Role: FOLLOWER
I20260709 13:10:24.426672 25421 consensus_queue.cc:260] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.430713 25220 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:58402 (request call id 53) took 1171 ms. Trace:
I20260709 13:10:24.431069 25220 rpcz_store.cc:276] 0709 13:10:23.259653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.178913 (+919260us) service_pool.cc:224] Handling call
0709 13:10:24.223368 (+ 44455us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:10:24.223465 (+    97us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:10:24.361987 (+138522us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:24.430264 (+ 68277us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:24.430660 (+   396us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.435297 25456 raft_consensus.cc:493] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.435428 25293 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:57250 (request call id 50) took 1279 ms. Trace:
I20260709 13:10:24.435796 25456 raft_consensus.cc:515] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.435782 25293 rpcz_store.cc:276] 0709 13:10:23.155971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.176139 (+1020168us) service_pool.cc:224] Handling call
0709 13:10:24.277648 (+101509us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:10:24.277727 (+    79us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:10:24.302960 (+ 25233us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:24.434957 (+131997us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:24.435374 (+   417us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.438035 25456 leader_election.cc:290] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:24.439570 25422 tablet_bootstrap.cc:654] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:24.439566 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:10:24.441069 25343 leader_election.cc:343] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:24.442706 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:10:24.443990 25345 leader_election.cc:343] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:24.444401 25345 leader_election.cc:304] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:10:24.445384 25456 raft_consensus.cc:2749] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:24.446035 25419 ts_tablet_manager.cc:1434] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468: Time spent starting tablet: real 0.122s	user 0.009s	sys 0.004s
I20260709 13:10:24.446563 25421 ts_tablet_manager.cc:1434] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.001s
I20260709 13:10:24.454015 25419 tablet_bootstrap.cc:492] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468: Bootstrap starting.
I20260709 13:10:24.459658 25216 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:58402 (request call id 54) took 1195 ms. Trace:
I20260709 13:10:24.448475 25286 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:57250 (request call id 54) took 1179 ms. Trace:
I20260709 13:10:24.460175 25286 rpcz_store.cc:276] 0709 13:10:23.270371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.230661 (+960290us) service_pool.cc:224] Handling call
0709 13:10:24.232392 (+  1731us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:10:24.232477 (+    85us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:10:24.340394 (+107917us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:24.448128 (+107734us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:24.448430 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.461658 25291 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:57250 (request call id 53) took 1201 ms. Trace:
I20260709 13:10:24.451454 25294 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:57250 (request call id 55) took 1166 ms. Trace:
I20260709 13:10:24.460043 25216 rpcz_store.cc:276] 0709 13:10:23.264465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.178727 (+914262us) service_pool.cc:224] Handling call
0709 13:10:24.240446 (+ 61719us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:10:24.240775 (+   329us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:10:24.393581 (+152806us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:24.459170 (+ 65589us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:24.459600 (+   430us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.462505 25291 rpcz_store.cc:276] 0709 13:10:23.260694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.234269 (+973575us) service_pool.cc:224] Handling call
0709 13:10:24.276929 (+ 42660us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:10:24.277014 (+    85us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:10:24.373717 (+ 96703us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:24.461194 (+ 87477us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:24.461599 (+   405us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.464164 25421 tablet_bootstrap.cc:492] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce: Bootstrap starting.
I20260709 13:10:24.474718 25419 tablet_bootstrap.cc:654] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:24.462725 25294 rpcz_store.cc:276] 0709 13:10:23.284634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.258190 (+973556us) service_pool.cc:224] Handling call
0709 13:10:24.278128 (+ 19938us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:10:24.278245 (+   117us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:10:24.415263 (+137018us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:24.451010 (+ 35747us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:24.451401 (+   391us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.479235 25422 tablet_bootstrap.cc:492] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19: No bootstrap required, opened a new log
I20260709 13:10:24.479396 25211 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:58402 (request call id 55) took 1196 ms. Trace:
I20260709 13:10:24.479698 25422 ts_tablet_manager.cc:1403] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19: Time spent bootstrapping tablet: real 0.107s	user 0.012s	sys 0.003s
I20260709 13:10:24.479776 25211 rpcz_store.cc:276] 0709 13:10:23.282684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.251404 (+968720us) service_pool.cc:224] Handling call
0709 13:10:24.299725 (+ 48321us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:10:24.299819 (+    94us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:10:24.425259 (+125440us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:24.478925 (+ 53666us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:24.479340 (+   415us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.483556 25421 tablet_bootstrap.cc:654] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:24.483121 25422 raft_consensus.cc:359] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.484072 25422 raft_consensus.cc:385] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:24.484390 25422 raft_consensus.cc:740] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Initialized, Role: FOLLOWER
I20260709 13:10:24.485052 25422 consensus_queue.cc:260] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.486177 25419 tablet_bootstrap.cc:492] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468: No bootstrap required, opened a new log
I20260709 13:10:24.486618 25419 ts_tablet_manager.cc:1403] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.001s
I20260709 13:10:24.487192 25422 ts_tablet_manager.cc:1434] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:10:24.488566 25422 tablet_bootstrap.cc:492] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19: Bootstrap starting.
I20260709 13:10:24.489210 25419 raft_consensus.cc:359] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.489933 25419 raft_consensus.cc:385] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:24.490203 25419 raft_consensus.cc:740] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Initialized, Role: FOLLOWER
I20260709 13:10:24.490996 25419 consensus_queue.cc:260] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.493284 25419 ts_tablet_manager.cc:1434] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:10:24.495337 25422 tablet_bootstrap.cc:654] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:24.495908 25431 raft_consensus.cc:493] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.496487 25431 raft_consensus.cc:515] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.500335 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:10:24.501641 25270 leader_election.cc:343] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:24.501562 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:24.502494 25229 raft_consensus.cc:2468] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 0.
I20260709 13:10:24.504199 25271 leader_election.cc:304] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:10:24.505221 25439 raft_consensus.cc:2804] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:24.505568 25439 raft_consensus.cc:493] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:24.505900 25439 raft_consensus.cc:3060] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:24.507185 25419 tablet_bootstrap.cc:492] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468: Bootstrap starting.
I20260709 13:10:24.509609 25431 leader_election.cc:290] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:24.513589 25419 tablet_bootstrap.cc:654] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:24.513193 25439 raft_consensus.cc:515] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.516773 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:10:24.517369 25229 raft_consensus.cc:3060] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:24.517537 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:10:24.518709 25421 tablet_bootstrap.cc:492] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce: No bootstrap required, opened a new log
W20260709 13:10:24.519264 25270 leader_election.cc:343] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:24.516870 25439 leader_election.cc:290] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:24.519533 25421 ts_tablet_manager.cc:1403] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce: Time spent bootstrapping tablet: real 0.056s	user 0.032s	sys 0.008s
I20260709 13:10:24.523399 25421 raft_consensus.cc:359] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.524250 25422 tablet_bootstrap.cc:492] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19: No bootstrap required, opened a new log
I20260709 13:10:24.524307 25421 raft_consensus.cc:385] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:24.524785 25422 ts_tablet_manager.cc:1403] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19: Time spent bootstrapping tablet: real 0.036s	user 0.013s	sys 0.003s
I20260709 13:10:24.524827 25421 raft_consensus.cc:740] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Initialized, Role: FOLLOWER
I20260709 13:10:24.525738 25229 raft_consensus.cc:2468] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 1.
I20260709 13:10:24.526836 25271 leader_election.cc:304] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:10:24.527597 25422 raft_consensus.cc:359] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.527920 25439 raft_consensus.cc:2804] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:24.528546 25439 raft_consensus.cc:697] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:10:24.528136 25422 raft_consensus.cc:385] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:24.529557 25422 raft_consensus.cc:740] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Initialized, Role: FOLLOWER
I20260709 13:10:24.529237 25439 consensus_queue.cc:237] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.526084 25421 consensus_queue.cc:260] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.530798 25419 tablet_bootstrap.cc:492] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468: No bootstrap required, opened a new log
I20260709 13:10:24.530272 25422 consensus_queue.cc:260] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.531260 25419 ts_tablet_manager.cc:1403] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.007s
I20260709 13:10:24.532891 25422 ts_tablet_manager.cc:1434] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:10:24.533826 25422 tablet_bootstrap.cc:492] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19: Bootstrap starting.
I20260709 13:10:24.534682 25419 raft_consensus.cc:359] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.535604 25419 raft_consensus.cc:385] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:24.535977 25419 raft_consensus.cc:740] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Initialized, Role: FOLLOWER
I20260709 13:10:24.537040 25419 consensus_queue.cc:260] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.539129 25421 ts_tablet_manager.cc:1434] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:10:24.540392 25422 tablet_bootstrap.cc:654] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:24.545377 25421 tablet_bootstrap.cc:492] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce: Bootstrap starting.
I20260709 13:10:24.547222 25419 ts_tablet_manager.cc:1434] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.007s
I20260709 13:10:24.552230 25421 tablet_bootstrap.cc:654] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:24.551455 25125 catalog_manager.cc:5697] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 0 to 1, leader changed from <none> to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 1 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:24.554989 25419 tablet_bootstrap.cc:492] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468: Bootstrap starting.
I20260709 13:10:24.558224 25422 tablet_bootstrap.cc:492] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19: No bootstrap required, opened a new log
I20260709 13:10:24.558691 25422 ts_tablet_manager.cc:1403] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.011s
I20260709 13:10:24.559439 25421 tablet_bootstrap.cc:492] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce: No bootstrap required, opened a new log
I20260709 13:10:24.560105 25421 ts_tablet_manager.cc:1403] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.003s
I20260709 13:10:24.561559 25422 raft_consensus.cc:359] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.562351 25419 tablet_bootstrap.cc:654] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:24.562309 25422 raft_consensus.cc:385] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:24.562795 25422 raft_consensus.cc:740] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Initialized, Role: FOLLOWER
I20260709 13:10:24.563781 25422 consensus_queue.cc:260] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.563877 25421 raft_consensus.cc:359] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.565924 25421 raft_consensus.cc:385] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:24.566259 25422 ts_tablet_manager.cc:1434] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:10:24.566217 25421 raft_consensus.cc:740] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Initialized, Role: FOLLOWER
I20260709 13:10:24.567250 25422 tablet_bootstrap.cc:492] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19: Bootstrap starting.
I20260709 13:10:24.567104 25421 consensus_queue.cc:260] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.568902 25419 tablet_bootstrap.cc:492] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468: No bootstrap required, opened a new log
I20260709 13:10:24.569423 25419 ts_tablet_manager.cc:1403] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.001s
I20260709 13:10:24.571722 25419 raft_consensus.cc:359] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.572434 25419 raft_consensus.cc:385] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:24.572782 25419 raft_consensus.cc:740] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Initialized, Role: FOLLOWER
I20260709 13:10:24.573601 25422 tablet_bootstrap.cc:654] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:24.573503 25419 consensus_queue.cc:260] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.575781 25419 ts_tablet_manager.cc:1434] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:10:24.578024 25421 ts_tablet_manager.cc:1434] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:10:24.578804 25422 tablet_bootstrap.cc:492] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19: No bootstrap required, opened a new log
I20260709 13:10:24.579281 25422 ts_tablet_manager.cc:1403] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19: Time spent bootstrapping tablet: real 0.012s	user 0.011s	sys 0.000s
I20260709 13:10:24.580490 25419 tablet_bootstrap.cc:492] T 25e0218933774b319104f23505937179 P 79d99c0e498349bda74127365219e468: Bootstrap starting.
I20260709 13:10:24.582079 25422 raft_consensus.cc:359] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.582821 25422 raft_consensus.cc:385] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:24.583155 25422 raft_consensus.cc:740] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Initialized, Role: FOLLOWER
I20260709 13:10:24.584026 25422 consensus_queue.cc:260] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.587044 25419 tablet_bootstrap.cc:654] T 25e0218933774b319104f23505937179 P 79d99c0e498349bda74127365219e468: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:24.586472 25422 ts_tablet_manager.cc:1434] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:10:24.588279 25422 tablet_bootstrap.cc:492] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19: Bootstrap starting.
I20260709 13:10:24.592001 25421 tablet_bootstrap.cc:492] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce: Bootstrap starting.
I20260709 13:10:24.596927 25422 tablet_bootstrap.cc:654] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:24.598381 25421 tablet_bootstrap.cc:654] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:24.599129 25419 tablet_bootstrap.cc:492] T 25e0218933774b319104f23505937179 P 79d99c0e498349bda74127365219e468: No bootstrap required, opened a new log
I20260709 13:10:24.599635 25419 ts_tablet_manager.cc:1403] T 25e0218933774b319104f23505937179 P 79d99c0e498349bda74127365219e468: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.008s
I20260709 13:10:24.602896 25422 tablet_bootstrap.cc:492] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19: No bootstrap required, opened a new log
I20260709 13:10:24.602988 25421 tablet_bootstrap.cc:492] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce: No bootstrap required, opened a new log
I20260709 13:10:24.602684 25419 raft_consensus.cc:359] T 25e0218933774b319104f23505937179 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.603323 25422 ts_tablet_manager.cc:1403] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 13:10:24.603356 25419 raft_consensus.cc:385] T 25e0218933774b319104f23505937179 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:24.603448 25421 ts_tablet_manager.cc:1403] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce: Time spent bootstrapping tablet: real 0.012s	user 0.006s	sys 0.004s
I20260709 13:10:24.603811 25419 raft_consensus.cc:740] T 25e0218933774b319104f23505937179 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Initialized, Role: FOLLOWER
I20260709 13:10:24.604663 25419 consensus_queue.cc:260] T 25e0218933774b319104f23505937179 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.605432 25422 raft_consensus.cc:359] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.606035 25422 raft_consensus.cc:385] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:24.606276 25422 raft_consensus.cc:740] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Initialized, Role: FOLLOWER
I20260709 13:10:24.606355 25421 raft_consensus.cc:359] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.606873 25419 ts_tablet_manager.cc:1434] T 25e0218933774b319104f23505937179 P 79d99c0e498349bda74127365219e468: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:10:24.607187 25421 raft_consensus.cc:385] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:24.606896 25422 consensus_queue.cc:260] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.607448 25421 raft_consensus.cc:740] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Initialized, Role: FOLLOWER
I20260709 13:10:24.608126 25419 tablet_bootstrap.cc:492] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468: Bootstrap starting.
I20260709 13:10:24.608969 25422 ts_tablet_manager.cc:1434] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:10:24.609867 25422 tablet_bootstrap.cc:492] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19: Bootstrap starting.
I20260709 13:10:24.611869 25421 consensus_queue.cc:260] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.613929 25419 tablet_bootstrap.cc:654] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:24.614464 25421 ts_tablet_manager.cc:1434] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.002s
I20260709 13:10:24.617468 25422 tablet_bootstrap.cc:654] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:24.625095 25441 raft_consensus.cc:493] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.625555 25441 raft_consensus.cc:515] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.626024 25419 tablet_bootstrap.cc:492] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468: No bootstrap required, opened a new log
I20260709 13:10:24.626528 25419 ts_tablet_manager.cc:1403] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.008s
I20260709 13:10:24.627677 25441 leader_election.cc:290] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:24.629029 25419 raft_consensus.cc:359] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.629658 25419 raft_consensus.cc:385] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:24.629989 25419 raft_consensus.cc:740] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Initialized, Role: FOLLOWER
I20260709 13:10:24.629894 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:24.630306 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:24.630859 25419 consensus_queue.cc:260] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:10:24.631691 25194 leader_election.cc:343] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:24.632273 25195 leader_election.cc:343] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:24.632720 25195 leader_election.cc:304] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:10:24.633466 25441 raft_consensus.cc:2749] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:24.619480 25421 tablet_bootstrap.cc:492] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce: Bootstrap starting.
I20260709 13:10:24.635931 25419 ts_tablet_manager.cc:1434] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.002s
I20260709 13:10:24.636806 25419 tablet_bootstrap.cc:492] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468: Bootstrap starting.
I20260709 13:10:24.641355 25421 tablet_bootstrap.cc:654] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:24.642753 25419 tablet_bootstrap.cc:654] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:24.653632 25421 tablet_bootstrap.cc:492] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce: No bootstrap required, opened a new log
I20260709 13:10:24.654129 25421 ts_tablet_manager.cc:1403] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce: Time spent bootstrapping tablet: real 0.039s	user 0.011s	sys 0.008s
I20260709 13:10:24.654162 25419 tablet_bootstrap.cc:492] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468: No bootstrap required, opened a new log
I20260709 13:10:24.654721 25419 ts_tablet_manager.cc:1403] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.008s
I20260709 13:10:24.654925 25422 tablet_bootstrap.cc:492] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19: No bootstrap required, opened a new log
I20260709 13:10:24.655344 25422 ts_tablet_manager.cc:1403] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19: Time spent bootstrapping tablet: real 0.046s	user 0.018s	sys 0.005s
I20260709 13:10:24.657043 25419 raft_consensus.cc:359] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.657708 25419 raft_consensus.cc:385] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:24.657979 25419 raft_consensus.cc:740] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Initialized, Role: FOLLOWER
I20260709 13:10:24.658757 25422 raft_consensus.cc:359] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.658718 25419 consensus_queue.cc:260] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.659523 25422 raft_consensus.cc:385] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:24.659880 25422 raft_consensus.cc:740] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Initialized, Role: FOLLOWER
I20260709 13:10:24.660133 25421 raft_consensus.cc:359] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.660801 25421 raft_consensus.cc:385] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:24.660599 25422 consensus_queue.cc:260] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.661090 25421 raft_consensus.cc:740] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Initialized, Role: FOLLOWER
I20260709 13:10:24.661164 25419 ts_tablet_manager.cc:1434] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:10:24.661860 25421 consensus_queue.cc:260] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.662472 25419 tablet_bootstrap.cc:492] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468: Bootstrap starting.
I20260709 13:10:24.665040 25422 ts_tablet_manager.cc:1434] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:10:24.665904 25422 tablet_bootstrap.cc:492] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19: Bootstrap starting.
I20260709 13:10:24.668284 25419 tablet_bootstrap.cc:654] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:24.671350 25422 tablet_bootstrap.cc:654] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:24.679427 25421 ts_tablet_manager.cc:1434] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:10:24.679466 25422 tablet_bootstrap.cc:492] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19: No bootstrap required, opened a new log
I20260709 13:10:24.680110 25422 ts_tablet_manager.cc:1403] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.004s
I20260709 13:10:24.682386 25421 tablet_bootstrap.cc:492] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce: Bootstrap starting.
I20260709 13:10:24.682510 25422 raft_consensus.cc:359] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.683202 25422 raft_consensus.cc:385] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:24.683466 25422 raft_consensus.cc:740] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Initialized, Role: FOLLOWER
I20260709 13:10:24.684863 25422 consensus_queue.cc:260] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.686967 25419 tablet_bootstrap.cc:492] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468: No bootstrap required, opened a new log
I20260709 13:10:24.687476 25419 ts_tablet_manager.cc:1403] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.008s
I20260709 13:10:24.688550 25421 tablet_bootstrap.cc:654] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:24.689592 25422 ts_tablet_manager.cc:1434] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:10:24.690562 25422 tablet_bootstrap.cc:492] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19: Bootstrap starting.
I20260709 13:10:24.690407 25419 raft_consensus.cc:359] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.691329 25419 raft_consensus.cc:385] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:24.691759 25419 raft_consensus.cc:740] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Initialized, Role: FOLLOWER
I20260709 13:10:24.692883 25419 consensus_queue.cc:260] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.696357 25422 tablet_bootstrap.cc:654] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:24.699689 25419 ts_tablet_manager.cc:1434] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:10:24.700628 25419 tablet_bootstrap.cc:492] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468: Bootstrap starting.
I20260709 13:10:24.701318 25441 raft_consensus.cc:493] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.701934 25441 raft_consensus.cc:515] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.706223 25419 tablet_bootstrap.cc:654] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:24.706441 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:24.707083 25379 raft_consensus.cc:2468] T 25e0218933774b319104f23505937179 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 0.
I20260709 13:10:24.707562 25422 tablet_bootstrap.cc:492] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19: No bootstrap required, opened a new log
I20260709 13:10:24.708007 25422 ts_tablet_manager.cc:1403] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 13:10:24.708377 25439 raft_consensus.cc:493] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.708879 25439 raft_consensus.cc:515] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.709244 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:24.709477 25195 leader_election.cc:304] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:10:24.710059 25305 raft_consensus.cc:2468] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 0.
I20260709 13:10:24.710963 25439 leader_election.cc:290] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:24.708489 25421 tablet_bootstrap.cc:492] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce: No bootstrap required, opened a new log
I20260709 13:10:24.711666 25421 ts_tablet_manager.cc:1403] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce: Time spent bootstrapping tablet: real 0.029s	user 0.007s	sys 0.010s
I20260709 13:10:24.712110 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:24.712714 25229 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 0.
I20260709 13:10:24.713008 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:24.714238 25271 leader_election.cc:304] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:10:24.714845 25270 leader_election.cc:343] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:24.715358 25441 leader_election.cc:290] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:24.715013 25439 raft_consensus.cc:2804] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:24.715811 25441 raft_consensus.cc:2804] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:24.716158 25439 raft_consensus.cc:493] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:24.716800 25439 raft_consensus.cc:3060] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:24.717077 25421 raft_consensus.cc:359] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.716192 25441 raft_consensus.cc:493] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:24.717832 25421 raft_consensus.cc:385] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:24.718219 25421 raft_consensus.cc:740] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Initialized, Role: FOLLOWER
I20260709 13:10:24.718008 25441 raft_consensus.cc:3060] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:24.718906 25421 consensus_queue.cc:260] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.716053 25422 raft_consensus.cc:359] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.727015 25422 raft_consensus.cc:385] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:24.727317 25422 raft_consensus.cc:740] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Initialized, Role: FOLLOWER
I20260709 13:10:24.728272 25421 ts_tablet_manager.cc:1434] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:10:24.727919 25422 consensus_queue.cc:260] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.729249 25421 tablet_bootstrap.cc:492] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce: Bootstrap starting.
I20260709 13:10:24.733873 25431 raft_consensus.cc:493] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.734378 25431 raft_consensus.cc:515] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.736295 25431 leader_election.cc:290] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:24.736634 25421 tablet_bootstrap.cc:654] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:24.737475 25422 ts_tablet_manager.cc:1434] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.002s
I20260709 13:10:24.738406 25422 tablet_bootstrap.cc:492] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19: Bootstrap starting.
I20260709 13:10:24.738690 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:24.739176 25419 tablet_bootstrap.cc:492] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468: No bootstrap required, opened a new log
I20260709 13:10:24.739297 25229 raft_consensus.cc:2468] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 0.
I20260709 13:10:24.739763 25419 ts_tablet_manager.cc:1403] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468: Time spent bootstrapping tablet: real 0.039s	user 0.010s	sys 0.018s
I20260709 13:10:24.740507 25439 raft_consensus.cc:515] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.741549 25271 leader_election.cc:304] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:10:24.742712 25439 leader_election.cc:290] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:24.743225 25419 raft_consensus.cc:359] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.743888 25419 raft_consensus.cc:385] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:24.744138 25419 raft_consensus.cc:740] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Initialized, Role: FOLLOWER
I20260709 13:10:24.741885 25441 raft_consensus.cc:515] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.744388 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:10:24.744891 25422 tablet_bootstrap.cc:654] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:24.745858 25270 leader_election.cc:343] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:24.743260 25439 raft_consensus.cc:2804] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:24.746429 25439 raft_consensus.cc:493] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:24.746757 25439 raft_consensus.cc:3060] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:24.746685 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:10:24.747318 25229 raft_consensus.cc:3060] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:24.740612 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:24.750186 25379 raft_consensus.cc:2468] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 0.
I20260709 13:10:24.752349 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:10:24.752889 25305 raft_consensus.cc:3060] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:24.754285 25441 leader_election.cc:290] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:24.754948 25419 consensus_queue.cc:260] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.758150 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:10:24.758725 25379 raft_consensus.cc:3060] T 25e0218933774b319104f23505937179 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:24.760057 25419 ts_tablet_manager.cc:1434] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 13:10:24.760547 25460 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.753536 25439 raft_consensus.cc:515] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.760962 25460 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.762841 25460 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:24.763188 25439 leader_election.cc:290] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:24.763585 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:24.764338 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:10:24.764904 25378 raft_consensus.cc:3060] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:24.765308 25345 leader_election.cc:343] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:24.767684 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:10:24.760977 25419 tablet_bootstrap.cc:492] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468: Bootstrap starting.
I20260709 13:10:24.768254 25230 raft_consensus.cc:3060] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:24.768546 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:24.769156 25304 raft_consensus.cc:2468] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 0.
I20260709 13:10:24.770326 25343 leader_election.cc:304] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:10:24.771371 25460 raft_consensus.cc:2804] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:24.771715 25460 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:24.772058 25460 raft_consensus.cc:3060] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:24.775554 25441 raft_consensus.cc:493] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.776021 25441 raft_consensus.cc:515] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.778352 25229 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 1.
I20260709 13:10:24.778450 25441 leader_election.cc:290] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:24.778839 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:24.791235 25304 raft_consensus.cc:2468] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 0.
I20260709 13:10:24.791460 25439 raft_consensus.cc:493] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.783388 25305 raft_consensus.cc:2468] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 1.
I20260709 13:10:24.784348 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:24.791925 25271 leader_election.cc:304] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:10:24.792202 25377 raft_consensus.cc:2468] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 0.
I20260709 13:10:24.792373 25460 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.793670 25194 leader_election.cc:304] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:10:24.794502 25441 raft_consensus.cc:2804] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:24.794559 25194 leader_election.cc:304] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:10:24.794929 25441 raft_consensus.cc:493] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:24.795291 25441 raft_consensus.cc:3060] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:24.795485 25230 raft_consensus.cc:2468] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 1.
I20260709 13:10:24.796948 25271 leader_election.cc:304] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:10:24.798206 25431 raft_consensus.cc:2804] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:24.799444 25484 raft_consensus.cc:2804] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:24.802337 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:10:24.788625 25379 raft_consensus.cc:2468] T 25e0218933774b319104f23505937179 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 1.
W20260709 13:10:24.808457 25345 leader_election.cc:343] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:24.772051 25378 raft_consensus.cc:2468] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 1.
I20260709 13:10:24.791941 25439 raft_consensus.cc:515] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.812050 25441 raft_consensus.cc:515] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.812986 25460 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:24.813392 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:10:24.817667 25270 leader_election.cc:343] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:24.817878 25439 leader_election.cc:290] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:24.818468 25439 raft_consensus.cc:2804] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:24.818956 25439 raft_consensus.cc:697] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:10:24.819916 25441 leader_election.cc:290] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:24.819833 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:10:24.820585 25378 raft_consensus.cc:3060] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:24.826021 25378 raft_consensus.cc:2468] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 1.
I20260709 13:10:24.819828 25439 consensus_queue.cc:237] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.827257 25195 leader_election.cc:304] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:10:24.828239 25441 raft_consensus.cc:2804] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:24.790638 25419 tablet_bootstrap.cc:654] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:24.828724 25441 raft_consensus.cc:697] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:10:24.829871 25441 consensus_queue.cc:237] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.836704 25484 raft_consensus.cc:697] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:10:24.837854 25484 consensus_queue.cc:237] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.840833 25431 raft_consensus.cc:697] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:10:24.841380 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:24.842084 25229 raft_consensus.cc:2468] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 0.
I20260709 13:10:24.841766 25431 consensus_queue.cc:237] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.843142 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:10:24.843896 25304 raft_consensus.cc:3060] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:24.844079 25271 leader_election.cc:304] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:10:24.845513 25419 tablet_bootstrap.cc:492] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468: No bootstrap required, opened a new log
I20260709 13:10:24.845965 25419 ts_tablet_manager.cc:1403] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468: Time spent bootstrapping tablet: real 0.085s	user 0.012s	sys 0.000s
I20260709 13:10:24.846076 25487 raft_consensus.cc:2804] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:24.847054 25487 raft_consensus.cc:493] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:24.842192 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:10:24.847759 25305 raft_consensus.cc:3060] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:24.848642 25419 raft_consensus.cc:359] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.847426 25487 raft_consensus.cc:3060] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:24.849439 25419 raft_consensus.cc:385] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:24.850610 25419 raft_consensus.cc:740] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Initialized, Role: FOLLOWER
I20260709 13:10:24.851442 25419 consensus_queue.cc:260] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.859454 25422 tablet_bootstrap.cc:492] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19: No bootstrap required, opened a new log
I20260709 13:10:24.860517 25305 raft_consensus.cc:2468] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 1.
I20260709 13:10:24.860993 25304 raft_consensus.cc:2468] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 1.
I20260709 13:10:24.859099 25487 raft_consensus.cc:515] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.862437 25343 leader_election.cc:304] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:10:24.863481 25460 raft_consensus.cc:2804] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:24.864001 25460 raft_consensus.cc:697] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:10:24.865305 25422 ts_tablet_manager.cc:1403] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19: Time spent bootstrapping tablet: real 0.127s	user 0.029s	sys 0.030s
I20260709 13:10:24.866319 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
W20260709 13:10:24.867810 25270 leader_election.cc:343] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:24.864945 25460 consensus_queue.cc:237] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.868690 25487 leader_election.cc:290] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:24.868690 25422 raft_consensus.cc:359] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.869491 25422 raft_consensus.cc:385] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:24.869817 25422 raft_consensus.cc:740] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Initialized, Role: FOLLOWER
I20260709 13:10:24.870486 25422 consensus_queue.cc:260] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.863570 25421 tablet_bootstrap.cc:492] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce: No bootstrap required, opened a new log
I20260709 13:10:24.871856 25421 ts_tablet_manager.cc:1403] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce: Time spent bootstrapping tablet: real 0.143s	user 0.020s	sys 0.058s
I20260709 13:10:24.872864 25422 ts_tablet_manager.cc:1434] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:10:24.873775 25422 tablet_bootstrap.cc:492] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19: Bootstrap starting.
I20260709 13:10:24.874361 25421 raft_consensus.cc:359] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.875023 25421 raft_consensus.cc:385] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:24.875286 25421 raft_consensus.cc:740] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Initialized, Role: FOLLOWER
I20260709 13:10:24.875914 25421 consensus_queue.cc:260] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.876022 25127 catalog_manager.cc:5697] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 1 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:24.865888 25419 ts_tablet_manager.cc:1434] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:10:24.878474 25419 tablet_bootstrap.cc:492] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468: Bootstrap starting.
I20260709 13:10:24.879061 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:10:24.879549 25422 tablet_bootstrap.cc:654] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:24.879622 25229 raft_consensus.cc:3060] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:24.883989 25419 tablet_bootstrap.cc:654] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:24.883916 25456 raft_consensus.cc:493] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.884675 25456 raft_consensus.cc:515] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.886943 25421 ts_tablet_manager.cc:1434] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 13:10:24.887833 25421 tablet_bootstrap.cc:492] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce: Bootstrap starting.
I20260709 13:10:24.888927 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:24.889557 25228 raft_consensus.cc:2468] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 0.
I20260709 13:10:24.889292 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:24.891242 25345 leader_election.cc:304] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
W20260709 13:10:24.891827 25343 leader_election.cc:343] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:24.892212 25455 raft_consensus.cc:2804] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:24.892602 25455 raft_consensus.cc:493] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:24.892946 25455 raft_consensus.cc:3060] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:24.893388 25421 tablet_bootstrap.cc:654] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:24.884858 25128 catalog_manager.cc:5697] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 0 to 1, leader changed from <none> to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 1 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:24.903239 25128 catalog_manager.cc:5697] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 0 to 1, leader changed from <none> to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 1 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:24.889462 25456 leader_election.cc:290] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:24.930495 25125 catalog_manager.cc:5697] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 1 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:24.932356 25456 raft_consensus.cc:493] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.933152 25456 raft_consensus.cc:515] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.936668 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:10:24.938441 25345 leader_election.cc:343] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:24.940965 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:24.941854 25305 raft_consensus.cc:2468] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 0.
I20260709 13:10:24.943666 25343 leader_election.cc:304] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:10:24.944839 25423 raft_consensus.cc:2804] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:24.945288 25423 raft_consensus.cc:493] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:24.945701 25423 raft_consensus.cc:3060] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:24.955549 25423 raft_consensus.cc:515] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.959090 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
W20260709 13:10:24.960850 25345 leader_election.cc:343] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:24.940168 25456 leader_election.cc:290] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:24.964725 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:10:24.965463 25305 raft_consensus.cc:3060] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:24.973548 25378 raft_consensus.cc:3060] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:24.974294 25305 raft_consensus.cc:2468] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 1.
I20260709 13:10:24.975493 25343 leader_election.cc:304] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:10:24.976821 25423 leader_election.cc:290] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:24.976781 25229 raft_consensus.cc:2468] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 1.
I20260709 13:10:24.949187 25455 raft_consensus.cc:515] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.978272 25271 leader_election.cc:304] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:10:24.977710 25423 raft_consensus.cc:2804] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:24.980506 25431 raft_consensus.cc:2804] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:24.980928 25423 raft_consensus.cc:697] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:10:24.980965 25431 raft_consensus.cc:697] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:10:24.981899 25423 consensus_queue.cc:237] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.982554 25431 consensus_queue.cc:237] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:24.986855 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:10:24.987655 25229 raft_consensus.cc:3060] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:24.988150 25487 consensus_queue.cc:1048] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:24.996382 25127 catalog_manager.cc:5697] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 1 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:25.010514 25125 catalog_manager.cc:5697] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 0 to 1, leader changed from <none> to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 1 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:24.999725 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:10:25.005124 25421 tablet_bootstrap.cc:492] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce: No bootstrap required, opened a new log
I20260709 13:10:24.999466 25455 leader_election.cc:290] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:25.012826 25421 ts_tablet_manager.cc:1403] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce: Time spent bootstrapping tablet: real 0.125s	user 0.028s	sys 0.034s
W20260709 13:10:25.013332 25343 leader_election.cc:343] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:25.014328 25229 raft_consensus.cc:2468] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 1.
I20260709 13:10:25.018901 25422 tablet_bootstrap.cc:492] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19: No bootstrap required, opened a new log
I20260709 13:10:25.010536 25419 tablet_bootstrap.cc:492] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468: No bootstrap required, opened a new log
I20260709 13:10:25.018723 25345 leader_election.cc:304] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:10:25.019418 25422 ts_tablet_manager.cc:1403] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19: Time spent bootstrapping tablet: real 0.146s	user 0.031s	sys 0.032s
I20260709 13:10:25.019712 25419 ts_tablet_manager.cc:1403] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468: Time spent bootstrapping tablet: real 0.141s	user 0.022s	sys 0.042s
I20260709 13:10:25.020357 25455 raft_consensus.cc:2804] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:25.020987 25455 raft_consensus.cc:697] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:10:25.015944 25421 raft_consensus.cc:359] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.021737 25421 raft_consensus.cc:385] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.022145 25421 raft_consensus.cc:740] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.023164 25421 consensus_queue.cc:260] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.022025 25455 consensus_queue.cc:237] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.028059 25422 raft_consensus.cc:359] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.028761 25422 raft_consensus.cc:385] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.029038 25422 raft_consensus.cc:740] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.030056 25422 consensus_queue.cc:260] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.031952 25422 ts_tablet_manager.cc:1434] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:10:25.032796 25422 tablet_bootstrap.cc:492] T ca881f8516e046c99da202e9d9ea00a1 P da445ce82dc4467f95f4fa52297eaa19: Bootstrap starting.
I20260709 13:10:25.029995 25419 raft_consensus.cc:359] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.034835 25419 raft_consensus.cc:385] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.035084 25419 raft_consensus.cc:740] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.035643 25419 consensus_queue.cc:260] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.044337 25419 ts_tablet_manager.cc:1434] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.001s
I20260709 13:10:25.044456 25421 ts_tablet_manager.cc:1434] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce: Time spent starting tablet: real 0.031s	user 0.010s	sys 0.000s
I20260709 13:10:25.045323 25419 tablet_bootstrap.cc:492] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468: Bootstrap starting.
I20260709 13:10:25.050976 25422 tablet_bootstrap.cc:654] T ca881f8516e046c99da202e9d9ea00a1 P da445ce82dc4467f95f4fa52297eaa19: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.045361 25421 tablet_bootstrap.cc:492] T c6d3131e75284c0eb555c937d1c619cb P 1f539ba21487460085b837e7529a78ce: Bootstrap starting.
I20260709 13:10:25.061913 25487 consensus_queue.cc:1048] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:25.063792 25421 tablet_bootstrap.cc:654] T c6d3131e75284c0eb555c937d1c619cb P 1f539ba21487460085b837e7529a78ce: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.068593 25419 tablet_bootstrap.cc:654] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.070405 25422 tablet_bootstrap.cc:492] T ca881f8516e046c99da202e9d9ea00a1 P da445ce82dc4467f95f4fa52297eaa19: No bootstrap required, opened a new log
I20260709 13:10:25.071456 25422 ts_tablet_manager.cc:1403] T ca881f8516e046c99da202e9d9ea00a1 P da445ce82dc4467f95f4fa52297eaa19: Time spent bootstrapping tablet: real 0.039s	user 0.014s	sys 0.010s
I20260709 13:10:25.073154 25125 catalog_manager.cc:5697] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 1 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:25.075732 25487 raft_consensus.cc:493] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.075559 25125 catalog_manager.cc:5697] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 1 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:25.076488 25487 raft_consensus.cc:515] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.075695 25422 raft_consensus.cc:359] T ca881f8516e046c99da202e9d9ea00a1 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.078249 25422 raft_consensus.cc:385] T ca881f8516e046c99da202e9d9ea00a1 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.078701 25422 raft_consensus.cc:740] T ca881f8516e046c99da202e9d9ea00a1 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.079511 25422 consensus_queue.cc:260] T ca881f8516e046c99da202e9d9ea00a1 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.080204 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:25.081162 25421 tablet_bootstrap.cc:492] T c6d3131e75284c0eb555c937d1c619cb P 1f539ba21487460085b837e7529a78ce: No bootstrap required, opened a new log
I20260709 13:10:25.081593 25421 ts_tablet_manager.cc:1403] T c6d3131e75284c0eb555c937d1c619cb P 1f539ba21487460085b837e7529a78ce: Time spent bootstrapping tablet: real 0.036s	user 0.012s	sys 0.002s
W20260709 13:10:25.081940 25271 leader_election.cc:343] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:25.084395 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:25.084859 25422 ts_tablet_manager.cc:1434] T ca881f8516e046c99da202e9d9ea00a1 P da445ce82dc4467f95f4fa52297eaa19: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:10:25.085023 25378 raft_consensus.cc:2468] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 0.
I20260709 13:10:25.086359 25422 tablet_bootstrap.cc:492] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19: Bootstrap starting.
I20260709 13:10:25.087234 25270 leader_election.cc:304] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:10:25.088039 25431 raft_consensus.cc:2804] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:25.088379 25431 raft_consensus.cc:493] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.088690 25431 raft_consensus.cc:3060] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.088907 25487 leader_election.cc:290] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:25.084884 25421 raft_consensus.cc:359] T c6d3131e75284c0eb555c937d1c619cb P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.089838 25421 raft_consensus.cc:385] T c6d3131e75284c0eb555c937d1c619cb P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.090108 25421 raft_consensus.cc:740] T c6d3131e75284c0eb555c937d1c619cb P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.090741 25421 consensus_queue.cc:260] T c6d3131e75284c0eb555c937d1c619cb P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.092430 25422 tablet_bootstrap.cc:654] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.093616 25419 tablet_bootstrap.cc:492] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468: No bootstrap required, opened a new log
I20260709 13:10:25.094084 25419 ts_tablet_manager.cc:1403] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468: Time spent bootstrapping tablet: real 0.049s	user 0.017s	sys 0.000s
I20260709 13:10:25.095439 25455 raft_consensus.cc:493] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.096058 25455 raft_consensus.cc:515] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.096508 25419 raft_consensus.cc:359] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.097141 25419 raft_consensus.cc:385] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.097406 25419 raft_consensus.cc:740] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.098094 25419 consensus_queue.cc:260] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.098618 25455 leader_election.cc:290] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:25.100097 25419 ts_tablet_manager.cc:1434] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:10:25.100955 25419 tablet_bootstrap.cc:492] T 51ecc4484385405c857b3bee1077c36a P 79d99c0e498349bda74127365219e468: Bootstrap starting.
I20260709 13:10:25.101619 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:25.102468 25421 ts_tablet_manager.cc:1434] T c6d3131e75284c0eb555c937d1c619cb P 1f539ba21487460085b837e7529a78ce: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.001s
I20260709 13:10:25.103375 25421 tablet_bootstrap.cc:492] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce: Bootstrap starting.
I20260709 13:10:25.103811 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:25.104641 25229 raft_consensus.cc:2393] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 1: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:10:25.105660 25345 leader_election.cc:304] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:10:25.106949 25460 raft_consensus.cc:3060] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.108927 25421 tablet_bootstrap.cc:654] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.114809 25419 tablet_bootstrap.cc:654] T 51ecc4484385405c857b3bee1077c36a P 79d99c0e498349bda74127365219e468: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.116360 25455 raft_consensus.cc:493] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.116820 25455 raft_consensus.cc:515] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.117127 25460 raft_consensus.cc:2749] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:25.119480 25431 raft_consensus.cc:515] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.119961 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:25.120615 25305 raft_consensus.cc:2468] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 0.
I20260709 13:10:25.121769 25343 leader_election.cc:304] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:10:25.122545 25423 raft_consensus.cc:2804] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:25.122895 25423 raft_consensus.cc:493] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.123211 25423 raft_consensus.cc:3060] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.125510 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:25.126359 25229 raft_consensus.cc:2468] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 0.
I20260709 13:10:25.127310 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:10:25.127873 25378 raft_consensus.cc:3060] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.125065 25431 leader_election.cc:290] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:25.130347 25421 tablet_bootstrap.cc:492] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce: No bootstrap required, opened a new log
I20260709 13:10:25.130787 25421 ts_tablet_manager.cc:1403] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce: Time spent bootstrapping tablet: real 0.028s	user 0.005s	sys 0.004s
I20260709 13:10:25.131563 25422 tablet_bootstrap.cc:492] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19: No bootstrap required, opened a new log
I20260709 13:10:25.131979 25422 ts_tablet_manager.cc:1403] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19: Time spent bootstrapping tablet: real 0.046s	user 0.025s	sys 0.011s
I20260709 13:10:25.133471 25421 raft_consensus.cc:359] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.134045 25460 raft_consensus.cc:493] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.134135 25421 raft_consensus.cc:385] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.134425 25422 raft_consensus.cc:359] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.134583 25460 raft_consensus.cc:515] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.135089 25422 raft_consensus.cc:385] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:10:25.135282 25175 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:25.135377 25422 raft_consensus.cc:740] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.136039 25422 consensus_queue.cc:260] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.136649 25460 leader_election.cc:290] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:25.137425 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:25.138043 25229 raft_consensus.cc:2468] T c6d3131e75284c0eb555c937d1c619cb P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 0.
I20260709 13:10:25.138219 25422 ts_tablet_manager.cc:1434] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:10:25.134611 25421 raft_consensus.cc:740] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.138797 25423 raft_consensus.cc:515] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.139192 25345 leader_election.cc:304] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:10:25.139364 25421 consensus_queue.cc:260] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.139907 25460 raft_consensus.cc:2804] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:25.140357 25460 raft_consensus.cc:493] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.140753 25460 raft_consensus.cc:3060] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.141620 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:10:25.142230 25422 tablet_bootstrap.cc:492] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19: Bootstrap starting.
I20260709 13:10:25.142151 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:10:25.142272 25229 raft_consensus.cc:3060] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:25.144632 25271 leader_election.cc:343] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:25.145180 25455 leader_election.cc:290] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:25.147190 25378 raft_consensus.cc:2468] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 1.
I20260709 13:10:25.147902 25460 raft_consensus.cc:515] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.148360 25422 tablet_bootstrap.cc:654] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.149375 25229 raft_consensus.cc:2468] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 1.
I20260709 13:10:25.150092 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:25.150700 25305 raft_consensus.cc:2468] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 0.
I20260709 13:10:25.150897 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:10:25.151441 25228 raft_consensus.cc:3060] T c6d3131e75284c0eb555c937d1c619cb P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.151767 25270 leader_election.cc:304] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:10:25.152879 25431 raft_consensus.cc:2804] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:25.153330 25431 raft_consensus.cc:697] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:10:25.154188 25431 consensus_queue.cc:237] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.158270 25455 raft_consensus.cc:493] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.158751 25455 raft_consensus.cc:515] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.154213 25423 leader_election.cc:290] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:25.162514 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:10:25.163107 25305 raft_consensus.cc:3060] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.162987 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:25.164095 25230 raft_consensus.cc:2393] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 1: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:10:25.164669 25228 raft_consensus.cc:2468] T c6d3131e75284c0eb555c937d1c619cb P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 1.
I20260709 13:10:25.166647 25345 leader_election.cc:304] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:10:25.165524 25460 leader_election.cc:290] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:25.167205 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:25.167529 25423 raft_consensus.cc:2804] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:25.168200 25423 raft_consensus.cc:697] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:10:25.169294 25423 consensus_queue.cc:237] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.172910 25343 leader_election.cc:304] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:10:25.173462 25455 leader_election.cc:290] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:25.174258 25455 raft_consensus.cc:3060] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.176710 25345 leader_election.cc:304] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:10:25.175793 25421 ts_tablet_manager.cc:1434] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.000s
I20260709 13:10:25.177794 25456 raft_consensus.cc:2804] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:25.178232 25456 raft_consensus.cc:697] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:10:25.179040 25456 consensus_queue.cc:237] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.182233 25421 tablet_bootstrap.cc:492] T 87095494ab7d40b7a42f4b05732acbf5 P 1f539ba21487460085b837e7529a78ce: Bootstrap starting.
I20260709 13:10:25.187878 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:10:25.188468 25304 raft_consensus.cc:3060] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.187074 25305 raft_consensus.cc:2468] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 1.
I20260709 13:10:25.195325 25421 tablet_bootstrap.cc:654] T 87095494ab7d40b7a42f4b05732acbf5 P 1f539ba21487460085b837e7529a78ce: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.195393 25304 raft_consensus.cc:2468] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 1.
I20260709 13:10:25.176792 25125 catalog_manager.cc:5697] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 0 to 1, leader changed from <none> to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 1 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:25.197901 25128 catalog_manager.cc:5697] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 1 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:25.198721 25455 raft_consensus.cc:2749] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:25.202963 25419 tablet_bootstrap.cc:492] T 51ecc4484385405c857b3bee1077c36a P 79d99c0e498349bda74127365219e468: No bootstrap required, opened a new log
I20260709 13:10:25.203409 25419 ts_tablet_manager.cc:1403] T 51ecc4484385405c857b3bee1077c36a P 79d99c0e498349bda74127365219e468: Time spent bootstrapping tablet: real 0.103s	user 0.019s	sys 0.003s
I20260709 13:10:25.207903 25422 tablet_bootstrap.cc:492] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19: No bootstrap required, opened a new log
I20260709 13:10:25.208547 25422 ts_tablet_manager.cc:1403] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19: Time spent bootstrapping tablet: real 0.066s	user 0.023s	sys 0.031s
I20260709 13:10:25.211355 25422 raft_consensus.cc:359] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.211973 25422 raft_consensus.cc:385] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.212234 25422 raft_consensus.cc:740] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.212909 25419 raft_consensus.cc:359] T 51ecc4484385405c857b3bee1077c36a P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.213554 25419 raft_consensus.cc:385] T 51ecc4484385405c857b3bee1077c36a P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.213841 25419 raft_consensus.cc:740] T 51ecc4484385405c857b3bee1077c36a P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.214071 25422 consensus_queue.cc:260] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.214453 25419 consensus_queue.cc:260] T 51ecc4484385405c857b3bee1077c36a P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.215816 25421 tablet_bootstrap.cc:492] T 87095494ab7d40b7a42f4b05732acbf5 P 1f539ba21487460085b837e7529a78ce: No bootstrap required, opened a new log
I20260709 13:10:25.216284 25421 ts_tablet_manager.cc:1403] T 87095494ab7d40b7a42f4b05732acbf5 P 1f539ba21487460085b837e7529a78ce: Time spent bootstrapping tablet: real 0.034s	user 0.014s	sys 0.003s
I20260709 13:10:25.216370 25422 ts_tablet_manager.cc:1434] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:10:25.216437 25419 ts_tablet_manager.cc:1434] T 51ecc4484385405c857b3bee1077c36a P 79d99c0e498349bda74127365219e468: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:10:25.217283 25422 tablet_bootstrap.cc:492] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19: Bootstrap starting.
I20260709 13:10:25.216488 25127 catalog_manager.cc:5697] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 1 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:25.217398 25419 tablet_bootstrap.cc:492] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468: Bootstrap starting.
I20260709 13:10:25.219090 25421 raft_consensus.cc:359] T 87095494ab7d40b7a42f4b05732acbf5 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.219919 25421 raft_consensus.cc:385] T 87095494ab7d40b7a42f4b05732acbf5 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.220213 25421 raft_consensus.cc:740] T 87095494ab7d40b7a42f4b05732acbf5 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.220862 25421 consensus_queue.cc:260] T 87095494ab7d40b7a42f4b05732acbf5 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.224056 25422 tablet_bootstrap.cc:654] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.226197 25421 ts_tablet_manager.cc:1434] T 87095494ab7d40b7a42f4b05732acbf5 P 1f539ba21487460085b837e7529a78ce: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:10:25.227079 25421 tablet_bootstrap.cc:492] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce: Bootstrap starting.
I20260709 13:10:25.228437 25419 tablet_bootstrap.cc:654] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.230399 25431 raft_consensus.cc:493] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.230849 25431 raft_consensus.cc:515] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.232853 25431 leader_election.cc:290] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:25.234220 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:25.234274 25431 consensus_queue.cc:1048] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:25.234977 25229 raft_consensus.cc:2468] T 87095494ab7d40b7a42f4b05732acbf5 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 0.
I20260709 13:10:25.236781 25421 tablet_bootstrap.cc:654] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.236619 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:10:25.238003 25270 leader_election.cc:343] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:25.238812 25271 leader_election.cc:304] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:10:25.240918 25431 raft_consensus.cc:2804] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:25.241286 25431 raft_consensus.cc:493] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.241608 25431 raft_consensus.cc:3060] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.254179 25431 raft_consensus.cc:515] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.263084 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
W20260709 13:10:25.264482 25270 leader_election.cc:343] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:25.265069 25431 leader_election.cc:290] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:25.270030 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:10:25.270620 25228 raft_consensus.cc:3060] T 87095494ab7d40b7a42f4b05732acbf5 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.278692 25228 raft_consensus.cc:2468] T 87095494ab7d40b7a42f4b05732acbf5 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 1.
I20260709 13:10:25.282227 25456 consensus_queue.cc:1048] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:25.282307 25484 consensus_queue.cc:1048] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:25.283936 25484 consensus_queue.cc:1048] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:25.284950 25271 leader_election.cc:304] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:10:25.286150 25488 consensus_queue.cc:1048] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:25.287444 25488 raft_consensus.cc:2804] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:25.287863 25488 raft_consensus.cc:697] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:10:25.288677 25488 consensus_queue.cc:237] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.289968 25441 consensus_queue.cc:1048] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:25.298413 25419 tablet_bootstrap.cc:492] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468: No bootstrap required, opened a new log
I20260709 13:10:25.299008 25419 ts_tablet_manager.cc:1403] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468: Time spent bootstrapping tablet: real 0.082s	user 0.012s	sys 0.004s
I20260709 13:10:25.303437 25488 raft_consensus.cc:493] T ca881f8516e046c99da202e9d9ea00a1 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.303982 25488 raft_consensus.cc:515] T ca881f8516e046c99da202e9d9ea00a1 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.313555 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:25.313977 25422 tablet_bootstrap.cc:492] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19: No bootstrap required, opened a new log
I20260709 13:10:25.317658 25422 ts_tablet_manager.cc:1403] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19: Time spent bootstrapping tablet: real 0.101s	user 0.014s	sys 0.020s
I20260709 13:10:25.323143 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:25.323887 25229 raft_consensus.cc:2393] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 1: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:10:25.324610 25441 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.325091 25441 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.327585 25441 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:25.329335 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:25.314563 25488 leader_election.cc:290] T ca881f8516e046c99da202e9d9ea00a1 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:25.314862 25419 raft_consensus.cc:359] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.333539 25419 raft_consensus.cc:385] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.334008 25419 raft_consensus.cc:740] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.335166 25439 consensus_queue.cc:1048] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:25.335080 25419 consensus_queue.cc:260] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.336549 25439 raft_consensus.cc:493] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.337039 25439 raft_consensus.cc:515] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.339246 25439 leader_election.cc:290] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:25.340582 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:25.341535 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:25.321287 25422 raft_consensus.cc:359] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.342206 25377 raft_consensus.cc:2468] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 0.
I20260709 13:10:25.346622 25419 ts_tablet_manager.cc:1434] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468: Time spent starting tablet: real 0.047s	user 0.009s	sys 0.000s
I20260709 13:10:25.346710 25270 leader_election.cc:304] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:10:25.347599 25419 tablet_bootstrap.cc:492] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468: Bootstrap starting.
I20260709 13:10:25.347476 25439 raft_consensus.cc:2804] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:25.347939 25439 raft_consensus.cc:493] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.348424 25439 raft_consensus.cc:3060] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.347476 25421 tablet_bootstrap.cc:492] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce: No bootstrap required, opened a new log
I20260709 13:10:25.349321 25421 ts_tablet_manager.cc:1403] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce: Time spent bootstrapping tablet: real 0.122s	user 0.034s	sys 0.081s
I20260709 13:10:25.349895 25422 raft_consensus.cc:385] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.350247 25422 raft_consensus.cc:740] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.370656 25422 consensus_queue.cc:260] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.355124 25439 raft_consensus.cc:515] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.371528 25421 raft_consensus.cc:359] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.372439 25421 raft_consensus.cc:385] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.372797 25421 raft_consensus.cc:740] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.374112 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:10:25.347890 25271 leader_election.cc:304] T ca881f8516e046c99da202e9d9ea00a1 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:10:25.374817 25377 raft_consensus.cc:3060] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.378212 25431 raft_consensus.cc:3060] T ca881f8516e046c99da202e9d9ea00a1 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.373567 25421 consensus_queue.cc:260] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.379163 25439 leader_election.cc:290] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:25.379943 25421 ts_tablet_manager.cc:1434] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce: Time spent starting tablet: real 0.030s	user 0.003s	sys 0.003s
I20260709 13:10:25.380796 25422 ts_tablet_manager.cc:1434] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19: Time spent starting tablet: real 0.063s	user 0.007s	sys 0.000s
I20260709 13:10:25.381524 25441 consensus_queue.cc:1048] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:10:25.383602 25271 leader_election.cc:343] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:25.385396 25431 raft_consensus.cc:2749] T ca881f8516e046c99da202e9d9ea00a1 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:25.388656 25421 tablet_bootstrap.cc:492] T 35ae6d72e4154149b3d1721e2214570a P 1f539ba21487460085b837e7529a78ce: Bootstrap starting.
I20260709 13:10:25.394328 25422 tablet_bootstrap.cc:492] T 47228487a74240e9bc9bcd2e1d966ed6 P da445ce82dc4467f95f4fa52297eaa19: Bootstrap starting.
I20260709 13:10:25.394876 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:25.400836 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:10:25.404139 25421 tablet_bootstrap.cc:654] T 35ae6d72e4154149b3d1721e2214570a P 1f539ba21487460085b837e7529a78ce: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.404287 25228 raft_consensus.cc:3060] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.406032 25377 raft_consensus.cc:2468] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 1.
I20260709 13:10:25.408459 25439 consensus_queue.cc:1048] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:25.408984 25270 leader_election.cc:304] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:10:25.407582 25194 leader_election.cc:304] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:10:25.408511 25431 consensus_queue.cc:1048] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:25.410269 25488 raft_consensus.cc:2804] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:25.407444 25419 tablet_bootstrap.cc:654] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.410701 25488 raft_consensus.cc:697] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:10:25.411549 25488 consensus_queue.cc:237] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:10:25.412377 25271 leader_election.cc:343] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:25.413309 25422 tablet_bootstrap.cc:654] T 47228487a74240e9bc9bcd2e1d966ed6 P da445ce82dc4467f95f4fa52297eaa19: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.415011 25441 raft_consensus.cc:2749] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:25.420463 25460 consensus_queue.cc:1048] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:25.454924 25422 tablet_bootstrap.cc:492] T 47228487a74240e9bc9bcd2e1d966ed6 P da445ce82dc4467f95f4fa52297eaa19: No bootstrap required, opened a new log
I20260709 13:10:25.455374 25422 ts_tablet_manager.cc:1403] T 47228487a74240e9bc9bcd2e1d966ed6 P da445ce82dc4467f95f4fa52297eaa19: Time spent bootstrapping tablet: real 0.061s	user 0.011s	sys 0.005s
I20260709 13:10:25.461011 25439 raft_consensus.cc:493] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.461696 25421 tablet_bootstrap.cc:492] T 35ae6d72e4154149b3d1721e2214570a P 1f539ba21487460085b837e7529a78ce: No bootstrap required, opened a new log
I20260709 13:10:25.464344 25421 ts_tablet_manager.cc:1403] T 35ae6d72e4154149b3d1721e2214570a P 1f539ba21487460085b837e7529a78ce: Time spent bootstrapping tablet: real 0.076s	user 0.007s	sys 0.012s
I20260709 13:10:25.467031 25421 raft_consensus.cc:359] T 35ae6d72e4154149b3d1721e2214570a P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.467669 25421 raft_consensus.cc:385] T 35ae6d72e4154149b3d1721e2214570a P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.467950 25421 raft_consensus.cc:740] T 35ae6d72e4154149b3d1721e2214570a P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.462563 25439 raft_consensus.cc:515] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.468577 25421 consensus_queue.cc:260] T 35ae6d72e4154149b3d1721e2214570a P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.470292 25439 leader_election.cc:290] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:25.471256 25127 catalog_manager.cc:5697] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 0 to 1, leader changed from <none> to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 1 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:25.474360 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:10:25.478052 25271 leader_election.cc:343] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:25.495571 25230 raft_consensus.cc:3060] T 35ae6d72e4154149b3d1721e2214570a P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.496312 25421 ts_tablet_manager.cc:1434] T 35ae6d72e4154149b3d1721e2214570a P 1f539ba21487460085b837e7529a78ce: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.001s
I20260709 13:10:25.497272 25421 tablet_bootstrap.cc:492] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce: Bootstrap starting.
I20260709 13:10:25.502775 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:25.503432 25376 raft_consensus.cc:2468] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 0.
I20260709 13:10:25.505221 25270 leader_election.cc:304] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:10:25.506062 25439 raft_consensus.cc:2804] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:25.506444 25439 raft_consensus.cc:493] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.506770 25439 raft_consensus.cc:3060] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.508453 25460 consensus_queue.cc:1048] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:25.509047 25423 consensus_queue.cc:1048] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:25.509601 25455 raft_consensus.cc:493] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.510130 25455 raft_consensus.cc:515] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.511859 25431 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.512074 25455 leader_election.cc:290] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:25.512318 25431 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.514259 25431 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:25.514858 25421 tablet_bootstrap.cc:654] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.517020 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:25.519014 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:25.519397 25488 consensus_queue.cc:1048] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:10:25.520423 25270 leader_election.cc:343] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:25.521281 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:25.522094 25230 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 0.
I20260709 13:10:25.523376 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:10:25.526495 25343 leader_election.cc:343] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:25.527426 25345 leader_election.cc:343] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:25.527889 25345 leader_election.cc:304] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:10:25.529090 25456 raft_consensus.cc:493] T 51ecc4484385405c857b3bee1077c36a P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.529925 25455 raft_consensus.cc:2749] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:25.529646 25456 raft_consensus.cc:515] T 51ecc4484385405c857b3bee1077c36a P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.533155 25456 leader_election.cc:290] T 51ecc4484385405c857b3bee1077c36a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:25.534404 25271 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:10:25.535506 25488 raft_consensus.cc:2804] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:25.535974 25488 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.536387 25488 raft_consensus.cc:3060] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.538286 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:10:25.540325 25345 leader_election.cc:343] T 51ecc4484385405c857b3bee1077c36a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:25.544418 25455 consensus_queue.cc:1048] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:25.546193 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:25.550333 25421 tablet_bootstrap.cc:492] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce: No bootstrap required, opened a new log
I20260709 13:10:25.550981 25421 ts_tablet_manager.cc:1403] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce: Time spent bootstrapping tablet: real 0.054s	user 0.010s	sys 0.001s
W20260709 13:10:25.554348 25343 leader_election.cc:343] T 51ecc4484385405c857b3bee1077c36a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:25.554996 25343 leader_election.cc:304] T 51ecc4484385405c857b3bee1077c36a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:10:25.556711 25455 raft_consensus.cc:2749] T 51ecc4484385405c857b3bee1077c36a P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:25.559206 25421 raft_consensus.cc:359] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.560043 25421 raft_consensus.cc:385] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.560418 25421 raft_consensus.cc:740] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.561136 25421 consensus_queue.cc:260] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.562619 25419 tablet_bootstrap.cc:492] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468: No bootstrap required, opened a new log
I20260709 13:10:25.563050 25419 ts_tablet_manager.cc:1403] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468: Time spent bootstrapping tablet: real 0.216s	user 0.037s	sys 0.073s
I20260709 13:10:25.565503 25419 raft_consensus.cc:359] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.566131 25419 raft_consensus.cc:385] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.566378 25419 raft_consensus.cc:740] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.567534 25419 consensus_queue.cc:260] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.569437 25421 ts_tablet_manager.cc:1434] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:10:25.569821 25419 ts_tablet_manager.cc:1434] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:10:25.570458 25421 tablet_bootstrap.cc:492] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce: Bootstrap starting.
I20260709 13:10:25.570593 25419 tablet_bootstrap.cc:492] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468: Bootstrap starting.
I20260709 13:10:25.570315 25422 raft_consensus.cc:359] T 47228487a74240e9bc9bcd2e1d966ed6 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.571272 25422 raft_consensus.cc:385] T 47228487a74240e9bc9bcd2e1d966ed6 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.573014 25439 raft_consensus.cc:515] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.576529 25421 tablet_bootstrap.cc:654] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.576793 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:10:25.576825 25419 tablet_bootstrap.cc:654] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:25.578368 25271 leader_election.cc:343] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:25.550347 25488 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.589349 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:10:25.589931 25226 raft_consensus.cc:3060] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.593108 25421 tablet_bootstrap.cc:492] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce: No bootstrap required, opened a new log
I20260709 13:10:25.593616 25421 ts_tablet_manager.cc:1403] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.004s
I20260709 13:10:25.596973 25431 consensus_queue.cc:1048] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:25.598155 25455 consensus_queue.cc:1048] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:25.603678 25226 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 1.
I20260709 13:10:25.604944 25271 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:10:25.605892 25431 raft_consensus.cc:2804] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:25.606395 25431 raft_consensus.cc:697] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:10:25.607283 25431 consensus_queue.cc:237] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.615288 25456 consensus_queue.cc:1048] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:25.606387 25421 raft_consensus.cc:359] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.615267 25455 consensus_queue.cc:1048] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:25.619176 25421 raft_consensus.cc:385] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.619515 25419 tablet_bootstrap.cc:492] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468: No bootstrap required, opened a new log
I20260709 13:10:25.620384 25419 ts_tablet_manager.cc:1403] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468: Time spent bootstrapping tablet: real 0.050s	user 0.014s	sys 0.010s
I20260709 13:10:25.622756 25484 raft_consensus.cc:493] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.623189 25484 raft_consensus.cc:515] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.623349 25419 raft_consensus.cc:359] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.624038 25419 raft_consensus.cc:385] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.624357 25419 raft_consensus.cc:740] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.625236 25484 leader_election.cc:290] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:25.625102 25419 consensus_queue.cc:260] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.627959 25419 ts_tablet_manager.cc:1434] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:10:25.631405 25419 tablet_bootstrap.cc:492] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468: Bootstrap starting.
I20260709 13:10:25.637717 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:25.628300 25421 raft_consensus.cc:740] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.635468 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:25.636240 25455 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.639473 25421 consensus_queue.cc:260] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.639879 25455 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.641456 25421 ts_tablet_manager.cc:1434] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce: Time spent starting tablet: real 0.048s	user 0.004s	sys 0.000s
I20260709 13:10:25.641810 25455 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:25.642302 25421 tablet_bootstrap.cc:492] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce: Bootstrap starting.
W20260709 13:10:25.644544 25194 leader_election.cc:343] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:25.645156 25271 consensus_peers.cc:597] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:25.645025 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:10:25.646426 25195 leader_election.cc:343] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:25.646867 25195 leader_election.cc:304] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:10:25.571630 25422 raft_consensus.cc:740] T 47228487a74240e9bc9bcd2e1d966ed6 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.655794 25421 tablet_bootstrap.cc:654] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.656308 25484 raft_consensus.cc:2749] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:25.659112 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:25.665540 25228 raft_consensus.cc:2393] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 1: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:10:25.661986 25488 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:25.662672 25439 leader_election.cc:290] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:25.663230 25422 consensus_queue.cc:260] T 47228487a74240e9bc9bcd2e1d966ed6 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.668131 25460 consensus_queue.cc:1048] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:25.672933 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:10:25.672540 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:10:25.676232 25422 ts_tablet_manager.cc:1434] T 47228487a74240e9bc9bcd2e1d966ed6 P da445ce82dc4467f95f4fa52297eaa19: Time spent starting tablet: real 0.221s	user 0.008s	sys 0.007s
I20260709 13:10:25.677152 25422 tablet_bootstrap.cc:492] T 0eaedd90995b476890a2ea23d7089759 P da445ce82dc4467f95f4fa52297eaa19: Bootstrap starting.
I20260709 13:10:25.674539 25379 raft_consensus.cc:3060] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.679392 25376 raft_consensus.cc:3060] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.718240 25419 tablet_bootstrap.cc:654] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.708586 25345 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:10:25.707419 25455 consensus_queue.cc:1048] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:10:25.724399 25422 tablet_bootstrap.cc:654] T 0eaedd90995b476890a2ea23d7089759 P da445ce82dc4467f95f4fa52297eaa19: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.726011 25421 tablet_bootstrap.cc:492] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce: No bootstrap required, opened a new log
I20260709 13:10:25.726459 25421 ts_tablet_manager.cc:1403] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce: Time spent bootstrapping tablet: real 0.084s	user 0.014s	sys 0.011s
I20260709 13:10:25.729322 25421 raft_consensus.cc:359] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.730351 25421 raft_consensus.cc:385] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.730760 25421 raft_consensus.cc:740] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Initialized, Role: FOLLOWER
W20260709 13:10:25.730598 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 43670.5us
I20260709 13:10:25.736536 25421 consensus_queue.cc:260] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.738890 25422 tablet_bootstrap.cc:492] T 0eaedd90995b476890a2ea23d7089759 P da445ce82dc4467f95f4fa52297eaa19: No bootstrap required, opened a new log
I20260709 13:10:25.739313 25422 ts_tablet_manager.cc:1403] T 0eaedd90995b476890a2ea23d7089759 P da445ce82dc4467f95f4fa52297eaa19: Time spent bootstrapping tablet: real 0.062s	user 0.010s	sys 0.007s
I20260709 13:10:25.748407 25421 ts_tablet_manager.cc:1434] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.002s
I20260709 13:10:25.749008 25376 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 1.
I20260709 13:10:25.750821 25460 raft_consensus.cc:2749] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:25.755790 25530 raft_consensus.cc:493] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.756477 25530 raft_consensus.cc:515] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.756929 25422 raft_consensus.cc:359] T 0eaedd90995b476890a2ea23d7089759 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.757829 25422 raft_consensus.cc:385] T 0eaedd90995b476890a2ea23d7089759 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.758173 25422 raft_consensus.cc:740] T 0eaedd90995b476890a2ea23d7089759 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.758944 25422 consensus_queue.cc:260] T 0eaedd90995b476890a2ea23d7089759 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.760236 25530 leader_election.cc:290] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:25.760834 25422 ts_tablet_manager.cc:1434] T 0eaedd90995b476890a2ea23d7089759 P da445ce82dc4467f95f4fa52297eaa19: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.003s
I20260709 13:10:25.761323 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:25.761730 25422 tablet_bootstrap.cc:492] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19: Bootstrap starting.
I20260709 13:10:25.761933 25376 raft_consensus.cc:2468] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 0.
I20260709 13:10:25.763031 25195 leader_election.cc:304] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:10:25.765147 25421 tablet_bootstrap.cc:492] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce: Bootstrap starting.
I20260709 13:10:25.765496 25530 raft_consensus.cc:2804] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:25.773672 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:25.774325 25303 raft_consensus.cc:2468] T 0eaedd90995b476890a2ea23d7089759 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 0.
I20260709 13:10:25.774765 25379 raft_consensus.cc:2468] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 1.
I20260709 13:10:25.776078 25270 leader_election.cc:304] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:10:25.785101 25549 raft_consensus.cc:2804] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:25.786916 25549 raft_consensus.cc:697] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:10:25.788422 25549 consensus_queue.cc:237] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.770780 25530 raft_consensus.cc:493] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.790905 25128 catalog_manager.cc:5697] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 0 to 1, leader changed from <none> to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 1 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:25.804862 25441 raft_consensus.cc:493] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.805430 25441 raft_consensus.cc:515] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.809474 25441 leader_election.cc:290] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:25.791970 25530 raft_consensus.cc:3060] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.870954 25419 tablet_bootstrap.cc:492] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468: No bootstrap required, opened a new log
I20260709 13:10:25.871441 25419 ts_tablet_manager.cc:1403] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468: Time spent bootstrapping tablet: real 0.240s	user 0.012s	sys 0.025s
I20260709 13:10:25.866328 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:10:25.881086 25270 consensus_peers.cc:597] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 -> Peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Couldn't send request to peer 79d99c0e498349bda74127365219e468. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:25.880939 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:25.882277 25419 raft_consensus.cc:359] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.882937 25419 raft_consensus.cc:385] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.883188 25419 raft_consensus.cc:740] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.884184 25419 consensus_queue.cc:260] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:10:25.885461 25195 leader_election.cc:343] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:25.886770 25421 tablet_bootstrap.cc:654] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.885475 25550 consensus_queue.cc:1048] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:10:25.891117 25419 ts_tablet_manager.cc:1434] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
W20260709 13:10:25.890576 25194 leader_election.cc:343] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:25.893157 25419 tablet_bootstrap.cc:492] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468: Bootstrap starting.
I20260709 13:10:25.894527 25194 leader_election.cc:304] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:10:25.895263 25441 raft_consensus.cc:2749] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:25.897302 25441 raft_consensus.cc:493] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.898000 25441 raft_consensus.cc:515] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.900444 25441 leader_election.cc:290] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:25.905557 25419 tablet_bootstrap.cc:654] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.917486 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:25.918916 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:25.920912 25376 raft_consensus.cc:2468] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 0.
I20260709 13:10:25.925375 25530 raft_consensus.cc:515] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:10:25.925944 25194 leader_election.cc:343] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:25.926788 25271 consensus_peers.cc:597] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:25.927784 25421 tablet_bootstrap.cc:492] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce: No bootstrap required, opened a new log
I20260709 13:10:25.928619 25422 tablet_bootstrap.cc:654] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.930182 25421 ts_tablet_manager.cc:1403] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce: Time spent bootstrapping tablet: real 0.165s	user 0.012s	sys 0.011s
I20260709 13:10:25.942797 25421 raft_consensus.cc:359] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.943737 25421 raft_consensus.cc:385] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.944073 25421 raft_consensus.cc:740] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.944751 25421 consensus_queue.cc:260] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.949290 25128 catalog_manager.cc:5697] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 0 to 1, leader changed from <none> to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 1 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:25.958776 25128 catalog_manager.cc:5697] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 0 to 1, leader changed from <none> to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 1 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:25.960593 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:10:25.961272 25304 raft_consensus.cc:3060] T 0eaedd90995b476890a2ea23d7089759 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.962941 25439 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.967191 25439 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.969136 25439 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:25.963064 25195 leader_election.cc:304] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:10:25.963721 25421 ts_tablet_manager.cc:1434] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.001s
I20260709 13:10:25.970858 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:25.963972 25488 consensus_queue.cc:1048] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:25.961282 25530 leader_election.cc:290] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:25.964908 25484 raft_consensus.cc:493] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.979173 25484 raft_consensus.cc:515] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:25.980358 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:10:25.980914 25376 raft_consensus.cc:3060] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.981297 25484 leader_election.cc:290] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:25.973464 25441 raft_consensus.cc:2804] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:25.982466 25441 raft_consensus.cc:493] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.982847 25441 raft_consensus.cc:3060] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.983032 25304 raft_consensus.cc:2468] T 0eaedd90995b476890a2ea23d7089759 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 1.
I20260709 13:10:25.975701 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:25.985244 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:25.985958 25379 raft_consensus.cc:2393] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 1: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
W20260709 13:10:25.978464 25271 leader_election.cc:343] T 47228487a74240e9bc9bcd2e1d966ed6 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:25.988981 25270 leader_election.cc:343] T 47228487a74240e9bc9bcd2e1d966ed6 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:25.989642 25194 leader_election.cc:304] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:10:25.989929 25270 leader_election.cc:304] T 47228487a74240e9bc9bcd2e1d966ed6 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:10:25.990463 25484 raft_consensus.cc:2804] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:25.990892 25484 raft_consensus.cc:697] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:10:25.970872 25421 tablet_bootstrap.cc:492] T f78697097cd14345b6a749c7aad4f696 P 1f539ba21487460085b837e7529a78ce: Bootstrap starting.
I20260709 13:10:25.991582 25439 raft_consensus.cc:2749] T 47228487a74240e9bc9bcd2e1d966ed6 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:25.993479 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:25.994973 25194 leader_election.cc:304] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:10:25.995776 25530 raft_consensus.cc:3060] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.991622 25484 consensus_queue.cc:237] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.002337 25421 tablet_bootstrap.cc:654] T f78697097cd14345b6a749c7aad4f696 P 1f539ba21487460085b837e7529a78ce: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.007359 25419 tablet_bootstrap.cc:492] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468: No bootstrap required, opened a new log
I20260709 13:10:26.007922 25419 ts_tablet_manager.cc:1403] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468: Time spent bootstrapping tablet: real 0.115s	user 0.010s	sys 0.009s
I20260709 13:10:26.008263 25441 raft_consensus.cc:515] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.010818 25419 raft_consensus.cc:359] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.011123 25376 raft_consensus.cc:2468] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 1.
I20260709 13:10:26.011556 25419 raft_consensus.cc:385] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.011891 25419 raft_consensus.cc:740] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.012550 25419 consensus_queue.cc:260] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.015383 25422 tablet_bootstrap.cc:492] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19: No bootstrap required, opened a new log
I20260709 13:10:26.015688 25421 tablet_bootstrap.cc:492] T f78697097cd14345b6a749c7aad4f696 P 1f539ba21487460085b837e7529a78ce: No bootstrap required, opened a new log
I20260709 13:10:26.015843 25422 ts_tablet_manager.cc:1403] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19: Time spent bootstrapping tablet: real 0.254s	user 0.018s	sys 0.015s
I20260709 13:10:26.016081 25530 raft_consensus.cc:2749] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:26.016189 25421 ts_tablet_manager.cc:1403] T f78697097cd14345b6a749c7aad4f696 P 1f539ba21487460085b837e7529a78ce: Time spent bootstrapping tablet: real 0.045s	user 0.010s	sys 0.002s
I20260709 13:10:26.018002 25422 raft_consensus.cc:359] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.018507 25422 raft_consensus.cc:385] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.018743 25422 raft_consensus.cc:740] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.018772 25421 raft_consensus.cc:359] T f78697097cd14345b6a749c7aad4f696 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.019562 25421 raft_consensus.cc:385] T f78697097cd14345b6a749c7aad4f696 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.019827 25421 raft_consensus.cc:740] T f78697097cd14345b6a749c7aad4f696 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.020023 25422 consensus_queue.cc:260] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.021615 25422 ts_tablet_manager.cc:1434] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:10:26.023010 25419 ts_tablet_manager.cc:1434] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.004s
I20260709 13:10:26.023849 25419 tablet_bootstrap.cc:492] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468: Bootstrap starting.
I20260709 13:10:26.024580 25441 leader_election.cc:290] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:26.025192 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
W20260709 13:10:26.026582 25194 leader_election.cc:343] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.029321 25419 tablet_bootstrap.cc:654] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.031145 25422 tablet_bootstrap.cc:492] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19: Bootstrap starting.
I20260709 13:10:26.035009 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:10:26.035917 25376 raft_consensus.cc:3060] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.037411 25422 tablet_bootstrap.cc:654] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.043784 25419 tablet_bootstrap.cc:492] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468: No bootstrap required, opened a new log
I20260709 13:10:26.044167 25419 ts_tablet_manager.cc:1403] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 13:10:26.046365 25419 raft_consensus.cc:359] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.047000 25419 raft_consensus.cc:385] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.047030 25376 raft_consensus.cc:2468] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 1.
I20260709 13:10:26.048393 25195 leader_election.cc:304] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:10:26.047312 25419 raft_consensus.cc:740] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.049880 25441 raft_consensus.cc:2804] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:26.049687 25419 consensus_queue.cc:260] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.050566 25441 raft_consensus.cc:697] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:10:26.051645 25441 consensus_queue.cc:237] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.054915 25419 ts_tablet_manager.cc:1434] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:10:26.055864 25419 tablet_bootstrap.cc:492] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468: Bootstrap starting.
I20260709 13:10:26.020455 25421 consensus_queue.cc:260] T f78697097cd14345b6a749c7aad4f696 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.059756 25422 tablet_bootstrap.cc:492] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19: No bootstrap required, opened a new log
I20260709 13:10:26.060200 25422 ts_tablet_manager.cc:1403] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19: Time spent bootstrapping tablet: real 0.029s	user 0.007s	sys 0.004s
I20260709 13:10:26.062841 25422 raft_consensus.cc:359] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.063529 25422 raft_consensus.cc:385] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.063797 25422 raft_consensus.cc:740] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.064544 25422 consensus_queue.cc:260] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.065917 25419 tablet_bootstrap.cc:654] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.072990 25421 ts_tablet_manager.cc:1434] T f78697097cd14345b6a749c7aad4f696 P 1f539ba21487460085b837e7529a78ce: Time spent starting tablet: real 0.056s	user 0.005s	sys 0.000s
I20260709 13:10:26.076280 25421 tablet_bootstrap.cc:492] T 56a9fdb76a7d494e81629b861acc1489 P 1f539ba21487460085b837e7529a78ce: Bootstrap starting.
I20260709 13:10:26.076731 25422 ts_tablet_manager.cc:1434] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:10:26.081944 25421 tablet_bootstrap.cc:654] T 56a9fdb76a7d494e81629b861acc1489 P 1f539ba21487460085b837e7529a78ce: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.086690 25419 tablet_bootstrap.cc:492] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468: No bootstrap required, opened a new log
I20260709 13:10:26.087168 25419 ts_tablet_manager.cc:1403] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468: Time spent bootstrapping tablet: real 0.032s	user 0.005s	sys 0.010s
I20260709 13:10:26.088464 25422 tablet_bootstrap.cc:492] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19: Bootstrap starting.
I20260709 13:10:26.089419 25421 tablet_bootstrap.cc:492] T 56a9fdb76a7d494e81629b861acc1489 P 1f539ba21487460085b837e7529a78ce: No bootstrap required, opened a new log
I20260709 13:10:26.090077 25421 ts_tablet_manager.cc:1403] T 56a9fdb76a7d494e81629b861acc1489 P 1f539ba21487460085b837e7529a78ce: Time spent bootstrapping tablet: real 0.014s	user 0.007s	sys 0.006s
I20260709 13:10:26.089725 25419 raft_consensus.cc:359] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.090399 25419 raft_consensus.cc:385] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.090705 25419 raft_consensus.cc:740] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.090497 25128 catalog_manager.cc:5697] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 1 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:26.091542 25419 consensus_queue.cc:260] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.093019 25421 raft_consensus.cc:359] T 56a9fdb76a7d494e81629b861acc1489 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.093660 25421 raft_consensus.cc:385] T 56a9fdb76a7d494e81629b861acc1489 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.093693 25419 ts_tablet_manager.cc:1434] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.006s
I20260709 13:10:26.094054 25421 raft_consensus.cc:740] T 56a9fdb76a7d494e81629b861acc1489 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.094786 25419 tablet_bootstrap.cc:492] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468: Bootstrap starting.
I20260709 13:10:26.094787 25421 consensus_queue.cc:260] T 56a9fdb76a7d494e81629b861acc1489 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.096256 25422 tablet_bootstrap.cc:654] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.096863 25421 ts_tablet_manager.cc:1434] T 56a9fdb76a7d494e81629b861acc1489 P 1f539ba21487460085b837e7529a78ce: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:10:26.097802 25421 tablet_bootstrap.cc:492] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce: Bootstrap starting.
I20260709 13:10:26.100466 25419 tablet_bootstrap.cc:654] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.103520 25421 tablet_bootstrap.cc:654] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.107969 25484 raft_consensus.cc:493] T f78697097cd14345b6a749c7aad4f696 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.108584 25484 raft_consensus.cc:515] T f78697097cd14345b6a749c7aad4f696 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.109926 25439 raft_consensus.cc:493] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.110528 25439 raft_consensus.cc:515] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.113837 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:26.114482 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:10:26.116302 25270 leader_election.cc:343] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.117602 25484 leader_election.cc:290] T f78697097cd14345b6a749c7aad4f696 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:26.119742 25229 raft_consensus.cc:3060] T 56a9fdb76a7d494e81629b861acc1489 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.122304 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:26.123899 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:26.125659 25419 tablet_bootstrap.cc:492] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468: No bootstrap required, opened a new log
I20260709 13:10:26.125921 25195 leader_election.cc:304] T f78697097cd14345b6a749c7aad4f696 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:10:26.126356 25419 ts_tablet_manager.cc:1403] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468: Time spent bootstrapping tablet: real 0.032s	user 0.017s	sys 0.000s
I20260709 13:10:26.127112 25484 raft_consensus.cc:2749] T f78697097cd14345b6a749c7aad4f696 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:10:26.129364 25271 leader_election.cc:343] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.130017 25271 leader_election.cc:304] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:10:26.131063 25488 raft_consensus.cc:2749] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:26.143047 25419 raft_consensus.cc:359] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.143771 25419 raft_consensus.cc:385] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.144049 25419 raft_consensus.cc:740] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.144348 25421 tablet_bootstrap.cc:492] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce: No bootstrap required, opened a new log
I20260709 13:10:26.144860 25421 ts_tablet_manager.cc:1403] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce: Time spent bootstrapping tablet: real 0.047s	user 0.031s	sys 0.015s
I20260709 13:10:26.145206 25422 tablet_bootstrap.cc:492] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19: No bootstrap required, opened a new log
I20260709 13:10:26.145052 25419 consensus_queue.cc:260] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.145840 25422 ts_tablet_manager.cc:1403] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19: Time spent bootstrapping tablet: real 0.058s	user 0.021s	sys 0.022s
I20260709 13:10:26.147275 25439 leader_election.cc:290] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:26.148432 25419 ts_tablet_manager.cc:1434] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:10:26.148408 25422 raft_consensus.cc:359] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.149132 25422 raft_consensus.cc:385] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.149395 25422 raft_consensus.cc:740] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.150065 25422 consensus_queue.cc:260] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.151024 25488 consensus_queue.cc:1048] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:26.152011 25422 ts_tablet_manager.cc:1434] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:10:26.153021 25422 tablet_bootstrap.cc:492] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19: Bootstrap starting.
I20260709 13:10:26.158166 25421 raft_consensus.cc:359] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.158834 25421 raft_consensus.cc:385] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.159093 25421 raft_consensus.cc:740] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.160084 25419 tablet_bootstrap.cc:492] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468: Bootstrap starting.
I20260709 13:10:26.166520 25421 consensus_queue.cc:260] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.167547 25439 consensus_queue.cc:1048] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:26.169991 25421 ts_tablet_manager.cc:1434] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:10:26.170956 25422 tablet_bootstrap.cc:654] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.171002 25421 tablet_bootstrap.cc:492] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce: Bootstrap starting.
I20260709 13:10:26.200850 25421 tablet_bootstrap.cc:654] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:26.196682 25175 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:26.205775 25554 raft_consensus.cc:493] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.206489 25554 raft_consensus.cc:515] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.210052 25422 tablet_bootstrap.cc:492] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19: No bootstrap required, opened a new log
I20260709 13:10:26.210520 25422 ts_tablet_manager.cc:1403] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19: Time spent bootstrapping tablet: real 0.058s	user 0.011s	sys 0.011s
I20260709 13:10:26.212435 25419 tablet_bootstrap.cc:654] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.213222 25422 raft_consensus.cc:359] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.213985 25422 raft_consensus.cc:385] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.214249 25422 raft_consensus.cc:740] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.214923 25422 consensus_queue.cc:260] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.217775 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:26.218392 25230 raft_consensus.cc:2468] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 0.
I20260709 13:10:26.218811 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:26.214886 25554 leader_election.cc:290] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:26.219669 25345 leader_election.cc:304] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
W20260709 13:10:26.229003 25343 leader_election.cc:343] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.230154 25554 raft_consensus.cc:2804] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:26.230621 25554 raft_consensus.cc:493] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.231083 25554 raft_consensus.cc:3060] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.233395 25439 consensus_queue.cc:1048] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:26.236377 25422 ts_tablet_manager.cc:1434] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.000s
I20260709 13:10:26.240531 25422 tablet_bootstrap.cc:492] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P da445ce82dc4467f95f4fa52297eaa19: Bootstrap starting.
I20260709 13:10:26.239600 25421 tablet_bootstrap.cc:492] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce: No bootstrap required, opened a new log
I20260709 13:10:26.246142 25421 ts_tablet_manager.cc:1403] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce: Time spent bootstrapping tablet: real 0.075s	user 0.010s	sys 0.013s
I20260709 13:10:26.247296 25128 catalog_manager.cc:5697] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 1 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:26.248422 25554 raft_consensus.cc:515] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.249953 25421 raft_consensus.cc:359] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.251926 25421 raft_consensus.cc:385] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.252596 25421 raft_consensus.cc:740] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.254091 25421 consensus_queue.cc:260] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.256027 25422 tablet_bootstrap.cc:654] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P da445ce82dc4467f95f4fa52297eaa19: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.259927 25421 ts_tablet_manager.cc:1434] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 13:10:26.260808 25421 tablet_bootstrap.cc:492] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce: Bootstrap starting.
I20260709 13:10:26.262902 25550 raft_consensus.cc:493] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.263394 25550 raft_consensus.cc:515] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.266022 25550 leader_election.cc:290] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:26.268563 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:10:26.271288 25271 leader_election.cc:343] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.272473 25421 tablet_bootstrap.cc:654] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.280352 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:26.283131 25549 consensus_queue.cc:1048] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:26.286828 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:10:26.287429 25226 raft_consensus.cc:3060] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.287942 25419 tablet_bootstrap.cc:492] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468: No bootstrap required, opened a new log
I20260709 13:10:26.288419 25419 ts_tablet_manager.cc:1403] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468: Time spent bootstrapping tablet: real 0.129s	user 0.016s	sys 0.016s
I20260709 13:10:26.290717 25554 leader_election.cc:290] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:26.292034 25419 raft_consensus.cc:359] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.292692 25419 raft_consensus.cc:385] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.292981 25419 raft_consensus.cc:740] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.294158 25226 raft_consensus.cc:2468] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 1.
I20260709 13:10:26.295258 25345 leader_election.cc:304] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:10:26.296059 25554 raft_consensus.cc:2804] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:26.297130 25554 raft_consensus.cc:697] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:10:26.297988 25554 consensus_queue.cc:237] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.299610 25419 consensus_queue.cc:260] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.303247 25419 ts_tablet_manager.cc:1434] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.001s
I20260709 13:10:26.304399 25419 tablet_bootstrap.cc:492] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468: Bootstrap starting.
I20260709 13:10:26.304936 25422 tablet_bootstrap.cc:492] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P da445ce82dc4467f95f4fa52297eaa19: No bootstrap required, opened a new log
I20260709 13:10:26.305454 25422 ts_tablet_manager.cc:1403] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P da445ce82dc4467f95f4fa52297eaa19: Time spent bootstrapping tablet: real 0.065s	user 0.019s	sys 0.029s
I20260709 13:10:26.308068 25422 raft_consensus.cc:359] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.308840 25422 raft_consensus.cc:385] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:10:26.309957 25270 leader_election.cc:343] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.310424 25270 leader_election.cc:304] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:10:26.311340 25422 raft_consensus.cc:740] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.311434 25550 raft_consensus.cc:2749] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:26.312592 25419 tablet_bootstrap.cc:654] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.312561 25422 consensus_queue.cc:260] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.315330 25422 ts_tablet_manager.cc:1434] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P da445ce82dc4467f95f4fa52297eaa19: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:10:26.316622 25422 tablet_bootstrap.cc:492] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19: Bootstrap starting.
I20260709 13:10:26.283147 25421 tablet_bootstrap.cc:492] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce: No bootstrap required, opened a new log
I20260709 13:10:26.318717 25421 ts_tablet_manager.cc:1403] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce: Time spent bootstrapping tablet: real 0.058s	user 0.012s	sys 0.000s
I20260709 13:10:26.319669 25419 tablet_bootstrap.cc:492] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468: No bootstrap required, opened a new log
I20260709 13:10:26.320097 25419 ts_tablet_manager.cc:1403] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 13:10:26.320112 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:10:26.320860 25305 raft_consensus.cc:3060] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.321287 25421 raft_consensus.cc:359] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.321947 25421 raft_consensus.cc:385] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.322201 25421 raft_consensus.cc:740] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.323259 25422 tablet_bootstrap.cc:654] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.324085 25125 catalog_manager.cc:5697] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 1 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:26.325817 25421 consensus_queue.cc:260] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.322763 25419 raft_consensus.cc:359] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.327549 25419 raft_consensus.cc:385] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.327823 25419 raft_consensus.cc:740] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.328526 25419 consensus_queue.cc:260] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.330621 25419 ts_tablet_manager.cc:1434] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:10:26.331429 25419 tablet_bootstrap.cc:492] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468: Bootstrap starting.
I20260709 13:10:26.332135 25421 ts_tablet_manager.cc:1434] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:10:26.333083 25421 tablet_bootstrap.cc:492] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce: Bootstrap starting.
I20260709 13:10:26.337019 25419 tablet_bootstrap.cc:654] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.337517 25305 raft_consensus.cc:2468] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 1.
I20260709 13:10:26.341413 25421 tablet_bootstrap.cc:654] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.369655 25554 raft_consensus.cc:493] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.370342 25554 raft_consensus.cc:515] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.373404 25554 leader_election.cc:290] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:26.374863 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:26.375697 25226 raft_consensus.cc:2468] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 0.
I20260709 13:10:26.377204 25345 leader_election.cc:304] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:10:26.378266 25554 raft_consensus.cc:2804] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:26.378700 25554 raft_consensus.cc:493] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.379113 25554 raft_consensus.cc:3060] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.387943 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:10:26.391091 25343 leader_election.cc:343] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.393961 25421 tablet_bootstrap.cc:492] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce: No bootstrap required, opened a new log
I20260709 13:10:26.393989 25419 tablet_bootstrap.cc:492] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468: No bootstrap required, opened a new log
I20260709 13:10:26.394558 25421 ts_tablet_manager.cc:1403] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce: Time spent bootstrapping tablet: real 0.062s	user 0.008s	sys 0.023s
I20260709 13:10:26.395180 25419 ts_tablet_manager.cc:1403] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468: Time spent bootstrapping tablet: real 0.064s	user 0.028s	sys 0.030s
I20260709 13:10:26.394604 25554 raft_consensus.cc:515] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.395529 25484 raft_consensus.cc:493] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.396014 25484 raft_consensus.cc:515] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.397789 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:10:26.398041 25484 leader_election.cc:290] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:26.397703 25419 raft_consensus.cc:359] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.398444 25421 raft_consensus.cc:359] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.398484 25419 raft_consensus.cc:385] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.399120 25422 tablet_bootstrap.cc:492] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19: No bootstrap required, opened a new log
I20260709 13:10:26.399684 25419 raft_consensus.cc:740] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.399423 25421 raft_consensus.cc:385] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.399871 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:26.399976 25422 ts_tablet_manager.cc:1403] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19: Time spent bootstrapping tablet: real 0.084s	user 0.014s	sys 0.027s
I20260709 13:10:26.400089 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:26.400542 25419 consensus_queue.cc:260] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:10:26.401360 25194 leader_election.cc:343] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.401492 25554 leader_election.cc:290] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:10:26.402071 25195 leader_election.cc:343] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.402504 25195 leader_election.cc:304] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:10:26.402657 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:10:26.403765 25419 ts_tablet_manager.cc:1434] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:10:26.398439 25226 raft_consensus.cc:3060] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:26.403975 25343 leader_election.cc:343] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.404701 25419 tablet_bootstrap.cc:492] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468: Bootstrap starting.
I20260709 13:10:26.408183 25422 raft_consensus.cc:359] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.408861 25422 raft_consensus.cc:385] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.409109 25422 raft_consensus.cc:740] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.403707 25484 raft_consensus.cc:2749] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:26.400239 25421 raft_consensus.cc:740] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.410498 25419 tablet_bootstrap.cc:654] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.410166 25421 consensus_queue.cc:260] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.412299 25421 ts_tablet_manager.cc:1434] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.000s
I20260709 13:10:26.409714 25422 consensus_queue.cc:260] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.412914 25484 consensus_queue.cc:1048] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:26.415145 25422 ts_tablet_manager.cc:1434] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:10:26.415097 25226 raft_consensus.cc:2468] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 1.
I20260709 13:10:26.416426 25421 tablet_bootstrap.cc:492] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce: Bootstrap starting.
I20260709 13:10:26.424508 25421 tablet_bootstrap.cc:654] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.430374 25422 tablet_bootstrap.cc:492] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19: Bootstrap starting.
I20260709 13:10:26.433285 25554 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.433830 25554 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.435957 25554 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:26.442938 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:26.443675 25304 raft_consensus.cc:2468] T 47228487a74240e9bc9bcd2e1d966ed6 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 0.
I20260709 13:10:26.444793 25343 leader_election.cc:304] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:10:26.445580 25554 raft_consensus.cc:2804] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:26.445984 25554 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.446324 25554 raft_consensus.cc:3060] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.447227 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:10:26.448801 25345 leader_election.cc:343] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.448884 25304 raft_consensus.cc:3060] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.445603 25229 raft_consensus.cc:3060] T f78697097cd14345b6a749c7aad4f696 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.453717 25345 leader_election.cc:304] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:10:26.459183 25422 tablet_bootstrap.cc:654] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.481513 25550 raft_consensus.cc:493] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.482254 25550 raft_consensus.cc:515] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.484335 25550 leader_election.cc:290] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:26.485728 25422 tablet_bootstrap.cc:492] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19: No bootstrap required, opened a new log
I20260709 13:10:26.485574 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:26.486181 25422 ts_tablet_manager.cc:1403] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19: Time spent bootstrapping tablet: real 0.056s	user 0.014s	sys 0.018s
I20260709 13:10:26.485960 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:26.486284 25226 raft_consensus.cc:2468] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 0.
I20260709 13:10:26.486815 25379 raft_consensus.cc:2468] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 0.
I20260709 13:10:26.487669 25271 leader_election.cc:304] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:10:26.488535 25550 raft_consensus.cc:2804] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:26.488987 25550 raft_consensus.cc:493] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.489400 25550 raft_consensus.cc:3060] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.489466 25422 raft_consensus.cc:359] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.490260 25422 raft_consensus.cc:385] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.490561 25422 raft_consensus.cc:740] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.491214 25422 consensus_queue.cc:260] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.493430 25422 ts_tablet_manager.cc:1434] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:10:26.495126 25422 tablet_bootstrap.cc:492] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19: Bootstrap starting.
I20260709 13:10:26.500794 25422 tablet_bootstrap.cc:654] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.505345 25484 raft_consensus.cc:493] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.505882 25484 raft_consensus.cc:515] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.507874 25484 leader_election.cc:290] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:26.456503 25455 raft_consensus.cc:2804] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:26.514081 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:10:26.515846 25194 leader_election.cc:343] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.516188 25554 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.518303 25484 consensus_queue.cc:1048] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:26.519469 25441 raft_consensus.cc:493] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.519948 25441 raft_consensus.cc:515] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.522064 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:10:26.523491 25195 leader_election.cc:343] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.523936 25195 leader_election.cc:304] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:10:26.524675 25484 raft_consensus.cc:2749] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:26.527117 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:26.523926 25455 raft_consensus.cc:697] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:10:26.527705 25376 raft_consensus.cc:2468] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 0.
I20260709 13:10:26.527654 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:26.528684 25419 tablet_bootstrap.cc:492] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468: No bootstrap required, opened a new log
I20260709 13:10:26.530009 25419 ts_tablet_manager.cc:1403] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468: Time spent bootstrapping tablet: real 0.125s	user 0.043s	sys 0.038s
I20260709 13:10:26.531909 25550 raft_consensus.cc:515] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.533962 25550 leader_election.cc:290] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:26.522022 25441 leader_election.cc:290] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:26.538787 25419 raft_consensus.cc:359] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.539435 25419 raft_consensus.cc:385] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.539641 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:10:26.539713 25419 raft_consensus.cc:740] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.540055 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:10:26.540661 25379 raft_consensus.cc:3060] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.535894 25302 raft_consensus.cc:2468] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 0.
W20260709 13:10:26.541145 25345 leader_election.cc:343] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.540798 25419 consensus_queue.cc:260] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.535629 25455 consensus_queue.cc:237] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.542557 25460 raft_consensus.cc:493] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.542449 25194 leader_election.cc:304] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:10:26.543022 25460 raft_consensus.cc:515] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.543802 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:10:26.544330 25230 raft_consensus.cc:3060] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.546079 25460 leader_election.cc:290] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:26.546990 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:26.547358 25419 ts_tablet_manager.cc:1434] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468: Time spent starting tablet: real 0.017s	user 0.002s	sys 0.004s
I20260709 13:10:26.534897 25484 consensus_queue.cc:1048] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:10:26.548198 25419 tablet_bootstrap.cc:492] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468: Bootstrap starting.
I20260709 13:10:26.548595 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:26.549851 25379 raft_consensus.cc:2468] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 1.
I20260709 13:10:26.550447 25554 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:26.553046 25421 tablet_bootstrap.cc:492] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce: No bootstrap required, opened a new log
I20260709 13:10:26.599561 25421 ts_tablet_manager.cc:1403] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce: Time spent bootstrapping tablet: real 0.183s	user 0.032s	sys 0.076s
I20260709 13:10:26.600735 25456 raft_consensus.cc:493] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.552640 25441 raft_consensus.cc:2804] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:26.604955 25441 raft_consensus.cc:493] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.605319 25441 raft_consensus.cc:3060] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.606492 25422 tablet_bootstrap.cc:492] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19: No bootstrap required, opened a new log
I20260709 13:10:26.607081 25422 ts_tablet_manager.cc:1403] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19: Time spent bootstrapping tablet: real 0.113s	user 0.017s	sys 0.005s
I20260709 13:10:26.610329 25441 raft_consensus.cc:515] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.610760 25422 raft_consensus.cc:359] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.611660 25422 raft_consensus.cc:385] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.612035 25422 raft_consensus.cc:740] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.601281 25456 raft_consensus.cc:515] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.615749 25456 leader_election.cc:290] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:26.598598 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:10:26.616333 25302 raft_consensus.cc:3060] T 47228487a74240e9bc9bcd2e1d966ed6 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.618333 25230 raft_consensus.cc:2468] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 1.
I20260709 13:10:26.612826 25422 consensus_queue.cc:260] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:10:26.601763 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 49212.5us
I20260709 13:10:26.611280 25345 leader_election.cc:304] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:10:26.623893 25422 ts_tablet_manager.cc:1434] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.001s
I20260709 13:10:26.559618 25270 leader_election.cc:304] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:10:26.623912 25554 raft_consensus.cc:2749] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:10:26.628928 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 76413us
I20260709 13:10:26.630373 25550 raft_consensus.cc:2804] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:26.630875 25550 raft_consensus.cc:697] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:10:26.631647 25550 consensus_queue.cc:237] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.633960 25530 consensus_queue.cc:1048] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:26.634418 25302 raft_consensus.cc:2468] T 47228487a74240e9bc9bcd2e1d966ed6 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 1.
I20260709 13:10:26.636473 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:26.637070 25303 raft_consensus.cc:2468] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 0.
I20260709 13:10:26.637573 25343 leader_election.cc:304] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:10:26.637902 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:26.638651 25455 raft_consensus.cc:2804] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:26.639266 25455 raft_consensus.cc:697] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:10:26.642316 25554 raft_consensus.cc:493] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.642611 25441 leader_election.cc:290] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:26.643800 25422 tablet_bootstrap.cc:492] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19: Bootstrap starting.
I20260709 13:10:26.642885 25554 raft_consensus.cc:515] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:10:26.646234 25345 leader_election.cc:343] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.648651 25554 leader_election.cc:290] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:26.649955 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:26.652457 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:10:26.653115 25377 raft_consensus.cc:3060] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.653486 25126 catalog_manager.cc:5697] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 1 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:26.646508 25455 consensus_queue.cc:237] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.665994 25377 raft_consensus.cc:2468] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 1.
I20260709 13:10:26.675709 25554 raft_consensus.cc:493] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.680932 25419 tablet_bootstrap.cc:654] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.681170 25421 raft_consensus.cc:359] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.682294 25421 raft_consensus.cc:385] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.682579 25421 raft_consensus.cc:740] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.672638 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:10:26.687148 25421 consensus_queue.cc:260] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.690337 25195 leader_election.cc:304] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:10:26.694525 25343 leader_election.cc:304] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:10:26.686086 25554 raft_consensus.cc:515] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.697188 25554 leader_election.cc:290] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:26.700565 25301 raft_consensus.cc:3060] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.697006 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:26.709461 25421 ts_tablet_manager.cc:1434] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce: Time spent starting tablet: real 0.109s	user 0.008s	sys 0.000s
I20260709 13:10:26.706341 25530 raft_consensus.cc:2804] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:26.724460 25421 tablet_bootstrap.cc:492] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce: Bootstrap starting.
I20260709 13:10:26.726313 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:26.715391 25554 raft_consensus.cc:2804] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:26.707155 25226 raft_consensus.cc:2468] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 0.
I20260709 13:10:26.724555 25530 raft_consensus.cc:697] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:10:26.739387 25530 consensus_queue.cc:237] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:10:26.740851 25345 leader_election.cc:343] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.736306 25554 raft_consensus.cc:493] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:26.741254 25597 log.cc:927] Time spent T f78697097cd14345b6a749c7aad4f696 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:10:26.742419 25456 consensus_queue.cc:1048] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:10:26.743288 25554 raft_consensus.cc:3060] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.754509 25377 raft_consensus.cc:3060] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.763466 25421 tablet_bootstrap.cc:654] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:26.764323 25343 leader_election.cc:343] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.768638 25345 leader_election.cc:304] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:10:26.769438 25456 raft_consensus.cc:2804] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:26.769902 25456 raft_consensus.cc:493] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.770305 25456 raft_consensus.cc:3060] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.780529 25301 raft_consensus.cc:2468] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 1.
I20260709 13:10:26.777261 25554 raft_consensus.cc:515] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.803536 25422 tablet_bootstrap.cc:654] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.809393 25455 consensus_queue.cc:1048] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:10:26.812758 25128 catalog_manager.cc:5697] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 0 to 1, leader changed from <none> to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 1 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:26.820545 25487 raft_consensus.cc:493] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.820818 25549 raft_consensus.cc:493] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.821113 25487 raft_consensus.cc:515] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.821314 25549 raft_consensus.cc:515] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.823999 25549 leader_election.cc:290] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:26.825157 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:26.825843 25376 raft_consensus.cc:2468] T 51ecc4484385405c857b3bee1077c36a P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 0.
I20260709 13:10:26.826892 25270 leader_election.cc:304] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:10:26.820384 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:26.827687 25549 raft_consensus.cc:2804] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:26.828092 25549 raft_consensus.cc:493] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.828495 25549 raft_consensus.cc:3060] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.829881 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:26.828810 25487 leader_election.cc:290] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:26.833731 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
W20260709 13:10:26.835003 25343 leader_election.cc:343] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.835528 25343 leader_election.cc:304] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:10:26.835788 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:26.835927 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:26.836601 25226 raft_consensus.cc:2393] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 1: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:10:26.837585 25554 leader_election.cc:290] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:26.838138 25455 raft_consensus.cc:2749] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:10:26.839229 25271 leader_election.cc:343] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.839512 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:10:26.840057 25303 raft_consensus.cc:3060] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.840309 25271 leader_election.cc:304] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
W20260709 13:10:26.837291 25345 leader_election.cc:343] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.838395 25456 raft_consensus.cc:515] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.850356 25422 tablet_bootstrap.cc:492] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19: No bootstrap required, opened a new log
I20260709 13:10:26.850770 25422 ts_tablet_manager.cc:1403] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19: Time spent bootstrapping tablet: real 0.207s	user 0.011s	sys 0.004s
I20260709 13:10:26.853099 25487 raft_consensus.cc:3060] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.855245 25125 catalog_manager.cc:5697] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 1 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:26.856712 25421 tablet_bootstrap.cc:492] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce: No bootstrap required, opened a new log
I20260709 13:10:26.857172 25421 ts_tablet_manager.cc:1403] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce: Time spent bootstrapping tablet: real 0.133s	user 0.033s	sys 0.009s
I20260709 13:10:26.859797 25421 raft_consensus.cc:359] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.886647 25421 raft_consensus.cc:385] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.859997 25422 raft_consensus.cc:359] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.887046 25421 raft_consensus.cc:740] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.887250 25422 raft_consensus.cc:385] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.887570 25422 raft_consensus.cc:740] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.887806 25421 consensus_queue.cc:260] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.888156 25422 consensus_queue.cc:260] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.890194 25422 ts_tablet_manager.cc:1434] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.025s
I20260709 13:10:26.890331 25421 ts_tablet_manager.cc:1434] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.026s
I20260709 13:10:26.867174 25128 catalog_manager.cc:5697] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 1 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:26.890982 25422 tablet_bootstrap.cc:492] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19: Bootstrap starting.
I20260709 13:10:26.891203 25421 tablet_bootstrap.cc:492] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce: Bootstrap starting.
I20260709 13:10:26.893204 25419 tablet_bootstrap.cc:492] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468: No bootstrap required, opened a new log
I20260709 13:10:26.893625 25419 ts_tablet_manager.cc:1403] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468: Time spent bootstrapping tablet: real 0.346s	user 0.010s	sys 0.016s
I20260709 13:10:26.897251 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:10:26.868937 25303 raft_consensus.cc:2468] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 1.
I20260709 13:10:26.899724 25226 raft_consensus.cc:3060] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.902390 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
W20260709 13:10:26.904038 25343 leader_election.cc:343] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.894927 25456 leader_election.cc:290] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:26.904546 25549 raft_consensus.cc:515] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.906692 25226 raft_consensus.cc:2468] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 1.
I20260709 13:10:26.907280 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:10:26.909027 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:10:26.909344 25487 raft_consensus.cc:2749] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:26.909584 25376 raft_consensus.cc:3060] T 51ecc4484385405c857b3bee1077c36a P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.911741 25422 tablet_bootstrap.cc:654] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.911810 25549 leader_election.cc:290] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:26.915649 25343 leader_election.cc:304] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
W20260709 13:10:26.917109 25271 leader_election.cc:343] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.917303 25421 tablet_bootstrap.cc:654] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.918088 25376 raft_consensus.cc:2468] T 51ecc4484385405c857b3bee1077c36a P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 1.
I20260709 13:10:26.918800 25554 raft_consensus.cc:2804] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:26.920104 25554 raft_consensus.cc:697] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:10:26.921787 25345 leader_election.cc:304] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:10:26.920954 25554 consensus_queue.cc:237] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:26.936832 25455 raft_consensus.cc:2804] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:26.937517 25455 raft_consensus.cc:697] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:10:27.007588 25270 leader_election.cc:304] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:10:27.021368 25488 raft_consensus.cc:2804] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:10:27.021461 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 47773.1us
I20260709 13:10:27.021953 25488 raft_consensus.cc:697] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:10:27.019282 25419 raft_consensus.cc:359] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.022635 25419 raft_consensus.cc:385] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.022985 25419 raft_consensus.cc:740] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.022749 25488 consensus_queue.cc:237] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.023845 25419 consensus_queue.cc:260] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.027922 25419 ts_tablet_manager.cc:1434] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468: Time spent starting tablet: real 0.134s	user 0.005s	sys 0.010s
I20260709 13:10:27.019238 25455 consensus_queue.cc:237] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.045492 25422 tablet_bootstrap.cc:492] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19: No bootstrap required, opened a new log
I20260709 13:10:27.046203 25422 ts_tablet_manager.cc:1403] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19: Time spent bootstrapping tablet: real 0.155s	user 0.046s	sys 0.050s
I20260709 13:10:27.059710 25421 tablet_bootstrap.cc:492] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce: No bootstrap required, opened a new log
I20260709 13:10:27.060074 25421 ts_tablet_manager.cc:1403] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce: Time spent bootstrapping tablet: real 0.169s	user 0.037s	sys 0.043s
I20260709 13:10:27.060703 25419 tablet_bootstrap.cc:492] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468: Bootstrap starting.
I20260709 13:10:27.064342 25422 raft_consensus.cc:359] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.064826 25422 raft_consensus.cc:385] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.065073 25422 raft_consensus.cc:740] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.063694 25421 raft_consensus.cc:359] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.066115 25421 raft_consensus.cc:385] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.066437 25421 raft_consensus.cc:740] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.067166 25421 consensus_queue.cc:260] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.068967 25419 tablet_bootstrap.cc:654] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.074590 25421 ts_tablet_manager.cc:1434] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 13:10:27.075569 25421 tablet_bootstrap.cc:492] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce: Bootstrap starting.
I20260709 13:10:27.081403 25422 consensus_queue.cc:260] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.082862 25422 ts_tablet_manager.cc:1434] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19: Time spent starting tablet: real 0.036s	user 0.004s	sys 0.000s
I20260709 13:10:27.083616 25422 tablet_bootstrap.cc:492] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19: Bootstrap starting.
I20260709 13:10:27.085121 25604 consensus_queue.cc:1048] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:10:27.085502 25125 catalog_manager.cc:5697] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 0 to 1, leader changed from <none> to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 1 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:27.096944 25422 tablet_bootstrap.cc:654] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.094169 25421 tablet_bootstrap.cc:654] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.101783 25419 tablet_bootstrap.cc:492] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468: No bootstrap required, opened a new log
I20260709 13:10:27.102680 25419 ts_tablet_manager.cc:1403] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468: Time spent bootstrapping tablet: real 0.043s	user 0.008s	sys 0.003s
I20260709 13:10:27.105078 25487 consensus_queue.cc:1048] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:27.107062 25419 raft_consensus.cc:359] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.107730 25419 raft_consensus.cc:385] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.108028 25419 raft_consensus.cc:740] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.108669 25419 consensus_queue.cc:260] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.110945 25419 ts_tablet_manager.cc:1434] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.001s
I20260709 13:10:27.111826 25419 tablet_bootstrap.cc:492] T 08c29bb25d6947ddaa43c22713738514 P 79d99c0e498349bda74127365219e468: Bootstrap starting.
I20260709 13:10:27.117489 25419 tablet_bootstrap.cc:654] T 08c29bb25d6947ddaa43c22713738514 P 79d99c0e498349bda74127365219e468: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.122581 25421 tablet_bootstrap.cc:492] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce: No bootstrap required, opened a new log
I20260709 13:10:27.123023 25421 ts_tablet_manager.cc:1403] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce: Time spent bootstrapping tablet: real 0.048s	user 0.013s	sys 0.006s
I20260709 13:10:27.126492 25421 raft_consensus.cc:359] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.127120 25421 raft_consensus.cc:385] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.127378 25421 raft_consensus.cc:740] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.127950 25421 consensus_queue.cc:260] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.130052 25421 ts_tablet_manager.cc:1434] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:10:27.132146 25421 tablet_bootstrap.cc:492] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce: Bootstrap starting.
I20260709 13:10:27.137950 25421 tablet_bootstrap.cc:654] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.138792 25549 raft_consensus.cc:493] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.139317 25549 raft_consensus.cc:515] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.141173 25419 tablet_bootstrap.cc:492] T 08c29bb25d6947ddaa43c22713738514 P 79d99c0e498349bda74127365219e468: No bootstrap required, opened a new log
I20260709 13:10:27.141618 25419 ts_tablet_manager.cc:1403] T 08c29bb25d6947ddaa43c22713738514 P 79d99c0e498349bda74127365219e468: Time spent bootstrapping tablet: real 0.030s	user 0.009s	sys 0.000s
I20260709 13:10:27.144279 25419 raft_consensus.cc:359] T 08c29bb25d6947ddaa43c22713738514 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.144945 25419 raft_consensus.cc:385] T 08c29bb25d6947ddaa43c22713738514 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.145205 25419 raft_consensus.cc:740] T 08c29bb25d6947ddaa43c22713738514 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.145809 25419 consensus_queue.cc:260] T 08c29bb25d6947ddaa43c22713738514 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.147562 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:27.148574 25419 ts_tablet_manager.cc:1434] T 08c29bb25d6947ddaa43c22713738514 P 79d99c0e498349bda74127365219e468: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
W20260709 13:10:27.148908 25270 leader_election.cc:343] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.149456 25419 tablet_bootstrap.cc:492] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468: Bootstrap starting.
I20260709 13:10:27.154878 25604 raft_consensus.cc:493] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.155359 25604 raft_consensus.cc:515] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.155908 25419 tablet_bootstrap.cc:654] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.157450 25604 leader_election.cc:290] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:27.158398 25550 consensus_queue.cc:1048] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:27.159325 25126 catalog_manager.cc:5697] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 1 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:27.161988 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:27.161525 25126 catalog_manager.cc:5697] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 1 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:27.162787 25229 raft_consensus.cc:2468] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 0.
I20260709 13:10:27.164610 25549 leader_election.cc:290] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:27.177115 25604 consensus_queue.cc:1048] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:27.178423 25421 tablet_bootstrap.cc:492] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce: No bootstrap required, opened a new log
I20260709 13:10:27.178872 25421 ts_tablet_manager.cc:1403] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.006s
I20260709 13:10:27.180753 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:27.181416 25421 raft_consensus.cc:359] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.182108 25421 raft_consensus.cc:385] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.182400 25421 raft_consensus.cc:740] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.182922 25441 consensus_queue.cc:1048] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:27.183038 25421 consensus_queue.cc:260] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.185402 25421 ts_tablet_manager.cc:1434] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:10:27.186247 25421 tablet_bootstrap.cc:492] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce: Bootstrap starting.
I20260709 13:10:27.188608 25604 raft_consensus.cc:493] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.190039 25441 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.190650 25441 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.191879 25421 tablet_bootstrap.cc:654] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.194761 25441 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:27.198585 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:27.189338 25604 raft_consensus.cc:515] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.211820 25421 tablet_bootstrap.cc:492] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce: No bootstrap required, opened a new log
I20260709 13:10:27.212266 25421 ts_tablet_manager.cc:1403] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.002s
I20260709 13:10:27.214730 25421 raft_consensus.cc:359] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.215370 25421 raft_consensus.cc:385] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.215622 25421 raft_consensus.cc:740] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.216250 25421 consensus_queue.cc:260] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.224870 25421 ts_tablet_manager.cc:1434] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:10:27.225734 25421 tablet_bootstrap.cc:492] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce: Bootstrap starting.
I20260709 13:10:27.229533 25455 consensus_queue.cc:1048] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:27.233251 25604 leader_election.cc:290] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:10:27.239827 25345 leader_election.cc:343] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:27.253105 25343 leader_election.cc:343] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.253219 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:27.253620 25419 tablet_bootstrap.cc:492] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468: No bootstrap required, opened a new log
I20260709 13:10:27.254240 25419 ts_tablet_manager.cc:1403] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468: Time spent bootstrapping tablet: real 0.105s	user 0.026s	sys 0.020s
I20260709 13:10:27.254112 25271 leader_election.cc:304] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:10:27.253551 25343 leader_election.cc:304] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:10:27.255543 25549 raft_consensus.cc:2804] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:27.255576 25554 raft_consensus.cc:2749] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:27.256016 25549 raft_consensus.cc:493] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.256415 25549 raft_consensus.cc:3060] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.257874 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:27.258731 25421 tablet_bootstrap.cc:654] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.263739 25422 tablet_bootstrap.cc:492] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19: No bootstrap required, opened a new log
I20260709 13:10:27.264113 25422 ts_tablet_manager.cc:1403] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19: Time spent bootstrapping tablet: real 0.181s	user 0.045s	sys 0.068s
I20260709 13:10:27.258780 25229 raft_consensus.cc:2468] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 0.
I20260709 13:10:27.272291 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:27.276046 25549 raft_consensus.cc:515] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.279887 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:10:27.280803 25484 consensus_queue.cc:1048] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:27.282352 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:10:27.283941 25343 leader_election.cc:343] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.284245 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:10:27.284925 25229 raft_consensus.cc:3060] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.285574 25419 raft_consensus.cc:359] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.286276 25419 raft_consensus.cc:385] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.286599 25419 raft_consensus.cc:740] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Initialized, Role: FOLLOWER
W20260709 13:10:27.287248 25270 leader_election.cc:343] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.287307 25419 consensus_queue.cc:260] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.292498 25419 ts_tablet_manager.cc:1434] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.001s
I20260709 13:10:27.294441 25419 tablet_bootstrap.cc:492] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468: Bootstrap starting.
I20260709 13:10:27.296669 25229 raft_consensus.cc:2468] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 1.
I20260709 13:10:27.282068 25549 leader_election.cc:290] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:27.302095 25271 leader_election.cc:304] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:10:27.302381 25228 raft_consensus.cc:3060] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.303256 25195 leader_election.cc:304] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:10:27.303740 25345 leader_election.cc:304] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:10:27.306073 25456 raft_consensus.cc:2804] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:27.306535 25456 raft_consensus.cc:493] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.311717 25456 raft_consensus.cc:3060] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.325516 25530 raft_consensus.cc:2749] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:27.318900 25549 raft_consensus.cc:2804] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:27.328297 25549 raft_consensus.cc:697] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:10:27.329048 25549 consensus_queue.cc:237] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:10:27.331497 25175 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:27.332433 25456 raft_consensus.cc:515] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.333194 25421 tablet_bootstrap.cc:492] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce: No bootstrap required, opened a new log
I20260709 13:10:27.333806 25421 ts_tablet_manager.cc:1403] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce: Time spent bootstrapping tablet: real 0.108s	user 0.017s	sys 0.008s
I20260709 13:10:27.334455 25456 leader_election.cc:290] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:27.336468 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
W20260709 13:10:27.337800 25343 leader_election.cc:343] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.337913 25422 raft_consensus.cc:359] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.338179 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:10:27.338599 25422 raft_consensus.cc:385] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.338833 25228 raft_consensus.cc:3060] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.338927 25422 raft_consensus.cc:740] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.339673 25422 consensus_queue.cc:260] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.342589 25455 consensus_queue.cc:1048] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:27.345007 25422 ts_tablet_manager.cc:1434] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19: Time spent starting tablet: real 0.081s	user 0.006s	sys 0.001s
I20260709 13:10:27.345978 25422 tablet_bootstrap.cc:492] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19: Bootstrap starting.
I20260709 13:10:27.352047 25419 tablet_bootstrap.cc:654] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.356317 25484 raft_consensus.cc:493] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.356855 25484 raft_consensus.cc:515] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.363529 25484 leader_election.cc:290] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:27.364846 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:10:27.366405 25194 leader_election.cc:343] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.367756 25484 raft_consensus.cc:493] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.368402 25421 raft_consensus.cc:359] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.369261 25421 raft_consensus.cc:385] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.369629 25421 raft_consensus.cc:740] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.368258 25484 raft_consensus.cc:515] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.372004 25422 tablet_bootstrap.cc:654] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.374680 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:27.373883 25484 leader_election.cc:290] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:27.375167 25421 consensus_queue.cc:260] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.383919 25421 ts_tablet_manager.cc:1434] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce: Time spent starting tablet: real 0.050s	user 0.008s	sys 0.000s
I20260709 13:10:27.384753 25421 tablet_bootstrap.cc:492] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce: Bootstrap starting.
I20260709 13:10:27.385509 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:27.368860 25228 raft_consensus.cc:2468] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 1.
I20260709 13:10:27.387027 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:27.391193 25484 raft_consensus.cc:493] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:27.391448 25195 leader_election.cc:343] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.391753 25549 raft_consensus.cc:493] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.393550 25125 catalog_manager.cc:5697] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 0 to 1, leader changed from <none> to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 1 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:27.394987 25195 leader_election.cc:304] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:10:27.395606 25376 raft_consensus.cc:2393] T 51ecc4484385405c857b3bee1077c36a P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 1: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:10:27.394207 25484 raft_consensus.cc:515] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.396363 25549 raft_consensus.cc:515] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.397351 25484 leader_election.cc:290] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:27.398027 25549 leader_election.cc:290] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:27.402038 25441 raft_consensus.cc:2749] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:27.403227 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:27.403229 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:27.403996 25228 raft_consensus.cc:2468] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 0.
W20260709 13:10:27.404697 25194 leader_election.cc:343] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.405076 25271 leader_election.cc:304] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:10:27.407647 25422 tablet_bootstrap.cc:492] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19: No bootstrap required, opened a new log
I20260709 13:10:27.409461 25422 ts_tablet_manager.cc:1403] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19: Time spent bootstrapping tablet: real 0.064s	user 0.012s	sys 0.000s
I20260709 13:10:27.408242 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:27.410416 25376 raft_consensus.cc:2468] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 0.
I20260709 13:10:27.408012 25549 raft_consensus.cc:2804] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:27.411276 25549 raft_consensus.cc:493] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.411680 25549 raft_consensus.cc:3060] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.414466 25421 tablet_bootstrap.cc:654] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.415774 25419 tablet_bootstrap.cc:492] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468: No bootstrap required, opened a new log
I20260709 13:10:27.416208 25419 ts_tablet_manager.cc:1403] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468: Time spent bootstrapping tablet: real 0.122s	user 0.009s	sys 0.009s
I20260709 13:10:27.418417 25422 raft_consensus.cc:359] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.419175 25419 raft_consensus.cc:359] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.419853 25195 leader_election.cc:304] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:10:27.423400 25422 raft_consensus.cc:385] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.423458 25419 raft_consensus.cc:385] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.409561 25345 leader_election.cc:304] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:10:27.423807 25422 raft_consensus.cc:740] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.423846 25419 raft_consensus.cc:740] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.424156 25636 raft_consensus.cc:3060] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.425179 25549 raft_consensus.cc:515] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.425431 25419 consensus_queue.cc:260] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.427078 25421 tablet_bootstrap.cc:492] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce: No bootstrap required, opened a new log
I20260709 13:10:27.427227 25549 leader_election.cc:290] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:27.427507 25421 ts_tablet_manager.cc:1403] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce: Time spent bootstrapping tablet: real 0.043s	user 0.010s	sys 0.005s
I20260709 13:10:27.428076 25455 raft_consensus.cc:2804] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:27.428550 25455 raft_consensus.cc:697] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:10:27.429351 25455 consensus_queue.cc:237] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.429893 25421 raft_consensus.cc:359] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.430498 25421 raft_consensus.cc:385] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.430733 25421 raft_consensus.cc:740] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.431634 25636 raft_consensus.cc:2749] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:27.432519 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:10:27.432746 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:10:27.433096 25376 raft_consensus.cc:3060] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.433223 25228 raft_consensus.cc:3060] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.433341 25419 ts_tablet_manager.cc:1434] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.005s
I20260709 13:10:27.434266 25419 tablet_bootstrap.cc:492] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468: Bootstrap starting.
I20260709 13:10:27.439756 25376 raft_consensus.cc:2468] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 1.
I20260709 13:10:27.440498 25422 consensus_queue.cc:260] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.441039 25228 raft_consensus.cc:2468] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 1.
I20260709 13:10:27.441150 25270 leader_election.cc:304] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:10:27.442656 25422 ts_tablet_manager.cc:1434] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19: Time spent starting tablet: real 0.028s	user 0.004s	sys 0.002s
I20260709 13:10:27.443382 25419 tablet_bootstrap.cc:654] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.444823 25421 consensus_queue.cc:260] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.446360 25550 raft_consensus.cc:2804] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:27.446826 25550 raft_consensus.cc:697] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:10:27.447679 25421 ts_tablet_manager.cc:1434] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
I20260709 13:10:27.447536 25550 consensus_queue.cc:237] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.448484 25422 tablet_bootstrap.cc:492] T 88997763405742ee8b8e6b43d7392c1f P da445ce82dc4467f95f4fa52297eaa19: Bootstrap starting.
I20260709 13:10:27.450891 25455 consensus_queue.cc:1048] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:27.452991 25421 tablet_bootstrap.cc:492] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce: Bootstrap starting.
I20260709 13:10:27.456705 25550 raft_consensus.cc:493] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.457304 25550 raft_consensus.cc:515] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.459434 25550 leader_election.cc:290] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:27.460566 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:27.461691 25421 tablet_bootstrap.cc:654] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.465034 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:27.465935 25228 raft_consensus.cc:2393] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 1: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:10:27.466923 25271 leader_election.cc:304] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:10:27.468264 25422 tablet_bootstrap.cc:654] T 88997763405742ee8b8e6b43d7392c1f P da445ce82dc4467f95f4fa52297eaa19: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.468721 25550 raft_consensus.cc:3060] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.468952 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:27.469795 25376 raft_consensus.cc:2468] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 0.
I20260709 13:10:27.472733 25421 tablet_bootstrap.cc:492] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce: No bootstrap required, opened a new log
I20260709 13:10:27.473379 25421 ts_tablet_manager.cc:1403] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.001s
I20260709 13:10:27.476347 25421 raft_consensus.cc:359] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.477002 25421 raft_consensus.cc:385] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.477267 25421 raft_consensus.cc:740] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.477870 25421 consensus_queue.cc:260] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.479046 25195 leader_election.cc:304] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:10:27.481007 25228 raft_consensus.cc:3060] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.481688 25636 raft_consensus.cc:2804] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:27.482113 25636 raft_consensus.cc:493] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.482438 25636 raft_consensus.cc:3060] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.488026 25554 raft_consensus.cc:493] T 08c29bb25d6947ddaa43c22713738514 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.488538 25554 raft_consensus.cc:515] T 08c29bb25d6947ddaa43c22713738514 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.490731 25554 leader_election.cc:290] T 08c29bb25d6947ddaa43c22713738514 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:27.491796 25421 ts_tablet_manager.cc:1434] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:10:27.492978 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:10:27.494669 25343 leader_election.cc:343] T 08c29bb25d6947ddaa43c22713738514 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.488510 25636 raft_consensus.cc:515] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.501173 25421 tablet_bootstrap.cc:492] T 7fd182e135fd4b4db8700ed3173fd000 P 1f539ba21487460085b837e7529a78ce: Bootstrap starting.
I20260709 13:10:27.501689 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:10:27.502398 25636 leader_election.cc:290] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:27.502542 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:10:27.503010 25194 leader_election.cc:343] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.506640 25125 catalog_manager.cc:5697] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 0 to 1, leader changed from <none> to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 1 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:27.511433 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:10:27.511973 25376 raft_consensus.cc:3060] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:27.518805 25345 leader_election.cc:343] T 08c29bb25d6947ddaa43c22713738514 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.519284 25345 leader_election.cc:304] T 08c29bb25d6947ddaa43c22713738514 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:10:27.520207 25554 raft_consensus.cc:2749] T 08c29bb25d6947ddaa43c22713738514 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:27.487244 25550 raft_consensus.cc:2749] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:27.522816 25376 raft_consensus.cc:2468] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 1.
I20260709 13:10:27.529371 25422 tablet_bootstrap.cc:492] T 88997763405742ee8b8e6b43d7392c1f P da445ce82dc4467f95f4fa52297eaa19: No bootstrap required, opened a new log
I20260709 13:10:27.530025 25422 ts_tablet_manager.cc:1403] T 88997763405742ee8b8e6b43d7392c1f P da445ce82dc4467f95f4fa52297eaa19: Time spent bootstrapping tablet: real 0.082s	user 0.030s	sys 0.018s
I20260709 13:10:27.529428 25554 consensus_queue.cc:1048] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:27.533660 25126 catalog_manager.cc:5697] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 1 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:27.536026 25419 tablet_bootstrap.cc:492] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468: No bootstrap required, opened a new log
I20260709 13:10:27.540764 25195 leader_election.cc:304] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:10:27.541625 25484 raft_consensus.cc:2804] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:27.542007 25419 ts_tablet_manager.cc:1403] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468: Time spent bootstrapping tablet: real 0.108s	user 0.024s	sys 0.017s
I20260709 13:10:27.542160 25484 raft_consensus.cc:697] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:10:27.542997 25484 consensus_queue.cc:237] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.545810 25421 tablet_bootstrap.cc:654] T 7fd182e135fd4b4db8700ed3173fd000 P 1f539ba21487460085b837e7529a78ce: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.546924 25422 raft_consensus.cc:359] T 88997763405742ee8b8e6b43d7392c1f P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.547901 25554 consensus_queue.cc:1048] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:27.551530 25422 raft_consensus.cc:385] T 88997763405742ee8b8e6b43d7392c1f P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.551905 25422 raft_consensus.cc:740] T 88997763405742ee8b8e6b43d7392c1f P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.552630 25422 consensus_queue.cc:260] T 88997763405742ee8b8e6b43d7392c1f P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.554780 25422 ts_tablet_manager.cc:1434] T 88997763405742ee8b8e6b43d7392c1f P da445ce82dc4467f95f4fa52297eaa19: Time spent starting tablet: real 0.024s	user 0.002s	sys 0.004s
I20260709 13:10:27.549945 25419 raft_consensus.cc:359] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.555256 25419 raft_consensus.cc:385] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.555671 25419 raft_consensus.cc:740] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.556548 25419 consensus_queue.cc:260] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.559455 25419 ts_tablet_manager.cc:1434] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 13:10:27.561363 25419 tablet_bootstrap.cc:492] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468: Bootstrap starting.
I20260709 13:10:27.566984 25419 tablet_bootstrap.cc:654] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.560474 25422 tablet_bootstrap.cc:492] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19: Bootstrap starting.
I20260709 13:10:27.568884 25128 catalog_manager.cc:5697] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 1 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:27.572630 25422 tablet_bootstrap.cc:654] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.576766 25554 raft_consensus.cc:493] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.577325 25554 raft_consensus.cc:515] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.584213 25456 consensus_queue.cc:1048] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:27.586041 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:27.586697 25229 raft_consensus.cc:2468] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 0.
I20260709 13:10:27.590286 25345 leader_election.cc:304] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:10:27.595002 25554 leader_election.cc:290] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:27.595513 25554 raft_consensus.cc:2804] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:27.595826 25554 raft_consensus.cc:493] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.596135 25554 raft_consensus.cc:3060] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.605257 25636 raft_consensus.cc:493] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.605933 25636 raft_consensus.cc:515] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.606429 25421 tablet_bootstrap.cc:492] T 7fd182e135fd4b4db8700ed3173fd000 P 1f539ba21487460085b837e7529a78ce: No bootstrap required, opened a new log
I20260709 13:10:27.606918 25421 ts_tablet_manager.cc:1403] T 7fd182e135fd4b4db8700ed3173fd000 P 1f539ba21487460085b837e7529a78ce: Time spent bootstrapping tablet: real 0.106s	user 0.013s	sys 0.006s
I20260709 13:10:27.607976 25636 leader_election.cc:290] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:27.601341 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:27.609400 25421 raft_consensus.cc:359] T 7fd182e135fd4b4db8700ed3173fd000 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.610100 25421 raft_consensus.cc:385] T 7fd182e135fd4b4db8700ed3173fd000 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.610011 25550 consensus_queue.cc:1048] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:27.610414 25421 raft_consensus.cc:740] T 7fd182e135fd4b4db8700ed3173fd000 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.610668 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:27.611038 25421 consensus_queue.cc:260] T 7fd182e135fd4b4db8700ed3173fd000 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:10:27.612186 25195 leader_election.cc:343] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.612610 25421 ts_tablet_manager.cc:1434] T 7fd182e135fd4b4db8700ed3173fd000 P 1f539ba21487460085b837e7529a78ce: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:10:27.613508 25421 tablet_bootstrap.cc:492] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce: Bootstrap starting.
W20260709 13:10:27.614050 25343 leader_election.cc:343] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.615442 25550 raft_consensus.cc:493] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.615978 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:27.615906 25550 raft_consensus.cc:515] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:10:27.617401 25194 leader_election.cc:343] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.617883 25194 leader_election.cc:304] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:10:27.620393 25636 raft_consensus.cc:2749] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:27.620462 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:27.623692 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:27.621438 25229 raft_consensus.cc:2393] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 1: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:10:27.626245 25439 consensus_queue.cc:1048] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:27.631587 25550 leader_election.cc:290] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:27.632196 25421 tablet_bootstrap.cc:654] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.638760 25270 leader_election.cc:304] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:10:27.640450 25439 raft_consensus.cc:3060] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.641934 25422 tablet_bootstrap.cc:492] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19: No bootstrap required, opened a new log
I20260709 13:10:27.642432 25422 ts_tablet_manager.cc:1403] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19: Time spent bootstrapping tablet: real 0.082s	user 0.015s	sys 0.001s
I20260709 13:10:27.645090 25549 raft_consensus.cc:493] T 88997763405742ee8b8e6b43d7392c1f P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.645572 25549 raft_consensus.cc:515] T 88997763405742ee8b8e6b43d7392c1f P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.647801 25549 leader_election.cc:290] T 88997763405742ee8b8e6b43d7392c1f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:27.658078 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:10:27.665567 25270 leader_election.cc:343] T 88997763405742ee8b8e6b43d7392c1f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.667896 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:27.671746 25419 tablet_bootstrap.cc:492] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468: No bootstrap required, opened a new log
I20260709 13:10:27.672260 25419 ts_tablet_manager.cc:1403] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468: Time spent bootstrapping tablet: real 0.111s	user 0.013s	sys 0.003s
I20260709 13:10:27.672442 25554 raft_consensus.cc:515] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.675082 25419 raft_consensus.cc:359] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.675896 25419 raft_consensus.cc:385] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.644923 25422 raft_consensus.cc:359] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.676687 25422 raft_consensus.cc:385] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.677002 25422 raft_consensus.cc:740] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Initialized, Role: FOLLOWER
W20260709 13:10:27.677373 25271 leader_election.cc:343] T 88997763405742ee8b8e6b43d7392c1f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.677697 25422 consensus_queue.cc:260] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.680256 25422 ts_tablet_manager.cc:1434] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.000s
I20260709 13:10:27.681212 25422 tablet_bootstrap.cc:492] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19: Bootstrap starting.
I20260709 13:10:27.686082 25439 raft_consensus.cc:2749] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:27.678236 25271 leader_election.cc:304] T 88997763405742ee8b8e6b43d7392c1f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:10:27.676214 25419 raft_consensus.cc:740] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.687353 25419 consensus_queue.cc:260] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.688791 25422 tablet_bootstrap.cc:654] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.693248 25550 raft_consensus.cc:2749] T 88997763405742ee8b8e6b43d7392c1f P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:27.694846 25422 tablet_bootstrap.cc:492] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19: No bootstrap required, opened a new log
I20260709 13:10:27.695361 25422 ts_tablet_manager.cc:1403] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19: Time spent bootstrapping tablet: real 0.014s	user 0.008s	sys 0.003s
I20260709 13:10:27.699237 25419 ts_tablet_manager.cc:1434] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.001s
I20260709 13:10:27.700150 25419 tablet_bootstrap.cc:492] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468: Bootstrap starting.
I20260709 13:10:27.707316 25419 tablet_bootstrap.cc:654] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.709568 25422 raft_consensus.cc:359] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.710353 25422 raft_consensus.cc:385] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.710680 25422 raft_consensus.cc:740] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.711414 25422 consensus_queue.cc:260] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.712643 25421 tablet_bootstrap.cc:492] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce: No bootstrap required, opened a new log
I20260709 13:10:27.713097 25421 ts_tablet_manager.cc:1403] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce: Time spent bootstrapping tablet: real 0.100s	user 0.025s	sys 0.041s
I20260709 13:10:27.714094 25422 ts_tablet_manager.cc:1434] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:10:27.715252 25554 leader_election.cc:290] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:27.715641 25421 raft_consensus.cc:359] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.715934 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:10:27.716389 25421 raft_consensus.cc:385] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.716660 25636 raft_consensus.cc:493] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.716727 25421 raft_consensus.cc:740] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.717344 25636 raft_consensus.cc:515] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.717659 25421 consensus_queue.cc:260] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.716634 25226 raft_consensus.cc:3060] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.720009 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:10:27.720366 25421 ts_tablet_manager.cc:1434] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:10:27.723462 25421 tablet_bootstrap.cc:492] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce: Bootstrap starting.
I20260709 13:10:27.721138 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:27.724455 25303 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 0.
I20260709 13:10:27.722048 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:27.721182 25636 leader_election.cc:290] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:27.725405 25377 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 0.
I20260709 13:10:27.726634 25195 leader_election.cc:304] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:10:27.727399 25636 raft_consensus.cc:2804] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:10:27.723456 25343 leader_election.cc:343] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.727749 25636 raft_consensus.cc:493] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.728169 25636 raft_consensus.cc:3060] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.734517 25421 tablet_bootstrap.cc:654] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.735996 25226 raft_consensus.cc:2468] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 1.
I20260709 13:10:27.737254 25345 leader_election.cc:304] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:10:27.738750 25456 raft_consensus.cc:2804] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:27.739216 25456 raft_consensus.cc:697] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:10:27.740032 25456 consensus_queue.cc:237] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.744814 25439 raft_consensus.cc:493] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.745316 25439 raft_consensus.cc:515] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.748303 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:27.748929 25377 raft_consensus.cc:2468] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 0.
I20260709 13:10:27.748433 25439 leader_election.cc:290] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:27.750254 25270 leader_election.cc:304] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:10:27.750602 25636 raft_consensus.cc:515] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.751076 25439 raft_consensus.cc:2804] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:27.751500 25439 raft_consensus.cc:493] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.751833 25439 raft_consensus.cc:3060] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.753130 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:27.753355 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:10:27.753993 25303 raft_consensus.cc:3060] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.753954 25228 raft_consensus.cc:2468] T 7fd182e135fd4b4db8700ed3173fd000 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 0.
I20260709 13:10:27.761353 25303 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 1.
I20260709 13:10:27.762866 25194 leader_election.cc:304] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:10:27.763669 25484 raft_consensus.cc:2804] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:27.764117 25484 raft_consensus.cc:697] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:10:27.764882 25484 consensus_queue.cc:237] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.766595 25439 raft_consensus.cc:515] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.767395 25488 raft_consensus.cc:493] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.767844 25488 raft_consensus.cc:515] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.770265 25488 leader_election.cc:290] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:27.772154 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:27.772436 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:27.772964 25377 raft_consensus.cc:2393] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 1: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:10:27.774211 25270 leader_election.cc:304] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:10:27.775390 25488 raft_consensus.cc:3060] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.777009 25422 tablet_bootstrap.cc:492] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19: Bootstrap starting.
I20260709 13:10:27.781026 25126 catalog_manager.cc:5697] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 1 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:27.790033 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:10:27.790632 25377 raft_consensus.cc:3060] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.791512 25488 raft_consensus.cc:2749] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:27.804554 25125 catalog_manager.cc:5697] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 1 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:27.815460 25487 consensus_queue.cc:1048] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:27.808940 25636 leader_election.cc:290] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:27.825839 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:10:27.827108 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:10:27.837150 25228 raft_consensus.cc:3060] T 7fd182e135fd4b4db8700ed3173fd000 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.837080 25377 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 1.
I20260709 13:10:27.819780 25439 leader_election.cc:290] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:27.842037 25554 raft_consensus.cc:493] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.842568 25554 raft_consensus.cc:515] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.844043 25377 raft_consensus.cc:3060] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.835498 25376 raft_consensus.cc:3060] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.849611 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:27.852214 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:27.858834 25343 leader_election.cc:304] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:10:27.845374 25554 leader_election.cc:290] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:27.887975 25554 consensus_queue.cc:1048] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:27.890969 25228 raft_consensus.cc:2468] T 7fd182e135fd4b4db8700ed3173fd000 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 1.
I20260709 13:10:27.894181 25376 raft_consensus.cc:2468] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 1.
I20260709 13:10:27.895493 25271 leader_election.cc:304] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:10:27.896266 25421 tablet_bootstrap.cc:492] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce: No bootstrap required, opened a new log
I20260709 13:10:27.896732 25421 ts_tablet_manager.cc:1403] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce: Time spent bootstrapping tablet: real 0.173s	user 0.044s	sys 0.087s
I20260709 13:10:27.897483 25456 raft_consensus.cc:2749] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:27.899308 25421 raft_consensus.cc:359] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.899969 25421 raft_consensus.cc:385] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.900220 25421 raft_consensus.cc:740] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.896302 25549 raft_consensus.cc:2804] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:27.900880 25549 raft_consensus.cc:697] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:10:27.900823 25421 consensus_queue.cc:260] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.903107 25421 ts_tablet_manager.cc:1434] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 13:10:27.901794 25549 consensus_queue.cc:237] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.905874 25421 tablet_bootstrap.cc:492] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce: Bootstrap starting.
I20260709 13:10:27.911151 25488 consensus_queue.cc:1048] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:27.911819 25421 tablet_bootstrap.cc:654] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.919749 25419 tablet_bootstrap.cc:492] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468: No bootstrap required, opened a new log
I20260709 13:10:27.920185 25419 ts_tablet_manager.cc:1403] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468: Time spent bootstrapping tablet: real 0.220s	user 0.048s	sys 0.049s
I20260709 13:10:27.923178 25419 raft_consensus.cc:359] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.924106 25419 raft_consensus.cc:385] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.924501 25419 raft_consensus.cc:740] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.929185 25422 tablet_bootstrap.cc:654] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.925393 25419 consensus_queue.cc:260] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.933713 25419 ts_tablet_manager.cc:1434] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:10:27.937588 25419 tablet_bootstrap.cc:492] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468: Bootstrap starting.
I20260709 13:10:27.949923 25455 consensus_queue.cc:1048] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:27.966506 25419 tablet_bootstrap.cc:654] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.968187 25421 tablet_bootstrap.cc:492] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce: No bootstrap required, opened a new log
I20260709 13:10:27.969291 25421 ts_tablet_manager.cc:1403] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce: Time spent bootstrapping tablet: real 0.064s	user 0.011s	sys 0.027s
I20260709 13:10:27.972813 25421 raft_consensus.cc:359] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.973654 25421 raft_consensus.cc:385] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.974011 25421 raft_consensus.cc:740] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.974674 25421 consensus_queue.cc:260] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:27.976877 25421 ts_tablet_manager.cc:1434] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:10:27.977948 25125 catalog_manager.cc:5697] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 0 to 1, leader changed from <none> to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 1 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:27.978821 25421 tablet_bootstrap.cc:492] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce: Bootstrap starting.
I20260709 13:10:27.978682 25488 consensus_queue.cc:1048] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:27.992525 25421 tablet_bootstrap.cc:654] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.998731 25439 consensus_queue.cc:1048] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:28.007824 25421 tablet_bootstrap.cc:492] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce: No bootstrap required, opened a new log
I20260709 13:10:28.008327 25421 ts_tablet_manager.cc:1403] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.002s
I20260709 13:10:28.014653 25419 tablet_bootstrap.cc:492] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468: No bootstrap required, opened a new log
I20260709 13:10:28.015208 25419 ts_tablet_manager.cc:1403] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468: Time spent bootstrapping tablet: real 0.078s	user 0.009s	sys 0.002s
I20260709 13:10:28.016039 25530 raft_consensus.cc:493] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.016510 25530 raft_consensus.cc:515] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.018509 25422 tablet_bootstrap.cc:492] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19: No bootstrap required, opened a new log
I20260709 13:10:28.019014 25422 ts_tablet_manager.cc:1403] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19: Time spent bootstrapping tablet: real 0.242s	user 0.013s	sys 0.009s
I20260709 13:10:28.018893 25419 raft_consensus.cc:359] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.019731 25419 raft_consensus.cc:385] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.020066 25419 raft_consensus.cc:740] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.018534 25530 leader_election.cc:290] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:28.020828 25419 consensus_queue.cc:260] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.021481 25422 raft_consensus.cc:359] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.022151 25422 raft_consensus.cc:385] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.022375 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:28.022859 25421 raft_consensus.cc:359] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.023527 25421 raft_consensus.cc:385] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.023624 25419 ts_tablet_manager.cc:1434] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:10:28.023996 25421 raft_consensus.cc:740] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.024920 25419 tablet_bootstrap.cc:492] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468: Bootstrap starting.
I20260709 13:10:28.024804 25421 consensus_queue.cc:260] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.026777 25421 ts_tablet_manager.cc:1434] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.001s
I20260709 13:10:28.027640 25421 tablet_bootstrap.cc:492] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce: Bootstrap starting.
I20260709 13:10:28.032981 25419 tablet_bootstrap.cc:654] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.033222 25421 tablet_bootstrap.cc:654] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.022418 25422 raft_consensus.cc:740] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Initialized, Role: FOLLOWER
W20260709 13:10:28.024039 25194 leader_election.cc:343] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.034327 25422 consensus_queue.cc:260] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.036463 25422 ts_tablet_manager.cc:1434] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.000s
I20260709 13:10:28.037449 25422 tablet_bootstrap.cc:492] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P da445ce82dc4467f95f4fa52297eaa19: Bootstrap starting.
I20260709 13:10:28.038118 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:28.038757 25377 raft_consensus.cc:2468] T 08c29bb25d6947ddaa43c22713738514 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 0.
I20260709 13:10:28.043443 25195 leader_election.cc:304] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:10:28.044523 25530 raft_consensus.cc:2804] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:28.044874 25530 raft_consensus.cc:493] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.045182 25530 raft_consensus.cc:3060] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.046351 25419 tablet_bootstrap.cc:492] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468: No bootstrap required, opened a new log
I20260709 13:10:28.046154 25636 consensus_queue.cc:1048] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:28.046787 25419 ts_tablet_manager.cc:1403] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468: Time spent bootstrapping tablet: real 0.022s	user 0.005s	sys 0.011s
I20260709 13:10:28.048579 25422 tablet_bootstrap.cc:654] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P da445ce82dc4467f95f4fa52297eaa19: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.049299 25419 raft_consensus.cc:359] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.050374 25419 raft_consensus.cc:385] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.050626 25419 raft_consensus.cc:740] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.056679 25419 consensus_queue.cc:260] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.059581 25419 ts_tablet_manager.cc:1434] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.005s
I20260709 13:10:28.060614 25419 tablet_bootstrap.cc:492] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468: Bootstrap starting.
I20260709 13:10:28.061667 25530 raft_consensus.cc:515] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.064429 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
W20260709 13:10:28.065565 25194 leader_election.cc:343] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.067939 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:10:28.068470 25377 raft_consensus.cc:3060] T 08c29bb25d6947ddaa43c22713738514 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.073439 25419 tablet_bootstrap.cc:654] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.077970 25484 consensus_queue.cc:1048] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:28.090812 25377 raft_consensus.cc:2468] T 08c29bb25d6947ddaa43c22713738514 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 1.
I20260709 13:10:28.092489 25195 leader_election.cc:304] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:10:28.093357 25484 raft_consensus.cc:2804] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:28.093856 25484 raft_consensus.cc:697] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:10:28.094630 25484 consensus_queue.cc:237] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.098168 25419 tablet_bootstrap.cc:492] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468: No bootstrap required, opened a new log
I20260709 13:10:28.098668 25419 ts_tablet_manager.cc:1403] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468: Time spent bootstrapping tablet: real 0.038s	user 0.008s	sys 0.007s
I20260709 13:10:28.101164 25419 raft_consensus.cc:359] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.101857 25419 raft_consensus.cc:385] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.102171 25419 raft_consensus.cc:740] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.103000 25419 consensus_queue.cc:260] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.105829 25419 ts_tablet_manager.cc:1434] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:10:28.104969 25530 leader_election.cc:290] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:28.106916 25419 tablet_bootstrap.cc:492] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468: Bootstrap starting.
I20260709 13:10:28.112131 25421 tablet_bootstrap.cc:492] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce: No bootstrap required, opened a new log
I20260709 13:10:28.112577 25421 ts_tablet_manager.cc:1403] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce: Time spent bootstrapping tablet: real 0.085s	user 0.013s	sys 0.017s
I20260709 13:10:28.115128 25419 tablet_bootstrap.cc:654] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.115067 25421 raft_consensus.cc:359] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.115772 25421 raft_consensus.cc:385] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.116046 25421 raft_consensus.cc:740] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.116673 25421 consensus_queue.cc:260] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.120061 25422 tablet_bootstrap.cc:492] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P da445ce82dc4467f95f4fa52297eaa19: No bootstrap required, opened a new log
I20260709 13:10:28.120493 25422 ts_tablet_manager.cc:1403] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P da445ce82dc4467f95f4fa52297eaa19: Time spent bootstrapping tablet: real 0.083s	user 0.022s	sys 0.014s
I20260709 13:10:28.122980 25422 raft_consensus.cc:359] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.123633 25422 raft_consensus.cc:385] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.123903 25422 raft_consensus.cc:740] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.124751 25422 consensus_queue.cc:260] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.127074 25421 ts_tablet_manager.cc:1434] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 13:10:28.130702 25422 ts_tablet_manager.cc:1434] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P da445ce82dc4467f95f4fa52297eaa19: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260709 13:10:28.131640 25422 tablet_bootstrap.cc:492] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19: Bootstrap starting.
I20260709 13:10:28.132656 25419 tablet_bootstrap.cc:492] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468: No bootstrap required, opened a new log
I20260709 13:10:28.133087 25419 ts_tablet_manager.cc:1403] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.002s
I20260709 13:10:28.135763 25421 tablet_bootstrap.cc:492] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce: Bootstrap starting.
I20260709 13:10:28.135666 25419 raft_consensus.cc:359] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.136317 25419 raft_consensus.cc:385] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.136562 25419 raft_consensus.cc:740] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.137336 25419 consensus_queue.cc:260] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.139576 25419 ts_tablet_manager.cc:1434] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:10:28.140484 25419 tablet_bootstrap.cc:492] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468: Bootstrap starting.
I20260709 13:10:28.144654 25422 tablet_bootstrap.cc:654] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.146522 25421 tablet_bootstrap.cc:654] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.154392 25530 consensus_queue.cc:1048] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:28.155277 25419 tablet_bootstrap.cc:654] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.163246 25530 raft_consensus.cc:493] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.164002 25530 raft_consensus.cc:515] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.168480 25530 leader_election.cc:290] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:28.169485 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:28.170403 25375 raft_consensus.cc:2468] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 0.
I20260709 13:10:28.171998 25195 leader_election.cc:304] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:10:28.173386 25530 raft_consensus.cc:2804] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:28.174049 25530 raft_consensus.cc:493] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.174512 25530 raft_consensus.cc:3060] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:28.184345 25674 log.cc:927] Time spent T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:10:28.197516 25422 tablet_bootstrap.cc:492] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19: No bootstrap required, opened a new log
I20260709 13:10:28.198128 25422 ts_tablet_manager.cc:1403] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19: Time spent bootstrapping tablet: real 0.067s	user 0.011s	sys 0.005s
I20260709 13:10:28.203671 25422 raft_consensus.cc:359] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.204370 25422 raft_consensus.cc:385] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.204636 25422 raft_consensus.cc:740] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.208763 25422 consensus_queue.cc:260] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.211684 25455 raft_consensus.cc:493] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.212209 25455 raft_consensus.cc:515] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.212621 25421 tablet_bootstrap.cc:492] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce: No bootstrap required, opened a new log
I20260709 13:10:28.213270 25421 ts_tablet_manager.cc:1403] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce: Time spent bootstrapping tablet: real 0.078s	user 0.010s	sys 0.009s
I20260709 13:10:28.218300 25455 leader_election.cc:290] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:28.218842 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:28.219449 25228 raft_consensus.cc:2468] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 0.
I20260709 13:10:28.219766 25422 ts_tablet_manager.cc:1434] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:10:28.220623 25345 leader_election.cc:304] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:10:28.216964 25421 raft_consensus.cc:359] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.221325 25421 raft_consensus.cc:385] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.220652 25422 tablet_bootstrap.cc:492] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19: Bootstrap starting.
I20260709 13:10:28.221491 25455 raft_consensus.cc:2804] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:28.221690 25421 raft_consensus.cc:740] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.222010 25455 raft_consensus.cc:493] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.222473 25455 raft_consensus.cc:3060] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.222517 25421 consensus_queue.cc:260] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.224087 25421 ts_tablet_manager.cc:1434] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 13:10:28.225042 25421 tablet_bootstrap.cc:492] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce: Bootstrap starting.
I20260709 13:10:28.227609 25422 tablet_bootstrap.cc:654] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.231081 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:28.231947 25301 raft_consensus.cc:2468] T 88997763405742ee8b8e6b43d7392c1f P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 0.
I20260709 13:10:28.240100 25421 tablet_bootstrap.cc:654] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.241391 25530 raft_consensus.cc:515] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.244284 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:28.244906 25301 raft_consensus.cc:2468] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 0.
I20260709 13:10:28.248992 25636 consensus_queue.cc:1048] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:28.260350 25456 raft_consensus.cc:493] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.260979 25456 raft_consensus.cc:515] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.252403 25126 catalog_manager.cc:5697] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 1 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:28.265147 25636 raft_consensus.cc:493] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.265642 25636 raft_consensus.cc:515] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.267632 25636 leader_election.cc:290] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:28.273408 25422 tablet_bootstrap.cc:492] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19: No bootstrap required, opened a new log
I20260709 13:10:28.273903 25422 ts_tablet_manager.cc:1403] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19: Time spent bootstrapping tablet: real 0.053s	user 0.009s	sys 0.007s
I20260709 13:10:28.269845 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:28.275063 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:28.277786 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:10:28.278337 25376 raft_consensus.cc:3060] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.278343 25303 raft_consensus.cc:2468] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 0.
I20260709 13:10:28.270295 25455 raft_consensus.cc:515] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.282091 25456 leader_election.cc:290] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:10:28.283471 25195 leader_election.cc:343] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.283735 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:10:28.283999 25419 tablet_bootstrap.cc:492] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468: No bootstrap required, opened a new log
I20260709 13:10:28.284559 25419 ts_tablet_manager.cc:1403] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468: Time spent bootstrapping tablet: real 0.144s	user 0.016s	sys 0.024s
I20260709 13:10:28.284328 25304 raft_consensus.cc:3060] T 88997763405742ee8b8e6b43d7392c1f P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.284581 25530 leader_election.cc:290] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:28.295866 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:28.297274 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:28.298794 25455 leader_election.cc:290] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:28.300272 25422 raft_consensus.cc:359] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.300942 25422 raft_consensus.cc:385] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.301198 25422 raft_consensus.cc:740] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.303256 25422 consensus_queue.cc:260] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.306010 25194 leader_election.cc:304] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:10:28.306535 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:10:28.307078 25226 raft_consensus.cc:3060] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.307339 25636 raft_consensus.cc:2804] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:28.307698 25636 raft_consensus.cc:493] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:28.307893 25343 leader_election.cc:343] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.308030 25636 raft_consensus.cc:3060] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.308621 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:10:28.309607 25422 ts_tablet_manager.cc:1434] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19: Time spent starting tablet: real 0.035s	user 0.003s	sys 0.003s
I20260709 13:10:28.310451 25422 tablet_bootstrap.cc:492] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19: Bootstrap starting.
I20260709 13:10:28.309170 25302 raft_consensus.cc:3060] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.314002 25487 raft_consensus.cc:493] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.314448 25487 raft_consensus.cc:515] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:10:28.315026 25345 leader_election.cc:343] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.315398 25345 leader_election.cc:304] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:10:28.315621 25304 raft_consensus.cc:2468] T 88997763405742ee8b8e6b43d7392c1f P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 1.
I20260709 13:10:28.316596 25456 raft_consensus.cc:2749] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:28.317386 25487 leader_election.cc:290] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:28.318060 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:28.318734 25301 raft_consensus.cc:3060] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.319450 25455 consensus_queue.cc:1048] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:28.319484 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:28.320291 25376 raft_consensus.cc:2468] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 1.
I20260709 13:10:28.318694 25377 raft_consensus.cc:2468] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 0.
W20260709 13:10:28.321856 25271 leader_election.cc:343] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.322299 25195 leader_election.cc:304] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:10:28.323061 25530 raft_consensus.cc:2804] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:28.323650 25270 leader_election.cc:304] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:10:28.324506 25487 raft_consensus.cc:2804] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:28.323665 25530 raft_consensus.cc:697] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:10:28.324958 25487 raft_consensus.cc:493] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.325353 25487 raft_consensus.cc:3060] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.325520 25530 consensus_queue.cc:237] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.328295 25419 raft_consensus.cc:359] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.329744 25419 raft_consensus.cc:385] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.330176 25419 raft_consensus.cc:740] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.327947 25226 raft_consensus.cc:2468] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 1.
I20260709 13:10:28.330884 25419 consensus_queue.cc:260] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.331676 25455 raft_consensus.cc:493] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.332899 25455 raft_consensus.cc:515] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.333882 25419 ts_tablet_manager.cc:1434] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468: Time spent starting tablet: real 0.049s	user 0.003s	sys 0.003s
I20260709 13:10:28.334926 25419 tablet_bootstrap.cc:492] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468: Bootstrap starting.
I20260709 13:10:28.338277 25439 consensus_queue.cc:1048] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:28.343156 25487 raft_consensus.cc:515] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.343935 25345 leader_election.cc:304] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:10:28.344390 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:28.344740 25456 raft_consensus.cc:2804] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:28.345305 25456 raft_consensus.cc:697] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:10:28.345677 25455 leader_election.cc:290] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:28.336979 25636 raft_consensus.cc:515] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.346144 25456 consensus_queue.cc:237] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.347153 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:28.347548 25230 raft_consensus.cc:2393] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 1: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:10:28.347738 25304 raft_consensus.cc:2468] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 0.
I20260709 13:10:28.356168 25636 leader_election.cc:290] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:28.356485 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:10:28.357697 25343 leader_election.cc:304] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:10:28.361079 25422 tablet_bootstrap.cc:654] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.361738 25377 raft_consensus.cc:3060] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.362504 25421 tablet_bootstrap.cc:492] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce: No bootstrap required, opened a new log
I20260709 13:10:28.362922 25421 ts_tablet_manager.cc:1403] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce: Time spent bootstrapping tablet: real 0.138s	user 0.016s	sys 0.008s
I20260709 13:10:28.368346 25439 consensus_queue.cc:1048] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:28.375175 25487 leader_election.cc:290] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:28.377085 25419 tablet_bootstrap.cc:654] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.378118 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:10:28.376350 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:10:28.379225 25375 raft_consensus.cc:3060] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.380831 25377 raft_consensus.cc:2468] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 1.
I20260709 13:10:28.381321 25604 raft_consensus.cc:2764] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
W20260709 13:10:28.385989 25271 leader_election.cc:343] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.388556 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:10:28.389063 25304 raft_consensus.cc:3060] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.400878 25125 catalog_manager.cc:5697] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 1 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:28.418531 25421 raft_consensus.cc:359] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.419272 25421 raft_consensus.cc:385] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.419603 25421 raft_consensus.cc:740] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.420225 25421 consensus_queue.cc:260] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.404803 25195 leader_election.cc:304] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:10:28.425937 25530 raft_consensus.cc:2804] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:28.426425 25530 raft_consensus.cc:697] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:10:28.427263 25530 consensus_queue.cc:237] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.432077 25455 consensus_queue.cc:1048] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:28.435285 25375 raft_consensus.cc:2468] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 1.
I20260709 13:10:28.436556 25270 leader_election.cc:304] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:10:28.437599 25439 raft_consensus.cc:2804] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:28.438051 25439 raft_consensus.cc:697] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:10:28.438683 25304 raft_consensus.cc:2468] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 1.
I20260709 13:10:28.438764 25439 consensus_queue.cc:237] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.443044 25421 ts_tablet_manager.cc:1434] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce: Time spent starting tablet: real 0.080s	user 0.008s	sys 0.001s
I20260709 13:10:28.443729 25421 tablet_bootstrap.cc:492] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce: Bootstrap starting.
I20260709 13:10:28.444559 25422 tablet_bootstrap.cc:492] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19: No bootstrap required, opened a new log
I20260709 13:10:28.445009 25422 ts_tablet_manager.cc:1403] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19: Time spent bootstrapping tablet: real 0.135s	user 0.014s	sys 0.011s
I20260709 13:10:28.445935 25636 raft_consensus.cc:493] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.446381 25636 raft_consensus.cc:515] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.448418 25636 leader_election.cc:290] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:28.449009 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:10:28.450409 25194 leader_election.cc:343] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.450500 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:28.450634 25128 catalog_manager.cc:5697] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 1 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:28.453954 25195 leader_election.cc:343] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.454385 25195 leader_election.cc:304] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:10:28.456964 25419 tablet_bootstrap.cc:492] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468: No bootstrap required, opened a new log
I20260709 13:10:28.457417 25419 ts_tablet_manager.cc:1403] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468: Time spent bootstrapping tablet: real 0.123s	user 0.017s	sys 0.021s
I20260709 13:10:28.458017 25484 raft_consensus.cc:2749] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:28.460687 25302 raft_consensus.cc:2468] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 1.
I20260709 13:10:28.466262 25419 raft_consensus.cc:359] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.468125 25419 raft_consensus.cc:385] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.468406 25419 raft_consensus.cc:740] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.500123 25422 raft_consensus.cc:359] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.504642 25419 consensus_queue.cc:260] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.501026 25422 raft_consensus.cc:385] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.509246 25419 ts_tablet_manager.cc:1434] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.005s
I20260709 13:10:28.514153 25422 raft_consensus.cc:740] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.515347 25422 consensus_queue.cc:260] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.517639 25419 tablet_bootstrap.cc:492] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468: Bootstrap starting.
I20260709 13:10:28.521811 25455 raft_consensus.cc:493] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.522279 25455 raft_consensus.cc:515] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.524207 25455 leader_election.cc:290] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:28.525938 25422 ts_tablet_manager.cc:1434] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19: Time spent starting tablet: real 0.081s	user 0.007s	sys 0.000s
I20260709 13:10:28.527104 25422 tablet_bootstrap.cc:492] T 11892dffe99a496ebf3d98773631357c P da445ce82dc4467f95f4fa52297eaa19: Bootstrap starting.
I20260709 13:10:28.529052 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:10:28.530647 25343 leader_election.cc:343] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.531335 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:28.532191 25228 raft_consensus.cc:2468] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 0.
I20260709 13:10:28.532943 25421 tablet_bootstrap.cc:654] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:28.535403 25693 log.cc:927] Time spent T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.071s	user 0.002s	sys 0.000s
I20260709 13:10:28.537482 25419 tablet_bootstrap.cc:654] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.538312 25345 leader_election.cc:304] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:10:28.542558 25455 raft_consensus.cc:2804] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:28.543035 25455 raft_consensus.cc:493] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.540855 25125 catalog_manager.cc:5697] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 1 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:28.543428 25455 raft_consensus.cc:3060] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.550242 25422 tablet_bootstrap.cc:654] T 11892dffe99a496ebf3d98773631357c P da445ce82dc4467f95f4fa52297eaa19: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.556890 25604 raft_consensus.cc:493] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.557646 25604 raft_consensus.cc:515] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.568440 25455 raft_consensus.cc:515] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.570931 25128 catalog_manager.cc:5697] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 0 to 1, leader changed from <none> to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 1 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:28.569726 25530 raft_consensus.cc:493] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.574959 25530 raft_consensus.cc:515] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.574126 25604 leader_election.cc:290] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:28.580892 25530 leader_election.cc:290] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:28.583700 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:28.585021 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:10:28.585363 25343 leader_election.cc:343] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:28.586251 25195 leader_election.cc:343] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.588310 25419 tablet_bootstrap.cc:492] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468: No bootstrap required, opened a new log
I20260709 13:10:28.588886 25419 ts_tablet_manager.cc:1403] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468: Time spent bootstrapping tablet: real 0.072s	user 0.011s	sys 0.006s
I20260709 13:10:28.594633 25419 raft_consensus.cc:359] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.594977 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:10:28.595615 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:28.595743 25419 raft_consensus.cc:385] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.596604 25419 raft_consensus.cc:740] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.597235 25455 leader_election.cc:290] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:28.597299 25419 consensus_queue.cc:260] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:10:28.602718 25343 leader_election.cc:343] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.603516 25419 ts_tablet_manager.cc:1434] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:10:28.605489 25419 tablet_bootstrap.cc:492] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 79d99c0e498349bda74127365219e468: Bootstrap starting.
I20260709 13:10:28.598102 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:28.611030 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:10:28.611575 25226 raft_consensus.cc:3060] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:28.619665 25345 leader_election.cc:343] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.620096 25345 leader_election.cc:304] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:10:28.620759 25455 raft_consensus.cc:2749] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:10:28.621912 25194 leader_election.cc:343] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.626984 25226 raft_consensus.cc:2468] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 1.
I20260709 13:10:28.627991 25421 tablet_bootstrap.cc:492] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce: No bootstrap required, opened a new log
I20260709 13:10:28.628378 25421 ts_tablet_manager.cc:1403] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce: Time spent bootstrapping tablet: real 0.185s	user 0.015s	sys 0.018s
I20260709 13:10:28.624945 25194 leader_election.cc:304] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:10:28.629556 25530 raft_consensus.cc:2749] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:28.630559 25345 leader_election.cc:304] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:10:28.631536 25455 raft_consensus.cc:2804] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:28.631980 25455 raft_consensus.cc:697] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
W20260709 13:10:28.633046 25175 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:28.632649 25455 consensus_queue.cc:237] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.631531 25422 tablet_bootstrap.cc:492] T 11892dffe99a496ebf3d98773631357c P da445ce82dc4467f95f4fa52297eaa19: No bootstrap required, opened a new log
I20260709 13:10:28.634123 25422 ts_tablet_manager.cc:1403] T 11892dffe99a496ebf3d98773631357c P da445ce82dc4467f95f4fa52297eaa19: Time spent bootstrapping tablet: real 0.107s	user 0.022s	sys 0.011s
I20260709 13:10:28.636821 25421 raft_consensus.cc:359] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.637616 25421 raft_consensus.cc:385] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.637959 25421 raft_consensus.cc:740] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.638630 25421 consensus_queue.cc:260] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.640604 25421 ts_tablet_manager.cc:1434] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce: Time spent starting tablet: real 0.012s	user 0.001s	sys 0.005s
I20260709 13:10:28.641733 25421 tablet_bootstrap.cc:492] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce: Bootstrap starting.
I20260709 13:10:28.643404 25419 tablet_bootstrap.cc:654] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 79d99c0e498349bda74127365219e468: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.645401 25422 raft_consensus.cc:359] T 11892dffe99a496ebf3d98773631357c P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.646173 25422 raft_consensus.cc:385] T 11892dffe99a496ebf3d98773631357c P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.646461 25422 raft_consensus.cc:740] T 11892dffe99a496ebf3d98773631357c P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.650020 25422 consensus_queue.cc:260] T 11892dffe99a496ebf3d98773631357c P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.653537 25422 ts_tablet_manager.cc:1434] T 11892dffe99a496ebf3d98773631357c P da445ce82dc4467f95f4fa52297eaa19: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:10:28.655485 25422 tablet_bootstrap.cc:492] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19: Bootstrap starting.
I20260709 13:10:28.655859 25126 catalog_manager.cc:5697] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 1 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:28.664361 25422 tablet_bootstrap.cc:654] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.670900 25419 tablet_bootstrap.cc:492] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 79d99c0e498349bda74127365219e468: No bootstrap required, opened a new log
I20260709 13:10:28.671301 25419 ts_tablet_manager.cc:1403] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 79d99c0e498349bda74127365219e468: Time spent bootstrapping tablet: real 0.066s	user 0.005s	sys 0.008s
I20260709 13:10:28.673264 25419 raft_consensus.cc:359] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.673928 25419 raft_consensus.cc:385] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.674157 25419 raft_consensus.cc:740] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.674760 25419 consensus_queue.cc:260] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.676752 25419 ts_tablet_manager.cc:1434] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 79d99c0e498349bda74127365219e468: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.001s
I20260709 13:10:28.677587 25419 tablet_bootstrap.cc:492] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468: Bootstrap starting.
I20260709 13:10:28.683703 25419 tablet_bootstrap.cc:654] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.684448 25484 consensus_queue.cc:1048] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:28.692131 25421 tablet_bootstrap.cc:654] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.693840 25419 tablet_bootstrap.cc:492] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468: No bootstrap required, opened a new log
I20260709 13:10:28.694815 25302 raft_consensus.cc:3060] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.700569 25422 tablet_bootstrap.cc:492] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19: No bootstrap required, opened a new log
I20260709 13:10:28.701023 25422 ts_tablet_manager.cc:1403] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19: Time spent bootstrapping tablet: real 0.046s	user 0.012s	sys 0.012s
I20260709 13:10:28.703572 25422 raft_consensus.cc:359] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.704658 25422 raft_consensus.cc:385] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.704936 25422 raft_consensus.cc:740] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.705595 25422 consensus_queue.cc:260] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.707873 25422 ts_tablet_manager.cc:1434] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:10:28.708628 25422 tablet_bootstrap.cc:492] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19: Bootstrap starting.
I20260709 13:10:28.694267 25419 ts_tablet_manager.cc:1403] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.003s
I20260709 13:10:28.712267 25636 consensus_queue.cc:1048] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:28.713951 25422 tablet_bootstrap.cc:654] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.743535 25419 raft_consensus.cc:359] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.744524 25419 raft_consensus.cc:385] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.746393 25419 raft_consensus.cc:740] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.747392 25419 consensus_queue.cc:260] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.747964 25604 consensus_queue.cc:1048] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:28.756178 25419 ts_tablet_manager.cc:1434] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468: Time spent starting tablet: real 0.045s	user 0.005s	sys 0.002s
I20260709 13:10:28.757371 25419 tablet_bootstrap.cc:492] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468: Bootstrap starting.
I20260709 13:10:28.765080 25419 tablet_bootstrap.cc:654] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.772279 25439 raft_consensus.cc:493] T 11892dffe99a496ebf3d98773631357c P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.772759 25439 raft_consensus.cc:515] T 11892dffe99a496ebf3d98773631357c P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.777530 25439 leader_election.cc:290] T 11892dffe99a496ebf3d98773631357c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:28.783150 25421 tablet_bootstrap.cc:492] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce: No bootstrap required, opened a new log
I20260709 13:10:28.783612 25421 ts_tablet_manager.cc:1403] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce: Time spent bootstrapping tablet: real 0.142s	user 0.017s	sys 0.040s
I20260709 13:10:28.786176 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:28.786893 25422 tablet_bootstrap.cc:492] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19: No bootstrap required, opened a new log
I20260709 13:10:28.784987 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:28.787323 25422 ts_tablet_manager.cc:1403] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19: Time spent bootstrapping tablet: real 0.079s	user 0.023s	sys 0.031s
W20260709 13:10:28.788184 25270 leader_election.cc:343] T 11892dffe99a496ebf3d98773631357c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.789793 25422 raft_consensus.cc:359] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.790410 25422 raft_consensus.cc:385] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.790643 25422 raft_consensus.cc:740] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.791693 25422 consensus_queue.cc:260] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.793771 25422 ts_tablet_manager.cc:1434] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
W20260709 13:10:28.789513 25271 leader_election.cc:343] T 11892dffe99a496ebf3d98773631357c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.794590 25422 tablet_bootstrap.cc:492] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19: Bootstrap starting.
I20260709 13:10:28.794378 25271 leader_election.cc:304] T 11892dffe99a496ebf3d98773631357c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:10:28.795233 25439 raft_consensus.cc:2749] T 11892dffe99a496ebf3d98773631357c P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:28.800390 25636 raft_consensus.cc:493] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.801595 25422 tablet_bootstrap.cc:654] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.801047 25636 raft_consensus.cc:515] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.807016 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:28.807838 25375 raft_consensus.cc:2468] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 0.
I20260709 13:10:28.809561 25195 leader_election.cc:304] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:10:28.810503 25484 raft_consensus.cc:2804] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:28.810874 25484 raft_consensus.cc:493] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.811295 25484 raft_consensus.cc:3060] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.813120 25422 tablet_bootstrap.cc:492] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19: No bootstrap required, opened a new log
I20260709 13:10:28.813556 25422 ts_tablet_manager.cc:1403] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.002s
I20260709 13:10:28.816099 25422 raft_consensus.cc:359] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.816725 25422 raft_consensus.cc:385] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.816994 25422 raft_consensus.cc:740] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.817605 25422 consensus_queue.cc:260] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.819677 25422 ts_tablet_manager.cc:1434] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:10:28.820051 25421 raft_consensus.cc:359] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.820631 25422 tablet_bootstrap.cc:492] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19: Bootstrap starting.
I20260709 13:10:28.820931 25636 leader_election.cc:290] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:28.820698 25421 raft_consensus.cc:385] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.818161 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:28.821796 25421 raft_consensus.cc:740] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.822047 25301 raft_consensus.cc:2468] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 0.
I20260709 13:10:28.822485 25421 consensus_queue.cc:260] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.817734 25484 raft_consensus.cc:515] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.824461 25421 ts_tablet_manager.cc:1434] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.001s
I20260709 13:10:28.826483 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:10:28.826987 25301 raft_consensus.cc:3060] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.827175 25422 tablet_bootstrap.cc:654] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.831727 25421 tablet_bootstrap.cc:492] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce: Bootstrap starting.
I20260709 13:10:28.838030 25421 tablet_bootstrap.cc:654] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.842133 25455 consensus_queue.cc:1048] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:28.845199 25419 tablet_bootstrap.cc:492] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468: No bootstrap required, opened a new log
I20260709 13:10:28.845634 25419 ts_tablet_manager.cc:1403] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468: Time spent bootstrapping tablet: real 0.089s	user 0.022s	sys 0.015s
I20260709 13:10:28.848564 25419 raft_consensus.cc:359] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.849174 25419 raft_consensus.cc:385] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.849459 25419 raft_consensus.cc:740] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.850085 25419 consensus_queue.cc:260] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.852257 25419 ts_tablet_manager.cc:1434] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:10:28.853621 25439 raft_consensus.cc:493] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.854225 25439 raft_consensus.cc:515] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.858419 25439 leader_election.cc:290] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:28.860368 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:28.862416 25604 raft_consensus.cc:493] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.862851 25604 raft_consensus.cc:515] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:10:28.864995 25270 leader_election.cc:343] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.867156 25604 leader_election.cc:290] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:28.863569 25419 tablet_bootstrap.cc:492] T af9115771e334c95a7dec25c698514dc P 79d99c0e498349bda74127365219e468: Bootstrap starting.
I20260709 13:10:28.868796 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:10:28.870128 25345 leader_election.cc:343] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.878777 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:28.881057 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:28.881631 25229 raft_consensus.cc:2468] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 0.
I20260709 13:10:28.883491 25484 leader_election.cc:290] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:28.885255 25636 consensus_queue.cc:1048] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:28.885541 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:10:28.886451 25375 raft_consensus.cc:3060] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.889405 25456 raft_consensus.cc:493] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.889896 25456 raft_consensus.cc:515] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.891872 25456 leader_election.cc:290] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:28.893625 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:10:28.896232 25345 leader_election.cc:343] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.898986 25301 raft_consensus.cc:2468] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 1.
I20260709 13:10:28.902432 25484 consensus_queue.cc:1048] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:10:28.902675 25343 leader_election.cc:343] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.903059 25343 leader_election.cc:304] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:10:28.904078 25455 raft_consensus.cc:2749] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:28.911355 25422 tablet_bootstrap.cc:492] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19: No bootstrap required, opened a new log
I20260709 13:10:28.914146 25422 ts_tablet_manager.cc:1403] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19: Time spent bootstrapping tablet: real 0.091s	user 0.028s	sys 0.032s
I20260709 13:10:28.916280 25194 leader_election.cc:304] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:10:28.917019 25484 raft_consensus.cc:2804] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:28.917491 25484 raft_consensus.cc:697] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:10:28.917156 25422 raft_consensus.cc:359] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.917968 25422 raft_consensus.cc:385] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.918242 25422 raft_consensus.cc:740] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.918557 25484 consensus_queue.cc:237] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.918830 25422 consensus_queue.cc:260] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.920830 25422 ts_tablet_manager.cc:1434] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:10:28.921819 25422 tablet_bootstrap.cc:492] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19: Bootstrap starting.
I20260709 13:10:28.927663 25422 tablet_bootstrap.cc:654] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.932399 25484 consensus_queue.cc:1048] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:28.935294 25271 leader_election.cc:304] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:10:28.936163 25422 tablet_bootstrap.cc:492] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19: No bootstrap required, opened a new log
I20260709 13:10:28.936113 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:28.936661 25422 ts_tablet_manager.cc:1403] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.002s
I20260709 13:10:28.937680 25419 tablet_bootstrap.cc:654] T af9115771e334c95a7dec25c698514dc P 79d99c0e498349bda74127365219e468: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.940008 25439 raft_consensus.cc:2804] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:28.940340 25439 raft_consensus.cc:493] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.940624 25439 raft_consensus.cc:3060] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.941114 25422 raft_consensus.cc:359] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.941727 25422 raft_consensus.cc:385] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.942020 25422 raft_consensus.cc:740] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.942623 25422 consensus_queue.cc:260] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.944542 25422 ts_tablet_manager.cc:1434] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.002s
I20260709 13:10:28.946460 25422 tablet_bootstrap.cc:492] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19: Bootstrap starting.
I20260709 13:10:28.946593 25439 raft_consensus.cc:515] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.949229 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
W20260709 13:10:28.950827 25270 leader_election.cc:343] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.953051 25422 tablet_bootstrap.cc:654] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.954459 25487 consensus_queue.cc:1048] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:28.957278 25419 tablet_bootstrap.cc:492] T af9115771e334c95a7dec25c698514dc P 79d99c0e498349bda74127365219e468: No bootstrap required, opened a new log
I20260709 13:10:28.957706 25419 ts_tablet_manager.cc:1403] T af9115771e334c95a7dec25c698514dc P 79d99c0e498349bda74127365219e468: Time spent bootstrapping tablet: real 0.098s	user 0.010s	sys 0.000s
I20260709 13:10:28.948226 25439 leader_election.cc:290] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:28.960251 25419 raft_consensus.cc:359] T af9115771e334c95a7dec25c698514dc P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:28.997377 25456 raft_consensus.cc:493] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.002205 25456 raft_consensus.cc:515] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:29.003611 25375 raft_consensus.cc:2468] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 1.
W20260709 13:10:29.004015 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 68802.4us
I20260709 13:10:29.009975 25422 tablet_bootstrap.cc:492] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19: No bootstrap required, opened a new log
I20260709 13:10:29.010426 25422 ts_tablet_manager.cc:1403] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19: Time spent bootstrapping tablet: real 0.064s	user 0.010s	sys 0.004s
I20260709 13:10:29.004232 25456 leader_election.cc:290] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:28.997661 25460 raft_consensus.cc:493] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.004823 25419 raft_consensus.cc:385] T af9115771e334c95a7dec25c698514dc P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.011765 25419 raft_consensus.cc:740] T af9115771e334c95a7dec25c698514dc P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.011785 25460 raft_consensus.cc:515] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:29.012488 25419 consensus_queue.cc:260] T af9115771e334c95a7dec25c698514dc P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:29.014106 25460 leader_election.cc:290] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:29.014205 25419 ts_tablet_manager.cc:1434] T af9115771e334c95a7dec25c698514dc P 79d99c0e498349bda74127365219e468: Time spent starting tablet: real 0.056s	user 0.007s	sys 0.000s
I20260709 13:10:29.015508 25419 tablet_bootstrap.cc:492] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468: Bootstrap starting.
W20260709 13:10:29.016917 25343 leader_election.cc:343] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.007454 25421 tablet_bootstrap.cc:492] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce: No bootstrap required, opened a new log
I20260709 13:10:29.018280 25421 ts_tablet_manager.cc:1403] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce: Time spent bootstrapping tablet: real 0.187s	user 0.084s	sys 0.035s
I20260709 13:10:29.017409 25343 leader_election.cc:304] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:10:29.019444 25456 raft_consensus.cc:2749] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:29.021822 25419 tablet_bootstrap.cc:654] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.021984 25421 raft_consensus.cc:359] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:29.072841 25421 raft_consensus.cc:385] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.081933 25421 raft_consensus.cc:740] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.083293 25421 consensus_queue.cc:260] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:29.074222 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:29.071108 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:29.094657 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:10:29.095651 25228 raft_consensus.cc:3060] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:29.097494 25345 leader_election.cc:343] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:29.105470 25345 leader_election.cc:343] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.105999 25127 catalog_manager.cc:5697] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 1 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:29.125000 25421 ts_tablet_manager.cc:1434] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce: Time spent starting tablet: real 0.106s	user 0.004s	sys 0.006s
I20260709 13:10:29.124778 25228 raft_consensus.cc:2468] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 1.
W20260709 13:10:29.129031 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 112043us
I20260709 13:10:29.145983 25604 raft_consensus.cc:493] T af9115771e334c95a7dec25c698514dc P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.146783 25604 raft_consensus.cc:515] T af9115771e334c95a7dec25c698514dc P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:29.152740 25604 leader_election.cc:290] T af9115771e334c95a7dec25c698514dc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:29.152462 25422 raft_consensus.cc:359] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:29.154779 25421 tablet_bootstrap.cc:492] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce: Bootstrap starting.
I20260709 13:10:29.153494 25422 raft_consensus.cc:385] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.155507 25422 raft_consensus.cc:740] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Initialized, Role: FOLLOWER
W20260709 13:10:29.156066 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 62287us
I20260709 13:10:29.156297 25422 consensus_queue.cc:260] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:29.161134 25422 ts_tablet_manager.cc:1434] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19: Time spent starting tablet: real 0.150s	user 0.008s	sys 0.000s
I20260709 13:10:29.163021 25422 tablet_bootstrap.cc:492] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19: Bootstrap starting.
I20260709 13:10:29.171327 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:29.172088 25228 raft_consensus.cc:2393] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 1: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:10:29.172219 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:29.173120 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:29.173285 25301 raft_consensus.cc:2468] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 0.
I20260709 13:10:29.175661 25304 raft_consensus.cc:2468] T 11892dffe99a496ebf3d98773631357c P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 0.
I20260709 13:10:29.176749 25419 tablet_bootstrap.cc:492] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468: No bootstrap required, opened a new log
I20260709 13:10:29.177512 25419 ts_tablet_manager.cc:1403] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468: Time spent bootstrapping tablet: real 0.162s	user 0.021s	sys 0.014s
I20260709 13:10:29.181136 25419 raft_consensus.cc:359] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:29.181983 25419 raft_consensus.cc:385] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.182312 25419 raft_consensus.cc:740] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.184723 25419 consensus_queue.cc:260] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:29.190431 25722 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.191239 25722 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:29.207094 25724 consensus_queue.cc:1048] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:29.213212 25419 ts_tablet_manager.cc:1434] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.001s
I20260709 13:10:29.214182 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:29.216126 25302 raft_consensus.cc:2393] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 1: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:10:29.217600 25419 tablet_bootstrap.cc:492] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468: Bootstrap starting.
I20260709 13:10:29.233654 25230 raft_consensus.cc:3060] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.234346 25343 leader_election.cc:304] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:10:29.235376 25554 raft_consensus.cc:2804] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:29.235757 25554 raft_consensus.cc:493] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.235944 25343 leader_election.cc:304] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:10:29.236122 25554 raft_consensus.cc:3060] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.236944 25604 raft_consensus.cc:2804] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:29.237336 25604 raft_consensus.cc:493] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.237691 25604 raft_consensus.cc:3060] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.246410 25343 leader_election.cc:304] T af9115771e334c95a7dec25c698514dc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:10:29.247402 25460 raft_consensus.cc:3060] T af9115771e334c95a7dec25c698514dc P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.251716 25725 raft_consensus.cc:493] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.252355 25725 raft_consensus.cc:515] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:29.261518 25725 leader_election.cc:290] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:29.272789 25271 leader_election.cc:304] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:10:29.277832 25726 raft_consensus.cc:2804] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:29.278396 25726 raft_consensus.cc:697] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:10:29.279511 25726 consensus_queue.cc:237] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:29.294160 25729 raft_consensus.cc:493] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.294662 25729 raft_consensus.cc:515] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:29.285959 25604 raft_consensus.cc:515] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:29.303503 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:29.308259 25226 raft_consensus.cc:2393] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 1: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:10:29.308749 25460 raft_consensus.cc:2749] T af9115771e334c95a7dec25c698514dc P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:29.310712 25729 leader_election.cc:290] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:29.310985 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:29.311286 25727 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.314043 25422 tablet_bootstrap.cc:654] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.319365 25419 tablet_bootstrap.cc:654] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.323277 25300 raft_consensus.cc:3060] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.327181 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:29.311805 25727 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:29.330054 25421 tablet_bootstrap.cc:654] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.332365 25305 raft_consensus.cc:2468] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 0.
I20260709 13:10:29.307524 25722 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:29.334580 25549 consensus_queue.cc:1048] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:10:29.342729 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:29.347112 25727 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:29.347030 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:29.348207 25194 leader_election.cc:304] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:10:29.353776 25195 leader_election.cc:343] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.359786 25724 raft_consensus.cc:2804] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:29.360378 25724 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.360859 25724 raft_consensus.cc:3060] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.375823 25604 leader_election.cc:290] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:29.381412 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:29.386196 25530 raft_consensus.cc:493] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.386852 25530 raft_consensus.cc:515] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:29.396101 25554 raft_consensus.cc:515] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:29.401618 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:29.404397 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:10:29.405048 25302 raft_consensus.cc:3060] T 11892dffe99a496ebf3d98773631357c P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.404976 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
W20260709 13:10:29.412248 25343 leader_election.cc:343] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:29.412734 25345 leader_election.cc:343] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.434312 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:29.434598 25554 leader_election.cc:290] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:29.420416 25731 consensus_queue.cc:1048] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:10:29.437831 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:10:29.439639 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:10:29.446591 25345 leader_election.cc:343] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.446805 25484 consensus_queue.cc:1048] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:29.446977 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:10:29.447022 25345 leader_election.cc:304] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:10:29.447603 25305 raft_consensus.cc:3060] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.436180 25530 leader_election.cc:290] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:29.449867 25730 raft_consensus.cc:2749] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:29.454931 25732 consensus_queue.cc:1048] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:10:29.456451 25270 leader_election.cc:304] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
W20260709 13:10:29.460520 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 57468.9us
W20260709 13:10:29.461655 25270 leader_election.cc:343] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.463115 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:29.483537 25195 leader_election.cc:304] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:10:29.492038 25126 catalog_manager.cc:5697] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 0 to 1, leader changed from <none> to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 1 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:29.463472 25726 raft_consensus.cc:2749] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:10:29.497954 25345 leader_election.cc:343] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.504937 25302 raft_consensus.cc:2468] T 11892dffe99a496ebf3d98773631357c P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 1.
I20260709 13:10:29.495687 25305 raft_consensus.cc:2468] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 1.
I20260709 13:10:29.513339 25419 tablet_bootstrap.cc:492] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468: No bootstrap required, opened a new log
I20260709 13:10:29.513252 25343 leader_election.cc:304] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:10:29.513796 25419 ts_tablet_manager.cc:1403] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468: Time spent bootstrapping tablet: real 0.297s	user 0.013s	sys 0.017s
I20260709 13:10:29.516887 25343 leader_election.cc:304] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:10:29.508500 25724 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:29.518117 25228 raft_consensus.cc:2393] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 1: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:10:29.517927 25604 raft_consensus.cc:2804] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:29.522125 25604 raft_consensus.cc:697] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:10:29.519665 25730 raft_consensus.cc:2804] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:29.525066 25422 tablet_bootstrap.cc:492] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19: No bootstrap required, opened a new log
I20260709 13:10:29.526944 25271 leader_election.cc:304] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:10:29.527070 25730 raft_consensus.cc:697] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:10:29.527240 25422 ts_tablet_manager.cc:1403] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19: Time spent bootstrapping tablet: real 0.365s	user 0.012s	sys 0.010s
I20260709 13:10:29.534416 25439 raft_consensus.cc:493] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.534884 25439 raft_consensus.cc:515] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:29.536700 25484 consensus_queue.cc:1048] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:29.539218 25439 leader_election.cc:290] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:29.540164 25726 raft_consensus.cc:3060] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:29.543891 25734 log.cc:927] Time spent T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:10:29.544606 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:29.545259 25228 raft_consensus.cc:2468] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 0.
I20260709 13:10:29.543413 25604 consensus_queue.cc:237] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:29.547573 25724 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:29.547765 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
W20260709 13:10:29.549170 25195 leader_election.cc:343] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.545123 25422 raft_consensus.cc:359] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:29.550351 25422 raft_consensus.cc:385] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.546976 25271 leader_election.cc:304] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:10:29.550635 25422 raft_consensus.cc:740] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.550066 25419 raft_consensus.cc:359] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:29.551476 25419 raft_consensus.cc:385] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.551738 25419 raft_consensus.cc:740] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.554512 25487 raft_consensus.cc:2804] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:29.554915 25487 raft_consensus.cc:493] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.555269 25487 raft_consensus.cc:3060] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.562342 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:29.528151 25730 consensus_queue.cc:237] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:29.581444 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:10:29.607121 25422 consensus_queue.cc:260] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:29.612939 25421 tablet_bootstrap.cc:492] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce: No bootstrap required, opened a new log
I20260709 13:10:29.615096 25530 raft_consensus.cc:2749] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:29.613623 25421 ts_tablet_manager.cc:1403] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce: Time spent bootstrapping tablet: real 0.459s	user 0.016s	sys 0.046s
W20260709 13:10:29.629428 25714 log.cc:927] Time spent T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.056s	user 0.008s	sys 0.010s
I20260709 13:10:29.650828 25422 ts_tablet_manager.cc:1434] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19: Time spent starting tablet: real 0.123s	user 0.006s	sys 0.003s
I20260709 13:10:29.651904 25422 tablet_bootstrap.cc:492] T 67fb9a2520c542d38f72828988ddc804 P da445ce82dc4467f95f4fa52297eaa19: Bootstrap starting.
W20260709 13:10:29.653255 25738 log.cc:927] Time spent T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.129s	user 0.001s	sys 0.005s
I20260709 13:10:29.622413 25487 raft_consensus.cc:515] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:29.657218 25487 leader_election.cc:290] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:29.658883 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:10:29.660986 25421 raft_consensus.cc:359] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:29.661794 25421 raft_consensus.cc:385] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.666301 25421 raft_consensus.cc:740] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.662499 25419 consensus_queue.cc:260] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:29.667223 25376 raft_consensus.cc:2468] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 0.
I20260709 13:10:29.665364 25726 raft_consensus.cc:2749] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:29.675824 25419 ts_tablet_manager.cc:1434] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468: Time spent starting tablet: real 0.162s	user 0.017s	sys 0.032s
I20260709 13:10:29.677273 25419 tablet_bootstrap.cc:492] T c279dfc4b0d248a4a884e78a33fd437c P 79d99c0e498349bda74127365219e468: Bootstrap starting.
I20260709 13:10:29.686937 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:10:29.687642 25224 raft_consensus.cc:3060] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.692265 25421 consensus_queue.cc:260] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:29.714514 25421 ts_tablet_manager.cc:1434] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce: Time spent starting tablet: real 0.096s	user 0.007s	sys 0.001s
I20260709 13:10:29.715682 25421 tablet_bootstrap.cc:492] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce: Bootstrap starting.
I20260709 13:10:29.722604 25302 raft_consensus.cc:2468] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 1.
I20260709 13:10:29.730657 25194 leader_election.cc:304] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:10:29.735770 25724 raft_consensus.cc:2804] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:29.738961 25422 tablet_bootstrap.cc:654] T 67fb9a2520c542d38f72828988ddc804 P da445ce82dc4467f95f4fa52297eaa19: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.743068 25724 raft_consensus.cc:697] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:10:29.745401 25224 raft_consensus.cc:2468] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 1.
I20260709 13:10:29.746363 25724 consensus_queue.cc:237] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:29.749178 25271 leader_election.cc:304] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:10:29.753721 25726 raft_consensus.cc:2804] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:29.754671 25127 catalog_manager.cc:5697] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 1 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:29.755715 25726 raft_consensus.cc:697] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:10:29.756479 25127 catalog_manager.cc:5697] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 1 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:29.757257 25419 tablet_bootstrap.cc:654] T c279dfc4b0d248a4a884e78a33fd437c P 79d99c0e498349bda74127365219e468: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.756691 25726 consensus_queue.cc:237] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:29.784960 25421 tablet_bootstrap.cc:654] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.809681 25126 catalog_manager.cc:5697] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 1 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:29.814657 25422 tablet_bootstrap.cc:492] T 67fb9a2520c542d38f72828988ddc804 P da445ce82dc4467f95f4fa52297eaa19: No bootstrap required, opened a new log
I20260709 13:10:29.824023 25422 ts_tablet_manager.cc:1403] T 67fb9a2520c542d38f72828988ddc804 P da445ce82dc4467f95f4fa52297eaa19: Time spent bootstrapping tablet: real 0.172s	user 0.019s	sys 0.004s
I20260709 13:10:29.826411 25422 raft_consensus.cc:359] T 67fb9a2520c542d38f72828988ddc804 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:29.827041 25422 raft_consensus.cc:385] T 67fb9a2520c542d38f72828988ddc804 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.827306 25422 raft_consensus.cc:740] T 67fb9a2520c542d38f72828988ddc804 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.827963 25422 consensus_queue.cc:260] T 67fb9a2520c542d38f72828988ddc804 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:29.829602 25422 ts_tablet_manager.cc:1434] T 67fb9a2520c542d38f72828988ddc804 P da445ce82dc4467f95f4fa52297eaa19: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
I20260709 13:10:29.830818 25422 tablet_bootstrap.cc:492] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19: Bootstrap starting.
I20260709 13:10:29.833757 25421 tablet_bootstrap.cc:492] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce: No bootstrap required, opened a new log
I20260709 13:10:29.834235 25421 ts_tablet_manager.cc:1403] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce: Time spent bootstrapping tablet: real 0.119s	user 0.012s	sys 0.013s
I20260709 13:10:29.837200 25487 consensus_queue.cc:1048] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:29.837081 25421 raft_consensus.cc:359] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:29.838006 25421 raft_consensus.cc:385] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.838291 25421 raft_consensus.cc:740] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.839455 25419 tablet_bootstrap.cc:492] T c279dfc4b0d248a4a884e78a33fd437c P 79d99c0e498349bda74127365219e468: No bootstrap required, opened a new log
I20260709 13:10:29.839956 25419 ts_tablet_manager.cc:1403] T c279dfc4b0d248a4a884e78a33fd437c P 79d99c0e498349bda74127365219e468: Time spent bootstrapping tablet: real 0.163s	user 0.013s	sys 0.003s
I20260709 13:10:29.842283 25419 raft_consensus.cc:359] T c279dfc4b0d248a4a884e78a33fd437c P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:29.843006 25419 raft_consensus.cc:385] T c279dfc4b0d248a4a884e78a33fd437c P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.843307 25419 raft_consensus.cc:740] T c279dfc4b0d248a4a884e78a33fd437c P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Initialized, Role: FOLLOWER
W20260709 13:10:29.843515 25175 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:29.843997 25419 consensus_queue.cc:260] T c279dfc4b0d248a4a884e78a33fd437c P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:29.839109 25421 consensus_queue.cc:260] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:29.847620 25421 ts_tablet_manager.cc:1434] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.001s
I20260709 13:10:29.847911 25422 tablet_bootstrap.cc:654] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.851182 25421 tablet_bootstrap.cc:492] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce: Bootstrap starting.
I20260709 13:10:29.853701 25549 consensus_queue.cc:1048] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:29.853658 25127 catalog_manager.cc:5697] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 0 to 1, leader changed from <none> to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 1 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:29.861377 25421 tablet_bootstrap.cc:654] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.872715 25421 tablet_bootstrap.cc:492] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce: No bootstrap required, opened a new log
I20260709 13:10:29.873150 25421 ts_tablet_manager.cc:1403] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.000s
I20260709 13:10:29.875598 25421 raft_consensus.cc:359] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:29.876242 25421 raft_consensus.cc:385] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.876508 25421 raft_consensus.cc:740] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.877090 25421 consensus_queue.cc:260] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:29.881913 25419 ts_tablet_manager.cc:1434] T c279dfc4b0d248a4a884e78a33fd437c P 79d99c0e498349bda74127365219e468: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.000s
I20260709 13:10:29.882920 25419 tablet_bootstrap.cc:492] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468: Bootstrap starting.
I20260709 13:10:29.886569 25421 ts_tablet_manager.cc:1434] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.002s
I20260709 13:10:29.887603 25421 tablet_bootstrap.cc:492] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce: Bootstrap starting.
I20260709 13:10:29.893258 25421 tablet_bootstrap.cc:654] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.894804 25422 tablet_bootstrap.cc:492] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19: No bootstrap required, opened a new log
I20260709 13:10:29.895277 25422 ts_tablet_manager.cc:1403] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19: Time spent bootstrapping tablet: real 0.065s	user 0.013s	sys 0.011s
I20260709 13:10:29.897957 25422 raft_consensus.cc:359] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:29.898592 25422 raft_consensus.cc:385] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.898845 25422 raft_consensus.cc:740] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.899464 25422 consensus_queue.cc:260] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:29.901470 25422 ts_tablet_manager.cc:1434] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.001s
I20260709 13:10:29.905105 25422 tablet_bootstrap.cc:492] T a1eeb9f9696c44b9b744d926cf3312ff P da445ce82dc4467f95f4fa52297eaa19: Bootstrap starting.
I20260709 13:10:29.907640 25419 tablet_bootstrap.cc:654] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.911370 25422 tablet_bootstrap.cc:654] T a1eeb9f9696c44b9b744d926cf3312ff P da445ce82dc4467f95f4fa52297eaa19: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.920066 25421 tablet_bootstrap.cc:492] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce: No bootstrap required, opened a new log
I20260709 13:10:29.920459 25421 ts_tablet_manager.cc:1403] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce: Time spent bootstrapping tablet: real 0.033s	user 0.008s	sys 0.005s
I20260709 13:10:29.924999 25422 tablet_bootstrap.cc:492] T a1eeb9f9696c44b9b744d926cf3312ff P da445ce82dc4467f95f4fa52297eaa19: No bootstrap required, opened a new log
I20260709 13:10:29.925443 25422 ts_tablet_manager.cc:1403] T a1eeb9f9696c44b9b744d926cf3312ff P da445ce82dc4467f95f4fa52297eaa19: Time spent bootstrapping tablet: real 0.021s	user 0.003s	sys 0.008s
I20260709 13:10:29.928139 25419 tablet_bootstrap.cc:492] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468: No bootstrap required, opened a new log
I20260709 13:10:29.928586 25419 ts_tablet_manager.cc:1403] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468: Time spent bootstrapping tablet: real 0.046s	user 0.012s	sys 0.007s
I20260709 13:10:29.928476 25421 raft_consensus.cc:359] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:29.929199 25421 raft_consensus.cc:385] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.929440 25421 raft_consensus.cc:740] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.930140 25421 consensus_queue.cc:260] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:29.931191 25419 raft_consensus.cc:359] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:29.931790 25419 raft_consensus.cc:385] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.932029 25419 raft_consensus.cc:740] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.932302 25421 ts_tablet_manager.cc:1434] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:10:29.932644 25419 consensus_queue.cc:260] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:29.933383 25421 tablet_bootstrap.cc:492] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce: Bootstrap starting.
I20260709 13:10:29.935573 25419 ts_tablet_manager.cc:1434] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:10:29.938370 25419 tablet_bootstrap.cc:492] T ea5abc7f78c6412885cf5a12e2a9ee6c P 79d99c0e498349bda74127365219e468: Bootstrap starting.
I20260709 13:10:29.940902 25422 raft_consensus.cc:359] T a1eeb9f9696c44b9b744d926cf3312ff P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:29.941592 25422 raft_consensus.cc:385] T a1eeb9f9696c44b9b744d926cf3312ff P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.941934 25422 raft_consensus.cc:740] T a1eeb9f9696c44b9b744d926cf3312ff P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.942592 25422 consensus_queue.cc:260] T a1eeb9f9696c44b9b744d926cf3312ff P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:29.944700 25422 ts_tablet_manager.cc:1434] T a1eeb9f9696c44b9b744d926cf3312ff P da445ce82dc4467f95f4fa52297eaa19: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:10:29.945421 25421 tablet_bootstrap.cc:654] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.945870 25422 tablet_bootstrap.cc:492] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19: Bootstrap starting.
I20260709 13:10:29.953922 25422 tablet_bootstrap.cc:654] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.960916 25228 raft_consensus.cc:3060] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.964207 25421 tablet_bootstrap.cc:492] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce: No bootstrap required, opened a new log
I20260709 13:10:29.964422 25422 tablet_bootstrap.cc:492] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19: No bootstrap required, opened a new log
I20260709 13:10:29.964686 25421 ts_tablet_manager.cc:1403] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.005s
I20260709 13:10:29.964800 25422 ts_tablet_manager.cc:1403] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.008s
I20260709 13:10:29.967331 25421 raft_consensus.cc:359] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:29.968091 25421 raft_consensus.cc:385] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.967481 25422 raft_consensus.cc:359] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:29.967805 25455 consensus_queue.cc:1048] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:29.968513 25421 raft_consensus.cc:740] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.968603 25422 raft_consensus.cc:385] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.968935 25422 raft_consensus.cc:740] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.969214 25421 consensus_queue.cc:260] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:29.969542 25422 consensus_queue.cc:260] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:29.971289 25421 ts_tablet_manager.cc:1434] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:10:29.975739 25421 tablet_bootstrap.cc:492] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce: Bootstrap starting.
I20260709 13:10:29.975780 25419 tablet_bootstrap.cc:654] T ea5abc7f78c6412885cf5a12e2a9ee6c P 79d99c0e498349bda74127365219e468: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.976401 25422 ts_tablet_manager.cc:1434] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:10:29.977527 25422 tablet_bootstrap.cc:492] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19: Bootstrap starting.
I20260709 13:10:29.980620 25604 raft_consensus.cc:493] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.981122 25604 raft_consensus.cc:515] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:29.981992 25421 tablet_bootstrap.cc:654] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.983335 25422 tablet_bootstrap.cc:654] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.984236 25604 leader_election.cc:290] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:29.984892 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:29.985486 25224 raft_consensus.cc:2468] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 0.
I20260709 13:10:29.986797 25345 leader_election.cc:304] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:10:29.988185 25455 raft_consensus.cc:2804] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:29.988504 25455 raft_consensus.cc:493] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.988770 25455 raft_consensus.cc:3060] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.994539 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:29.995201 25301 raft_consensus.cc:2468] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 0.
I20260709 13:10:29.995317 25421 tablet_bootstrap.cc:492] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce: No bootstrap required, opened a new log
I20260709 13:10:29.995299 25422 tablet_bootstrap.cc:492] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19: No bootstrap required, opened a new log
I20260709 13:10:29.995891 25421 ts_tablet_manager.cc:1403] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.010s
I20260709 13:10:29.996008 25422 ts_tablet_manager.cc:1403] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.001s
I20260709 13:10:29.998643 25729 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.998507 25421 raft_consensus.cc:359] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:29.999168 25421 raft_consensus.cc:385] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.999109 25729 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:29.998764 25422 raft_consensus.cc:359] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:29.999853 25422 raft_consensus.cc:385] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.000113 25422 raft_consensus.cc:740] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.000730 25422 consensus_queue.cc:260] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:30.001104 25729 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:29.999526 25421 raft_consensus.cc:740] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.002918 25422 ts_tablet_manager.cc:1434] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:10:30.003072 25421 consensus_queue.cc:260] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:30.003479 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:30.003897 25422 tablet_bootstrap.cc:492] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19: Bootstrap starting.
I20260709 13:10:30.004267 25302 raft_consensus.cc:2393] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 1: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:10:30.004918 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:30.005944 25421 ts_tablet_manager.cc:1434] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:10:30.006909 25421 tablet_bootstrap.cc:492] T e74320a7302d4cd8b705dce5d385079a P 1f539ba21487460085b837e7529a78ce: Bootstrap starting.
I20260709 13:10:30.010021 25422 tablet_bootstrap.cc:654] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.009577 25345 leader_election.cc:304] T c279dfc4b0d248a4a884e78a33fd437c P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:10:30.012576 25421 tablet_bootstrap.cc:654] T e74320a7302d4cd8b705dce5d385079a P 1f539ba21487460085b837e7529a78ce: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.013615 25731 raft_consensus.cc:3060] T c279dfc4b0d248a4a884e78a33fd437c P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.026715 25731 raft_consensus.cc:2749] T c279dfc4b0d248a4a884e78a33fd437c P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:30.033332 25422 tablet_bootstrap.cc:492] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19: No bootstrap required, opened a new log
I20260709 13:10:30.035481 25554 consensus_queue.cc:1048] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:30.048202 25228 raft_consensus.cc:3060] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.041463 25455 raft_consensus.cc:515] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:30.049275 25456 consensus_queue.cc:1048] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:30.057495 25422 ts_tablet_manager.cc:1403] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19: Time spent bootstrapping tablet: real 0.054s	user 0.013s	sys 0.016s
I20260709 13:10:30.061137 25422 raft_consensus.cc:359] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:30.062094 25422 raft_consensus.cc:385] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.062448 25422 raft_consensus.cc:740] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.063221 25422 consensus_queue.cc:260] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:30.067085 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:10:30.067639 25303 raft_consensus.cc:3060] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.067998 25455 leader_election.cc:290] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:30.069821 25422 ts_tablet_manager.cc:1434] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:10:30.070178 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:10:30.070771 25224 raft_consensus.cc:3060] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.071034 25422 tablet_bootstrap.cc:492] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19: Bootstrap starting.
I20260709 13:10:30.082376 25422 tablet_bootstrap.cc:654] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.088052 25303 raft_consensus.cc:2468] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 1.
I20260709 13:10:30.090035 25343 leader_election.cc:304] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:10:30.090741 25455 raft_consensus.cc:2804] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:30.091189 25455 raft_consensus.cc:697] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:10:30.091823 25455 consensus_queue.cc:237] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:30.090456 25604 consensus_queue.cc:1048] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:30.106868 25224 raft_consensus.cc:2468] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 1.
I20260709 13:10:30.109225 25422 tablet_bootstrap.cc:492] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19: No bootstrap required, opened a new log
I20260709 13:10:30.109813 25422 ts_tablet_manager.cc:1403] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19: Time spent bootstrapping tablet: real 0.039s	user 0.013s	sys 0.004s
I20260709 13:10:30.118216 25422 raft_consensus.cc:359] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:30.119149 25422 raft_consensus.cc:385] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.122588 25422 raft_consensus.cc:740] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.123226 25422 consensus_queue.cc:260] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:30.125396 25421 tablet_bootstrap.cc:492] T e74320a7302d4cd8b705dce5d385079a P 1f539ba21487460085b837e7529a78ce: No bootstrap required, opened a new log
I20260709 13:10:30.111654 25128 catalog_manager.cc:5697] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 1 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:30.126488 25421 ts_tablet_manager.cc:1403] T e74320a7302d4cd8b705dce5d385079a P 1f539ba21487460085b837e7529a78ce: Time spent bootstrapping tablet: real 0.120s	user 0.033s	sys 0.057s
I20260709 13:10:30.127904 25422 ts_tablet_manager.cc:1434] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:10:30.127980 25419 tablet_bootstrap.cc:492] T ea5abc7f78c6412885cf5a12e2a9ee6c P 79d99c0e498349bda74127365219e468: No bootstrap required, opened a new log
I20260709 13:10:30.129914 25419 ts_tablet_manager.cc:1403] T ea5abc7f78c6412885cf5a12e2a9ee6c P 79d99c0e498349bda74127365219e468: Time spent bootstrapping tablet: real 0.192s	user 0.006s	sys 0.007s
I20260709 13:10:30.130681 25422 tablet_bootstrap.cc:492] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19: Bootstrap starting.
I20260709 13:10:30.133116 25421 raft_consensus.cc:359] T e74320a7302d4cd8b705dce5d385079a P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:30.133857 25421 raft_consensus.cc:385] T e74320a7302d4cd8b705dce5d385079a P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.134384 25419 raft_consensus.cc:359] T ea5abc7f78c6412885cf5a12e2a9ee6c P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:30.134745 25723 raft_consensus.cc:493] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.135154 25419 raft_consensus.cc:385] T ea5abc7f78c6412885cf5a12e2a9ee6c P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.135375 25723 raft_consensus.cc:515] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:30.135442 25419 raft_consensus.cc:740] T ea5abc7f78c6412885cf5a12e2a9ee6c P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.139015 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:30.139580 25723 leader_election.cc:290] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:30.139696 25301 raft_consensus.cc:2468] T 67fb9a2520c542d38f72828988ddc804 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 0.
I20260709 13:10:30.140640 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:30.140856 25194 leader_election.cc:304] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:10:30.141661 25723 raft_consensus.cc:2804] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:30.142004 25723 raft_consensus.cc:493] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:30.142642 25195 leader_election.cc:343] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:30.142843 25422 tablet_bootstrap.cc:654] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.142318 25723 raft_consensus.cc:3060] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.142292 25419 consensus_queue.cc:260] T ea5abc7f78c6412885cf5a12e2a9ee6c P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:30.145141 25419 ts_tablet_manager.cc:1434] T ea5abc7f78c6412885cf5a12e2a9ee6c P 79d99c0e498349bda74127365219e468: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:10:30.148797 25726 raft_consensus.cc:493] T a1eeb9f9696c44b9b744d926cf3312ff P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.149235 25726 raft_consensus.cc:515] T a1eeb9f9696c44b9b744d926cf3312ff P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:30.151858 25726 leader_election.cc:290] T a1eeb9f9696c44b9b744d926cf3312ff P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:30.134137 25421 raft_consensus.cc:740] T e74320a7302d4cd8b705dce5d385079a P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.156673 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:30.166580 25723 raft_consensus.cc:515] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:30.161388 25724 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.167675 25724 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:30.171208 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:30.153650 25421 consensus_queue.cc:260] T e74320a7302d4cd8b705dce5d385079a P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:10:30.167107 25271 leader_election.cc:343] T a1eeb9f9696c44b9b744d926cf3312ff P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:30.160334 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:30.170166 25724 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:30.174912 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:10:30.176776 25195 leader_election.cc:343] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:30.175875 25419 tablet_bootstrap.cc:492] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468: Bootstrap starting.
I20260709 13:10:30.179680 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:10:30.180074 25421 ts_tablet_manager.cc:1434] T e74320a7302d4cd8b705dce5d385079a P 1f539ba21487460085b837e7529a78ce: Time spent starting tablet: real 0.053s	user 0.003s	sys 0.003s
I20260709 13:10:30.206434 25303 raft_consensus.cc:3060] T 67fb9a2520c542d38f72828988ddc804 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.207135 25421 tablet_bootstrap.cc:492] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce: Bootstrap starting.
I20260709 13:10:30.172998 25377 raft_consensus.cc:2468] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 0.
I20260709 13:10:30.187176 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
W20260709 13:10:30.210834 25195 leader_election.cc:343] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:30.210870 25270 leader_election.cc:304] T a1eeb9f9696c44b9b744d926cf3312ff P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:10:30.188176 25723 leader_election.cc:290] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:30.212062 25549 raft_consensus.cc:2804] T a1eeb9f9696c44b9b744d926cf3312ff P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:30.212445 25549 raft_consensus.cc:493] T a1eeb9f9696c44b9b744d926cf3312ff P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.212791 25549 raft_consensus.cc:3060] T a1eeb9f9696c44b9b744d926cf3312ff P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.190428 25422 tablet_bootstrap.cc:492] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19: No bootstrap required, opened a new log
I20260709 13:10:30.213567 25422 ts_tablet_manager.cc:1403] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19: Time spent bootstrapping tablet: real 0.083s	user 0.003s	sys 0.018s
I20260709 13:10:30.177392 25301 raft_consensus.cc:2468] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 0.
I20260709 13:10:30.218670 25194 leader_election.cc:304] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:10:30.222666 25722 raft_consensus.cc:2804] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:30.223079 25722 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.223511 25722 raft_consensus.cc:3060] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.237558 25722 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:30.240595 25722 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:30.254981 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:10:30.255674 25301 raft_consensus.cc:3060] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.257365 25376 raft_consensus.cc:3060] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.258044 25303 raft_consensus.cc:2468] T 67fb9a2520c542d38f72828988ddc804 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 1.
I20260709 13:10:30.256352 25549 raft_consensus.cc:515] T a1eeb9f9696c44b9b744d926cf3312ff P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:30.255170 25487 raft_consensus.cc:493] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.260175 25487 raft_consensus.cc:515] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:30.259430 25422 raft_consensus.cc:359] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:30.261570 25422 raft_consensus.cc:385] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.261983 25549 leader_election.cc:290] T a1eeb9f9696c44b9b744d926cf3312ff P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:30.261909 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:10:30.262595 25379 raft_consensus.cc:3060] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.263525 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:10:30.261894 25422 raft_consensus.cc:740] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.264789 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:30.265408 25377 raft_consensus.cc:2468] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 0.
I20260709 13:10:30.254417 25725 raft_consensus.cc:493] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.266383 25270 leader_election.cc:304] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:10:30.267196 25726 raft_consensus.cc:2804] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:30.267563 25726 raft_consensus.cc:493] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.267942 25726 raft_consensus.cc:3060] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:30.268141 25195 leader_election.cc:343] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:30.273023 25422 consensus_queue.cc:260] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:30.274001 25421 tablet_bootstrap.cc:654] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.274134 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:30.274878 25229 raft_consensus.cc:2468] T e74320a7302d4cd8b705dce5d385079a P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 0.
I20260709 13:10:30.275476 25194 leader_election.cc:304] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:10:30.276212 25549 consensus_queue.cc:1048] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:30.263185 25487 leader_election.cc:290] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:30.266453 25725 raft_consensus.cc:515] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:30.282199 25455 raft_consensus.cc:493] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.283365 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:10:30.287387 25455 raft_consensus.cc:515] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:30.291554 25455 leader_election.cc:290] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:30.294890 25422 ts_tablet_manager.cc:1434] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19: Time spent starting tablet: real 0.081s	user 0.002s	sys 0.012s
I20260709 13:10:30.296188 25530 consensus_queue.cc:1048] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:30.300453 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:30.286671 25724 raft_consensus.cc:2804] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:30.303228 25722 raft_consensus.cc:493] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.303426 25724 raft_consensus.cc:697] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:10:30.303813 25722 raft_consensus.cc:515] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:30.304450 25724 consensus_queue.cc:237] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:30.304268 25725 leader_election.cc:290] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:30.308177 25419 tablet_bootstrap.cc:654] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.310515 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:30.311319 25377 raft_consensus.cc:2468] T ea5abc7f78c6412885cf5a12e2a9ee6c P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 0.
W20260709 13:10:30.313205 25345 leader_election.cc:343] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:30.314131 25270 leader_election.cc:304] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:10:30.323753 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 47076.5us
W20260709 13:10:30.325785 25271 leader_election.cc:343] T a1eeb9f9696c44b9b744d926cf3312ff P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:30.326517 25379 raft_consensus.cc:2468] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 1.
I20260709 13:10:30.327509 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:30.330075 25227 raft_consensus.cc:2468] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 0.
I20260709 13:10:30.328400 25301 raft_consensus.cc:2468] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 1.
I20260709 13:10:30.329177 25722 leader_election.cc:290] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:30.329319 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:30.332620 25270 leader_election.cc:304] T a1eeb9f9696c44b9b744d926cf3312ff P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:10:30.320163 25725 raft_consensus.cc:2804] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:30.347796 25422 tablet_bootstrap.cc:492] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19: Bootstrap starting.
I20260709 13:10:30.350941 25377 raft_consensus.cc:2468] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 0.
I20260709 13:10:30.352815 25195 leader_election.cc:304] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:10:30.347774 25725 raft_consensus.cc:493] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.338002 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:30.354957 25530 raft_consensus.cc:2804] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:30.357264 25530 raft_consensus.cc:493] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.357595 25530 raft_consensus.cc:3060] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.354749 25725 raft_consensus.cc:3060] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.361217 25488 raft_consensus.cc:2804] T a1eeb9f9696c44b9b744d926cf3312ff P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:30.363392 25303 raft_consensus.cc:2468] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 0.
I20260709 13:10:30.364022 25488 raft_consensus.cc:697] T a1eeb9f9696c44b9b744d926cf3312ff P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:10:30.365662 25421 tablet_bootstrap.cc:492] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce: No bootstrap required, opened a new log
I20260709 13:10:30.365186 25488 consensus_queue.cc:237] T a1eeb9f9696c44b9b744d926cf3312ff P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:30.366164 25421 ts_tablet_manager.cc:1403] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce: Time spent bootstrapping tablet: real 0.159s	user 0.021s	sys 0.006s
I20260709 13:10:30.375284 25194 leader_election.cc:304] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:10:30.337630 25726 raft_consensus.cc:515] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:30.385965 25723 raft_consensus.cc:2804] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:30.377130 25530 raft_consensus.cc:515] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:30.406455 25530 leader_election.cc:290] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:30.409853 25726 leader_election.cc:290] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:30.412875 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:10:30.413517 25378 raft_consensus.cc:3060] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.407095 25421 raft_consensus.cc:359] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:30.407315 25725 raft_consensus.cc:515] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:30.417809 25421 raft_consensus.cc:385] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.419373 25421 raft_consensus.cc:740] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.421627 25421 consensus_queue.cc:260] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:30.393852 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:30.427361 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:10:30.427498 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:10:30.427961 25305 raft_consensus.cc:3060] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.428915 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:10:30.429448 25227 raft_consensus.cc:3060] T e74320a7302d4cd8b705dce5d385079a P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.428035 25379 raft_consensus.cc:3060] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.432477 25421 ts_tablet_manager.cc:1434] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.000s
I20260709 13:10:30.399668 25722 consensus_queue.cc:1048] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.033s
I20260709 13:10:30.426142 25723 raft_consensus.cc:697] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
W20260709 13:10:30.442162 25343 leader_election.cc:343] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:30.442603 25343 leader_election.cc:304] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:10:30.448765 25421 tablet_bootstrap.cc:492] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce: Bootstrap starting.
I20260709 13:10:30.449556 25723 consensus_queue.cc:237] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:30.452160 25422 tablet_bootstrap.cc:654] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.458459 25378 raft_consensus.cc:2468] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 1.
I20260709 13:10:30.462898 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:10:30.463508 25378 raft_consensus.cc:3060] T ea5abc7f78c6412885cf5a12e2a9ee6c P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.463716 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:10:30.464285 25226 raft_consensus.cc:3060] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.461581 25126 catalog_manager.cc:5697] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 1 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:30.447608 25729 raft_consensus.cc:2749] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:30.446835 25726 consensus_queue.cc:1048] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 13:10:30.459822 25195 leader_election.cc:304] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:10:30.477619 25722 raft_consensus.cc:2804] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:30.478125 25722 raft_consensus.cc:697] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:10:30.478549 25379 raft_consensus.cc:2468] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 1.
I20260709 13:10:30.478920 25722 consensus_queue.cc:237] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:30.480129 25270 leader_election.cc:304] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:10:30.459232 25725 leader_election.cc:290] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:30.484673 25488 raft_consensus.cc:2804] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:30.487088 25488 raft_consensus.cc:697] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:10:30.487726 25488 consensus_queue.cc:237] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:30.488241 25305 raft_consensus.cc:2468] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 1.
I20260709 13:10:30.495471 25127 catalog_manager.cc:5697] T a1eeb9f9696c44b9b744d926cf3312ff P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 0 to 1, leader changed from <none> to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 1 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:30.497434 25419 tablet_bootstrap.cc:492] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468: No bootstrap required, opened a new log
I20260709 13:10:30.498092 25419 ts_tablet_manager.cc:1403] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468: Time spent bootstrapping tablet: real 0.352s	user 0.026s	sys 0.030s
I20260709 13:10:30.510540 25226 raft_consensus.cc:2468] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 1.
I20260709 13:10:30.512319 25271 leader_election.cc:304] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:10:30.513324 25783 log.cc:927] Time spent T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:10:30.513928 25549 raft_consensus.cc:2804] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:30.515283 25549 raft_consensus.cc:697] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:10:30.518436 25549 consensus_queue.cc:237] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:30.520566 25421 tablet_bootstrap.cc:654] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.534941 25727 raft_consensus.cc:493] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.535488 25727 raft_consensus.cc:515] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:30.542222 25227 raft_consensus.cc:2468] T e74320a7302d4cd8b705dce5d385079a P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 1.
I20260709 13:10:30.550480 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:30.550187 25419 raft_consensus.cc:359] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:30.553005 25419 raft_consensus.cc:385] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.553296 25419 raft_consensus.cc:740] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.554134 25419 consensus_queue.cc:260] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:10:30.557935 25270 leader_election.cc:343] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:30.549499 25378 raft_consensus.cc:2468] T ea5abc7f78c6412885cf5a12e2a9ee6c P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 1.
I20260709 13:10:30.549106 25727 leader_election.cc:290] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:30.558914 25722 raft_consensus.cc:493] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.561721 25722 raft_consensus.cc:515] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:30.565340 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:30.566730 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:30.578578 25303 raft_consensus.cc:2468] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 0.
I20260709 13:10:30.564503 25419 ts_tablet_manager.cc:1434] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468: Time spent starting tablet: real 0.066s	user 0.010s	sys 0.000s
I20260709 13:10:30.583017 25419 tablet_bootstrap.cc:492] T 135bcb58ad5b4506a12d94ef2b0d824c P 79d99c0e498349bda74127365219e468: Bootstrap starting.
W20260709 13:10:30.583655 25195 leader_election.cc:343] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:30.564790 25722 leader_election.cc:290] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:30.588536 25194 leader_election.cc:304] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:10:30.593094 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:30.593947 25729 consensus_queue.cc:1048] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:10:30.599756 25271 leader_election.cc:343] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:30.604414 25271 leader_election.cc:304] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:10:30.597259 25742 raft_consensus.cc:2804] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:30.614147 25455 consensus_queue.cc:1048] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:30.615646 25742 raft_consensus.cc:493] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.612475 25488 raft_consensus.cc:2749] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:30.635566 25419 tablet_bootstrap.cc:654] T 135bcb58ad5b4506a12d94ef2b0d824c P 79d99c0e498349bda74127365219e468: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.626793 25742 raft_consensus.cc:3060] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.653100 25127 catalog_manager.cc:5697] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 1 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:30.657270 25127 catalog_manager.cc:5697] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 1 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:30.668444 25422 tablet_bootstrap.cc:492] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19: No bootstrap required, opened a new log
I20260709 13:10:30.668947 25422 ts_tablet_manager.cc:1403] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19: Time spent bootstrapping tablet: real 0.350s	user 0.013s	sys 0.038s
I20260709 13:10:30.675071 25456 raft_consensus.cc:493] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.675544 25456 raft_consensus.cc:515] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:30.677603 25422 raft_consensus.cc:359] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:30.679437 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:10:30.681228 25345 leader_election.cc:343] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:30.682001 25456 leader_election.cc:290] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:30.684166 25742 raft_consensus.cc:515] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:30.678303 25422 raft_consensus.cc:385] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.686262 25422 raft_consensus.cc:740] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.685667 25126 catalog_manager.cc:5697] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 0 to 1, leader changed from <none> to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 1 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:30.687049 25422 consensus_queue.cc:260] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:30.688381 25422 ts_tablet_manager.cc:1434] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.001s
I20260709 13:10:30.689329 25422 tablet_bootstrap.cc:492] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19: Bootstrap starting.
I20260709 13:10:30.693204 25126 catalog_manager.cc:5697] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 0 to 1, leader changed from <none> to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 1 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:30.708175 25785 log.cc:927] Time spent T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:10:30.714001 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:30.715595 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
W20260709 13:10:30.718317 25195 leader_election.cc:343] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:30.718946 25742 leader_election.cc:290] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:30.720057 25726 raft_consensus.cc:493] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.720547 25726 raft_consensus.cc:515] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:30.721361 25530 consensus_queue.cc:1048] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:30.722538 25726 leader_election.cc:290] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:30.724727 25421 tablet_bootstrap.cc:492] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce: No bootstrap required, opened a new log
I20260709 13:10:30.725452 25421 ts_tablet_manager.cc:1403] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce: Time spent bootstrapping tablet: real 0.284s	user 0.014s	sys 0.007s
W20260709 13:10:30.725615 25343 leader_election.cc:343] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:30.726033 25343 leader_election.cc:304] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:10:30.727864 25729 raft_consensus.cc:2749] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:30.728313 25419 tablet_bootstrap.cc:492] T 135bcb58ad5b4506a12d94ef2b0d824c P 79d99c0e498349bda74127365219e468: No bootstrap required, opened a new log
I20260709 13:10:30.728732 25419 ts_tablet_manager.cc:1403] T 135bcb58ad5b4506a12d94ef2b0d824c P 79d99c0e498349bda74127365219e468: Time spent bootstrapping tablet: real 0.146s	user 0.006s	sys 0.009s
I20260709 13:10:30.730588 25421 raft_consensus.cc:359] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:30.731235 25421 raft_consensus.cc:385] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.731510 25421 raft_consensus.cc:740] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.731547 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:30.732287 25378 raft_consensus.cc:2468] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 0.
I20260709 13:10:30.724359 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:10:30.733971 25270 leader_election.cc:304] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:10:30.739354 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:30.740566 25727 raft_consensus.cc:2804] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:30.740981 25727 raft_consensus.cc:493] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.741394 25727 raft_consensus.cc:3060] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:30.740630 25271 leader_election.cc:343] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:30.738111 25421 consensus_queue.cc:260] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:30.741040 25305 raft_consensus.cc:3060] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.755193 25727 raft_consensus.cc:515] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:30.759642 25421 ts_tablet_manager.cc:1434] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.000s
I20260709 13:10:30.762713 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:10:30.763535 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:10:30.764113 25378 raft_consensus.cc:3060] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.781196 25421 tablet_bootstrap.cc:492] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce: Bootstrap starting.
I20260709 13:10:30.760530 25727 leader_election.cc:290] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:10:30.791999 25271 leader_election.cc:343] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:30.779677 25419 raft_consensus.cc:359] T 135bcb58ad5b4506a12d94ef2b0d824c P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:30.793918 25419 raft_consensus.cc:385] T 135bcb58ad5b4506a12d94ef2b0d824c P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.787863 25378 raft_consensus.cc:2468] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 1.
I20260709 13:10:30.796550 25270 leader_election.cc:304] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:10:30.797555 25488 raft_consensus.cc:2804] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:30.798271 25488 raft_consensus.cc:697] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:10:30.799975 25488 consensus_queue.cc:237] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:30.803624 25422 tablet_bootstrap.cc:654] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.804924 25305 raft_consensus.cc:2468] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 1.
I20260709 13:10:30.806234 25194 leader_election.cc:304] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:10:30.810914 25421 tablet_bootstrap.cc:654] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:30.812361 25195 consensus_peers.cc:597] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce -> Peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Couldn't send request to peer 79d99c0e498349bda74127365219e468. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:30.794214 25419 raft_consensus.cc:740] T 135bcb58ad5b4506a12d94ef2b0d824c P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.813040 25781 raft_consensus.cc:2804] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:30.817611 25781 raft_consensus.cc:697] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:10:30.817765 25422 tablet_bootstrap.cc:492] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19: No bootstrap required, opened a new log
I20260709 13:10:30.818207 25422 ts_tablet_manager.cc:1403] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19: Time spent bootstrapping tablet: real 0.129s	user 0.010s	sys 0.001s
I20260709 13:10:30.818769 25781 consensus_queue.cc:237] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:30.820493 25421 tablet_bootstrap.cc:492] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce: No bootstrap required, opened a new log
I20260709 13:10:30.816953 25419 consensus_queue.cc:260] T 135bcb58ad5b4506a12d94ef2b0d824c P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:30.820652 25422 raft_consensus.cc:359] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:30.821380 25422 raft_consensus.cc:385] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.821638 25422 raft_consensus.cc:740] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.821024 25421 ts_tablet_manager.cc:1403] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce: Time spent bootstrapping tablet: real 0.045s	user 0.005s	sys 0.005s
I20260709 13:10:30.822356 25422 consensus_queue.cc:260] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:30.824898 25419 ts_tablet_manager.cc:1434] T 135bcb58ad5b4506a12d94ef2b0d824c P 79d99c0e498349bda74127365219e468: Time spent starting tablet: real 0.096s	user 0.006s	sys 0.001s
I20260709 13:10:30.824932 25422 ts_tablet_manager.cc:1434] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:10:30.826118 25422 tablet_bootstrap.cc:492] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19: Bootstrap starting.
I20260709 13:10:30.828651 25419 tablet_bootstrap.cc:492] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468: Bootstrap starting.
I20260709 13:10:30.831681 25421 raft_consensus.cc:359] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:30.832176 25421 raft_consensus.cc:385] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.832403 25421 raft_consensus.cc:740] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.833122 25422 tablet_bootstrap.cc:654] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.832923 25421 consensus_queue.cc:260] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:30.834597 25419 tablet_bootstrap.cc:654] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.838038 25126 catalog_manager.cc:5697] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 0 to 1, leader changed from <none> to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 1 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:30.845144 25224 raft_consensus.cc:3060] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.849617 25128 catalog_manager.cc:5697] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 1 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:30.853071 25421 ts_tablet_manager.cc:1434] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.000s
I20260709 13:10:30.854128 25421 tablet_bootstrap.cc:492] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce: Bootstrap starting.
I20260709 13:10:30.857002 25422 tablet_bootstrap.cc:492] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19: No bootstrap required, opened a new log
I20260709 13:10:30.857553 25422 ts_tablet_manager.cc:1403] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19: Time spent bootstrapping tablet: real 0.032s	user 0.005s	sys 0.012s
I20260709 13:10:30.859624 25419 tablet_bootstrap.cc:492] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468: No bootstrap required, opened a new log
I20260709 13:10:30.860052 25419 ts_tablet_manager.cc:1403] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.000s
I20260709 13:10:30.860250 25421 tablet_bootstrap.cc:654] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.860250 25422 raft_consensus.cc:359] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:30.861317 25422 raft_consensus.cc:385] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.861661 25422 raft_consensus.cc:740] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.862465 25422 consensus_queue.cc:260] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:30.865155 25422 ts_tablet_manager.cc:1434] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:10:30.866523 25422 tablet_bootstrap.cc:492] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19: Bootstrap starting.
I20260709 13:10:30.866628 25419 raft_consensus.cc:359] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:30.867357 25419 raft_consensus.cc:385] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.867609 25419 raft_consensus.cc:740] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.868213 25419 consensus_queue.cc:260] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:30.872092 25419 ts_tablet_manager.cc:1434] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.002s
I20260709 13:10:30.873116 25419 tablet_bootstrap.cc:492] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468: Bootstrap starting.
I20260709 13:10:30.879110 25421 tablet_bootstrap.cc:492] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce: No bootstrap required, opened a new log
I20260709 13:10:30.879626 25419 tablet_bootstrap.cc:654] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.880739 25421 ts_tablet_manager.cc:1403] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.001s
I20260709 13:10:30.882107 25422 tablet_bootstrap.cc:654] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.883486 25421 raft_consensus.cc:359] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:30.884191 25421 raft_consensus.cc:385] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.884447 25421 raft_consensus.cc:740] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.886353 25421 consensus_queue.cc:260] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:30.890376 25421 ts_tablet_manager.cc:1434] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:10:30.891510 25421 tablet_bootstrap.cc:492] T 60f74f1604ed4390892e271c77fd0f07 P 1f539ba21487460085b837e7529a78ce: Bootstrap starting.
I20260709 13:10:30.901883 25726 consensus_queue.cc:1048] T a1eeb9f9696c44b9b744d926cf3312ff P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:30.910555 25742 raft_consensus.cc:493] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.911511 25781 raft_consensus.cc:493] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.911213 25742 raft_consensus.cc:515] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:30.912002 25781 raft_consensus.cc:515] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:30.916913 25742 leader_election.cc:290] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:30.918193 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:30.918423 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:30.919239 25378 raft_consensus.cc:2468] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 1.
I20260709 13:10:30.919940 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:30.920684 25300 raft_consensus.cc:2468] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 0.
I20260709 13:10:30.920818 25195 leader_election.cc:304] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:10:30.924539 25781 leader_election.cc:290] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:30.925267 25781 raft_consensus.cc:2804] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:30.926465 25194 leader_election.cc:304] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:10:30.927479 25722 raft_consensus.cc:2804] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:30.928123 25722 raft_consensus.cc:493] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.928553 25722 raft_consensus.cc:3060] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.925680 25781 raft_consensus.cc:493] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.939848 25781 raft_consensus.cc:3060] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.927418 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:10:30.945788 25195 leader_election.cc:343] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:30.948729 25488 consensus_queue.cc:1048] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:30.962241 25488 consensus_queue.cc:1048] T a1eeb9f9696c44b9b744d926cf3312ff P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:30.964378 25742 consensus_queue.cc:1048] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:30.990513 25549 consensus_queue.cc:1048] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:30.994201 25549 consensus_queue.cc:1048] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:30.995224 25722 raft_consensus.cc:515] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:30.999361 25422 tablet_bootstrap.cc:492] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19: No bootstrap required, opened a new log
I20260709 13:10:31.000370 25422 ts_tablet_manager.cc:1403] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19: Time spent bootstrapping tablet: real 0.134s	user 0.041s	sys 0.056s
I20260709 13:10:31.002302 25419 tablet_bootstrap.cc:492] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468: No bootstrap required, opened a new log
I20260709 13:10:31.002764 25419 ts_tablet_manager.cc:1403] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468: Time spent bootstrapping tablet: real 0.130s	user 0.014s	sys 0.034s
I20260709 13:10:31.005221 25723 consensus_queue.cc:1048] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:31.007431 25421 tablet_bootstrap.cc:654] T 60f74f1604ed4390892e271c77fd0f07 P 1f539ba21487460085b837e7529a78ce: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.082199 25781 raft_consensus.cc:515] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:31.083503 25224 raft_consensus.cc:1240] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:10:31.087066 25530 raft_consensus.cc:493] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.087555 25530 raft_consensus.cc:515] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:10:31.090961 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 64081.6us
I20260709 13:10:31.083477 25422 raft_consensus.cc:359] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:31.095329 25422 raft_consensus.cc:385] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.095669 25422 raft_consensus.cc:740] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.097783 25422 consensus_queue.cc:260] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:31.113194 25419 raft_consensus.cc:359] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:31.114059 25419 raft_consensus.cc:385] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.114401 25419 raft_consensus.cc:740] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.115229 25419 consensus_queue.cc:260] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:31.128314 25419 ts_tablet_manager.cc:1434] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468: Time spent starting tablet: real 0.125s	user 0.013s	sys 0.004s
I20260709 13:10:31.129211 25422 ts_tablet_manager.cc:1434] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19: Time spent starting tablet: real 0.128s	user 0.016s	sys 0.000s
I20260709 13:10:31.131613 25722 leader_election.cc:290] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:10:31.145304 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 53394.3us
I20260709 13:10:31.155253 25810 consensus_queue.cc:1048] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:10:31.152319 25488 raft_consensus.cc:493] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.158718 25488 raft_consensus.cc:515] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:31.161036 25488 leader_election.cc:290] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:31.161686 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:10:31.162473 25302 raft_consensus.cc:3060] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.167855 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:10:31.180469 25554 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.181123 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:31.181702 25378 raft_consensus.cc:2468] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 0.
I20260709 13:10:31.182156 25419 tablet_bootstrap.cc:492] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468: Bootstrap starting.
I20260709 13:10:31.180943 25554 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:31.184835 25726 consensus_queue.cc:1048] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:31.185174 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:31.187536 25270 leader_election.cc:304] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:10:31.188643 25487 raft_consensus.cc:493] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.189123 25487 raft_consensus.cc:515] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:31.188716 25421 tablet_bootstrap.cc:492] T 60f74f1604ed4390892e271c77fd0f07 P 1f539ba21487460085b837e7529a78ce: No bootstrap required, opened a new log
I20260709 13:10:31.189913 25530 leader_election.cc:290] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:31.190063 25421 ts_tablet_manager.cc:1403] T 60f74f1604ed4390892e271c77fd0f07 P 1f539ba21487460085b837e7529a78ce: Time spent bootstrapping tablet: real 0.299s	user 0.024s	sys 0.009s
I20260709 13:10:31.191097 25487 leader_election.cc:290] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:31.191725 25487 raft_consensus.cc:2804] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:31.192042 25487 raft_consensus.cc:493] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.192376 25487 raft_consensus.cc:3060] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.192649 25421 raft_consensus.cc:359] T 60f74f1604ed4390892e271c77fd0f07 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:31.193041 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:31.193347 25421 raft_consensus.cc:385] T 60f74f1604ed4390892e271c77fd0f07 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.193607 25305 raft_consensus.cc:2468] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 0.
I20260709 13:10:31.187230 25554 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:31.195276 25194 leader_election.cc:304] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:10:31.161361 25781 leader_election.cc:290] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:31.197664 25302 raft_consensus.cc:2468] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 1.
I20260709 13:10:31.193619 25421 raft_consensus.cc:740] T 60f74f1604ed4390892e271c77fd0f07 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.200026 25421 consensus_queue.cc:260] T 60f74f1604ed4390892e271c77fd0f07 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:31.201027 25487 raft_consensus.cc:515] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:31.201340 25723 raft_consensus.cc:2804] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:31.201776 25723 raft_consensus.cc:493] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.202042 25194 leader_election.cc:304] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:10:31.202106 25723 raft_consensus.cc:3060] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.202750 25810 raft_consensus.cc:2804] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:31.203207 25810 raft_consensus.cc:697] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:10:31.203998 25810 consensus_queue.cc:237] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:10:31.206060 25175 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:31.213958 25487 leader_election.cc:290] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:31.215804 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:31.225662 25421 ts_tablet_manager.cc:1434] T 60f74f1604ed4390892e271c77fd0f07 P 1f539ba21487460085b837e7529a78ce: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.002s
W20260709 13:10:31.218832 25270 leader_election.cc:343] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:31.227618 25456 raft_consensus.cc:493] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.228085 25456 raft_consensus.cc:515] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:31.229768 25456 leader_election.cc:290] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:31.231066 25723 raft_consensus.cc:515] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:31.233090 25723 leader_election.cc:290] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:31.246260 25488 consensus_queue.cc:1059] T a1eeb9f9696c44b9b744d926cf3312ff P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:31.219933 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:10:31.252146 25488 raft_consensus.cc:3055] T a1eeb9f9696c44b9b744d926cf3312ff P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:31.253365 25488 raft_consensus.cc:740] T a1eeb9f9696c44b9b744d926cf3312ff P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:10:31.254108 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:10:31.278739 25727 raft_consensus.cc:493] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.279268 25727 raft_consensus.cc:515] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:31.247118 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:31.282896 25488 consensus_queue.cc:260] T a1eeb9f9696c44b9b744d926cf3312ff P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:31.285137 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:31.283200 25378 raft_consensus.cc:3060] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.290228 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:10:31.292601 25488 raft_consensus.cc:3060] T a1eeb9f9696c44b9b744d926cf3312ff P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:31.315641 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:31.290742 25374 raft_consensus.cc:3060] T 135bcb58ad5b4506a12d94ef2b0d824c P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.321857 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:10:31.323624 25303 raft_consensus.cc:2393] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 1: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:10:31.327431 25549 consensus_queue.cc:1048] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:31.329351 25419 tablet_bootstrap.cc:654] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.332772 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:31.348910 25343 leader_election.cc:304] T 135bcb58ad5b4506a12d94ef2b0d824c P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:10:31.349288 25742 raft_consensus.cc:493] T 60f74f1604ed4390892e271c77fd0f07 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.349843 25742 raft_consensus.cc:515] T 60f74f1604ed4390892e271c77fd0f07 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:10:31.360626 25195 leader_election.cc:343] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:31.385998 25270 leader_election.cc:343] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:31.386827 25195 leader_election.cc:304] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:10:31.388190 25195 leader_election.cc:343] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:31.389614 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:10:31.390291 25299 raft_consensus.cc:3060] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:31.391878 25195 leader_election.cc:343] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:31.391971 25781 raft_consensus.cc:2749] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:31.419658 25731 raft_consensus.cc:2749] T 135bcb58ad5b4506a12d94ef2b0d824c P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:31.420674 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:31.412408 25742 leader_election.cc:290] T 60f74f1604ed4390892e271c77fd0f07 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:31.424175 25376 raft_consensus.cc:3060] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.427237 25421 tablet_bootstrap.cc:492] T cc7fda8ece3144099df1f442c8012dfd P 1f539ba21487460085b837e7529a78ce: Bootstrap starting.
I20260709 13:10:31.427614 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:31.427696 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:31.428274 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:10:31.428514 25225 raft_consensus.cc:2393] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 1: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:10:31.429922 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:31.430455 25229 raft_consensus.cc:3060] T 60f74f1604ed4390892e271c77fd0f07 P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.435753 25345 leader_election.cc:304] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:10:31.436638 25456 raft_consensus.cc:3060] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:31.438699 25271 leader_election.cc:343] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:31.439112 25271 leader_election.cc:304] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
W20260709 13:10:31.439819 25271 leader_election.cc:343] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:31.440385 25271 leader_election.cc:304] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:10:31.441849 25549 raft_consensus.cc:2749] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:31.445964 25727 leader_election.cc:290] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:31.451783 25456 raft_consensus.cc:2749] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:31.433051 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:31.459641 25299 raft_consensus.cc:2468] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 1.
I20260709 13:10:31.460182 25549 raft_consensus.cc:2749] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:31.461160 25194 leader_election.cc:304] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:10:31.461913 25818 raft_consensus.cc:2804] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:31.462344 25818 raft_consensus.cc:697] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:10:31.464567 25818 consensus_queue.cc:237] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:31.464941 25378 raft_consensus.cc:2468] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 1.
I20260709 13:10:31.465469 25488 consensus_queue.cc:1048] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:31.466738 25810 consensus_queue.cc:1048] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:10:31.475332 25271 leader_election.cc:343] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:31.481915 25421 tablet_bootstrap.cc:654] T cc7fda8ece3144099df1f442c8012dfd P 1f539ba21487460085b837e7529a78ce: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.486902 25419 tablet_bootstrap.cc:492] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468: No bootstrap required, opened a new log
I20260709 13:10:31.487464 25419 ts_tablet_manager.cc:1403] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468: Time spent bootstrapping tablet: real 0.307s	user 0.008s	sys 0.012s
I20260709 13:10:31.520002 25419 raft_consensus.cc:359] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:31.520723 25419 raft_consensus.cc:385] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.521009 25419 raft_consensus.cc:740] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.521626 25419 consensus_queue.cc:260] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:31.531220 25419 ts_tablet_manager.cc:1434] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.000s
I20260709 13:10:31.540359 25270 leader_election.cc:304] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:10:31.541414 25727 raft_consensus.cc:2804] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:31.541915 25727 raft_consensus.cc:697] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:10:31.542698 25727 consensus_queue.cc:237] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:31.562883 25419 tablet_bootstrap.cc:492] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468: Bootstrap starting.
I20260709 13:10:31.593993 25421 tablet_bootstrap.cc:492] T cc7fda8ece3144099df1f442c8012dfd P 1f539ba21487460085b837e7529a78ce: No bootstrap required, opened a new log
I20260709 13:10:31.603307 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:31.607997 25419 tablet_bootstrap.cc:654] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.609902 25421 ts_tablet_manager.cc:1403] T cc7fda8ece3144099df1f442c8012dfd P 1f539ba21487460085b837e7529a78ce: Time spent bootstrapping tablet: real 0.183s	user 0.017s	sys 0.044s
I20260709 13:10:31.611678 25814 consensus_queue.cc:1048] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:31.615672 25742 consensus_queue.cc:1048] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:31.617091 25421 raft_consensus.cc:359] T cc7fda8ece3144099df1f442c8012dfd P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:31.619797 25421 raft_consensus.cc:385] T cc7fda8ece3144099df1f442c8012dfd P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.620074 25421 raft_consensus.cc:740] T cc7fda8ece3144099df1f442c8012dfd P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.620750 25421 consensus_queue.cc:260] T cc7fda8ece3144099df1f442c8012dfd P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:31.623178 25421 ts_tablet_manager.cc:1434] T cc7fda8ece3144099df1f442c8012dfd P 1f539ba21487460085b837e7529a78ce: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:10:31.624351 25195 leader_election.cc:304] T 60f74f1604ed4390892e271c77fd0f07 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:10:31.625765 25814 raft_consensus.cc:2749] T 60f74f1604ed4390892e271c77fd0f07 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:31.634398 25816 raft_consensus.cc:493] T cc7fda8ece3144099df1f442c8012dfd P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.638536 25816 raft_consensus.cc:515] T cc7fda8ece3144099df1f442c8012dfd P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:31.641956 25421 tablet_bootstrap.cc:492] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce: Bootstrap starting.
I20260709 13:10:31.642968 25816 leader_election.cc:290] T cc7fda8ece3144099df1f442c8012dfd P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:31.648577 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:31.647320 25125 catalog_manager.cc:5697] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 1 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:31.656988 25125 catalog_manager.cc:5697] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 1 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:31.673588 25421 tablet_bootstrap.cc:654] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.685312 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:31.686174 25377 raft_consensus.cc:2393] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 1: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:10:31.691282 25421 tablet_bootstrap.cc:492] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce: No bootstrap required, opened a new log
I20260709 13:10:31.692010 25421 ts_tablet_manager.cc:1403] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce: Time spent bootstrapping tablet: real 0.061s	user 0.013s	sys 0.002s
I20260709 13:10:31.692318 25195 leader_election.cc:304] T cc7fda8ece3144099df1f442c8012dfd P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:10:31.693430 25781 raft_consensus.cc:3060] T cc7fda8ece3144099df1f442c8012dfd P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.703789 25814 consensus_queue.cc:1048] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:31.704262 25781 raft_consensus.cc:2749] T cc7fda8ece3144099df1f442c8012dfd P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:31.716976 25419 tablet_bootstrap.cc:492] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468: No bootstrap required, opened a new log
I20260709 13:10:31.716645 25421 raft_consensus.cc:359] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:31.717459 25419 ts_tablet_manager.cc:1403] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468: Time spent bootstrapping tablet: real 0.155s	user 0.036s	sys 0.063s
I20260709 13:10:31.717680 25421 raft_consensus.cc:385] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.717988 25421 raft_consensus.cc:740] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.718623 25421 consensus_queue.cc:260] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:31.720069 25419 raft_consensus.cc:359] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:31.720638 25421 ts_tablet_manager.cc:1434] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:10:31.720777 25419 raft_consensus.cc:385] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.721298 25419 raft_consensus.cc:740] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.722184 25419 consensus_queue.cc:260] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:31.724553 25419 ts_tablet_manager.cc:1434] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:10:31.725473 25419 tablet_bootstrap.cc:492] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 79d99c0e498349bda74127365219e468: Bootstrap starting.
W20260709 13:10:31.729936 25195 consensus_peers.cc:597] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce -> Peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Couldn't send request to peer 79d99c0e498349bda74127365219e468. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:31.731101 25419 tablet_bootstrap.cc:654] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 79d99c0e498349bda74127365219e468: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.736224 25419 tablet_bootstrap.cc:492] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 79d99c0e498349bda74127365219e468: No bootstrap required, opened a new log
I20260709 13:10:31.736649 25419 ts_tablet_manager.cc:1403] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 79d99c0e498349bda74127365219e468: Time spent bootstrapping tablet: real 0.011s	user 0.006s	sys 0.003s
I20260709 13:10:31.739086 25419 raft_consensus.cc:359] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:31.739708 25419 raft_consensus.cc:385] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.739961 25419 raft_consensus.cc:740] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.740522 25419 consensus_queue.cc:260] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:31.742327 25419 ts_tablet_manager.cc:1434] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 79d99c0e498349bda74127365219e468: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:10:31.745231 25126 catalog_manager.cc:5697] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 0 to 1, leader changed from <none> to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 1 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:31.773877 25731 raft_consensus.cc:493] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.774341 25731 raft_consensus.cc:515] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:31.776342 25731 leader_election.cc:290] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:31.777077 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:31.777411 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:31.777685 25228 raft_consensus.cc:2468] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 0.
I20260709 13:10:31.778045 25300 raft_consensus.cc:2468] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 0.
I20260709 13:10:31.779018 25343 leader_election.cc:304] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:10:31.779585 25731 raft_consensus.cc:2804] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:31.779935 25731 raft_consensus.cc:493] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.780221 25731 raft_consensus.cc:3060] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.784945 25731 raft_consensus.cc:515] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:31.786504 25731 leader_election.cc:290] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:31.787235 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:10:31.787784 25228 raft_consensus.cc:3060] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.787767 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:10:31.788503 25300 raft_consensus.cc:3060] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.793648 25228 raft_consensus.cc:2468] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 1.
I20260709 13:10:31.793990 25300 raft_consensus.cc:2468] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 1.
I20260709 13:10:31.794600 25345 leader_election.cc:304] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:10:31.795291 25731 raft_consensus.cc:2804] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:31.795672 25731 raft_consensus.cc:697] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:10:31.796409 25731 consensus_queue.cc:237] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:31.804576 25127 catalog_manager.cc:5697] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 1 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:31.865588 25405 tablet.cc:2406] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 79d99c0e498349bda74127365219e468: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:10:32.027518 25781 consensus_queue.cc:1048] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:32.041069 25375 raft_consensus.cc:3060] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:32.051276 25742 consensus_queue.cc:1048] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:32.075752 25727 consensus_queue.cc:1048] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:32.091451 25726 consensus_queue.cc:1048] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:32.153517 25790 raft_consensus.cc:493] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.153951 25790 raft_consensus.cc:515] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:32.155591 25790 leader_election.cc:290] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:32.156417 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:32.156421 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:32.158077 25345 leader_election.cc:304] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:10:32.158659 25790 raft_consensus.cc:2749] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:32.216387 25790 consensus_queue.cc:1048] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:32.245358 25846 consensus_queue.cc:1048] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:32.279838 25375 raft_consensus.cc:3060] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 79d99c0e498349bda74127365219e468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:32.478236 25847 raft_consensus.cc:493] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:10:32.478792 25847 raft_consensus.cc:515] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:32.481122 25847 leader_election.cc:290] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:32.481392 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:10:32.482206 25225 raft_consensus.cc:2393] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 2: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:10:32.482529 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:10:32.483086 25303 raft_consensus.cc:2468] T a1eeb9f9696c44b9b744d926cf3312ff P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 2.
I20260709 13:10:32.485195 25343 leader_election.cc:304] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:10:32.485960 25847 raft_consensus.cc:2804] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:32.486289 25847 raft_consensus.cc:493] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:10:32.486644 25847 raft_consensus.cc:3060] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:32.491472 25847 raft_consensus.cc:515] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:32.492913 25847 leader_election.cc:290] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:32.493711 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:10:32.493705 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:10:32.494529 25225 raft_consensus.cc:2393] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 2: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:10:32.497915 25303 raft_consensus.cc:2468] T a1eeb9f9696c44b9b744d926cf3312ff P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 2.
I20260709 13:10:32.498747 25343 leader_election.cc:304] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:10:32.499344 25847 raft_consensus.cc:2804] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:32.499722 25847 raft_consensus.cc:697] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 2 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:10:32.500444 25847 consensus_queue.cc:237] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:32.508841 25125 catalog_manager.cc:5697] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 1 to 2, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 2 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:32.916111 25225 raft_consensus.cc:1275] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:32.917270 25847 consensus_queue.cc:1048] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:32.924046 24113 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260709 13:10:32.967166 25303 raft_consensus.cc:1275] T a1eeb9f9696c44b9b744d926cf3312ff P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:10:32.972028 25859 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:32.973338 25790 consensus_queue.cc:1048] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:10:32.975734 25860 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:32.989077 25863 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:32.991153 24113 server_base.cc:1061] running on GCE node
I20260709 13:10:32.992223 24113 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:32.992466 24113 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:32.992673 24113 hybrid_clock.cc:648] HybridClock initialized: now 1783602632992657 us; error 0 us; skew 500 ppm
I20260709 13:10:32.993309 24113 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:33.000511 24113 webserver.cc:533] Webserver started at http://127.23.140.68:38171/ using document root <none> and password file <none>
I20260709 13:10:33.000988 24113 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:33.001157 24113 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:33.001506 24113 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:33.002838 24113 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602598684750-24113-0/minicluster-data/ts-3-root/instance:
uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
format_stamp: "Formatted at 2026-07-09 13:10:32 on dist-test-slave-1rs3"
I20260709 13:10:33.007617 24113 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:10:33.011852 25870 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:33.012668 24113 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:10:33.012943 24113 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602598684750-24113-0/minicluster-data/ts-3-root
uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
format_stamp: "Formatted at 2026-07-09 13:10:32 on dist-test-slave-1rs3"
I20260709 13:10:33.013242 24113 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602598684750-24113-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602598684750-24113-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602598684750-24113-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:33.041455 24113 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:33.043527 24113 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:33.046233 24113 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:33.048707 24113 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:33.048991 24113 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:33.049331 24113 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:33.049573 24113 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:33.101790 24113 rpc_server.cc:307] RPC server started. Bound to: 127.23.140.68:34085
I20260709 13:10:33.101912 25932 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.140.68:34085 every 8 connection(s)
I20260709 13:10:33.107012 24113 auto_leader_rebalancer-test.cc:384] add a tserver: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:10:33.123978 25933 heartbeater.cc:344] Connected to a master server at 127.23.140.126:37145
I20260709 13:10:33.124787 25933 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:33.125598 25933 heartbeater.cc:507] Master 127.23.140.126:37145 requested a full tablet report, sending...
I20260709 13:10:33.127417 25125 ts_manager.cc:194] Registered new tserver with Master: 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:10:33.128695 25125 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33566
I20260709 13:10:33.362164 25225 consensus_queue.cc:237] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:33.372009 25303 raft_consensus.cc:1275] T 88997763405742ee8b8e6b43d7392c1f P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:33.373481 25818 consensus_queue.cc:1048] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:33.380028 25376 raft_consensus.cc:1275] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:33.382604 25940 consensus_queue.cc:1048] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:33.386559 25855 raft_consensus.cc:2955] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:33.389147 25303 raft_consensus.cc:2955] T 88997763405742ee8b8e6b43d7392c1f P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
W20260709 13:10:33.396026 25195 consensus_peers.cc:597] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce -> Peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085): Couldn't send request to peer 6c4b021f3f9e41adb75e870a08ad88b6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 88997763405742ee8b8e6b43d7392c1f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:33.409264 25125 catalog_manager.cc:5697] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce reported cstate change: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New cstate: current_term: 1 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:33.418052 25375 raft_consensus.cc:2955] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:33.425103 25303 consensus_queue.cc:237] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:33.448228 25230 raft_consensus.cc:1275] T 87095494ab7d40b7a42f4b05732acbf5 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:33.450798 25854 consensus_queue.cc:1048] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:33.454641 25375 raft_consensus.cc:1275] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:33.457211 25854 consensus_queue.cc:1048] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:33.461764 25823 raft_consensus.cc:2955] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:33.466611 25230 raft_consensus.cc:2955] T 87095494ab7d40b7a42f4b05732acbf5 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
W20260709 13:10:33.471443 25270 consensus_peers.cc:597] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 -> Peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085): Couldn't send request to peer 6c4b021f3f9e41adb75e870a08ad88b6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 87095494ab7d40b7a42f4b05732acbf5. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:33.474370 25375 raft_consensus.cc:2955] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:33.486589 25230 consensus_queue.cc:237] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:33.481335 25126 catalog_manager.cc:5697] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New cstate: current_term: 1 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:33.499691 25376 raft_consensus.cc:1275] T c279dfc4b0d248a4a884e78a33fd437c P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:33.501978 25300 raft_consensus.cc:1275] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:33.503409 25818 consensus_queue.cc:1048] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:10:33.505241 25195 consensus_peers.cc:597] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce -> Peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085): Couldn't send request to peer 6c4b021f3f9e41adb75e870a08ad88b6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c279dfc4b0d248a4a884e78a33fd437c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:33.506397 25855 consensus_queue.cc:1048] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:33.519654 25855 raft_consensus.cc:2955] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:33.522965 25376 raft_consensus.cc:2955] T c279dfc4b0d248a4a884e78a33fd437c P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:33.521778 25300 raft_consensus.cc:2955] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:33.533176 25303 consensus_queue.cc:237] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:33.537389 25127 catalog_manager.cc:5697] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce reported cstate change: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New cstate: current_term: 1 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:33.542127 25270 consensus_peers.cc:597] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 -> Peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085): Couldn't send request to peer 6c4b021f3f9e41adb75e870a08ad88b6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7fd182e135fd4b4db8700ed3173fd000. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:33.543833 25376 raft_consensus.cc:1275] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:33.544535 25230 raft_consensus.cc:1275] T 7fd182e135fd4b4db8700ed3173fd000 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:33.545027 25854 consensus_queue.cc:1048] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:33.545866 25823 consensus_queue.cc:1048] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:33.560349 25230 raft_consensus.cc:2955] T 7fd182e135fd4b4db8700ed3173fd000 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:33.560081 25823 raft_consensus.cc:2955] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:33.569031 25376 raft_consensus.cc:2955] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:33.589972 25127 catalog_manager.cc:5697] T 7fd182e135fd4b4db8700ed3173fd000 P 1f539ba21487460085b837e7529a78ce reported cstate change: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New cstate: current_term: 1 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:33.887552 25960 ts_tablet_manager.cc:933] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6: Initiating tablet copy from peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361)
I20260709 13:10:33.890493 25960 tablet_copy_client.cc:323] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Beginning tablet copy session from remote peer at address 127.23.140.65:39361
I20260709 13:10:33.902407 25240 tablet_copy_service.cc:140] P 1f539ba21487460085b837e7529a78ce: Received BeginTabletCopySession request for tablet 88997763405742ee8b8e6b43d7392c1f from peer 6c4b021f3f9e41adb75e870a08ad88b6 ({username='slave'} at 127.0.0.1:54000)
I20260709 13:10:33.902977 25240 tablet_copy_service.cc:161] P 1f539ba21487460085b837e7529a78ce: Beginning new tablet copy session on tablet 88997763405742ee8b8e6b43d7392c1f from peer 6c4b021f3f9e41adb75e870a08ad88b6 at {username='slave'} at 127.0.0.1:54000: session id = 6c4b021f3f9e41adb75e870a08ad88b6-88997763405742ee8b8e6b43d7392c1f
I20260709 13:10:33.911749 25240 tablet_copy_source_session.cc:215] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:33.915884 25960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88997763405742ee8b8e6b43d7392c1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:33.930586 25960 tablet_copy_client.cc:806] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:33.931166 25960 tablet_copy_client.cc:670] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:33.934993 25960 tablet_copy_client.cc:538] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:33.941401 25960 tablet_bootstrap.cc:492] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap starting.
I20260709 13:10:33.950680 25964 ts_tablet_manager.cc:933] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6: Initiating tablet copy from peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:33.953482 25964 tablet_copy_client.cc:323] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Beginning tablet copy session from remote peer at address 127.23.140.66:33127
I20260709 13:10:33.963937 25960 tablet_bootstrap.cc:492] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:33.965044 25960 tablet_bootstrap.cc:492] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap complete.
I20260709 13:10:33.965693 25960 ts_tablet_manager.cc:1403] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.005s
I20260709 13:10:33.968580 25960 raft_consensus.cc:359] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:33.970959 25960 raft_consensus.cc:740] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Initialized, Role: LEARNER
I20260709 13:10:33.971596 25960 consensus_queue.cc:260] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:33.975971 25933 heartbeater.cc:499] Master 127.23.140.126:37145 was elected leader, sending a full tablet report...
I20260709 13:10:33.976507 25960 ts_tablet_manager.cc:1434] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 13:10:33.978334 25240 tablet_copy_service.cc:342] P 1f539ba21487460085b837e7529a78ce: Request end of tablet copy session 6c4b021f3f9e41adb75e870a08ad88b6-88997763405742ee8b8e6b43d7392c1f received from {username='slave'} at 127.0.0.1:54000
I20260709 13:10:33.978780 25240 tablet_copy_service.cc:434] P 1f539ba21487460085b837e7529a78ce: ending tablet copy session 6c4b021f3f9e41adb75e870a08ad88b6-88997763405742ee8b8e6b43d7392c1f on tablet 88997763405742ee8b8e6b43d7392c1f with peer 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:10:33.987661 25315 tablet_copy_service.cc:140] P da445ce82dc4467f95f4fa52297eaa19: Received BeginTabletCopySession request for tablet 87095494ab7d40b7a42f4b05732acbf5 from peer 6c4b021f3f9e41adb75e870a08ad88b6 ({username='slave'} at 127.0.0.1:46556)
I20260709 13:10:33.988222 25315 tablet_copy_service.cc:161] P da445ce82dc4467f95f4fa52297eaa19: Beginning new tablet copy session on tablet 87095494ab7d40b7a42f4b05732acbf5 from peer 6c4b021f3f9e41adb75e870a08ad88b6 at {username='slave'} at 127.0.0.1:46556: session id = 6c4b021f3f9e41adb75e870a08ad88b6-87095494ab7d40b7a42f4b05732acbf5
I20260709 13:10:33.995304 25315 tablet_copy_source_session.cc:215] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:33.997975 25964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87095494ab7d40b7a42f4b05732acbf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:34.019966 25964 tablet_copy_client.cc:806] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:34.020545 25964 tablet_copy_client.cc:670] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:34.024659 25964 tablet_copy_client.cc:538] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:34.033981 25964 tablet_bootstrap.cc:492] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap starting.
I20260709 13:10:34.051017 25960 ts_tablet_manager.cc:933] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6: Initiating tablet copy from peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361)
I20260709 13:10:34.053279 25960 tablet_copy_client.cc:323] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Beginning tablet copy session from remote peer at address 127.23.140.65:39361
I20260709 13:10:34.054935 25240 tablet_copy_service.cc:140] P 1f539ba21487460085b837e7529a78ce: Received BeginTabletCopySession request for tablet c279dfc4b0d248a4a884e78a33fd437c from peer 6c4b021f3f9e41adb75e870a08ad88b6 ({username='slave'} at 127.0.0.1:54000)
I20260709 13:10:34.055452 25240 tablet_copy_service.cc:161] P 1f539ba21487460085b837e7529a78ce: Beginning new tablet copy session on tablet c279dfc4b0d248a4a884e78a33fd437c from peer 6c4b021f3f9e41adb75e870a08ad88b6 at {username='slave'} at 127.0.0.1:54000: session id = 6c4b021f3f9e41adb75e870a08ad88b6-c279dfc4b0d248a4a884e78a33fd437c
I20260709 13:10:34.058132 25964 tablet_bootstrap.cc:492] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:34.059060 25964 tablet_bootstrap.cc:492] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap complete.
I20260709 13:10:34.059783 25964 ts_tablet_manager.cc:1403] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent bootstrapping tablet: real 0.026s	user 0.021s	sys 0.004s
I20260709 13:10:34.063573 25964 raft_consensus.cc:359] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:34.064380 25964 raft_consensus.cc:740] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Initialized, Role: LEARNER
I20260709 13:10:34.064988 25964 consensus_queue.cc:260] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:34.067134 25964 ts_tablet_manager.cc:1434] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:10:34.067854 25240 tablet_copy_source_session.cc:215] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:34.069994 25315 tablet_copy_service.cc:342] P da445ce82dc4467f95f4fa52297eaa19: Request end of tablet copy session 6c4b021f3f9e41adb75e870a08ad88b6-87095494ab7d40b7a42f4b05732acbf5 received from {username='slave'} at 127.0.0.1:46556
I20260709 13:10:34.070437 25315 tablet_copy_service.cc:434] P da445ce82dc4467f95f4fa52297eaa19: ending tablet copy session 6c4b021f3f9e41adb75e870a08ad88b6-87095494ab7d40b7a42f4b05732acbf5 on tablet 87095494ab7d40b7a42f4b05732acbf5 with peer 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:10:34.078732 25960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c279dfc4b0d248a4a884e78a33fd437c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:34.098855 25960 tablet_copy_client.cc:806] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:34.099431 25960 tablet_copy_client.cc:670] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:34.102602 25960 tablet_copy_client.cc:538] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:34.111531 25960 tablet_bootstrap.cc:492] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap starting.
I20260709 13:10:34.135304 25960 tablet_bootstrap.cc:492] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:34.136186 25960 tablet_bootstrap.cc:492] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap complete.
I20260709 13:10:34.136833 25960 ts_tablet_manager.cc:1403] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.005s
I20260709 13:10:34.139586 25960 raft_consensus.cc:359] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:34.140406 25960 raft_consensus.cc:740] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Initialized, Role: LEARNER
I20260709 13:10:34.141019 25960 consensus_queue.cc:260] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:34.143155 25960 ts_tablet_manager.cc:1434] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.007s
I20260709 13:10:34.145131 25240 tablet_copy_service.cc:342] P 1f539ba21487460085b837e7529a78ce: Request end of tablet copy session 6c4b021f3f9e41adb75e870a08ad88b6-c279dfc4b0d248a4a884e78a33fd437c received from {username='slave'} at 127.0.0.1:54000
I20260709 13:10:34.145519 25240 tablet_copy_service.cc:434] P 1f539ba21487460085b837e7529a78ce: ending tablet copy session 6c4b021f3f9e41adb75e870a08ad88b6-c279dfc4b0d248a4a884e78a33fd437c on tablet c279dfc4b0d248a4a884e78a33fd437c with peer 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:10:34.156569 25960 ts_tablet_manager.cc:933] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6: Initiating tablet copy from peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:34.157977 25960 tablet_copy_client.cc:323] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Beginning tablet copy session from remote peer at address 127.23.140.66:33127
I20260709 13:10:34.159307 25315 tablet_copy_service.cc:140] P da445ce82dc4467f95f4fa52297eaa19: Received BeginTabletCopySession request for tablet 7fd182e135fd4b4db8700ed3173fd000 from peer 6c4b021f3f9e41adb75e870a08ad88b6 ({username='slave'} at 127.0.0.1:46556)
I20260709 13:10:34.159720 25315 tablet_copy_service.cc:161] P da445ce82dc4467f95f4fa52297eaa19: Beginning new tablet copy session on tablet 7fd182e135fd4b4db8700ed3173fd000 from peer 6c4b021f3f9e41adb75e870a08ad88b6 at {username='slave'} at 127.0.0.1:46556: session id = 6c4b021f3f9e41adb75e870a08ad88b6-7fd182e135fd4b4db8700ed3173fd000
I20260709 13:10:34.167286 25315 tablet_copy_source_session.cc:215] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:34.170110 25960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fd182e135fd4b4db8700ed3173fd000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:34.184919 25960 tablet_copy_client.cc:806] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:34.185491 25960 tablet_copy_client.cc:670] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:34.189832 25960 tablet_copy_client.cc:538] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:34.196499 25960 tablet_bootstrap.cc:492] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap starting.
I20260709 13:10:34.214272 25960 tablet_bootstrap.cc:492] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:34.215029 25960 tablet_bootstrap.cc:492] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap complete.
I20260709 13:10:34.215574 25960 ts_tablet_manager.cc:1403] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 13:10:34.217703 25960 raft_consensus.cc:359] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:34.218462 25960 raft_consensus.cc:740] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Initialized, Role: LEARNER
I20260709 13:10:34.219023 25960 consensus_queue.cc:260] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:34.221642 25960 ts_tablet_manager.cc:1434] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:10:34.227481 25315 tablet_copy_service.cc:342] P da445ce82dc4467f95f4fa52297eaa19: Request end of tablet copy session 6c4b021f3f9e41adb75e870a08ad88b6-7fd182e135fd4b4db8700ed3173fd000 received from {username='slave'} at 127.0.0.1:46556
I20260709 13:10:34.227895 25315 tablet_copy_service.cc:434] P da445ce82dc4467f95f4fa52297eaa19: ending tablet copy session 6c4b021f3f9e41adb75e870a08ad88b6-7fd182e135fd4b4db8700ed3173fd000 on tablet 7fd182e135fd4b4db8700ed3173fd000 with peer 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:10:34.351776 25908 raft_consensus.cc:1217] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:34.395193 25908 raft_consensus.cc:1217] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:34.590827 25908 raft_consensus.cc:1217] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:34.599362 25908 raft_consensus.cc:1217] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:34.764861 25855 raft_consensus.cc:1064] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce: attempting to promote NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 to VOTER
I20260709 13:10:34.766888 25855 consensus_queue.cc:237] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:34.772830 25376 raft_consensus.cc:1275] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:34.772982 25908 raft_consensus.cc:1275] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:34.773944 25299 raft_consensus.cc:1275] T 88997763405742ee8b8e6b43d7392c1f P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:34.774323 25855 consensus_queue.cc:1048] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:34.775311 25969 consensus_queue.cc:1048] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:34.776103 25940 consensus_queue.cc:1048] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:34.815017 25969 raft_consensus.cc:2955] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:34.818372 25908 raft_consensus.cc:2955] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:34.826825 25375 raft_consensus.cc:2955] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:34.835218 25299 raft_consensus.cc:2955] T 88997763405742ee8b8e6b43d7392c1f P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:34.835422 25126 catalog_manager.cc:5697] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce reported cstate change: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:34.861171 25975 raft_consensus.cc:1064] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19: attempting to promote NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 to VOTER
I20260709 13:10:34.863782 25975 consensus_queue.cc:237] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:34.882371 25908 raft_consensus.cc:1275] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:34.882546 25230 raft_consensus.cc:1275] T 87095494ab7d40b7a42f4b05732acbf5 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:34.882959 25375 raft_consensus.cc:1275] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:34.883764 25975 consensus_queue.cc:1048] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:34.885740 25823 consensus_queue.cc:1048] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:34.886482 25978 consensus_queue.cc:1048] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:34.908967 25727 raft_consensus.cc:2955] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:34.910369 25375 raft_consensus.cc:2955] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:34.916713 25230 raft_consensus.cc:2955] T 87095494ab7d40b7a42f4b05732acbf5 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:34.922851 25225 consensus_queue.cc:237] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:34.932319 25128 catalog_manager.cc:5697] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:34.936314 25908 raft_consensus.cc:2955] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:34.940372 25907 raft_consensus.cc:1275] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:34.941874 25969 consensus_queue.cc:1048] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:34.948858 25940 raft_consensus.cc:2955] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:34.961560 25907 raft_consensus.cc:2955] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:34.946997 25375 raft_consensus.cc:1275] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:34.968403 25115 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 88997763405742ee8b8e6b43d7392c1f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:34.971024 25855 consensus_queue.cc:1048] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:34.971469 25299 consensus_queue.cc:237] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:34.988175 25908 raft_consensus.cc:1275] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:34.990957 25823 consensus_queue.cc:1048] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:34.993037 25375 raft_consensus.cc:1275] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:34.995400 25128 catalog_manager.cc:5697] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: config changed from index 3 to 4, VOTER da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) evicted. New cstate: current_term: 1 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:34.997359 25375 raft_consensus.cc:2955] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:34.998719 25978 consensus_queue.cc:1048] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:35.007097 25294 tablet_service.cc:1558] Processing DeleteTablet for tablet 88997763405742ee8b8e6b43d7392c1f with delete_type TABLET_DATA_TOMBSTONED (TS da445ce82dc4467f95f4fa52297eaa19 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57250
I20260709 13:10:35.008531 25823 raft_consensus.cc:2955] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1f539ba21487460085b837e7529a78ce (127.23.140.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:35.011873 25908 raft_consensus.cc:2955] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1f539ba21487460085b837e7529a78ce (127.23.140.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:35.019080 25376 raft_consensus.cc:2955] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1f539ba21487460085b837e7529a78ce (127.23.140.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:35.021034 25113 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 87095494ab7d40b7a42f4b05732acbf5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:35.025564 25992 tablet_replica.cc:333] T 88997763405742ee8b8e6b43d7392c1f P da445ce82dc4467f95f4fa52297eaa19: stopping tablet replica
I20260709 13:10:35.026808 25992 raft_consensus.cc:2243] T 88997763405742ee8b8e6b43d7392c1f P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:35.027537 25992 raft_consensus.cc:2272] T 88997763405742ee8b8e6b43d7392c1f P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:35.044771 25992 ts_tablet_manager.cc:1916] T 88997763405742ee8b8e6b43d7392c1f P da445ce82dc4467f95f4fa52297eaa19: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:35.041507 25126 catalog_manager.cc:5697] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: config changed from index 3 to 4, VOTER 1f539ba21487460085b837e7529a78ce (127.23.140.65) evicted. New cstate: current_term: 1 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:35.069514 25211 tablet_service.cc:1558] Processing DeleteTablet for tablet 87095494ab7d40b7a42f4b05732acbf5 with delete_type TABLET_DATA_TOMBSTONED (TS 1f539ba21487460085b837e7529a78ce not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58402
I20260709 13:10:35.070868 25975 raft_consensus.cc:1064] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19: attempting to promote NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 to VOTER
I20260709 13:10:35.071712 25992 ts_tablet_manager.cc:1929] T 88997763405742ee8b8e6b43d7392c1f P da445ce82dc4467f95f4fa52297eaa19: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:35.072274 25992 log.cc:1199] T 88997763405742ee8b8e6b43d7392c1f P da445ce82dc4467f95f4fa52297eaa19: Deleting WAL directory at /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602598684750-24113-0/minicluster-data/ts-1-root/wals/88997763405742ee8b8e6b43d7392c1f
I20260709 13:10:35.074469 25113 catalog_manager.cc:5028] TS da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): tablet 88997763405742ee8b8e6b43d7392c1f (table test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]) successfully deleted
I20260709 13:10:35.077080 25975 consensus_queue.cc:237] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:35.084704 25995 tablet_replica.cc:333] T 87095494ab7d40b7a42f4b05732acbf5 P 1f539ba21487460085b837e7529a78ce: stopping tablet replica
I20260709 13:10:35.085821 25995 raft_consensus.cc:2243] T 87095494ab7d40b7a42f4b05732acbf5 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:35.086603 25995 raft_consensus.cc:2272] T 87095494ab7d40b7a42f4b05732acbf5 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:35.089835 25995 ts_tablet_manager.cc:1916] T 87095494ab7d40b7a42f4b05732acbf5 P 1f539ba21487460085b837e7529a78ce: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:35.151374 25908 raft_consensus.cc:1275] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:35.152068 25375 raft_consensus.cc:1275] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:35.153098 25823 consensus_queue.cc:1048] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:35.157006 25225 raft_consensus.cc:1275] T 7fd182e135fd4b4db8700ed3173fd000 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:35.158624 25975 consensus_queue.cc:1048] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:35.162416 25823 consensus_queue.cc:1048] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:35.165328 25995 ts_tablet_manager.cc:1929] T 87095494ab7d40b7a42f4b05732acbf5 P 1f539ba21487460085b837e7529a78ce: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:35.165740 25995 log.cc:1199] T 87095494ab7d40b7a42f4b05732acbf5 P 1f539ba21487460085b837e7529a78ce: Deleting WAL directory at /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602598684750-24113-0/minicluster-data/ts-0-root/wals/87095494ab7d40b7a42f4b05732acbf5
I20260709 13:10:35.168188 25115 catalog_manager.cc:5028] TS 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): tablet 87095494ab7d40b7a42f4b05732acbf5 (table test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]) successfully deleted
I20260709 13:10:35.170527 25991 raft_consensus.cc:1064] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce: attempting to promote NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 to VOTER
I20260709 13:10:35.172941 25991 consensus_queue.cc:237] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:35.194013 25908 raft_consensus.cc:1275] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:35.194661 25299 raft_consensus.cc:1275] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:35.195355 25377 raft_consensus.cc:1275] T c279dfc4b0d248a4a884e78a33fd437c P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:35.195747 25940 consensus_queue.cc:1048] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:35.196898 25991 consensus_queue.cc:1048] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:35.219858 25940 consensus_queue.cc:1048] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:35.222924 25823 raft_consensus.cc:2955] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:35.228245 25375 raft_consensus.cc:2955] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:35.234567 25908 raft_consensus.cc:2955] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:35.246290 25125 catalog_manager.cc:5697] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:35.252243 25940 raft_consensus.cc:2955] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:35.265153 25299 raft_consensus.cc:2955] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:35.271118 25302 consensus_queue.cc:237] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:35.277242 25908 raft_consensus.cc:1275] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:35.278891 25377 raft_consensus.cc:1275] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:35.279903 25975 consensus_queue.cc:1048] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:35.280755 25377 raft_consensus.cc:2955] T c279dfc4b0d248a4a884e78a33fd437c P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:35.282675 25975 consensus_queue.cc:1048] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:35.290306 25975 raft_consensus.cc:2955] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1f539ba21487460085b837e7529a78ce (127.23.140.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:35.291786 25908 raft_consensus.cc:2955] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1f539ba21487460085b837e7529a78ce (127.23.140.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:35.296909 25128 catalog_manager.cc:5697] T c279dfc4b0d248a4a884e78a33fd437c P 79d99c0e498349bda74127365219e468 reported cstate change: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:35.304162 25113 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7fd182e135fd4b4db8700ed3173fd000 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:35.312559 25125 catalog_manager.cc:5697] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: config changed from index 3 to 4, VOTER 1f539ba21487460085b837e7529a78ce (127.23.140.65) evicted. New cstate: current_term: 1 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:35.319798 25908 raft_consensus.cc:2955] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:35.324244 25211 tablet_service.cc:1558] Processing DeleteTablet for tablet 7fd182e135fd4b4db8700ed3173fd000 with delete_type TABLET_DATA_TOMBSTONED (TS 1f539ba21487460085b837e7529a78ce not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58402
I20260709 13:10:35.325268 25229 consensus_queue.cc:237] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:35.326274 25995 tablet_replica.cc:333] T 7fd182e135fd4b4db8700ed3173fd000 P 1f539ba21487460085b837e7529a78ce: stopping tablet replica
I20260709 13:10:35.327265 25995 raft_consensus.cc:2243] T 7fd182e135fd4b4db8700ed3173fd000 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:35.327759 25995 pending_rounds.cc:70] T 7fd182e135fd4b4db8700ed3173fd000 P 1f539ba21487460085b837e7529a78ce: Trying to abort 1 pending ops.
I20260709 13:10:35.328063 25995 pending_rounds.cc:77] T 7fd182e135fd4b4db8700ed3173fd000 P 1f539ba21487460085b837e7529a78ce: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305636393254744064 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "7fd182e135fd4b4db8700ed3173fd000" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } } }
I20260709 13:10:35.331697 25995 raft_consensus.cc:2917] T 7fd182e135fd4b4db8700ed3173fd000 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 13:10:35.331799 25303 raft_consensus.cc:1275] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:35.332149 25995 raft_consensus.cc:2889] T 7fd182e135fd4b4db8700ed3173fd000 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:10:35.332572 25995 raft_consensus.cc:2272] T 7fd182e135fd4b4db8700ed3173fd000 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:35.333257 25940 consensus_queue.cc:1048] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:35.335877 25995 ts_tablet_manager.cc:1916] T 7fd182e135fd4b4db8700ed3173fd000 P 1f539ba21487460085b837e7529a78ce: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:35.331996 25377 raft_consensus.cc:2955] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1f539ba21487460085b837e7529a78ce (127.23.140.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:35.339627 25907 raft_consensus.cc:1275] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:35.340210 25969 raft_consensus.cc:2955] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79d99c0e498349bda74127365219e468 (127.23.140.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:35.342696 25991 consensus_queue.cc:1048] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:35.347469 25303 raft_consensus.cc:2955] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79d99c0e498349bda74127365219e468 (127.23.140.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:35.372738 25995 ts_tablet_manager.cc:1929] T 7fd182e135fd4b4db8700ed3173fd000 P 1f539ba21487460085b837e7529a78ce: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:35.373147 25995 log.cc:1199] T 7fd182e135fd4b4db8700ed3173fd000 P 1f539ba21487460085b837e7529a78ce: Deleting WAL directory at /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602598684750-24113-0/minicluster-data/ts-0-root/wals/7fd182e135fd4b4db8700ed3173fd000
I20260709 13:10:35.372440 25907 raft_consensus.cc:2955] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79d99c0e498349bda74127365219e468 (127.23.140.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:35.380164 25115 catalog_manager.cc:5028] TS 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): tablet 7fd182e135fd4b4db8700ed3173fd000 (table test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]) successfully deleted
I20260709 13:10:35.392426 25126 catalog_manager.cc:5697] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce reported cstate change: config changed from index 3 to 4, VOTER 79d99c0e498349bda74127365219e468 (127.23.140.67) evicted. New cstate: current_term: 1 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:35.395229 25115 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c279dfc4b0d248a4a884e78a33fd437c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:35.409436 25361 tablet_service.cc:1558] Processing DeleteTablet for tablet c279dfc4b0d248a4a884e78a33fd437c with delete_type TABLET_DATA_TOMBSTONED (TS 79d99c0e498349bda74127365219e468 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36248
I20260709 13:10:35.416535 26005 tablet_replica.cc:333] T c279dfc4b0d248a4a884e78a33fd437c P 79d99c0e498349bda74127365219e468: stopping tablet replica
I20260709 13:10:35.427157 26005 raft_consensus.cc:2243] T c279dfc4b0d248a4a884e78a33fd437c P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:35.428282 26005 raft_consensus.cc:2272] T c279dfc4b0d248a4a884e78a33fd437c P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:35.432682 26005 ts_tablet_manager.cc:1916] T c279dfc4b0d248a4a884e78a33fd437c P 79d99c0e498349bda74127365219e468: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:35.443795 26005 ts_tablet_manager.cc:1929] T c279dfc4b0d248a4a884e78a33fd437c P 79d99c0e498349bda74127365219e468: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:35.444137 26005 log.cc:1199] T c279dfc4b0d248a4a884e78a33fd437c P 79d99c0e498349bda74127365219e468: Deleting WAL directory at /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602598684750-24113-0/minicluster-data/ts-2-root/wals/c279dfc4b0d248a4a884e78a33fd437c
I20260709 13:10:35.445855 25114 catalog_manager.cc:5028] TS 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): tablet c279dfc4b0d248a4a884e78a33fd437c (table test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]) successfully deleted
I20260709 13:10:36.479885 25377 consensus_queue.cc:237] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:36.486398 25299 raft_consensus.cc:1275] T a1eeb9f9696c44b9b744d926cf3312ff P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:10:36.487540 25977 consensus_queue.cc:1048] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:36.488073 25229 raft_consensus.cc:1275] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:10:36.490180 25977 consensus_queue.cc:1048] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:36.499846 26006 raft_consensus.cc:2955] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:36.501251 25299 raft_consensus.cc:2955] T a1eeb9f9696c44b9b744d926cf3312ff P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:36.509358 25225 raft_consensus.cc:2955] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:36.518332 25125 catalog_manager.cc:5697] T a1eeb9f9696c44b9b744d926cf3312ff P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: config changed from index -1 to 3, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New cstate: current_term: 2 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:36.518783 25299 consensus_queue.cc:237] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
W20260709 13:10:36.525622 25344 consensus_peers.cc:597] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 -> Peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085): Couldn't send request to peer 6c4b021f3f9e41adb75e870a08ad88b6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a1eeb9f9696c44b9b744d926cf3312ff. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:36.535809 25229 raft_consensus.cc:1275] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:10:36.535902 25270 consensus_peers.cc:597] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 -> Peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085): Couldn't send request to peer 6c4b021f3f9e41adb75e870a08ad88b6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ea5abc7f78c6412885cf5a12e2a9ee6c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:36.536967 25375 raft_consensus.cc:1275] T ea5abc7f78c6412885cf5a12e2a9ee6c P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:36.538378 25975 consensus_queue.cc:1048] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:36.539224 25978 consensus_queue.cc:1048] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:36.547154 25978 raft_consensus.cc:2955] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:36.548727 25375 raft_consensus.cc:2955] T ea5abc7f78c6412885cf5a12e2a9ee6c P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:36.551048 25225 raft_consensus.cc:2955] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:36.568183 25375 consensus_queue.cc:237] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
W20260709 13:10:36.575906 25344 consensus_peers.cc:597] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 -> Peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085): Couldn't send request to peer 6c4b021f3f9e41adb75e870a08ad88b6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ca881f8516e046c99da202e9d9ea00a1. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:36.581610 25299 raft_consensus.cc:1275] T ca881f8516e046c99da202e9d9ea00a1 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:36.586576 25994 consensus_queue.cc:1048] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:36.579772 25128 catalog_manager.cc:5697] T ea5abc7f78c6412885cf5a12e2a9ee6c P 79d99c0e498349bda74127365219e468 reported cstate change: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New cstate: current_term: 1 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:36.593206 25225 raft_consensus.cc:1275] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:36.595460 26006 raft_consensus.cc:2955] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:36.597411 25994 consensus_queue.cc:1048] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:36.596796 25299 raft_consensus.cc:2955] T ca881f8516e046c99da202e9d9ea00a1 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:36.606688 25225 raft_consensus.cc:2955] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:36.611198 25303 consensus_queue.cc:237] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:36.619997 25128 catalog_manager.cc:5697] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 reported cstate change: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New cstate: current_term: 1 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:36.630532 25377 raft_consensus.cc:1275] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:36.631034 25225 raft_consensus.cc:1275] T f78697097cd14345b6a749c7aad4f696 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:10:36.631989 25270 consensus_peers.cc:597] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 -> Peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085): Couldn't send request to peer 6c4b021f3f9e41adb75e870a08ad88b6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f78697097cd14345b6a749c7aad4f696. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:36.633405 25975 consensus_queue.cc:1048] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:36.634322 25978 consensus_queue.cc:1048] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:36.643020 25978 raft_consensus.cc:2955] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:36.644909 25225 raft_consensus.cc:2955] T f78697097cd14345b6a749c7aad4f696 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:36.670637 25125 catalog_manager.cc:5697] T f78697097cd14345b6a749c7aad4f696 P 1f539ba21487460085b837e7529a78ce reported cstate change: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New cstate: current_term: 1 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:36.691733 25377 raft_consensus.cc:2955] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:36.888046 26031 ts_tablet_manager.cc:933] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6: Initiating tablet copy from peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:36.890297 26031 tablet_copy_client.cc:323] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Beginning tablet copy session from remote peer at address 127.23.140.67:34091
I20260709 13:10:36.905414 25389 tablet_copy_service.cc:140] P 79d99c0e498349bda74127365219e468: Received BeginTabletCopySession request for tablet a1eeb9f9696c44b9b744d926cf3312ff from peer 6c4b021f3f9e41adb75e870a08ad88b6 ({username='slave'} at 127.0.0.1:56308)
I20260709 13:10:36.905969 25389 tablet_copy_service.cc:161] P 79d99c0e498349bda74127365219e468: Beginning new tablet copy session on tablet a1eeb9f9696c44b9b744d926cf3312ff from peer 6c4b021f3f9e41adb75e870a08ad88b6 at {username='slave'} at 127.0.0.1:56308: session id = 6c4b021f3f9e41adb75e870a08ad88b6-a1eeb9f9696c44b9b744d926cf3312ff
I20260709 13:10:36.912074 25389 tablet_copy_source_session.cc:215] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:36.915568 26031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1eeb9f9696c44b9b744d926cf3312ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.927637 26031 tablet_copy_client.cc:806] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:36.928215 26031 tablet_copy_client.cc:670] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:36.932145 26031 tablet_copy_client.cc:538] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:36.933128 26034 ts_tablet_manager.cc:933] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6: Initiating tablet copy from peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:36.935164 26034 tablet_copy_client.cc:323] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Beginning tablet copy session from remote peer at address 127.23.140.66:33127
I20260709 13:10:36.936756 25315 tablet_copy_service.cc:140] P da445ce82dc4467f95f4fa52297eaa19: Received BeginTabletCopySession request for tablet ea5abc7f78c6412885cf5a12e2a9ee6c from peer 6c4b021f3f9e41adb75e870a08ad88b6 ({username='slave'} at 127.0.0.1:46556)
I20260709 13:10:36.937282 25315 tablet_copy_service.cc:161] P da445ce82dc4467f95f4fa52297eaa19: Beginning new tablet copy session on tablet ea5abc7f78c6412885cf5a12e2a9ee6c from peer 6c4b021f3f9e41adb75e870a08ad88b6 at {username='slave'} at 127.0.0.1:46556: session id = 6c4b021f3f9e41adb75e870a08ad88b6-ea5abc7f78c6412885cf5a12e2a9ee6c
I20260709 13:10:36.939670 26031 tablet_bootstrap.cc:492] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap starting.
I20260709 13:10:36.944525 25315 tablet_copy_source_session.cc:215] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:36.948043 26034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea5abc7f78c6412885cf5a12e2a9ee6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.963644 26034 tablet_copy_client.cc:806] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:36.964246 26034 tablet_copy_client.cc:670] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:36.965152 26031 tablet_bootstrap.cc:492] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:36.966037 26031 tablet_bootstrap.cc:492] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap complete.
I20260709 13:10:36.966688 26031 ts_tablet_manager.cc:1403] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent bootstrapping tablet: real 0.027s	user 0.024s	sys 0.001s
I20260709 13:10:36.968820 26034 tablet_copy_client.cc:538] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:36.969702 26031 raft_consensus.cc:359] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:36.974067 26031 raft_consensus.cc:740] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Initialized, Role: LEARNER
I20260709 13:10:36.979979 26031 consensus_queue.cc:260] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:36.973244 26037 ts_tablet_manager.cc:933] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6: Initiating tablet copy from peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:36.984473 26031 ts_tablet_manager.cc:1434] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent starting tablet: real 0.017s	user 0.011s	sys 0.000s
I20260709 13:10:36.986033 26037 tablet_copy_client.cc:323] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Beginning tablet copy session from remote peer at address 127.23.140.67:34091
I20260709 13:10:36.986104 25389 tablet_copy_service.cc:342] P 79d99c0e498349bda74127365219e468: Request end of tablet copy session 6c4b021f3f9e41adb75e870a08ad88b6-a1eeb9f9696c44b9b744d926cf3312ff received from {username='slave'} at 127.0.0.1:56308
I20260709 13:10:36.986766 25389 tablet_copy_service.cc:434] P 79d99c0e498349bda74127365219e468: ending tablet copy session 6c4b021f3f9e41adb75e870a08ad88b6-a1eeb9f9696c44b9b744d926cf3312ff on tablet a1eeb9f9696c44b9b744d926cf3312ff with peer 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:10:36.987990 25389 tablet_copy_service.cc:140] P 79d99c0e498349bda74127365219e468: Received BeginTabletCopySession request for tablet ca881f8516e046c99da202e9d9ea00a1 from peer 6c4b021f3f9e41adb75e870a08ad88b6 ({username='slave'} at 127.0.0.1:56308)
I20260709 13:10:36.988495 25389 tablet_copy_service.cc:161] P 79d99c0e498349bda74127365219e468: Beginning new tablet copy session on tablet ca881f8516e046c99da202e9d9ea00a1 from peer 6c4b021f3f9e41adb75e870a08ad88b6 at {username='slave'} at 127.0.0.1:56308: session id = 6c4b021f3f9e41adb75e870a08ad88b6-ca881f8516e046c99da202e9d9ea00a1
I20260709 13:10:36.990058 26034 tablet_bootstrap.cc:492] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap starting.
I20260709 13:10:37.001382 25389 tablet_copy_source_session.cc:215] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:37.004331 26037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca881f8516e046c99da202e9d9ea00a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.009395 26034 tablet_bootstrap.cc:492] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:37.011545 26034 tablet_bootstrap.cc:492] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap complete.
I20260709 13:10:37.015669 26034 ts_tablet_manager.cc:1403] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.004s
I20260709 13:10:37.019649 26037 tablet_copy_client.cc:806] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:37.020280 26037 tablet_copy_client.cc:670] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:37.020033 26034 raft_consensus.cc:359] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:37.024309 26034 raft_consensus.cc:740] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Initialized, Role: LEARNER
I20260709 13:10:37.025048 26034 consensus_queue.cc:260] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:37.030745 26034 ts_tablet_manager.cc:1434] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 13:10:37.031592 26037 tablet_copy_client.cc:538] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:37.035286 25315 tablet_copy_service.cc:342] P da445ce82dc4467f95f4fa52297eaa19: Request end of tablet copy session 6c4b021f3f9e41adb75e870a08ad88b6-ea5abc7f78c6412885cf5a12e2a9ee6c received from {username='slave'} at 127.0.0.1:46556
I20260709 13:10:37.035698 25315 tablet_copy_service.cc:434] P da445ce82dc4467f95f4fa52297eaa19: ending tablet copy session 6c4b021f3f9e41adb75e870a08ad88b6-ea5abc7f78c6412885cf5a12e2a9ee6c on tablet ea5abc7f78c6412885cf5a12e2a9ee6c with peer 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:10:37.040869 26037 tablet_bootstrap.cc:492] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap starting.
I20260709 13:10:37.058553 26037 tablet_bootstrap.cc:492] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:37.059729 26037 tablet_bootstrap.cc:492] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap complete.
I20260709 13:10:37.060410 26037 ts_tablet_manager.cc:1403] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent bootstrapping tablet: real 0.020s	user 0.018s	sys 0.001s
I20260709 13:10:37.063165 26037 raft_consensus.cc:359] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:37.064064 26037 raft_consensus.cc:740] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Initialized, Role: LEARNER
I20260709 13:10:37.064687 26037 consensus_queue.cc:260] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:37.066991 26037 ts_tablet_manager.cc:1434] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:10:37.068586 25389 tablet_copy_service.cc:342] P 79d99c0e498349bda74127365219e468: Request end of tablet copy session 6c4b021f3f9e41adb75e870a08ad88b6-ca881f8516e046c99da202e9d9ea00a1 received from {username='slave'} at 127.0.0.1:56308
I20260709 13:10:37.068984 25389 tablet_copy_service.cc:434] P 79d99c0e498349bda74127365219e468: ending tablet copy session 6c4b021f3f9e41adb75e870a08ad88b6-ca881f8516e046c99da202e9d9ea00a1 on tablet ca881f8516e046c99da202e9d9ea00a1 with peer 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:10:37.162622 26037 ts_tablet_manager.cc:933] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6: Initiating tablet copy from peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:37.164577 26037 tablet_copy_client.cc:323] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Beginning tablet copy session from remote peer at address 127.23.140.66:33127
I20260709 13:10:37.166218 25315 tablet_copy_service.cc:140] P da445ce82dc4467f95f4fa52297eaa19: Received BeginTabletCopySession request for tablet f78697097cd14345b6a749c7aad4f696 from peer 6c4b021f3f9e41adb75e870a08ad88b6 ({username='slave'} at 127.0.0.1:46556)
I20260709 13:10:37.166762 25315 tablet_copy_service.cc:161] P da445ce82dc4467f95f4fa52297eaa19: Beginning new tablet copy session on tablet f78697097cd14345b6a749c7aad4f696 from peer 6c4b021f3f9e41adb75e870a08ad88b6 at {username='slave'} at 127.0.0.1:46556: session id = 6c4b021f3f9e41adb75e870a08ad88b6-f78697097cd14345b6a749c7aad4f696
I20260709 13:10:37.173036 25315 tablet_copy_source_session.cc:215] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:37.175652 26037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f78697097cd14345b6a749c7aad4f696. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.197443 26037 tablet_copy_client.cc:806] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:37.198109 26037 tablet_copy_client.cc:670] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:37.201407 26037 tablet_copy_client.cc:538] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:37.208420 26037 tablet_bootstrap.cc:492] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap starting.
I20260709 13:10:37.224539 26037 tablet_bootstrap.cc:492] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:37.225189 26037 tablet_bootstrap.cc:492] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap complete.
I20260709 13:10:37.225692 26037 ts_tablet_manager.cc:1403] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.000s
I20260709 13:10:37.227859 26037 raft_consensus.cc:359] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:37.228448 26037 raft_consensus.cc:740] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Initialized, Role: LEARNER
I20260709 13:10:37.229048 26037 consensus_queue.cc:260] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:37.231312 26037 ts_tablet_manager.cc:1434] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:10:37.233335 25315 tablet_copy_service.cc:342] P da445ce82dc4467f95f4fa52297eaa19: Request end of tablet copy session 6c4b021f3f9e41adb75e870a08ad88b6-f78697097cd14345b6a749c7aad4f696 received from {username='slave'} at 127.0.0.1:46556
I20260709 13:10:37.233706 25315 tablet_copy_service.cc:434] P da445ce82dc4467f95f4fa52297eaa19: ending tablet copy session 6c4b021f3f9e41adb75e870a08ad88b6-f78697097cd14345b6a749c7aad4f696 on tablet f78697097cd14345b6a749c7aad4f696 with peer 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:10:37.320422 25907 raft_consensus.cc:1217] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:37.467398 25907 raft_consensus.cc:1217] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:10:37.572124 25907 raft_consensus.cc:1217] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:37.580870 25907 raft_consensus.cc:1217] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:37.857498 26028 raft_consensus.cc:1064] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19: attempting to promote NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 to VOTER
I20260709 13:10:37.891000 26028 consensus_queue.cc:237] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:37.910696 25227 raft_consensus.cc:1275] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:37.913240 25907 raft_consensus.cc:1275] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:37.914564 25975 consensus_queue.cc:1048] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:37.916563 25975 consensus_queue.cc:1048] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:37.935228 25377 raft_consensus.cc:1275] T ea5abc7f78c6412885cf5a12e2a9ee6c P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:37.941397 25975 consensus_queue.cc:1048] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:37.967252 26047 raft_consensus.cc:1064] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468: attempting to promote NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 to VOTER
I20260709 13:10:37.970806 26047 consensus_queue.cc:237] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:38.006810 25975 raft_consensus.cc:2955] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:38.008427 25907 raft_consensus.cc:1275] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:38.008605 25908 raft_consensus.cc:2955] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:38.010246 26043 consensus_queue.cc:1048] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:38.019766 25298 raft_consensus.cc:1275] T ca881f8516e046c99da202e9d9ea00a1 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:38.021972 26006 consensus_queue.cc:1048] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:38.033538 25227 raft_consensus.cc:1275] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:38.033939 25126 catalog_manager.cc:5697] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:38.041260 26043 consensus_queue.cc:1048] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:38.052225 26006 raft_consensus.cc:2955] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:38.053301 25227 raft_consensus.cc:2955] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:38.061728 25907 raft_consensus.cc:2955] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:38.072824 26049 raft_consensus.cc:1064] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468: attempting to promote NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 to VOTER
I20260709 13:10:38.075237 26049 consensus_queue.cc:237] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:38.085808 25126 catalog_manager.cc:5697] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:38.094434 25225 raft_consensus.cc:2955] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:38.114339 25299 raft_consensus.cc:2955] T ca881f8516e046c99da202e9d9ea00a1 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:38.125007 25302 consensus_queue.cc:237] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:38.131316 25907 raft_consensus.cc:1275] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:38.136708 25907 raft_consensus.cc:1275] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 LEARNER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:10:38.137015 26028 consensus_queue.cc:1048] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:38.138237 26006 consensus_queue.cc:1048] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:38.148051 25225 raft_consensus.cc:1275] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:38.148525 25302 raft_consensus.cc:1275] T a1eeb9f9696c44b9b744d926cf3312ff P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:10:38.151185 26028 consensus_queue.cc:1048] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:38.151131 26047 consensus_queue.cc:1048] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:38.153329 25229 raft_consensus.cc:1275] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:10:38.154693 26050 raft_consensus.cc:1064] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19: attempting to promote NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 to VOTER
I20260709 13:10:38.159199 26049 consensus_queue.cc:1048] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:38.157212 26050 consensus_queue.cc:237] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:38.227669 25907 raft_consensus.cc:2955] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79d99c0e498349bda74127365219e468 (127.23.140.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:38.241202 25229 raft_consensus.cc:2955] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79d99c0e498349bda74127365219e468 (127.23.140.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:38.262696 25994 raft_consensus.cc:2955] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:38.261860 26030 raft_consensus.cc:2955] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79d99c0e498349bda74127365219e468 (127.23.140.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:38.273614 25908 raft_consensus.cc:2955] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:38.274755 25125 catalog_manager.cc:5697] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce reported cstate change: config changed from index 3 to 4, VOTER 79d99c0e498349bda74127365219e468 (127.23.140.67) evicted. New cstate: current_term: 1 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:38.288923 25230 raft_consensus.cc:2955] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:38.293540 25906 raft_consensus.cc:1275] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:38.302606 25361 tablet_service.cc:1558] Processing DeleteTablet for tablet ea5abc7f78c6412885cf5a12e2a9ee6c with delete_type TABLET_DATA_TOMBSTONED (TS 79d99c0e498349bda74127365219e468 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36248
I20260709 13:10:38.335906 26070 tablet_replica.cc:333] T ea5abc7f78c6412885cf5a12e2a9ee6c P 79d99c0e498349bda74127365219e468: stopping tablet replica
I20260709 13:10:38.336925 26070 raft_consensus.cc:2243] T ea5abc7f78c6412885cf5a12e2a9ee6c P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:38.337483 26070 pending_rounds.cc:70] T ea5abc7f78c6412885cf5a12e2a9ee6c P 79d99c0e498349bda74127365219e468: Trying to abort 1 pending ops.
I20260709 13:10:38.338631 25113 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ea5abc7f78c6412885cf5a12e2a9ee6c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:38.349805 25371 raft_consensus.cc:1275] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:38.348243 26045 consensus_queue.cc:1048] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:10:38.337728 26070 pending_rounds.cc:77] T ea5abc7f78c6412885cf5a12e2a9ee6c P 79d99c0e498349bda74127365219e468: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305636404694810624 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } } }
I20260709 13:10:38.357311 26070 raft_consensus.cc:2917] T ea5abc7f78c6412885cf5a12e2a9ee6c P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 13:10:38.357899 26070 raft_consensus.cc:2889] T ea5abc7f78c6412885cf5a12e2a9ee6c P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:10:38.357437 25126 catalog_manager.cc:5697] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce reported cstate change: config changed from index 3 to 4, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:38.358366 26070 raft_consensus.cc:2272] T ea5abc7f78c6412885cf5a12e2a9ee6c P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:38.371484 25230 raft_consensus.cc:1275] T f78697097cd14345b6a749c7aad4f696 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:38.376660 26071 consensus_queue.cc:1048] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:38.385529 26070 ts_tablet_manager.cc:1916] T ea5abc7f78c6412885cf5a12e2a9ee6c P 79d99c0e498349bda74127365219e468: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:38.456059 26070 ts_tablet_manager.cc:1929] T ea5abc7f78c6412885cf5a12e2a9ee6c P 79d99c0e498349bda74127365219e468: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:38.456564 26070 log.cc:1199] T ea5abc7f78c6412885cf5a12e2a9ee6c P 79d99c0e498349bda74127365219e468: Deleting WAL directory at /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602598684750-24113-0/minicluster-data/ts-2-root/wals/ea5abc7f78c6412885cf5a12e2a9ee6c
I20260709 13:10:38.616892 26030 raft_consensus.cc:2955] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:38.618598 25300 raft_consensus.cc:2955] T a1eeb9f9696c44b9b744d926cf3312ff P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:38.628001 25373 raft_consensus.cc:2955] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:38.639165 25114 catalog_manager.cc:5028] TS 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): tablet ea5abc7f78c6412885cf5a12e2a9ee6c (table test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]) successfully deleted
I20260709 13:10:38.678669 25908 raft_consensus.cc:2955] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
W20260709 13:10:38.695755 25159 debug-util.cc:398] Leaking SignalData structure 0x7b0800096fe0 after lost signal to thread 24116
W20260709 13:10:38.696723 25159 debug-util.cc:398] Leaking SignalData structure 0x7b0800038440 after lost signal to thread 25162
W20260709 13:10:38.697564 25159 debug-util.cc:398] Leaking SignalData structure 0x7b08002de720 after lost signal to thread 25254
W20260709 13:10:38.698390 25159 debug-util.cc:398] Leaking SignalData structure 0x7b08002fd200 after lost signal to thread 25329
W20260709 13:10:38.699318 25159 debug-util.cc:398] Leaking SignalData structure 0x7b08002f7460 after lost signal to thread 25403
W20260709 13:10:38.700289 25159 debug-util.cc:398] Leaking SignalData structure 0x7b08002fdb40 after lost signal to thread 25932
I20260709 13:10:38.723376 25377 consensus_queue.cc:237] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:38.723471 25373 consensus_queue.cc:237] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:38.725672 26071 consensus_queue.cc:1048] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:38.741603 25227 raft_consensus.cc:1275] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:38.750537 25906 raft_consensus.cc:1275] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:38.751822 25908 raft_consensus.cc:1275] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:38.755097 25230 raft_consensus.cc:1275] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:38.759289 26048 consensus_queue.cc:1048] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:38.761543 25128 catalog_manager.cc:5697] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:38.762725 26043 consensus_queue.cc:1048] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:38.760905 26047 consensus_queue.cc:1048] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:38.775520 26006 consensus_queue.cc:1048] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:38.781997 25994 raft_consensus.cc:2955] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:38.786857 25908 raft_consensus.cc:2955] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:38.786906 25230 raft_consensus.cc:2955] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:38.796169 25227 raft_consensus.cc:2955] T f78697097cd14345b6a749c7aad4f696 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:38.802047 26049 raft_consensus.cc:2955] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:38.812721 25225 raft_consensus.cc:2955] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:38.818858 25125 catalog_manager.cc:5697] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: config changed from index 3 to 4, VOTER da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) evicted. New cstate: current_term: 1 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:38.823060 25114 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ca881f8516e046c99da202e9d9ea00a1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:38.825103 25300 consensus_queue.cc:237] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:38.832875 25294 tablet_service.cc:1558] Processing DeleteTablet for tablet ca881f8516e046c99da202e9d9ea00a1 with delete_type TABLET_DATA_TOMBSTONED (TS da445ce82dc4467f95f4fa52297eaa19 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57250
I20260709 13:10:38.834884 25906 raft_consensus.cc:1275] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:38.835243 25908 raft_consensus.cc:2955] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:38.836194 26050 consensus_queue.cc:1048] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:38.840023 26078 tablet_replica.cc:333] T ca881f8516e046c99da202e9d9ea00a1 P da445ce82dc4467f95f4fa52297eaa19: stopping tablet replica
I20260709 13:10:38.843997 25114 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a1eeb9f9696c44b9b744d926cf3312ff with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:38.843737 25125 catalog_manager.cc:5697] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce reported cstate change: config changed from index 4 to 5, VOTER da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) evicted. New cstate: current_term: 2 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:38.846863 26071 raft_consensus.cc:2955] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1f539ba21487460085b837e7529a78ce (127.23.140.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
W20260709 13:10:38.851608 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 60836.2us
I20260709 13:10:38.851629 25906 raft_consensus.cc:2955] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1f539ba21487460085b837e7529a78ce (127.23.140.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:38.863677 25113 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f78697097cd14345b6a749c7aad4f696 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:38.868824 25377 raft_consensus.cc:1275] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:38.871039 25975 consensus_queue.cc:1048] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:38.874886 25377 raft_consensus.cc:2955] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1f539ba21487460085b837e7529a78ce (127.23.140.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:38.881698 26078 raft_consensus.cc:2243] T ca881f8516e046c99da202e9d9ea00a1 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:38.882517 26078 raft_consensus.cc:2272] T ca881f8516e046c99da202e9d9ea00a1 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:38.886258 25294 tablet_service.cc:1558] Processing DeleteTablet for tablet a1eeb9f9696c44b9b744d926cf3312ff with delete_type TABLET_DATA_TOMBSTONED (TS da445ce82dc4467f95f4fa52297eaa19 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:57250
I20260709 13:10:38.888991 26078 ts_tablet_manager.cc:1916] T ca881f8516e046c99da202e9d9ea00a1 P da445ce82dc4467f95f4fa52297eaa19: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:38.897068 25125 catalog_manager.cc:5697] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: config changed from index 3 to 4, VOTER 1f539ba21487460085b837e7529a78ce (127.23.140.65) evicted. New cstate: current_term: 1 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:38.918355 25211 tablet_service.cc:1558] Processing DeleteTablet for tablet f78697097cd14345b6a749c7aad4f696 with delete_type TABLET_DATA_TOMBSTONED (TS 1f539ba21487460085b837e7529a78ce not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58402
I20260709 13:10:38.957056 26078 ts_tablet_manager.cc:1929] T ca881f8516e046c99da202e9d9ea00a1 P da445ce82dc4467f95f4fa52297eaa19: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:38.957578 26078 log.cc:1199] T ca881f8516e046c99da202e9d9ea00a1 P da445ce82dc4467f95f4fa52297eaa19: Deleting WAL directory at /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602598684750-24113-0/minicluster-data/ts-1-root/wals/ca881f8516e046c99da202e9d9ea00a1
I20260709 13:10:38.961323 25113 catalog_manager.cc:5028] TS da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): tablet ca881f8516e046c99da202e9d9ea00a1 (table test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]) successfully deleted
I20260709 13:10:38.960417 26079 tablet_replica.cc:333] T f78697097cd14345b6a749c7aad4f696 P 1f539ba21487460085b837e7529a78ce: stopping tablet replica
I20260709 13:10:38.963059 26079 raft_consensus.cc:2243] T f78697097cd14345b6a749c7aad4f696 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:38.964262 26078 tablet_replica.cc:333] T a1eeb9f9696c44b9b744d926cf3312ff P da445ce82dc4467f95f4fa52297eaa19: stopping tablet replica
I20260709 13:10:38.965267 26078 raft_consensus.cc:2243] T a1eeb9f9696c44b9b744d926cf3312ff P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:38.965607 26079 raft_consensus.cc:2272] T f78697097cd14345b6a749c7aad4f696 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:38.965929 26078 raft_consensus.cc:2272] T a1eeb9f9696c44b9b744d926cf3312ff P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:38.969430 26078 ts_tablet_manager.cc:1916] T a1eeb9f9696c44b9b744d926cf3312ff P da445ce82dc4467f95f4fa52297eaa19: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:38.969607 26079 ts_tablet_manager.cc:1916] T f78697097cd14345b6a749c7aad4f696 P 1f539ba21487460085b837e7529a78ce: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:38.988376 26078 ts_tablet_manager.cc:1929] T a1eeb9f9696c44b9b744d926cf3312ff P da445ce82dc4467f95f4fa52297eaa19: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:10:38.988829 26078 log.cc:1199] T a1eeb9f9696c44b9b744d926cf3312ff P da445ce82dc4467f95f4fa52297eaa19: Deleting WAL directory at /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602598684750-24113-0/minicluster-data/ts-1-root/wals/a1eeb9f9696c44b9b744d926cf3312ff
I20260709 13:10:38.990270 25113 catalog_manager.cc:5028] TS da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): tablet a1eeb9f9696c44b9b744d926cf3312ff (table test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]) successfully deleted
I20260709 13:10:38.992177 26079 ts_tablet_manager.cc:1929] T f78697097cd14345b6a749c7aad4f696 P 1f539ba21487460085b837e7529a78ce: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:38.992552 26079 log.cc:1199] T f78697097cd14345b6a749c7aad4f696 P 1f539ba21487460085b837e7529a78ce: Deleting WAL directory at /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602598684750-24113-0/minicluster-data/ts-0-root/wals/f78697097cd14345b6a749c7aad4f696
I20260709 13:10:38.998124 25115 catalog_manager.cc:5028] TS 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): tablet f78697097cd14345b6a749c7aad4f696 (table test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]) successfully deleted
W20260709 13:10:39.524677 25929 debug-util.cc:398] Leaking SignalData structure 0x7b08002e7ec0 after lost signal to thread 24116
W20260709 13:10:39.526140 25929 debug-util.cc:398] Leaking SignalData structure 0x7b08002e85a0 after lost signal to thread 25162
W20260709 13:10:39.527292 25929 debug-util.cc:398] Leaking SignalData structure 0x7b0800304480 after lost signal to thread 25254
W20260709 13:10:39.528674 25929 debug-util.cc:398] Leaking SignalData structure 0x7b08002dfcc0 after lost signal to thread 25329
W20260709 13:10:39.530179 25929 debug-util.cc:398] Leaking SignalData structure 0x7b08002f0f20 after lost signal to thread 25403
W20260709 13:10:39.531805 25929 debug-util.cc:398] Leaking SignalData structure 0x7b08002d8ca0 after lost signal to thread 25932
I20260709 13:10:40.053457 25227 consensus_queue.cc:237] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
W20260709 13:10:40.063265 25195 consensus_peers.cc:597] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce -> Peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085): Couldn't send request to peer 6c4b021f3f9e41adb75e870a08ad88b6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 08c29bb25d6947ddaa43c22713738514. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:40.064522 25297 raft_consensus.cc:1275] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:40.065201 25373 raft_consensus.cc:1275] T 08c29bb25d6947ddaa43c22713738514 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:40.066174 26082 consensus_queue.cc:1048] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:40.067314 26046 consensus_queue.cc:1048] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:40.121006 26082 raft_consensus.cc:2955] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:40.123140 25379 raft_consensus.cc:2955] T 08c29bb25d6947ddaa43c22713738514 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:40.130649 25297 raft_consensus.cc:2955] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:40.140924 25377 consensus_queue.cc:237] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:40.144526 25128 catalog_manager.cc:5697] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce reported cstate change: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New cstate: current_term: 1 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:40.165395 25227 raft_consensus.cc:1275] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:40.165457 25298 raft_consensus.cc:1275] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:40.167004 26087 consensus_queue.cc:1048] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:40.169243 26077 consensus_queue.cc:1048] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:10:40.167016 25344 consensus_peers.cc:597] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 -> Peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085): Couldn't send request to peer 6c4b021f3f9e41adb75e870a08ad88b6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b1dbd9bfdb4f4ed582b5d84e9cc7602a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:40.198292 26077 raft_consensus.cc:2955] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:40.200425 25228 raft_consensus.cc:2955] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:40.218030 25297 raft_consensus.cc:2955] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:40.281298 25127 catalog_manager.cc:5697] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce reported cstate change: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New cstate: current_term: 1 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:40.292147 25228 consensus_queue.cc:237] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:40.312755 25377 raft_consensus.cc:1275] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:40.317827 26082 consensus_queue.cc:1048] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:10:40.323941 25195 consensus_peers.cc:597] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce -> Peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085): Couldn't send request to peer 6c4b021f3f9e41adb75e870a08ad88b6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0bcff15b40224dcaa2c76d2c4fd3b27b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:40.355775 25298 raft_consensus.cc:1275] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:40.362239 26085 raft_consensus.cc:2955] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:40.366470 26082 consensus_queue.cc:1048] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:40.380339 25377 raft_consensus.cc:2955] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:40.407716 25127 catalog_manager.cc:5697] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce reported cstate change: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New cstate: current_term: 1 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:40.451576 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 62663us
I20260709 13:10:40.464587 25377 consensus_queue.cc:237] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:40.490955 25297 raft_consensus.cc:2955] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
W20260709 13:10:40.493353 25344 consensus_peers.cc:597] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 -> Peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085): Couldn't send request to peer 6c4b021f3f9e41adb75e870a08ad88b6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c6d3131e75284c0eb555c937d1c619cb. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:40.496138 25228 raft_consensus.cc:1275] T c6d3131e75284c0eb555c937d1c619cb P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:40.496191 25299 raft_consensus.cc:1275] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:40.497677 26097 consensus_queue.cc:1048] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:40.498632 26077 consensus_queue.cc:1048] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:40.526037 26100 raft_consensus.cc:2955] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:40.530580 25230 raft_consensus.cc:2955] T c6d3131e75284c0eb555c937d1c619cb P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:40.549837 25299 raft_consensus.cc:2955] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:40.556939 25125 catalog_manager.cc:5697] T c6d3131e75284c0eb555c937d1c619cb P 1f539ba21487460085b837e7529a78ce reported cstate change: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New cstate: current_term: 1 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:40.629036 26105 ts_tablet_manager.cc:933] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6: Initiating tablet copy from peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:40.641824 26105 tablet_copy_client.cc:323] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Beginning tablet copy session from remote peer at address 127.23.140.67:34091
I20260709 13:10:40.644016 25389 tablet_copy_service.cc:140] P 79d99c0e498349bda74127365219e468: Received BeginTabletCopySession request for tablet b1dbd9bfdb4f4ed582b5d84e9cc7602a from peer 6c4b021f3f9e41adb75e870a08ad88b6 ({username='slave'} at 127.0.0.1:56308)
I20260709 13:10:40.644687 25389 tablet_copy_service.cc:161] P 79d99c0e498349bda74127365219e468: Beginning new tablet copy session on tablet b1dbd9bfdb4f4ed582b5d84e9cc7602a from peer 6c4b021f3f9e41adb75e870a08ad88b6 at {username='slave'} at 127.0.0.1:56308: session id = 6c4b021f3f9e41adb75e870a08ad88b6-b1dbd9bfdb4f4ed582b5d84e9cc7602a
I20260709 13:10:40.673498 25389 tablet_copy_source_session.cc:215] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:40.686502 26105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1dbd9bfdb4f4ed582b5d84e9cc7602a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:40.745236 26107 ts_tablet_manager.cc:933] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6: Initiating tablet copy from peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361)
I20260709 13:10:40.755505 26108 ts_tablet_manager.cc:933] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6: Initiating tablet copy from peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361)
I20260709 13:10:40.774827 26107 tablet_copy_client.cc:323] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Beginning tablet copy session from remote peer at address 127.23.140.65:39361
I20260709 13:10:40.785197 26108 tablet_copy_client.cc:323] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Beginning tablet copy session from remote peer at address 127.23.140.65:39361
I20260709 13:10:40.791668 26105 tablet_copy_client.cc:806] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:40.792418 26105 tablet_copy_client.cc:670] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:40.793375 25240 tablet_copy_service.cc:140] P 1f539ba21487460085b837e7529a78ce: Received BeginTabletCopySession request for tablet 0bcff15b40224dcaa2c76d2c4fd3b27b from peer 6c4b021f3f9e41adb75e870a08ad88b6 ({username='slave'} at 127.0.0.1:54000)
I20260709 13:10:40.798906 25240 tablet_copy_service.cc:161] P 1f539ba21487460085b837e7529a78ce: Beginning new tablet copy session on tablet 0bcff15b40224dcaa2c76d2c4fd3b27b from peer 6c4b021f3f9e41adb75e870a08ad88b6 at {username='slave'} at 127.0.0.1:54000: session id = 6c4b021f3f9e41adb75e870a08ad88b6-0bcff15b40224dcaa2c76d2c4fd3b27b
I20260709 13:10:40.797574 25239 tablet_copy_service.cc:140] P 1f539ba21487460085b837e7529a78ce: Received BeginTabletCopySession request for tablet 08c29bb25d6947ddaa43c22713738514 from peer 6c4b021f3f9e41adb75e870a08ad88b6 ({username='slave'} at 127.0.0.1:54000)
I20260709 13:10:40.801266 25239 tablet_copy_service.cc:161] P 1f539ba21487460085b837e7529a78ce: Beginning new tablet copy session on tablet 08c29bb25d6947ddaa43c22713738514 from peer 6c4b021f3f9e41adb75e870a08ad88b6 at {username='slave'} at 127.0.0.1:54000: session id = 6c4b021f3f9e41adb75e870a08ad88b6-08c29bb25d6947ddaa43c22713738514
I20260709 13:10:40.809303 25240 tablet_copy_source_session.cc:215] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:40.810081 25239 tablet_copy_source_session.cc:215] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:40.813916 26105 tablet_copy_client.cc:538] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:40.817112 26108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08c29bb25d6947ddaa43c22713738514. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:40.828860 26105 tablet_bootstrap.cc:492] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap starting.
I20260709 13:10:40.844322 26107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bcff15b40224dcaa2c76d2c4fd3b27b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:40.877861 26105 tablet_bootstrap.cc:492] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:40.878854 26105 tablet_bootstrap.cc:492] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap complete.
I20260709 13:10:40.879534 26105 ts_tablet_manager.cc:1403] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent bootstrapping tablet: real 0.051s	user 0.028s	sys 0.001s
I20260709 13:10:40.882836 26112 ts_tablet_manager.cc:933] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6: Initiating tablet copy from peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:40.885980 26105 raft_consensus.cc:359] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:40.886940 26105 raft_consensus.cc:740] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Initialized, Role: LEARNER
I20260709 13:10:40.887584 26105 consensus_queue.cc:260] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:40.895479 26105 ts_tablet_manager.cc:1434] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 13:10:40.919688 25389 tablet_copy_service.cc:342] P 79d99c0e498349bda74127365219e468: Request end of tablet copy session 6c4b021f3f9e41adb75e870a08ad88b6-b1dbd9bfdb4f4ed582b5d84e9cc7602a received from {username='slave'} at 127.0.0.1:56308
I20260709 13:10:40.919991 26112 tablet_copy_client.cc:323] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Beginning tablet copy session from remote peer at address 127.23.140.67:34091
I20260709 13:10:40.920225 25389 tablet_copy_service.cc:434] P 79d99c0e498349bda74127365219e468: ending tablet copy session 6c4b021f3f9e41adb75e870a08ad88b6-b1dbd9bfdb4f4ed582b5d84e9cc7602a on tablet b1dbd9bfdb4f4ed582b5d84e9cc7602a with peer 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:10:40.925894 25389 tablet_copy_service.cc:140] P 79d99c0e498349bda74127365219e468: Received BeginTabletCopySession request for tablet c6d3131e75284c0eb555c937d1c619cb from peer 6c4b021f3f9e41adb75e870a08ad88b6 ({username='slave'} at 127.0.0.1:56308)
I20260709 13:10:40.926388 25389 tablet_copy_service.cc:161] P 79d99c0e498349bda74127365219e468: Beginning new tablet copy session on tablet c6d3131e75284c0eb555c937d1c619cb from peer 6c4b021f3f9e41adb75e870a08ad88b6 at {username='slave'} at 127.0.0.1:56308: session id = 6c4b021f3f9e41adb75e870a08ad88b6-c6d3131e75284c0eb555c937d1c619cb
I20260709 13:10:40.933696 25389 tablet_copy_source_session.cc:215] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:40.939630 26112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6d3131e75284c0eb555c937d1c619cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:40.956837 26107 tablet_copy_client.cc:806] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:40.965576 26107 tablet_copy_client.cc:670] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:40.973309 26107 tablet_copy_client.cc:538] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:40.974380 26108 tablet_copy_client.cc:806] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:40.975872 26108 tablet_copy_client.cc:670] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:40.984033 26108 tablet_copy_client.cc:538] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:40.987440 26107 tablet_bootstrap.cc:492] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap starting.
I20260709 13:10:40.993829 26112 tablet_copy_client.cc:806] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:40.994464 26112 tablet_copy_client.cc:670] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:40.998296 26112 tablet_copy_client.cc:538] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:40.999104 25906 raft_consensus.cc:1217] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:41.007546 26108 tablet_bootstrap.cc:492] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap starting.
I20260709 13:10:41.030191 26112 tablet_bootstrap.cc:492] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap starting.
I20260709 13:10:41.086359 26107 tablet_bootstrap.cc:492] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:41.093317 26108 tablet_bootstrap.cc:492] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:41.094687 26108 tablet_bootstrap.cc:492] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap complete.
I20260709 13:10:41.095521 26108 ts_tablet_manager.cc:1403] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent bootstrapping tablet: real 0.088s	user 0.021s	sys 0.004s
I20260709 13:10:41.093725 26107 tablet_bootstrap.cc:492] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap complete.
I20260709 13:10:41.098958 26107 ts_tablet_manager.cc:1403] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent bootstrapping tablet: real 0.112s	user 0.023s	sys 0.004s
I20260709 13:10:41.105369 26107 raft_consensus.cc:359] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:41.125506 26107 raft_consensus.cc:740] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Initialized, Role: LEARNER
I20260709 13:10:41.126416 26107 consensus_queue.cc:260] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:41.130162 26107 ts_tablet_manager.cc:1434] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent starting tablet: real 0.029s	user 0.003s	sys 0.004s
I20260709 13:10:41.124502 26108 raft_consensus.cc:359] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:41.131173 26108 raft_consensus.cc:740] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Initialized, Role: LEARNER
I20260709 13:10:41.127916 26112 tablet_bootstrap.cc:492] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:41.134238 26112 tablet_bootstrap.cc:492] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap complete.
I20260709 13:10:41.135636 25240 tablet_copy_service.cc:342] P 1f539ba21487460085b837e7529a78ce: Request end of tablet copy session 6c4b021f3f9e41adb75e870a08ad88b6-0bcff15b40224dcaa2c76d2c4fd3b27b received from {username='slave'} at 127.0.0.1:54000
I20260709 13:10:41.135931 26112 ts_tablet_manager.cc:1403] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent bootstrapping tablet: real 0.106s	user 0.021s	sys 0.003s
I20260709 13:10:41.136103 25240 tablet_copy_service.cc:434] P 1f539ba21487460085b837e7529a78ce: ending tablet copy session 6c4b021f3f9e41adb75e870a08ad88b6-0bcff15b40224dcaa2c76d2c4fd3b27b on tablet 0bcff15b40224dcaa2c76d2c4fd3b27b with peer 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:10:41.134518 26108 consensus_queue.cc:260] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:41.140765 26108 ts_tablet_manager.cc:1434] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent starting tablet: real 0.044s	user 0.005s	sys 0.001s
I20260709 13:10:41.144896 25240 tablet_copy_service.cc:342] P 1f539ba21487460085b837e7529a78ce: Request end of tablet copy session 6c4b021f3f9e41adb75e870a08ad88b6-08c29bb25d6947ddaa43c22713738514 received from {username='slave'} at 127.0.0.1:54000
I20260709 13:10:41.145357 25240 tablet_copy_service.cc:434] P 1f539ba21487460085b837e7529a78ce: ending tablet copy session 6c4b021f3f9e41adb75e870a08ad88b6-08c29bb25d6947ddaa43c22713738514 on tablet 08c29bb25d6947ddaa43c22713738514 with peer 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:10:41.159571 25906 raft_consensus.cc:1217] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:41.179873 25906 raft_consensus.cc:1217] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:41.198742 26112 raft_consensus.cc:359] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:41.199800 26112 raft_consensus.cc:740] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Initialized, Role: LEARNER
I20260709 13:10:41.200583 26112 consensus_queue.cc:260] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:41.211804 26112 ts_tablet_manager.cc:1434] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent starting tablet: real 0.076s	user 0.002s	sys 0.005s
I20260709 13:10:41.216527 25389 tablet_copy_service.cc:342] P 79d99c0e498349bda74127365219e468: Request end of tablet copy session 6c4b021f3f9e41adb75e870a08ad88b6-c6d3131e75284c0eb555c937d1c619cb received from {username='slave'} at 127.0.0.1:56308
I20260709 13:10:41.216962 25389 tablet_copy_service.cc:434] P 79d99c0e498349bda74127365219e468: ending tablet copy session 6c4b021f3f9e41adb75e870a08ad88b6-c6d3131e75284c0eb555c937d1c619cb on tablet c6d3131e75284c0eb555c937d1c619cb with peer 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:10:41.448403 25906 raft_consensus.cc:1217] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:41.586305 26097 raft_consensus.cc:1064] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468: attempting to promote NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 to VOTER
I20260709 13:10:41.638573 26082 raft_consensus.cc:1064] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce: attempting to promote NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 to VOTER
I20260709 13:10:41.641664 26082 consensus_queue.cc:237] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:41.589454 26097 consensus_queue.cc:237] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:10:41.710035 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 50290us
I20260709 13:10:41.722571 26085 raft_consensus.cc:1064] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce: attempting to promote NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 to VOTER
I20260709 13:10:41.733237 26085 consensus_queue.cc:237] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:41.754895 25906 raft_consensus.cc:1275] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:41.756753 26099 consensus_queue.cc:1048] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:41.768062 25299 raft_consensus.cc:1275] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:41.777714 26099 consensus_queue.cc:1048] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:41.777987 25299 raft_consensus.cc:1275] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:41.800654 25908 raft_consensus.cc:1275] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:41.801095 25907 raft_consensus.cc:1275] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:41.802825 26099 consensus_queue.cc:1048] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:41.828514 25375 raft_consensus.cc:1275] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:41.828974 25379 raft_consensus.cc:1275] T 08c29bb25d6947ddaa43c22713738514 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:41.815289 26100 consensus_queue.cc:1048] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:10:41.835453 25228 raft_consensus.cc:1275] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:41.835587 25298 raft_consensus.cc:1275] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:41.842958 26099 consensus_queue.cc:1048] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:41.846546 26099 consensus_queue.cc:1048] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:41.848426 26126 consensus_queue.cc:1048] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 13:10:41.854835 26099 consensus_queue.cc:1048] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:41.859316 26100 consensus_queue.cc:1048] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:41.873370 26085 raft_consensus.cc:2955] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:41.909436 25297 raft_consensus.cc:2955] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:41.937739 25906 raft_consensus.cc:2955] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:41.958778 26125 raft_consensus.cc:1064] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468: attempting to promote NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 to VOTER
I20260709 13:10:41.961423 26125 consensus_queue.cc:237] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:41.989004 25907 raft_consensus.cc:2955] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:41.982421 26085 raft_consensus.cc:2955] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:42.006390 25127 catalog_manager.cc:5697] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce reported cstate change: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:10:42.045564 26131 log.cc:927] Time spent T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.077s	user 0.002s	sys 0.000s
I20260709 13:10:42.077951 26119 raft_consensus.cc:2955] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:42.099929 25300 raft_consensus.cc:2955] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:42.127910 25908 raft_consensus.cc:1275] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:42.130532 26097 consensus_queue.cc:1048] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:10:42.145968 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 60095.3us
I20260709 13:10:42.153460 25302 raft_consensus.cc:1275] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:42.161618 26097 consensus_queue.cc:1048] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:10:42.171643 26133 log.cc:927] Time spent T 0bcff15b40224dcaa2c76d2c4fd3b27b P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.176s	user 0.002s	sys 0.003s
I20260709 13:10:42.164893 25908 raft_consensus.cc:2955] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
W20260709 13:10:42.210557 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 60450.7us
I20260709 13:10:42.213374 25126 catalog_manager.cc:5697] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 reported cstate change: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:10:42.249317 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 62741us
I20260709 13:10:42.247319 25377 raft_consensus.cc:2955] T 08c29bb25d6947ddaa43c22713738514 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:42.250746 25375 raft_consensus.cc:2955] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:42.265650 25300 raft_consensus.cc:2955] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:42.304557 25225 raft_consensus.cc:1275] T c6d3131e75284c0eb555c937d1c619cb P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:42.311012 26119 consensus_queue.cc:1048] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:42.312247 25229 raft_consensus.cc:2955] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
W20260709 13:10:42.323096 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 128963us
I20260709 13:10:42.340435 26097 raft_consensus.cc:2955] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:42.342273 25906 raft_consensus.cc:2955] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:42.345897 25125 catalog_manager.cc:5697] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:42.351356 25230 consensus_queue.cc:237] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:42.353538 25298 raft_consensus.cc:2955] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:42.364674 25302 raft_consensus.cc:1275] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:42.375520 25906 raft_consensus.cc:1275] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:42.379268 26085 consensus_queue.cc:1048] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:42.391541 26139 consensus_queue.cc:1048] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:42.409154 25126 catalog_manager.cc:5697] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 reported cstate change: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:42.415438 25908 raft_consensus.cc:2955] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79d99c0e498349bda74127365219e468 (127.23.140.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:42.413789 26085 raft_consensus.cc:2955] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79d99c0e498349bda74127365219e468 (127.23.140.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:42.448774 25298 raft_consensus.cc:2955] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79d99c0e498349bda74127365219e468 (127.23.140.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:42.471240 25227 consensus_queue.cc:237] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:42.477186 25115 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0bcff15b40224dcaa2c76d2c4fd3b27b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:42.494393 25908 raft_consensus.cc:1275] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:42.496730 26147 consensus_queue.cc:1048] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:42.473860 25128 catalog_manager.cc:5697] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: config changed from index 3 to 4, VOTER 79d99c0e498349bda74127365219e468 (127.23.140.67) evicted. New cstate: current_term: 1 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:42.505610 26140 raft_consensus.cc:2955] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79d99c0e498349bda74127365219e468 (127.23.140.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:42.512127 25906 raft_consensus.cc:2955] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79d99c0e498349bda74127365219e468 (127.23.140.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:42.537817 25298 raft_consensus.cc:1275] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:42.541709 26085 consensus_queue.cc:1048] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:10:42.547773 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 132289us
I20260709 13:10:42.549029 25377 consensus_queue.cc:237] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:42.551910 25371 consensus_queue.cc:237] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:42.554183 25361 tablet_service.cc:1558] Processing DeleteTablet for tablet 0bcff15b40224dcaa2c76d2c4fd3b27b with delete_type TABLET_DATA_TOMBSTONED (TS 79d99c0e498349bda74127365219e468 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36248
I20260709 13:10:42.556264 25128 catalog_manager.cc:5697] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: config changed from index 3 to 4, VOTER 79d99c0e498349bda74127365219e468 (127.23.140.67) evicted. New cstate: current_term: 1 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:42.561911 25115 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 08c29bb25d6947ddaa43c22713738514 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:42.570667 25367 tablet_service.cc:1558] Processing DeleteTablet for tablet 08c29bb25d6947ddaa43c22713738514 with delete_type TABLET_DATA_TOMBSTONED (TS 79d99c0e498349bda74127365219e468 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36248
I20260709 13:10:42.599529 25908 raft_consensus.cc:1275] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:42.601950 26125 consensus_queue.cc:1048] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:42.601714 25227 raft_consensus.cc:1275] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:42.606009 26100 consensus_queue.cc:1048] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:42.609534 26126 raft_consensus.cc:2955] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:42.615427 25908 raft_consensus.cc:2955] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:42.618865 25227 raft_consensus.cc:2955] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:42.622989 25907 raft_consensus.cc:1275] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:42.627951 26144 consensus_queue.cc:1048] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:42.638302 25302 raft_consensus.cc:1275] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:42.639012 26128 raft_consensus.cc:2955] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1f539ba21487460085b837e7529a78ce (127.23.140.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:42.641538 25907 raft_consensus.cc:2955] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1f539ba21487460085b837e7529a78ce (127.23.140.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:42.662988 25128 catalog_manager.cc:5697] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: config changed from index 3 to 4, VOTER 1f539ba21487460085b837e7529a78ce (127.23.140.65) evicted. New cstate: current_term: 1 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:42.675458 26144 consensus_queue.cc:1048] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:42.679584 25211 tablet_service.cc:1558] Processing DeleteTablet for tablet c6d3131e75284c0eb555c937d1c619cb with delete_type TABLET_DATA_TOMBSTONED (TS 1f539ba21487460085b837e7529a78ce not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58402
I20260709 13:10:42.691129 26156 tablet_replica.cc:333] T c6d3131e75284c0eb555c937d1c619cb P 1f539ba21487460085b837e7529a78ce: stopping tablet replica
I20260709 13:10:42.696341 26156 raft_consensus.cc:2243] T c6d3131e75284c0eb555c937d1c619cb P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:42.696985 26156 pending_rounds.cc:70] T c6d3131e75284c0eb555c937d1c619cb P 1f539ba21487460085b837e7529a78ce: Trying to abort 1 pending ops.
I20260709 13:10:42.697316 26156 pending_rounds.cc:77] T c6d3131e75284c0eb555c937d1c619cb P 1f539ba21487460085b837e7529a78ce: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305636421468119040 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "c6d3131e75284c0eb555c937d1c619cb" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } } }
I20260709 13:10:42.698704 26156 raft_consensus.cc:2917] T c6d3131e75284c0eb555c937d1c619cb P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 13:10:42.699369 26156 raft_consensus.cc:2889] T c6d3131e75284c0eb555c937d1c619cb P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:10:42.699817 26156 raft_consensus.cc:2272] T c6d3131e75284c0eb555c937d1c619cb P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.703295 25128 catalog_manager.cc:5697] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce reported cstate change: config changed from index 3 to 4, VOTER da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) evicted. New cstate: current_term: 1 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:42.708312 26156 ts_tablet_manager.cc:1916] T c6d3131e75284c0eb555c937d1c619cb P 1f539ba21487460085b837e7529a78ce: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:42.669032 25298 raft_consensus.cc:2955] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79d99c0e498349bda74127365219e468 (127.23.140.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:42.728639 25294 tablet_service.cc:1558] Processing DeleteTablet for tablet b1dbd9bfdb4f4ed582b5d84e9cc7602a with delete_type TABLET_DATA_TOMBSTONED (TS da445ce82dc4467f95f4fa52297eaa19 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57250
I20260709 13:10:42.714896 25300 raft_consensus.cc:2955] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1f539ba21487460085b837e7529a78ce (127.23.140.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:42.725862 25114 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b1dbd9bfdb4f4ed582b5d84e9cc7602a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:42.764377 25114 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c6d3131e75284c0eb555c937d1c619cb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:42.769286 26157 tablet_replica.cc:333] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P da445ce82dc4467f95f4fa52297eaa19: stopping tablet replica
I20260709 13:10:42.773201 26155 tablet_replica.cc:333] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 79d99c0e498349bda74127365219e468: stopping tablet replica
I20260709 13:10:42.775254 26155 raft_consensus.cc:2243] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:42.776742 26157 raft_consensus.cc:2243] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:42.781069 26157 raft_consensus.cc:2272] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.781831 26155 raft_consensus.cc:2272] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.786037 26156 ts_tablet_manager.cc:1929] T c6d3131e75284c0eb555c937d1c619cb P 1f539ba21487460085b837e7529a78ce: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:42.786513 26156 log.cc:1199] T c6d3131e75284c0eb555c937d1c619cb P 1f539ba21487460085b837e7529a78ce: Deleting WAL directory at /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602598684750-24113-0/minicluster-data/ts-0-root/wals/c6d3131e75284c0eb555c937d1c619cb
I20260709 13:10:42.786597 26157 ts_tablet_manager.cc:1916] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P da445ce82dc4467f95f4fa52297eaa19: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:42.788060 25115 catalog_manager.cc:5028] TS 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): tablet c6d3131e75284c0eb555c937d1c619cb (table test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]) successfully deleted
I20260709 13:10:42.794672 26155 ts_tablet_manager.cc:1916] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 79d99c0e498349bda74127365219e468: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:42.807973 26155 ts_tablet_manager.cc:1929] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 79d99c0e498349bda74127365219e468: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:42.808444 26155 log.cc:1199] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 79d99c0e498349bda74127365219e468: Deleting WAL directory at /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602598684750-24113-0/minicluster-data/ts-2-root/wals/0bcff15b40224dcaa2c76d2c4fd3b27b
I20260709 13:10:42.810248 25114 catalog_manager.cc:5028] TS 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): tablet 0bcff15b40224dcaa2c76d2c4fd3b27b (table test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]) successfully deleted
I20260709 13:10:42.811218 26155 tablet_replica.cc:333] T 08c29bb25d6947ddaa43c22713738514 P 79d99c0e498349bda74127365219e468: stopping tablet replica
I20260709 13:10:42.812001 26155 raft_consensus.cc:2243] T 08c29bb25d6947ddaa43c22713738514 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:42.812570 26155 raft_consensus.cc:2272] T 08c29bb25d6947ddaa43c22713738514 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.817505 26155 ts_tablet_manager.cc:1916] T 08c29bb25d6947ddaa43c22713738514 P 79d99c0e498349bda74127365219e468: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:42.813576 26157 ts_tablet_manager.cc:1929] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P da445ce82dc4467f95f4fa52297eaa19: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:42.826128 26157 log.cc:1199] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P da445ce82dc4467f95f4fa52297eaa19: Deleting WAL directory at /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602598684750-24113-0/minicluster-data/ts-1-root/wals/b1dbd9bfdb4f4ed582b5d84e9cc7602a
I20260709 13:10:42.831017 25113 catalog_manager.cc:5028] TS da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): tablet b1dbd9bfdb4f4ed582b5d84e9cc7602a (table test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]) successfully deleted
I20260709 13:10:42.832631 26155 ts_tablet_manager.cc:1929] T 08c29bb25d6947ddaa43c22713738514 P 79d99c0e498349bda74127365219e468: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:42.833123 26155 log.cc:1199] T 08c29bb25d6947ddaa43c22713738514 P 79d99c0e498349bda74127365219e468: Deleting WAL directory at /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602598684750-24113-0/minicluster-data/ts-2-root/wals/08c29bb25d6947ddaa43c22713738514
I20260709 13:10:42.834687 25114 catalog_manager.cc:5028] TS 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): tablet 08c29bb25d6947ddaa43c22713738514 (table test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]) successfully deleted
I20260709 13:10:43.876070 25302 consensus_queue.cc:237] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:43.885457 25372 raft_consensus.cc:1275] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:43.887598 25229 raft_consensus.cc:1275] T e74320a7302d4cd8b705dce5d385079a P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:43.888281 26150 consensus_queue.cc:1048] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:43.890117 26150 consensus_queue.cc:1048] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:10:43.887640 25270 consensus_peers.cc:597] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 -> Peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085): Couldn't send request to peer 6c4b021f3f9e41adb75e870a08ad88b6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e74320a7302d4cd8b705dce5d385079a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:43.918891 26045 raft_consensus.cc:2955] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:43.924077 25230 raft_consensus.cc:2955] T e74320a7302d4cd8b705dce5d385079a P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:43.943522 25372 raft_consensus.cc:2955] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:43.963897 25229 consensus_queue.cc:237] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:43.982511 25127 catalog_manager.cc:5697] T e74320a7302d4cd8b705dce5d385079a P 1f539ba21487460085b837e7529a78ce reported cstate change: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New cstate: current_term: 1 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
W20260709 13:10:44.018385 25195 consensus_peers.cc:597] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce -> Peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085): Couldn't send request to peer 6c4b021f3f9e41adb75e870a08ad88b6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7e85321bc6774ed28bf79ebfd5eae6e0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:44.020355 25372 raft_consensus.cc:1275] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:44.023504 26140 consensus_queue.cc:1048] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:44.044328 25302 raft_consensus.cc:1275] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:44.048283 26085 consensus_queue.cc:1048] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:44.074295 26165 raft_consensus.cc:2955] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:44.083021 25377 raft_consensus.cc:2955] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:44.093276 25302 raft_consensus.cc:2955] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:44.122956 25377 consensus_queue.cc:237] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:44.126399 25125 catalog_manager.cc:5697] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce reported cstate change: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New cstate: current_term: 1 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:44.158442 25230 raft_consensus.cc:1275] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:44.165505 26164 consensus_queue.cc:1048] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:10:44.166769 25344 consensus_peers.cc:597] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 -> Peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085): Couldn't send request to peer 6c4b021f3f9e41adb75e870a08ad88b6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 47228487a74240e9bc9bcd2e1d966ed6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:44.171068 25298 raft_consensus.cc:1275] T 47228487a74240e9bc9bcd2e1d966ed6 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:44.172396 26144 consensus_queue.cc:1048] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:44.194487 26164 raft_consensus.cc:2955] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:44.196336 25298 raft_consensus.cc:2955] T 47228487a74240e9bc9bcd2e1d966ed6 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:44.211829 25230 raft_consensus.cc:2955] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:44.228850 25125 catalog_manager.cc:5697] T 47228487a74240e9bc9bcd2e1d966ed6 P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New cstate: current_term: 1 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:44.230407 25298 consensus_queue.cc:237] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
W20260709 13:10:44.258695 25270 consensus_peers.cc:597] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 -> Peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085): Couldn't send request to peer 6c4b021f3f9e41adb75e870a08ad88b6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 60f74f1604ed4390892e271c77fd0f07. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:44.259994 25377 raft_consensus.cc:1275] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:44.262231 25229 raft_consensus.cc:1275] T 60f74f1604ed4390892e271c77fd0f07 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:44.263209 26158 consensus_queue.cc:1048] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:44.266342 26045 consensus_queue.cc:1048] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:44.280045 26045 raft_consensus.cc:2955] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:44.283968 25377 raft_consensus.cc:2955] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:44.309134 25125 catalog_manager.cc:5697] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 reported cstate change: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New cstate: current_term: 1 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:44.310446 25229 raft_consensus.cc:2955] T 60f74f1604ed4390892e271c77fd0f07 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:44.478724 26181 ts_tablet_manager.cc:933] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6: Initiating tablet copy from peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:44.497769 26181 tablet_copy_client.cc:323] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Beginning tablet copy session from remote peer at address 127.23.140.66:33127
I20260709 13:10:44.499572 25315 tablet_copy_service.cc:140] P da445ce82dc4467f95f4fa52297eaa19: Received BeginTabletCopySession request for tablet e74320a7302d4cd8b705dce5d385079a from peer 6c4b021f3f9e41adb75e870a08ad88b6 ({username='slave'} at 127.0.0.1:46556)
I20260709 13:10:44.500089 25315 tablet_copy_service.cc:161] P da445ce82dc4467f95f4fa52297eaa19: Beginning new tablet copy session on tablet e74320a7302d4cd8b705dce5d385079a from peer 6c4b021f3f9e41adb75e870a08ad88b6 at {username='slave'} at 127.0.0.1:46556: session id = 6c4b021f3f9e41adb75e870a08ad88b6-e74320a7302d4cd8b705dce5d385079a
I20260709 13:10:44.520494 26180 ts_tablet_manager.cc:933] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6: Initiating tablet copy from peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361)
I20260709 13:10:44.523439 25315 tablet_copy_source_session.cc:215] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:44.526255 26180 tablet_copy_client.cc:323] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Beginning tablet copy session from remote peer at address 127.23.140.65:39361
I20260709 13:10:44.526717 26181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e74320a7302d4cd8b705dce5d385079a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.528064 25240 tablet_copy_service.cc:140] P 1f539ba21487460085b837e7529a78ce: Received BeginTabletCopySession request for tablet 7e85321bc6774ed28bf79ebfd5eae6e0 from peer 6c4b021f3f9e41adb75e870a08ad88b6 ({username='slave'} at 127.0.0.1:54000)
I20260709 13:10:44.528610 25240 tablet_copy_service.cc:161] P 1f539ba21487460085b837e7529a78ce: Beginning new tablet copy session on tablet 7e85321bc6774ed28bf79ebfd5eae6e0 from peer 6c4b021f3f9e41adb75e870a08ad88b6 at {username='slave'} at 127.0.0.1:54000: session id = 6c4b021f3f9e41adb75e870a08ad88b6-7e85321bc6774ed28bf79ebfd5eae6e0
I20260709 13:10:44.552166 26181 tablet_copy_client.cc:806] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:44.552920 26181 tablet_copy_client.cc:670] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:44.556649 26181 tablet_copy_client.cc:538] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:44.568738 26181 tablet_bootstrap.cc:492] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap starting.
I20260709 13:10:44.572639 25240 tablet_copy_source_session.cc:215] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:44.586613 26180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e85321bc6774ed28bf79ebfd5eae6e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.628818 26180 tablet_copy_client.cc:806] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:44.629545 26180 tablet_copy_client.cc:670] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:44.633571 26180 tablet_copy_client.cc:538] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:44.648095 26180 tablet_bootstrap.cc:492] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap starting.
I20260709 13:10:44.652118 26181 tablet_bootstrap.cc:492] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:44.653218 26181 tablet_bootstrap.cc:492] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap complete.
I20260709 13:10:44.657274 26181 ts_tablet_manager.cc:1403] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent bootstrapping tablet: real 0.089s	user 0.025s	sys 0.029s
I20260709 13:10:44.662281 26181 raft_consensus.cc:359] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:44.663410 26181 raft_consensus.cc:740] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Initialized, Role: LEARNER
I20260709 13:10:44.664129 26181 consensus_queue.cc:260] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:44.719275 26181 ts_tablet_manager.cc:1434] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent starting tablet: real 0.061s	user 0.003s	sys 0.008s
I20260709 13:10:44.739483 25315 tablet_copy_service.cc:342] P da445ce82dc4467f95f4fa52297eaa19: Request end of tablet copy session 6c4b021f3f9e41adb75e870a08ad88b6-e74320a7302d4cd8b705dce5d385079a received from {username='slave'} at 127.0.0.1:46556
I20260709 13:10:44.739953 25315 tablet_copy_service.cc:434] P da445ce82dc4467f95f4fa52297eaa19: ending tablet copy session 6c4b021f3f9e41adb75e870a08ad88b6-e74320a7302d4cd8b705dce5d385079a on tablet e74320a7302d4cd8b705dce5d385079a with peer 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:10:44.743522 26181 ts_tablet_manager.cc:933] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6: Initiating tablet copy from peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:44.746477 26189 ts_tablet_manager.cc:933] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6: Initiating tablet copy from peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:44.751587 26180 tablet_bootstrap.cc:492] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:44.752948 26180 tablet_bootstrap.cc:492] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap complete.
I20260709 13:10:44.753666 26180 ts_tablet_manager.cc:1403] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent bootstrapping tablet: real 0.106s	user 0.033s	sys 0.015s
I20260709 13:10:44.754475 26181 tablet_copy_client.cc:323] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Beginning tablet copy session from remote peer at address 127.23.140.66:33127
I20260709 13:10:44.756335 25315 tablet_copy_service.cc:140] P da445ce82dc4467f95f4fa52297eaa19: Received BeginTabletCopySession request for tablet 60f74f1604ed4390892e271c77fd0f07 from peer 6c4b021f3f9e41adb75e870a08ad88b6 ({username='slave'} at 127.0.0.1:46556)
I20260709 13:10:44.756839 25315 tablet_copy_service.cc:161] P da445ce82dc4467f95f4fa52297eaa19: Beginning new tablet copy session on tablet 60f74f1604ed4390892e271c77fd0f07 from peer 6c4b021f3f9e41adb75e870a08ad88b6 at {username='slave'} at 127.0.0.1:46556: session id = 6c4b021f3f9e41adb75e870a08ad88b6-60f74f1604ed4390892e271c77fd0f07
I20260709 13:10:44.765588 25315 tablet_copy_source_session.cc:215] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:44.767447 26189 tablet_copy_client.cc:323] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Beginning tablet copy session from remote peer at address 127.23.140.67:34091
I20260709 13:10:44.769484 26181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60f74f1604ed4390892e271c77fd0f07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.776621 25389 tablet_copy_service.cc:140] P 79d99c0e498349bda74127365219e468: Received BeginTabletCopySession request for tablet 47228487a74240e9bc9bcd2e1d966ed6 from peer 6c4b021f3f9e41adb75e870a08ad88b6 ({username='slave'} at 127.0.0.1:56308)
I20260709 13:10:44.777272 25389 tablet_copy_service.cc:161] P 79d99c0e498349bda74127365219e468: Beginning new tablet copy session on tablet 47228487a74240e9bc9bcd2e1d966ed6 from peer 6c4b021f3f9e41adb75e870a08ad88b6 at {username='slave'} at 127.0.0.1:56308: session id = 6c4b021f3f9e41adb75e870a08ad88b6-47228487a74240e9bc9bcd2e1d966ed6
I20260709 13:10:44.778366 26180 raft_consensus.cc:359] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:44.779230 26180 raft_consensus.cc:740] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Initialized, Role: LEARNER
I20260709 13:10:44.779978 26180 consensus_queue.cc:260] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:44.782446 26180 ts_tablet_manager.cc:1434] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:10:44.786950 25240 tablet_copy_service.cc:342] P 1f539ba21487460085b837e7529a78ce: Request end of tablet copy session 6c4b021f3f9e41adb75e870a08ad88b6-7e85321bc6774ed28bf79ebfd5eae6e0 received from {username='slave'} at 127.0.0.1:54000
I20260709 13:10:44.787379 25240 tablet_copy_service.cc:434] P 1f539ba21487460085b837e7529a78ce: ending tablet copy session 6c4b021f3f9e41adb75e870a08ad88b6-7e85321bc6774ed28bf79ebfd5eae6e0 on tablet 7e85321bc6774ed28bf79ebfd5eae6e0 with peer 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:10:44.788105 26181 tablet_copy_client.cc:806] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:44.789347 26181 tablet_copy_client.cc:670] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:44.815806 26181 tablet_copy_client.cc:538] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:44.819289 25389 tablet_copy_source_session.cc:215] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:44.833544 26189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47228487a74240e9bc9bcd2e1d966ed6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.848624 25908 raft_consensus.cc:1217] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:44.868003 26189 tablet_copy_client.cc:806] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:44.870499 26189 tablet_copy_client.cc:670] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:44.879360 26189 tablet_copy_client.cc:538] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:44.881691 26181 tablet_bootstrap.cc:492] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap starting.
I20260709 13:10:44.901162 26189 tablet_bootstrap.cc:492] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap starting.
I20260709 13:10:44.927307 25908 raft_consensus.cc:1217] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:44.932385 26189 tablet_bootstrap.cc:492] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:44.939303 26189 tablet_bootstrap.cc:492] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap complete.
I20260709 13:10:44.940085 26189 ts_tablet_manager.cc:1403] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent bootstrapping tablet: real 0.039s	user 0.024s	sys 0.000s
I20260709 13:10:44.951395 26189 raft_consensus.cc:359] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:44.952332 26189 raft_consensus.cc:740] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Initialized, Role: LEARNER
I20260709 13:10:44.953094 26189 consensus_queue.cc:260] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:44.955816 26189 ts_tablet_manager.cc:1434] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent starting tablet: real 0.015s	user 0.000s	sys 0.005s
I20260709 13:10:44.960907 25389 tablet_copy_service.cc:342] P 79d99c0e498349bda74127365219e468: Request end of tablet copy session 6c4b021f3f9e41adb75e870a08ad88b6-47228487a74240e9bc9bcd2e1d966ed6 received from {username='slave'} at 127.0.0.1:56308
I20260709 13:10:44.961337 25389 tablet_copy_service.cc:434] P 79d99c0e498349bda74127365219e468: ending tablet copy session 6c4b021f3f9e41adb75e870a08ad88b6-47228487a74240e9bc9bcd2e1d966ed6 on tablet 47228487a74240e9bc9bcd2e1d966ed6 with peer 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:10:44.967983 26181 tablet_bootstrap.cc:492] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:44.972685 26181 tablet_bootstrap.cc:492] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap complete.
I20260709 13:10:44.973699 26181 ts_tablet_manager.cc:1403] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent bootstrapping tablet: real 0.141s	user 0.009s	sys 0.021s
I20260709 13:10:44.976778 26181 raft_consensus.cc:359] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:44.977686 26181 raft_consensus.cc:740] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Initialized, Role: LEARNER
I20260709 13:10:44.978472 26181 consensus_queue.cc:260] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:45.006620 26181 ts_tablet_manager.cc:1434] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent starting tablet: real 0.033s	user 0.004s	sys 0.003s
I20260709 13:10:45.008569 25315 tablet_copy_service.cc:342] P da445ce82dc4467f95f4fa52297eaa19: Request end of tablet copy session 6c4b021f3f9e41adb75e870a08ad88b6-60f74f1604ed4390892e271c77fd0f07 received from {username='slave'} at 127.0.0.1:46556
I20260709 13:10:45.009006 25315 tablet_copy_service.cc:434] P da445ce82dc4467f95f4fa52297eaa19: ending tablet copy session 6c4b021f3f9e41adb75e870a08ad88b6-60f74f1604ed4390892e271c77fd0f07 on tablet 60f74f1604ed4390892e271c77fd0f07 with peer 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:10:45.162470 25907 raft_consensus.cc:1217] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:45.174721 25907 raft_consensus.cc:1217] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:45.240929 26150 raft_consensus.cc:1064] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19: attempting to promote NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 to VOTER
I20260709 13:10:45.243350 26150 consensus_queue.cc:237] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:45.277230 25907 raft_consensus.cc:1275] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:45.282140 26179 consensus_queue.cc:1048] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:45.291491 25370 raft_consensus.cc:1275] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:45.291572 25229 raft_consensus.cc:1275] T e74320a7302d4cd8b705dce5d385079a P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:45.295876 26150 consensus_queue.cc:1048] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:45.317773 26196 consensus_queue.cc:1048] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:10:45.342921 26045 raft_consensus.cc:2955] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:45.356225 25370 raft_consensus.cc:2955] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:45.361515 25907 raft_consensus.cc:2955] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:45.377920 25125 catalog_manager.cc:5697] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:45.430330 25227 raft_consensus.cc:2955] T e74320a7302d4cd8b705dce5d385079a P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:45.472324 25300 consensus_queue.cc:237] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:45.478766 25907 raft_consensus.cc:1275] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:45.480885 26045 consensus_queue.cc:1048] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:45.495330 25377 raft_consensus.cc:1275] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:45.499341 26179 consensus_queue.cc:1048] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:45.505519 26150 raft_consensus.cc:2955] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1f539ba21487460085b837e7529a78ce (127.23.140.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:45.520153 25370 raft_consensus.cc:2955] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1f539ba21487460085b837e7529a78ce (127.23.140.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:45.520153 25907 raft_consensus.cc:2955] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1f539ba21487460085b837e7529a78ce (127.23.140.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:45.533165 26140 raft_consensus.cc:1064] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce: attempting to promote NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 to VOTER
I20260709 13:10:45.536911 25113 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e74320a7302d4cd8b705dce5d385079a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:45.538556 26140 consensus_queue.cc:237] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:45.553243 25127 catalog_manager.cc:5697] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: config changed from index 3 to 4, VOTER 1f539ba21487460085b837e7529a78ce (127.23.140.65) evicted. New cstate: current_term: 1 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:45.569218 25211 tablet_service.cc:1558] Processing DeleteTablet for tablet e74320a7302d4cd8b705dce5d385079a with delete_type TABLET_DATA_TOMBSTONED (TS 1f539ba21487460085b837e7529a78ce not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58402
I20260709 13:10:45.601195 26204 tablet_replica.cc:333] T e74320a7302d4cd8b705dce5d385079a P 1f539ba21487460085b837e7529a78ce: stopping tablet replica
I20260709 13:10:45.606719 26204 raft_consensus.cc:2243] T e74320a7302d4cd8b705dce5d385079a P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:45.608283 26204 raft_consensus.cc:2272] T e74320a7302d4cd8b705dce5d385079a P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:45.613214 26204 ts_tablet_manager.cc:1916] T e74320a7302d4cd8b705dce5d385079a P 1f539ba21487460085b837e7529a78ce: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:45.619335 25907 raft_consensus.cc:1275] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:45.625098 26166 consensus_queue.cc:1048] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:45.633335 26204 ts_tablet_manager.cc:1929] T e74320a7302d4cd8b705dce5d385079a P 1f539ba21487460085b837e7529a78ce: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:45.633924 26204 log.cc:1199] T e74320a7302d4cd8b705dce5d385079a P 1f539ba21487460085b837e7529a78ce: Deleting WAL directory at /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602598684750-24113-0/minicluster-data/ts-0-root/wals/e74320a7302d4cd8b705dce5d385079a
I20260709 13:10:45.635593 25115 catalog_manager.cc:5028] TS 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): tablet e74320a7302d4cd8b705dce5d385079a (table test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]) successfully deleted
I20260709 13:10:45.651736 25377 raft_consensus.cc:1275] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:45.657618 25298 raft_consensus.cc:1275] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:45.659180 26166 consensus_queue.cc:1048] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:10:45.662436 26147 consensus_queue.cc:1048] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:45.688572 26147 raft_consensus.cc:2955] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:45.691964 25370 raft_consensus.cc:2955] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:45.710927 25908 raft_consensus.cc:2955] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:45.717514 26197 raft_consensus.cc:1064] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468: attempting to promote NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 to VOTER
I20260709 13:10:45.720453 26197 consensus_queue.cc:237] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:45.729102 25127 catalog_manager.cc:5697] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 79d99c0e498349bda74127365219e468 reported cstate change: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:45.747574 25907 raft_consensus.cc:1275] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:45.749306 26126 consensus_queue.cc:1048] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:45.750589 25298 raft_consensus.cc:2955] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:45.756608 25300 raft_consensus.cc:1275] T 47228487a74240e9bc9bcd2e1d966ed6 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:45.759080 26187 consensus_queue.cc:1048] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:45.766820 26045 raft_consensus.cc:1064] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19: attempting to promote NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 to VOTER
I20260709 13:10:45.769054 26045 consensus_queue.cc:237] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:45.771633 25229 raft_consensus.cc:1275] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:45.783952 26164 consensus_queue.cc:1048] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:45.788105 25227 consensus_queue.cc:237] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:45.795744 25907 raft_consensus.cc:1275] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:45.798345 26147 consensus_queue.cc:1048] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:45.803970 26187 raft_consensus.cc:2955] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:45.807722 25302 raft_consensus.cc:1275] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:45.805160 25229 raft_consensus.cc:2955] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:45.807719 26207 raft_consensus.cc:2955] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79d99c0e498349bda74127365219e468 (127.23.140.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:45.811751 26165 consensus_queue.cc:1048] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:45.819271 25302 raft_consensus.cc:2955] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79d99c0e498349bda74127365219e468 (127.23.140.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:45.822032 25908 raft_consensus.cc:2955] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79d99c0e498349bda74127365219e468 (127.23.140.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:45.846240 25298 raft_consensus.cc:2955] T 47228487a74240e9bc9bcd2e1d966ed6 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:45.841970 25907 raft_consensus.cc:2955] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:45.847465 25126 catalog_manager.cc:5697] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce reported cstate change: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:45.867939 25370 consensus_queue.cc:237] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:45.874611 25115 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7e85321bc6774ed28bf79ebfd5eae6e0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:45.890588 25377 raft_consensus.cc:1275] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:45.895444 26196 consensus_queue.cc:1048] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:45.897007 25227 raft_consensus.cc:1275] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:45.899801 26187 consensus_queue.cc:1048] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:45.901880 25227 raft_consensus.cc:1275] T 60f74f1604ed4390892e271c77fd0f07 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:45.904520 25906 raft_consensus.cc:1275] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:45.902697 25907 raft_consensus.cc:1275] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:45.912358 26187 consensus_queue.cc:1048] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:45.914469 26150 consensus_queue.cc:1048] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:45.920600 26164 raft_consensus.cc:2955] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:45.930344 26179 consensus_queue.cc:1048] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:45.931769 25227 raft_consensus.cc:2955] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:45.940397 25128 catalog_manager.cc:5697] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: config changed from index 3 to 4, VOTER 79d99c0e498349bda74127365219e468 (127.23.140.67) evicted. New cstate: current_term: 1 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:45.972220 25907 raft_consensus.cc:2955] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:45.976315 25114 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 47228487a74240e9bc9bcd2e1d966ed6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:45.980264 25361 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e85321bc6774ed28bf79ebfd5eae6e0 with delete_type TABLET_DATA_TOMBSTONED (TS 79d99c0e498349bda74127365219e468 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36248
I20260709 13:10:45.990408 26215 raft_consensus.cc:2955] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:45.991284 25126 catalog_manager.cc:5697] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 reported cstate change: config changed from index 3 to 4, VOTER da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) evicted. New cstate: current_term: 1 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:45.994626 25370 raft_consensus.cc:2955] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:46.001407 26219 tablet_replica.cc:333] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 79d99c0e498349bda74127365219e468: stopping tablet replica
I20260709 13:10:46.002678 26219 raft_consensus.cc:2243] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:46.003849 26219 raft_consensus.cc:2272] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:46.007524 25229 raft_consensus.cc:2955] T 60f74f1604ed4390892e271c77fd0f07 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:46.011647 26219 ts_tablet_manager.cc:1916] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 79d99c0e498349bda74127365219e468: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:46.025596 25294 tablet_service.cc:1558] Processing DeleteTablet for tablet 47228487a74240e9bc9bcd2e1d966ed6 with delete_type TABLET_DATA_TOMBSTONED (TS da445ce82dc4467f95f4fa52297eaa19 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57250
I20260709 13:10:46.044296 26219 ts_tablet_manager.cc:1929] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 79d99c0e498349bda74127365219e468: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:46.044899 26219 log.cc:1199] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 79d99c0e498349bda74127365219e468: Deleting WAL directory at /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602598684750-24113-0/minicluster-data/ts-2-root/wals/7e85321bc6774ed28bf79ebfd5eae6e0
I20260709 13:10:46.046655 25114 catalog_manager.cc:5028] TS 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): tablet 7e85321bc6774ed28bf79ebfd5eae6e0 (table test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]) successfully deleted
I20260709 13:10:46.044377 25125 catalog_manager.cc:5697] T 60f74f1604ed4390892e271c77fd0f07 P 1f539ba21487460085b837e7529a78ce reported cstate change: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:46.054711 26220 tablet_replica.cc:333] T 47228487a74240e9bc9bcd2e1d966ed6 P da445ce82dc4467f95f4fa52297eaa19: stopping tablet replica
I20260709 13:10:46.060016 26220 raft_consensus.cc:2243] T 47228487a74240e9bc9bcd2e1d966ed6 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:46.061232 26220 raft_consensus.cc:2272] T 47228487a74240e9bc9bcd2e1d966ed6 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:46.063004 25907 raft_consensus.cc:2955] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:46.070138 26220 ts_tablet_manager.cc:1916] T 47228487a74240e9bc9bcd2e1d966ed6 P da445ce82dc4467f95f4fa52297eaa19: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:46.106186 26220 ts_tablet_manager.cc:1929] T 47228487a74240e9bc9bcd2e1d966ed6 P da445ce82dc4467f95f4fa52297eaa19: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:46.107187 26220 log.cc:1199] T 47228487a74240e9bc9bcd2e1d966ed6 P da445ce82dc4467f95f4fa52297eaa19: Deleting WAL directory at /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602598684750-24113-0/minicluster-data/ts-1-root/wals/47228487a74240e9bc9bcd2e1d966ed6
I20260709 13:10:46.109905 25113 catalog_manager.cc:5028] TS da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): tablet 47228487a74240e9bc9bcd2e1d966ed6 (table test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]) successfully deleted
I20260709 13:10:46.118258 25302 consensus_queue.cc:237] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:46.129698 25907 raft_consensus.cc:1275] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:46.132077 25370 raft_consensus.cc:1275] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:46.133653 26215 consensus_queue.cc:1048] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:46.135910 26196 consensus_queue.cc:1048] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:10:46.143559 26045 raft_consensus.cc:2955] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1f539ba21487460085b837e7529a78ce (127.23.140.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:46.153225 25906 raft_consensus.cc:2955] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1f539ba21487460085b837e7529a78ce (127.23.140.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:46.153065 25370 raft_consensus.cc:2955] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1f539ba21487460085b837e7529a78ce (127.23.140.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:46.161139 25113 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 60f74f1604ed4390892e271c77fd0f07 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:46.188261 25126 catalog_manager.cc:5697] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: config changed from index 3 to 4, VOTER 1f539ba21487460085b837e7529a78ce (127.23.140.65) evicted. New cstate: current_term: 1 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:46.202509 25211 tablet_service.cc:1558] Processing DeleteTablet for tablet 60f74f1604ed4390892e271c77fd0f07 with delete_type TABLET_DATA_TOMBSTONED (TS 1f539ba21487460085b837e7529a78ce not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58402
I20260709 13:10:46.218894 26222 tablet_replica.cc:333] T 60f74f1604ed4390892e271c77fd0f07 P 1f539ba21487460085b837e7529a78ce: stopping tablet replica
I20260709 13:10:46.220717 26222 raft_consensus.cc:2243] T 60f74f1604ed4390892e271c77fd0f07 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:46.222160 26222 raft_consensus.cc:2272] T 60f74f1604ed4390892e271c77fd0f07 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:46.225564 26222 ts_tablet_manager.cc:1916] T 60f74f1604ed4390892e271c77fd0f07 P 1f539ba21487460085b837e7529a78ce: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:46.243551 26222 ts_tablet_manager.cc:1929] T 60f74f1604ed4390892e271c77fd0f07 P 1f539ba21487460085b837e7529a78ce: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:46.244098 26222 log.cc:1199] T 60f74f1604ed4390892e271c77fd0f07 P 1f539ba21487460085b837e7529a78ce: Deleting WAL directory at /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602598684750-24113-0/minicluster-data/ts-0-root/wals/60f74f1604ed4390892e271c77fd0f07
I20260709 13:10:46.245684 25115 catalog_manager.cc:5028] TS 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): tablet 60f74f1604ed4390892e271c77fd0f07 (table test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]) successfully deleted
I20260709 13:10:47.265290 25228 consensus_queue.cc:237] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:47.270633 25299 raft_consensus.cc:1275] T 67fb9a2520c542d38f72828988ddc804 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:47.271463 25371 raft_consensus.cc:1275] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:47.271885 26140 consensus_queue.cc:1048] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:10:47.272801 25195 consensus_peers.cc:597] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce -> Peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085): Couldn't send request to peer 6c4b021f3f9e41adb75e870a08ad88b6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 67fb9a2520c542d38f72828988ddc804. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:47.273810 26147 consensus_queue.cc:1048] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:47.281535 26207 raft_consensus.cc:2955] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:47.282725 25299 raft_consensus.cc:2955] T 67fb9a2520c542d38f72828988ddc804 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:47.290731 25370 raft_consensus.cc:2955] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:47.298491 25228 consensus_queue.cc:237] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
W20260709 13:10:47.314855 25195 consensus_peers.cc:597] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce -> Peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085): Couldn't send request to peer 6c4b021f3f9e41adb75e870a08ad88b6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 135bcb58ad5b4506a12d94ef2b0d824c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:47.314553 25126 catalog_manager.cc:5697] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce reported cstate change: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New cstate: current_term: 1 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:47.316011 25299 raft_consensus.cc:1275] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:47.315346 25371 raft_consensus.cc:1275] T 135bcb58ad5b4506a12d94ef2b0d824c P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:47.317193 26226 consensus_queue.cc:1048] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:47.318178 26147 consensus_queue.cc:1048] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:47.327232 26226 raft_consensus.cc:2955] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:47.331928 25371 raft_consensus.cc:2955] T 135bcb58ad5b4506a12d94ef2b0d824c P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:47.338364 25299 raft_consensus.cc:2955] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:47.349411 25228 consensus_queue.cc:237] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:47.354418 25124 catalog_manager.cc:5697] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce reported cstate change: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New cstate: current_term: 1 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:47.367089 25297 raft_consensus.cc:1275] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:47.367357 25371 raft_consensus.cc:1275] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:47.368695 26147 consensus_queue.cc:1048] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:10:47.369498 25195 consensus_peers.cc:597] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce -> Peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085): Couldn't send request to peer 6c4b021f3f9e41adb75e870a08ad88b6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9cae37d53acd4bcdbe2fa0bd91b36cc4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:47.370452 26147 consensus_queue.cc:1048] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:47.379369 26207 raft_consensus.cc:2955] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:47.382459 25297 raft_consensus.cc:2955] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:47.395576 25299 consensus_queue.cc:237] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:47.403163 25126 catalog_manager.cc:5697] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce reported cstate change: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New cstate: current_term: 1 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:47.404098 25270 consensus_peers.cc:597] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 -> Peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085): Couldn't send request to peer 6c4b021f3f9e41adb75e870a08ad88b6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 51ecc4484385405c857b3bee1077c36a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:47.404717 25370 raft_consensus.cc:1275] T 51ecc4484385405c857b3bee1077c36a P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:47.404150 25371 raft_consensus.cc:2955] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:47.405627 25228 raft_consensus.cc:1275] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:47.408507 26229 consensus_queue.cc:1048] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:47.409337 26227 consensus_queue.cc:1048] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:47.422575 26228 raft_consensus.cc:2955] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:47.424053 25228 raft_consensus.cc:2955] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:47.456346 25371 raft_consensus.cc:2955] T 51ecc4484385405c857b3bee1077c36a P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:47.477064 25128 catalog_manager.cc:5697] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce reported cstate change: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New cstate: current_term: 1 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:47.753791 26249 ts_tablet_manager.cc:933] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6: Initiating tablet copy from peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361)
I20260709 13:10:47.755947 26249 tablet_copy_client.cc:323] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Beginning tablet copy session from remote peer at address 127.23.140.65:39361
I20260709 13:10:47.757562 25240 tablet_copy_service.cc:140] P 1f539ba21487460085b837e7529a78ce: Received BeginTabletCopySession request for tablet 135bcb58ad5b4506a12d94ef2b0d824c from peer 6c4b021f3f9e41adb75e870a08ad88b6 ({username='slave'} at 127.0.0.1:54000)
I20260709 13:10:47.758091 25240 tablet_copy_service.cc:161] P 1f539ba21487460085b837e7529a78ce: Beginning new tablet copy session on tablet 135bcb58ad5b4506a12d94ef2b0d824c from peer 6c4b021f3f9e41adb75e870a08ad88b6 at {username='slave'} at 127.0.0.1:54000: session id = 6c4b021f3f9e41adb75e870a08ad88b6-135bcb58ad5b4506a12d94ef2b0d824c
I20260709 13:10:47.762923 25240 tablet_copy_source_session.cc:215] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:47.765439 26249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 135bcb58ad5b4506a12d94ef2b0d824c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:47.778394 26249 tablet_copy_client.cc:806] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:47.778921 26249 tablet_copy_client.cc:670] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:47.782366 26249 tablet_copy_client.cc:538] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:47.789286 26251 ts_tablet_manager.cc:933] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6: Initiating tablet copy from peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:47.790197 26249 tablet_bootstrap.cc:492] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap starting.
I20260709 13:10:47.802613 26251 tablet_copy_client.cc:323] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Beginning tablet copy session from remote peer at address 127.23.140.66:33127
I20260709 13:10:47.804452 25315 tablet_copy_service.cc:140] P da445ce82dc4467f95f4fa52297eaa19: Received BeginTabletCopySession request for tablet 51ecc4484385405c857b3bee1077c36a from peer 6c4b021f3f9e41adb75e870a08ad88b6 ({username='slave'} at 127.0.0.1:46556)
I20260709 13:10:47.804986 25315 tablet_copy_service.cc:161] P da445ce82dc4467f95f4fa52297eaa19: Beginning new tablet copy session on tablet 51ecc4484385405c857b3bee1077c36a from peer 6c4b021f3f9e41adb75e870a08ad88b6 at {username='slave'} at 127.0.0.1:46556: session id = 6c4b021f3f9e41adb75e870a08ad88b6-51ecc4484385405c857b3bee1077c36a
I20260709 13:10:47.812649 25315 tablet_copy_source_session.cc:215] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:47.822077 26251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51ecc4484385405c857b3bee1077c36a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:47.836728 26253 ts_tablet_manager.cc:933] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6: Initiating tablet copy from peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361)
I20260709 13:10:47.838613 26249 tablet_bootstrap.cc:492] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:47.843063 26249 tablet_bootstrap.cc:492] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap complete.
I20260709 13:10:47.843848 26249 ts_tablet_manager.cc:1403] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent bootstrapping tablet: real 0.054s	user 0.022s	sys 0.004s
I20260709 13:10:47.848004 26249 raft_consensus.cc:359] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:47.848686 26249 raft_consensus.cc:740] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Initialized, Role: LEARNER
I20260709 13:10:47.849283 26249 consensus_queue.cc:260] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:47.850780 26253 tablet_copy_client.cc:323] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Beginning tablet copy session from remote peer at address 127.23.140.65:39361
I20260709 13:10:47.851720 26251 tablet_copy_client.cc:806] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:47.852444 25240 tablet_copy_service.cc:140] P 1f539ba21487460085b837e7529a78ce: Received BeginTabletCopySession request for tablet 9cae37d53acd4bcdbe2fa0bd91b36cc4 from peer 6c4b021f3f9e41adb75e870a08ad88b6 ({username='slave'} at 127.0.0.1:54000)
I20260709 13:10:47.852607 26251 tablet_copy_client.cc:670] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:47.853003 25240 tablet_copy_service.cc:161] P 1f539ba21487460085b837e7529a78ce: Beginning new tablet copy session on tablet 9cae37d53acd4bcdbe2fa0bd91b36cc4 from peer 6c4b021f3f9e41adb75e870a08ad88b6 at {username='slave'} at 127.0.0.1:54000: session id = 6c4b021f3f9e41adb75e870a08ad88b6-9cae37d53acd4bcdbe2fa0bd91b36cc4
I20260709 13:10:47.853870 26249 ts_tablet_manager.cc:1434] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:10:47.855943 25239 tablet_copy_service.cc:342] P 1f539ba21487460085b837e7529a78ce: Request end of tablet copy session 6c4b021f3f9e41adb75e870a08ad88b6-135bcb58ad5b4506a12d94ef2b0d824c received from {username='slave'} at 127.0.0.1:54000
I20260709 13:10:47.856330 25239 tablet_copy_service.cc:434] P 1f539ba21487460085b837e7529a78ce: ending tablet copy session 6c4b021f3f9e41adb75e870a08ad88b6-135bcb58ad5b4506a12d94ef2b0d824c on tablet 135bcb58ad5b4506a12d94ef2b0d824c with peer 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:10:47.865003 25240 tablet_copy_source_session.cc:215] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:47.866524 26251 tablet_copy_client.cc:538] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:47.866918 26249 ts_tablet_manager.cc:933] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6: Initiating tablet copy from peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361)
I20260709 13:10:47.874230 26253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cae37d53acd4bcdbe2fa0bd91b36cc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:47.875205 26249 tablet_copy_client.cc:323] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Beginning tablet copy session from remote peer at address 127.23.140.65:39361
I20260709 13:10:47.876703 25240 tablet_copy_service.cc:140] P 1f539ba21487460085b837e7529a78ce: Received BeginTabletCopySession request for tablet 67fb9a2520c542d38f72828988ddc804 from peer 6c4b021f3f9e41adb75e870a08ad88b6 ({username='slave'} at 127.0.0.1:54000)
I20260709 13:10:47.877195 25240 tablet_copy_service.cc:161] P 1f539ba21487460085b837e7529a78ce: Beginning new tablet copy session on tablet 67fb9a2520c542d38f72828988ddc804 from peer 6c4b021f3f9e41adb75e870a08ad88b6 at {username='slave'} at 127.0.0.1:54000: session id = 6c4b021f3f9e41adb75e870a08ad88b6-67fb9a2520c542d38f72828988ddc804
I20260709 13:10:47.884424 26251 tablet_bootstrap.cc:492] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap starting.
I20260709 13:10:47.885144 25240 tablet_copy_source_session.cc:215] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:47.890486 26253 tablet_copy_client.cc:806] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:47.891139 26253 tablet_copy_client.cc:670] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:47.892426 26249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67fb9a2520c542d38f72828988ddc804. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:10:47.899945 25929 debug-util.cc:398] Leaking SignalData structure 0x7b08002c2140 after lost signal to thread 24116
W20260709 13:10:47.900856 25929 debug-util.cc:398] Leaking SignalData structure 0x7b0800300a80 after lost signal to thread 25162
W20260709 13:10:47.901940 25929 debug-util.cc:398] Leaking SignalData structure 0x7b08002e8c20 after lost signal to thread 25254
W20260709 13:10:47.902890 25929 debug-util.cc:398] Leaking SignalData structure 0x7b08002e83c0 after lost signal to thread 25329
W20260709 13:10:47.903787 25929 debug-util.cc:398] Leaking SignalData structure 0x7b08001bcf00 after lost signal to thread 25403
W20260709 13:10:47.904758 25929 debug-util.cc:398] Leaking SignalData structure 0x7b0800306ea0 after lost signal to thread 25932
I20260709 13:10:47.912521 26253 tablet_copy_client.cc:538] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:47.927291 26249 tablet_copy_client.cc:806] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:47.928256 26249 tablet_copy_client.cc:670] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:47.938097 26249 tablet_copy_client.cc:538] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:47.951694 26249 tablet_bootstrap.cc:492] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap starting.
I20260709 13:10:47.956347 26251 tablet_bootstrap.cc:492] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:47.957906 26251 tablet_bootstrap.cc:492] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap complete.
I20260709 13:10:47.958668 26251 ts_tablet_manager.cc:1403] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent bootstrapping tablet: real 0.074s	user 0.023s	sys 0.031s
I20260709 13:10:47.966921 26251 raft_consensus.cc:359] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:47.968954 26251 raft_consensus.cc:740] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Initialized, Role: LEARNER
I20260709 13:10:47.969647 26251 consensus_queue.cc:260] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:47.971422 26253 tablet_bootstrap.cc:492] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap starting.
I20260709 13:10:47.979259 26251 ts_tablet_manager.cc:1434] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:10:47.987200 25315 tablet_copy_service.cc:342] P da445ce82dc4467f95f4fa52297eaa19: Request end of tablet copy session 6c4b021f3f9e41adb75e870a08ad88b6-51ecc4484385405c857b3bee1077c36a received from {username='slave'} at 127.0.0.1:46556
I20260709 13:10:47.987720 25315 tablet_copy_service.cc:434] P da445ce82dc4467f95f4fa52297eaa19: ending tablet copy session 6c4b021f3f9e41adb75e870a08ad88b6-51ecc4484385405c857b3bee1077c36a on tablet 51ecc4484385405c857b3bee1077c36a with peer 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:10:48.012679 26249 tablet_bootstrap.cc:492] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:48.013674 26249 tablet_bootstrap.cc:492] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap complete.
I20260709 13:10:48.016943 26249 ts_tablet_manager.cc:1403] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent bootstrapping tablet: real 0.065s	user 0.017s	sys 0.007s
I20260709 13:10:48.019834 26249 raft_consensus.cc:359] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:48.025894 26249 raft_consensus.cc:740] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Initialized, Role: LEARNER
I20260709 13:10:48.026605 26249 consensus_queue.cc:260] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:48.029134 26249 ts_tablet_manager.cc:1434] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.000s
I20260709 13:10:48.035277 25240 tablet_copy_service.cc:342] P 1f539ba21487460085b837e7529a78ce: Request end of tablet copy session 6c4b021f3f9e41adb75e870a08ad88b6-67fb9a2520c542d38f72828988ddc804 received from {username='slave'} at 127.0.0.1:54000
I20260709 13:10:48.035728 25240 tablet_copy_service.cc:434] P 1f539ba21487460085b837e7529a78ce: ending tablet copy session 6c4b021f3f9e41adb75e870a08ad88b6-67fb9a2520c542d38f72828988ddc804 on tablet 67fb9a2520c542d38f72828988ddc804 with peer 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:10:48.044005 26253 tablet_bootstrap.cc:492] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:48.044974 26253 tablet_bootstrap.cc:492] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap complete.
I20260709 13:10:48.045641 26253 ts_tablet_manager.cc:1403] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent bootstrapping tablet: real 0.074s	user 0.016s	sys 0.012s
I20260709 13:10:48.048244 26253 raft_consensus.cc:359] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:48.049104 26253 raft_consensus.cc:740] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Initialized, Role: LEARNER
I20260709 13:10:48.050208 26253 consensus_queue.cc:260] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:48.054916 26253 ts_tablet_manager.cc:1434] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:10:48.070065 25240 tablet_copy_service.cc:342] P 1f539ba21487460085b837e7529a78ce: Request end of tablet copy session 6c4b021f3f9e41adb75e870a08ad88b6-9cae37d53acd4bcdbe2fa0bd91b36cc4 received from {username='slave'} at 127.0.0.1:54000
I20260709 13:10:48.070508 25240 tablet_copy_service.cc:434] P 1f539ba21487460085b837e7529a78ce: ending tablet copy session 6c4b021f3f9e41adb75e870a08ad88b6-9cae37d53acd4bcdbe2fa0bd91b36cc4 on tablet 9cae37d53acd4bcdbe2fa0bd91b36cc4 with peer 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:10:48.226225 25908 raft_consensus.cc:1217] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:48.268354 25905 raft_consensus.cc:1217] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 13:10:48.359380 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 67441.1us
I20260709 13:10:48.406330 25905 raft_consensus.cc:1217] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 13:10:48.445524 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 53736.5us
I20260709 13:10:48.450580 25905 raft_consensus.cc:1217] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 13:10:48.479045 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 48852.6us
I20260709 13:10:48.793861 26207 raft_consensus.cc:1064] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce: attempting to promote NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 to VOTER
I20260709 13:10:48.795882 26207 consensus_queue.cc:237] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:48.802302 25905 raft_consensus.cc:1275] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:48.802735 25370 raft_consensus.cc:1275] T 135bcb58ad5b4506a12d94ef2b0d824c P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:48.804107 26265 consensus_queue.cc:1048] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:48.805037 26147 consensus_queue.cc:1048] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:48.802739 25299 raft_consensus.cc:1275] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:48.814831 26248 raft_consensus.cc:1064] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19: attempting to promote NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 to VOTER
I20260709 13:10:48.823310 26265 consensus_queue.cc:1048] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:48.823457 26248 consensus_queue.cc:237] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:48.828274 26147 raft_consensus.cc:2955] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:48.836354 25377 raft_consensus.cc:2955] T 135bcb58ad5b4506a12d94ef2b0d824c P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:48.845686 25905 raft_consensus.cc:1275] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:48.847347 26264 consensus_queue.cc:1048] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:48.851140 26226 raft_consensus.cc:1064] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce: attempting to promote NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 to VOTER
I20260709 13:10:48.853534 26226 consensus_queue.cc:237] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:48.861248 25905 raft_consensus.cc:2955] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:48.862890 25371 raft_consensus.cc:1275] T 51ecc4484385405c857b3bee1077c36a P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:48.864821 25229 raft_consensus.cc:1275] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:48.867579 26264 consensus_queue.cc:1048] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:48.870504 25124 catalog_manager.cc:5697] T 135bcb58ad5b4506a12d94ef2b0d824c P 79d99c0e498349bda74127365219e468 reported cstate change: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:48.884326 26264 consensus_queue.cc:1048] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:48.894868 25905 raft_consensus.cc:1275] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:48.895826 25371 raft_consensus.cc:1275] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:48.898144 26265 consensus_queue.cc:1048] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:48.903012 26226 consensus_queue.cc:1048] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:48.914695 25299 raft_consensus.cc:1275] T 67fb9a2520c542d38f72828988ddc804 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:48.918665 26265 raft_consensus.cc:1064] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce: attempting to promote NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 to VOTER
I20260709 13:10:48.921962 26265 consensus_queue.cc:237] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:48.931063 25905 raft_consensus.cc:1275] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:48.932909 26226 consensus_queue.cc:1048] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:48.934103 25371 raft_consensus.cc:1275] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:48.938812 26226 consensus_queue.cc:1048] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:48.942970 26226 consensus_queue.cc:1048] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:48.944641 26248 raft_consensus.cc:2955] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:48.958772 25908 raft_consensus.cc:2955] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:48.964066 25299 raft_consensus.cc:1275] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:48.965792 25377 raft_consensus.cc:2955] T 51ecc4484385405c857b3bee1077c36a P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:48.967512 25297 raft_consensus.cc:2955] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:48.972570 25229 raft_consensus.cc:2955] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:48.993041 26226 consensus_queue.cc:1048] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:49.034375 25126 catalog_manager.cc:5697] T 51ecc4484385405c857b3bee1077c36a P 79d99c0e498349bda74127365219e468 reported cstate change: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:49.043078 26274 raft_consensus.cc:2955] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:49.046051 26147 raft_consensus.cc:2955] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:49.081794 25300 raft_consensus.cc:2955] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
W20260709 13:10:49.089835 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 45039.9us
I20260709 13:10:49.104538 25225 consensus_queue.cc:237] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:49.107816 25372 raft_consensus.cc:2955] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:49.110409 25126 catalog_manager.cc:5697] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce reported cstate change: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:49.110988 25370 raft_consensus.cc:2955] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:49.110421 25905 raft_consensus.cc:2955] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:49.120831 25908 raft_consensus.cc:2955] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:49.130203 25907 raft_consensus.cc:1275] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:49.130805 25300 raft_consensus.cc:1275] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:49.131745 26226 consensus_queue.cc:1048] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:49.132560 26147 consensus_queue.cc:1048] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:49.138475 25299 raft_consensus.cc:2955] T 67fb9a2520c542d38f72828988ddc804 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:49.145730 26274 raft_consensus.cc:2955] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79d99c0e498349bda74127365219e468 (127.23.140.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:49.151562 25300 raft_consensus.cc:2955] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79d99c0e498349bda74127365219e468 (127.23.140.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:49.158547 25115 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 135bcb58ad5b4506a12d94ef2b0d824c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:49.161178 25905 raft_consensus.cc:2955] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79d99c0e498349bda74127365219e468 (127.23.140.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:49.167394 25128 catalog_manager.cc:5697] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:49.189947 25125 catalog_manager.cc:5697] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: config changed from index 3 to 4, VOTER 79d99c0e498349bda74127365219e468 (127.23.140.67) evicted. New cstate: current_term: 1 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:49.313133 25300 consensus_queue.cc:237] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:49.320581 25361 tablet_service.cc:1558] Processing DeleteTablet for tablet 135bcb58ad5b4506a12d94ef2b0d824c with delete_type TABLET_DATA_TOMBSTONED (TS 79d99c0e498349bda74127365219e468 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36248
I20260709 13:10:49.323835 26292 tablet_replica.cc:333] T 135bcb58ad5b4506a12d94ef2b0d824c P 79d99c0e498349bda74127365219e468: stopping tablet replica
I20260709 13:10:49.326097 26292 raft_consensus.cc:2243] T 135bcb58ad5b4506a12d94ef2b0d824c P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:49.328352 26292 raft_consensus.cc:2272] T 135bcb58ad5b4506a12d94ef2b0d824c P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:49.329448 25225 raft_consensus.cc:1275] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:49.330446 25905 raft_consensus.cc:1275] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:49.332216 26263 consensus_queue.cc:1048] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:49.333429 26292 ts_tablet_manager.cc:1916] T 135bcb58ad5b4506a12d94ef2b0d824c P 79d99c0e498349bda74127365219e468: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:49.333509 26264 consensus_queue.cc:1048] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:49.340474 25225 consensus_queue.cc:237] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:49.347580 25230 consensus_queue.cc:237] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:49.373107 25908 raft_consensus.cc:1275] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:49.375479 25907 raft_consensus.cc:1275] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:49.379357 26147 consensus_queue.cc:1048] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:49.381325 26147 consensus_queue.cc:1048] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:10:49.386132 25907 raft_consensus.cc:2955] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79d99c0e498349bda74127365219e468 (127.23.140.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:49.398667 25370 raft_consensus.cc:1275] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:49.406502 26274 raft_consensus.cc:2955] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:49.408733 25377 raft_consensus.cc:1275] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:49.421977 26207 consensus_queue.cc:1048] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:49.423774 26292 ts_tablet_manager.cc:1929] T 135bcb58ad5b4506a12d94ef2b0d824c P 79d99c0e498349bda74127365219e468: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:49.424507 26292 log.cc:1199] T 135bcb58ad5b4506a12d94ef2b0d824c P 79d99c0e498349bda74127365219e468: Deleting WAL directory at /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602598684750-24113-0/minicluster-data/ts-2-root/wals/135bcb58ad5b4506a12d94ef2b0d824c
I20260709 13:10:49.424724 26265 raft_consensus.cc:2955] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:49.426802 25114 catalog_manager.cc:5028] TS 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): tablet 135bcb58ad5b4506a12d94ef2b0d824c (table test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]) successfully deleted
I20260709 13:10:49.420845 26226 consensus_queue.cc:1048] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:49.428901 25906 raft_consensus.cc:2955] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:49.363560 26264 raft_consensus.cc:2955] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79d99c0e498349bda74127365219e468 (127.23.140.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:49.452965 25229 raft_consensus.cc:2955] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79d99c0e498349bda74127365219e468 (127.23.140.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:49.460450 25371 raft_consensus.cc:2955] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:49.478524 25113 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 51ecc4484385405c857b3bee1077c36a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:49.482460 25126 catalog_manager.cc:5697] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: config changed from index 3 to 4, VOTER da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) evicted. New cstate: current_term: 1 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:49.511559 25906 raft_consensus.cc:2955] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:49.513613 25115 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9cae37d53acd4bcdbe2fa0bd91b36cc4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:49.521854 25371 raft_consensus.cc:2955] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:49.529570 25124 catalog_manager.cc:5697] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce reported cstate change: config changed from index 3 to 4, VOTER 79d99c0e498349bda74127365219e468 (127.23.140.67) evicted. New cstate: current_term: 1 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:49.537202 25115 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 67fb9a2520c542d38f72828988ddc804 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:49.548787 25294 tablet_service.cc:1558] Processing DeleteTablet for tablet 9cae37d53acd4bcdbe2fa0bd91b36cc4 with delete_type TABLET_DATA_TOMBSTONED (TS da445ce82dc4467f95f4fa52297eaa19 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57250
I20260709 13:10:49.594525 26297 tablet_replica.cc:333] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P da445ce82dc4467f95f4fa52297eaa19: stopping tablet replica
I20260709 13:10:49.599614 25126 catalog_manager.cc:5697] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: config changed from index 3 to 4, VOTER da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) evicted. New cstate: current_term: 1 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:49.599347 26297 raft_consensus.cc:2243] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:49.604444 26297 raft_consensus.cc:2272] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:49.606030 25361 tablet_service.cc:1558] Processing DeleteTablet for tablet 51ecc4484385405c857b3bee1077c36a with delete_type TABLET_DATA_TOMBSTONED (TS 79d99c0e498349bda74127365219e468 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36248
I20260709 13:10:49.607012 26292 tablet_replica.cc:333] T 51ecc4484385405c857b3bee1077c36a P 79d99c0e498349bda74127365219e468: stopping tablet replica
I20260709 13:10:49.608112 26292 raft_consensus.cc:2243] T 51ecc4484385405c857b3bee1077c36a P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:49.608827 26292 raft_consensus.cc:2272] T 51ecc4484385405c857b3bee1077c36a P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:49.617978 25294 tablet_service.cc:1558] Processing DeleteTablet for tablet 67fb9a2520c542d38f72828988ddc804 with delete_type TABLET_DATA_TOMBSTONED (TS da445ce82dc4467f95f4fa52297eaa19 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57250
I20260709 13:10:49.619434 26297 ts_tablet_manager.cc:1916] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P da445ce82dc4467f95f4fa52297eaa19: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:49.626972 26292 ts_tablet_manager.cc:1916] T 51ecc4484385405c857b3bee1077c36a P 79d99c0e498349bda74127365219e468: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:49.642855 26297 ts_tablet_manager.cc:1929] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P da445ce82dc4467f95f4fa52297eaa19: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:49.643349 26297 log.cc:1199] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P da445ce82dc4467f95f4fa52297eaa19: Deleting WAL directory at /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602598684750-24113-0/minicluster-data/ts-1-root/wals/9cae37d53acd4bcdbe2fa0bd91b36cc4
I20260709 13:10:49.645272 26297 tablet_replica.cc:333] T 67fb9a2520c542d38f72828988ddc804 P da445ce82dc4467f95f4fa52297eaa19: stopping tablet replica
I20260709 13:10:49.646070 25113 catalog_manager.cc:5028] TS da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): tablet 9cae37d53acd4bcdbe2fa0bd91b36cc4 (table test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]) successfully deleted
I20260709 13:10:49.646349 26297 raft_consensus.cc:2243] T 67fb9a2520c542d38f72828988ddc804 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:49.647030 26297 raft_consensus.cc:2272] T 67fb9a2520c542d38f72828988ddc804 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:49.648145 26292 ts_tablet_manager.cc:1929] T 51ecc4484385405c857b3bee1077c36a P 79d99c0e498349bda74127365219e468: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:49.648561 26292 log.cc:1199] T 51ecc4484385405c857b3bee1077c36a P 79d99c0e498349bda74127365219e468: Deleting WAL directory at /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602598684750-24113-0/minicluster-data/ts-2-root/wals/51ecc4484385405c857b3bee1077c36a
I20260709 13:10:49.649973 25114 catalog_manager.cc:5028] TS 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): tablet 51ecc4484385405c857b3bee1077c36a (table test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]) successfully deleted
I20260709 13:10:49.650105 26297 ts_tablet_manager.cc:1916] T 67fb9a2520c542d38f72828988ddc804 P da445ce82dc4467f95f4fa52297eaa19: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:49.659475 26297 ts_tablet_manager.cc:1929] T 67fb9a2520c542d38f72828988ddc804 P da445ce82dc4467f95f4fa52297eaa19: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:49.659803 26297 log.cc:1199] T 67fb9a2520c542d38f72828988ddc804 P da445ce82dc4467f95f4fa52297eaa19: Deleting WAL directory at /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602598684750-24113-0/minicluster-data/ts-1-root/wals/67fb9a2520c542d38f72828988ddc804
I20260709 13:10:49.660997 25113 catalog_manager.cc:5028] TS da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): tablet 67fb9a2520c542d38f72828988ddc804 (table test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]) successfully deleted
I20260709 13:10:50.702469 25300 consensus_queue.cc:237] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:50.709605 25230 raft_consensus.cc:1275] T cc7fda8ece3144099df1f442c8012dfd P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:50.710894 26263 consensus_queue.cc:1048] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:50.711958 25371 raft_consensus.cc:1275] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:10:50.714468 25270 consensus_peers.cc:597] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 -> Peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085): Couldn't send request to peer 6c4b021f3f9e41adb75e870a08ad88b6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cc7fda8ece3144099df1f442c8012dfd. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:50.715270 26263 consensus_queue.cc:1048] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:50.720732 26298 raft_consensus.cc:2955] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:50.723959 25371 raft_consensus.cc:2955] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:50.728026 25230 raft_consensus.cc:2955] T cc7fda8ece3144099df1f442c8012dfd P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:50.737715 25300 consensus_queue.cc:237] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:50.737488 25126 catalog_manager.cc:5697] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 reported cstate change: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New cstate: current_term: 1 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
W20260709 13:10:50.746626 25270 consensus_peers.cc:597] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 -> Peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085): Couldn't send request to peer 6c4b021f3f9e41adb75e870a08ad88b6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: af9115771e334c95a7dec25c698514dc. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:50.747001 25225 raft_consensus.cc:1275] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:50.755808 25372 raft_consensus.cc:1275] T af9115771e334c95a7dec25c698514dc P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:50.756188 26301 consensus_queue.cc:1048] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:50.758463 26298 consensus_queue.cc:1048] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:50.773356 26263 raft_consensus.cc:2955] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:50.776121 25225 raft_consensus.cc:2955] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:50.776211 25372 raft_consensus.cc:2955] T af9115771e334c95a7dec25c698514dc P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:50.794067 25125 catalog_manager.cc:5697] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce reported cstate change: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New cstate: current_term: 1 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:50.799686 25225 consensus_queue.cc:237] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:50.809542 25372 raft_consensus.cc:1275] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:10:50.810184 25195 consensus_peers.cc:597] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce -> Peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085): Couldn't send request to peer 6c4b021f3f9e41adb75e870a08ad88b6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0eaedd90995b476890a2ea23d7089759. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:50.810425 25300 raft_consensus.cc:1275] T 0eaedd90995b476890a2ea23d7089759 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:50.811290 26207 consensus_queue.cc:1048] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:50.812696 26207 consensus_queue.cc:1048] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:50.827796 26207 raft_consensus.cc:2955] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:50.845922 25300 consensus_queue.cc:237] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:50.846216 25370 raft_consensus.cc:2955] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:50.852327 25125 catalog_manager.cc:5697] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce reported cstate change: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New cstate: current_term: 1 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:50.859623 25299 raft_consensus.cc:2955] T 0eaedd90995b476890a2ea23d7089759 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
W20260709 13:10:50.877802 25270 consensus_peers.cc:597] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 -> Peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085): Couldn't send request to peer 6c4b021f3f9e41adb75e870a08ad88b6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 56a9fdb76a7d494e81629b861acc1489. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:50.880264 25371 raft_consensus.cc:1275] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:50.882061 25225 raft_consensus.cc:1275] T 56a9fdb76a7d494e81629b861acc1489 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:50.885584 26311 consensus_queue.cc:1048] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:50.887370 26311 consensus_queue.cc:1048] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:50.900635 26263 raft_consensus.cc:2955] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:50.902777 25371 raft_consensus.cc:2955] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:50.903771 25225 raft_consensus.cc:2955] T 56a9fdb76a7d494e81629b861acc1489 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:50.918704 25125 catalog_manager.cc:5697] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New cstate: current_term: 1 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:51.168944 26321 ts_tablet_manager.cc:933] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6: Initiating tablet copy from peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:51.174400 26321 tablet_copy_client.cc:323] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Beginning tablet copy session from remote peer at address 127.23.140.66:33127
I20260709 13:10:51.176367 25315 tablet_copy_service.cc:140] P da445ce82dc4467f95f4fa52297eaa19: Received BeginTabletCopySession request for tablet cc7fda8ece3144099df1f442c8012dfd from peer 6c4b021f3f9e41adb75e870a08ad88b6 ({username='slave'} at 127.0.0.1:46556)
I20260709 13:10:51.176891 25315 tablet_copy_service.cc:161] P da445ce82dc4467f95f4fa52297eaa19: Beginning new tablet copy session on tablet cc7fda8ece3144099df1f442c8012dfd from peer 6c4b021f3f9e41adb75e870a08ad88b6 at {username='slave'} at 127.0.0.1:46556: session id = 6c4b021f3f9e41adb75e870a08ad88b6-cc7fda8ece3144099df1f442c8012dfd
I20260709 13:10:51.184147 25315 tablet_copy_source_session.cc:215] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:51.187553 26321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc7fda8ece3144099df1f442c8012dfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:51.203650 26321 tablet_copy_client.cc:806] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:51.204383 26321 tablet_copy_client.cc:670] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:51.209172 26321 tablet_copy_client.cc:538] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:51.215394 26321 tablet_bootstrap.cc:492] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap starting.
I20260709 13:10:51.233451 26321 tablet_bootstrap.cc:492] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:51.234221 26321 tablet_bootstrap.cc:492] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap complete.
I20260709 13:10:51.234782 26321 ts_tablet_manager.cc:1403] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.011s
I20260709 13:10:51.237071 26321 raft_consensus.cc:359] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:51.237669 26321 raft_consensus.cc:740] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Initialized, Role: LEARNER
I20260709 13:10:51.238281 26321 consensus_queue.cc:260] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:51.241202 26321 ts_tablet_manager.cc:1434] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.005s
I20260709 13:10:51.243287 25315 tablet_copy_service.cc:342] P da445ce82dc4467f95f4fa52297eaa19: Request end of tablet copy session 6c4b021f3f9e41adb75e870a08ad88b6-cc7fda8ece3144099df1f442c8012dfd received from {username='slave'} at 127.0.0.1:46556
I20260709 13:10:51.243741 25315 tablet_copy_service.cc:434] P da445ce82dc4467f95f4fa52297eaa19: ending tablet copy session 6c4b021f3f9e41adb75e870a08ad88b6-cc7fda8ece3144099df1f442c8012dfd on tablet cc7fda8ece3144099df1f442c8012dfd with peer 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:10:51.263706 26321 ts_tablet_manager.cc:933] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6: Initiating tablet copy from peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361)
I20260709 13:10:51.265389 26321 tablet_copy_client.cc:323] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Beginning tablet copy session from remote peer at address 127.23.140.65:39361
I20260709 13:10:51.267092 25240 tablet_copy_service.cc:140] P 1f539ba21487460085b837e7529a78ce: Received BeginTabletCopySession request for tablet 0eaedd90995b476890a2ea23d7089759 from peer 6c4b021f3f9e41adb75e870a08ad88b6 ({username='slave'} at 127.0.0.1:54000)
I20260709 13:10:51.267599 25240 tablet_copy_service.cc:161] P 1f539ba21487460085b837e7529a78ce: Beginning new tablet copy session on tablet 0eaedd90995b476890a2ea23d7089759 from peer 6c4b021f3f9e41adb75e870a08ad88b6 at {username='slave'} at 127.0.0.1:54000: session id = 6c4b021f3f9e41adb75e870a08ad88b6-0eaedd90995b476890a2ea23d7089759
I20260709 13:10:51.275103 25240 tablet_copy_source_session.cc:215] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:51.277803 26321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0eaedd90995b476890a2ea23d7089759. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:51.289690 26321 tablet_copy_client.cc:806] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:51.290309 26321 tablet_copy_client.cc:670] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:51.293897 26321 tablet_copy_client.cc:538] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:51.300500 26321 tablet_bootstrap.cc:492] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap starting.
I20260709 13:10:51.319463 26321 tablet_bootstrap.cc:492] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:51.320194 26321 tablet_bootstrap.cc:492] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap complete.
I20260709 13:10:51.320940 26321 ts_tablet_manager.cc:1403] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent bootstrapping tablet: real 0.021s	user 0.018s	sys 0.003s
I20260709 13:10:51.323253 26321 raft_consensus.cc:359] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:51.323860 26321 raft_consensus.cc:740] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Initialized, Role: LEARNER
I20260709 13:10:51.324347 26321 consensus_queue.cc:260] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:51.329358 26321 ts_tablet_manager.cc:1434] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:10:51.330935 25240 tablet_copy_service.cc:342] P 1f539ba21487460085b837e7529a78ce: Request end of tablet copy session 6c4b021f3f9e41adb75e870a08ad88b6-0eaedd90995b476890a2ea23d7089759 received from {username='slave'} at 127.0.0.1:54000
I20260709 13:10:51.331306 25240 tablet_copy_service.cc:434] P 1f539ba21487460085b837e7529a78ce: ending tablet copy session 6c4b021f3f9e41adb75e870a08ad88b6-0eaedd90995b476890a2ea23d7089759 on tablet 0eaedd90995b476890a2ea23d7089759 with peer 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:10:51.335577 26321 ts_tablet_manager.cc:933] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6: Initiating tablet copy from peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:51.339720 26321 tablet_copy_client.cc:323] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Beginning tablet copy session from remote peer at address 127.23.140.66:33127
I20260709 13:10:51.341516 25315 tablet_copy_service.cc:140] P da445ce82dc4467f95f4fa52297eaa19: Received BeginTabletCopySession request for tablet 56a9fdb76a7d494e81629b861acc1489 from peer 6c4b021f3f9e41adb75e870a08ad88b6 ({username='slave'} at 127.0.0.1:46556)
I20260709 13:10:51.342051 25315 tablet_copy_service.cc:161] P da445ce82dc4467f95f4fa52297eaa19: Beginning new tablet copy session on tablet 56a9fdb76a7d494e81629b861acc1489 from peer 6c4b021f3f9e41adb75e870a08ad88b6 at {username='slave'} at 127.0.0.1:46556: session id = 6c4b021f3f9e41adb75e870a08ad88b6-56a9fdb76a7d494e81629b861acc1489
I20260709 13:10:51.351029 25315 tablet_copy_source_session.cc:215] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:51.355572 26328 ts_tablet_manager.cc:933] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6: Initiating tablet copy from peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:51.355784 26321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56a9fdb76a7d494e81629b861acc1489. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:51.360136 26328 tablet_copy_client.cc:323] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Beginning tablet copy session from remote peer at address 127.23.140.66:33127
I20260709 13:10:51.362558 25315 tablet_copy_service.cc:140] P da445ce82dc4467f95f4fa52297eaa19: Received BeginTabletCopySession request for tablet af9115771e334c95a7dec25c698514dc from peer 6c4b021f3f9e41adb75e870a08ad88b6 ({username='slave'} at 127.0.0.1:46556)
I20260709 13:10:51.363065 25315 tablet_copy_service.cc:161] P da445ce82dc4467f95f4fa52297eaa19: Beginning new tablet copy session on tablet af9115771e334c95a7dec25c698514dc from peer 6c4b021f3f9e41adb75e870a08ad88b6 at {username='slave'} at 127.0.0.1:46556: session id = 6c4b021f3f9e41adb75e870a08ad88b6-af9115771e334c95a7dec25c698514dc
I20260709 13:10:51.373210 25315 tablet_copy_source_session.cc:215] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:51.373637 26321 tablet_copy_client.cc:806] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:51.374514 26321 tablet_copy_client.cc:670] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:51.376147 26328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af9115771e334c95a7dec25c698514dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:51.377729 26321 tablet_copy_client.cc:538] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:51.383632 26321 tablet_bootstrap.cc:492] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap starting.
I20260709 13:10:51.392493 26328 tablet_copy_client.cc:806] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:51.393148 26328 tablet_copy_client.cc:670] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:51.397688 26328 tablet_copy_client.cc:538] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:51.413013 26328 tablet_bootstrap.cc:492] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap starting.
I20260709 13:10:51.440907 26321 tablet_bootstrap.cc:492] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:51.441876 26321 tablet_bootstrap.cc:492] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap complete.
I20260709 13:10:51.442464 26321 ts_tablet_manager.cc:1403] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent bootstrapping tablet: real 0.059s	user 0.029s	sys 0.018s
I20260709 13:10:51.444440 26321 raft_consensus.cc:359] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:51.445020 26321 raft_consensus.cc:740] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Initialized, Role: LEARNER
I20260709 13:10:51.445457 26321 consensus_queue.cc:260] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:51.449156 26321 ts_tablet_manager.cc:1434] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:10:51.450910 25315 tablet_copy_service.cc:342] P da445ce82dc4467f95f4fa52297eaa19: Request end of tablet copy session 6c4b021f3f9e41adb75e870a08ad88b6-56a9fdb76a7d494e81629b861acc1489 received from {username='slave'} at 127.0.0.1:46556
I20260709 13:10:51.451321 25315 tablet_copy_service.cc:434] P da445ce82dc4467f95f4fa52297eaa19: ending tablet copy session 6c4b021f3f9e41adb75e870a08ad88b6-56a9fdb76a7d494e81629b861acc1489 on tablet 56a9fdb76a7d494e81629b861acc1489 with peer 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:10:51.482499 26328 tablet_bootstrap.cc:492] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:51.483464 26328 tablet_bootstrap.cc:492] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap complete.
I20260709 13:10:51.484138 26328 ts_tablet_manager.cc:1403] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent bootstrapping tablet: real 0.071s	user 0.016s	sys 0.022s
I20260709 13:10:51.487221 26328 raft_consensus.cc:359] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:51.488095 26328 raft_consensus.cc:740] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Initialized, Role: LEARNER
I20260709 13:10:51.488719 26328 consensus_queue.cc:260] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:51.493906 26328 ts_tablet_manager.cc:1434] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.006s
I20260709 13:10:51.495441 25315 tablet_copy_service.cc:342] P da445ce82dc4467f95f4fa52297eaa19: Request end of tablet copy session 6c4b021f3f9e41adb75e870a08ad88b6-af9115771e334c95a7dec25c698514dc received from {username='slave'} at 127.0.0.1:46556
I20260709 13:10:51.495880 25315 tablet_copy_service.cc:434] P da445ce82dc4467f95f4fa52297eaa19: ending tablet copy session 6c4b021f3f9e41adb75e870a08ad88b6-af9115771e334c95a7dec25c698514dc on tablet af9115771e334c95a7dec25c698514dc with peer 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:10:51.686329 25907 raft_consensus.cc:1217] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:51.854382 25905 raft_consensus.cc:1217] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:51.884608 25905 raft_consensus.cc:1217] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:51.889983 25905 raft_consensus.cc:1217] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:52.163691 26263 raft_consensus.cc:1064] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19: attempting to promote NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 to VOTER
I20260709 13:10:52.166036 26263 consensus_queue.cc:237] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:52.172247 25907 raft_consensus.cc:1275] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:52.173543 26263 consensus_queue.cc:1048] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:52.173898 25370 raft_consensus.cc:1275] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:52.175804 25225 raft_consensus.cc:1275] T cc7fda8ece3144099df1f442c8012dfd P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:52.175737 26333 consensus_queue.cc:1048] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:52.184054 26263 consensus_queue.cc:1048] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:52.201349 26301 raft_consensus.cc:2955] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:52.205832 25907 raft_consensus.cc:2955] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:52.217130 25370 raft_consensus.cc:2955] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:52.221566 25225 raft_consensus.cc:2955] T cc7fda8ece3144099df1f442c8012dfd P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:52.228978 25126 catalog_manager.cc:5697] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:52.264050 25300 consensus_queue.cc:237] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:52.274721 25907 raft_consensus.cc:1275] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:52.275235 25370 raft_consensus.cc:1275] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:52.276448 26301 consensus_queue.cc:1048] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:52.277551 26334 consensus_queue.cc:1048] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:52.284078 26301 raft_consensus.cc:2955] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1f539ba21487460085b837e7529a78ce (127.23.140.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:52.287874 25907 raft_consensus.cc:2955] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1f539ba21487460085b837e7529a78ce (127.23.140.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:52.288064 25370 raft_consensus.cc:2955] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1f539ba21487460085b837e7529a78ce (127.23.140.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:52.299242 25113 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cc7fda8ece3144099df1f442c8012dfd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:52.305847 25128 catalog_manager.cc:5697] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: config changed from index 3 to 4, VOTER 1f539ba21487460085b837e7529a78ce (127.23.140.65) evicted. New cstate: current_term: 1 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:52.321530 25211 tablet_service.cc:1558] Processing DeleteTablet for tablet cc7fda8ece3144099df1f442c8012dfd with delete_type TABLET_DATA_TOMBSTONED (TS 1f539ba21487460085b837e7529a78ce not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58402
I20260709 13:10:52.325924 26343 tablet_replica.cc:333] T cc7fda8ece3144099df1f442c8012dfd P 1f539ba21487460085b837e7529a78ce: stopping tablet replica
I20260709 13:10:52.326892 26343 raft_consensus.cc:2243] T cc7fda8ece3144099df1f442c8012dfd P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.327530 26343 raft_consensus.cc:2272] T cc7fda8ece3144099df1f442c8012dfd P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.332365 26343 ts_tablet_manager.cc:1916] T cc7fda8ece3144099df1f442c8012dfd P 1f539ba21487460085b837e7529a78ce: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:52.352178 26343 ts_tablet_manager.cc:1929] T cc7fda8ece3144099df1f442c8012dfd P 1f539ba21487460085b837e7529a78ce: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:52.352607 26343 log.cc:1199] T cc7fda8ece3144099df1f442c8012dfd P 1f539ba21487460085b837e7529a78ce: Deleting WAL directory at /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602598684750-24113-0/minicluster-data/ts-0-root/wals/cc7fda8ece3144099df1f442c8012dfd
I20260709 13:10:52.354236 25115 catalog_manager.cc:5028] TS 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): tablet cc7fda8ece3144099df1f442c8012dfd (table test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]) successfully deleted
I20260709 13:10:52.373005 26263 raft_consensus.cc:1064] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19: attempting to promote NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 to VOTER
I20260709 13:10:52.375408 26263 consensus_queue.cc:237] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:52.381199 25907 raft_consensus.cc:1275] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:52.382624 26301 consensus_queue.cc:1048] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:52.385493 25371 raft_consensus.cc:1275] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:52.385557 25230 raft_consensus.cc:1275] T 56a9fdb76a7d494e81629b861acc1489 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:52.386627 26263 consensus_queue.cc:1048] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:52.388214 26263 consensus_queue.cc:1048] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:10:52.409449 26301 raft_consensus.cc:2955] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:52.416348 26316 raft_consensus.cc:1064] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce: attempting to promote NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 to VOTER
I20260709 13:10:52.415493 25230 raft_consensus.cc:2955] T 56a9fdb76a7d494e81629b861acc1489 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:52.421558 25905 raft_consensus.cc:2955] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:52.422860 25371 raft_consensus.cc:2955] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:52.426977 26316 consensus_queue.cc:237] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:52.446501 25128 catalog_manager.cc:5697] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 reported cstate change: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:52.462113 26334 raft_consensus.cc:1064] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19: attempting to promote NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 to VOTER
I20260709 13:10:52.481616 26334 consensus_queue.cc:237] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:10:52.486563 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 64049.8us
I20260709 13:10:52.506531 25907 raft_consensus.cc:1275] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:52.510685 25370 raft_consensus.cc:1275] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:52.513960 26207 consensus_queue.cc:1048] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:52.514698 26349 consensus_queue.cc:1048] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:52.520490 25300 raft_consensus.cc:1275] T 0eaedd90995b476890a2ea23d7089759 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:52.535565 25300 consensus_queue.cc:237] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:52.541392 25907 raft_consensus.cc:1275] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:52.542901 25371 raft_consensus.cc:1275] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:52.543100 26301 consensus_queue.cc:1048] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:52.552739 26207 raft_consensus.cc:2955] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:52.553867 26301 consensus_queue.cc:1048] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:52.556406 26263 raft_consensus.cc:2955] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1f539ba21487460085b837e7529a78ce (127.23.140.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:52.559067 25371 raft_consensus.cc:2955] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:52.571624 25905 raft_consensus.cc:2955] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1f539ba21487460085b837e7529a78ce (127.23.140.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:52.579859 25907 raft_consensus.cc:2955] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:52.583441 25230 raft_consensus.cc:1275] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:52.584930 26334 consensus_queue.cc:1048] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:52.586483 25124 catalog_manager.cc:5697] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce reported cstate change: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:52.595729 26349 consensus_queue.cc:1048] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:52.602957 25371 raft_consensus.cc:1275] T af9115771e334c95a7dec25c698514dc P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:52.603811 25907 raft_consensus.cc:1275] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:52.605975 26355 consensus_queue.cc:1048] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:52.603878 25370 raft_consensus.cc:2955] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1f539ba21487460085b837e7529a78ce (127.23.140.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:52.610036 26354 consensus_queue.cc:1048] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:52.611799 25113 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 56a9fdb76a7d494e81629b861acc1489 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:52.625669 25125 catalog_manager.cc:5697] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: config changed from index 3 to 4, VOTER 1f539ba21487460085b837e7529a78ce (127.23.140.65) evicted. New cstate: current_term: 1 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:52.630411 26355 raft_consensus.cc:2955] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:52.633826 25299 raft_consensus.cc:2955] T 0eaedd90995b476890a2ea23d7089759 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:52.645463 25371 raft_consensus.cc:2955] T af9115771e334c95a7dec25c698514dc P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:52.648991 25225 raft_consensus.cc:2955] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:52.650394 25211 tablet_service.cc:1558] Processing DeleteTablet for tablet 56a9fdb76a7d494e81629b861acc1489 with delete_type TABLET_DATA_TOMBSTONED (TS 1f539ba21487460085b837e7529a78ce not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58402
I20260709 13:10:52.651314 26343 tablet_replica.cc:333] T 56a9fdb76a7d494e81629b861acc1489 P 1f539ba21487460085b837e7529a78ce: stopping tablet replica
I20260709 13:10:52.652294 26343 raft_consensus.cc:2243] T 56a9fdb76a7d494e81629b861acc1489 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.653061 26343 raft_consensus.cc:2272] T 56a9fdb76a7d494e81629b861acc1489 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.663862 25230 consensus_queue.cc:237] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:52.666435 26343 ts_tablet_manager.cc:1916] T 56a9fdb76a7d494e81629b861acc1489 P 1f539ba21487460085b837e7529a78ce: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:52.670360 25906 raft_consensus.cc:1275] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:52.671959 26207 consensus_queue.cc:1048] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:52.681031 25370 raft_consensus.cc:1275] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:52.680572 26349 raft_consensus.cc:2955] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:52.682349 25906 raft_consensus.cc:2955] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:52.689261 26316 consensus_queue.cc:1048] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:52.693238 25115 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0eaedd90995b476890a2ea23d7089759 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:52.695966 25370 raft_consensus.cc:2955] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:52.688834 25126 catalog_manager.cc:5697] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce reported cstate change: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:52.712149 25906 raft_consensus.cc:2955] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:52.724367 25124 catalog_manager.cc:5697] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: config changed from index 3 to 4, VOTER da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) evicted. New cstate: current_term: 1 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:52.717898 26343 ts_tablet_manager.cc:1929] T 56a9fdb76a7d494e81629b861acc1489 P 1f539ba21487460085b837e7529a78ce: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:52.727097 26343 log.cc:1199] T 56a9fdb76a7d494e81629b861acc1489 P 1f539ba21487460085b837e7529a78ce: Deleting WAL directory at /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602598684750-24113-0/minicluster-data/ts-0-root/wals/56a9fdb76a7d494e81629b861acc1489
I20260709 13:10:52.728600 25115 catalog_manager.cc:5028] TS 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): tablet 56a9fdb76a7d494e81629b861acc1489 (table test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]) successfully deleted
I20260709 13:10:52.737272 25294 tablet_service.cc:1558] Processing DeleteTablet for tablet 0eaedd90995b476890a2ea23d7089759 with delete_type TABLET_DATA_TOMBSTONED (TS da445ce82dc4467f95f4fa52297eaa19 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57250
I20260709 13:10:52.737629 25303 consensus_queue.cc:237] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:52.746786 25907 raft_consensus.cc:1275] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:52.751652 26301 consensus_queue.cc:1048] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:52.754549 25225 raft_consensus.cc:1275] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:52.756197 26354 consensus_queue.cc:1048] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:52.760982 26301 raft_consensus.cc:2955] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79d99c0e498349bda74127365219e468 (127.23.140.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:52.762830 25907 raft_consensus.cc:2955] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79d99c0e498349bda74127365219e468 (127.23.140.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:52.767040 26360 tablet_replica.cc:333] T 0eaedd90995b476890a2ea23d7089759 P da445ce82dc4467f95f4fa52297eaa19: stopping tablet replica
I20260709 13:10:52.768188 26360 raft_consensus.cc:2243] T 0eaedd90995b476890a2ea23d7089759 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.767820 25225 raft_consensus.cc:2955] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79d99c0e498349bda74127365219e468 (127.23.140.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:52.769037 26360 raft_consensus.cc:2272] T 0eaedd90995b476890a2ea23d7089759 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.772249 26360 ts_tablet_manager.cc:1916] T 0eaedd90995b476890a2ea23d7089759 P da445ce82dc4467f95f4fa52297eaa19: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:52.782449 25126 catalog_manager.cc:5697] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: config changed from index 3 to 4, VOTER 79d99c0e498349bda74127365219e468 (127.23.140.67) evicted. New cstate: current_term: 1 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:52.790643 26360 ts_tablet_manager.cc:1929] T 0eaedd90995b476890a2ea23d7089759 P da445ce82dc4467f95f4fa52297eaa19: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:52.791147 26360 log.cc:1199] T 0eaedd90995b476890a2ea23d7089759 P da445ce82dc4467f95f4fa52297eaa19: Deleting WAL directory at /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602598684750-24113-0/minicluster-data/ts-1-root/wals/0eaedd90995b476890a2ea23d7089759
I20260709 13:10:52.793286 25113 catalog_manager.cc:5028] TS da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): tablet 0eaedd90995b476890a2ea23d7089759 (table test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]) successfully deleted
I20260709 13:10:52.793978 25113 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet af9115771e334c95a7dec25c698514dc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:52.802772 25361 tablet_service.cc:1558] Processing DeleteTablet for tablet af9115771e334c95a7dec25c698514dc with delete_type TABLET_DATA_TOMBSTONED (TS 79d99c0e498349bda74127365219e468 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36248
I20260709 13:10:52.806584 26361 tablet_replica.cc:333] T af9115771e334c95a7dec25c698514dc P 79d99c0e498349bda74127365219e468: stopping tablet replica
I20260709 13:10:52.807816 26361 raft_consensus.cc:2243] T af9115771e334c95a7dec25c698514dc P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.808413 26361 raft_consensus.cc:2272] T af9115771e334c95a7dec25c698514dc P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.810715 26361 ts_tablet_manager.cc:1916] T af9115771e334c95a7dec25c698514dc P 79d99c0e498349bda74127365219e468: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:52.821403 26361 ts_tablet_manager.cc:1929] T af9115771e334c95a7dec25c698514dc P 79d99c0e498349bda74127365219e468: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:52.821791 26361 log.cc:1199] T af9115771e334c95a7dec25c698514dc P 79d99c0e498349bda74127365219e468: Deleting WAL directory at /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602598684750-24113-0/minicluster-data/ts-2-root/wals/af9115771e334c95a7dec25c698514dc
I20260709 13:10:52.824530 25114 catalog_manager.cc:5028] TS 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): tablet af9115771e334c95a7dec25c698514dc (table test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]) successfully deleted
I20260709 13:10:53.503168 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:53.556497 25225 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c"
dest_uuid: "1f539ba21487460085b837e7529a78ce"
mode: GRACEFUL
new_leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
 from {username='slave'} at 127.0.0.1:45014
I20260709 13:10:53.557227 25225 raft_consensus.cc:606] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Received request to transfer leadership to TS 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:10:53.559652 25225 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0"
dest_uuid: "1f539ba21487460085b837e7529a78ce"
mode: GRACEFUL
new_leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
 from {username='slave'} at 127.0.0.1:45014
I20260709 13:10:53.560138 25225 raft_consensus.cc:606] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Received request to transfer leadership to TS 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:10:53.563254 25225 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4"
dest_uuid: "1f539ba21487460085b837e7529a78ce"
mode: GRACEFUL
new_leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
 from {username='slave'} at 127.0.0.1:45014
I20260709 13:10:53.563665 25225 raft_consensus.cc:606] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Received request to transfer leadership to TS 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:10:53.579775 25370 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff"
dest_uuid: "79d99c0e498349bda74127365219e468"
mode: GRACEFUL
new_leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
 from {username='slave'} at 127.0.0.1:59274
I20260709 13:10:53.580333 25370 raft_consensus.cc:606] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 2 LEADER]: Received request to transfer leadership to TS 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:10:53.582985 25370 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1"
dest_uuid: "79d99c0e498349bda74127365219e468"
mode: GRACEFUL
new_leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
 from {username='slave'} at 127.0.0.1:59274
I20260709 13:10:53.583473 25370 raft_consensus.cc:606] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Received request to transfer leadership to TS 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:10:53.599388 25303 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211"
dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
mode: GRACEFUL
new_leader_uuid: "1f539ba21487460085b837e7529a78ce"
 from {username='slave'} at 127.0.0.1:35660
I20260709 13:10:53.599932 25303 raft_consensus.cc:606] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Received request to transfer leadership to TS 1f539ba21487460085b837e7529a78ce
I20260709 13:10:53.601382 24113 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:10:53.602702 24113 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:53.643245 26299 raft_consensus.cc:993] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468: : Instructing follower 6c4b021f3f9e41adb75e870a08ad88b6 to start an election
I20260709 13:10:53.643759 26299 raft_consensus.cc:1081] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 2 LEADER]: Signalling peer 6c4b021f3f9e41adb75e870a08ad88b6 to start an election
I20260709 13:10:53.645123 25907 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff"
dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
 from {username='slave'} at 127.0.0.1:50060
I20260709 13:10:53.645540 25907 raft_consensus.cc:493] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:53.645861 25907 raft_consensus.cc:3060] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:53.650015 25907 raft_consensus.cc:515] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:53.652259 25907 leader_election.cc:290] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 3 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:53.653505 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:10:53.653813 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:10:53.654211 25230 raft_consensus.cc:3060] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:53.654320 25372 raft_consensus.cc:3055] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:53.654652 25372 raft_consensus.cc:740] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:10:53.655392 25372 consensus_queue.cc:260] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:53.656563 25372 raft_consensus.cc:3060] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:53.660642 25230 raft_consensus.cc:2468] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 3.
I20260709 13:10:53.661880 25874 leader_election.cc:304] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:10:53.664186 25372 raft_consensus.cc:2468] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 3.
I20260709 13:10:53.664309 26367 raft_consensus.cc:2804] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:53.665732 26367 raft_consensus.cc:697] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:10:53.667245 26367 consensus_queue.cc:237] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:53.668031 26207 raft_consensus.cc:993] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce: : Instructing follower 6c4b021f3f9e41adb75e870a08ad88b6 to start an election
I20260709 13:10:53.668532 26207 raft_consensus.cc:1081] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Signalling peer 6c4b021f3f9e41adb75e870a08ad88b6 to start an election
I20260709 13:10:53.669955 25906 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4"
dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
 from {username='slave'} at 127.0.0.1:50056
I20260709 13:10:53.670440 25906 raft_consensus.cc:493] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:53.670773 25906 raft_consensus.cc:3060] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:53.679737 25906 raft_consensus.cc:515] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:53.679435 25126 catalog_manager.cc:5697] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 2 to 3, leader changed from 79d99c0e498349bda74127365219e468 (127.23.140.67) to 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68). New cstate: current_term: 3 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:53.682300 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:10:53.682894 25229 raft_consensus.cc:3055] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:53.683177 25229 raft_consensus.cc:740] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:10:53.683912 25229 consensus_queue.cc:260] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:53.686337 25229 raft_consensus.cc:3060] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:53.688392 26366 raft_consensus.cc:993] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19: : Instructing follower 1f539ba21487460085b837e7529a78ce to start an election
I20260709 13:10:53.688869 26263 raft_consensus.cc:1081] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Signalling peer 1f539ba21487460085b837e7529a78ce to start an election
I20260709 13:10:53.690474 25225 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211"
dest_uuid: "1f539ba21487460085b837e7529a78ce"
 from {username='slave'} at 127.0.0.1:58422
I20260709 13:10:53.691017 25225 raft_consensus.cc:493] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:53.691377 25225 raft_consensus.cc:3060] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:53.695509 25229 raft_consensus.cc:2468] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 2.
I20260709 13:10:53.697023 25906 leader_election.cc:290] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:53.698222 25874 leader_election.cc:304] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:10:53.700829 25225 raft_consensus.cc:515] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:53.701469 26367 raft_consensus.cc:2804] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:53.702015 26367 raft_consensus.cc:697] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:10:53.702841 26367 consensus_queue.cc:237] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:53.703226 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:10:53.706168 25372 raft_consensus.cc:3060] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:53.714661 25372 raft_consensus.cc:2468] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 2.
I20260709 13:10:53.716379 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:10:53.716581 25225 leader_election.cc:290] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:53.716961 25303 raft_consensus.cc:3055] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:53.717306 25303 raft_consensus.cc:740] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:10:53.717965 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:10:53.718022 25303 consensus_queue.cc:260] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:53.718632 25372 raft_consensus.cc:3060] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:53.719156 25303 raft_consensus.cc:3060] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:53.725888 25303 raft_consensus.cc:2468] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 2.
I20260709 13:10:53.725979 25372 raft_consensus.cc:2468] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 2.
I20260709 13:10:53.727810 25194 leader_election.cc:304] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:10:53.728636 26207 raft_consensus.cc:2804] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:53.729121 26207 raft_consensus.cc:697] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 2 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:10:53.729281 25126 catalog_manager.cc:5697] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 1 to 2, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68). New cstate: current_term: 2 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:53.730037 26207 consensus_queue.cc:237] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:53.744153 26316 raft_consensus.cc:993] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce: : Instructing follower 6c4b021f3f9e41adb75e870a08ad88b6 to start an election
I20260709 13:10:53.744635 26207 raft_consensus.cc:1081] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Signalling peer 6c4b021f3f9e41adb75e870a08ad88b6 to start an election
I20260709 13:10:53.744889 25126 catalog_manager.cc:5697] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 1 to 2, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 2 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:53.746188 25906 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c"
dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
 from {username='slave'} at 127.0.0.1:50056
I20260709 13:10:53.746719 25906 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:53.747010 25906 raft_consensus.cc:3060] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:53.753046 25906 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:53.755126 25906 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:53.756105 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:10:53.756366 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:10:53.756680 25303 raft_consensus.cc:3060] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:53.756911 25225 raft_consensus.cc:3055] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:53.757232 25225 raft_consensus.cc:740] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:10:53.757928 25225 consensus_queue.cc:260] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:53.759078 25225 raft_consensus.cc:3060] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:53.761719 25303 raft_consensus.cc:2468] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 2.
I20260709 13:10:53.764245 25872 leader_election.cc:304] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:10:53.764961 26367 raft_consensus.cc:2804] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:53.765420 26367 raft_consensus.cc:697] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:10:53.766286 26367 consensus_queue.cc:237] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:53.767758 25225 raft_consensus.cc:2468] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 2.
I20260709 13:10:53.775518 25124 catalog_manager.cc:5697] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 1 to 2, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68). New cstate: current_term: 2 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:53.868253 25372 consensus_queue.cc:237] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:53.875383 25229 raft_consensus.cc:1275] T 35ae6d72e4154149b3d1721e2214570a P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:53.875548 25303 raft_consensus.cc:1275] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:10:53.875854 25344 consensus_peers.cc:597] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 -> Peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085): Couldn't send request to peer 6c4b021f3f9e41adb75e870a08ad88b6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 35ae6d72e4154149b3d1721e2214570a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:53.876868 26377 consensus_queue.cc:1048] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:53.877693 26299 consensus_queue.cc:1048] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:53.885188 26299 raft_consensus.cc:2955] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:53.886848 25229 raft_consensus.cc:2955] T 35ae6d72e4154149b3d1721e2214570a P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:53.891855 26316 raft_consensus.cc:993] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce: : Instructing follower 6c4b021f3f9e41adb75e870a08ad88b6 to start an election
I20260709 13:10:53.892287 26316 raft_consensus.cc:1081] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Signalling peer 6c4b021f3f9e41adb75e870a08ad88b6 to start an election
I20260709 13:10:53.893846 25906 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0"
dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
 from {username='slave'} at 127.0.0.1:50056
I20260709 13:10:53.894347 25906 raft_consensus.cc:493] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:53.894662 25906 raft_consensus.cc:3060] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:53.897573 25303 raft_consensus.cc:2955] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:53.903375 25124 catalog_manager.cc:5697] T 35ae6d72e4154149b3d1721e2214570a P 1f539ba21487460085b837e7529a78ce reported cstate change: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New cstate: current_term: 1 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:53.905045 25906 raft_consensus.cc:515] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:53.907774 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:10:53.908289 25225 raft_consensus.cc:3055] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:53.908582 25225 raft_consensus.cc:740] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:10:53.909293 25225 consensus_queue.cc:260] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:53.909422 25229 consensus_queue.cc:237] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:53.910326 25225 raft_consensus.cc:3060] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:53.911342 25906 leader_election.cc:290] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:53.913811 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:10:53.914319 25300 raft_consensus.cc:3060] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:53.923595 25303 raft_consensus.cc:1275] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:10:53.924048 25195 consensus_peers.cc:597] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce -> Peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085): Couldn't send request to peer 6c4b021f3f9e41adb75e870a08ad88b6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 25e0218933774b319104f23505937179. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:53.924242 25372 raft_consensus.cc:1275] T 25e0218933774b319104f23505937179 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:53.928843 25225 raft_consensus.cc:2468] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 2.
I20260709 13:10:53.928838 26349 consensus_queue.cc:1048] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:53.931067 25300 raft_consensus.cc:2468] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 2.
I20260709 13:10:53.932174 25872 leader_election.cc:304] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:10:53.933146 26349 consensus_queue.cc:1048] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:53.933436 26367 raft_consensus.cc:2804] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:53.933996 26367 raft_consensus.cc:697] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:10:53.934811 26367 consensus_queue.cc:237] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:53.957737 26349 raft_consensus.cc:2955] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:53.958976 25300 raft_consensus.cc:2955] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:53.959740 25126 catalog_manager.cc:5697] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 1 to 2, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68). New cstate: current_term: 2 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:53.978462 26299 raft_consensus.cc:993] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468: : Instructing follower 6c4b021f3f9e41adb75e870a08ad88b6 to start an election
I20260709 13:10:53.978899 26299 raft_consensus.cc:1081] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Signalling peer 6c4b021f3f9e41adb75e870a08ad88b6 to start an election
I20260709 13:10:53.980507 25906 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1"
dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
 from {username='slave'} at 127.0.0.1:50060
I20260709 13:10:53.981009 25906 raft_consensus.cc:493] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:53.981341 25906 raft_consensus.cc:3060] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:53.981591 25372 raft_consensus.cc:2955] T 25e0218933774b319104f23505937179 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:54.023767 25906 raft_consensus.cc:515] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:54.025794 25906 leader_election.cc:290] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:54.030030 25124 catalog_manager.cc:5697] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce reported cstate change: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New cstate: current_term: 1 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:54.044449 25370 consensus_queue.cc:237] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:54.047387 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:10:54.048075 25225 raft_consensus.cc:3060] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:54.055730 25225 raft_consensus.cc:2468] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 2.
I20260709 13:10:54.058822 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:10:54.058291 25874 leader_election.cc:304] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:10:54.060104 26367 raft_consensus.cc:2804] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:54.060577 26367 raft_consensus.cc:697] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:10:54.059442 25371 raft_consensus.cc:3055] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:54.061169 25371 raft_consensus.cc:740] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:10:54.061403 26367 consensus_queue.cc:237] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:54.061990 25371 consensus_queue.cc:260] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:54.063374 25371 raft_consensus.cc:3060] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:54.070087 25344 consensus_peers.cc:597] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 -> Peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085): Couldn't send request to peer 6c4b021f3f9e41adb75e870a08ad88b6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 11892dffe99a496ebf3d98773631357c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:54.071280 25303 raft_consensus.cc:1275] T 11892dffe99a496ebf3d98773631357c P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:54.073905 25124 catalog_manager.cc:5697] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 1 to 2, leader changed from 79d99c0e498349bda74127365219e468 (127.23.140.67) to 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68). New cstate: current_term: 2 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:54.076797 25371 raft_consensus.cc:2468] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 2.
I20260709 13:10:54.075896 25230 raft_consensus.cc:1275] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:54.083403 26290 consensus_queue.cc:1048] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:54.094702 26382 consensus_queue.cc:1048] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:54.108341 26382 raft_consensus.cc:2955] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:54.112013 25300 raft_consensus.cc:2955] T 11892dffe99a496ebf3d98773631357c P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:54.111357 25303 raft_consensus.cc:1275] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:10:54.123126 25175 auto_rebalancer.cc:629] Failed to schedule move for tablet f616a884a8284b1f8fd7c51549e8a211: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:10:54.124169 26207 consensus_queue.cc:1048] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:54.132609 25371 raft_consensus.cc:1275] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:54.134935 25124 catalog_manager.cc:5697] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 reported cstate change: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New cstate: current_term: 1 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:54.136529 26207 consensus_queue.cc:1048] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:54.135221 25230 raft_consensus.cc:2955] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:54.143632 25370 raft_consensus.cc:1275] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:54.146452 25229 raft_consensus.cc:1275] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:54.146225 26367 consensus_queue.cc:1048] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:54.148918 26367 consensus_queue.cc:1048] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:54.213135 25303 raft_consensus.cc:1275] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:54.217013 26367 consensus_queue.cc:1048] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:54.221315 25372 raft_consensus.cc:1275] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:54.223552 26367 consensus_queue.cc:1048] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:54.275395 25225 raft_consensus.cc:1275] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:54.277695 26368 consensus_queue.cc:1048] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:10:54.347195 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 81944.1us
I20260709 13:10:54.353204 25228 raft_consensus.cc:1275] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:54.357693 26398 consensus_queue.cc:1048] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:54.464250 26407 ts_tablet_manager.cc:933] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6: Initiating tablet copy from peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:54.467115 26407 tablet_copy_client.cc:323] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Beginning tablet copy session from remote peer at address 127.23.140.67:34091
I20260709 13:10:54.469046 25371 raft_consensus.cc:1275] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:54.469208 25389 tablet_copy_service.cc:140] P 79d99c0e498349bda74127365219e468: Received BeginTabletCopySession request for tablet 35ae6d72e4154149b3d1721e2214570a from peer 6c4b021f3f9e41adb75e870a08ad88b6 ({username='slave'} at 127.0.0.1:56308)
I20260709 13:10:54.469811 25389 tablet_copy_service.cc:161] P 79d99c0e498349bda74127365219e468: Beginning new tablet copy session on tablet 35ae6d72e4154149b3d1721e2214570a from peer 6c4b021f3f9e41adb75e870a08ad88b6 at {username='slave'} at 127.0.0.1:56308: session id = 6c4b021f3f9e41adb75e870a08ad88b6-35ae6d72e4154149b3d1721e2214570a
I20260709 13:10:54.470309 26398 consensus_queue.cc:1048] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:54.484395 25389 tablet_copy_source_session.cc:215] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:54.487759 26407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35ae6d72e4154149b3d1721e2214570a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:54.507167 26407 tablet_copy_client.cc:806] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:54.507725 26407 tablet_copy_client.cc:670] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:54.512888 26410 ts_tablet_manager.cc:933] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6: Initiating tablet copy from peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361)
I20260709 13:10:54.519847 26407 tablet_copy_client.cc:538] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:54.521404 25225 raft_consensus.cc:1275] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:54.523447 26398 consensus_queue.cc:1048] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:54.530272 25225 raft_consensus.cc:1275] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:54.531174 26407 tablet_bootstrap.cc:492] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap starting.
I20260709 13:10:54.531788 26398 consensus_queue.cc:1048] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:54.538244 26410 tablet_copy_client.cc:323] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Beginning tablet copy session from remote peer at address 127.23.140.65:39361
I20260709 13:10:54.542531 25240 tablet_copy_service.cc:140] P 1f539ba21487460085b837e7529a78ce: Received BeginTabletCopySession request for tablet 25e0218933774b319104f23505937179 from peer 6c4b021f3f9e41adb75e870a08ad88b6 ({username='slave'} at 127.0.0.1:54000)
I20260709 13:10:54.543063 25240 tablet_copy_service.cc:161] P 1f539ba21487460085b837e7529a78ce: Beginning new tablet copy session on tablet 25e0218933774b319104f23505937179 from peer 6c4b021f3f9e41adb75e870a08ad88b6 at {username='slave'} at 127.0.0.1:54000: session id = 6c4b021f3f9e41adb75e870a08ad88b6-25e0218933774b319104f23505937179
I20260709 13:10:54.551753 25240 tablet_copy_source_session.cc:215] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:54.556595 26410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25e0218933774b319104f23505937179. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:54.563140 25298 raft_consensus.cc:1275] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:54.564584 26398 consensus_queue.cc:1048] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:54.584256 26410 tablet_copy_client.cc:806] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:54.584901 26410 tablet_copy_client.cc:670] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:54.587612 26407 tablet_bootstrap.cc:492] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:54.588356 26407 tablet_bootstrap.cc:492] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap complete.
I20260709 13:10:54.588891 26407 ts_tablet_manager.cc:1403] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent bootstrapping tablet: real 0.058s	user 0.019s	sys 0.002s
I20260709 13:10:54.591348 26407 raft_consensus.cc:359] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:54.592232 26407 raft_consensus.cc:740] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Initialized, Role: LEARNER
I20260709 13:10:54.592948 26407 consensus_queue.cc:260] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:54.595398 26407 ts_tablet_manager.cc:1434] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.003s
I20260709 13:10:54.597154 25389 tablet_copy_service.cc:342] P 79d99c0e498349bda74127365219e468: Request end of tablet copy session 6c4b021f3f9e41adb75e870a08ad88b6-35ae6d72e4154149b3d1721e2214570a received from {username='slave'} at 127.0.0.1:56308
I20260709 13:10:54.597576 25389 tablet_copy_service.cc:434] P 79d99c0e498349bda74127365219e468: ending tablet copy session 6c4b021f3f9e41adb75e870a08ad88b6-35ae6d72e4154149b3d1721e2214570a on tablet 35ae6d72e4154149b3d1721e2214570a with peer 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:10:54.612387 26407 ts_tablet_manager.cc:933] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6: Initiating tablet copy from peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:54.605846 26410 tablet_copy_client.cc:538] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:54.603674 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:54.627516 26410 tablet_bootstrap.cc:492] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap starting.
I20260709 13:10:54.653818 26407 tablet_copy_client.cc:323] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Beginning tablet copy session from remote peer at address 127.23.140.67:34091
I20260709 13:10:54.657090 25389 tablet_copy_service.cc:140] P 79d99c0e498349bda74127365219e468: Received BeginTabletCopySession request for tablet 11892dffe99a496ebf3d98773631357c from peer 6c4b021f3f9e41adb75e870a08ad88b6 ({username='slave'} at 127.0.0.1:56308)
I20260709 13:10:54.657598 25389 tablet_copy_service.cc:161] P 79d99c0e498349bda74127365219e468: Beginning new tablet copy session on tablet 11892dffe99a496ebf3d98773631357c from peer 6c4b021f3f9e41adb75e870a08ad88b6 at {username='slave'} at 127.0.0.1:56308: session id = 6c4b021f3f9e41adb75e870a08ad88b6-11892dffe99a496ebf3d98773631357c
I20260709 13:10:54.665503 25389 tablet_copy_source_session.cc:215] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:54.665902 26410 tablet_bootstrap.cc:492] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:54.666854 26410 tablet_bootstrap.cc:492] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap complete.
I20260709 13:10:54.669344 26410 ts_tablet_manager.cc:1403] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent bootstrapping tablet: real 0.042s	user 0.026s	sys 0.002s
I20260709 13:10:54.668673 26407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11892dffe99a496ebf3d98773631357c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:54.672304 26410 raft_consensus.cc:359] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:54.673110 26410 raft_consensus.cc:740] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Initialized, Role: LEARNER
I20260709 13:10:54.673843 26410 consensus_queue.cc:260] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:54.676311 26410 ts_tablet_manager.cc:1434] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:10:54.685091 25240 tablet_copy_service.cc:342] P 1f539ba21487460085b837e7529a78ce: Request end of tablet copy session 6c4b021f3f9e41adb75e870a08ad88b6-25e0218933774b319104f23505937179 received from {username='slave'} at 127.0.0.1:54000
I20260709 13:10:54.685528 25240 tablet_copy_service.cc:434] P 1f539ba21487460085b837e7529a78ce: ending tablet copy session 6c4b021f3f9e41adb75e870a08ad88b6-25e0218933774b319104f23505937179 on tablet 25e0218933774b319104f23505937179 with peer 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:10:54.695278 26407 tablet_copy_client.cc:806] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:54.695947 26407 tablet_copy_client.cc:670] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:54.702445 26407 tablet_copy_client.cc:538] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:54.711241 26407 tablet_bootstrap.cc:492] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap starting.
I20260709 13:10:54.723327 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:54.732430 26407 tablet_bootstrap.cc:492] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:54.733398 26407 tablet_bootstrap.cc:492] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap complete.
I20260709 13:10:54.734066 26407 ts_tablet_manager.cc:1403] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent bootstrapping tablet: real 0.023s	user 0.018s	sys 0.005s
I20260709 13:10:54.736963 26407 raft_consensus.cc:359] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:54.737840 26407 raft_consensus.cc:740] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Initialized, Role: LEARNER
I20260709 13:10:54.738469 26407 consensus_queue.cc:260] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:54.740984 26407 ts_tablet_manager.cc:1434] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:10:54.744819 25389 tablet_copy_service.cc:342] P 79d99c0e498349bda74127365219e468: Request end of tablet copy session 6c4b021f3f9e41adb75e870a08ad88b6-11892dffe99a496ebf3d98773631357c received from {username='slave'} at 127.0.0.1:56308
I20260709 13:10:54.745226 25389 tablet_copy_service.cc:434] P 79d99c0e498349bda74127365219e468: ending tablet copy session 6c4b021f3f9e41adb75e870a08ad88b6-11892dffe99a496ebf3d98773631357c on tablet 11892dffe99a496ebf3d98773631357c with peer 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:10:54.772238 25371 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0"
dest_uuid: "79d99c0e498349bda74127365219e468"
mode: GRACEFUL
new_leader_uuid: "1f539ba21487460085b837e7529a78ce"
 from {username='slave'} at 127.0.0.1:59274
I20260709 13:10:54.772768 25371 raft_consensus.cc:606] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Received request to transfer leadership to TS 1f539ba21487460085b837e7529a78ce
I20260709 13:10:54.775039 25371 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a"
dest_uuid: "79d99c0e498349bda74127365219e468"
mode: GRACEFUL
new_leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
 from {username='slave'} at 127.0.0.1:59274
I20260709 13:10:54.775552 25371 raft_consensus.cc:606] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Received request to transfer leadership to TS 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:10:54.777855 25229 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c"
dest_uuid: "1f539ba21487460085b837e7529a78ce"
mode: GRACEFUL
new_leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
 from {username='slave'} at 127.0.0.1:45014
I20260709 13:10:54.778363 25229 raft_consensus.cc:606] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Received request to transfer leadership to TS 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:10:54.788071 25371 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05"
dest_uuid: "79d99c0e498349bda74127365219e468"
mode: GRACEFUL
new_leader_uuid: "1f539ba21487460085b837e7529a78ce"
 from {username='slave'} at 127.0.0.1:59274
I20260709 13:10:54.788661 25371 raft_consensus.cc:606] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Received request to transfer leadership to TS 1f539ba21487460085b837e7529a78ce
I20260709 13:10:54.792124 25303 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93"
dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
mode: GRACEFUL
new_leader_uuid: "79d99c0e498349bda74127365219e468"
 from {username='slave'} at 127.0.0.1:35660
I20260709 13:10:54.792560 25303 raft_consensus.cc:606] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Received request to transfer leadership to TS 79d99c0e498349bda74127365219e468
I20260709 13:10:54.793830 24113 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:54.796182 24113 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:54.858487 26377 raft_consensus.cc:993] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468: : Instructing follower 1f539ba21487460085b837e7529a78ce to start an election
I20260709 13:10:54.859004 26377 raft_consensus.cc:1081] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Signalling peer 1f539ba21487460085b837e7529a78ce to start an election
I20260709 13:10:54.860456 25225 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05"
dest_uuid: "1f539ba21487460085b837e7529a78ce"
 from {username='slave'} at 127.0.0.1:58418
I20260709 13:10:54.860947 25225 raft_consensus.cc:493] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:54.861263 25225 raft_consensus.cc:3060] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:54.867511 25225 raft_consensus.cc:515] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:54.869109 25225 leader_election.cc:290] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:54.870023 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:10:54.870039 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:10:54.870673 25303 raft_consensus.cc:3060] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:54.870769 25372 raft_consensus.cc:3055] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:54.871140 25372 raft_consensus.cc:740] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:10:54.871853 25372 consensus_queue.cc:260] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:54.873275 25372 raft_consensus.cc:3060] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:54.875777 25303 raft_consensus.cc:2468] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 2.
I20260709 13:10:54.877389 25194 leader_election.cc:304] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:10:54.878275 26406 raft_consensus.cc:2804] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:54.878772 26406 raft_consensus.cc:697] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 2 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:10:54.881111 25372 raft_consensus.cc:2468] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 2.
I20260709 13:10:54.879671 26406 consensus_queue.cc:237] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:54.905326 25126 catalog_manager.cc:5697] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 1 to 2, leader changed from 79d99c0e498349bda74127365219e468 (127.23.140.67) to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 2 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:54.920086 26377 raft_consensus.cc:993] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468: : Instructing follower 1f539ba21487460085b837e7529a78ce to start an election
I20260709 13:10:54.920562 26377 raft_consensus.cc:1081] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Signalling peer 1f539ba21487460085b837e7529a78ce to start an election
I20260709 13:10:54.922029 25225 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0"
dest_uuid: "1f539ba21487460085b837e7529a78ce"
 from {username='slave'} at 127.0.0.1:58418
I20260709 13:10:54.922505 25225 raft_consensus.cc:493] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:54.922834 25225 raft_consensus.cc:3060] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:54.929134 25225 raft_consensus.cc:515] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:54.930956 25225 leader_election.cc:290] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:54.933435 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:10:54.933666 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:10:54.934000 25303 raft_consensus.cc:3060] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:54.934509 25372 raft_consensus.cc:3055] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:54.934830 25372 raft_consensus.cc:740] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:10:54.935515 25372 consensus_queue.cc:260] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:54.936601 25372 raft_consensus.cc:3060] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:54.942741 25372 raft_consensus.cc:2468] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 2.
I20260709 13:10:54.943722 25195 leader_election.cc:304] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:10:54.945392 26406 raft_consensus.cc:2804] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:54.945902 26406 raft_consensus.cc:697] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 2 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:10:54.947049 26349 raft_consensus.cc:993] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce: : Instructing follower 6c4b021f3f9e41adb75e870a08ad88b6 to start an election
I20260709 13:10:54.946758 26406 consensus_queue.cc:237] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:54.947535 26349 raft_consensus.cc:1081] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Signalling peer 6c4b021f3f9e41adb75e870a08ad88b6 to start an election
I20260709 13:10:54.949970 25906 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c"
dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
 from {username='slave'} at 127.0.0.1:50056
I20260709 13:10:54.950438 25906 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:54.950724 25906 raft_consensus.cc:3060] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:54.953028 25303 raft_consensus.cc:2468] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 2.
I20260709 13:10:54.958297 25906 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:54.960705 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:10:54.961191 25906 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:54.961308 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:10:54.978607 25303 raft_consensus.cc:3060] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:54.961236 25225 raft_consensus.cc:3055] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:54.964188 25905 raft_consensus.cc:1217] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:54.980405 25225 raft_consensus.cc:740] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:10:54.981142 25225 consensus_queue.cc:260] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:54.983021 25225 raft_consensus.cc:3060] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:54.991259 25303 raft_consensus.cc:2468] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 2.
I20260709 13:10:54.989351 25124 catalog_manager.cc:5697] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 1 to 2, leader changed from 79d99c0e498349bda74127365219e468 (127.23.140.67) to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 2 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:54.995281 25225 raft_consensus.cc:2468] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 2.
I20260709 13:10:54.996491 25874 leader_election.cc:304] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:10:54.997215 26402 raft_consensus.cc:2804] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:54.997684 26402 raft_consensus.cc:697] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:10:54.998682 26402 consensus_queue.cc:237] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:55.012949 25906 raft_consensus.cc:1217] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:55.016611 25124 catalog_manager.cc:5697] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 1 to 2, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68). New cstate: current_term: 2 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:55.062399 25906 raft_consensus.cc:1217] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:55.152642 26290 raft_consensus.cc:993] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468: : Instructing follower 6c4b021f3f9e41adb75e870a08ad88b6 to start an election
I20260709 13:10:55.153151 26290 raft_consensus.cc:1081] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Signalling peer 6c4b021f3f9e41adb75e870a08ad88b6 to start an election
I20260709 13:10:55.154909 25905 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a"
dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
 from {username='slave'} at 127.0.0.1:50060
I20260709 13:10:55.155412 25905 raft_consensus.cc:493] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:55.155732 25905 raft_consensus.cc:3060] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:55.168286 25905 raft_consensus.cc:515] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:55.170895 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:10:55.171442 25225 raft_consensus.cc:3060] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:55.176410 26354 raft_consensus.cc:993] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19: : Instructing follower 79d99c0e498349bda74127365219e468 to start an election
I20260709 13:10:55.177011 26263 raft_consensus.cc:1081] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Signalling peer 79d99c0e498349bda74127365219e468 to start an election
I20260709 13:10:55.177954 25225 raft_consensus.cc:2468] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 2.
I20260709 13:10:55.178505 25372 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93"
dest_uuid: "79d99c0e498349bda74127365219e468"
 from {username='slave'} at 127.0.0.1:36254
I20260709 13:10:55.179065 25874 leader_election.cc:304] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:10:55.179847 26402 raft_consensus.cc:2804] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:55.180135 25905 leader_election.cc:290] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:55.180303 26402 raft_consensus.cc:697] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:10:55.181293 26402 consensus_queue.cc:237] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:55.179232 25372 raft_consensus.cc:493] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:55.182333 25372 raft_consensus.cc:3060] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:55.184162 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:10:55.184696 25370 raft_consensus.cc:3055] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:55.184965 25370 raft_consensus.cc:740] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:10:55.185655 25370 consensus_queue.cc:260] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:55.186802 25370 raft_consensus.cc:3060] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:55.193264 25370 raft_consensus.cc:2468] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 2.
I20260709 13:10:55.195509 25372 raft_consensus.cc:515] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:55.198343 25372 leader_election.cc:290] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:55.198483 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:10:55.199268 25225 raft_consensus.cc:3060] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:55.198483 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:10:55.199994 25303 raft_consensus.cc:3055] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:55.200318 25303 raft_consensus.cc:740] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:10:55.201040 25303 consensus_queue.cc:260] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:55.202450 25303 raft_consensus.cc:3060] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:55.207968 25225 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 2.
I20260709 13:10:55.209168 25345 leader_election.cc:304] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:10:55.210018 26377 raft_consensus.cc:2804] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:55.210502 26377 raft_consensus.cc:697] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 2 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:10:55.211138 25303 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 2.
I20260709 13:10:55.211344 26377 consensus_queue.cc:237] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:55.216629 25124 catalog_manager.cc:5697] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 1 to 2, leader changed from 79d99c0e498349bda74127365219e468 (127.23.140.67) to 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68). New cstate: current_term: 2 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:55.224395 25128 catalog_manager.cc:5697] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 1 to 2, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 2 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:55.345366 25372 raft_consensus.cc:1275] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:55.346655 26207 consensus_queue.cc:1048] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:55.383539 25303 raft_consensus.cc:1275] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:55.387036 26207 consensus_queue.cc:1048] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:55.391520 26382 raft_consensus.cc:1064] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468: attempting to promote NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 to VOTER
I20260709 13:10:55.392217 25299 raft_consensus.cc:1275] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:55.395624 26382 consensus_queue.cc:237] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:55.402976 26406 consensus_queue.cc:1048] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:55.431663 25372 raft_consensus.cc:1275] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:55.437883 26406 consensus_queue.cc:1048] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:55.456697 25905 raft_consensus.cc:1275] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:55.457587 25298 raft_consensus.cc:1275] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:55.458186 26382 consensus_queue.cc:1048] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:55.458653 25225 raft_consensus.cc:1275] T 35ae6d72e4154149b3d1721e2214570a P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:55.459175 26290 consensus_queue.cc:1048] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:55.462347 25225 raft_consensus.cc:1275] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:55.463855 26382 consensus_queue.cc:1048] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:55.464499 26402 consensus_queue.cc:1048] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:55.513038 26382 raft_consensus.cc:1064] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468: attempting to promote NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 to VOTER
I20260709 13:10:55.515626 26382 consensus_queue.cc:237] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:55.532176 26290 raft_consensus.cc:2955] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:55.540912 25230 raft_consensus.cc:2955] T 35ae6d72e4154149b3d1721e2214570a P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
W20260709 13:10:55.566462 26436 log.cc:927] Time spent T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 13:10:55.572033 25905 raft_consensus.cc:2955] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:55.575546 26349 raft_consensus.cc:1064] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce: attempting to promote NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 to VOTER
I20260709 13:10:55.579573 26349 consensus_queue.cc:237] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:55.620088 25128 catalog_manager.cc:5697] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:55.632174 25298 raft_consensus.cc:1275] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:10:55.633919 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 48817us
I20260709 13:10:55.642844 26367 consensus_queue.cc:1048] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:55.658675 25230 raft_consensus.cc:1275] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:55.664369 26443 consensus_queue.cc:1048] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:55.666721 25230 raft_consensus.cc:1275] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:10:55.667462 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 84095.7us
I20260709 13:10:55.669651 25299 raft_consensus.cc:1275] T 11892dffe99a496ebf3d98773631357c P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:55.676821 26367 consensus_queue.cc:1048] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:55.684569 25299 raft_consensus.cc:1275] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:55.685886 26451 consensus_queue.cc:1048] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:55.691735 25299 raft_consensus.cc:2955] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:55.710964 25372 raft_consensus.cc:1275] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:55.724669 25303 raft_consensus.cc:1275] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:55.726755 26316 consensus_queue.cc:1048] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:55.735813 25905 raft_consensus.cc:1275] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:55.738654 25905 raft_consensus.cc:1275] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:55.745157 26451 consensus_queue.cc:1048] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:55.746552 26316 consensus_queue.cc:1048] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:55.751350 26450 consensus_queue.cc:1048] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:55.775585 26448 consensus_queue.cc:1048] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:55.777086 25370 consensus_queue.cc:237] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:55.779806 25372 raft_consensus.cc:1275] T 25e0218933774b319104f23505937179 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:55.797140 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:55.800494 25298 raft_consensus.cc:1275] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:55.804641 25906 raft_consensus.cc:1275] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:55.805397 26406 raft_consensus.cc:2955] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:55.810904 26446 raft_consensus.cc:2955] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:55.816479 26316 consensus_queue.cc:1048] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:55.828691 25229 raft_consensus.cc:1275] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:55.830112 25230 raft_consensus.cc:2955] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:55.833956 26451 consensus_queue.cc:1048] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:55.836727 26443 consensus_queue.cc:1048] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:55.872639 25299 raft_consensus.cc:2955] T 11892dffe99a496ebf3d98773631357c P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:55.882548 26448 consensus_queue.cc:1048] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:55.884706 26446 raft_consensus.cc:2955] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1f539ba21487460085b837e7529a78ce (127.23.140.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:55.878446 25298 raft_consensus.cc:2955] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:55.894271 25906 raft_consensus.cc:2955] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:55.899027 25124 catalog_manager.cc:5697] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce reported cstate change: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:55.914711 25907 raft_consensus.cc:2955] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1f539ba21487460085b837e7529a78ce (127.23.140.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:55.924646 25377 raft_consensus.cc:2955] T 25e0218933774b319104f23505937179 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:55.941383 25126 catalog_manager.cc:5697] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: config changed from index 3 to 4, VOTER 1f539ba21487460085b837e7529a78ce (127.23.140.65) evicted. New cstate: current_term: 1 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:55.954216 25124 catalog_manager.cc:5697] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce reported cstate change: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:55.956848 25211 tablet_service.cc:1558] Processing DeleteTablet for tablet 35ae6d72e4154149b3d1721e2214570a with delete_type TABLET_DATA_TOMBSTONED (TS 1f539ba21487460085b837e7529a78ce not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58402
I20260709 13:10:55.963042 25114 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 35ae6d72e4154149b3d1721e2214570a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:55.968750 25303 raft_consensus.cc:2955] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1f539ba21487460085b837e7529a78ce (127.23.140.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:55.982672 25225 consensus_queue.cc:237] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:56.011264 25300 raft_consensus.cc:1275] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:56.015734 26349 consensus_queue.cc:1048] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:56.031723 26406 raft_consensus.cc:2955] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79d99c0e498349bda74127365219e468 (127.23.140.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:56.036046 25908 raft_consensus.cc:2955] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:56.050895 25115 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 25e0218933774b319104f23505937179 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:56.054345 25300 raft_consensus.cc:2955] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79d99c0e498349bda74127365219e468 (127.23.140.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:56.056819 25905 raft_consensus.cc:1275] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:56.059186 26349 consensus_queue.cc:1048] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:56.063230 25126 catalog_manager.cc:5697] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce reported cstate change: config changed from index 3 to 4, VOTER 79d99c0e498349bda74127365219e468 (127.23.140.67) evicted. New cstate: current_term: 1 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:56.068926 26464 tablet_replica.cc:333] T 35ae6d72e4154149b3d1721e2214570a P 1f539ba21487460085b837e7529a78ce: stopping tablet replica
I20260709 13:10:56.073704 26464 raft_consensus.cc:2243] T 35ae6d72e4154149b3d1721e2214570a P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:56.085480 26464 raft_consensus.cc:2272] T 35ae6d72e4154149b3d1721e2214570a P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:56.089835 25908 raft_consensus.cc:2955] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79d99c0e498349bda74127365219e468 (127.23.140.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:56.091658 26464 ts_tablet_manager.cc:1916] T 35ae6d72e4154149b3d1721e2214570a P 1f539ba21487460085b837e7529a78ce: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:10:56.069919 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 90531.5us
I20260709 13:10:56.083963 25361 tablet_service.cc:1558] Processing DeleteTablet for tablet 25e0218933774b319104f23505937179 with delete_type TABLET_DATA_TOMBSTONED (TS 79d99c0e498349bda74127365219e468 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36248
I20260709 13:10:56.104707 26466 tablet_replica.cc:333] T 25e0218933774b319104f23505937179 P 79d99c0e498349bda74127365219e468: stopping tablet replica
I20260709 13:10:56.105892 26466 raft_consensus.cc:2243] T 25e0218933774b319104f23505937179 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:56.106676 26466 raft_consensus.cc:2272] T 25e0218933774b319104f23505937179 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:56.112859 25372 consensus_queue.cc:237] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:56.125036 25225 raft_consensus.cc:1275] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:56.130434 26466 ts_tablet_manager.cc:1916] T 25e0218933774b319104f23505937179 P 79d99c0e498349bda74127365219e468: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:56.111819 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:56.126230 25908 raft_consensus.cc:1275] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:56.130868 26382 consensus_queue.cc:1048] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:56.132313 26451 consensus_queue.cc:1048] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:56.144328 26446 raft_consensus.cc:2955] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:56.145839 25908 raft_consensus.cc:2955] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:56.148180 26464 ts_tablet_manager.cc:1929] T 35ae6d72e4154149b3d1721e2214570a P 1f539ba21487460085b837e7529a78ce: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:56.148715 26464 log.cc:1199] T 35ae6d72e4154149b3d1721e2214570a P 1f539ba21487460085b837e7529a78ce: Deleting WAL directory at /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602598684750-24113-0/minicluster-data/ts-0-root/wals/35ae6d72e4154149b3d1721e2214570a
I20260709 13:10:56.150265 25115 catalog_manager.cc:5028] TS 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): tablet 35ae6d72e4154149b3d1721e2214570a (table test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]) successfully deleted
I20260709 13:10:56.153692 25114 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 11892dffe99a496ebf3d98773631357c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:56.158777 25225 raft_consensus.cc:2955] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:56.161701 25125 catalog_manager.cc:5697] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: config changed from index 3 to 4, VOTER da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) evicted. New cstate: current_term: 1 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:10:56.176585 25294 tablet_service.cc:1558] Processing DeleteTablet for tablet 11892dffe99a496ebf3d98773631357c with delete_type TABLET_DATA_TOMBSTONED (TS da445ce82dc4467f95f4fa52297eaa19 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57250
I20260709 13:10:56.179998 26466 ts_tablet_manager.cc:1929] T 25e0218933774b319104f23505937179 P 79d99c0e498349bda74127365219e468: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:56.180553 26466 log.cc:1199] T 25e0218933774b319104f23505937179 P 79d99c0e498349bda74127365219e468: Deleting WAL directory at /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602598684750-24113-0/minicluster-data/ts-2-root/wals/25e0218933774b319104f23505937179
I20260709 13:10:56.186878 25114 catalog_manager.cc:5028] TS 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): tablet 25e0218933774b319104f23505937179 (table test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]) successfully deleted
I20260709 13:10:56.206422 26467 tablet_replica.cc:333] T 11892dffe99a496ebf3d98773631357c P da445ce82dc4467f95f4fa52297eaa19: stopping tablet replica
I20260709 13:10:56.207955 26467 raft_consensus.cc:2243] T 11892dffe99a496ebf3d98773631357c P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:56.208885 26467 raft_consensus.cc:2272] T 11892dffe99a496ebf3d98773631357c P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:56.212809 26467 ts_tablet_manager.cc:1916] T 11892dffe99a496ebf3d98773631357c P da445ce82dc4467f95f4fa52297eaa19: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:56.231016 25372 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4"
dest_uuid: "79d99c0e498349bda74127365219e468"
mode: GRACEFUL
new_leader_uuid: "1f539ba21487460085b837e7529a78ce"
 from {username='slave'} at 127.0.0.1:59274
I20260709 13:10:56.231719 25372 raft_consensus.cc:606] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Received request to transfer leadership to TS 1f539ba21487460085b837e7529a78ce
I20260709 13:10:56.235122 25225 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804"
dest_uuid: "1f539ba21487460085b837e7529a78ce"
mode: GRACEFUL
new_leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
 from {username='slave'} at 127.0.0.1:45014
I20260709 13:10:56.235738 25225 raft_consensus.cc:606] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Received request to transfer leadership to TS 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:10:56.238658 25302 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69"
dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
mode: GRACEFUL
new_leader_uuid: "1f539ba21487460085b837e7529a78ce"
 from {username='slave'} at 127.0.0.1:35660
I20260709 13:10:56.238945 26467 ts_tablet_manager.cc:1929] T 11892dffe99a496ebf3d98773631357c P da445ce82dc4467f95f4fa52297eaa19: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:56.239210 25302 raft_consensus.cc:606] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Received request to transfer leadership to TS 1f539ba21487460085b837e7529a78ce
I20260709 13:10:56.239461 26467 log.cc:1199] T 11892dffe99a496ebf3d98773631357c P da445ce82dc4467f95f4fa52297eaa19: Deleting WAL directory at /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602598684750-24113-0/minicluster-data/ts-1-root/wals/11892dffe99a496ebf3d98773631357c
I20260709 13:10:56.242097 25113 catalog_manager.cc:5028] TS da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): tablet 11892dffe99a496ebf3d98773631357c (table test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]) successfully deleted
I20260709 13:10:56.242240 25225 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc"
dest_uuid: "1f539ba21487460085b837e7529a78ce"
mode: GRACEFUL
new_leader_uuid: "79d99c0e498349bda74127365219e468"
 from {username='slave'} at 127.0.0.1:45014
I20260709 13:10:56.242880 25225 raft_consensus.cc:606] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Received request to transfer leadership to TS 79d99c0e498349bda74127365219e468
I20260709 13:10:56.245440 25302 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696"
dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
mode: GRACEFUL
new_leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
 from {username='slave'} at 127.0.0.1:35660
I20260709 13:10:56.246060 25302 raft_consensus.cc:606] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Received request to transfer leadership to TS 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:10:56.247126 24113 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:56.248461 24113 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:56.306505 26349 raft_consensus.cc:993] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce: : Instructing follower 6c4b021f3f9e41adb75e870a08ad88b6 to start an election
I20260709 13:10:56.307029 26316 raft_consensus.cc:1081] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Signalling peer 6c4b021f3f9e41adb75e870a08ad88b6 to start an election
I20260709 13:10:56.308421 25908 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804"
dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
 from {username='slave'} at 127.0.0.1:50056
I20260709 13:10:56.308972 25908 raft_consensus.cc:493] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:56.309330 25908 raft_consensus.cc:3060] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:56.314317 26263 raft_consensus.cc:993] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19: : Instructing follower 1f539ba21487460085b837e7529a78ce to start an election
I20260709 13:10:56.315006 26465 raft_consensus.cc:1081] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Signalling peer 1f539ba21487460085b837e7529a78ce to start an election
I20260709 13:10:56.317348 25230 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69"
dest_uuid: "1f539ba21487460085b837e7529a78ce"
 from {username='slave'} at 127.0.0.1:58422
I20260709 13:10:56.317888 25230 raft_consensus.cc:493] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:56.318182 25230 raft_consensus.cc:3060] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:56.318486 26382 raft_consensus.cc:993] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468: : Instructing follower 1f539ba21487460085b837e7529a78ce to start an election
I20260709 13:10:56.318943 26446 raft_consensus.cc:1081] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Signalling peer 1f539ba21487460085b837e7529a78ce to start an election
I20260709 13:10:56.320588 25225 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4"
dest_uuid: "1f539ba21487460085b837e7529a78ce"
 from {username='slave'} at 127.0.0.1:58418
I20260709 13:10:56.321172 25225 raft_consensus.cc:493] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:56.321529 25225 raft_consensus.cc:3060] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:56.323472 25908 raft_consensus.cc:515] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:56.325448 25230 raft_consensus.cc:515] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:56.326308 25908 leader_election.cc:290] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:56.327478 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:10:56.328011 25229 raft_consensus.cc:3055] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:56.328300 25229 raft_consensus.cc:740] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:10:56.329118 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:10:56.328996 25229 consensus_queue.cc:260] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:56.329639 25302 raft_consensus.cc:3055] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:56.329946 25302 raft_consensus.cc:740] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:10:56.330201 25229 raft_consensus.cc:3060] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:56.330634 25302 consensus_queue.cc:260] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:56.331167 25225 raft_consensus.cc:515] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:56.331708 25302 raft_consensus.cc:3060] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:56.332968 25225 leader_election.cc:290] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:56.334018 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:10:56.334173 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:10:56.334707 25372 raft_consensus.cc:3055] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:56.334993 25377 raft_consensus.cc:3060] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:56.335009 25372 raft_consensus.cc:740] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:10:56.335916 25372 consensus_queue.cc:260] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:56.336853 25372 raft_consensus.cc:3060] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:56.337040 25230 leader_election.cc:290] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:56.338099 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:10:56.338631 25303 raft_consensus.cc:3060] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:56.338881 25229 raft_consensus.cc:2468] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 2.
I20260709 13:10:56.343848 25377 raft_consensus.cc:2468] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 2.
I20260709 13:10:56.344295 25302 raft_consensus.cc:2468] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 2.
I20260709 13:10:56.345358 25194 leader_election.cc:304] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:10:56.346135 26316 raft_consensus.cc:2804] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:56.346618 26316 raft_consensus.cc:697] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 2 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:10:56.347386 26316 consensus_queue.cc:237] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:56.348436 25874 leader_election.cc:304] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:10:56.349270 26402 raft_consensus.cc:2804] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:56.349694 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:10:56.349959 26402 raft_consensus.cc:697] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:10:56.350289 25377 raft_consensus.cc:3060] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:56.350819 26402 consensus_queue.cc:237] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:56.356202 25372 raft_consensus.cc:2468] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 2.
I20260709 13:10:56.356588 25303 raft_consensus.cc:2468] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 2.
I20260709 13:10:56.357583 25194 leader_election.cc:304] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:10:56.358356 25377 raft_consensus.cc:2468] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 2.
I20260709 13:10:56.358803 26349 raft_consensus.cc:2804] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:56.359479 26349 raft_consensus.cc:697] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 2 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:10:56.360281 26349 consensus_queue.cc:237] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:56.364028 25128 catalog_manager.cc:5697] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 1 to 2, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68). New cstate: current_term: 2 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:56.375942 25126 catalog_manager.cc:5697] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 1 to 2, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 2 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:56.389981 25126 catalog_manager.cc:5697] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 1 to 2, leader changed from 79d99c0e498349bda74127365219e468 (127.23.140.67) to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 2 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:56.524931 26316 raft_consensus.cc:993] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce: : Instructing follower 79d99c0e498349bda74127365219e468 to start an election
I20260709 13:10:56.525451 26349 raft_consensus.cc:1081] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Signalling peer 79d99c0e498349bda74127365219e468 to start an election
I20260709 13:10:56.526921 25372 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc"
dest_uuid: "79d99c0e498349bda74127365219e468"
 from {username='slave'} at 127.0.0.1:36264
I20260709 13:10:56.527341 25372 raft_consensus.cc:493] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:56.527568 25372 raft_consensus.cc:3060] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:56.532291 25372 raft_consensus.cc:515] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:56.533862 25372 leader_election.cc:290] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:56.534809 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:10:56.535446 25303 raft_consensus.cc:3060] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:56.537395 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:10:56.538050 25229 raft_consensus.cc:3055] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:56.538385 25229 raft_consensus.cc:740] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:10:56.539642 25229 consensus_queue.cc:260] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:56.540899 25229 raft_consensus.cc:3060] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:56.541891 25303 raft_consensus.cc:2468] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 2.
I20260709 13:10:56.543027 25343 leader_election.cc:304] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:10:56.543763 26451 raft_consensus.cc:2804] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:56.544301 26451 raft_consensus.cc:697] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 2 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:10:56.545140 26451 consensus_queue.cc:237] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:56.546758 25229 raft_consensus.cc:2468] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 2.
I20260709 13:10:56.554139 25126 catalog_manager.cc:5697] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 1 to 2, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 2 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:56.741115 25303 raft_consensus.cc:1275] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:56.742709 26349 consensus_queue.cc:1048] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:56.753592 25372 raft_consensus.cc:1275] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:56.756075 26316 consensus_queue.cc:1048] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:56.778234 25372 raft_consensus.cc:1275] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:56.782882 26316 consensus_queue.cc:1048] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:56.790228 25303 raft_consensus.cc:1275] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:56.796142 26465 raft_consensus.cc:993] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19: : Instructing follower 6c4b021f3f9e41adb75e870a08ad88b6 to start an election
I20260709 13:10:56.797312 26465 raft_consensus.cc:1081] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Signalling peer 6c4b021f3f9e41adb75e870a08ad88b6 to start an election
I20260709 13:10:56.799089 25906 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696"
dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
 from {username='slave'} at 127.0.0.1:50058
I20260709 13:10:56.799583 25906 raft_consensus.cc:493] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:56.799850 26316 consensus_queue.cc:1048] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:56.799906 25906 raft_consensus.cc:3060] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:56.808877 25906 raft_consensus.cc:515] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:56.811597 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:10:56.812194 25302 raft_consensus.cc:3055] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:56.812754 25302 raft_consensus.cc:740] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:10:56.812176 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:10:56.813294 25370 raft_consensus.cc:3060] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:56.813457 25302 consensus_queue.cc:260] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:56.814580 25302 raft_consensus.cc:3060] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:56.816910 25906 leader_election.cc:290] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:56.822430 25302 raft_consensus.cc:2468] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 2.
I20260709 13:10:56.823776 25872 leader_election.cc:304] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:10:56.825730 26402 raft_consensus.cc:2804] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:56.826210 26402 raft_consensus.cc:697] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:10:56.827931 25370 raft_consensus.cc:2468] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 2.
I20260709 13:10:56.827013 26402 consensus_queue.cc:237] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:56.847842 25128 catalog_manager.cc:5697] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 1 to 2, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68). New cstate: current_term: 2 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:56.871037 25370 raft_consensus.cc:1275] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:56.872277 26402 consensus_queue.cc:1048] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:56.884529 25229 raft_consensus.cc:1275] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:56.886408 26402 consensus_queue.cc:1048] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:57.021535 25302 raft_consensus.cc:1275] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:57.022678 26451 consensus_queue.cc:1048] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:57.031745 25225 raft_consensus.cc:1275] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:57.033641 26486 consensus_queue.cc:1048] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:57.357476 25372 raft_consensus.cc:1275] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:57.406852 25298 raft_consensus.cc:1275] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:57.409921 26493 consensus_queue.cc:1048] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:57.424268 26495 consensus_queue.cc:1048] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:57.466979 25230 consensus_queue.cc:237] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
W20260709 13:10:57.474813 25195 consensus_peers.cc:597] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce -> Peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085): Couldn't send request to peer 6c4b021f3f9e41adb75e870a08ad88b6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 275226661cc840559134f8c9e5b15719. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:57.478036 25298 raft_consensus.cc:1275] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:57.478695 25372 raft_consensus.cc:1275] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:57.479442 26497 consensus_queue.cc:1048] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:57.481653 26497 consensus_queue.cc:1048] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:57.486749 26489 raft_consensus.cc:2955] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:57.490362 25298 raft_consensus.cc:2955] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:57.496619 25372 raft_consensus.cc:2955] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:57.506110 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:57.507128 25377 consensus_queue.cc:237] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:57.515202 25128 catalog_manager.cc:5697] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce reported cstate change: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New cstate: current_term: 1 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:57.519443 25344 consensus_peers.cc:597] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 -> Peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085): Couldn't send request to peer 6c4b021f3f9e41adb75e870a08ad88b6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d56909a48cf841eb99365741e9e29e93. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:57.522198 25230 raft_consensus.cc:1275] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:10:57.524070 26488 consensus_queue.cc:1048] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:57.524394 25298 raft_consensus.cc:1275] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:10:57.526142 26488 consensus_queue.cc:1048] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:57.531893 26496 raft_consensus.cc:2955] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:57.533314 25229 raft_consensus.cc:2955] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:57.549863 25298 raft_consensus.cc:2955] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:57.557156 25302 consensus_queue.cc:237] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
W20260709 13:10:57.567113 25270 consensus_peers.cc:597] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 -> Peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085): Couldn't send request to peer 6c4b021f3f9e41adb75e870a08ad88b6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8d0f43a786a846b49924a589e4a36f2f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:57.568337 25230 raft_consensus.cc:1275] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:57.569929 25377 raft_consensus.cc:1275] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:57.571738 26472 consensus_queue.cc:1048] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:57.572749 26492 consensus_queue.cc:1048] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:57.582501 25125 catalog_manager.cc:5697] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 reported cstate change: config changed from index -1 to 3, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New cstate: current_term: 2 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:57.589608 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:57.620965 26472 raft_consensus.cc:2955] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:57.622189 25225 raft_consensus.cc:2955] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:57.626353 25377 raft_consensus.cc:2955] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:57.638051 25125 catalog_manager.cc:5697] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce reported cstate change: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New cstate: current_term: 1 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:57.648278 25225 consensus_queue.cc:237] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:57.660135 25377 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11892dffe99a496ebf3d98773631357c"
dest_uuid: "79d99c0e498349bda74127365219e468"
mode: GRACEFUL
new_leader_uuid: "1f539ba21487460085b837e7529a78ce"
 from {username='slave'} at 127.0.0.1:59274
I20260709 13:10:57.660748 25377 raft_consensus.cc:606] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Received request to transfer leadership to TS 1f539ba21487460085b837e7529a78ce
I20260709 13:10:57.663839 25230 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4"
dest_uuid: "1f539ba21487460085b837e7529a78ce"
mode: GRACEFUL
new_leader_uuid: "79d99c0e498349bda74127365219e468"
 from {username='slave'} at 127.0.0.1:45014
I20260709 13:10:57.664366 25230 raft_consensus.cc:606] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 2 LEADER]: Received request to transfer leadership to TS 79d99c0e498349bda74127365219e468
I20260709 13:10:57.665189 25377 raft_consensus.cc:1275] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:10:57.665650 25195 consensus_peers.cc:597] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce -> Peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085): Couldn't send request to peer 6c4b021f3f9e41adb75e870a08ad88b6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f5c9116c92454e2ab270a148a8c5c4ea. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:57.666512 26316 consensus_queue.cc:1048] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:57.667027 25302 raft_consensus.cc:1275] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:57.668437 26316 consensus_queue.cc:1048] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:57.668610 25302 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22"
dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
mode: GRACEFUL
new_leader_uuid: "79d99c0e498349bda74127365219e468"
 from {username='slave'} at 127.0.0.1:35660
I20260709 13:10:57.671773 25302 raft_consensus.cc:606] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Received request to transfer leadership to TS 79d99c0e498349bda74127365219e468
I20260709 13:10:57.675369 25303 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c"
dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
mode: GRACEFUL
new_leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
 from {username='slave'} at 127.0.0.1:35660
I20260709 13:10:57.675896 25303 raft_consensus.cc:606] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Received request to transfer leadership to TS 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:10:57.677228 24113 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:10:57.678864 24113 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:57.680236 26489 raft_consensus.cc:2955] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:57.681656 25298 raft_consensus.cc:2955] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:57.690004 25377 raft_consensus.cc:2955] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:10:57.701419 25128 catalog_manager.cc:5697] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce reported cstate change: config changed from index -1 to 2, NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) added. New cstate: current_term: 1 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:57.749866 26472 raft_consensus.cc:993] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19: : Instructing follower 6c4b021f3f9e41adb75e870a08ad88b6 to start an election
I20260709 13:10:57.750319 26492 raft_consensus.cc:1081] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Signalling peer 6c4b021f3f9e41adb75e870a08ad88b6 to start an election
I20260709 13:10:57.751875 25905 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c"
dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
 from {username='slave'} at 127.0.0.1:50058
I20260709 13:10:57.752326 25905 raft_consensus.cc:493] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:57.752640 25905 raft_consensus.cc:3060] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:57.761319 25905 raft_consensus.cc:515] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:57.763566 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:10:57.764106 25230 raft_consensus.cc:3060] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:57.768649 25230 raft_consensus.cc:2468] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 2.
I20260709 13:10:57.769590 25874 leader_election.cc:304] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:10:57.770381 26495 raft_consensus.cc:2804] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:57.770581 25905 leader_election.cc:290] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:57.770830 26495 raft_consensus.cc:697] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:10:57.772023 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:10:57.771723 26495 consensus_queue.cc:237] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:57.772617 25298 raft_consensus.cc:3055] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:57.772934 25298 raft_consensus.cc:740] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:10:57.774268 25298 consensus_queue.cc:260] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:57.775796 25298 raft_consensus.cc:3060] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:57.783998 25298 raft_consensus.cc:2468] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 2.
I20260709 13:10:57.793406 25128 catalog_manager.cc:5697] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 1 to 2, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68). New cstate: current_term: 2 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:57.825976 26489 raft_consensus.cc:993] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce: : Instructing follower 79d99c0e498349bda74127365219e468 to start an election
I20260709 13:10:57.826489 26349 raft_consensus.cc:1081] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 2 LEADER]: Signalling peer 79d99c0e498349bda74127365219e468 to start an election
I20260709 13:10:57.827888 25377 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4"
dest_uuid: "79d99c0e498349bda74127365219e468"
 from {username='slave'} at 127.0.0.1:36264
I20260709 13:10:57.828313 25377 raft_consensus.cc:493] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:57.828589 25377 raft_consensus.cc:3060] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:57.838892 25377 raft_consensus.cc:515] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:57.840904 25377 leader_election.cc:290] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:57.841161 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:10:57.841372 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:10:57.841872 25303 raft_consensus.cc:3060] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:57.844219 25230 raft_consensus.cc:3055] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:57.844870 25230 raft_consensus.cc:740] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:10:57.845686 25230 consensus_queue.cc:260] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:57.847692 25230 raft_consensus.cc:3060] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:57.848162 25303 raft_consensus.cc:2468] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 3.
I20260709 13:10:57.850492 25343 leader_election.cc:304] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:10:57.851215 26496 raft_consensus.cc:2804] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:57.851703 26496 raft_consensus.cc:697] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 3 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:10:57.852684 26496 consensus_queue.cc:237] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:57.855084 25230 raft_consensus.cc:2468] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 3.
I20260709 13:10:57.871336 25128 catalog_manager.cc:5697] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 2 to 3, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 3 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:57.897095 26492 raft_consensus.cc:993] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19: : Instructing follower 79d99c0e498349bda74127365219e468 to start an election
I20260709 13:10:57.897532 26472 raft_consensus.cc:1081] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Signalling peer 79d99c0e498349bda74127365219e468 to start an election
I20260709 13:10:57.899096 25377 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22"
dest_uuid: "79d99c0e498349bda74127365219e468"
 from {username='slave'} at 127.0.0.1:36254
I20260709 13:10:57.899605 25377 raft_consensus.cc:493] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:57.899933 25377 raft_consensus.cc:3060] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:57.906402 25377 raft_consensus.cc:515] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:57.908381 25377 leader_election.cc:290] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:57.909438 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:10:57.913856 25230 raft_consensus.cc:3060] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:57.910342 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:10:57.916399 25303 raft_consensus.cc:3055] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:57.916790 25303 raft_consensus.cc:740] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:10:57.917929 25303 consensus_queue.cc:260] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:57.925225 25303 raft_consensus.cc:3060] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:57.933936 25303 raft_consensus.cc:2468] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 2.
I20260709 13:10:57.935604 25343 leader_election.cc:304] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:10:57.936638 26488 raft_consensus.cc:2804] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:57.937115 26488 raft_consensus.cc:697] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 2 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:10:57.937923 26488 consensus_queue.cc:237] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:57.943390 25230 raft_consensus.cc:2468] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 2.
I20260709 13:10:57.947368 26519 ts_tablet_manager.cc:933] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6: Initiating tablet copy from peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:57.948201 26520 ts_tablet_manager.cc:933] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6: Initiating tablet copy from peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361)
I20260709 13:10:57.959685 26519 tablet_copy_client.cc:323] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Beginning tablet copy session from remote peer at address 127.23.140.67:34091
I20260709 13:10:57.962527 25389 tablet_copy_service.cc:140] P 79d99c0e498349bda74127365219e468: Received BeginTabletCopySession request for tablet d56909a48cf841eb99365741e9e29e93 from peer 6c4b021f3f9e41adb75e870a08ad88b6 ({username='slave'} at 127.0.0.1:56308)
I20260709 13:10:57.963218 25389 tablet_copy_service.cc:161] P 79d99c0e498349bda74127365219e468: Beginning new tablet copy session on tablet d56909a48cf841eb99365741e9e29e93 from peer 6c4b021f3f9e41adb75e870a08ad88b6 at {username='slave'} at 127.0.0.1:56308: session id = 6c4b021f3f9e41adb75e870a08ad88b6-d56909a48cf841eb99365741e9e29e93
I20260709 13:10:57.973234 26520 tablet_copy_client.cc:323] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Beginning tablet copy session from remote peer at address 127.23.140.65:39361
I20260709 13:10:57.975034 25240 tablet_copy_service.cc:140] P 1f539ba21487460085b837e7529a78ce: Received BeginTabletCopySession request for tablet 275226661cc840559134f8c9e5b15719 from peer 6c4b021f3f9e41adb75e870a08ad88b6 ({username='slave'} at 127.0.0.1:54000)
I20260709 13:10:57.975539 25240 tablet_copy_service.cc:161] P 1f539ba21487460085b837e7529a78ce: Beginning new tablet copy session on tablet 275226661cc840559134f8c9e5b15719 from peer 6c4b021f3f9e41adb75e870a08ad88b6 at {username='slave'} at 127.0.0.1:54000: session id = 6c4b021f3f9e41adb75e870a08ad88b6-275226661cc840559134f8c9e5b15719
I20260709 13:10:57.973627 25389 tablet_copy_source_session.cc:215] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:57.985214 26519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d56909a48cf841eb99365741e9e29e93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:57.986177 25128 catalog_manager.cc:5697] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 1 to 2, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 2 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:57.990729 25240 tablet_copy_source_session.cc:215] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:57.993995 26520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 275226661cc840559134f8c9e5b15719. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:58.007426 26496 raft_consensus.cc:993] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468: : Instructing follower 1f539ba21487460085b837e7529a78ce to start an election
I20260709 13:10:58.007915 26496 raft_consensus.cc:1081] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Signalling peer 1f539ba21487460085b837e7529a78ce to start an election
I20260709 13:10:58.009483 25230 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "11892dffe99a496ebf3d98773631357c"
dest_uuid: "1f539ba21487460085b837e7529a78ce"
 from {username='slave'} at 127.0.0.1:58418
I20260709 13:10:58.009996 25230 raft_consensus.cc:493] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:58.010334 25230 raft_consensus.cc:3060] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:58.007450 26519 tablet_copy_client.cc:806] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:58.011507 26519 tablet_copy_client.cc:670] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:58.012014 26520 tablet_copy_client.cc:806] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:58.012609 26520 tablet_copy_client.cc:670] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:58.016028 25230 raft_consensus.cc:515] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:58.017369 26520 tablet_copy_client.cc:538] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:58.019415 25230 leader_election.cc:290] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:10:58.019575 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:10:58.020160 25906 raft_consensus.cc:3060] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:58.026947 26519 tablet_copy_client.cc:538] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:58.026952 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:10:58.027616 25377 raft_consensus.cc:3055] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:58.027918 25377 raft_consensus.cc:740] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:10:58.028043 26520 tablet_bootstrap.cc:492] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap starting.
I20260709 13:10:58.028606 25377 consensus_queue.cc:260] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:58.030915 25377 raft_consensus.cc:3060] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:58.026707 26524 ts_tablet_manager.cc:933] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6: Initiating tablet copy from peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:58.033718 25906 raft_consensus.cc:2468] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 2.
I20260709 13:10:58.038941 25377 raft_consensus.cc:2468] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 2.
I20260709 13:10:58.050323 25195 leader_election.cc:304] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:10:58.051124 26497 raft_consensus.cc:2804] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:58.051620 26524 tablet_copy_client.cc:323] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Beginning tablet copy session from remote peer at address 127.23.140.66:33127
I20260709 13:10:58.051879 26519 tablet_bootstrap.cc:492] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap starting.
I20260709 13:10:58.051614 26497 raft_consensus.cc:697] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 2 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:10:58.053304 25315 tablet_copy_service.cc:140] P da445ce82dc4467f95f4fa52297eaa19: Received BeginTabletCopySession request for tablet 8d0f43a786a846b49924a589e4a36f2f from peer 6c4b021f3f9e41adb75e870a08ad88b6 ({username='slave'} at 127.0.0.1:46556)
I20260709 13:10:58.053886 25315 tablet_copy_service.cc:161] P da445ce82dc4467f95f4fa52297eaa19: Beginning new tablet copy session on tablet 8d0f43a786a846b49924a589e4a36f2f from peer 6c4b021f3f9e41adb75e870a08ad88b6 at {username='slave'} at 127.0.0.1:46556: session id = 6c4b021f3f9e41adb75e870a08ad88b6-8d0f43a786a846b49924a589e4a36f2f
I20260709 13:10:58.053501 26497 consensus_queue.cc:237] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:58.065271 25315 tablet_copy_source_session.cc:215] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:58.069625 26524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d0f43a786a846b49924a589e4a36f2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:58.081434 26520 tablet_bootstrap.cc:492] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:58.082551 26520 tablet_bootstrap.cc:492] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap complete.
I20260709 13:10:58.083274 26520 ts_tablet_manager.cc:1403] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent bootstrapping tablet: real 0.055s	user 0.025s	sys 0.000s
I20260709 13:10:58.086728 26520 raft_consensus.cc:359] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:58.087581 26520 raft_consensus.cc:740] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Initialized, Role: LEARNER
I20260709 13:10:58.090032 26520 consensus_queue.cc:260] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:58.092808 26520 ts_tablet_manager.cc:1434] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:10:58.095054 25240 tablet_copy_service.cc:342] P 1f539ba21487460085b837e7529a78ce: Request end of tablet copy session 6c4b021f3f9e41adb75e870a08ad88b6-275226661cc840559134f8c9e5b15719 received from {username='slave'} at 127.0.0.1:54000
I20260709 13:10:58.095475 25240 tablet_copy_service.cc:434] P 1f539ba21487460085b837e7529a78ce: ending tablet copy session 6c4b021f3f9e41adb75e870a08ad88b6-275226661cc840559134f8c9e5b15719 on tablet 275226661cc840559134f8c9e5b15719 with peer 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:10:58.098446 26519 tablet_bootstrap.cc:492] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:58.099392 26519 tablet_bootstrap.cc:492] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap complete.
I20260709 13:10:58.100131 26519 ts_tablet_manager.cc:1403] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent bootstrapping tablet: real 0.049s	user 0.026s	sys 0.004s
I20260709 13:10:58.087838 25128 catalog_manager.cc:5697] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 1 to 2, leader changed from 79d99c0e498349bda74127365219e468 (127.23.140.67) to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 2 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:58.103271 26519 raft_consensus.cc:359] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:58.104143 26519 raft_consensus.cc:740] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Initialized, Role: LEARNER
I20260709 13:10:58.104835 26519 consensus_queue.cc:260] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:58.107255 26519 ts_tablet_manager.cc:1434] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:10:58.109793 25389 tablet_copy_service.cc:342] P 79d99c0e498349bda74127365219e468: Request end of tablet copy session 6c4b021f3f9e41adb75e870a08ad88b6-d56909a48cf841eb99365741e9e29e93 received from {username='slave'} at 127.0.0.1:56308
I20260709 13:10:58.110307 25389 tablet_copy_service.cc:434] P 79d99c0e498349bda74127365219e468: ending tablet copy session 6c4b021f3f9e41adb75e870a08ad88b6-d56909a48cf841eb99365741e9e29e93 on tablet d56909a48cf841eb99365741e9e29e93 with peer 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:10:58.121721 26524 tablet_copy_client.cc:806] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:58.122402 26524 tablet_copy_client.cc:670] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:58.134707 26524 tablet_copy_client.cc:538] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:58.143921 26524 tablet_bootstrap.cc:492] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap starting.
W20260709 13:10:58.154649 25326 debug-util.cc:398] Leaking SignalData structure 0x7b080009e340 after lost signal to thread 24116
W20260709 13:10:58.155762 25326 debug-util.cc:398] Leaking SignalData structure 0x7b080004b0e0 after lost signal to thread 25162
W20260709 13:10:58.157027 25326 debug-util.cc:398] Leaking SignalData structure 0x7b0800358a20 after lost signal to thread 25254
W20260709 13:10:58.158663 25326 debug-util.cc:398] Leaking SignalData structure 0x7b080029f820 after lost signal to thread 25329
W20260709 13:10:58.159710 25326 debug-util.cc:398] Leaking SignalData structure 0x7b08000d2520 after lost signal to thread 25403
W20260709 13:10:58.160957 25326 debug-util.cc:398] Leaking SignalData structure 0x7b08002a5020 after lost signal to thread 25932
I20260709 13:10:58.164287 26519 ts_tablet_manager.cc:933] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6: Initiating tablet copy from peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361)
I20260709 13:10:58.167400 26524 tablet_bootstrap.cc:492] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:58.168294 26524 tablet_bootstrap.cc:492] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap complete.
I20260709 13:10:58.168974 26524 ts_tablet_manager.cc:1403] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent bootstrapping tablet: real 0.025s	user 0.020s	sys 0.004s
I20260709 13:10:58.171936 26524 raft_consensus.cc:359] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:58.172791 26524 raft_consensus.cc:740] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Initialized, Role: LEARNER
I20260709 13:10:58.173439 26524 consensus_queue.cc:260] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:58.176209 26524 ts_tablet_manager.cc:1434] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:10:58.182502 25315 tablet_copy_service.cc:342] P da445ce82dc4467f95f4fa52297eaa19: Request end of tablet copy session 6c4b021f3f9e41adb75e870a08ad88b6-8d0f43a786a846b49924a589e4a36f2f received from {username='slave'} at 127.0.0.1:46556
I20260709 13:10:58.193867 25315 tablet_copy_service.cc:434] P da445ce82dc4467f95f4fa52297eaa19: ending tablet copy session 6c4b021f3f9e41adb75e870a08ad88b6-8d0f43a786a846b49924a589e4a36f2f on tablet 8d0f43a786a846b49924a589e4a36f2f with peer 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:10:58.198388 26519 tablet_copy_client.cc:323] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Beginning tablet copy session from remote peer at address 127.23.140.65:39361
I20260709 13:10:58.199956 25240 tablet_copy_service.cc:140] P 1f539ba21487460085b837e7529a78ce: Received BeginTabletCopySession request for tablet f5c9116c92454e2ab270a148a8c5c4ea from peer 6c4b021f3f9e41adb75e870a08ad88b6 ({username='slave'} at 127.0.0.1:54000)
I20260709 13:10:58.200516 25240 tablet_copy_service.cc:161] P 1f539ba21487460085b837e7529a78ce: Beginning new tablet copy session on tablet f5c9116c92454e2ab270a148a8c5c4ea from peer 6c4b021f3f9e41adb75e870a08ad88b6 at {username='slave'} at 127.0.0.1:54000: session id = 6c4b021f3f9e41adb75e870a08ad88b6-f5c9116c92454e2ab270a148a8c5c4ea
I20260709 13:10:58.211709 25240 tablet_copy_source_session.cc:215] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:58.214954 26519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5c9116c92454e2ab270a148a8c5c4ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:58.233434 26519 tablet_copy_client.cc:806] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:58.238632 26519 tablet_copy_client.cc:670] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:58.246296 26519 tablet_copy_client.cc:538] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:58.259560 26519 tablet_bootstrap.cc:492] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap starting.
I20260709 13:10:58.277933 26519 tablet_bootstrap.cc:492] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:58.278857 26519 tablet_bootstrap.cc:492] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6: Bootstrap complete.
I20260709 13:10:58.279596 26519 ts_tablet_manager.cc:1403] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent bootstrapping tablet: real 0.021s	user 0.019s	sys 0.000s
I20260709 13:10:58.282092 26519 raft_consensus.cc:359] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:58.282701 26519 raft_consensus.cc:740] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Initialized, Role: LEARNER
I20260709 13:10:58.283200 26519 consensus_queue.cc:260] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:58.284955 26519 ts_tablet_manager.cc:1434] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.003s
I20260709 13:10:58.290978 25240 tablet_copy_service.cc:342] P 1f539ba21487460085b837e7529a78ce: Request end of tablet copy session 6c4b021f3f9e41adb75e870a08ad88b6-f5c9116c92454e2ab270a148a8c5c4ea received from {username='slave'} at 127.0.0.1:54000
I20260709 13:10:58.291764 25240 tablet_copy_service.cc:434] P 1f539ba21487460085b837e7529a78ce: ending tablet copy session 6c4b021f3f9e41adb75e870a08ad88b6-f5c9116c92454e2ab270a148a8c5c4ea on tablet f5c9116c92454e2ab270a148a8c5c4ea with peer 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:10:58.340240 25905 raft_consensus.cc:1217] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:10:58.361163 25298 raft_consensus.cc:1275] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:58.361570 25905 raft_consensus.cc:1217] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:58.363025 26488 consensus_queue.cc:1048] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:58.390134 25298 raft_consensus.cc:1275] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:58.393172 26450 consensus_queue.cc:1048] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:58.398591 25230 raft_consensus.cc:1275] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:58.428855 26495 consensus_queue.cc:1048] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:58.480969 25229 raft_consensus.cc:1275] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:58.485023 25230 raft_consensus.cc:1275] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:58.535219 25302 raft_consensus.cc:1275] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:58.552168 26488 consensus_queue.cc:1048] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:58.556823 26488 consensus_queue.cc:1048] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:58.602936 25905 raft_consensus.cc:1217] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:58.631759 26498 consensus_queue.cc:1048] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:58.672602 25372 raft_consensus.cc:1275] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:58.679708 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:59.757709 25906 raft_consensus.cc:1217] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:59.758682 25906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50056 (request call id 316) took 1040 ms. Trace:
I20260709 13:10:59.759279 25906 rpcz_store.cc:276] 0709 13:10:58.718558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:59.757038 (+1038480us) service_pool.cc:224] Handling call
0709 13:10:59.757588 (+   550us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:59.758375 (+   787us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:59.758400 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:59.758439 (+    39us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:59.758467 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:59.758518 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:59.758624 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:59.779942 25229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1217) took 1089 ms. Trace:
I20260709 13:10:59.780498 25229 rpcz_store.cc:276] 0709 13:10:58.690402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.705327 (+ 14925us) service_pool.cc:224] Handling call
0709 13:10:58.705601 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:58.705771 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:58.705798 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:58.705838 (+    40us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:58.705869 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:59.779658 (+1073789us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:59.779831 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:59.785979 26497 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:10:59.786461 26548 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:10:59.786558 26497 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:59.787127 26548 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:59.788509 26548 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:10:59.788741 26497 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:59.797698 26495 raft_consensus.cc:493] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:10:59.799762 26495 raft_consensus.cc:515] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:59.804908 26495 leader_election.cc:290] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:59.815770 26551 raft_consensus.cc:493] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:10:59.816506 26551 raft_consensus.cc:515] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:59.817700 26541 raft_consensus.cc:493] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:10:59.818214 26550 raft_consensus.cc:493] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.818857 26541 raft_consensus.cc:515] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:59.818868 26550 raft_consensus.cc:515] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:59.821818 26541 leader_election.cc:290] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:59.822280 26550 leader_election.cc:290] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:59.823271 26550 raft_consensus.cc:493] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:10:59.823803 26550 raft_consensus.cc:515] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:59.824249 26492 raft_consensus.cc:493] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:10:59.824895 26492 raft_consensus.cc:515] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:10:59.831471 25269 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.806s	user 0.006s	sys 0.023s
W20260709 13:10:59.831940 25269 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.807s	user 0.007s	sys 0.023s
I20260709 13:10:59.832975 26492 leader_election.cc:290] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:59.833981 26553 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:10:59.834628 26553 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:59.835175 26491 raft_consensus.cc:493] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:10:59.835777 26491 raft_consensus.cc:515] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:59.838119 26491 leader_election.cc:290] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:10:59.838594 26492 raft_consensus.cc:493] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:10:59.826915 26540 raft_consensus.cc:493] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:10:59.840335 26492 raft_consensus.cc:515] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:59.842447 26556 raft_consensus.cc:493] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:10:59.843397 26492 leader_election.cc:290] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:59.840472 26540 raft_consensus.cc:515] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:59.837545 26552 raft_consensus.cc:493] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:10:59.844527 26552 raft_consensus.cc:515] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:10:59.838692 26491 raft_consensus.cc:493] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.845917 26540 leader_election.cc:290] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:59.846236 26491 raft_consensus.cc:515] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:59.846658 26552 leader_election.cc:290] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361)
I20260709 13:10:59.847244 26555 raft_consensus.cc:493] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:10:59.847615 26540 raft_consensus.cc:493] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:10:59.854681 26540 raft_consensus.cc:515] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:59.856765 26540 leader_election.cc:290] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:59.848326 26551 leader_election.cc:290] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:59.826339 26550 leader_election.cc:290] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:59.858357 26555 raft_consensus.cc:515] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:59.860251 26555 leader_election.cc:290] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:10:59.860831 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:59.865082 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:59.865686 25379 raft_consensus.cc:2468] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 1.
I20260709 13:10:59.866173 26498 raft_consensus.cc:493] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:10:59.866041 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:59.866752 26498 raft_consensus.cc:515] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:59.867411 25372 raft_consensus.cc:2468] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 2.
I20260709 13:10:59.868399 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:59.871244 25371 raft_consensus.cc:2468] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 1.
I20260709 13:10:59.839368 26544 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:10:59.852555 26492 raft_consensus.cc:493] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:10:59.873641 26492 raft_consensus.cc:515] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:59.875619 26492 leader_election.cc:290] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:59.854084 26554 raft_consensus.cc:493] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:10:59.876237 26554 raft_consensus.cc:515] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:59.867067 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:10:59.869001 26498 leader_election.cc:290] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:10:59.878436 26554 leader_election.cc:290] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:59.851711 26491 leader_election.cc:290] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:59.870031 26488 raft_consensus.cc:493] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:10:59.870558 26486 raft_consensus.cc:493] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:10:59.879232 26488 raft_consensus.cc:515] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:59.879344 26486 raft_consensus.cc:515] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:59.881884 26486 leader_election.cc:290] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:10:59.882036 25377 raft_consensus.cc:2468] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 1.
I20260709 13:10:59.883152 26544 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:59.883654 25873 leader_election.cc:304] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:10:59.885414 26540 raft_consensus.cc:2804] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:59.885957 26540 raft_consensus.cc:493] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:10:59.886416 26540 raft_consensus.cc:3060] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:59.881405 26488 leader_election.cc:290] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:10:59.843369 26556 raft_consensus.cc:515] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:10:59.893162 26556 leader_election.cc:290] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:59.893935 26544 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:10:59.894382 26553 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:10:59.894731 26540 raft_consensus.cc:515] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:59.897085 26540 leader_election.cc:290] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:59.949205 26349 raft_consensus.cc:493] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:10:59.950954 26349 raft_consensus.cc:515] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:59.958596 26349 leader_election.cc:290] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:10:59.959481 26497 raft_consensus.cc:493] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:10:59.960469 26497 raft_consensus.cc:515] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:59.962123 26546 raft_consensus.cc:493] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
W20260709 13:10:59.949241 25929 debug-util.cc:398] Leaking SignalData structure 0x7b08001c7720 after lost signal to thread 24116
I20260709 13:10:59.968433 26548 raft_consensus.cc:493] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:10:59.963462 26492 raft_consensus.cc:493] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:10:59.978003 26548 raft_consensus.cc:515] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:59.978739 26492 raft_consensus.cc:515] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:59.970786 26549 raft_consensus.cc:493] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:10:59.981325 26492 leader_election.cc:290] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:10:59.962164 26544 raft_consensus.cc:493] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:10:59.970883 26555 raft_consensus.cc:493] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:10:59.963056 26546 raft_consensus.cc:515] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:59.983743 26489 raft_consensus.cc:493] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:10:59.986912 26560 raft_consensus.cc:493] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:10:59.992128 26491 raft_consensus.cc:493] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:10:59.992262 26561 raft_consensus.cc:493] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:10:59.992689 26492 raft_consensus.cc:493] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:10:59.993000 26491 raft_consensus.cc:515] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:59.980832 26548 leader_election.cc:290] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:10:59.981664 26549 raft_consensus.cc:515] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:59.996539 25906 raft_consensus.cc:1240] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:59.996191 26555 raft_consensus.cc:515] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:59.986367 26349 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:10:59.993644 26492 raft_consensus.cc:515] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:10:59.999704 26564 raft_consensus.cc:493] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:10:59.999904 26550 raft_consensus.cc:493] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:10:59.993273 26561 raft_consensus.cc:515] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:10:59.959491 26472 raft_consensus.cc:493] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:10:59.970911 26554 raft_consensus.cc:493] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:00.001863 26564 raft_consensus.cc:515] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:00.003959 26558 raft_consensus.cc:493] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:00.004452 26554 raft_consensus.cc:515] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:00.004833 26558 raft_consensus.cc:515] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:00.008680 26498 raft_consensus.cc:493] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:00.010027 26498 raft_consensus.cc:515] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:00.017584 26551 raft_consensus.cc:493] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:00.018646 26551 raft_consensus.cc:515] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:00.022717 26472 raft_consensus.cc:515] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:00.003247 26557 raft_consensus.cc:493] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:00.003346 26556 raft_consensus.cc:493] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:00.005460 26492 leader_election.cc:290] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:00.026554 26557 raft_consensus.cc:515] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:00.030527 26489 raft_consensus.cc:515] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:00.001863 26544 raft_consensus.cc:515] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:00.011816 26491 leader_election.cc:290] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:00.032182 26550 raft_consensus.cc:515] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:00.045728 26486 raft_consensus.cc:493] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:00.045964 26565 raft_consensus.cc:493] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:00.039034 26349 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:00.014314 26559 raft_consensus.cc:493] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:00.046581 26486 raft_consensus.cc:515] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:11:00.046980 26565 raft_consensus.cc:515] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:00.219208 25929 debug-util.cc:398] Leaking SignalData structure 0x7b0800324e20 after lost signal to thread 25162
I20260709 13:11:00.136595 26550 leader_election.cc:290] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:00.235759 26349 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:00.045112 26560 raft_consensus.cc:515] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:00.236912 26550 raft_consensus.cc:493] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:00.237799 26550 raft_consensus.cc:515] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:00.239058 26560 leader_election.cc:290] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:00.240568 26550 leader_election.cc:290] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:00.095220 26561 leader_election.cc:290] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:00.098097 26564 leader_election.cc:290] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:00.112824 26489 leader_election.cc:290] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:00.047187 26491 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:00.062976 26540 raft_consensus.cc:493] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:00.121333 26554 leader_election.cc:290] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:00.206461 26552 raft_consensus.cc:493] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:00.052413 26492 raft_consensus.cc:493] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:00.097100 26558 leader_election.cc:290] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:00.128603 26488 raft_consensus.cc:493] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:00.136833 26546 leader_election.cc:290] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:00.206319 26563 raft_consensus.cc:493] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:00.095007 26472 leader_election.cc:290] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:00.206382 26450 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:00.226277 26555 leader_election.cc:290] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:00.218508 26549 leader_election.cc:290] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:00.053647 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:00.110540 26562 raft_consensus.cc:493] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:00.136229 26547 raft_consensus.cc:493] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:00.263904 26498 leader_election.cc:290] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:00.227053 26548 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:00.071071 26553 raft_consensus.cc:493] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:00.290808 26450 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:00.296082 26553 raft_consensus.cc:515] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:00.297852 26450 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:00.297994 26491 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:00.052969 26556 raft_consensus.cc:515] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:00.096261 26495 raft_consensus.cc:493] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:00.298797 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:00.289809 26492 raft_consensus.cc:515] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:00.291112 25126 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40020 (request call id 260) took 1600 ms. Trace:
I20260709 13:11:00.295950 26552 raft_consensus.cc:515] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:11:00.298380 26553 leader_election.cc:290] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:00.260313 26544 leader_election.cc:290] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:00.269853 26554 raft_consensus.cc:493] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:00.299316 26495 raft_consensus.cc:515] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:00.299522 25297 raft_consensus.cc:2468] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 1.
I20260709 13:11:00.113453 26559 raft_consensus.cc:515] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:00.302736 26549 raft_consensus.cc:493] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:00.307191 25906 raft_consensus.cc:2468] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 1.
I20260709 13:11:00.270916 26537 raft_consensus.cc:493] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:00.314245 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:00.313958 26547 raft_consensus.cc:515] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:00.319677 25301 raft_consensus.cc:2468] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 1.
I20260709 13:11:00.307806 26549 raft_consensus.cc:515] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:11:00.322058 26548 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:00.289896 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:00.327606 26551 leader_election.cc:290] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:00.284623 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 67052.3us
I20260709 13:11:00.307623 26562 raft_consensus.cc:515] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:00.308445 26567 raft_consensus.cc:493] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:00.308302 26488 raft_consensus.cc:515] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:00.343026 26569 raft_consensus.cc:493] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:00.301400 26540 raft_consensus.cc:515] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:00.301035 25126 rpcz_store.cc:276] 0709 13:10:58.690776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.693420 (+  2644us) service_pool.cc:224] Handling call
0709 13:11:00.290888 (+1597468us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":2}
I20260709 13:11:00.395222 26578 raft_consensus.cc:493] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:00.408231 26565 leader_election.cc:290] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:00.371377 26570 raft_consensus.cc:493] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:00.409957 26570 raft_consensus.cc:515] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:00.372470 26575 raft_consensus.cc:493] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:00.411824 26575 raft_consensus.cc:515] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:00.414693 26562 leader_election.cc:290] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:00.419565 26349 raft_consensus.cc:493] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:00.420008 26491 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:00.420223 26349 raft_consensus.cc:515] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:00.420680 26572 raft_consensus.cc:493] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
W20260709 13:11:00.422058 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 49974us
I20260709 13:11:00.353219 26554 raft_consensus.cc:515] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:00.363196 26563 raft_consensus.cc:515] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:00.375276 26498 raft_consensus.cc:493] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:00.371184 26561 raft_consensus.cc:493] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:00.425009 26548 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:00.426389 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:00.361006 26574 raft_consensus.cc:493] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:00.396157 26578 raft_consensus.cc:515] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:11:00.436822 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:00.428200 26567 raft_consensus.cc:515] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:00.428819 26497 leader_election.cc:290] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:00.430737 26488 leader_election.cc:290] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:00.444451 25906 raft_consensus.cc:2468] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 1.
I20260709 13:11:00.433921 26570 leader_election.cc:290] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:00.438782 26548 raft_consensus.cc:493] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:00.421388 26572 raft_consensus.cc:515] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:00.452664 26486 leader_election.cc:290] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:00.322626 26537 raft_consensus.cc:515] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:00.464936 26557 leader_election.cc:290] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:00.434643 26569 raft_consensus.cc:515] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:00.483819 26552 leader_election.cc:290] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:00.487226 26498 raft_consensus.cc:515] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:00.489296 25128 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40026 (request call id 236) took 1779 ms. Trace:
I20260709 13:11:00.490394 25128 rpcz_store.cc:276] 0709 13:10:58.670775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.692507 (+ 21732us) service_pool.cc:224] Handling call
0709 13:11:00.444164 (+1751657us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74214,"reported_tablets":1}
I20260709 13:11:00.442193 26579 raft_consensus.cc:493] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:00.499087 26537 leader_election.cc:290] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:00.458165 26574 raft_consensus.cc:515] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:00.466109 26488 raft_consensus.cc:493] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:00.459333 26561 raft_consensus.cc:515] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:00.504974 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 66971.2us
I20260709 13:11:00.493844 26547 leader_election.cc:290] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:00.509588 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:00.509462 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:00.509459 26488 raft_consensus.cc:515] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:00.513919 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:00.514631 26559 leader_election.cc:290] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:00.514928 26497 raft_consensus.cc:493] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:00.515105 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:00.515262 26488 leader_election.cc:290] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:00.515576 26497 raft_consensus.cc:515] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:00.501236 26548 raft_consensus.cc:515] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:00.515329 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 137822us
I20260709 13:11:00.506431 26492 leader_election.cc:290] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:00.516359 26581 raft_consensus.cc:493] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:00.525364 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:00.520200 26556 leader_election.cc:290] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:00.519230 26569 leader_election.cc:290] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:00.530601 26498 leader_election.cc:290] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:00.532055 26549 leader_election.cc:290] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:00.531620 26540 leader_election.cc:290] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:00.506619 26579 raft_consensus.cc:515] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:00.546950 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:00.536455 26567 leader_election.cc:290] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:00.530067 26568 raft_consensus.cc:493] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:00.567853 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:00.524996 26563 leader_election.cc:290] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:00.572196 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:11:00.551698 25929 debug-util.cc:398] Leaking SignalData structure 0x7b0800282e40 after lost signal to thread 25254
W20260709 13:11:00.574771 25929 debug-util.cc:398] Leaking SignalData structure 0x7b08002f0ee0 after lost signal to thread 25255
I20260709 13:11:00.575402 25901 raft_consensus.cc:2468] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 1.
I20260709 13:11:00.575452 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:00.584714 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:00.585582 25907 raft_consensus.cc:2393] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 2: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:11:00.586056 26548 leader_election.cc:290] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:00.583945 25906 raft_consensus.cc:2468] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 1.
I20260709 13:11:00.590286 26495 leader_election.cc:290] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:00.591095 26572 leader_election.cc:290] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:00.595243 25872 leader_election.cc:304] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:11:00.595500 26574 leader_election.cc:290] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:00.595258 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:00.597110 26561 leader_election.cc:290] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:00.597621 26497 leader_election.cc:290] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:00.598335 26495 raft_consensus.cc:2804] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:00.598789 26495 raft_consensus.cc:493] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:00.599182 26495 raft_consensus.cc:3060] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:00.597564 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:00.599764 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:00.600371 25300 raft_consensus.cc:2468] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 1.
I20260709 13:11:00.584744 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:00.606074 25873 leader_election.cc:304] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:00.607003 26575 leader_election.cc:290] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:00.607088 26540 raft_consensus.cc:2804] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:00.607282 26349 leader_election.cc:290] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:00.607657 26540 raft_consensus.cc:493] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:00.605947 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:00.588555 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:00.604692 26568 raft_consensus.cc:515] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:00.609468 25872 leader_election.cc:304] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:00.613313 26349 raft_consensus.cc:493] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:00.610848 26540 raft_consensus.cc:3060] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:00.619426 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:00.619354 26349 raft_consensus.cc:515] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:00.620189 25304 raft_consensus.cc:2468] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 1.
I20260709 13:11:00.620774 25344 leader_election.cc:304] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:00.621255 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:00.617444 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:00.622159 25344 leader_election.cc:304] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:00.622978 26559 raft_consensus.cc:2804] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:00.623346 26559 raft_consensus.cc:493] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:00.623440 26570 raft_consensus.cc:2804] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:00.623805 26559 raft_consensus.cc:3060] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:00.623844 26570 raft_consensus.cc:493] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:00.624094 26551 raft_consensus.cc:2804] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:00.624375 26570 raft_consensus.cc:3060] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:00.624555 26551 raft_consensus.cc:493] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:00.628623 26551 raft_consensus.cc:3060] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:00.630497 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:00.631497 25902 raft_consensus.cc:2468] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 1.
I20260709 13:11:00.633992 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:00.635136 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:00.635468 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:00.635753 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:00.636603 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:00.636931 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:11:00.663547 25929 debug-util.cc:398] Leaking SignalData structure 0x7b08002d8ac0 after lost signal to thread 25329
I20260709 13:11:00.663341 26574 raft_consensus.cc:493] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:00.634075 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:11:00.670625 25929 debug-util.cc:398] Leaking SignalData structure 0x7b08000ca2a0 after lost signal to thread 25330
I20260709 13:11:00.664669 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:00.582597 26581 raft_consensus.cc:515] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:00.680038 26581 leader_election.cc:290] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:00.680970 26566 raft_consensus.cc:493] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:00.681571 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:00.683116 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:00.683004 26566 raft_consensus.cc:515] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:00.685196 26349 leader_election.cc:290] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:00.691288 26563 raft_consensus.cc:1064] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468: attempting to promote NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 to VOTER
I20260709 13:11:00.689651 25873 leader_election.cc:304] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:00.695346 25873 leader_election.cc:304] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:00.696167 26450 raft_consensus.cc:2804] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:00.696547 26450 raft_consensus.cc:493] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:00.664171 26574 raft_consensus.cc:515] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:00.696902 26450 raft_consensus.cc:3060] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:00.698997 26577 raft_consensus.cc:2804] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:00.685150 26567 raft_consensus.cc:493] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:00.702378 26349 raft_consensus.cc:493] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:00.688710 26572 raft_consensus.cc:493] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:00.709393 26563 consensus_queue.cc:237] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:00.710178 26349 raft_consensus.cc:515] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:00.710261 26492 raft_consensus.cc:1064] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19: attempting to promote NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 to VOTER
I20260709 13:11:00.712024 26489 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:00.712824 26578 leader_election.cc:290] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:00.717921 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:00.718583 25300 raft_consensus.cc:2468] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 3.
I20260709 13:11:00.699179 26568 leader_election.cc:290] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:00.723203 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:00.726848 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:00.727945 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:00.728969 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:00.731067 26574 leader_election.cc:290] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:00.731423 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:00.736081 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:00.737151 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:00.737272 26552 consensus_queue.cc:1059] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:00.738617 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:00.738788 26552 raft_consensus.cc:3055] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:00.739234 26552 raft_consensus.cc:740] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:00.739265 25299 raft_consensus.cc:2468] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 1.
I20260709 13:11:00.740417 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:00.740578 26567 raft_consensus.cc:515] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:00.711253 26577 raft_consensus.cc:493] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:00.710198 26572 raft_consensus.cc:515] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:00.753846 26349 leader_election.cc:290] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:00.763888 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:00.720315 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:11:00.742659 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 53298.1us
I20260709 13:11:00.766498 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:00.768504 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:00.769727 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:00.763911 26566 leader_election.cc:290] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:00.770336 25226 raft_consensus.cc:2468] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 1.
I20260709 13:11:00.772353 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:00.774091 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:00.774859 25377 raft_consensus.cc:3060] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:00.775005 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:00.723177 26548 raft_consensus.cc:493] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:00.725059 26497 raft_consensus.cc:493] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:00.725199 26556 raft_consensus.cc:493] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:00.776837 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:00.745224 26568 raft_consensus.cc:493] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:00.745780 26540 raft_consensus.cc:515] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:00.783598 25270 leader_election.cc:304] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:00.776261 26349 raft_consensus.cc:493] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:00.765192 26577 raft_consensus.cc:3060] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:00.754372 26554 leader_election.cc:290] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:00.778621 25929 debug-util.cc:398] Leaking SignalData structure 0x7b0800354a40 after lost signal to thread 25403
I20260709 13:11:00.746469 26567 leader_election.cc:290] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:00.751499 26579 leader_election.cc:290] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:00.781420 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:00.779217 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:00.784330 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:00.784224 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:00.789355 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:00.789527 26583 raft_consensus.cc:493] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:00.790441 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:00.793134 25270 leader_election.cc:304] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:00.749715 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:00.792375 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:00.795236 26576 raft_consensus.cc:2804] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:00.798570 26349 raft_consensus.cc:515] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:00.740417 26552 consensus_queue.cc:260] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:00.778169 26489 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:00.810432 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:00.748997 26492 consensus_queue.cc:237] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:00.812352 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:00.813064 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:00.814921 25228 raft_consensus.cc:2468] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 1.
I20260709 13:11:00.816411 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:00.817342 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:00.807526 26576 raft_consensus.cc:493] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:00.795504 26548 raft_consensus.cc:515] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:00.809109 26553 raft_consensus.cc:2804] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:00.820466 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:00.795699 26497 raft_consensus.cc:515] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:00.826642 26349 leader_election.cc:290] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:00.829527 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:00.807862 26556 raft_consensus.cc:515] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:00.821552 26576 raft_consensus.cc:3060] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:00.835266 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:11:00.836314 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.836591 26551 raft_consensus.cc:515] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:00.838321 25872 leader_election.cc:304] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:00.839205 26556 leader_election.cc:290] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:00.839035 26450 raft_consensus.cc:515] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:00.839654 26537 raft_consensus.cc:2804] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:00.840214 26537 raft_consensus.cc:493] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:00.840411 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:00.840636 26537 raft_consensus.cc:3060] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:00.840770 26497 leader_election.cc:290] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:00.827884 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:00.823434 26553 raft_consensus.cc:493] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:00.843050 26553 raft_consensus.cc:3060] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:00.843536 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:00.810587 26568 raft_consensus.cc:515] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:00.847889 26548 leader_election.cc:290] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:00.834313 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:11:00.853226 25929 debug-util.cc:398] Leaking SignalData structure 0x7b0800342920 after lost signal to thread 25932
I20260709 13:11:00.855181 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:00.855835 25873 leader_election.cc:304] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:00.816015 26583 raft_consensus.cc:515] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:00.855696 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:00.857620 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:00.858134 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:00.858271 25370 raft_consensus.cc:2468] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 1.
I20260709 13:11:00.863230 26568 leader_election.cc:290] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:00.866170 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:00.866678 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:00.867235 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:00.836450 26495 raft_consensus.cc:515] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:00.871546 26495 leader_election.cc:290] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:00.872174 26495 raft_consensus.cc:2749] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:00.873541 26540 leader_election.cc:290] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 3 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:00.873468 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:00.874575 26572 leader_election.cc:290] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:00.869208 26570 raft_consensus.cc:515] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:00.875231 25221 raft_consensus.cc:2468] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 1.
I20260709 13:11:00.885013 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:00.885342 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:00.885528 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:00.885013 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:00.888860 26570 leader_election.cc:290] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:00.889415 26551 leader_election.cc:290] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:00.889817 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:00.890007 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:00.866305 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:00.892657 26583 leader_election.cc:290] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:00.893934 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:00.876797 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:00.931164 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:00.931242 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:00.931622 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:00.932610 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:11:00.937508 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 58767.5us
I20260709 13:11:00.938467 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:11:00.939579 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 92722.6us
I20260709 13:11:00.851738 26552 raft_consensus.cc:3060] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:00.935146 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:00.844609 26450 leader_election.cc:290] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:00.895901 26553 raft_consensus.cc:515] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:00.960646 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 57695.5us
I20260709 13:11:00.960754 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:00.962011 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:00.964416 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:00.965201 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:00.965611 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:00.972760 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:00.974236 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:00.974906 25228 raft_consensus.cc:2468] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 1.
I20260709 13:11:00.960367 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:00.978324 25343 leader_election.cc:304] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:00.990254 25377 raft_consensus.cc:2468] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 2.
I20260709 13:11:00.991997 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:00.953344 25222 raft_consensus.cc:2468] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 1.
I20260709 13:11:00.995405 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:00.996377 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:00.996760 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:00.997984 25370 raft_consensus.cc:1240] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:01.005916 26564 raft_consensus.cc:2749] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:01.006774 25343 leader_election.cc:304] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:01.008134 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:01.008446 25343 leader_election.cc:304] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:01.009009 26560 raft_consensus.cc:2749] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:01.009454 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:01.010747 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:01.011162 25345 leader_election.cc:304] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:01.011987 26560 raft_consensus.cc:2749] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:01.012084 26553 leader_election.cc:290] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:00.963677 26559 raft_consensus.cc:515] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:01.013960 25270 leader_election.cc:304] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:01.019086 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:01.013931 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:00.986222 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:01.076596 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:01.076941 26576 raft_consensus.cc:515] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:01.027648 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:01.030575 25371 raft_consensus.cc:2393] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 2: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:01.035848 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:01.079587 25379 raft_consensus.cc:2468] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 1.
I20260709 13:11:01.034425 25343 leader_election.cc:304] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:01.074414 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:01.030110 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:01.084935 25372 raft_consensus.cc:2468] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 2.
I20260709 13:11:01.087574 26581 raft_consensus.cc:2749] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:01.087884 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:01.088092 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:01.089178 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:01.089978 25378 raft_consensus.cc:1240] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:01.089182 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:01.091279 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:01.038556 25194 leader_election.cc:304] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:01.092104 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:01.035586 26553 raft_consensus.cc:2804] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:01.075521 26489 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:01.077126 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:01.098414 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:01.077237 25370 raft_consensus.cc:2468] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 1.
I20260709 13:11:01.078588 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:01.096441 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:01.027179 26584 raft_consensus.cc:2749] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:11:01.096681 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 58304.9us
I20260709 13:11:01.091615 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:01.034842 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:01.028622 26559 leader_election.cc:290] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:01.003239 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 147485us
W20260709 13:11:01.093729 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 59350.9us
I20260709 13:11:01.098577 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:01.096171 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:01.106770 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:01.092828 25902 raft_consensus.cc:2468] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 1.
I20260709 13:11:01.093811 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:01.106961 25379 raft_consensus.cc:2468] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 1.
I20260709 13:11:01.112056 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:01.107441 25343 leader_election.cc:304] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:01.109433 25377 raft_consensus.cc:2468] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 2.
I20260709 13:11:01.028436 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:01.041953 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:01.028733 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:01.100368 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:01.099207 26583 raft_consensus.cc:2804] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:01.110877 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:01.098598 26553 raft_consensus.cc:493] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:01.117460 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:01.123421 25370 raft_consensus.cc:2468] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 1.
I20260709 13:11:01.123934 25375 raft_consensus.cc:1240] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:01.121879 25376 raft_consensus.cc:2468] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 2.
W20260709 13:11:01.117589 25271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.117024 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:01.121098 25905 raft_consensus.cc:1240] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:01.121806 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:01.137213 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:01.135852 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:01.173857 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:01.174621 25377 raft_consensus.cc:2468] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 1.
W20260709 13:11:01.155526 25271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.139657 25194 leader_election.cc:304] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:01.122371 25373 raft_consensus.cc:2468] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 2.
I20260709 13:11:01.176003 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:01.119444 26559 raft_consensus.cc:2804] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:11:01.178714 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 53169.9us
I20260709 13:11:01.122156 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:01.190999 25343 leader_election.cc:304] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:01.119342 26583 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:01.192624 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:01.194070 25872 leader_election.cc:304] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:01.147650 25873 leader_election.cc:304] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:01.195665 26563 raft_consensus.cc:2749] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:01.195416 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:01.197394 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:01.135427 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:01.198325 25902 raft_consensus.cc:1240] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:01.140694 26576 leader_election.cc:290] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:01.127492 26553 raft_consensus.cc:3060] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:01.200363 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:01.212385 26495 raft_consensus.cc:2749] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:01.136572 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:01.136907 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:01.206810 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:01.118201 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:11:01.208021 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 60459.9us
I20260709 13:11:01.209208 26537 raft_consensus.cc:515] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:01.210140 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:01.223881 25904 raft_consensus.cc:2393] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 2: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:11:01.185875 26548 raft_consensus.cc:2804] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:01.225953 26548 raft_consensus.cc:493] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:01.226385 26548 raft_consensus.cc:3060] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:01.191073 26559 raft_consensus.cc:493] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:01.215600 26540 raft_consensus.cc:2804] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:01.231962 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:01.231979 26540 raft_consensus.cc:493] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:01.232801 26540 raft_consensus.cc:3060] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:01.233150 26559 raft_consensus.cc:3060] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:01.236572 26537 leader_election.cc:290] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:01.236752 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:01.237634 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:01.218183 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:01.199958 25903 raft_consensus.cc:3060] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:01.222226 25873 leader_election.cc:304] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:01.227501 25908 raft_consensus.cc:1240] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:01.203444 25906 raft_consensus.cc:1275] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 LEARNER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:11:01.230461 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:01.230521 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:01.231340 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:01.229297 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:01.217775 25905 raft_consensus.cc:1275] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:01.202680 26583 raft_consensus.cc:3060] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:01.230073 25343 leader_election.cc:304] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:01.239907 26349 consensus_queue.cc:1059] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:01.241446 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:01.244390 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:01.245052 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:01.246809 26349 raft_consensus.cc:3055] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:01.247134 26349 raft_consensus.cc:740] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:01.250568 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:01.237855 26577 raft_consensus.cc:515] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:01.251571 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:01.253317 26577 leader_election.cc:290] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:01.253650 25900 raft_consensus.cc:2393] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 2: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:11:01.256108 25343 leader_election.cc:304] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:01.246773 26537 raft_consensus.cc:2804] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:01.257247 26537 raft_consensus.cc:697] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:01.258201 26537 consensus_queue.cc:237] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:01.261369 26564 raft_consensus.cc:2749] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:01.262122 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:01.262223 26349 consensus_queue.cc:260] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:01.246279 26572 consensus_queue.cc:1048] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:11:01.250581 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:01.263384 26349 raft_consensus.cc:3060] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:01.266189 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:01.271162 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:01.273526 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:01.276279 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:01.277590 26564 raft_consensus.cc:2749] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:01.281013 25303 raft_consensus.cc:1275] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:11:01.283644 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:01.284248 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:01.286468 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:01.286489 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:01.287344 25899 raft_consensus.cc:3060] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:01.287974 25907 raft_consensus.cc:1240] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:01.289454 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:01.290903 25270 leader_election.cc:304] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:01.291718 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:01.293726 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:01.295109 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:01.293321 26557 raft_consensus.cc:2749] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:01.296846 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:01.277699 26574 consensus_queue.cc:1048] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:11:01.299930 25270 leader_election.cc:304] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:01.300799 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:01.301435 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:01.304435 26574 raft_consensus.cc:2804] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:01.304903 26574 raft_consensus.cc:493] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:01.305356 26574 raft_consensus.cc:3060] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:01.302055 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:01.302165 25222 raft_consensus.cc:1275] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:01.302867 25902 raft_consensus.cc:1240] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:01.307035 25270 leader_election.cc:304] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:01.311110 25271 leader_election.cc:304] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
W20260709 13:11:01.314427 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.315124 26552 raft_consensus.cc:2749] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:01.315475 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:01.316457 25271 leader_election.cc:304] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:01.317533 25271 leader_election.cc:304] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:11:01.326889 26554 raft_consensus.cc:2749] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:01.328161 25271 leader_election.cc:304] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:01.328964 26552 raft_consensus.cc:2804] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:01.329367 26552 raft_consensus.cc:493] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:01.329725 26552 raft_consensus.cc:3060] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:01.330209 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:01.332238 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:01.310835 26557 raft_consensus.cc:2804] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:01.329643 25271 leader_election.cc:304] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:01.333453 26557 raft_consensus.cc:493] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:01.329918 26576 raft_consensus.cc:2749] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:01.333885 26557 raft_consensus.cc:3060] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:01.334444 25271 leader_election.cc:304] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:01.333889 26554 raft_consensus.cc:2749] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:01.340436 26552 raft_consensus.cc:515] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:11:01.342831 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:01.344523 25225 raft_consensus.cc:2468] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 2.
I20260709 13:11:01.345818 25270 leader_election.cc:304] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:01.346403 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:01.346985 25375 raft_consensus.cc:2393] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 2: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:01.346434 25345 leader_election.cc:304] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:01.347533 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:01.334751 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:01.347510 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:01.349934 25372 raft_consensus.cc:3060] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:01.348788 25345 leader_election.cc:304] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:01.352394 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:01.354403 25222 raft_consensus.cc:1275] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:11:01.354681 26584 raft_consensus.cc:2749] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:01.357831 25345 leader_election.cc:304] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:01.360150 26581 consensus_queue.cc:1048] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:01.362371 26561 raft_consensus.cc:2749] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:01.362448 26548 raft_consensus.cc:515] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:01.362488 25345 leader_election.cc:304] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:01.363559 25228 raft_consensus.cc:1240] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:01.363706 26584 raft_consensus.cc:2749] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:01.347472 26556 raft_consensus.cc:2749] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:01.351172 26576 raft_consensus.cc:2804] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:01.366109 25345 leader_election.cc:304] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:01.366422 26576 raft_consensus.cc:493] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:01.367000 26576 raft_consensus.cc:3060] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:01.367043 26575 raft_consensus.cc:2749] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:01.352512 26578 raft_consensus.cc:2804] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:01.370168 25345 leader_election.cc:304] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:01.370214 26578 raft_consensus.cc:493] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:01.370870 26578 raft_consensus.cc:3060] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:01.371713 25270 leader_election.cc:304] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:01.375170 25345 leader_election.cc:304] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:01.378399 25345 leader_election.cc:304] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:01.377552 26561 raft_consensus.cc:2804] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:01.379314 26561 raft_consensus.cc:493] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:01.380939 26561 raft_consensus.cc:3060] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:01.385031 25378 raft_consensus.cc:1275] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:01.387571 25372 raft_consensus.cc:2468] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 3.
I20260709 13:11:01.387856 25195 leader_election.cc:304] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:01.389571 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:01.390725 26563 raft_consensus.cc:2749] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:01.391027 26560 consensus_queue.cc:1048] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:01.391520 26563 consensus_queue.cc:1059] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:01.388469 26559 raft_consensus.cc:515] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:11:01.393814 25345 leader_election.cc:304] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:01.394277 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:01.397215 26584 raft_consensus.cc:2804] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:01.398470 26584 raft_consensus.cc:697] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 2 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:01.399041 25271 leader_election.cc:304] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:01.399364 26584 consensus_queue.cc:237] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:01.400496 25271 leader_election.cc:304] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:01.378113 26581 raft_consensus.cc:2749] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:01.402011 26554 raft_consensus.cc:2749] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:01.402160 26556 raft_consensus.cc:2749] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:01.402824 26540 raft_consensus.cc:515] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:01.408461 26540 leader_election.cc:290] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:01.403122 26564 raft_consensus.cc:3055] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:01.409741 26564 raft_consensus.cc:740] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:01.394366 26559 leader_election.cc:290] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:11:01.410795 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 137193us
I20260709 13:11:01.410609 26564 consensus_queue.cc:260] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:01.411530 25195 leader_election.cc:304] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:01.412230 26568 raft_consensus.cc:2749] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:01.412918 26568 raft_consensus.cc:2749] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:01.413342 25874 leader_election.cc:304] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:01.401734 25271 leader_election.cc:304] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:01.414136 25195 leader_election.cc:304] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:11:01.414615 26556 raft_consensus.cc:2749] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:01.414808 26568 raft_consensus.cc:2804] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:01.415192 26568 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:01.415529 26568 raft_consensus.cc:3060] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:01.415719 25271 leader_election.cc:304] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:01.418044 26540 raft_consensus.cc:2804] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:01.418440 26540 raft_consensus.cc:493] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:01.418797 26540 raft_consensus.cc:3060] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:01.421533 26556 raft_consensus.cc:2749] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:01.423020 25271 leader_election.cc:304] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:01.423485 25195 leader_election.cc:304] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:01.425112 26349 raft_consensus.cc:2749] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:01.425562 26548 leader_election.cc:290] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:01.425418 26497 consensus_queue.cc:1059] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:11:01.424607 26556 raft_consensus.cc:2749] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:01.435225 26349 raft_consensus.cc:3055] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:01.434799 26552 leader_election.cc:290] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361)
I20260709 13:11:01.435598 26349 raft_consensus.cc:740] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:01.436388 25899 raft_consensus.cc:2468] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 2.
I20260709 13:11:01.425535 26489 consensus_queue.cc:1059] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:11:01.437201 25902 raft_consensus.cc:1240] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:01.437582 26489 raft_consensus.cc:3055] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:01.438010 26489 raft_consensus.cc:740] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:01.438380 25874 leader_election.cc:304] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:01.438961 26489 consensus_queue.cc:260] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:01.436404 26349 consensus_queue.cc:260] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:01.440234 26591 raft_consensus.cc:2749] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:01.440308 26489 raft_consensus.cc:3060] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:01.440989 26349 raft_consensus.cc:3060] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:01.441671 25874 leader_election.cc:304] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:01.443397 25271 leader_election.cc:304] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:01.445251 26591 raft_consensus.cc:2804] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:01.445636 26591 raft_consensus.cc:493] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:01.446009 26591 raft_consensus.cc:3060] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:01.430058 26572 raft_consensus.cc:1064] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce: attempting to promote NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 to VOTER
I20260709 13:11:01.448089 25874 leader_election.cc:304] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:01.450075 25271 leader_election.cc:304] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:01.450672 26537 raft_consensus.cc:2749] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:01.449316 26554 raft_consensus.cc:2749] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:01.452262 26572 consensus_queue.cc:237] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:01.454301 25874 leader_election.cc:304] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:01.456439 26554 raft_consensus.cc:2749] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:01.458034 25271 leader_election.cc:304] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:01.457079 26578 raft_consensus.cc:515] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:01.462234 26578 leader_election.cc:290] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:01.462749 26554 raft_consensus.cc:2749] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:01.463423 26554 raft_consensus.cc:2749] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:11:01.464350 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 110242us
I20260709 13:11:01.465015 25270 leader_election.cc:304] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:01.466045 25270 leader_election.cc:304] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:01.457031 26576 raft_consensus.cc:515] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:01.470438 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 47019.2us
I20260709 13:11:01.446405 26561 raft_consensus.cc:515] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:01.473187 25195 leader_election.cc:304] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:01.471693 25270 leader_election.cc:304] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
W20260709 13:11:01.476286 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 85115.1us
I20260709 13:11:01.477248 25874 leader_election.cc:304] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:11:01.477931 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 84206.9us
I20260709 13:11:01.478163 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:01.428522 26574 raft_consensus.cc:515] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:01.484972 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:01.487406 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:01.489996 26604 raft_consensus.cc:2749] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:01.474049 26552 raft_consensus.cc:2804] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:01.491087 26583 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:01.492479 25229 raft_consensus.cc:1240] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:01.491104 26552 raft_consensus.cc:493] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:01.493146 26583 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:01.493269 25195 leader_election.cc:304] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:01.492456 26576 leader_election.cc:290] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:01.493930 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:01.493417 26552 raft_consensus.cc:3060] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:01.496601 25270 leader_election.cc:304] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:01.499346 25270 leader_election.cc:304] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:01.500272 25270 leader_election.cc:304] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:01.501116 25270 leader_election.cc:304] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:01.444864 26568 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:01.449913 26540 raft_consensus.cc:515] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:01.477005 26554 raft_consensus.cc:2804] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:01.455437 26557 raft_consensus.cc:515] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:01.477279 25903 raft_consensus.cc:2468] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 2.
W20260709 13:11:01.545403 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 43812.1us
I20260709 13:11:01.559135 25195 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:01.477082 26489 raft_consensus.cc:2749] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:01.476832 26556 consensus_queue.cc:1048] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:11:01.547422 25376 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92f679df8187472794ba8595642f63f9"
dest_uuid: "79d99c0e498349bda74127365219e468"
mode: GRACEFUL
new_leader_uuid: "1f539ba21487460085b837e7529a78ce"
 from {username='slave'} at 127.0.0.1:59274
I20260709 13:11:01.509440 26583 raft_consensus.cc:2749] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:01.549116 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:01.550076 25374 raft_consensus.cc:1240] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:01.550434 25378 raft_consensus.cc:1240] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:11:01.513557 26554 raft_consensus.cc:493] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:01.551017 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:01.552196 26557 leader_election.cc:290] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:01.555034 26574 leader_election.cc:290] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:01.495652 26450 raft_consensus.cc:2749] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:01.557883 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:01.591285 26497 raft_consensus.cc:2749] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:01.589491 25376 raft_consensus.cc:606] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Received request to transfer leadership to TS 1f539ba21487460085b837e7529a78ce
I20260709 13:11:01.548698 26540 leader_election.cc:290] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:01.481007 26578 consensus_queue.cc:1048] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.078s
I20260709 13:11:01.511286 26576 raft_consensus.cc:2749] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:01.510210 26492 raft_consensus.cc:2804] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:11:01.591605 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 96222.2us
I20260709 13:11:01.558597 26560 consensus_queue.cc:1059] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:11:01.558859 26604 raft_consensus.cc:3060] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:01.589421 26537 raft_consensus.cc:2749] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:11:01.574651 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.610980 25195 leader_election.cc:304] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:01.637146 26349 raft_consensus.cc:2749] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:01.637621 25195 leader_election.cc:304] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:01.639211 25195 leader_election.cc:304] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:01.598076 26554 raft_consensus.cc:3060] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:01.612063 26557 raft_consensus.cc:2804] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:01.612975 25296 raft_consensus.cc:1240] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:01.613924 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:01.614126 26548 consensus_queue.cc:1059] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:01.614476 26564 raft_consensus.cc:3060] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:01.651070 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:01.615866 25299 raft_consensus.cc:1240] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:01.621161 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:01.625267 26492 raft_consensus.cc:493] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:01.625314 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:01.625857 25304 raft_consensus.cc:1240] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:01.626883 25222 raft_consensus.cc:2393] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 2: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:01.632227 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:01.497844 26584 consensus_queue.cc:1059] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.094s
I20260709 13:11:01.640780 25344 leader_election.cc:304] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:01.646021 25195 leader_election.cc:304] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:01.643376 26489 raft_consensus.cc:2749] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:01.643545 26602 raft_consensus.cc:2749] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:01.643844 26557 raft_consensus.cc:493] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:01.615586 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:01.677237 25230 raft_consensus.cc:2410] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:11:01.649955 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
W20260709 13:11:01.665851 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.676100 26570 raft_consensus.cc:2804] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:01.681075 25298 raft_consensus.cc:1240] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:01.665633 26349 consensus_queue.cc:1059] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:01.668596 25303 raft_consensus.cc:1240] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:01.671546 25343 leader_election.cc:304] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:01.673004 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:01.665597 26492 raft_consensus.cc:3060] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:01.682358 26557 raft_consensus.cc:3060] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:01.687182 25227 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0"
dest_uuid: "1f539ba21487460085b837e7529a78ce"
mode: GRACEFUL
new_leader_uuid: "da445ce82dc4467f95f4fa52297eaa19"
 from {username='slave'} at 127.0.0.1:45014
I20260709 13:11:01.696709 25227 raft_consensus.cc:606] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 2 LEADER]: Received request to transfer leadership to TS da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:01.688099 26349 raft_consensus.cc:3055] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:11:01.697559 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 196490us
I20260709 13:11:01.697630 26349 raft_consensus.cc:740] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:01.689314 25195 leader_election.cc:304] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:11:01.701218 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.702348 26489 raft_consensus.cc:2749] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:01.706789 26349 consensus_queue.cc:260] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:01.710772 25126 catalog_manager.cc:5697] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 1 to 2, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68). New cstate: current_term: 2 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:01.711606 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:01.693123 26570 raft_consensus.cc:697] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 2 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:01.715657 25300 raft_consensus.cc:1240] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:01.714887 26570 consensus_queue.cc:237] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:01.704777 26591 raft_consensus.cc:515] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:01.705430 25270 leader_election.cc:304] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:01.704470 25195 leader_election.cc:304] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:01.719970 25270 leader_election.cc:304] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:01.720355 25195 leader_election.cc:304] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:01.718803 26561 leader_election.cc:290] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:01.721818 26561 raft_consensus.cc:2749] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:01.722425 26561 raft_consensus.cc:493] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:01.722527 26488 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:01.722891 26561 raft_consensus.cc:515] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:01.723289 26488 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:11:01.724759 26591 leader_election.cc:290] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:01.725462 26489 raft_consensus.cc:2749] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:01.724815 26561 leader_election.cc:290] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:01.725909 26599 raft_consensus.cc:493] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:01.726424 26497 raft_consensus.cc:3055] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:01.726840 26497 raft_consensus.cc:740] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:01.726617 26599 raft_consensus.cc:515] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:01.727782 26497 consensus_queue.cc:260] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:01.729022 26497 raft_consensus.cc:3060] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:01.688015 25901 raft_consensus.cc:1240] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:01.739331 26605 raft_consensus.cc:2749] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:01.730315 25270 leader_election.cc:304] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:01.738976 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:01.741729 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:01.744956 26349 raft_consensus.cc:3060] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:01.719020 25899 raft_consensus.cc:1240] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:01.729175 26599 leader_election.cc:290] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:01.742138 26489 raft_consensus.cc:2749] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:01.750741 26576 raft_consensus.cc:2804] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:01.751129 26576 raft_consensus.cc:493] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:01.751489 26576 raft_consensus.cc:3060] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:01.725926 26556 raft_consensus.cc:2804] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:01.742650 26568 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:01.752841 26556 raft_consensus.cc:493] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:01.753326 26556 raft_consensus.cc:3060] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:01.738569 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 227876us
I20260709 13:11:01.745935 26488 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:01.760767 25270 leader_election.cc:304] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:01.763129 25270 leader_election.cc:304] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:01.762646 25195 leader_election.cc:304] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:01.756855 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:01.782491 25378 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc"
dest_uuid: "79d99c0e498349bda74127365219e468"
mode: GRACEFUL
new_leader_uuid: "1f539ba21487460085b837e7529a78ce"
 from {username='slave'} at 127.0.0.1:59274
I20260709 13:11:01.783176 25378 raft_consensus.cc:606] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 2 LEADER]: Received request to transfer leadership to TS 1f539ba21487460085b837e7529a78ce
I20260709 13:11:01.784015 26568 raft_consensus.cc:2749] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:01.785384 26603 raft_consensus.cc:2749] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:11:01.792374 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.805480 25229 raft_consensus.cc:2468] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 2.
I20260709 13:11:01.815894 25195 leader_election.cc:304] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:01.816756 26349 raft_consensus.cc:2749] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:01.731724 26609 raft_consensus.cc:2749] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:01.834185 25195 leader_election.cc:304] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:01.834514 25228 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211"
dest_uuid: "1f539ba21487460085b837e7529a78ce"
mode: GRACEFUL
new_leader_uuid: "da445ce82dc4467f95f4fa52297eaa19"
 from {username='slave'} at 127.0.0.1:45014
I20260709 13:11:01.835071 25228 raft_consensus.cc:606] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 2 LEADER]: Received request to transfer leadership to TS da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:01.836875 25195 leader_election.cc:304] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:01.786837 26611 raft_consensus.cc:2749] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:01.844974 25195 leader_election.cc:304] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:01.845841 26349 raft_consensus.cc:2749] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:01.847397 25195 leader_election.cc:304] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:01.850797 24113 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:11:01.851022 26560 raft_consensus.cc:3055] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:01.851421 26560 raft_consensus.cc:740] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:01.852407 24113 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:01.852182 26560 consensus_queue.cc:260] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:01.853011 26604 raft_consensus.cc:2749] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:11:01.825115 26553 consensus_meta.cc:287] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.597s	user 0.007s	sys 0.003s
I20260709 13:11:01.838681 26578 raft_consensus.cc:3055] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:01.859978 25195 leader_election.cc:304] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:01.860790 26578 raft_consensus.cc:740] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:01.859592 26553 raft_consensus.cc:515] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:01.868062 26553 leader_election.cc:290] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:01.868583 26609 raft_consensus.cc:2749] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:01.870039 25296 raft_consensus.cc:1240] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:01.841562 26583 raft_consensus.cc:2749] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:01.892069 26349 raft_consensus.cc:2749] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:11:01.892529 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 129463us
I20260709 13:11:01.894533 26605 consensus_queue.cc:1048] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:01.897022 25872 leader_election.cc:304] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:01.898082 26579 raft_consensus.cc:2749] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:11:01.907325 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 47421.1us
I20260709 13:11:01.909474 25195 leader_election.cc:304] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:01.903180 25873 leader_election.cc:304] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:01.912515 25873 leader_election.cc:304] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:01.906136 26552 raft_consensus.cc:515] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:01.916109 25908 raft_consensus.cc:1275] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:01.891264 26578 consensus_queue.cc:260] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:01.916769 26552 leader_election.cc:290] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:01.917179 26578 raft_consensus.cc:3060] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:01.917799 25301 raft_consensus.cc:1240] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:01.914966 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:01.856132 26613 raft_consensus.cc:2749] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:01.925938 25372 raft_consensus.cc:1240] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:01.858528 26570 consensus_queue.cc:1059] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 13:11:01.927942 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:01.930279 25908 raft_consensus.cc:1240] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:01.931233 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:01.933722 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:01.935390 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:01.937268 25224 raft_consensus.cc:2468] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 2.
I20260709 13:11:01.922501 26564 consensus_queue.cc:1048] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:11:01.868569 26492 raft_consensus.cc:515] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:01.918362 26568 raft_consensus.cc:2749] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:01.911103 25195 leader_election.cc:304] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:01.943413 26576 raft_consensus.cc:515] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:01.921903 26495 raft_consensus.cc:2804] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:01.922223 26579 raft_consensus.cc:2749] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:01.950212 26576 leader_election.cc:290] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:01.951566 26572 raft_consensus.cc:2749] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:01.952497 25195 leader_election.cc:304] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:01.952708 25125 catalog_manager.cc:5697] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 1 to 2, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 2 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:01.955400 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:01.956609 26556 raft_consensus.cc:515] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:01.920957 26554 raft_consensus.cc:515] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:01.964203 26492 leader_election.cc:290] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:01.964852 25302 raft_consensus.cc:1240] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:01.966019 25223 raft_consensus.cc:1275] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:01.967151 25195 leader_election.cc:304] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:01.966416 25221 raft_consensus.cc:1240] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:01.967037 26572 raft_consensus.cc:2749] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:01.973917 26495 raft_consensus.cc:697] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:01.974852 26495 consensus_queue.cc:237] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:01.889268 26557 raft_consensus.cc:515] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:01.980211 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:01.981245 26349 consensus_queue.cc:1059] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:01.984114 25195 leader_election.cc:304] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:01.984635 25305 raft_consensus.cc:1240] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:01.983073 26583 consensus_queue.cc:1059] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:11:01.998052 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:01.978413 26489 raft_consensus.cc:2749] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:01.996899 26572 raft_consensus.cc:2749] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:02.006425 25270 leader_election.cc:304] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:01.986545 26613 consensus_queue.cc:1059] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:11:02.001143 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:02.013857 26568 consensus_queue.cc:1059] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:11:02.018437 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:02.000964 26575 consensus_queue.cc:1048] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:11:02.024380 26613 raft_consensus.cc:3055] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:02.024748 26613 raft_consensus.cc:740] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:02.025818 26568 raft_consensus.cc:3055] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:02.026207 26568 raft_consensus.cc:740] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:02.026993 26568 consensus_queue.cc:260] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:02.015430 26604 raft_consensus.cc:2804] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:02.028095 26568 raft_consensus.cc:3060] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:02.028334 26604 raft_consensus.cc:697] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 2 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:02.029240 26604 consensus_queue.cc:237] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:02.031960 26554 leader_election.cc:290] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:02.003202 26584 consensus_queue.cc:1059] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:11:02.034508 26584 raft_consensus.cc:3055] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:02.034825 26584 raft_consensus.cc:740] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:02.035732 26584 consensus_queue.cc:260] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:02.011696 26602 consensus_queue.cc:1059] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:11:02.038909 26584 raft_consensus.cc:3060] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:02.009004 26611 consensus_queue.cc:1059] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:11:02.041079 26554 consensus_queue.cc:1059] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:02.042174 26554 raft_consensus.cc:3055] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:02.042522 26554 raft_consensus.cc:740] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:02.043390 26560 raft_consensus.cc:3060] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:02.020165 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:02.005652 26609 consensus_queue.cc:1059] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:11:02.049552 26611 raft_consensus.cc:3055] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:02.049965 26611 raft_consensus.cc:740] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:02.050462 25901 raft_consensus.cc:1240] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:02.050810 26611 consensus_queue.cc:260] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:02.052203 26611 raft_consensus.cc:3060] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:02.046265 26572 raft_consensus.cc:3055] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:02.020470 26581 consensus_queue.cc:1059] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:11:02.046695 26556 leader_election.cc:290] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:02.059366 25872 leader_election.cc:304] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:02.065444 26579 raft_consensus.cc:2749] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:02.067277 26557 leader_election.cc:290] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:02.056409 26572 raft_consensus.cc:740] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:02.075073 25270 leader_election.cc:304] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:02.091455 26612 raft_consensus.cc:3055] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:02.091930 26612 raft_consensus.cc:740] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:02.043422 26554 consensus_queue.cc:260] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:02.094583 25270 leader_election.cc:304] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:02.099920 26554 raft_consensus.cc:3060] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:02.104847 26576 raft_consensus.cc:2749] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:02.097687 26557 raft_consensus.cc:2749] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:11:02.121271 26614 log.cc:927] Time spent T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:11:02.106940 25901 raft_consensus.cc:1240] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:02.118476 26612 consensus_queue.cc:260] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:11:02.110948 26572 consensus_queue.cc:260] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:11:02.100178 26574 consensus_queue.cc:1059] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:11:02.108454 26605 consensus_queue.cc:1059] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:11:02.132560 26572 raft_consensus.cc:3060] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:02.142750 25874 leader_election.cc:304] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:02.144186 25874 leader_election.cc:304] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:02.161536 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:02.161979 26489 raft_consensus.cc:3055] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:02.162499 26489 raft_consensus.cc:740] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:02.163578 26489 consensus_queue.cc:260] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:02.164922 26489 raft_consensus.cc:3060] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:02.167901 25303 raft_consensus.cc:1275] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:02.170388 26607 raft_consensus.cc:2804] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:02.170920 26607 raft_consensus.cc:697] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:02.193455 26607 consensus_queue.cc:237] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:02.194311 26553 raft_consensus.cc:3055] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:02.197558 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:02.198987 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:02.200541 25303 raft_consensus.cc:1240] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:02.200387 25271 leader_election.cc:304] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:02.194617 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:02.194826 26553 raft_consensus.cc:740] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:02.203342 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:02.203816 26553 consensus_queue.cc:260] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:02.204909 25305 raft_consensus.cc:1275] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:02.208360 25195 leader_election.cc:304] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:02.216691 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
W20260709 13:11:02.226044 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.231153 26564 raft_consensus.cc:3055] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:02.231593 26564 raft_consensus.cc:740] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:02.232470 26564 consensus_queue.cc:260] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:02.233665 26564 raft_consensus.cc:3060] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:02.221903 26605 raft_consensus.cc:2749] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:02.237939 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:02.214550 26602 raft_consensus.cc:2749] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:02.214687 26612 raft_consensus.cc:3060] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:02.251184 25271 leader_election.cc:304] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:02.235617 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:02.257033 25271 leader_election.cc:304] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:11:02.233922 26609 consensus_queue.cc:1059] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:11:02.245045 26556 raft_consensus.cc:493] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:02.252964 25900 raft_consensus.cc:1275] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:02.254632 26557 raft_consensus.cc:2749] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:02.261651 26553 raft_consensus.cc:3060] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:02.268939 26583 consensus_queue.cc:1059] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:11:02.265663 26602 consensus_queue.cc:1059] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:11:02.317276 26548 raft_consensus.cc:3055] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:02.317806 26548 raft_consensus.cc:740] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:02.318683 26548 consensus_queue.cc:260] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:02.320688 26548 raft_consensus.cc:3060] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:02.322302 26497 raft_consensus.cc:3055] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:02.322844 26497 raft_consensus.cc:740] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:02.294348 26557 raft_consensus.cc:2804] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:02.326545 26497 consensus_queue.cc:260] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:02.279490 26556 raft_consensus.cc:515] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:02.343708 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 338425us
I20260709 13:11:02.362062 25343 leader_election.cc:304] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:11:02.363981 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 376594us
I20260709 13:11:02.363438 26349 raft_consensus.cc:3055] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:02.372426 26349 raft_consensus.cc:740] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
W20260709 13:11:02.373889 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 164148us
I20260709 13:11:02.345714 26557 raft_consensus.cc:697] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 2 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
W20260709 13:11:02.374059 25345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.351406 26540 raft_consensus.cc:2749] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:02.378101 26349 consensus_queue.cc:260] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:02.389608 25370 raft_consensus.cc:1275] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:02.390082 26584 raft_consensus.cc:493] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:02.390604 26584 raft_consensus.cc:515] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:02.392690 26622 raft_consensus.cc:2955] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:11:02.395020 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:02.397545 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:02.399658 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:02.399942 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:02.400484 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:02.382251 26559 raft_consensus.cc:2749] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:02.400167 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:02.408485 25270 leader_election.cc:304] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:02.410410 26556 leader_election.cc:290] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:02.410492 25900 raft_consensus.cc:1275] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:02.411317 26557 consensus_queue.cc:237] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:02.383252 26497 raft_consensus.cc:3060] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:02.413689 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.413909 26349 raft_consensus.cc:3060] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:02.414319 25376 raft_consensus.cc:1275] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:11:02.416136 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 285297us
I20260709 13:11:02.421897 26632 consensus_queue.cc:1048] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:11:02.392697 26584 leader_election.cc:290] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:02.434122 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.410621 26552 raft_consensus.cc:3055] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:02.422189 26599 consensus_queue.cc:1048] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:11:02.437693 26537 consensus_queue.cc:1048] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:02.436578 25874 leader_election.cc:304] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:02.446069 25872 leader_election.cc:304] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:02.431356 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:02.460419 25270 leader_election.cc:304] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:02.461272 26633 raft_consensus.cc:2749] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:02.461593 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:02.443989 26554 raft_consensus.cc:2749] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:02.461265 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:02.435490 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:02.397437 26613 consensus_queue.cc:260] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:02.444585 26552 raft_consensus.cc:740] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
W20260709 13:11:02.493120 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.428174 26489 consensus_queue.cc:1048] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:11:02.472327 25345 leader_election.cc:304] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
W20260709 13:11:02.506305 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 249355us
I20260709 13:11:02.508026 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:02.466094 26604 raft_consensus.cc:2749] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:02.464818 26579 raft_consensus.cc:2749] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:02.510989 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:11:02.505165 26578 consensus_meta.cc:287] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.588s	user 0.011s	sys 0.000s
I20260709 13:11:02.522661 25305 raft_consensus.cc:1240] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:02.523270 26349 consensus_queue.cc:1059] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:02.509809 26563 raft_consensus.cc:2749] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:02.539139 26349 consensus_queue.cc:1048] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:02.554857 25378 raft_consensus.cc:2468] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 2.
I20260709 13:11:02.557618 26615 consensus_queue.cc:1059] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.099s
I20260709 13:11:02.559063 26615 raft_consensus.cc:3055] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:02.559482 26615 raft_consensus.cc:740] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:02.560490 26615 consensus_queue.cc:260] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:02.536465 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:02.537297 25302 raft_consensus.cc:2955] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:11:02.622165 26603 raft_consensus.cc:493] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.622926 26603 raft_consensus.cc:515] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:02.628302 26603 leader_election.cc:290] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:02.628885 26602 raft_consensus.cc:3055] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:02.629341 26602 raft_consensus.cc:740] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
W20260709 13:11:02.622272 26626 log.cc:927] Time spent T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
W20260709 13:11:02.655833 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 192681us
I20260709 13:11:02.656868 25230 raft_consensus.cc:2468] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 2.
I20260709 13:11:02.662621 25270 leader_election.cc:304] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:02.671180 26604 raft_consensus.cc:2749] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:02.672475 25270 leader_election.cc:304] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
W20260709 13:11:02.681706 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 220991us
I20260709 13:11:02.659873 26615 raft_consensus.cc:3060] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:02.680920 26604 raft_consensus.cc:2749] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:02.694054 26613 raft_consensus.cc:3060] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:02.700557 26630 log.cc:927] Time spent T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.214s	user 0.000s	sys 0.003s
I20260709 13:11:02.718605 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:02.720803 25301 raft_consensus.cc:2468] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 2.
I20260709 13:11:02.722023 26572 raft_consensus.cc:3055] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:02.722500 26572 raft_consensus.cc:740] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:02.723523 26572 consensus_queue.cc:260] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:02.726948 25271 leader_election.cc:304] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:11:02.717682 26600 raft_consensus.cc:993] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468: : Instructing follower 1f539ba21487460085b837e7529a78ce to start an election
I20260709 13:11:02.745157 26636 raft_consensus.cc:2804] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:02.745908 26636 raft_consensus.cc:697] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 2 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:02.746985 26636 consensus_queue.cc:237] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:02.752101 26560 raft_consensus.cc:1081] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 2 LEADER]: Signalling peer 1f539ba21487460085b837e7529a78ce to start an election
I20260709 13:11:02.752980 25902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50060 (request call id 240) took 1114 ms. Trace:
I20260709 13:11:02.666297 26602 consensus_queue.cc:260] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:02.758781 26602 raft_consensus.cc:3060] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:02.753530 25902 rpcz_store.cc:276] 0709 13:11:01.638080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.641472 (+  3392us) service_pool.cc:224] Handling call
0709 13:11:01.744226 (+102754us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:01.749099 (+  4873us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:01.749134 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:01.997089 (+247955us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b4c0023f180. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72df3ba20 00007fd72df4ca29 00007fd72df12644 00007fd72df39f2d 00007fd72df39b93 00007fd72fc6a18b 00007fd72fc6acb5 00007fd72fc6c004 00007fd72fc6b729 00007fd72fc70d96 00007fd72fc65adb
0709 13:11:02.057883 (+ 60794us) log.cc:844] Serialized 564 byte log entry
0709 13:11:02.341431 (+283548us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:02.341482 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.344869 (+  3387us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:02.698699 (+353830us) raft_consensus.cc:1685] finished
0709 13:11:02.699350 (+   651us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:02.752889 (+ 53539us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25057152,"thread_start_us":277803,"threads_started":1,"wal-append.queue_time_us":363619}
W20260709 13:11:02.769342 26620 log.cc:927] Time spent T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.418s	user 0.001s	sys 0.002s
I20260709 13:11:02.775317 26604 raft_consensus.cc:2955] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:11:02.785607 26552 consensus_queue.cc:260] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:02.787664 26552 raft_consensus.cc:3060] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:02.794752 25230 raft_consensus.cc:2955] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:11:02.798122 26633 raft_consensus.cc:493] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:02.829381 26633 raft_consensus.cc:515] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:02.832109 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:02.833806 25222 raft_consensus.cc:2393] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 2: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
W20260709 13:11:02.840775 26629 log.cc:927] Time spent T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.492s	user 0.002s	sys 0.000s
I20260709 13:11:02.852062 26488 raft_consensus.cc:493] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:02.852607 26488 raft_consensus.cc:515] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:02.858510 26572 raft_consensus.cc:3060] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:02.859894 26633 leader_election.cc:290] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:02.862066 26488 leader_election.cc:290] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:02.863415 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:02.864189 25908 raft_consensus.cc:2393] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 2: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:11:02.867223 25227 raft_consensus.cc:1275] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:11:02.900573 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 399910us
W20260709 13:11:02.897181 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 375623us
I20260709 13:11:02.907495 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:02.896348 26633 raft_consensus.cc:493] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.908267 25303 raft_consensus.cc:2468] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 2.
I20260709 13:11:02.914362 26548 consensus_queue.cc:1048] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:11:02.923164 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 407713us
I20260709 13:11:02.923630 25230 raft_consensus.cc:1275] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:11:02.924154 25230 pending_rounds.cc:85] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce: Aborting all ops after (but not including) 4
I20260709 13:11:02.924401 25230 pending_rounds.cc:107] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:11:02.924649 25230 raft_consensus.cc:2889] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:02.925915 25303 raft_consensus.cc:1240] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:02.932745 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:02.942826 25126 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33566 (request call id 173) took 1295 ms. Trace:
I20260709 13:11:02.945288 26349 consensus_queue.cc:1059] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:11:02.951848 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 440804us
I20260709 13:11:02.909838 26488 raft_consensus.cc:493] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
W20260709 13:11:02.959127 25345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.961155 25195 leader_election.cc:304] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:02.962419 26647 consensus_queue.cc:1048] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:02.953819 26572 raft_consensus.cc:3055] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:02.947889 26633 raft_consensus.cc:515] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:02.943360 25126 rpcz_store.cc:276] 0709 13:11:01.647141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.647282 (+   141us) service_pool.cc:224] Handling call
0709 13:11:02.942758 (+1295476us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:02.234943 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:02.267231 (+ 32288us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:02.271883 (+  4652us) write_op.cc:435] Acquired schema lock
0709 13:11:02.290649 (+ 18766us) tablet.cc:662] Decoding operations
0709 13:11:02.372120 (+ 81471us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:02.383030 (+ 10910us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:02.386280 (+  3250us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:11:02.411750 (+ 25470us) tablet.cc:701] Row locks acquired
0709 13:11:02.411804 (+    54us) write_op.cc:260] PREPARE: finished
0709 13:11:02.411986 (+   182us) write_op.cc:270] Start()
0709 13:11:02.412128 (+   142us) write_op.cc:276] Timestamp: P: 1783602662411920 usec, L: 0
0709 13:11:02.412164 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 13:11:02.412796 (+   632us) log.cc:844] Serialized 536 byte log entry
0709 13:11:02.921032 (+508236us) op_driver.cc:464] REPLICATION: finished
0709 13:11:02.931516 (+ 10484us) write_op.cc:301] APPLY: starting
0709 13:11:02.931618 (+   102us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:02.931726 (+   108us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:02.931886 (+   160us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:02.932190 (+   304us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:02.932460 (+   270us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:11:02.932514 (+    54us) write_op.cc:312] APPLY: finished
0709 13:11:02.932806 (+   292us) log.cc:844] Serialized 23 byte log entry
0709 13:11:02.932978 (+   172us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:02.933048 (+    70us) write_op.cc:454] Released schema lock
0709 13:11:02.933095 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:02.939355 (+  6260us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:02.939385 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":10205,"apply.run_cpu_time_us":1936,"apply.run_wall_time_us":7813,"num_ops":1,"prepare.queue_time_us":380242,"prepare.run_cpu_time_us":11471,"prepare.run_wall_time_us":237443,"raft.queue_time_us":451711,"raft.run_cpu_time_us":2717,"raft.run_wall_time_us":10430,"replication_time_us":508749,"thread_start_us":619421,"threads_started":4,"wal-append.queue_time_us":54394}]]}
I20260709 13:11:02.975756 26643 raft_consensus.cc:2804] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:02.956284 26488 raft_consensus.cc:515] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:02.983256 26488 leader_election.cc:290] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:02.979588 26642 raft_consensus.cc:493] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.978130 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:02.985667 25343 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:02.988013 25376 raft_consensus.cc:1275] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:11:02.972111 26572 raft_consensus.cc:740] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:02.993253 25343 leader_election.cc:304] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:02.794801 25902 raft_consensus.cc:2955] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:11:02.998005 25343 leader_election.cc:304] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:03.000550 26488 raft_consensus.cc:2749] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:03.004225 25343 leader_election.cc:304] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:02.994544 26548 consensus_queue.cc:1059] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:11:03.010725 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:11:03.015928 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 340940us
I20260709 13:11:02.996745 26622 raft_consensus.cc:2749] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:03.021340 25229 raft_consensus.cc:1275] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:03.019157 25270 leader_election.cc:304] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:02.995249 26643 raft_consensus.cc:697] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 2 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:03.025940 25908 raft_consensus.cc:1275] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:03.011159 26548 raft_consensus.cc:3055] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:03.020951 25343 leader_election.cc:304] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:03.027719 25270 leader_election.cc:304] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:02.997419 26642 raft_consensus.cc:515] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:03.041849 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:03.001120 25226 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc"
dest_uuid: "1f539ba21487460085b837e7529a78ce"
 from {username='slave'} at 127.0.0.1:58418
I20260709 13:11:03.044691 25301 raft_consensus.cc:3060] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:03.073041 25226 raft_consensus.cc:493] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:03.073441 25226 raft_consensus.cc:3060] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:02.979923 26640 consensus_queue.cc:1048] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.133s
I20260709 13:11:03.013170 26575 raft_consensus.cc:2804] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:03.080904 25376 raft_consensus.cc:1240] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 1. Current term is 2. Ops: []
W20260709 13:11:03.079523 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 44932.4us
I20260709 13:11:03.088850 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:03.031925 26552 raft_consensus.cc:2749] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:03.020100 25222 raft_consensus.cc:2468] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 3.
I20260709 13:11:03.076963 26584 raft_consensus.cc:2804] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:03.036994 26548 raft_consensus.cc:740] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:03.092669 25299 raft_consensus.cc:2393] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 3: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:03.098074 26575 raft_consensus.cc:697] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 2 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:03.091293 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:03.108475 26540 consensus_queue.cc:1048] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:03.108719 26621 raft_consensus.cc:493] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:03.109865 26644 raft_consensus.cc:2749] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:03.099254 26584 raft_consensus.cc:493] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:03.120411 25345 leader_election.cc:304] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:03.109304 26621 raft_consensus.cc:515] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:03.105847 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:03.087075 26572 consensus_queue.cc:260] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:03.124694 25899 raft_consensus.cc:1240] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:03.125620 26584 raft_consensus.cc:3060] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:03.130327 26644 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.111088 26560 consensus_queue.cc:1048] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:11:03.155108 26633 leader_election.cc:290] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:03.157406 26600 raft_consensus.cc:2804] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:03.157713 26559 raft_consensus.cc:493] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:03.165995 26642 leader_election.cc:290] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:03.180236 26572 raft_consensus.cc:3060] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:03.155660 26548 consensus_queue.cc:260] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:03.032526 25223 raft_consensus.cc:2955] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:11:03.179808 26600 raft_consensus.cc:493] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
W20260709 13:11:03.212179 26655 log.cc:927] Time spent T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:11:03.210049 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:03.233533 26600 raft_consensus.cc:3060] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:03.173849 26644 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:03.165534 26575 consensus_queue.cc:237] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:03.185138 26559 raft_consensus.cc:515] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:03.254738 25226 raft_consensus.cc:515] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:03.229709 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 155686us
W20260709 13:11:03.251027 26662 log.cc:927] Time spent T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:11:03.265374 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:03.253283 26611 raft_consensus.cc:493] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:03.270584 26579 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
W20260709 13:11:03.253484 26660 log.cc:927] Time spent T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:11:03.276713 26666 consensus_queue.cc:1048] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:11:03.270052 26622 raft_consensus.cc:493] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:03.277733 26622 raft_consensus.cc:515] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:03.278394 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:03.279217 25227 raft_consensus.cc:2393] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 2: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:03.279897 26622 leader_election.cc:290] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:03.252451 26556 raft_consensus.cc:493] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:03.266592 25872 leader_election.cc:304] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:03.156210 26643 consensus_queue.cc:237] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:03.254308 26651 log.cc:927] Time spent T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:11:03.270542 26621 leader_election.cc:290] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:03.271047 25296 raft_consensus.cc:2468] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 2.
I20260709 13:11:03.284538 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:11:03.293202 25195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:03.289351 25371 raft_consensus.cc:2955] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:11:03.299358 26577 raft_consensus.cc:2749] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:03.293165 25230 raft_consensus.cc:2468] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 3.
I20260709 13:11:03.303673 25270 leader_election.cc:304] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:03.274773 26579 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:03.286405 26548 raft_consensus.cc:3060] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:03.306195 26492 raft_consensus.cc:2749] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:03.321781 26644 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:03.327072 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:03.327764 25229 raft_consensus.cc:2468] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 2.
I20260709 13:11:03.293015 26556 raft_consensus.cc:515] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:03.280973 26611 raft_consensus.cc:515] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:11:03.305459 26615 consensus_queue.cc:1059] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:11:03.329133 26645 raft_consensus.cc:493] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.333309 26609 raft_consensus.cc:2955] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
W20260709 13:11:03.344383 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 58662.8us
I20260709 13:11:03.330821 26578 raft_consensus.cc:993] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468: : Instructing follower 1f539ba21487460085b837e7529a78ce to start an election
I20260709 13:11:03.345780 25377 raft_consensus.cc:2955] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:11:03.348650 26603 raft_consensus.cc:2749] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:03.350265 26621 raft_consensus.cc:1081] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Signalling peer 1f539ba21487460085b837e7529a78ce to start an election
I20260709 13:11:03.358197 26667 raft_consensus.cc:493] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:03.370270 25375 raft_consensus.cc:3060] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:03.372036 26492 raft_consensus.cc:493] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.374756 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:03.375357 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:03.391750 25299 raft_consensus.cc:2393] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 3: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:03.375783 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:03.392745 25302 raft_consensus.cc:2468] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 1.
I20260709 13:11:03.376698 26556 leader_election.cc:290] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:03.380226 25228 raft_consensus.cc:1275] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:03.382805 26612 raft_consensus.cc:493] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.387449 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:03.403855 25301 raft_consensus.cc:2468] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 2.
I20260709 13:11:03.398866 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:03.406086 26559 leader_election.cc:290] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:03.406476 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:03.408394 25228 raft_consensus.cc:2468] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 2.
I20260709 13:11:03.389292 26492 raft_consensus.cc:515] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:03.415575 26492 leader_election.cc:290] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:03.425446 25343 leader_election.cc:304] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:03.430363 26564 raft_consensus.cc:2804] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:03.430800 26564 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:03.431154 26564 raft_consensus.cc:3060] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:03.432462 25125 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40034 (request call id 258) took 1885 ms. Trace:
I20260709 13:11:03.433089 26574 raft_consensus.cc:3055] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:03.427271 25343 leader_election.cc:304] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:03.385915 26645 raft_consensus.cc:515] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:03.441633 25375 raft_consensus.cc:1275] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:03.434008 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:03.450542 25299 raft_consensus.cc:2393] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 2: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:03.443207 25222 raft_consensus.cc:1240] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 2. Current term is 3. Ops: []
W20260709 13:11:03.457407 26669 log.cc:927] Time spent T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:11:03.432960 25125 rpcz_store.cc:276] 0709 13:11:01.547103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.548086 (+   983us) service_pool.cc:224] Handling call
0709 13:11:03.432387 (+1884301us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:02.534227 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:02.562571 (+ 28344us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:02.562599 (+    28us) write_op.cc:435] Acquired schema lock
0709 13:11:02.562615 (+    16us) tablet.cc:662] Decoding operations
0709 13:11:02.562937 (+   322us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:02.562981 (+    44us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:02.563015 (+    34us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:11:02.563192 (+   177us) tablet.cc:701] Row locks acquired
0709 13:11:02.563210 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:11:02.563337 (+   127us) write_op.cc:270] Start()
0709 13:11:02.563459 (+   122us) write_op.cc:276] Timestamp: P: 1783602662563297 usec, L: 0
0709 13:11:02.563485 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:11:02.640244 (+ 76759us) log.cc:844] Serialized 536 byte log entry
0709 13:11:02.979581 (+339337us) op_driver.cc:464] REPLICATION: finished
0709 13:11:02.992830 (+ 13249us) write_op.cc:301] APPLY: starting
0709 13:11:02.994750 (+  1920us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:03.005378 (+ 10628us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:03.018968 (+ 13590us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:03.095111 (+ 76143us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:03.105490 (+ 10379us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:11:03.110952 (+  5462us) write_op.cc:312] APPLY: finished
0709 13:11:03.140540 (+ 29588us) log.cc:844] Serialized 23 byte log entry
0709 13:11:03.150806 (+ 10266us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:03.155243 (+  4437us) write_op.cc:454] Released schema lock
0709 13:11:03.158895 (+  3652us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:03.184073 (+ 25178us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:03.202258 (+ 18185us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":5590,"apply.run_cpu_time_us":2323,"apply.run_wall_time_us":179892,"num_ops":1,"prepare.queue_time_us":522053,"prepare.run_cpu_time_us":2875,"prepare.run_wall_time_us":122447,"replication_time_us":415943}]]}
I20260709 13:11:03.443975 26611 leader_election.cc:290] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:03.444442 26621 raft_consensus.cc:2804] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:03.470047 26621 raft_consensus.cc:493] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:03.470446 26621 raft_consensus.cc:3060] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:03.471315 26604 consensus_meta.cc:287] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.694s	user 0.011s	sys 0.000s
I20260709 13:11:03.433662 26574 raft_consensus.cc:740] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:03.447343 25228 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "92f679df8187472794ba8595642f63f9"
dest_uuid: "1f539ba21487460085b837e7529a78ce"
 from {username='slave'} at 127.0.0.1:58418
I20260709 13:11:03.472419 25228 raft_consensus.cc:493] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:03.472889 25228 raft_consensus.cc:3060] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:03.447850 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:03.473608 25227 raft_consensus.cc:2468] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 2.
I20260709 13:11:03.447717 26600 raft_consensus.cc:515] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:03.395735 26667 raft_consensus.cc:515] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:03.481805 26560 raft_consensus.cc:493] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.483485 25226 leader_election.cc:290] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:03.485422 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:03.492239 25377 raft_consensus.cc:3055] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:03.492568 25377 raft_consensus.cc:740] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:03.488610 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:03.494068 25225 raft_consensus.cc:2468] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 4.
I20260709 13:11:03.489261 25345 leader_election.cc:304] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:03.419334 26556 consensus_queue.cc:1048] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:11:03.493287 25377 consensus_queue.cc:260] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:03.421065 26612 raft_consensus.cc:515] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:11:03.419636 26584 raft_consensus.cc:515] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:03.497205 25345 leader_election.cc:304] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:03.504043 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:03.506592 25377 raft_consensus.cc:3060] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:03.510596 26648 raft_consensus.cc:493] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:03.511343 26648 raft_consensus.cc:515] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:03.515540 26648 leader_election.cc:290] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:03.516222 26648 raft_consensus.cc:493] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.516781 26648 raft_consensus.cc:515] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:03.520660 26648 leader_election.cc:290] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:03.522097 26600 leader_election.cc:290] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:03.522960 25378 raft_consensus.cc:1240] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:03.523834 26578 raft_consensus.cc:3060] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:03.504374 26667 leader_election.cc:290] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:03.528720 25899 raft_consensus.cc:2468] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 2.
I20260709 13:11:03.525863 25345 leader_election.cc:304] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:03.531038 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:03.545593 25377 raft_consensus.cc:2468] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 3.
I20260709 13:11:03.532742 26581 raft_consensus.cc:2804] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:03.549283 25345 leader_election.cc:304] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:03.550568 26564 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:03.552356 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:03.561117 25304 raft_consensus.cc:3060] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:03.562309 26564 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:03.553107 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:03.553799 25271 leader_election.cc:304] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:03.565092 25296 raft_consensus.cc:2468] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 2.
I20260709 13:11:03.496181 26560 raft_consensus.cc:515] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:03.536995 26600 raft_consensus.cc:2804] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:03.553169 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:03.572459 25302 raft_consensus.cc:2468] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 2.
I20260709 13:11:03.524564 26579 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:03.576251 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:03.576828 25296 raft_consensus.cc:3060] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:11:03.555166 25301 raft_consensus.cc:2955] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:11:03.535060 26574 consensus_queue.cc:260] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:03.554394 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:03.557839 26556 raft_consensus.cc:493] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.568380 25195 leader_election.cc:304] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:03.574935 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:03.575927 26631 raft_consensus.cc:2804] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:03.580914 25299 raft_consensus.cc:2393] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 3: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:03.567514 25194 leader_election.cc:304] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:03.581444 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:03.581254 25228 raft_consensus.cc:515] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:03.582124 26672 raft_consensus.cc:2804] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:03.583567 25908 raft_consensus.cc:2468] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 1.
I20260709 13:11:03.595003 26574 raft_consensus.cc:3060] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:03.559523 26581 raft_consensus.cc:493] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:03.595734 25377 raft_consensus.cc:2393] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 2: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:03.596946 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:03.603185 25225 raft_consensus.cc:2468] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 2.
I20260709 13:11:03.604125 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:03.604624 25225 raft_consensus.cc:3060] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:03.557982 25374 raft_consensus.cc:2468] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 2.
I20260709 13:11:03.578441 26600 raft_consensus.cc:493] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:03.601015 25195 leader_election.cc:304] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:11:03.606168 26631 raft_consensus.cc:493] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:03.606406 26672 raft_consensus.cc:493] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:03.610285 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:03.559738 26621 raft_consensus.cc:515] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:03.636996 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:03.637578 25302 raft_consensus.cc:3060] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:03.632650 26631 raft_consensus.cc:3060] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:03.604993 26581 raft_consensus.cc:3060] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:03.608201 26648 raft_consensus.cc:2804] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:03.604449 26572 raft_consensus.cc:2804] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:03.607754 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:03.615340 26600 raft_consensus.cc:3060] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:03.646589 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 380042us
I20260709 13:11:03.651701 26648 raft_consensus.cc:493] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
W20260709 13:11:03.651909 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 280056us
I20260709 13:11:03.636684 26602 raft_consensus.cc:2804] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:03.660233 26602 raft_consensus.cc:493] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:03.660708 26602 raft_consensus.cc:3060] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:03.662170 26492 consensus_queue.cc:1048] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:03.598100 26556 raft_consensus.cc:515] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:03.667687 26556 leader_election.cc:290] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:03.636281 26672 raft_consensus.cc:3060] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:03.657109 25872 leader_election.cc:304] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:03.675729 25302 raft_consensus.cc:2468] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 2.
I20260709 13:11:03.684015 26639 raft_consensus.cc:493] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.684634 26639 raft_consensus.cc:515] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:03.686980 26639 leader_election.cc:290] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:03.689822 26632 raft_consensus.cc:2804] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:03.690274 26632 raft_consensus.cc:493] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:03.695996 25225 raft_consensus.cc:2468] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 3.
I20260709 13:11:03.656956 26572 raft_consensus.cc:697] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 3 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:03.709676 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:03.690605 26632 raft_consensus.cc:3060] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:03.659111 26648 raft_consensus.cc:3060] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:03.713644 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:03.714813 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:03.715595 25226 raft_consensus.cc:2468] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 3.
I20260709 13:11:03.719180 25305 raft_consensus.cc:1240] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:03.724295 25302 raft_consensus.cc:2393] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 2: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:03.717908 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:03.704965 25900 raft_consensus.cc:2393] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 2: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:11:03.736117 25228 leader_election.cc:290] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:03.729627 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:03.732645 25874 leader_election.cc:304] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:11:03.736995 25375 raft_consensus.cc:2393] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 2: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:03.735462 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:03.737425 25376 raft_consensus.cc:3055] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:03.736256 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:03.737708 25376 raft_consensus.cc:740] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:03.742985 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:03.744349 25907 raft_consensus.cc:2468] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 2.
I20260709 13:11:03.745110 25225 raft_consensus.cc:1240] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:03.746215 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:03.746284 25304 raft_consensus.cc:2468] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 3.
I20260709 13:11:03.746979 25904 raft_consensus.cc:2468] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 2.
I20260709 13:11:03.747736 26615 raft_consensus.cc:493] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.748349 26663 raft_consensus.cc:493] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.748200 26615 raft_consensus.cc:515] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:03.742967 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:03.750594 25300 raft_consensus.cc:2468] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 2.
I20260709 13:11:03.754678 26670 raft_consensus.cc:2804] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:03.755225 26670 raft_consensus.cc:493] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:03.755697 26670 raft_consensus.cc:3060] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:03.721987 26612 leader_election.cc:290] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:03.758183 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:03.762682 25270 leader_election.cc:304] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:11:03.770545 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:03.771836 25226 raft_consensus.cc:2468] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 3.
I20260709 13:11:03.773625 25271 leader_election.cc:304] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:03.769204 26553 raft_consensus.cc:2804] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:03.748836 26663 raft_consensus.cc:515] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:03.786829 26650 consensus_queue.cc:1059] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:11:03.788183 25379 raft_consensus.cc:2468] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 2.
I20260709 13:11:03.785583 25343 leader_election.cc:304] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:03.775593 26560 leader_election.cc:290] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:03.797044 26632 raft_consensus.cc:515] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:03.770260 26602 raft_consensus.cc:515] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:03.781522 26553 raft_consensus.cc:493] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:03.770743 25873 leader_election.cc:304] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:03.712281 25901 raft_consensus.cc:2955] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:11:03.798830 26615 leader_election.cc:290] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:03.746404 25903 raft_consensus.cc:2955] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:11:03.815574 26591 raft_consensus.cc:3060] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:03.818156 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 47503.3us
I20260709 13:11:03.803120 26560 raft_consensus.cc:2804] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:11:03.828929 25902 consensus_meta.cc:287] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent flushing consensus metadata: real 0.723s	user 0.003s	sys 0.005s
I20260709 13:11:03.802683 26621 leader_election.cc:290] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:03.777364 26572 consensus_queue.cc:237] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:03.806740 26553 raft_consensus.cc:3060] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:03.797036 26670 raft_consensus.cc:515] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:03.845026 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 242596us
I20260709 13:11:03.836822 26560 raft_consensus.cc:493] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:03.848184 25345 leader_election.cc:304] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:03.854038 25345 leader_election.cc:304] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:03.864053 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:03.866554 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:03.867323 25222 raft_consensus.cc:2468] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 1.
I20260709 13:11:03.868417 26663 leader_election.cc:290] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:03.873392 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:03.842561 25296 raft_consensus.cc:2468] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 3.
I20260709 13:11:03.873647 25194 leader_election.cc:304] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:03.873106 25222 raft_consensus.cc:3060] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:03.856074 26560 raft_consensus.cc:3060] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:03.857975 26644 raft_consensus.cc:2804] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:03.872380 26649 raft_consensus.cc:2804] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:03.874641 26602 leader_election.cc:290] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:03.873293 26564 raft_consensus.cc:2804] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:03.899195 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:03.884982 26672 raft_consensus.cc:515] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:11:03.875633 26645 leader_election.cc:290] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:11:03.911487 25230 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.000s	sys 0.034s
I20260709 13:11:03.874657 26648 raft_consensus.cc:515] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:03.915232 25230 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.000s	sys 0.034s
I20260709 13:11:03.901144 26643 raft_consensus.cc:2804] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:03.902592 26563 raft_consensus.cc:493] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:03.904975 26649 raft_consensus.cc:493] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:03.924180 25297 raft_consensus.cc:2468] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 2.
I20260709 13:11:03.906170 25296 raft_consensus.cc:3060] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:03.906515 26644 raft_consensus.cc:697] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 3 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:03.908944 26564 raft_consensus.cc:697] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 3 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:03.910719 26631 raft_consensus.cc:515] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:03.999106 26643 raft_consensus.cc:697] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 2 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
W20260709 13:11:03.932572 26577 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.017s	sys 0.034s
I20260709 13:11:03.930532 26649 raft_consensus.cc:3060] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:03.930419 26663 raft_consensus.cc:493] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:03.930768 26563 raft_consensus.cc:515] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:04.031437 26563 leader_election.cc:290] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:11:04.019351 26577 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.017s	sys 0.034s
I20260709 13:11:04.021867 26632 leader_election.cc:290] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 3 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:04.046676 25371 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.012s	sys 0.033s
W20260709 13:11:04.047075 25371 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.012s	sys 0.033s
W20260709 13:11:04.021615 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 96029.3us
I20260709 13:11:04.032351 26670 leader_election.cc:290] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:04.051088 26492 raft_consensus.cc:493] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.038767 26663 raft_consensus.cc:515] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:04.090358 26591 raft_consensus.cc:2749] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:11:04.092971 26559 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.025s	sys 0.061s
W20260709 13:11:04.145674 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 403278us
I20260709 13:11:04.046209 26644 consensus_queue.cc:237] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:04.088269 26604 raft_consensus.cc:493] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:04.067152 26643 consensus_queue.cc:237] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:04.068682 26564 consensus_queue.cc:237] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:04.083858 26492 raft_consensus.cc:515] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:04.146574 26559 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.025s	sys 0.061s
I20260709 13:11:04.575395 26663 leader_election.cc:290] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:04.566780 25908 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.794s	user 0.021s	sys 0.022s
W20260709 13:11:04.633947 25902 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.779s	user 0.015s	sys 0.035s
W20260709 13:11:04.992309 25908 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.220s	user 0.032s	sys 0.037s
W20260709 13:11:04.992427 25902 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.140s	user 0.021s	sys 0.069s
W20260709 13:11:04.345659 26678 log.cc:927] Time spent T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.198s	user 0.000s	sys 0.000s
I20260709 13:11:04.987103 26697 raft_consensus.cc:493] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:04.993420 25902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50060 (request call id 246) took 2218 ms. Trace:
I20260709 13:11:04.523542 26575 raft_consensus.cc:493] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:04.985858 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:11:04.984328 25296 consensus_meta.cc:287] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.985s	user 0.009s	sys 0.001s
I20260709 13:11:04.288806 26554 raft_consensus.cc:493] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.995241 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
W20260709 13:11:04.696206 26650 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.894s	user 0.043s	sys 0.033s
W20260709 13:11:04.602506 25372 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.824s	user 0.017s	sys 0.030s
I20260709 13:11:04.994988 26604 raft_consensus.cc:515] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:04.587630 25222 consensus_meta.cc:287] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 0.693s	user 0.009s	sys 0.000s
W20260709 13:11:05.017251 26650 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.218s	user 0.051s	sys 0.035s
W20260709 13:11:05.017452 25372 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.242s	user 0.018s	sys 0.041s
I20260709 13:11:04.311388 26615 raft_consensus.cc:493] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:04.521463 26673 log.cc:927] Time spent T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.161s	user 0.000s	sys 0.000s
W20260709 13:11:04.727221 26679 log.cc:927] Time spent T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.372s	user 0.000s	sys 0.001s
I20260709 13:11:04.805562 26680 raft_consensus.cc:493] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:05.016345 26575 raft_consensus.cc:515] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:05.027621 26680 raft_consensus.cc:515] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:05.029460 26575 leader_election.cc:290] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:04.577430 25227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1299) took 1010 ms. Trace:
W20260709 13:11:04.854597 26683 log.cc:927] Time spent T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.510s	user 0.000s	sys 0.000s
I20260709 13:11:04.991151 26688 raft_consensus.cc:493] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
W20260709 13:11:04.665091 26572 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.014s	sys 0.021s
I20260709 13:11:04.986677 26696 raft_consensus.cc:493] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:04.999540 26492 leader_election.cc:290] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:04.698382 26609 raft_consensus.cc:493] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.029577 26680 leader_election.cc:290] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:05.036293 26572 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.974s	user 0.021s	sys 0.027s
I20260709 13:11:05.036471 26609 raft_consensus.cc:515] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:05.038757 26609 leader_election.cc:290] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:05.039572 26492 raft_consensus.cc:493] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:05.040107 26492 raft_consensus.cc:515] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:04.881546 26600 consensus_meta.cc:287] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 1.181s	user 0.011s	sys 0.000s
W20260709 13:11:04.994774 25223 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.962s	user 0.004s	sys 0.014s
W20260709 13:11:05.042060 25223 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.018s	user 0.004s	sys 0.014s
I20260709 13:11:05.042011 26600 raft_consensus.cc:515] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:05.042958 25223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58418 (request call id 1375) took 2050 ms. Trace:
I20260709 13:11:05.044193 26600 leader_election.cc:290] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:05.043361 25223 rpcz_store.cc:276] 0709 13:11:02.992954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.994232 (+  1278us) service_pool.cc:224] Handling call
0709 13:11:03.000439 (+  6207us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:03.019486 (+ 19047us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:11:03.506179 (+486693us) log.cc:844] Serialized 14 byte log entry
0709 13:11:05.042572 (+1536393us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:05.042641 (+    69us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:05.042688 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:05.042775 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:05.042899 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56647,"raft.queue_time_us":114249,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":5601,"thread_start_us":1448074,"threads_started":2,"wal-append.queue_time_us":751863}
W20260709 13:11:04.564503 25343 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.775s	user 0.013s	sys 0.029s
I20260709 13:11:05.045398 26492 leader_election.cc:290] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:05.045606 25343 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.256s	user 0.021s	sys 0.046s
W20260709 13:11:05.046299 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 1.26068e+06us
I20260709 13:11:05.046854 26492 raft_consensus.cc:493] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:05.047420 26492 raft_consensus.cc:515] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:05.049491 26492 leader_election.cc:290] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:04.987636 26699 raft_consensus.cc:493] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:04.725416 26674 log.cc:927] Time spent T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.391s	user 0.000s	sys 0.000s
W20260709 13:11:04.646797 25193 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.050s	sys 0.093s
W20260709 13:11:04.342550 26676 log.cc:927] Time spent T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.258s	user 0.001s	sys 0.000s
W20260709 13:11:05.054605 25193 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.056s	user 0.053s	sys 0.095s
I20260709 13:11:05.054767 26575 raft_consensus.cc:493] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
W20260709 13:11:04.343953 26581 consensus_meta.cc:287] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.687s	user 0.008s	sys 0.002s
I20260709 13:11:05.053018 26688 raft_consensus.cc:515] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:05.058529 26575 raft_consensus.cc:515] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:05.058595 26581 raft_consensus.cc:515] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:05.055394 26699 raft_consensus.cc:515] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:05.016414 25905 raft_consensus.cc:3060] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:04.606428 26578 consensus_meta.cc:287] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 1.082s	user 0.012s	sys 0.000s
I20260709 13:11:05.061220 26578 raft_consensus.cc:2749] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:05.013577 25902 rpcz_store.cc:276] 0709 13:11:02.775346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.783432 (+  8086us) service_pool.cc:224] Handling call
0709 13:11:02.794226 (+ 10794us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:02.794478 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:11:03.839498 (+1045020us) log.cc:844] Serialized 14 byte log entry
0709 13:11:04.993050 (+1153552us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:04.993098 (+    48us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:04.993147 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.993206 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:04.993345 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5841,"spinlock_wait_cycles":10451328,"thread_start_us":1144295,"threads_started":1,"wal-append.queue_time_us":1153765}
W20260709 13:11:04.349011 26553 consensus_meta.cc:287] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.502s	user 0.006s	sys 0.001s
W20260709 13:11:04.925658 26649 consensus_meta.cc:287] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.899s	user 0.006s	sys 0.000s
W20260709 13:11:04.367825 25903 consensus_meta.cc:287] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent flushing consensus metadata: real 0.553s	user 0.009s	sys 0.000s
W20260709 13:11:04.986411 25901 consensus_meta.cc:287] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent flushing consensus metadata: real 1.124s	user 0.010s	sys 0.006s
I20260709 13:11:05.003235 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:04.841296 26675 raft_consensus.cc:493] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.070904 25899 raft_consensus.cc:3060] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:05.071252 26675 raft_consensus.cc:515] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:05.073256 26675 leader_election.cc:290] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:05.015064 26700 raft_consensus.cc:493] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.073899 26700 raft_consensus.cc:515] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:05.074781 26553 raft_consensus.cc:515] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:05.076160 26700 leader_election.cc:290] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:04.355976 26631 leader_election.cc:290] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:11:04.286878 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 168911us
I20260709 13:11:04.523295 26622 raft_consensus.cc:493] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:05.016165 25296 raft_consensus.cc:2468] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 3.
I20260709 13:11:05.078101 25296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57272 (request call id 1176) took 1179 ms. Trace:
I20260709 13:11:05.060779 26581 leader_election.cc:290] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:05.078466 25296 rpcz_store.cc:276] 0709 13:11:03.898277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.898931 (+   654us) service_pool.cc:224] Handling call
0709 13:11:05.078018 (+1179087us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:05.020742 26650 raft_consensus.cc:493] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:05.079190 26591 raft_consensus.cc:493] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.079573 26650 raft_consensus.cc:515] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:05.060779 26699 leader_election.cc:290] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:05.018342 26554 raft_consensus.cc:515] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:05.022341 25222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58418 (request call id 1412) took 1150 ms. Trace:
I20260709 13:11:05.018471 25900 raft_consensus.cc:2468] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 2.
W20260709 13:11:04.697397 25196 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.006s	sys 0.036s
I20260709 13:11:04.995539 25874 leader_election.cc:304] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:04.990213 26692 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.990240 26695 raft_consensus.cc:493] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:05.014709 26663 raft_consensus.cc:493] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:05.015903 26697 raft_consensus.cc:515] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:05.030193 25227 rpcz_store.cc:276] 0709 13:11:03.566708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.568163 (+  1455us) service_pool.cc:224] Handling call
0709 13:11:03.576519 (+  8356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:03.576841 (+   322us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:03.576877 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:03.577329 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 13:11:04.067641 (+490312us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:11:04.067705 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.067788 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:04.577145 (+509357us) raft_consensus.cc:1685] finished
0709 13:11:04.577178 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:04.577359 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2263,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":13587,"thread_start_us":488114,"threads_started":1,"wal-append.queue_time_us":998221}
I20260709 13:11:05.033723 26584 leader_election.cc:290] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:05.035943 25906 raft_consensus.cc:1275] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:05.087519 25908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50058 (request call id 414) took 1395 ms. Trace:
I20260709 13:11:04.309423 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
W20260709 13:11:04.931241 26681 log.cc:927] Time spent T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.623s	user 0.001s	sys 0.001s
I20260709 13:11:05.002041 26648 leader_election.cc:290] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:05.002192 26556 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:05.089550 26663 raft_consensus.cc:515] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:05.090248 26556 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:05.051618 26570 raft_consensus.cc:493] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:05.092190 26556 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:05.029840 26615 raft_consensus.cc:515] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:04.907160 26560 consensus_meta.cc:287] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 1.009s	user 0.010s	sys 0.000s
I20260709 13:11:05.092479 26554 leader_election.cc:290] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:05.092308 26570 raft_consensus.cc:515] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:05.084852 26540 raft_consensus.cc:2749] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:05.092926 26560 raft_consensus.cc:515] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:11:05.055537 25229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1295) took 1676 ms. Trace:
I20260709 13:11:05.063166 25377 raft_consensus.cc:1275] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:05.063570 26693 raft_consensus.cc:493] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.063983 26680 raft_consensus.cc:493] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:05.070654 26609 raft_consensus.cc:493] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.073817 26649 raft_consensus.cc:515] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:05.077517 26553 leader_election.cc:290] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:04.355552 26672 leader_election.cc:290] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:05.079668 26591 raft_consensus.cc:515] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:05.022106 26612 consensus_queue.cc:1059] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:05.022425 25372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36254 (request call id 1442) took 1299 ms. Trace:
I20260709 13:11:05.024367 26604 leader_election.cc:290] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:05.083407 25196 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.064s	user 0.031s	sys 0.044s
I20260709 13:11:05.082540 25905 raft_consensus.cc:2468] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 3.
I20260709 13:11:05.104846 25372 rpcz_store.cc:276] 0709 13:11:03.721165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.724227 (+  3062us) service_pool.cc:224] Handling call
0709 13:11:03.740297 (+ 16070us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:03.741771 (+  1474us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:03.741799 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:03.758329 (+ 16530us) log.cc:844] Serialized 26 byte log entry
0709 13:11:05.019792 (+1261463us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:11:05.019883 (+    91us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:05.019951 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:05.019994 (+    43us) raft_consensus.cc:1685] finished
0709 13:11:05.020006 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:05.020149 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1127,"raft.queue_time_us":2523,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":8153,"thread_start_us":1244482,"threads_started":1,"wal-append.queue_time_us":1223162}
I20260709 13:11:05.119205 26702 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:05.097340 26693 raft_consensus.cc:515] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:05.123855 26702 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:05.124428 26648 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:05.124693 26697 leader_election.cc:290] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:05.083241 25222 rpcz_store.cc:276] 0709 13:11:03.871894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.872700 (+   806us) service_pool.cc:224] Handling call
0709 13:11:03.873002 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:05.019773 (+1146771us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:05.019822 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:05.019869 (+    47us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:11:05.020683 (+   814us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:05.020775 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:05.022263 (+  1488us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1248,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":1295}
I20260709 13:11:05.124987 26648 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:05.125645 26693 leader_election.cc:290] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:05.126070 26702 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:05.099221 26609 raft_consensus.cc:515] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:05.126976 26648 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:05.128363 25899 raft_consensus.cc:2468] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 3.
I20260709 13:11:05.128656 26609 leader_election.cc:290] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:05.132529 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:05.135263 25125 catalog_manager.cc:5697] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 2 to 3, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68). New cstate: current_term: 3 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:05.104590 26663 leader_election.cc:290] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:05.060698 26575 leader_election.cc:290] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:05.077437 26622 raft_consensus.cc:515] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:05.084620 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 89153.9us
I20260709 13:11:05.087888 25908 rpcz_store.cc:276] 0709 13:11:03.692319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.692437 (+   118us) service_pool.cc:224] Handling call
0709 13:11:03.722656 (+ 30219us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:03.734684 (+ 12028us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:03.734716 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:03.757851 (+ 23135us) log.cc:844] Serialized 26 byte log entry
0709 13:11:04.992948 (+1235097us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:04.992994 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.993106 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:05.087347 (+ 94241us) raft_consensus.cc:1685] finished
0709 13:11:05.087365 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:05.087469 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11395,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":8675,"thread_start_us":1220751,"threads_started":1,"wal-append.queue_time_us":1254139}
I20260709 13:11:05.094452 25230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54000 (request call id 165) took 1741 ms. Trace:
I20260709 13:11:05.094513 25297 raft_consensus.cc:2468] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 2.
I20260709 13:11:05.094020 25229 rpcz_store.cc:276] 0709 13:11:03.379281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.379604 (+   323us) service_pool.cc:224] Handling call
0709 13:11:03.379945 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:03.380133 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:03.380156 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:03.380644 (+   488us) log.cc:844] Serialized 26 byte log entry
0709 13:11:03.845100 (+464456us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:11:03.845161 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:03.845253 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:05.055340 (+1210087us) raft_consensus.cc:1685] finished
0709 13:11:05.055359 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:05.055481 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14208,"thread_start_us":462858,"threads_started":1,"wal-append.queue_time_us":660450}
I20260709 13:11:05.082250 26572 raft_consensus.cc:493] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:05.035895 26696 raft_consensus.cc:515] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:05.183285 26570 leader_election.cc:290] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:05.183569 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:05.184403 25223 raft_consensus.cc:2368] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 2. Current term is 3.
I20260709 13:11:05.184719 26560 leader_election.cc:290] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:05.184970 26696 leader_election.cc:290] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:05.093628 26540 raft_consensus.cc:493] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:05.099355 26680 raft_consensus.cc:515] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:05.185698 26540 raft_consensus.cc:515] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:05.186493 26572 raft_consensus.cc:515] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:05.187107 26680 leader_election.cc:290] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:05.123054 26604 raft_consensus.cc:493] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.111156 25194 leader_election.cc:304] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:05.190510 25297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57272 (request call id 1178) took 1031 ms. Trace:
I20260709 13:11:05.081725 26650 leader_election.cc:290] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:05.190809 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 79775.9us
I20260709 13:11:05.112617 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:05.115176 25128 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40020 (request call id 261) took 2955 ms. Trace:
I20260709 13:11:05.129930 26591 leader_election.cc:290] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:05.116142 25124 catalog_manager.cc:5697] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 1 to 2, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 2 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:05.117027 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:05.117831 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:05.118674 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:05.119139 26705 raft_consensus.cc:493] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:05.200637 25305 raft_consensus.cc:3060] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:05.119930 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:05.200814 25299 raft_consensus.cc:2468] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 2.
I20260709 13:11:05.201308 25301 raft_consensus.cc:2468] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 2.
I20260709 13:11:05.202257 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:05.170643 25377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36254 (request call id 1438) took 1453 ms. Trace:
I20260709 13:11:05.171126 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:05.086486 26692 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:05.204698 25303 raft_consensus.cc:2393] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 2: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:05.123416 26600 raft_consensus.cc:493] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:05.180799 25230 rpcz_store.cc:276] 0709 13:11:03.353486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.353654 (+   168us) service_pool.cc:224] Handling call
0709 13:11:03.354030 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:03.354282 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:03.354315 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:03.357410 (+  3095us) log.cc:844] Serialized 26 byte log entry
0709 13:11:03.915880 (+558470us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:03.915929 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:03.916012 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:05.094261 (+1178249us) raft_consensus.cc:1685] finished
0709 13:11:05.094278 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:05.094402 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":545092,"threads_started":1,"wal-append.queue_time_us":706337}
I20260709 13:11:05.206220 26692 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:05.208624 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:05.209583 25303 raft_consensus.cc:2393] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 3: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:05.210587 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:05.211917 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:05.094097 26695 raft_consensus.cc:515] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:05.215837 26695 leader_election.cc:290] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:05.216462 26695 raft_consensus.cc:493] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:05.217033 26695 raft_consensus.cc:515] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:05.220338 26695 leader_election.cc:290] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:05.220950 26695 raft_consensus.cc:493] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:05.222060 25304 raft_consensus.cc:2368] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 2. Current term is 3.
I20260709 13:11:05.154637 26609 raft_consensus.cc:493] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.234086 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:05.191610 25128 rpcz_store.cc:276] 0709 13:11:02.159905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.160052 (+   147us) service_pool.cc:224] Handling call
0709 13:11:02.310878 (+150826us) spinlock_profiling.cc:243] Waited 4.51 ms on lock 0x7b54002e0090. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72cb4ab71 00007fd72cb4b0b2 00007fd735ac4a89 00007fd735a5cda6 00007fd735a2e088 00007fd735b2c37e 00007fd733fed2a4 00007fd733fed232 00007fd733fed161 00007fd733fed0dc
0709 13:11:05.115090 (+2804212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24139,"reported_tablets":7,"spinlock_wait_cycles":10371328}
I20260709 13:11:05.203419 25377 rpcz_store.cc:276] 0709 13:11:03.717132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.717251 (+   119us) service_pool.cc:224] Handling call
0709 13:11:03.740327 (+ 23076us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:05.094606 (+1354279us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:05.170349 (+ 75743us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b540037bed4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:05.170580 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3041506816}
I20260709 13:11:05.190869 25297 rpcz_store.cc:276] 0709 13:11:04.150705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:04.309098 (+158393us) service_pool.cc:224] Handling call
0709 13:11:05.182165 (+873067us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:05.229467 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:05.235642 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:05.235816 25299 raft_consensus.cc:2468] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 2.
I20260709 13:11:05.236363 25297 raft_consensus.cc:2468] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 2.
I20260709 13:11:05.236915 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:05.061486 26688 leader_election.cc:290] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:05.148794 25125 catalog_manager.cc:5697] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 1 to 2, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68). New cstate: current_term: 2 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:05.212647 26600 raft_consensus.cc:515] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:05.116222 25270 leader_election.cc:304] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:11:05.240549 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 124406us
I20260709 13:11:05.200006 25298 raft_consensus.cc:2468] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 3.
W20260709 13:11:05.243611 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 60601.5us
I20260709 13:11:05.244825 25298 raft_consensus.cc:1275] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:05.157059 26648 raft_consensus.cc:493] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:05.233263 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:05.252205 25301 raft_consensus.cc:2468] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 3.
I20260709 13:11:05.111495 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:05.136866 26602 raft_consensus.cc:493] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:05.238009 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:05.253274 25300 raft_consensus.cc:3060] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:05.237264 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:05.253436 25226 raft_consensus.cc:3060] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:05.218163 25303 raft_consensus.cc:2468] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 2.
I20260709 13:11:05.223342 26696 raft_consensus.cc:2804] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:05.177115 26548 raft_consensus.cc:493] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:05.259902 25270 leader_election.cc:304] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:05.155267 26693 raft_consensus.cc:493] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:05.239707 25125 catalog_manager.cc:5697] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 1 to 2, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 2 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:11:05.247457 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:05.202996 26680 raft_consensus.cc:493] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:05.272756 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:05.283715 25297 raft_consensus.cc:2468] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 2.
I20260709 13:11:05.285280 25344 leader_election.cc:304] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:05.238762 26697 raft_consensus.cc:493] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:05.260402 25376 consensus_queue.cc:260] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:05.294847 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:05.222997 26604 raft_consensus.cc:515] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:05.242306 26572 leader_election.cc:290] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:05.254256 26702 raft_consensus.cc:493] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:05.254377 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:05.247779 26704 raft_consensus.cc:2804] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:05.312194 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:05.335587 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:05.336486 25297 raft_consensus.cc:2468] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 2.
I20260709 13:11:05.330629 25194 leader_election.cc:304] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:05.338191 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:05.339017 25297 raft_consensus.cc:2468] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 1.
I20260709 13:11:05.283295 26554 raft_consensus.cc:2749] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:05.243541 26609 raft_consensus.cc:515] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:05.346289 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:05.354406 25229 raft_consensus.cc:2468] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 1.
I20260709 13:11:05.221522 26695 raft_consensus.cc:515] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:05.348847 26581 raft_consensus.cc:2804] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:05.357345 26581 raft_consensus.cc:493] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.357677 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:05.352213 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:05.352326 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:05.358582 25908 raft_consensus.cc:2468] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 1.
I20260709 13:11:05.353296 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:11:05.347374 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 62201.2us
I20260709 13:11:05.360718 25226 raft_consensus.cc:2468] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 5.
I20260709 13:11:05.361213 25344 leader_election.cc:304] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:05.357811 26581 raft_consensus.cc:3060] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:05.362558 26644 raft_consensus.cc:2804] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:05.363080 26644 raft_consensus.cc:697] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 3 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:05.363956 26644 consensus_queue.cc:237] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:05.352191 26574 raft_consensus.cc:493] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.366061 26574 raft_consensus.cc:515] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:05.368211 26574 leader_election.cc:290] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:05.369807 26581 raft_consensus.cc:515] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:05.373409 26581 leader_election.cc:290] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:05.257400 26663 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:05.255577 26648 raft_consensus.cc:515] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:05.258285 26602 raft_consensus.cc:515] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:05.374221 26581 raft_consensus.cc:493] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:05.262542 26559 raft_consensus.cc:493] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:05.374794 26688 raft_consensus.cc:493] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:05.406071 26710 raft_consensus.cc:493] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:05.406370 26688 raft_consensus.cc:515] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:05.406639 26710 raft_consensus.cc:515] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:05.406993 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:05.375608 25907 raft_consensus.cc:2393] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 2: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:11:05.377557 26706 raft_consensus.cc:493] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:05.331202 26572 raft_consensus.cc:493] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:05.238277 26705 raft_consensus.cc:515] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:05.332279 26704 raft_consensus.cc:493] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.387265 25344 leader_election.cc:304] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:05.353682 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:05.310909 26680 raft_consensus.cc:515] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:05.390945 26643 raft_consensus.cc:493] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:05.378111 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:05.376538 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:05.282922 26548 raft_consensus.cc:515] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:05.346877 26564 raft_consensus.cc:493] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:05.345937 25221 raft_consensus.cc:2468] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 3.
I20260709 13:11:05.394769 25304 raft_consensus.cc:2393] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 2: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:05.392112 26570 raft_consensus.cc:493] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:05.332101 26702 raft_consensus.cc:515] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:05.389096 26649 leader_election.cc:290] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:05.390151 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:05.457206 26575 raft_consensus.cc:2804] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:05.294595 26693 raft_consensus.cc:515] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:05.377043 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 46481.6us
I20260709 13:11:05.408155 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:05.498848 25194 leader_election.cc:304] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:05.438385 25305 raft_consensus.cc:2468] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 3.
I20260709 13:11:05.391981 26701 raft_consensus.cc:493] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.439088 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:05.501222 25907 raft_consensus.cc:3060] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:05.450270 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 63081.5us
I20260709 13:11:05.438494 26559 raft_consensus.cc:515] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:05.453110 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:05.487938 26537 raft_consensus.cc:493] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.459183 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:05.506742 25370 raft_consensus.cc:2368] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for earlier term 4. Current term is 5.
I20260709 13:11:05.410043 25300 raft_consensus.cc:2468] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 3.
I20260709 13:11:05.465282 25225 raft_consensus.cc:2468] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 3.
I20260709 13:11:05.399799 25899 raft_consensus.cc:2368] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 2. Current term is 3.
I20260709 13:11:05.457672 26713 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:05.392432 25901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50058 (request call id 416) took 1697 ms. Trace:
I20260709 13:11:05.439327 26648 leader_election.cc:290] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:05.440017 26602 leader_election.cc:290] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:05.438699 26710 leader_election.cc:290] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:05.450553 25903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50056 (request call id 345) took 1699 ms. Trace:
I20260709 13:11:05.440025 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:05.488946 25343 leader_election.cc:304] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:05.438127 26688 leader_election.cc:290] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:05.491122 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:05.328922 26697 raft_consensus.cc:515] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:05.458105 26692 raft_consensus.cc:493] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.539832 26692 raft_consensus.cc:515] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:05.492095 25230 raft_consensus.cc:2468] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 2.
I20260709 13:11:05.493235 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:05.387934 26663 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:05.467408 25900 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 1.
I20260709 13:11:05.453908 26696 raft_consensus.cc:697] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 3 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:05.523408 26648 raft_consensus.cc:493] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:05.453693 26704 raft_consensus.cc:3060] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:05.452961 26615 leader_election.cc:290] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:05.460062 26703 raft_consensus.cc:493] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.388298 26650 raft_consensus.cc:493] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:05.503883 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:05.458499 25377 raft_consensus.cc:3060] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:05.466202 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:05.566864 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:05.410414 26581 raft_consensus.cc:515] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:05.467111 26564 raft_consensus.cc:515] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:05.500036 26622 leader_election.cc:290] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:05.500337 26575 raft_consensus.cc:493] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:05.607101 26575 raft_consensus.cc:3060] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:05.607718 26711 log.cc:927] Time spent T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 13:11:05.609282 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:05.594168 26548 leader_election.cc:290] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:05.610591 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:05.474897 26643 raft_consensus.cc:515] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:05.611310 25226 raft_consensus.cc:2468] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 1.
I20260709 13:11:05.612289 26702 leader_election.cc:290] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:05.612375 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:05.612681 26643 leader_election.cc:290] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:05.500221 26717 raft_consensus.cc:493] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:05.523413 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:05.466653 26572 raft_consensus.cc:515] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:05.613404 26717 raft_consensus.cc:515] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:05.613875 26692 leader_election.cc:290] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:05.614110 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:05.615459 26572 leader_election.cc:290] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:05.615787 26663 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:05.489742 26570 raft_consensus.cc:515] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:05.535585 25344 leader_election.cc:400] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 election: Vote denied by peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085) with higher term. Message: Invalid argument: T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 2. Current term is 3.
I20260709 13:11:05.543395 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:05.516906 26600 leader_election.cc:290] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:05.513743 26724 raft_consensus.cc:2804] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:05.504231 26721 raft_consensus.cc:493] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:05.520292 26604 leader_election.cc:290] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:05.518148 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:05.549407 25872 leader_election.cc:400] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 election: Vote denied by peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127) with higher term. Message: Invalid argument: T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 2. Current term is 3.
I20260709 13:11:05.528719 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:05.537418 26602 raft_consensus.cc:2804] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:11:05.556519 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 57747.1us
I20260709 13:11:05.658566 25872 leader_election.cc:403] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 13:11:05.497104 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 154134us
I20260709 13:11:05.513780 26537 raft_consensus.cc:515] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:05.659955 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 110672us
I20260709 13:11:05.660873 25872 leader_election.cc:304] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:05.564393 25343 leader_election.cc:304] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:05.488199 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:05.541080 26722 raft_consensus.cc:493] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:05.544131 25904 raft_consensus.cc:2468] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 1.
I20260709 13:11:05.672603 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:05.674156 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:05.675069 25229 raft_consensus.cc:2468] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 1.
I20260709 13:11:05.676589 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:05.677351 25225 raft_consensus.cc:2468] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 3.
W20260709 13:11:05.680344 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 116016us
I20260709 13:11:05.673244 25230 raft_consensus.cc:2468] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 2.
I20260709 13:11:05.592634 25375 raft_consensus.cc:2468] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 2.
I20260709 13:11:05.690150 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:05.691316 25271 leader_election.cc:304] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:05.690989 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:05.692986 25377 raft_consensus.cc:2468] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 3.
I20260709 13:11:05.593017 25228 raft_consensus.cc:2468] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 2.
I20260709 13:11:05.558063 26695 leader_election.cc:290] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:05.506337 26701 raft_consensus.cc:515] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:11:05.702041 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:05.619254 26548 raft_consensus.cc:493] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.606400 26705 leader_election.cc:290] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:05.715505 26574 consensus_queue.cc:1048] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:05.716181 25376 raft_consensus.cc:3060] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:05.610045 26696 consensus_queue.cc:237] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:05.453526 26706 raft_consensus.cc:515] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:05.719341 26706 leader_election.cc:290] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:05.613137 25226 raft_consensus.cc:2468] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 2.
I20260709 13:11:05.518436 26713 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:05.564824 26609 leader_election.cc:290] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:05.659013 25194 leader_election.cc:304] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:05.658015 26721 raft_consensus.cc:515] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:05.615494 26717 leader_election.cc:290] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:05.662670 26540 leader_election.cc:290] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:05.664499 26639 raft_consensus.cc:2749] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127) with higher term. Message: Invalid argument: T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 2. Current term is 3.
I20260709 13:11:05.666311 26570 leader_election.cc:290] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:05.666445 26607 raft_consensus.cc:2804] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:05.694337 26724 raft_consensus.cc:697] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 2 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:05.668817 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:05.563110 26648 raft_consensus.cc:515] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:05.618830 25378 raft_consensus.cc:2468] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 1.
I20260709 13:11:05.695817 25300 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 2.
I20260709 13:11:05.667192 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:05.699095 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
W20260709 13:11:05.602689 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 412606us
I20260709 13:11:05.698768 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:05.660569 26602 raft_consensus.cc:493] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.743678 25302 raft_consensus.cc:2368] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 3. Current term is 4.
I20260709 13:11:05.703720 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:05.705832 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:05.706980 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:05.745005 25297 raft_consensus.cc:2368] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 2. Current term is 3.
I20260709 13:11:05.707728 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:05.708989 26559 leader_election.cc:290] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:05.709906 25304 raft_consensus.cc:1275] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:05.710405 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:05.750882 25301 raft_consensus.cc:3060] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:05.711606 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:05.712291 26548 raft_consensus.cc:515] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:05.714944 26537 leader_election.cc:290] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:05.746052 25902 raft_consensus.cc:2393] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 2: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:11:05.721575 25270 leader_election.cc:400] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091) with higher term. Message: Invalid argument: T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for earlier term 4. Current term is 5.
I20260709 13:11:05.754673 25270 leader_election.cc:403] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:05.754958 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:05.755517 25225 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 2.
I20260709 13:11:05.756398 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:05.756559 26705 raft_consensus.cc:3060] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:11:05.756916 25225 raft_consensus.cc:2468] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 1.
I20260709 13:11:05.758733 26575 raft_consensus.cc:515] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:05.761943 25371 raft_consensus.cc:1240] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:05.733075 26631 raft_consensus.cc:493] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
W20260709 13:11:05.766124 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 252967us
I20260709 13:11:05.589823 26703 raft_consensus.cc:515] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:05.726074 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
W20260709 13:11:05.728821 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 69894.6us
I20260709 13:11:05.773150 25377 raft_consensus.cc:3060] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:11:05.728843 25271 leader_election.cc:304] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:05.594204 26650 raft_consensus.cc:515] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:05.690776 26692 raft_consensus.cc:2804] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:05.690084 26702 raft_consensus.cc:493] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:05.700484 26716 raft_consensus.cc:493] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.694120 26710 raft_consensus.cc:2764] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
W20260709 13:11:05.738873 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 181140us
I20260709 13:11:05.703087 26649 raft_consensus.cc:2804] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:05.670151 26722 raft_consensus.cc:515] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:05.690991 25373 raft_consensus.cc:2468] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 3.
I20260709 13:11:05.700989 26680 leader_election.cc:290] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:05.740924 25379 raft_consensus.cc:2393] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 2: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:05.743525 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:05.744459 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:05.745456 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:05.745572 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:05.745711 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:05.702589 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:05.523005 25903 rpcz_store.cc:276] 0709 13:11:03.741649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.745782 (+  4133us) service_pool.cc:224] Handling call
0709 13:11:03.746078 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:03.746292 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:11:05.070758 (+1324466us) log.cc:844] Serialized 14 byte log entry
0709 13:11:05.376605 (+305847us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:05.384545 (+  7940us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:05.388419 (+  3874us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:05.392397 (+  3978us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:05.441459 (+ 49062us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":38135,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":19798,"thread_start_us":274382,"threads_started":1,"wal-append.queue_time_us":321950}
W20260709 13:11:05.746361 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 85564.8us
I20260709 13:11:05.746222 26602 raft_consensus.cc:3060] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:05.747479 25224 raft_consensus.cc:2368] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for earlier term 4. Current term is 5.
I20260709 13:11:05.747550 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:05.738806 26607 raft_consensus.cc:493] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.743541 25372 raft_consensus.cc:2468] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 3.
I20260709 13:11:05.748296 26581 leader_election.cc:290] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:05.748330 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:05.749478 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:05.740526 26697 leader_election.cc:290] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:05.750769 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:05.710968 26564 leader_election.cc:290] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:05.734436 26730 raft_consensus.cc:2804] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:05.733506 26554 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.703310 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:05.747502 26724 consensus_queue.cc:237] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:05.754142 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:05.768339 25229 raft_consensus.cc:2468] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 2.
I20260709 13:11:05.756414 25270 leader_election.cc:304] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:05.769606 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:05.770105 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:05.771113 25874 leader_election.cc:400] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 election: Vote denied by peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361) with higher term. Message: Invalid argument: T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 2. Current term is 3.
I20260709 13:11:05.725545 25907 raft_consensus.cc:2468] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 3.
I20260709 13:11:05.772027 25376 raft_consensus.cc:2468] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 2.
I20260709 13:11:05.773913 25194 leader_election.cc:304] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:11:06.041077 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.971781 25344 leader_election.cc:304] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:06.102669 25378 raft_consensus.cc:2468] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 2.
W20260709 13:11:06.103552 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 347181us
I20260709 13:11:05.777371 25301 raft_consensus.cc:2468] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 3.
I20260709 13:11:06.058846 25872 leader_election.cc:304] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:06.120630 25297 raft_consensus.cc:2393] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 2: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:06.198473 25225 raft_consensus.cc:2468] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 2.
W20260709 13:11:06.061165 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 332375us
I20260709 13:11:06.121047 26697 raft_consensus.cc:2749] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:06.201385 25343 leader_election.cc:400] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 election: Vote denied by peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127) with higher term. Message: Invalid argument: T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 3. Current term is 4.
I20260709 13:11:06.201692 25343 leader_election.cc:403] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:11:06.103866 25374 raft_consensus.cc:2468] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 2.
I20260709 13:11:06.059791 25375 raft_consensus.cc:2468] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 1.
W20260709 13:11:06.120491 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 349481us
I20260709 13:11:06.102186 25227 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 2.
W20260709 13:11:06.203619 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 144844us
I20260709 13:11:06.134491 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:06.102186 25228 raft_consensus.cc:2468] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 2.
W20260709 13:11:06.059159 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 285304us
I20260709 13:11:05.991930 25377 raft_consensus.cc:2468] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 3.
I20260709 13:11:05.516464 25901 rpcz_store.cc:276] 0709 13:11:03.692865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.700359 (+  7494us) service_pool.cc:224] Handling call
0709 13:11:03.711931 (+ 11572us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:03.712152 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:11:05.073681 (+1361529us) log.cc:844] Serialized 14 byte log entry
0709 13:11:05.341673 (+267992us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:05.354054 (+ 12381us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:05.356546 (+  2492us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:05.376087 (+ 19541us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:05.390338 (+ 14251us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17560,"raft.queue_time_us":10238,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":29867,"thread_start_us":255139,"threads_started":1,"wal-append.queue_time_us":312580}
I20260709 13:11:06.153683 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:06.058748 25226 raft_consensus.cc:2468] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 2.
I20260709 13:11:06.211092 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:06.206648 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:06.207374 25299 raft_consensus.cc:1240] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:06.206910 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:06.214829 25271 leader_election.cc:304] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:06.210183 25343 leader_election.cc:400] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Vote denied by peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127) with higher term. Message: Invalid argument: T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 2. Current term is 3.
I20260709 13:11:06.206431 25194 leader_election.cc:304] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:06.216809 25343 leader_election.cc:403] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:06.217351 25194 leader_election.cc:304] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:11:05.920521 25195 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 1.703s (SENT)
I20260709 13:11:06.208539 25302 raft_consensus.cc:1275] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:06.218658 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:06.215962 25271 leader_election.cc:304] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:06.224560 25271 leader_election.cc:304] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:06.145577 25370 raft_consensus.cc:2468] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 2.
I20260709 13:11:06.221513 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:06.207978 25371 raft_consensus.cc:2468] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 1.
I20260709 13:11:05.924203 26574 raft_consensus.cc:493] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.226181 25194 leader_election.cc:304] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:05.813920 26717 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:06.103112 26615 raft_consensus.cc:2804] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:06.227337 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:05.959450 26703 leader_election.cc:290] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:05.779667 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:06.059531 26649 raft_consensus.cc:493] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:06.107209 26727 raft_consensus.cc:493] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:05.991079 26721 leader_election.cc:290] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:05.832581 26548 leader_election.cc:290] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:06.102756 26729 raft_consensus.cc:2804] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:05.781261 26705 raft_consensus.cc:2749] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091) with higher term. Message: Invalid argument: T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for earlier term 4. Current term is 5.
I20260709 13:11:06.223847 26564 raft_consensus.cc:3060] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:06.247509 25230 raft_consensus.cc:2468] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 3.
I20260709 13:11:05.922711 26704 raft_consensus.cc:515] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:06.254253 25298 raft_consensus.cc:2393] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 3: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:06.254508 26650 leader_election.cc:290] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:05.779985 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:06.119190 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:06.072166 26607 raft_consensus.cc:3060] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:06.229158 25376 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36264 (request call id 1115) took 2467 ms (client timeout 1703 ms). Trace:
I20260709 13:11:06.119866 26692 raft_consensus.cc:493] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.991334 26713 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:06.203496 26730 raft_consensus.cc:493] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:06.135007 26537 raft_consensus.cc:493] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:05.814498 26701 leader_election.cc:290] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:05.833330 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:06.241354 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:05.831166 26648 leader_election.cc:290] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:05.813704 26696 consensus_queue.cc:1048] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.417s
I20260709 13:11:05.876328 26693 leader_election.cc:290] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:06.162083 25221 raft_consensus.cc:2468] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 1.
I20260709 13:11:06.203688 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:11:06.224092 26642 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:11:06.225045 26699 raft_consensus.cc:2804] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:06.234261 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:06.231191 26680 raft_consensus.cc:2804] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:06.248137 26729 raft_consensus.cc:493] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:06.250053 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:05.814092 26631 raft_consensus.cc:515] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:06.209241 26554 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:06.237300 26574 raft_consensus.cc:515] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:06.233742 26609 raft_consensus.cc:2804] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:06.240621 26649 raft_consensus.cc:3060] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:06.256371 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:06.233579 26615 raft_consensus.cc:493] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:06.103417 26716 raft_consensus.cc:515] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:06.268559 25376 rpcz_store.cc:269] 0709 13:11:03.733616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.735211 (+  1595us) service_pool.cc:224] Handling call
0709 13:11:03.869315 (+134104us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b4c002f1600. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72df3ba20 00007fd72df4ca29 00007fd72df12644 00007fd72df39f2d 00007fd72df39b93 00007fd72fc6a18b 00007fd72fc6acb5 00007fd72fc65f30 00007fd72fc677de 00007fd72fc7327c 00007fd734c34b17
0709 13:11:05.260112 (+1390797us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b5400243ea0. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fbed06f 00007fd72fc65f60 00007fd72fc677de 00007fd72fc7327c 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2
0709 13:11:05.715819 (+455707us) spinlock_profiling.cc:243] Waited 422 ms on lock 0x7b5800049ad0. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fbcb0aa 00007fd72fc4d447 00007fd72fc65fe7 00007fd72fc677de 00007fd72fc7327c 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c
0709 13:11:06.200848 (+485029us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3938847232}
I20260709 13:11:06.237655 26733 raft_consensus.cc:2804] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:11:06.276106 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 135634us
I20260709 13:11:06.110358 26702 raft_consensus.cc:515] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:06.242607 26703 raft_consensus.cc:2804] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:06.248860 26721 raft_consensus.cc:493] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:06.243221 25904 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 1.
I20260709 13:11:06.271090 26692 raft_consensus.cc:3060] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:06.276276 26735 raft_consensus.cc:2804] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:06.275393 26705 raft_consensus.cc:2804] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:06.242782 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:06.246169 26727 raft_consensus.cc:515] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:06.299024 26730 raft_consensus.cc:3060] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:06.241605 26717 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:06.326121 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:11:06.329934 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 129135us
W20260709 13:11:06.330621 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 127263us
W20260709 13:11:06.331557 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 127073us
I20260709 13:11:06.354367 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:06.302979 26537 raft_consensus.cc:515] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:06.444960 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:06.447718 25270 leader_election.cc:304] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:06.454810 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:11:06.361286 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 440772us
W20260709 13:11:06.362001 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 137522us
I20260709 13:11:06.360626 26609 raft_consensus.cc:493] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:06.425189 26615 raft_consensus.cc:3060] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:06.425699 26574 leader_election.cc:290] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:06.366906 25301 raft_consensus.cc:1275] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:06.355046 26680 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:06.426297 26735 raft_consensus.cc:697] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:06.366350 26554 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:06.366389 26734 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.369979 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:06.364166 26631 leader_election.cc:290] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:06.358161 26722 leader_election.cc:290] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:06.365873 26704 leader_election.cc:290] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:06.354671 26699 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:06.353569 26729 raft_consensus.cc:3060] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:06.429170 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 219087us
I20260709 13:11:06.429642 26703 raft_consensus.cc:493] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:06.373016 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 401293us
I20260709 13:11:06.491686 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:06.430626 26584 raft_consensus.cc:2749] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127) with higher term. Message: Invalid argument: T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 2. Current term is 3.
I20260709 13:11:06.430779 26721 raft_consensus.cc:515] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:06.378988 25296 raft_consensus.cc:2468] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 3.
I20260709 13:11:06.431767 26649 raft_consensus.cc:515] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:06.433061 25305 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 1.
I20260709 13:11:06.328109 25373 raft_consensus.cc:2468] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 3.
I20260709 13:11:06.378161 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:06.466318 25271 leader_election.cc:304] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:06.468184 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:06.469425 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:06.470428 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:06.368345 26559 raft_consensus.cc:2804] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:06.474140 25874 leader_election.cc:304] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:06.425212 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:06.434901 26705 raft_consensus.cc:493] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:06.434041 26696 raft_consensus.cc:493] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:06.459914 25224 raft_consensus.cc:3060] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:06.441798 26733 raft_consensus.cc:493] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:06.488099 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:06.471944 26609 raft_consensus.cc:3060] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:06.474996 26680 raft_consensus.cc:3060] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:06.492355 25906 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 2.
I20260709 13:11:06.522280 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:06.488044 25900 raft_consensus.cc:2468] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 1.
I20260709 13:11:06.494112 25343 leader_election.cc:304] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:06.524783 25906 raft_consensus.cc:2393] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 2: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:11:06.517609 26705 raft_consensus.cc:3060] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:06.499402 26739 raft_consensus.cc:493] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:06.480239 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:06.489238 25345 leader_election.cc:304] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:06.533285 25229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1312) took 1146 ms. Trace:
W20260709 13:11:06.533419 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 44316.7us
I20260709 13:11:06.502553 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:06.491766 26699 raft_consensus.cc:3060] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:06.471765 26693 consensus_queue.cc:1048] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:11:06.490716 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:06.511242 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:06.512841 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:06.493713 26703 raft_consensus.cc:3060] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:06.544066 25375 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 1.
I20260709 13:11:06.487859 26744 raft_consensus.cc:2804] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:06.564214 25228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1322) took 1018 ms. Trace:
I20260709 13:11:06.514438 25379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36254 (request call id 1450) took 1051 ms. Trace:
I20260709 13:11:06.514510 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:06.515594 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:06.509501 26554 raft_consensus.cc:2749] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:06.509910 25271 leader_election.cc:304] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:06.521853 26696 raft_consensus.cc:515] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:06.525692 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:06.528615 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:06.569531 25377 raft_consensus.cc:2468] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 2.
I20260709 13:11:06.428720 26716 leader_election.cc:290] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:06.571295 25906 raft_consensus.cc:2393] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 3: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:06.518805 25195 leader_election.cc:304] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:06.511499 26559 raft_consensus.cc:493] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:06.533739 25229 rpcz_store.cc:276] 0709 13:11:05.386687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.223441 (+836754us) service_pool.cc:224] Handling call
0709 13:11:06.240149 (+ 16708us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:06.480819 (+240670us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:06.480852 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:06.480913 (+    61us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:06.480950 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:06.533084 (+ 52134us) spinlock_profiling.cc:243] Waited 240 ms on lock 0x7b54000884d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:06.533128 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:06.533233 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":552792448}
I20260709 13:11:06.537334 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:06.534917 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:06.535200 25370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36254 (request call id 1459) took 1058 ms. Trace:
I20260709 13:11:06.535728 25345 leader_election.cc:304] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:06.537081 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:06.500767 26631 consensus_queue.cc:1048] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:11:06.541065 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:06.576258 25370 rpcz_store.cc:276] 0709 13:11:05.484951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:05.613864 (+128913us) service_pool.cc:224] Handling call
0709 13:11:06.535046 (+921182us) spinlock_profiling.cc:243] Waited 531 ms on lock 0x7b5400457ed4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:06.535147 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1220693760}
I20260709 13:11:06.536942 26739 raft_consensus.cc:515] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:06.488040 26734 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:06.523808 26713 raft_consensus.cc:2804] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:06.540126 26735 consensus_queue.cc:237] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:06.542222 25903 raft_consensus.cc:2468] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 2.
I20260709 13:11:06.523751 26722 raft_consensus.cc:493] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:06.539920 26578 raft_consensus.cc:2804] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:06.553965 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:06.610982 25905 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 2.
I20260709 13:11:06.612040 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:06.612176 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:06.556092 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:06.556983 26705 raft_consensus.cc:515] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:06.558926 26727 leader_election.cc:290] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:06.559674 26721 leader_election.cc:290] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:06.559958 25344 leader_election.cc:304] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
W20260709 13:11:06.618369 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 58479.9us
I20260709 13:11:06.560871 25901 raft_consensus.cc:3060] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:06.522218 26733 raft_consensus.cc:3060] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:06.520855 26724 raft_consensus.cc:493] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:06.529829 26584 raft_consensus.cc:2749] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:06.566839 25299 raft_consensus.cc:2393] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 3: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
W20260709 13:11:06.566869 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 57096.8us
I20260709 13:11:06.530565 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:11:06.573324 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 54599.9us
I20260709 13:11:06.621691 25271 leader_election.cc:400] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361) with higher term. Message: Invalid argument: T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for earlier term 4. Current term is 5.
I20260709 13:11:06.622851 25271 leader_election.cc:304] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:06.623183 25195 leader_election.cc:304] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:06.564790 25228 rpcz_store.cc:276] 0709 13:11:05.545732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.229822 (+684090us) service_pool.cc:224] Handling call
0709 13:11:06.230148 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:06.230387 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:11:06.492966 (+262579us) log.cc:844] Serialized 14 byte log entry
0709 13:11:06.563765 (+ 70799us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:06.563852 (+    87us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:06.563909 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:06.563999 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:06.564145 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":327433,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":34,"raft.queue_time_us":1708,"thread_start_us":318557,"threads_started":2}
I20260709 13:11:06.624046 25271 leader_election.cc:304] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:06.624801 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:06.543887 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:06.565599 25379 rpcz_store.cc:276] 0709 13:11:05.454841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:05.458975 (+  4134us) service_pool.cc:224] Handling call
0709 13:11:06.505861 (+1046886us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b5400311ad4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:06.505986 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":479619456}
I20260709 13:11:06.581609 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:06.587085 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:06.626308 25370 raft_consensus.cc:2468] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 3.
W20260709 13:11:06.580003 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 44357us
I20260709 13:11:06.578713 25376 raft_consensus.cc:2393] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 3: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:06.568087 26744 raft_consensus.cc:493] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:06.579401 26559 raft_consensus.cc:3060] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:06.578673 26745 raft_consensus.cc:2804] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:06.591171 26734 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:06.588202 26704 raft_consensus.cc:2804] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:06.591996 26739 leader_election.cc:290] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:06.592949 26696 leader_election.cc:290] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:06.594617 26537 leader_election.cc:290] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:06.594687 26717 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:06.595690 26752 log.cc:927] Time spent T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:11:06.596423 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:06.649159 25379 raft_consensus.cc:1275] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:06.649417 25229 raft_consensus.cc:2468] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 3.
I20260709 13:11:06.650431 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:06.651428 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:06.651926 25229 raft_consensus.cc:2468] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 2.
I20260709 13:11:06.652551 26564 raft_consensus.cc:2749] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127) with higher term. Message: Invalid argument: T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 3. Current term is 4.
I20260709 13:11:06.652668 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:06.653265 25229 raft_consensus.cc:2468] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 2.
I20260709 13:11:06.642199 26574 raft_consensus.cc:2804] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:06.598342 26575 leader_election.cc:290] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:06.655306 26705 leader_election.cc:290] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:06.585690 26729 raft_consensus.cc:515] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:06.603945 25270 leader_election.cc:304] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:11:06.660411 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 56541.8us
I20260709 13:11:06.661150 25270 leader_election.cc:304] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:06.662967 25270 leader_election.cc:304] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:06.605337 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:11:06.606715 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.586742 26581 raft_consensus.cc:2804] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:06.616132 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:06.674930 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:06.675666 25905 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 1.
I20260709 13:11:06.676790 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:06.627738 25345 leader_election.cc:304] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:06.628381 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:06.682650 25376 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 1.
I20260709 13:11:06.636526 25271 leader_election.cc:304] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:06.685248 25376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36264 (request call id 1118) took 1021 ms. Trace:
I20260709 13:11:06.638686 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:06.685711 25376 rpcz_store.cc:276] 0709 13:11:05.664003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.683527 (+1019524us) service_pool.cc:224] Handling call
0709 13:11:06.683889 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:06.684820 (+   931us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:06.684863 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:06.684922 (+    59us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:06.684962 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:06.685040 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:06.685181 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:06.693640 25376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56308 (request call id 140) took 1019 ms. Trace:
I20260709 13:11:06.709923 25376 rpcz_store.cc:276] 0709 13:11:05.674001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.692656 (+1018655us) service_pool.cc:224] Handling call
0709 13:11:06.693038 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:06.693248 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:06.693280 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:06.693317 (+    37us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:06.693350 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:06.693420 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:06.693574 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:06.712322 25376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56308 (request call id 141) took 1038 ms. Trace:
I20260709 13:11:06.712864 25376 rpcz_store.cc:276] 0709 13:11:05.674246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.711322 (+1037076us) service_pool.cc:224] Handling call
0709 13:11:06.711736 (+   414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:06.711950 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:06.711987 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:06.712041 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:06.712072 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:06.712120 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:06.712260 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:06.634070 25195 leader_election.cc:304] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:06.641522 26721 raft_consensus.cc:2749] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:06.614216 26578 raft_consensus.cc:493] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:06.602954 26602 raft_consensus.cc:515] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:06.641883 25374 raft_consensus.cc:2393] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 3: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:06.610903 26554 consensus_queue.cc:1059] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:11:06.602774 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:06.639745 26744 raft_consensus.cc:3060] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:06.671017 26705 raft_consensus.cc:2804] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:06.656827 26574 raft_consensus.cc:493] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:06.736984 25376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56308 (request call id 142) took 1062 ms. Trace:
I20260709 13:11:06.908931 25376 rpcz_store.cc:276] 0709 13:11:05.674460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.716895 (+1042435us) service_pool.cc:224] Handling call
0709 13:11:06.732936 (+ 16041us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:06.733183 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:06.733221 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:06.733277 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:06.733319 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:06.733390 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:06.736898 (+  3508us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:06.760948 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:06.837543 26743 raft_consensus.cc:2749] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:06.911017 26743 raft_consensus.cc:2804] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:06.911463 26743 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:06.911912 26743 raft_consensus.cc:3060] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:06.837924 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:06.840061 25228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54000 (request call id 188) took 1078 ms. Trace:
I20260709 13:11:06.869987 26693 raft_consensus.cc:2749] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:11:06.847194 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 219555us
I20260709 13:11:06.918947 25376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56308 (request call id 143) took 1244 ms. Trace:
I20260709 13:11:06.919482 25376 rpcz_store.cc:276] 0709 13:11:05.676026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.917917 (+1241891us) service_pool.cc:224] Handling call
0709 13:11:06.918279 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:06.918489 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:06.918527 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:06.918581 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:06.918625 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:06.918699 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:06.918877 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:06.616066 26722 raft_consensus.cc:515] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:06.660660 26692 raft_consensus.cc:515] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:06.840662 26578 raft_consensus.cc:3060] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:06.645066 26704 raft_consensus.cc:493] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:06.901602 26649 leader_election.cc:290] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:06.636015 26702 leader_election.cc:290] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:06.644737 25373 raft_consensus.cc:2468] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 2.
I20260709 13:11:06.884642 25227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1321) took 1363 ms. Trace:
I20260709 13:11:06.640190 26556 raft_consensus.cc:2804] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:06.672371 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:06.837996 26604 raft_consensus.cc:493] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:06.930644 25227 rpcz_store.cc:276] 0709 13:11:05.521176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.229151 (+707975us) service_pool.cc:224] Handling call
0709 13:11:06.229548 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:06.231378 (+  1830us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:11:06.588294 (+356916us) log.cc:844] Serialized 14 byte log entry
0709 13:11:06.884197 (+295903us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:06.884272 (+    75us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:06.884331 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:06.884418 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:06.884570 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54020,"prepare.queue_time_us":326655,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":43809,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":4666,"thread_start_us":580170,"threads_started":2}
W20260709 13:11:06.842123 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 208146us
I20260709 13:11:06.936240 25372 raft_consensus.cc:2368] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 2. Current term is 3.
W20260709 13:11:06.928889 26732 log.cc:927] Time spent T 00000000000000000000000000000000 P 5140a3161b944724a989995efdc4a818: Append to log took a long time: real 0.318s	user 0.001s	sys 0.001s
I20260709 13:11:06.643090 26724 raft_consensus.cc:515] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:11:06.915853 25229 raft_consensus.cc:2468] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 3.
I20260709 13:11:06.656318 26615 raft_consensus.cc:515] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:06.917050 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:06.643831 26745 raft_consensus.cc:493] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:06.885354 26581 raft_consensus.cc:697] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 5 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:06.937083 25222 raft_consensus.cc:2393] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 3: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:06.971551 25229 raft_consensus.cc:1275] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:06.975592 26724 leader_election.cc:290] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:06.976325 25226 raft_consensus.cc:3060] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:11:06.981215 26701 raft_consensus.cc:493] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.983211 26701 raft_consensus.cc:515] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:06.984025 26559 raft_consensus.cc:515] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:06.991745 26724 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.992393 26724 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:06.992957 26701 leader_election.cc:290] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:11:06.994004 26730 consensus_meta.cc:287] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 0.524s	user 0.007s	sys 0.005s
I20260709 13:11:06.994406 26730 raft_consensus.cc:515] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:06.995623 26724 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:06.997184 25901 raft_consensus.cc:2468] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 3.
I20260709 13:11:06.920511 25345 leader_election.cc:304] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:06.894503 26648 raft_consensus.cc:493] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:06.899390 26696 raft_consensus.cc:493] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:06.887058 25379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36264 (request call id 1117) took 1223 ms. Trace:
I20260709 13:11:06.899152 26721 raft_consensus.cc:493] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:06.661763 26607 raft_consensus.cc:515] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:06.904489 26727 raft_consensus.cc:2804] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:06.914654 26574 raft_consensus.cc:3060] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:06.870548 26553 raft_consensus.cc:2804] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:06.914601 25228 rpcz_store.cc:276] 0709 13:11:05.761921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.839180 (+1077259us) service_pool.cc:224] Handling call
0709 13:11:06.839518 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:06.839686 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:06.839713 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:06.839756 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:06.839788 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:06.839892 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:06.840004 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:07.067682 25228 raft_consensus.cc:1275] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:06.916990 26705 raft_consensus.cc:697] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 3 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:06.915390 25224 raft_consensus.cc:2468] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 4.
I20260709 13:11:06.938122 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:06.927064 26704 raft_consensus.cc:3060] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:06.927541 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:06.923658 25376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36254 (request call id 1467) took 1196 ms. Trace:
I20260709 13:11:07.076682 25376 rpcz_store.cc:276] 0709 13:11:05.724972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.920676 (+1195704us) service_pool.cc:224] Handling call
0709 13:11:06.921160 (+   484us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:06.921380 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:06.921417 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:06.921472 (+    55us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:06.921515 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:06.921586 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:06.921719 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:06.947774 26581 consensus_queue.cc:237] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:06.950206 26722 leader_election.cc:290] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:06.951116 26760 raft_consensus.cc:493] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:07.088229 26760 raft_consensus.cc:515] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:07.091082 26760 leader_election.cc:290] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:06.951443 26745 raft_consensus.cc:3060] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:07.093072 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:06.957281 26729 leader_election.cc:290] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:06.957633 26702 raft_consensus.cc:493] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.959896 26602 leader_election.cc:290] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:06.960248 26699 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:06.961218 25300 raft_consensus.cc:2393] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 3: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:06.963480 26692 leader_election.cc:290] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:06.967329 26693 raft_consensus.cc:493] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:06.934432 26584 raft_consensus.cc:2804] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:06.966537 26733 raft_consensus.cc:515] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:06.970666 25374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36254 (request call id 1468) took 1245 ms. Trace:
I20260709 13:11:06.946905 26604 raft_consensus.cc:515] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:06.936893 25373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36254 (request call id 1456) took 1460 ms. Trace:
W20260709 13:11:07.000177 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 79766.2us
I20260709 13:11:07.099802 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:07.008221 25226 raft_consensus.cc:2468] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 3.
W20260709 13:11:06.924577 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 288164us
I20260709 13:11:07.074465 26743 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:06.959906 26615 leader_election.cc:290] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:06.953985 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:07.031345 26696 raft_consensus.cc:515] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:07.066594 26553 raft_consensus.cc:493] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:06.876783 26680 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:07.031436 26703 raft_consensus.cc:515] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:07.031335 26648 raft_consensus.cc:515] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:07.080982 25224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58422 (request call id 1323) took 1532 ms. Trace:
I20260709 13:11:07.128262 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:07.129447 25305 raft_consensus.cc:1240] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:07.031589 26721 raft_consensus.cc:515] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:07.136499 25345 leader_election.cc:304] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:07.175313 25345 leader_election.cc:304] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:07.000336 25379 rpcz_store.cc:276] 0709 13:11:05.663760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.657197 (+993437us) service_pool.cc:224] Handling call
0709 13:11:06.886460 (+229263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:06.886668 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:06.886704 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:06.886755 (+    51us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:06.886811 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:06.886878 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:06.886999 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:07.140187 25906 raft_consensus.cc:1275] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:11:07.143447 25297 raft_consensus.cc:1240] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:06.957283 26609 raft_consensus.cc:515] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:07.135720 26692 raft_consensus.cc:2804] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:07.159116 25902 raft_consensus.cc:1275] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:11:07.159435 26699 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:07.135654 25373 rpcz_store.cc:276] 0709 13:11:05.476418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.513688 (+1037270us) service_pool.cc:224] Handling call
0709 13:11:06.934200 (+420512us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:07.166728 26553 raft_consensus.cc:3060] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:07.188553 25225 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58422 (request call id 1324) took 1642 ms (client timeout 2174 ms). Trace:
I20260709 13:11:07.188623 26744 raft_consensus.cc:515] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:07.122296 26702 raft_consensus.cc:515] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:07.190784 26696 leader_election.cc:290] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:07.118656 26556 raft_consensus.cc:697] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 2 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
W20260709 13:11:07.189016 25225 rpcz_store.cc:269] 0709 13:11:05.546484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:05.757551 (+211067us) service_pool.cc:224] Handling call
0709 13:11:07.188372 (+1430821us) spinlock_profiling.cc:243] Waited 94.1 ms on lock 0x7b5400420c54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:07.188476 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":216634112}
I20260709 13:11:07.130059 25374 rpcz_store.cc:276] 0709 13:11:05.725111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.927898 (+1202787us) service_pool.cc:224] Handling call
0709 13:11:06.943567 (+ 15669us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:06.970332 (+ 26765us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:06.970367 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:06.970410 (+    43us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:11:06.970445 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:06.970502 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:06.970610 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:07.156102 26705 consensus_queue.cc:237] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:07.133577 26693 raft_consensus.cc:515] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:07.132889 26730 leader_election.cc:290] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:07.132972 26760 raft_consensus.cc:493] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:07.195489 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:07.165062 25901 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 1.
I20260709 13:11:07.205085 26556 consensus_queue.cc:237] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:11:07.205726 26609 leader_election.cc:290] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:07.184604 26692 raft_consensus.cc:493] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:07.192304 26702 leader_election.cc:290] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:07.196297 26744 leader_election.cc:290] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:07.239746 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 82587.4us
W20260709 13:11:07.241560 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:07.241940 25271 leader_election.cc:304] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:07.243010 26768 raft_consensus.cc:2804] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:07.243690 26768 raft_consensus.cc:697] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 2 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:07.244809 26768 consensus_queue.cc:237] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:07.172101 25224 rpcz_store.cc:276] 0709 13:11:05.546137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.219795 (+673658us) service_pool.cc:224] Handling call
0709 13:11:07.078278 (+858483us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:07.212797 26692 raft_consensus.cc:3060] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:07.302095 26727 raft_consensus.cc:697] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 3 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
W20260709 13:11:07.299189 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 123958us
I20260709 13:11:07.305361 25345 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:07.251940 26693 leader_election.cc:290] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:07.250027 25271 leader_election.cc:304] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:07.252913 26744 raft_consensus.cc:2804] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:07.252712 26648 leader_election.cc:290] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:07.270432 26604 leader_election.cc:290] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:07.270781 26721 leader_election.cc:290] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:07.272150 26733 leader_election.cc:290] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:07.269165 26574 raft_consensus.cc:515] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:07.288046 25900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50060 (request call id 267) took 1518 ms. Trace:
W20260709 13:11:07.289472 26759 log.cc:927] Time spent T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:11:07.239310 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:07.215117 26760 raft_consensus.cc:515] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:07.352342 26584 raft_consensus.cc:493] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:07.352909 26584 raft_consensus.cc:3060] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:07.353682 26760 leader_election.cc:290] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:07.242097 26767 raft_consensus.cc:3060] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:07.297205 26702 raft_consensus.cc:493] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.356618 26702 raft_consensus.cc:515] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:07.298331 26745 raft_consensus.cc:515] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:07.355785 25125 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33566 (request call id 174) took 3834 ms. Trace:
I20260709 13:11:07.241724 26559 leader_election.cc:290] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:07.247329 26607 leader_election.cc:290] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 3 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:07.306638 25345 leader_election.cc:304] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
W20260709 13:11:07.368794 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 62236.3us
I20260709 13:11:07.369647 25345 leader_election.cc:304] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
W20260709 13:11:07.307996 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 58089.8us
I20260709 13:11:07.363248 25125 rpcz_store.cc:276] 0709 13:11:03.521693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.528705 (+  7012us) service_pool.cc:224] Handling call
0709 13:11:03.610713 (+ 82008us) spinlock_profiling.cc:243] Waited 2.1 ms on lock 0x7b540034ec54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd9090 00007fd72fc77f3a 00007fd735a2e1cc 00007fd735b2c37e 00007fd733fed2a4 00007fd733fed232 00007fd733fed161 00007fd733fed0dc 00007fd733fec392 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:07.355696 (+3744983us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:05.729498 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:06.029443 (+299945us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:06.039051 (+  9608us) write_op.cc:435] Acquired schema lock
0709 13:11:06.071250 (+ 32199us) tablet.cc:662] Decoding operations
0709 13:11:06.203766 (+132516us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:06.210637 (+  6871us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:06.218119 (+  7482us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:11:06.306809 (+ 88690us) tablet.cc:701] Row locks acquired
0709 13:11:06.308270 (+  1461us) write_op.cc:260] PREPARE: finished
0709 13:11:06.328968 (+ 20698us) write_op.cc:270] Start()
0709 13:11:06.354643 (+ 25675us) write_op.cc:276] Timestamp: P: 1783602666325723 usec, L: 0
0709 13:11:06.357039 (+  2396us) op_driver.cc:348] REPLICATION: starting
0709 13:11:06.610223 (+253184us) log.cc:844] Serialized 1302 byte log entry
0709 13:11:06.966097 (+355874us) op_driver.cc:464] REPLICATION: finished
0709 13:11:07.126616 (+160519us) write_op.cc:301] APPLY: starting
0709 13:11:07.126697 (+    81us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:07.126916 (+   219us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:07.127091 (+   175us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:07.139036 (+ 11945us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:07.139300 (+   264us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:11:07.139367 (+    67us) write_op.cc:312] APPLY: finished
0709 13:11:07.139632 (+   265us) log.cc:844] Serialized 35 byte log entry
0709 13:11:07.139830 (+   198us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:07.139951 (+   121us) write_op.cc:454] Released schema lock
0709 13:11:07.140004 (+    53us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":116253,"reported_tablets":4,"spinlock_wait_cycles":4827904,"child_traces":[["op",{"apply.queue_time_us":155941,"apply.run_cpu_time_us":2685,"apply.run_wall_time_us":13771,"num_ops":3,"prepare.queue_time_us":413082,"replication_time_us":608910,"spinlock_wait_cycles":532361472,"thread_start_us":65628,"threads_started":1}]]}
I20260709 13:11:07.370648 25271 leader_election.cc:304] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:11:07.371778 25271 leader_election.cc:304] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:07.246628 26740 raft_consensus.cc:493] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.374689 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:07.253480 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:07.386547 26703 leader_election.cc:290] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:07.387393 26743 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:07.387925 26767 raft_consensus.cc:2749] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:07.388525 25374 raft_consensus.cc:3060] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:07.312359 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 97019.3us
I20260709 13:11:07.390432 25343 leader_election.cc:304] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:07.292446 26615 raft_consensus.cc:493] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.391486 26615 raft_consensus.cc:515] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:07.392508 26692 raft_consensus.cc:515] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:07.323909 26713 raft_consensus.cc:493] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:07.394021 26713 raft_consensus.cc:3060] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:07.394984 26702 leader_election.cc:290] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:07.396569 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:07.397450 25224 raft_consensus.cc:2468] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 3.
I20260709 13:11:07.395018 26615 leader_election.cc:290] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:07.399168 26745 leader_election.cc:290] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:07.399789 26663 raft_consensus.cc:2749] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:07.403909 26559 raft_consensus.cc:2749] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:07.310423 26772 raft_consensus.cc:2804] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:07.405108 26772 raft_consensus.cc:493] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.405509 26772 raft_consensus.cc:3060] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:07.406533 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:07.407092 25343 leader_election.cc:304] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:07.308378 26773 raft_consensus.cc:2749] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:07.324489 25298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57256 (request call id 1333) took 1617 ms. Trace:
I20260709 13:11:07.431864 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:07.427048 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:07.373186 26584 raft_consensus.cc:515] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:07.433101 25299 raft_consensus.cc:2468] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 1.
I20260709 13:11:07.309670 26744 raft_consensus.cc:493] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.383157 25345 leader_election.cc:304] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:07.384341 26760 raft_consensus.cc:2804] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:07.374126 26740 raft_consensus.cc:515] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:07.385025 26604 raft_consensus.cc:2804] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:11:07.407248 25371 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36254 (request call id 1465) took 1682 ms (client timeout 2026 ms). Trace:
I20260709 13:11:07.409355 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:07.472033 25227 raft_consensus.cc:3060] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:07.319233 26578 raft_consensus.cc:515] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:07.426802 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:07.477463 25305 raft_consensus.cc:2393] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 4: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:07.478606 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:07.428126 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:07.436452 25376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36254 (request call id 1469) took 1711 ms. Trace:
W20260709 13:11:07.437100 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 104463us
I20260709 13:11:07.432178 25298 rpcz_store.cc:276] 0709 13:11:05.707425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:05.707533 (+   108us) service_pool.cc:224] Handling call
0709 13:11:07.324233 (+1616700us) spinlock_profiling.cc:243] Waited 509 ms on lock 0x7b54000f8554. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:07.324414 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1169786240}
I20260709 13:11:07.467252 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:07.467335 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:07.475131 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:07.483948 25229 raft_consensus.cc:3060] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:07.471066 25371 rpcz_store.cc:269] 0709 13:11:05.724507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.234758 (+510251us) service_pool.cc:224] Handling call
0709 13:11:07.406378 (+1171620us) spinlock_profiling.cc:243] Waited 6.74 ms on lock 0x7b580014fd98. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72cb4ab71 00007fd72cb4aa22 00007fd735a63c09 00007fd734bbdee0 00007fd734c870ab 00007fd734c87131 00007fd734c350a0 00007fd734c34984 00007fd72e1af6d4 00007fd72e1af662
0709 13:11:07.407193 (+   815us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15507712}
I20260709 13:11:07.361939 25900 rpcz_store.cc:276] 0709 13:11:05.769720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:05.772007 (+  2287us) service_pool.cc:224] Handling call
0709 13:11:07.287719 (+1515712us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b5400276ad4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:07.287915 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":487446272}
I20260709 13:11:07.482592 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:07.488179 25299 raft_consensus.cc:2393] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 3: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:07.479818 25376 rpcz_store.cc:276] 0709 13:11:05.725251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:07.094760 (+1369509us) service_pool.cc:224] Handling call
0709 13:11:07.095071 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:07.213093 (+118022us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:07.213124 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:07.237675 (+ 24551us) log.cc:844] Serialized 26 byte log entry
0709 13:11:07.296401 (+ 58726us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:07.435760 (+139359us) log.cc:844] Serialized 14 byte log entry
0709 13:11:07.436053 (+   293us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:07.436151 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:07.436205 (+    54us) raft_consensus.cc:1685] finished
0709 13:11:07.436222 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:07.436385 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":145487,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":124611,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":3977,"thread_start_us":301326,"threads_started":3,"wal-append.queue_time_us":68093}
I20260709 13:11:07.489050 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:07.490370 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:07.446446 26559 raft_consensus.cc:3060] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:07.491096 26584 leader_election.cc:290] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:07.314919 26727 consensus_queue.cc:237] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:07.522478 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:07.488054 26767 raft_consensus.cc:2804] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:07.528683 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:07.528782 26767 raft_consensus.cc:493] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:07.529465 25303 raft_consensus.cc:2368] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 2. Current term is 3.
I20260709 13:11:07.524122 26740 leader_election.cc:290] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:07.467414 26744 raft_consensus.cc:3060] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:07.469058 26553 raft_consensus.cc:515] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:07.520965 26713 raft_consensus.cc:515] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:07.469651 26771 raft_consensus.cc:2804] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:07.491736 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:07.547355 25304 raft_consensus.cc:2468] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 1.
I20260709 13:11:07.547799 25908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50058 (request call id 428) took 1065 ms. Trace:
I20260709 13:11:07.548220 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:07.548164 25908 rpcz_store.cc:276] 0709 13:11:06.482796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.482957 (+   161us) service_pool.cc:224] Handling call
0709 13:11:07.547162 (+1064205us) spinlock_profiling.cc:243] Waited 4.09 ms on lock 0x7b58001a3198. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72cb4ab71 00007fd72cb4aa22 00007fd735a63c09 00007fd734bbdee0 00007fd734c870ab 00007fd734c87131 00007fd734c48fc0 00007fd734c33929 00007fd734c333d2 00007fd72e1aabd4
0709 13:11:07.547344 (+   182us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:07.547516 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:07.547543 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:07.547582 (+    39us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:07.547610 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:07.547660 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:07.547747 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9412352}
I20260709 13:11:07.549299 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:07.550238 25304 raft_consensus.cc:2368] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 3. Current term is 4.
I20260709 13:11:07.550971 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:07.551535 25304 raft_consensus.cc:2468] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 1.
I20260709 13:11:07.552255 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:07.528143 25305 raft_consensus.cc:2468] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 2.
I20260709 13:11:07.554169 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:07.554417 25229 raft_consensus.cc:2468] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 3.
I20260709 13:11:07.532513 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:07.533480 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:07.567174 25302 raft_consensus.cc:2468] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 1.
I20260709 13:11:07.567723 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:07.468240 26760 raft_consensus.cc:493] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.522778 26604 raft_consensus.cc:697] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 4 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:07.568626 26760 raft_consensus.cc:3060] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:07.568959 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:07.534288 26686 raft_consensus.cc:493] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.529677 26767 raft_consensus.cc:3060] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:07.535076 25194 leader_election.cc:304] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:07.554531 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
W20260709 13:11:07.571514 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 133910us
I20260709 13:11:07.537721 26578 leader_election.cc:290] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:07.545161 26713 leader_election.cc:290] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 3 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:07.530316 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:07.556622 26771 raft_consensus.cc:697] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 3 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:07.559515 26772 raft_consensus.cc:515] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:07.522769 26692 leader_election.cc:290] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:07.560715 26704 raft_consensus.cc:515] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:07.562283 26553 leader_election.cc:290] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:07.563226 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:07.563501 25128 catalog_manager.cc:5697] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 reported cstate change: config changed from index 3 to 4, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:07.567965 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:07.590840 25302 raft_consensus.cc:2468] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 2.
I20260709 13:11:07.591296 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:07.591751 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:07.592121 25230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58418 (request call id 1440) took 1095 ms. Trace:
I20260709 13:11:07.555366 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:07.592523 25230 rpcz_store.cc:276] 0709 13:11:06.496348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.520681 (+ 24333us) service_pool.cc:224] Handling call
0709 13:11:07.591127 (+1070446us) spinlock_profiling.cc:243] Waited 6.83 ms on lock 0x7b5800002a98. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72cb4ab71 00007fd72cb4aa22 00007fd735a63c09 00007fd734bbdee0 00007fd734c870ab 00007fd734c87131 00007fd734c350a0 00007fd734c34984 00007fd72e1af6d4 00007fd72e1af662
0709 13:11:07.592062 (+   935us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15707008}
I20260709 13:11:07.593426 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:07.582886 26745 raft_consensus.cc:2804] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:07.594201 26745 raft_consensus.cc:493] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:07.555318 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:07.594619 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:07.595342 25304 raft_consensus.cc:2468] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 1.
I20260709 13:11:07.595387 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:07.555299 25271 leader_election.cc:304] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:07.572958 25194 leader_election.cc:304] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:07.581380 25300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46556 (request call id 138) took 1040 ms. Trace:
I20260709 13:11:07.569772 25224 raft_consensus.cc:3060] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:11:07.571220 25374 raft_consensus.cc:2468] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 3.
I20260709 13:11:07.587054 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:07.487993 26769 consensus_queue.cc:1048] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.097s
I20260709 13:11:07.569443 26604 consensus_queue.cc:237] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:07.587131 26771 consensus_queue.cc:237] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:11:07.594669 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:07.594599 26745 raft_consensus.cc:3060] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:07.623158 25221 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58422 (request call id 1311) took 2235 ms (client timeout 1588 ms). Trace:
I20260709 13:11:07.650465 25298 raft_consensus.cc:2393] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 4: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:07.593638 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:08.074937 25300 rpcz_store.cc:276] 0709 13:11:06.540691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.540825 (+   134us) service_pool.cc:224] Handling call
0709 13:11:07.581141 (+1040316us) spinlock_profiling.cc:243] Waited 383 ms on lock 0x7b54004001d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:07.581301 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":881034112}
I20260709 13:11:07.636051 25297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46556 (request call id 131) took 1131 ms. Trace:
I20260709 13:11:08.075382 25128 catalog_manager.cc:5697] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 1 to 2, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 2 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:08.076614 25297 rpcz_store.cc:276] 0709 13:11:06.503681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.512069 (+  8388us) service_pool.cc:224] Handling call
0709 13:11:06.512362 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:07.176933 (+664571us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:07.634334 (+457401us) spinlock_profiling.cc:243] Waited 631 ms on lock 0x7b54002ca954. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:07.634539 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1450908416}
I20260709 13:11:08.151927 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:11:08.078080 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 522855us
I20260709 13:11:08.153913 25195 leader_election.cc:304] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:07.603315 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:08.154655 25303 raft_consensus.cc:2468] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 2.
I20260709 13:11:07.686193 25227 raft_consensus.cc:2468] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 3.
I20260709 13:11:08.155783 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:11:07.633665 25372 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36264 (request call id 1124) took 1593 ms (client timeout 1745 ms). Trace:
W20260709 13:11:07.650235 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 267150us
I20260709 13:11:07.583425 26686 raft_consensus.cc:515] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:07.829918 25296 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57256 (request call id 1338) took 2106 ms (client timeout 2090 ms). Trace:
I20260709 13:11:07.632582 25379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56308 (request call id 148) took 1180 ms. Trace:
I20260709 13:11:08.157734 25345 leader_election.cc:304] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:08.158135 25379 rpcz_store.cc:276] 0709 13:11:06.451752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:07.249097 (+797345us) service_pool.cc:224] Handling call
0709 13:11:07.631688 (+382591us) spinlock_profiling.cc:243] Waited 2.79 ms on lock 0x7b580014fd98. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72cb4ab71 00007fd72cb4aa22 00007fd735a63c09 00007fd734bbdee0 00007fd734c870ab 00007fd734c87131 00007fd734c48fc0 00007fd734c33929 00007fd734c333d2 00007fd72e1aabd4
0709 13:11:07.631940 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:07.632160 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:07.632197 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:07.632248 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:07.632299 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:07.632368 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:07.632506 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6428416}
I20260709 13:11:08.158867 25345 leader_election.cc:304] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
W20260709 13:11:08.157392 25372 rpcz_store.cc:269] 0709 13:11:06.040077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.235917 (+195840us) service_pool.cc:224] Handling call
0709 13:11:07.633432 (+1397515us) spinlock_profiling.cc:243] Waited 575 ms on lock 0x7b5400307354. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:07.633596 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1322362112}
I20260709 13:11:07.853312 26767 raft_consensus.cc:515] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:08.084407 26697 raft_consensus.cc:2804] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:07.687626 26744 raft_consensus.cc:515] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:08.073199 25221 rpcz_store.cc:269] 0709 13:11:05.386408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:05.502475 (+116067us) service_pool.cc:224] Handling call
0709 13:11:07.613592 (+2111117us) spinlock_profiling.cc:243] Waited 494 ms on lock 0x7b5400436554. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:07.613734 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1136567552}
I20260709 13:11:08.100625 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:07.898957 26768 raft_consensus.cc:493] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:08.103856 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 491497us
I20260709 13:11:08.166977 25345 leader_election.cc:304] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:07.835065 25378 raft_consensus.cc:2468] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 4.
I20260709 13:11:07.631785 26559 raft_consensus.cc:2749] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:08.106781 26772 leader_election.cc:290] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:08.126231 26760 consensus_meta.cc:287] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.557s	user 0.010s	sys 0.001s
I20260709 13:11:07.827981 26713 raft_consensus.cc:493] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.130779 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
W20260709 13:11:08.131407 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 215803us
I20260709 13:11:08.134886 25301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57256 (request call id 1346) took 1920 ms. Trace:
W20260709 13:11:08.139194 25222 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58422 (request call id 1314) took 2752 ms (client timeout 1684 ms). Trace:
I20260709 13:11:08.139314 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
W20260709 13:11:08.142455 26788 log.cc:927] Time spent T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:11:08.145328 25124 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40026 (request call id 239) took 5627 ms. Trace:
W20260709 13:11:08.146173 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 561208us
I20260709 13:11:08.137482 26704 leader_election.cc:290] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:07.635900 25226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58418 (request call id 1428) took 1278 ms. Trace:
I20260709 13:11:08.165019 25195 leader_election.cc:304] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:08.164956 25128 catalog_manager.cc:5697] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 reported cstate change: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:11:08.173645 25299 raft_consensus.cc:2393] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 4: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:08.174209 25302 raft_consensus.cc:2368] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 2. Current term is 3.
I20260709 13:11:08.188632 25302 raft_consensus.cc:1275] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:08.189091 25343 leader_election.cc:304] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:08.149718 26796 raft_consensus.cc:493] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:08.168651 25345 leader_election.cc:304] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:08.163189 26785 raft_consensus.cc:2749] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:11:08.177932 25222 rpcz_store.cc:269] 0709 13:11:05.387152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:05.513657 (+126505us) service_pool.cc:224] Handling call
0709 13:11:08.138949 (+2625292us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b5400041d54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:08.139111 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2870857472}
I20260709 13:11:08.193131 26785 raft_consensus.cc:2749] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:08.178323 25298 raft_consensus.cc:2393] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 3: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:08.190632 25343 leader_election.cc:400] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Vote denied by peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127) with higher term. Message: Invalid argument: T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 3. Current term is 4.
I20260709 13:11:08.194700 25298 raft_consensus.cc:1275] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:11:08.195271 25343 leader_election.cc:304] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:08.180500 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:08.196566 25300 raft_consensus.cc:1240] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:08.196806 25370 raft_consensus.cc:3060] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:08.181329 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:08.176877 25301 rpcz_store.cc:276] 0709 13:11:06.214524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.215335 (+   811us) service_pool.cc:224] Handling call
0709 13:11:06.237044 (+ 21709us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:06.472281 (+235237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:08.134644 (+1662363us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b5400168fd4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:08.134830 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":297804672}
I20260709 13:11:08.173378 26744 leader_election.cc:290] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:08.170665 26793 raft_consensus.cc:493] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:08.191712 25375 raft_consensus.cc:1240] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:08.177624 26701 consensus_queue.cc:1048] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:11:08.173987 26713 raft_consensus.cc:515] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:08.174104 26760 raft_consensus.cc:515] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:08.194777 25225 raft_consensus.cc:1240] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:08.167320 26697 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:08.190091 26559 raft_consensus.cc:493] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.179127 26769 raft_consensus.cc:2804] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:08.205822 25300 raft_consensus.cc:1275] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:11:08.214118 26697 raft_consensus.cc:3060] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:08.227993 26564 raft_consensus.cc:493] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:08.228204 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:08.228564 26564 raft_consensus.cc:515] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:08.179422 25224 raft_consensus.cc:2468] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 3.
I20260709 13:11:08.229895 26794 raft_consensus.cc:2749] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:08.206087 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:08.181577 25226 rpcz_store.cc:276] 0709 13:11:06.357806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.611745 (+253939us) service_pool.cc:224] Handling call
0709 13:11:07.635723 (+1023978us) spinlock_profiling.cc:243] Waited 364 ms on lock 0x7b540024c054. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:07.635840 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":836265344}
I20260709 13:11:08.231369 25305 raft_consensus.cc:2393] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 3: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
W20260709 13:11:08.205739 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 632817us
I20260709 13:11:08.208735 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:08.212270 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:08.199812 26692 raft_consensus.cc:2749] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:08.171900 26738 raft_consensus.cc:493] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:08.213153 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:08.203187 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:08.232586 25230 raft_consensus.cc:3060] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:08.169852 26786 raft_consensus.cc:2804] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:08.184204 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:08.193143 26761 raft_consensus.cc:3055] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:08.207317 26785 raft_consensus.cc:2804] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:08.179020 26686 leader_election.cc:290] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:08.229051 25901 raft_consensus.cc:2393] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 3: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:11:08.209681 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:08.233970 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
W20260709 13:11:08.163647 25296 rpcz_store.cc:269] 0709 13:11:05.723319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:05.749227 (+ 25908us) service_pool.cc:224] Handling call
0709 13:11:07.817690 (+2068463us) spinlock_profiling.cc:243] Waited 307 ms on lock 0x7b54001f13d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:07.829824 (+ 12134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":705355008}
I20260709 13:11:08.234730 25194 leader_election.cc:304] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:08.236080 25228 raft_consensus.cc:2393] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 3: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:08.178547 25124 rpcz_store.cc:276] 0709 13:11:02.518289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.548198 (+ 29909us) service_pool.cc:224] Handling call
0709 13:11:02.835401 (+287203us) spinlock_profiling.cc:243] Waited 22.6 ms on lock 0x7b540034ec54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd9090 00007fd72fc77f3a 00007fd735a2e1cc 00007fd735b2c37e 00007fd733fed2a4 00007fd733fed232 00007fd733fed161 00007fd733fed0dc 00007fd733fec392 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:08.145216 (+5309815us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:05.528308 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:05.535848 (+  7540us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:05.535890 (+    42us) write_op.cc:435] Acquired schema lock
0709 13:11:05.535909 (+    19us) tablet.cc:662] Decoding operations
0709 13:11:05.536296 (+   387us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:05.536354 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:05.536391 (+    37us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:11:05.536575 (+   184us) tablet.cc:701] Row locks acquired
0709 13:11:05.536594 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:11:05.539418 (+  2824us) write_op.cc:270] Start()
0709 13:11:05.539554 (+   136us) write_op.cc:276] Timestamp: P: 1783602665539373 usec, L: 0
0709 13:11:05.539575 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:11:05.540279 (+   704us) log.cc:844] Serialized 536 byte log entry
0709 13:11:06.362102 (+821823us) op_driver.cc:464] REPLICATION: finished
0709 13:11:07.210220 (+848118us) spinlock_profiling.cc:243] Waited 1.87 ms on lock 0x7b18001acf20. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72cb502a6 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72cb823f3 00007fd72cb847c1
0709 13:11:08.134789 (+924569us) spinlock_profiling.cc:243] Waited 7.75 ms on lock 0x7b18001acf20. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72cb823f3 00007fd72cb847c1 00007fd72cb84779 00007fd72cb84709 00007fd72cb846d1 00007fd72cb839cd 000000000038f354 000000000038f199 00007fd72cb6583a
0709 13:11:08.134895 (+   106us) write_op.cc:301] APPLY: starting
0709 13:11:08.134985 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:08.135082 (+    97us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:08.135101 (+    19us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:08.135357 (+   256us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:08.135559 (+   202us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:11:08.135624 (+    65us) write_op.cc:312] APPLY: finished
0709 13:11:08.135865 (+   241us) log.cc:844] Serialized 23 byte log entry
0709 13:11:08.136785 (+   920us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:08.136866 (+    81us) write_op.cc:454] Released schema lock
0709 13:11:08.136910 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:08.137660 (+   750us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:08.137690 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1652604,"reported_tablets":2,"spinlock_wait_cycles":52013952,"child_traces":[["op",{"apply.queue_time_us":218105,"apply.run_cpu_time_us":1654,"apply.run_wall_time_us":2724,"num_ops":1,"prepare.queue_time_us":259509,"prepare.run_cpu_time_us":98094,"prepare.run_wall_time_us":173469,"raft.queue_time_us":421936,"raft.run_cpu_time_us":35024,"raft.run_wall_time_us":331765,"replication_time_us":817562,"spinlock_wait_cycles":22112896,"thread_start_us":783598,"threads_started":4,"wal-append.queue_time_us":196622}]]}
I20260709 13:11:08.237637 26738 raft_consensus.cc:515] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:08.267653 25908 raft_consensus.cc:2376] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 3. Re-sending same reply.
I20260709 13:11:08.227260 26769 raft_consensus.cc:493] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:08.269989 26769 raft_consensus.cc:3060] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:08.180234 26768 raft_consensus.cc:515] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:08.234221 26564 leader_election.cc:290] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:08.264772 25907 raft_consensus.cc:2468] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 3.
I20260709 13:11:08.273006 25377 raft_consensus.cc:2468] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 3.
I20260709 13:11:08.232381 26559 raft_consensus.cc:515] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:08.277860 26795 raft_consensus.cc:2749] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:08.278581 26795 consensus_queue.cc:1048] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:08.280296 26795 raft_consensus.cc:2749] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:08.280966 26795 raft_consensus.cc:2749] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:08.283957 26745 raft_consensus.cc:515] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:08.284906 26744 raft_consensus.cc:493] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:08.286383 26744 raft_consensus.cc:515] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:08.212630 26796 raft_consensus.cc:515] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:08.210824 26793 raft_consensus.cc:515] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:08.285730 26692 raft_consensus.cc:493] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:08.226838 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:08.235397 26786 raft_consensus.cc:493] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:08.239262 26785 raft_consensus.cc:493] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:08.235237 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:08.293170 25370 raft_consensus.cc:2468] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 4.
I20260709 13:11:08.294354 26785 raft_consensus.cc:3060] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:08.237444 26761 raft_consensus.cc:740] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:08.302624 25904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50056 (request call id 361) took 1670 ms. Trace:
I20260709 13:11:08.290241 26704 raft_consensus.cc:493] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.291618 25900 raft_consensus.cc:3060] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:08.310631 25378 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36254 (request call id 1461) took 2825 ms (client timeout 3245 ms). Trace:
I20260709 13:11:08.313038 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:08.294915 26786 raft_consensus.cc:3060] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:08.311050 25378 rpcz_store.cc:269] 0709 13:11:05.485493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.520079 (+1034586us) service_pool.cc:224] Handling call
0709 13:11:08.310490 (+1790411us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54003110d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:08.310577 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2876439296}
I20260709 13:11:08.328088 25230 raft_consensus.cc:2468] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 4.
I20260709 13:11:08.297906 26692 raft_consensus.cc:515] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:08.338919 25223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58418 (request call id 1430) took 1980 ms. Trace:
I20260709 13:11:08.340313 26680 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:08.340785 26574 leader_election.cc:290] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:08.352434 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:08.332424 26768 leader_election.cc:290] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:08.350051 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:08.351699 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:08.423456 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:08.356226 26808 raft_consensus.cc:493] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.421612 25225 raft_consensus.cc:3060] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:08.426311 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:08.428350 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:08.333413 25374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36254 (request call id 1481) took 1141 ms. Trace:
I20260709 13:11:08.331068 26772 raft_consensus.cc:493] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.431599 25377 raft_consensus.cc:1240] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:08.430068 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:08.335588 26760 leader_election.cc:290] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:08.324494 26704 raft_consensus.cc:515] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:08.432685 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:08.421154 26744 leader_election.cc:290] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:08.344316 26795 raft_consensus.cc:493] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.428869 25378 raft_consensus.cc:3060] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:08.448030 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:08.448693 25370 raft_consensus.cc:3060] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:08.345250 26686 raft_consensus.cc:493] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:08.449575 26686 raft_consensus.cc:515] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:08.451529 26686 leader_election.cc:290] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:08.452129 26744 raft_consensus.cc:493] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:08.452646 26744 raft_consensus.cc:515] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:08.440411 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 275471us
W20260709 13:11:08.436362 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 267741us
I20260709 13:11:08.303078 25904 rpcz_store.cc:276] 0709 13:11:06.631822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:07.171709 (+539887us) service_pool.cc:224] Handling call
0709 13:11:07.204473 (+ 32764us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:07.204869 (+   396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:07.204921 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:07.205411 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 13:11:08.302041 (+1096630us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b180035ce00. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72f8174bc 00007fd72cb6548b 00007fd7359bfab9 00007fd72cb8169b 00007fd72cb7f93f 00007fd72cb81c02 00007fd72f80920b 00007fd72f80ed23 00007fd72f80f0d1
0709 13:11:08.302199 (+   158us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:08.302237 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:08.302311 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:08.302361 (+    50us) raft_consensus.cc:1685] finished
0709 13:11:08.302377 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:08.302567 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1423,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":103,"spinlock_wait_cycles":23191424,"thread_start_us":91265,"threads_started":1,"wal-append.queue_time_us":89618}
I20260709 13:11:08.484115 25874 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:11:08.439586 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 277030us
I20260709 13:11:08.461994 25370 raft_consensus.cc:2468] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 3.
I20260709 13:11:08.435055 25225 raft_consensus.cc:2468] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 4.
I20260709 13:11:08.442441 25222 raft_consensus.cc:3060] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:08.493619 25378 raft_consensus.cc:2468] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 4.
I20260709 13:11:08.466486 26738 leader_election.cc:290] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:08.435678 26772 raft_consensus.cc:515] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:11:08.424652 26808 raft_consensus.cc:515] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:08.467715 26745 leader_election.cc:290] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:08.515190 25873 leader_election.cc:304] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:08.430330 25374 rpcz_store.cc:276] 0709 13:11:07.192022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:07.208447 (+ 16425us) service_pool.cc:224] Handling call
0709 13:11:08.333194 (+1124747us) spinlock_profiling.cc:243] Waited 36.6 ms on lock 0x7b54004411d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:08.333352 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":84227968}
I20260709 13:11:08.483640 26686 raft_consensus.cc:493] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:08.509090 26701 consensus_queue.cc:1048] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:11:08.522727 26738 raft_consensus.cc:2749] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:08.514670 26680 raft_consensus.cc:493] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:08.523639 26808 leader_election.cc:290] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:08.504859 26793 leader_election.cc:290] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:08.526470 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 73921.9us
W20260709 13:11:08.529633 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 294973us
I20260709 13:11:08.430629 26761 consensus_queue.cc:260] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:08.347421 25223 rpcz_store.cc:276] 0709 13:11:06.358474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.939397 (+580923us) service_pool.cc:224] Handling call
0709 13:11:07.621827 (+682430us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:07.627116 (+  5289us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:07.627151 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:07.627205 (+    54us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:11:07.627241 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:07.627325 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:08.338739 (+711414us) spinlock_profiling.cc:243] Waited 652 ms on lock 0x7b5400436550. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6e8ad 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:08.338857 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1499392768}
W20260709 13:11:08.544521 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 60480.3us
I20260709 13:11:08.545814 25874 leader_election.cc:304] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:08.525906 26805 raft_consensus.cc:493] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:08.554922 25227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54000 (request call id 190) took 1015 ms. Trace:
I20260709 13:11:08.533072 26797 raft_consensus.cc:493] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:08.556023 26797 raft_consensus.cc:515] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:08.457017 26795 raft_consensus.cc:515] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:08.555596 25227 rpcz_store.cc:276] 0709 13:11:07.539426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:08.156595 (+617169us) service_pool.cc:224] Handling call
0709 13:11:08.156838 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:08.157018 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:11:08.439038 (+282020us) log.cc:844] Serialized 14 byte log entry
0709 13:11:08.554477 (+115439us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:08.554548 (+    71us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:08.554606 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:08.554692 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:08.554853 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":269084,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":1232,"thread_start_us":384822,"threads_started":2}
W20260709 13:11:08.552001 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 317285us
I20260709 13:11:08.560043 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:08.564064 25304 raft_consensus.cc:3060] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:08.565773 25194 leader_election.cc:400] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Vote denied by peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127) with higher term. Message: Invalid argument: T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 2. Current term is 3.
I20260709 13:11:08.569059 25904 raft_consensus.cc:1240] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:08.569216 25194 leader_election.cc:403] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:08.570470 25194 leader_election.cc:304] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:11:08.570590 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:08.572273 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:08.567121 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:08.505026 26806 consensus_queue.cc:1048] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 13:11:08.576579 25270 leader_election.cc:304] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:08.552265 26744 leader_election.cc:290] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:08.598311 25907 raft_consensus.cc:1240] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:08.598855 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:08.599331 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:08.584318 26794 raft_consensus.cc:2749] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127) with higher term. Message: Invalid argument: T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 2. Current term is 3.
I20260709 13:11:08.585004 26745 raft_consensus.cc:2804] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:08.587687 25374 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017"
dest_uuid: "79d99c0e498349bda74127365219e468"
mode: GRACEFUL
new_leader_uuid: "da445ce82dc4467f95f4fa52297eaa19"
 from {username='slave'} at 127.0.0.1:59274
I20260709 13:11:08.588780 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:08.592895 26767 leader_election.cc:290] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:08.594895 25305 raft_consensus.cc:1240] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:08.595350 25300 raft_consensus.cc:2393] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 3: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:08.596040 25299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57272 (request call id 1207) took 1079 ms. Trace:
I20260709 13:11:08.599433 25297 raft_consensus.cc:2468] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 3.
I20260709 13:11:08.599941 25908 raft_consensus.cc:3060] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:08.582105 25194 leader_election.cc:304] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:08.621673 25194 leader_election.cc:304] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:08.622895 25194 leader_election.cc:304] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:08.624536 25194 leader_election.cc:304] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:08.600629 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:08.626346 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:08.554631 26738 raft_consensus.cc:2749] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:08.530761 26686 raft_consensus.cc:515] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:08.542771 26680 raft_consensus.cc:515] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:08.606328 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:08.607028 26772 leader_election.cc:290] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361)
W20260709 13:11:08.607335 26807 log.cc:927] Time spent T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:11:08.610663 25226 raft_consensus.cc:3060] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:08.559557 26811 consensus_queue.cc:1059] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:11:08.613889 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:08.614116 25304 raft_consensus.cc:2468] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 3.
W20260709 13:11:08.614804 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 99701us
I20260709 13:11:08.562733 26761 raft_consensus.cc:3060] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:08.548375 26697 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:08.616743 25270 leader_election.cc:304] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:08.619226 25299 rpcz_store.cc:276] 0709 13:11:07.517018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:07.562997 (+ 45979us) service_pool.cc:224] Handling call
0709 13:11:08.595850 (+1032853us) spinlock_profiling.cc:243] Waited 584 ms on lock 0x7b54002c9f54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:08.595985 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1343000320}
I20260709 13:11:08.632804 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
W20260709 13:11:08.635212 26812 log.cc:927] Time spent T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:11:08.635970 26704 leader_election.cc:290] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:08.677014 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 60366.2us
W20260709 13:11:08.679872 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 153781us
I20260709 13:11:08.635872 26815 consensus_queue.cc:1059] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:08.623697 25374 raft_consensus.cc:606] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 3 LEADER]: Received request to transfer leadership to TS da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:08.636758 26793 raft_consensus.cc:2804] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:08.602154 26796 leader_election.cc:290] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:08.614944 26745 raft_consensus.cc:493] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:08.651070 25301 raft_consensus.cc:2468] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 3.
I20260709 13:11:08.617669 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:08.621788 26819 consensus_queue.cc:1059] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:11:08.620085 26814 raft_consensus.cc:2804] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:08.655783 26785 raft_consensus.cc:515] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:08.680959 25270 leader_election.cc:304] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:08.647773 26794 raft_consensus.cc:2804] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:11:08.677379 25345 connection.cc:256] RPC call timeout handler was delayed by -1.1820937080000249s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1787s for a response
I20260709 13:11:08.682655 25226 raft_consensus.cc:2468] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 3.
W20260709 13:11:08.800961 25345 connection.cc:256] RPC call timeout handler was delayed by -1.0195871309999802s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20299999999999999s for a response
I20260709 13:11:08.683578 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:08.802920 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:08.804566 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:08.804917 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:08.805188 25378 raft_consensus.cc:2468] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 2.
I20260709 13:11:08.684054 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
W20260709 13:11:08.679231 26799 log.cc:927] Time spent T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 13:11:08.714092 26732 log.cc:927] Time spent T 00000000000000000000000000000000 P 5140a3161b944724a989995efdc4a818: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:11:08.714766 26559 leader_election.cc:290] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:08.718015 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:08.683702 26808 raft_consensus.cc:2804] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:08.729741 25229 raft_consensus.cc:1240] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:08.676739 25221 raft_consensus.cc:3060] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:08.650025 26692 leader_election.cc:290] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:08.783492 26745 raft_consensus.cc:3060] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:08.742625 26697 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:08.744064 25302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57272 (request call id 1202) took 1253 ms. Trace:
W20260709 13:11:08.826370 26809 log.cc:927] Time spent T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:11:08.826207 25302 rpcz_store.cc:276] 0709 13:11:07.491103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:08.202313 (+711210us) service_pool.cc:224] Handling call
0709 13:11:08.202604 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:08.202931 (+   327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:08.202959 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:08.208548 (+  5589us) log.cc:844] Serialized 26 byte log entry
0709 13:11:08.551317 (+342769us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:08.551359 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:08.551427 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:08.743806 (+192379us) raft_consensus.cc:1685] finished
0709 13:11:08.743834 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:08.743995 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2411,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":3705,"thread_start_us":311117,"threads_started":1,"wal-append.queue_time_us":323720}
I20260709 13:11:08.560707 26805 raft_consensus.cc:515] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:08.832896 25222 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 3.
I20260709 13:11:08.643882 26810 raft_consensus.cc:2804] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:08.833938 26810 raft_consensus.cc:493] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:08.834362 26810 raft_consensus.cc:3060] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:08.835872 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:08.682838 25227 raft_consensus.cc:1240] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:08.837533 26713 leader_election.cc:290] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:08.837743 26795 leader_election.cc:290] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:08.781332 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:08.785738 25271 leader_election.cc:304] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:08.838343 26795 raft_consensus.cc:2749] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:11:08.784791 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 175717us
W20260709 13:11:08.787293 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 238516us
I20260709 13:11:08.839031 26795 raft_consensus.cc:493] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
W20260709 13:11:08.787369 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 106488us
I20260709 13:11:08.806021 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:08.806658 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:08.823246 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:11:08.806800 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 126123us
I20260709 13:11:08.841064 25378 raft_consensus.cc:2468] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 1.
I20260709 13:11:08.759080 26793 raft_consensus.cc:493] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:08.810156 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:11:08.812659 25195 leader_election.cc:336] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 1.703s (SENT)
I20260709 13:11:08.818572 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:08.819269 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:11:08.821360 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:08.823704 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:08.802091 26794 raft_consensus.cc:493] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:08.827433 25298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57256 (request call id 1357) took 1305 ms. Trace:
W20260709 13:11:08.838764 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 53197.5us
I20260709 13:11:08.865374 25271 leader_election.cc:304] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:08.802248 26796 raft_consensus.cc:2749] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:08.841287 25379 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 1.
I20260709 13:11:08.842236 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:08.807767 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:08.682039 26818 consensus_queue.cc:1059] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.131s
I20260709 13:11:08.825635 25908 raft_consensus.cc:2468] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 2.
I20260709 13:11:08.855659 26793 raft_consensus.cc:3060] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:08.839541 26795 raft_consensus.cc:515] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:08.859545 26817 raft_consensus.cc:3055] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:08.800290 26814 raft_consensus.cc:493] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:08.860023 25344 leader_election.cc:304] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:08.864342 25298 rpcz_store.cc:276] 0709 13:11:07.521719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:08.206648 (+684929us) service_pool.cc:224] Handling call
0709 13:11:08.206888 (+   240us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:08.210771 (+  3883us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:08.211015 (+   244us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:08.211407 (+   392us) log.cc:844] Serialized 26 byte log entry
0709 13:11:08.544725 (+333318us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:11:08.544789 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:08.544881 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:08.827230 (+282349us) raft_consensus.cc:1685] finished
0709 13:11:08.827247 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:08.827380 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3664,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":15492,"thread_start_us":253395,"threads_started":1,"wal-append.queue_time_us":405578}
I20260709 13:11:08.873123 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:08.871431 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:08.873931 25377 raft_consensus.cc:2376] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 2. Re-sending same reply.
I20260709 13:11:08.876034 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:08.876173 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:08.876927 25370 raft_consensus.cc:2393] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 2: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:08.875039 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:08.877696 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:08.878100 25377 raft_consensus.cc:2393] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 3: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:08.828001 26686 leader_election.cc:290] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:08.815443 26808 raft_consensus.cc:493] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:08.879424 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:11:08.860119 26786 consensus_meta.cc:287] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.528s	user 0.006s	sys 0.001s
I20260709 13:11:08.884238 26827 raft_consensus.cc:2749] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:08.867785 26794 raft_consensus.cc:3060] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:08.879683 25376 raft_consensus.cc:2393] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 3: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:08.879971 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:08.886059 25379 raft_consensus.cc:2393] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 4: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:08.886320 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:08.886696 25377 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2"
dest_uuid: "79d99c0e498349bda74127365219e468"
mode: GRACEFUL
new_leader_uuid: "da445ce82dc4467f95f4fa52297eaa19"
 from {username='slave'} at 127.0.0.1:59274
I20260709 13:11:08.880546 25378 raft_consensus.cc:1275] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:08.866197 26798 raft_consensus.cc:2804] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:08.887756 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:08.892360 25271 leader_election.cc:304] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:08.902875 25271 leader_election.cc:304] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:11:08.887398 25377 raft_consensus.cc:606] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Received request to transfer leadership to TS da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:08.879492 26825 raft_consensus.cc:3055] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:08.905365 25270 leader_election.cc:304] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:08.877169 26817 raft_consensus.cc:740] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:08.879201 26814 raft_consensus.cc:3060] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:08.910058 25271 leader_election.cc:304] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:08.920967 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:08.889355 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:08.921473 25270 leader_election.cc:304] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:08.932585 25377 raft_consensus.cc:2368] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 2. Current term is 3.
I20260709 13:11:08.932760 25270 leader_election.cc:304] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:08.932843 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:08.933696 25372 raft_consensus.cc:2468] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 2.
I20260709 13:11:08.922824 25271 leader_election.cc:304] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:08.902408 26796 raft_consensus.cc:2749] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:08.904915 26761 raft_consensus.cc:2749] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:08.950520 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:08.940678 25270 leader_election.cc:304] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:08.941275 26763 raft_consensus.cc:2749] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:08.936412 26615 raft_consensus.cc:2804] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:08.900239 26798 raft_consensus.cc:697] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 3 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:08.942345 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:08.909185 26825 raft_consensus.cc:740] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:08.943147 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:08.943897 25873 leader_election.cc:304] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:08.972980 25376 raft_consensus.cc:3060] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:08.973209 26738 raft_consensus.cc:2804] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:08.973785 26738 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:08.973255 26825 consensus_queue.cc:260] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:08.974141 26738 raft_consensus.cc:3060] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:08.974596 26825 raft_consensus.cc:3060] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:08.944708 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:08.952087 25270 leader_election.cc:304] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:08.889117 26786 raft_consensus.cc:515] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:08.917867 26553 raft_consensus.cc:2804] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:08.902976 26680 leader_election.cc:290] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:08.957464 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:08.960683 25221 raft_consensus.cc:2468] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 2.
I20260709 13:11:08.930202 26816 raft_consensus.cc:2749] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:08.902590 26697 consensus_queue.cc:1059] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:11:08.961714 26810 raft_consensus.cc:515] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:08.962949 26795 leader_election.cc:290] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:08.963012 25374 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22"
dest_uuid: "79d99c0e498349bda74127365219e468"
mode: GRACEFUL
new_leader_uuid: "1f539ba21487460085b837e7529a78ce"
 from {username='slave'} at 127.0.0.1:59274
I20260709 13:11:08.963970 26798 consensus_queue.cc:237] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:08.971333 26769 consensus_meta.cc:287] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.701s	user 0.009s	sys 0.000s
I20260709 13:11:08.971716 26796 raft_consensus.cc:2804] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:08.972292 25902 raft_consensus.cc:2393] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 3: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:11:08.971972 26615 raft_consensus.cc:697] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 3 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:08.979858 25270 leader_election.cc:304] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
W20260709 13:11:09.018189 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 158188us
W20260709 13:11:09.027859 25270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:08.990733 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:08.996583 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:08.885915 26808 raft_consensus.cc:3060] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:08.943610 26604 raft_consensus.cc:2804] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:09.007616 25376 raft_consensus.cc:2468] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 4.
I20260709 13:11:09.034092 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:09.035137 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:09.036226 25376 raft_consensus.cc:1240] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:09.037343 25376 raft_consensus.cc:1275] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:09.011550 26680 consensus_queue.cc:1059] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:08.997539 26763 raft_consensus.cc:2804] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:08.954943 26760 raft_consensus.cc:2804] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:11:08.979012 25900 consensus_meta.cc:287] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent flushing consensus metadata: real 0.651s	user 0.009s	sys 0.001s
I20260709 13:11:09.028798 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:11:09.006467 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 381983us
I20260709 13:11:09.047546 25194 leader_election.cc:304] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:11:09.048058 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 125327us
W20260709 13:11:09.041729 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 224259us
I20260709 13:11:09.032646 25375 raft_consensus.cc:2468] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 2.
I20260709 13:11:09.042546 25371 raft_consensus.cc:1275] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:11:09.048789 25271 leader_election.cc:304] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
W20260709 13:11:09.043728 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 94982.8us
I20260709 13:11:09.050570 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:09.051529 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:09.051717 25377 raft_consensus.cc:1275] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:11:09.052603 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:09.014751 26553 raft_consensus.cc:697] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 3 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:09.058256 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:09.058291 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:09.059577 25270 leader_election.cc:304] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:09.060436 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:09.058912 25379 raft_consensus.cc:2468] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 2.
W20260709 13:11:09.099712 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 52229.5us
W20260709 13:11:09.109896 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 61181.4us
I20260709 13:11:09.040375 25374 raft_consensus.cc:606] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 2 LEADER]: Received request to transfer leadership to TS 1f539ba21487460085b837e7529a78ce
I20260709 13:11:09.113415 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:09.041878 26604 raft_consensus.cc:493] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:09.041340 26704 raft_consensus.cc:493] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.045668 26574 raft_consensus.cc:2804] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:09.118230 25271 leader_election.cc:304] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
W20260709 13:11:09.120229 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 73904.7us
I20260709 13:11:09.121281 25872 leader_election.cc:304] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:09.047346 26796 raft_consensus.cc:697] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 3 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:09.122120 25872 leader_election.cc:304] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:09.016022 26814 raft_consensus.cc:515] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:09.046667 25900 raft_consensus.cc:2468] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 3.
I20260709 13:11:09.056520 26763 raft_consensus.cc:697] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 4 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:09.118222 26604 raft_consensus.cc:3060] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:09.137135 26615 consensus_queue.cc:237] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:09.134691 26839 raft_consensus.cc:2749] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:09.136190 26553 consensus_queue.cc:237] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:09.131306 26760 raft_consensus.cc:697] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 4 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:09.133188 26822 raft_consensus.cc:2749] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:11:09.174302 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 51091.5us
I20260709 13:11:09.110273 26793 raft_consensus.cc:515] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:09.154008 26745 raft_consensus.cc:515] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:09.043520 26769 raft_consensus.cc:515] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:11:09.134470 26795 raft_consensus.cc:493] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:09.143378 26802 raft_consensus.cc:2749] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:11:09.178982 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 119479us
I20260709 13:11:09.194408 25270 leader_election.cc:304] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:09.195740 26795 raft_consensus.cc:515] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:09.196447 26810 leader_election.cc:290] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:09.197054 26810 raft_consensus.cc:3055] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:09.177239 26763 consensus_queue.cc:237] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:09.197377 26810 raft_consensus.cc:740] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:09.197854 26795 leader_election.cc:290] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:09.198385 26795 raft_consensus.cc:2804] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:09.198707 26795 raft_consensus.cc:493] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:09.124606 26704 raft_consensus.cc:515] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:09.199057 26745 leader_election.cc:290] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:09.199326 26796 consensus_queue.cc:237] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:09.200582 26704 leader_election.cc:290] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:09.178424 26772 raft_consensus.cc:2804] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:09.200814 26810 consensus_queue.cc:260] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:09.202091 26810 raft_consensus.cc:3060] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:09.202469 26793 leader_election.cc:290] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:09.202365 26828 consensus_queue.cc:1048] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:09.203096 26793 raft_consensus.cc:493] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.203539 26793 raft_consensus.cc:515] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:09.206851 25271 leader_election.cc:304] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:11:09.175735 26806 raft_consensus.cc:493] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
W20260709 13:11:09.216619 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 94558.2us
I20260709 13:11:09.218242 25872 leader_election.cc:304] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:11:09.218998 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 169000us
I20260709 13:11:09.220803 25195 leader_election.cc:304] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:09.199070 26795 raft_consensus.cc:3060] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:09.179718 26680 consensus_queue.cc:1048] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:11:09.223279 25270 leader_election.cc:304] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:09.228785 25872 leader_election.cc:304] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
W20260709 13:11:09.224722 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 143630us
W20260709 13:11:09.225869 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 175694us
I20260709 13:11:09.230016 25873 leader_election.cc:304] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:09.219230 25373 raft_consensus.cc:1240] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 2. Current term is 3. Ops: []
W20260709 13:11:09.273979 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 53257.8us
I20260709 13:11:09.269912 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:09.215651 26772 raft_consensus.cc:697] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 4 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
W20260709 13:11:09.270475 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 47286.2us
I20260709 13:11:09.273543 25228 raft_consensus.cc:1240] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:09.273731 25230 raft_consensus.cc:1240] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:09.281591 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:09.218638 26574 raft_consensus.cc:697] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 3 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:09.175973 26843 consensus_queue.cc:1059] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:11:09.336344 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:09.287544 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:09.338419 25225 raft_consensus.cc:2368] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 3. Current term is 4.
I20260709 13:11:09.336362 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:09.339955 25230 raft_consensus.cc:2468] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 3.
W20260709 13:11:09.285079 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 55119.2us
I20260709 13:11:09.217604 26692 consensus_queue.cc:1048] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.065s
I20260709 13:11:09.341365 25873 leader_election.cc:304] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:09.345861 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:09.346891 25228 raft_consensus.cc:2393] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 3: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:09.217447 26564 consensus_queue.cc:1059] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.118s
W20260709 13:11:09.346755 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 63792.4us
I20260709 13:11:09.267684 26836 raft_consensus.cc:2804] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:09.347851 25195 leader_election.cc:304] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:09.272147 26697 raft_consensus.cc:2749] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:09.269699 26822 raft_consensus.cc:2804] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:09.352463 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:09.352573 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:09.357859 25228 raft_consensus.cc:3060] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:09.269399 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:09.267982 26793 leader_election.cc:290] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:09.365031 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:09.366209 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:09.367195 25297 raft_consensus.cc:2393] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 2: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:09.367833 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:09.368795 25300 raft_consensus.cc:2393] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 3: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:09.334792 26841 raft_consensus.cc:2749] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:09.356686 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:09.360814 25195 leader_election.cc:400] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 election: Vote denied by peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091) with higher term. Message: Invalid argument: T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 2. Current term is 3.
I20260709 13:11:09.370123 25195 leader_election.cc:403] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:11:09.370246 25298 raft_consensus.cc:2468] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 2.
I20260709 13:11:09.371438 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:09.338124 26842 raft_consensus.cc:2749] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:09.362205 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:09.346572 26832 raft_consensus.cc:493] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.364208 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:09.233971 26848 raft_consensus.cc:2804] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:09.225785 26806 raft_consensus.cc:515] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:09.380110 25195 leader_election.cc:304] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:09.383582 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:09.379958 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:09.388741 25195 leader_election.cc:304] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:09.389842 25298 raft_consensus.cc:2468] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 3.
I20260709 13:11:09.390965 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:09.359119 26822 raft_consensus.cc:493] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:09.349650 26836 raft_consensus.cc:493] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:09.387195 25302 raft_consensus.cc:1240] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:09.373433 25223 raft_consensus.cc:1240] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:09.235273 26821 consensus_queue.cc:1048] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.148s
I20260709 13:11:09.385545 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:09.388726 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:09.282675 26760 consensus_queue.cc:237] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:09.394933 25195 leader_election.cc:304] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:09.395802 26815 raft_consensus.cc:3055] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:09.395872 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:09.397598 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:09.394039 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:09.387101 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:09.427898 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:09.427940 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:09.452581 25302 raft_consensus.cc:2468] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 2.
I20260709 13:11:09.452646 25228 raft_consensus.cc:2468] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 4.
I20260709 13:11:09.394711 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:11:09.448771 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 53909.5us
W20260709 13:11:09.445010 26794 consensus_meta.cc:287] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 0.544s	user 0.000s	sys 0.009s
I20260709 13:11:09.443935 25301 raft_consensus.cc:2393] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 3: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:09.430399 25222 raft_consensus.cc:2393] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 3: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:09.450395 26815 raft_consensus.cc:740] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:09.427129 26836 raft_consensus.cc:3060] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:09.472107 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:09.397323 26772 consensus_queue.cc:237] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:09.443964 26842 raft_consensus.cc:2804] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:09.458642 26814 leader_election.cc:290] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:09.477859 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:09.684592 26842 raft_consensus.cc:493] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:09.686980 26842 raft_consensus.cc:3060] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:09.643857 25221 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58422 (request call id 1355) took 1290 ms (client timeout 1660 ms). Trace:
W20260709 13:11:09.689927 25221 rpcz_store.cc:269] 0709 13:11:08.353021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:08.420885 (+ 67864us) service_pool.cc:224] Handling call
0709 13:11:08.588609 (+167724us) spinlock_profiling.cc:243] Waited 3.56 ms on lock 0x7b5800002a98. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72cb4ab71 00007fd72cb4aa22 00007fd735a63c09 00007fd734bbdee0 00007fd734c870ab 00007fd734c87131 00007fd734c350a0 00007fd734c34984 00007fd72e1af6d4 00007fd72e1af662
0709 13:11:09.643682 (+1055073us) spinlock_profiling.cc:243] Waited 55.2 ms on lock 0x7b5400088ed4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:09.643793 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":135130880}
I20260709 13:11:09.691257 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:09.664798 26795 raft_consensus.cc:515] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:09.691897 25221 raft_consensus.cc:2376] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 79d99c0e498349bda74127365219e468 in term 3. Re-sending same reply.
I20260709 13:11:09.692854 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:09.693987 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:09.685052 26817 consensus_queue.cc:260] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:09.470271 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:09.695588 25343 leader_election.cc:304] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:09.695904 25229 raft_consensus.cc:2468] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 1.
I20260709 13:11:09.696661 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:09.560930 26849 raft_consensus.cc:2749] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:09.466565 26838 consensus_queue.cc:1048] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.087s
I20260709 13:11:09.398515 26832 raft_consensus.cc:515] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:09.458657 26855 raft_consensus.cc:2749] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:09.437510 26848 raft_consensus.cc:697] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 3 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:09.668004 25345 leader_election.cc:304] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:09.670213 25195 leader_election.cc:304] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
W20260709 13:11:09.559926 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 218617us
W20260709 13:11:09.616993 26808 consensus_meta.cc:287] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.563s	user 0.009s	sys 0.000s
W20260709 13:11:09.476747 26825 consensus_meta.cc:287] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent flushing consensus metadata: real 0.502s	user 0.008s	sys 0.002s
W20260709 13:11:09.478628 26738 consensus_meta.cc:287] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent flushing consensus metadata: real 0.504s	user 0.006s	sys 0.002s
I20260709 13:11:09.637636 26818 raft_consensus.cc:493] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.662358 26692 raft_consensus.cc:493] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:09.477075 26797 leader_election.cc:290] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:09.472425 26769 leader_election.cc:290] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:09.617471 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:09.673458 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:09.673996 26680 raft_consensus.cc:2749] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091) with higher term. Message: Invalid argument: T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 2. Current term is 3.
I20260709 13:11:09.659348 26559 raft_consensus.cc:3055] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:09.671545 26794 raft_consensus.cc:515] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:09.742182 26794 leader_election.cc:290] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:09.716813 26808 raft_consensus.cc:515] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:09.743068 26848 consensus_queue.cc:237] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:09.676447 26816 raft_consensus.cc:3055] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:09.745906 26816 raft_consensus.cc:740] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:09.720031 26738 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:09.746681 26816 consensus_queue.cc:260] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:09.747763 26738 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 3 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:09.747880 25226 raft_consensus.cc:1240] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 1. Current term is 2. Ops: []
W20260709 13:11:09.678895 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 309208us
I20260709 13:11:09.466630 26793 raft_consensus.cc:2749] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:09.617985 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:09.680709 25301 raft_consensus.cc:1275] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:09.560690 26852 raft_consensus.cc:2749] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:09.453393 26574 consensus_queue.cc:237] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:09.682766 26604 consensus_meta.cc:287] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.512s	user 0.010s	sys 0.000s
I20260709 13:11:09.690383 25300 raft_consensus.cc:1275] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:09.403025 26822 raft_consensus.cc:3060] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:09.694968 25221 raft_consensus.cc:2368] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 3. Current term is 4.
I20260709 13:11:09.697178 25229 raft_consensus.cc:2468] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 5.
W20260709 13:11:09.519392 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 290646us
I20260709 13:11:09.762322 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:09.764446 25229 raft_consensus.cc:1240] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:09.765470 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:09.766469 25229 raft_consensus.cc:1240] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:09.766696 25900 raft_consensus.cc:1275] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:11:09.766914 25899 raft_consensus.cc:3060] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 LEARNER]: Advancing to term 2
I20260709 13:11:09.767297 25221 raft_consensus.cc:1275] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:11:09.767684 25229 raft_consensus.cc:1275] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:09.768702 25221 raft_consensus.cc:1240] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:11:09.700874 26701 raft_consensus.cc:2749] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:09.702077 25343 leader_election.cc:304] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:11:09.770085 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 68070.4us
I20260709 13:11:09.771425 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:09.771828 25222 raft_consensus.cc:1275] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:09.772245 26701 raft_consensus.cc:2804] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:09.772370 25221 raft_consensus.cc:1240] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:09.772769 26701 raft_consensus.cc:493] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:09.773155 26701 raft_consensus.cc:3060] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:09.773190 25222 raft_consensus.cc:1240] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:11:09.754765 25223 raft_consensus.cc:3060] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:09.774015 26808 leader_election.cc:290] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:09.772260 25225 raft_consensus.cc:2393] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 3: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:09.777946 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:09.757618 25296 raft_consensus.cc:1240] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 4 LEADER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 13:11:09.779456 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:09.777968 25225 raft_consensus.cc:1275] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:09.781211 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:09.782073 25305 raft_consensus.cc:2393] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 4: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:09.473255 26841 raft_consensus.cc:2749] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:09.693535 26795 leader_election.cc:290] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:09.721602 26692 raft_consensus.cc:515] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:09.783308 26701 raft_consensus.cc:515] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:09.784457 26692 leader_election.cc:290] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:09.458730 26786 leader_election.cc:290] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:09.526922 26860 raft_consensus.cc:2804] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:09.785372 26701 leader_election.cc:290] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:09.785565 26860 raft_consensus.cc:493] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:09.644253 26806 leader_election.cc:290] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:11:09.713918 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 46004.3us
I20260709 13:11:09.714299 25194 leader_election.cc:400] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 election: Vote denied by peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127) with higher term. Message: Invalid argument: T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 2. Current term is 3.
I20260709 13:11:09.707487 25271 leader_election.cc:304] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:11:09.715056 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 44912.5us
I20260709 13:11:09.761443 26604 raft_consensus.cc:515] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:09.750317 26559 raft_consensus.cc:740] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:09.717455 26863 raft_consensus.cc:2749] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:09.738574 25224 raft_consensus.cc:2393] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 2: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:09.753674 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:11:09.737231 25871 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:09.753707 26744 consensus_queue.cc:1059] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:11:09.756525 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:09.737948 26854 raft_consensus.cc:2804] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:09.737600 26818 raft_consensus.cc:515] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:09.758302 26796 consensus_queue.cc:1048] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:11:09.695441 26817 raft_consensus.cc:3060] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:09.755328 26839 consensus_queue.cc:1048] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:11:09.703886 26553 raft_consensus.cc:493] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:09.458523 26851 raft_consensus.cc:2804] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:11:09.786737 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 72588.8us
W20260709 13:11:09.787094 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 79949.8us
I20260709 13:11:09.793210 25345 leader_election.cc:304] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:09.790071 25370 raft_consensus.cc:1240] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:09.787508 25195 leader_election.cc:304] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:09.790758 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
W20260709 13:11:09.790437 25872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:09.873108 25377 raft_consensus.cc:3060] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:09.790454 25375 raft_consensus.cc:1240] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 3. Current term is 4. Ops: []
W20260709 13:11:09.874595 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 81447us
I20260709 13:11:09.875250 25345 leader_election.cc:400] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 election: Vote denied by peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361) with higher term. Message: Invalid argument: T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 3. Current term is 4.
I20260709 13:11:09.875476 25345 leader_election.cc:403] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:11:09.777249 26822 raft_consensus.cc:515] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:09.879215 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:09.879539 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:09.879845 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:09.880028 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:09.880385 25296 raft_consensus.cc:3060] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:09.880956 25301 raft_consensus.cc:3060] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:09.881470 26692 consensus_queue.cc:1048] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:09.882962 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:09.883714 25300 raft_consensus.cc:2468] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 5.
I20260709 13:11:09.773633 25221 raft_consensus.cc:1240] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:09.886699 25343 leader_election.cc:304] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:09.789812 26808 raft_consensus.cc:2804] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:11:09.891794 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 104354us
I20260709 13:11:09.898753 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:09.899466 25370 raft_consensus.cc:2368] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 2. Current term is 3.
I20260709 13:11:09.899828 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:09.900095 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:09.789935 26604 leader_election.cc:290] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:09.906163 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:09.791814 26832 leader_election.cc:290] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:09.904914 25373 raft_consensus.cc:1240] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:09.786082 26860 raft_consensus.cc:3060] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:09.982793 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 79525.3us
I20260709 13:11:09.814800 26701 consensus_queue.cc:1059] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.187s
I20260709 13:11:09.765560 26842 raft_consensus.cc:515] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:09.987432 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:09.890640 26851 raft_consensus.cc:697] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:09.883780 26806 raft_consensus.cc:2749] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361) with higher term. Message: Invalid argument: T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 3. Current term is 4.
I20260709 13:11:09.877559 26863 raft_consensus.cc:2749] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:09.991590 25194 leader_election.cc:304] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:09.888089 26795 consensus_queue.cc:1048] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.120s
I20260709 13:11:09.814543 26786 consensus_queue.cc:1059] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.166s
I20260709 13:11:09.987608 25301 raft_consensus.cc:2468] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 3.
I20260709 13:11:09.910544 26794 raft_consensus.cc:2804] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:09.893896 26808 raft_consensus.cc:493] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:09.906791 26564 raft_consensus.cc:3060] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:09.910837 26854 raft_consensus.cc:697] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 4 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:09.885051 26553 raft_consensus.cc:515] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:09.989302 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:10.044571 25379 raft_consensus.cc:2393] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 4: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:09.989017 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:10.019847 25194 leader_election.cc:304] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:09.989459 26797 raft_consensus.cc:493] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:09.893541 26767 consensus_queue.cc:1048] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.120s
I20260709 13:11:10.043571 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:09.910682 26804 consensus_queue.cc:1059] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.106s
I20260709 13:11:10.027086 26786 raft_consensus.cc:3055] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:09.910416 26852 consensus_queue.cc:1048] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.115s
I20260709 13:11:09.905314 26815 consensus_queue.cc:260] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:10.062125 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:10.062629 25194 leader_election.cc:304] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:10.030773 25377 raft_consensus.cc:2468] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 3.
I20260709 13:11:10.065104 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:10.066489 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:10.067196 25377 raft_consensus.cc:2468] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 1.
I20260709 13:11:10.068138 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:10.018165 26832 raft_consensus.cc:2749] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:10.036424 25343 leader_election.cc:304] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:10.038233 26808 raft_consensus.cc:3060] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:10.038757 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:10.039695 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:09.987735 26868 consensus_queue.cc:1059] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.123s
I20260709 13:11:10.048552 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:09.893860 26692 consensus_queue.cc:1059] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.120s
I20260709 13:11:10.032893 25899 raft_consensus.cc:1275] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 LEARNER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:11:10.024459 26794 raft_consensus.cc:493] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:10.052356 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:10.074719 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:10.054769 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:10.057236 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:10.077086 25376 raft_consensus.cc:2393] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 2: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:10.092531 25298 raft_consensus.cc:3060] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:10.058430 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
W20260709 13:11:10.030746 26869 log.cc:927] Time spent T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.281s	user 0.000s	sys 0.001s
I20260709 13:11:10.098109 26854 consensus_queue.cc:237] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:10.098748 26842 leader_election.cc:290] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:10.060360 25195 leader_election.cc:400] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Vote denied by peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091) with higher term. Message: Invalid argument: T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 2. Current term is 3.
I20260709 13:11:10.060679 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:10.069480 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:10.049636 26680 raft_consensus.cc:493] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.049427 26849 raft_consensus.cc:493] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.052829 26826 raft_consensus.cc:3055] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:10.053968 26810 raft_consensus.cc:2749] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:10.051544 25374 raft_consensus.cc:2468] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 1.
I20260709 13:11:10.076975 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:10.143942 25370 raft_consensus.cc:2393] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 3: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:10.074646 26772 raft_consensus.cc:493] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:10.095400 26795 raft_consensus.cc:2804] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:10.096959 26794 raft_consensus.cc:3060] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:10.053972 26786 raft_consensus.cc:740] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:10.126398 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:10.127238 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:11:10.114789 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 362854us
I20260709 13:11:10.140619 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:10.141206 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:10.158420 25908 raft_consensus.cc:2376] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 79d99c0e498349bda74127365219e468 in term 2. Re-sending same reply.
W20260709 13:11:10.142900 26879 log.cc:927] Time spent T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:11:10.146842 25298 raft_consensus.cc:2468] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 2.
I20260709 13:11:10.091852 25902 raft_consensus.cc:1240] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:10.093197 26815 raft_consensus.cc:3060] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:10.074973 26769 raft_consensus.cc:2749] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:10.141499 26826 raft_consensus.cc:740] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:10.132258 26692 consensus_queue.cc:1243] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer da445ce82dc4467f95f4fa52297eaa19 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:11:10.182984 26818 leader_election.cc:290] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:10.153065 25903 raft_consensus.cc:1240] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:10.183501 26818 raft_consensus.cc:493] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.147699 26795 raft_consensus.cc:493] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.183956 26818 raft_consensus.cc:515] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:10.184512 26795 raft_consensus.cc:3060] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:10.150532 26849 raft_consensus.cc:515] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:10.156286 26822 leader_election.cc:290] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:10.051963 26797 raft_consensus.cc:515] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:10.159446 25872 leader_election.cc:304] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
W20260709 13:11:10.159482 25874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:10.198691 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 52436.6us
I20260709 13:11:10.112375 26805 leader_election.cc:290] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:10.172389 25376 raft_consensus.cc:1275] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:10.074648 26834 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.167203 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
W20260709 13:11:10.176601 26878 log.cc:927] Time spent T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:11:10.209776 26564 raft_consensus.cc:2749] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:10.179524 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:10.210734 25379 raft_consensus.cc:3060] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:10.210806 26834 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:10.213099 26834 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:10.156988 26767 raft_consensus.cc:493] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.213780 26767 raft_consensus.cc:515] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:10.116901 26851 consensus_queue.cc:237] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:10.182541 25374 raft_consensus.cc:1240] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:10.172931 26833 consensus_queue.cc:1059] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:11:10.173220 26868 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.202679 26804 raft_consensus.cc:2804] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:10.229238 26804 raft_consensus.cc:493] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:10.229708 26804 raft_consensus.cc:3060] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:10.204623 26797 leader_election.cc:290] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:10.157194 26772 raft_consensus.cc:515] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:10.218279 26826 consensus_queue.cc:260] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:10.239439 26826 raft_consensus.cc:3060] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:10.230453 26818 leader_election.cc:290] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:10.229278 26868 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:10.284116 24113 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
W20260709 13:11:10.287701 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 224956us
I20260709 13:11:10.289546 25194 leader_election.cc:304] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:10.291445 25194 leader_election.cc:304] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:11:10.124774 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 64622us
I20260709 13:11:10.298440 25222 raft_consensus.cc:1240] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:10.127979 25223 raft_consensus.cc:2468] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 3.
I20260709 13:11:10.300197 25223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58418 (request call id 1456) took 1015 ms. Trace:
I20260709 13:11:10.300650 25223 rpcz_store.cc:276] 0709 13:11:09.288138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.569658 (+281520us) service_pool.cc:224] Handling call
0709 13:11:10.299940 (+730282us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:10.302640 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:10.158205 25229 raft_consensus.cc:2468] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 1.
I20260709 13:11:10.305531 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:10.306344 25229 raft_consensus.cc:3060] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:10.308634 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:10.175732 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:10.319165 25305 raft_consensus.cc:2410] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:11:10.320755 25298 raft_consensus.cc:1240] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:10.199689 25344 leader_election.cc:304] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:10.162853 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:10.322574 25377 raft_consensus.cc:3060] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:10.326366 25373 raft_consensus.cc:1275] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:10.205837 25376 raft_consensus.cc:3055] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:10.327549 25376 raft_consensus.cc:740] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:10.199689 25872 leader_election.cc:304] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:10.142004 26680 raft_consensus.cc:515] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:11:10.342334 26886 raft_consensus.cc:2804] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:10.356046 26848 raft_consensus.cc:493] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:10.355903 26834 consensus_queue.cc:1059] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:10.357091 26848 raft_consensus.cc:515] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:10.362986 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:10.364207 25874 leader_election.cc:304] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:10.364667 26805 raft_consensus.cc:2749] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:10.366133 26868 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:10.367240 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:10.366005 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:10.386919 26832 raft_consensus.cc:2804] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:10.387748 26832 raft_consensus.cc:697] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 3 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:10.387820 26738 raft_consensus.cc:2749] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:10.390622 26883 raft_consensus.cc:3055] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:10.391407 26883 raft_consensus.cc:740] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
W20260709 13:11:10.387179 25873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:10.399061 25873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:10.402271 26886 raft_consensus.cc:697] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 2 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:10.404453 26886 consensus_queue.cc:237] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:10.357668 26834 raft_consensus.cc:493] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:10.422991 26834 raft_consensus.cc:515] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:10.423736 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:10.424984 26574 raft_consensus.cc:493] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:10.426015 26574 raft_consensus.cc:515] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:10.426770 25226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58418 (request call id 1451) took 1157 ms. Trace:
I20260709 13:11:10.411324 25298 raft_consensus.cc:1240] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:11:10.427261 25226 rpcz_store.cc:276] 0709 13:11:09.269276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.269375 (+    99us) service_pool.cc:224] Handling call
0709 13:11:09.269632 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:09.748292 (+478660us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:10.426182 (+677890us) spinlock_profiling.cc:243] Waited 478 ms on lock 0x7b5400195d54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:10.426549 (+   367us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1099428224}
I20260709 13:11:10.389520 26832 consensus_queue.cc:237] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:10.414417 26860 raft_consensus.cc:515] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:10.416378 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:10.417070 26868 raft_consensus.cc:2749] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:11:10.418519 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 54677.8us
I20260709 13:11:10.419929 25224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58422 (request call id 1365) took 1132 ms. Trace:
I20260709 13:11:10.396797 26883 consensus_queue.cc:260] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:10.444046 25223 raft_consensus.cc:3060] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:10.447623 25297 raft_consensus.cc:1240] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:10.480602 26785 leader_election.cc:290] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:10.480896 25299 raft_consensus.cc:1275] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:11:10.481208 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:11:10.454741 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 254937us
I20260709 13:11:10.546592 25226 raft_consensus.cc:1240] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 2. Current term is 3. Ops: []
W20260709 13:11:10.498446 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 298666us
I20260709 13:11:10.502440 25299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57256 (request call id 1367) took 1107 ms. Trace:
W20260709 13:11:10.519025 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 227852us
I20260709 13:11:10.550530 25299 rpcz_store.cc:276] 0709 13:11:09.392076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:10.454770 (+1062694us) service_pool.cc:224] Handling call
0709 13:11:10.480248 (+ 25478us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:10.492763 (+ 12515us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:10.499311 (+  6548us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:10.547850 26883 raft_consensus.cc:3060] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:10.557351 26771 raft_consensus.cc:993] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468: : Instructing follower da445ce82dc4467f95f4fa52297eaa19 to start an election
I20260709 13:11:10.561838 25298 raft_consensus.cc:1240] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 3 LEADER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:10.562583 25872 leader_election.cc:304] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:11:10.563418 26786 consensus_queue.cc:260] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:10.565402 26786 raft_consensus.cc:3060] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:10.532680 25899 raft_consensus.cc:1240] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:10.534292 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:10.510456 26848 leader_election.cc:290] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:10.541134 25296 consensus_meta.cc:287] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.660s	user 0.017s	sys 0.003s
W20260709 13:11:10.547595 26817 consensus_meta.cc:287] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent flushing consensus metadata: real 0.669s	user 0.014s	sys 0.034s
I20260709 13:11:10.489148 25224 rpcz_store.cc:276] 0709 13:11:09.287477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.477570 (+190093us) service_pool.cc:224] Handling call
0709 13:11:10.419417 (+941847us) spinlock_profiling.cc:243] Waited 21.2 ms on lock 0x7b540025dad4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:10.419707 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":48789760}
I20260709 13:11:10.576473 26827 raft_consensus.cc:1081] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Signalling peer da445ce82dc4467f95f4fa52297eaa19 to start an election
I20260709 13:11:10.578452 26680 leader_election.cc:290] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:10.579125 26868 raft_consensus.cc:2804] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:10.579664 26868 raft_consensus.cc:493] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:10.579957 26704 raft_consensus.cc:3055] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:10.580127 26868 raft_consensus.cc:3060] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:10.580520 26704 raft_consensus.cc:740] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:10.582026 26795 raft_consensus.cc:515] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:10.583588 26767 leader_election.cc:290] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:10.584404 26795 leader_election.cc:290] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:10.567620 26772 leader_election.cc:290] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:10.591732 25229 raft_consensus.cc:2468] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 3.
I20260709 13:11:10.580022 26834 leader_election.cc:290] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:10.596977 25903 raft_consensus.cc:2468] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 3.
I20260709 13:11:10.600657 26850 raft_consensus.cc:493] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.601241 26850 raft_consensus.cc:515] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:10.604385 25270 leader_election.cc:304] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:10.606384 25223 raft_consensus.cc:2468] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 3.
I20260709 13:11:10.608146 26866 raft_consensus.cc:3055] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:10.608680 26866 raft_consensus.cc:740] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:10.611917 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:10.611548 26866 consensus_queue.cc:260] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:10.612334 25343 leader_election.cc:304] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:10.612975 25230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58422 (request call id 1362) took 1326 ms. Trace:
I20260709 13:11:10.613113 26866 raft_consensus.cc:3060] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:10.622399 25194 leader_election.cc:304] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:10.623268 25379 raft_consensus.cc:2468] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 4.
I20260709 13:11:10.626411 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:10.627249 25227 raft_consensus.cc:3060] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:10.627988 26767 raft_consensus.cc:2749] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:10.628857 26767 consensus_queue.cc:1048] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:10.613401 25230 rpcz_store.cc:276] 0709 13:11:09.286703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.341308 (+ 54605us) service_pool.cc:224] Handling call
0709 13:11:10.611553 (+1270245us) spinlock_profiling.cc:243] Waited 988 us on lock 0x7b5800002a98. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72cb4ab71 00007fd72cb4aa22 00007fd735a63c09 00007fd734bbdee0 00007fd734c870ab 00007fd734c87131 00007fd734c350a0 00007fd734c34984 00007fd72e1af6d4 00007fd72e1af662
0709 13:11:10.612883 (+  1330us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2272128}
I20260709 13:11:10.599586 26704 consensus_queue.cc:260] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:10.634610 26842 raft_consensus.cc:2749] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:10.635288 26704 raft_consensus.cc:3060] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:10.635490 25194 leader_election.cc:304] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:10.636592 26842 raft_consensus.cc:2804] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:10.636804 25194 leader_election.cc:304] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:10.637207 26842 raft_consensus.cc:697] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 2 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:10.638728 26772 raft_consensus.cc:2749] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:10.638597 26842 consensus_queue.cc:237] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:10.639138 26680 raft_consensus.cc:2749] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:11:10.639415 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 89268.8us
I20260709 13:11:10.642038 26834 consensus_queue.cc:1059] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:10.643430 26680 raft_consensus.cc:3055] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:10.643965 26680 raft_consensus.cc:740] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:10.644671 26794 raft_consensus.cc:515] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:10.657056 25302 raft_consensus.cc:1240] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 3 LEADER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:10.662163 25271 leader_election.cc:304] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:10.662264 25126 catalog_manager.cc:5697] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 1 to 2, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 2 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
I20260709 13:11:10.663192 26772 raft_consensus.cc:2749] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:10.663972 25271 leader_election.cc:304] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:10.664271 25126 catalog_manager.cc:5697] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 2 to 3, leader changed from 79d99c0e498349bda74127365219e468 (127.23.140.67) to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 3 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:10.665833 24113 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:10.666628 26827 consensus_queue.cc:1059] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:10.667655 26827 consensus_queue.cc:1243] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [LEADER]: Peer da445ce82dc4467f95f4fa52297eaa19 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:11:10.668349 26827 raft_consensus.cc:3055] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:10.668772 26827 raft_consensus.cc:740] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:10.579070 25296 raft_consensus.cc:2468] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 2.
I20260709 13:11:10.645206 26680 consensus_queue.cc:260] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:10.671942 26819 raft_consensus.cc:3055] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:10.648032 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:10.672403 26819 raft_consensus.cc:740] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:10.672814 25230 raft_consensus.cc:2468] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 3.
I20260709 13:11:10.652014 26574 leader_election.cc:290] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:10.652469 25304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57272 (request call id 1220) took 1288 ms. Trace:
I20260709 13:11:10.673652 26819 consensus_queue.cc:260] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:10.675685 25126 catalog_manager.cc:5697] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:10.677814 25370 raft_consensus.cc:2468] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 4.
I20260709 13:11:10.676469 26819 raft_consensus.cc:3060] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:10.674451 25304 rpcz_store.cc:276] 0709 13:11:09.364085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.364751 (+   666us) service_pool.cc:224] Handling call
0709 13:11:10.652026 (+1287275us) spinlock_profiling.cc:243] Waited 688 ms on lock 0x7b54000f8f54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:10.652257 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1582055296}
I20260709 13:11:10.627266 26860 leader_election.cc:290] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:10.681341 26794 leader_election.cc:290] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:10.683831 26850 leader_election.cc:290] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:11:10.684149 26815 consensus_meta.cc:287] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent flushing consensus metadata: real 0.503s	user 0.011s	sys 0.003s
W20260709 13:11:10.655776 26808 consensus_meta.cc:287] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.564s	user 0.004s	sys 0.009s
I20260709 13:11:10.653385 25227 raft_consensus.cc:2468] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 2.
I20260709 13:11:10.510764 26785 consensus_queue.cc:1059] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.085s
I20260709 13:11:10.674252 25128 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40034 (request call id 259) took 4984 ms. Trace:
I20260709 13:11:10.693044 26772 raft_consensus.cc:2804] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:11:10.669544 26836 consensus_meta.cc:287] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent flushing consensus metadata: real 0.967s	user 0.014s	sys 0.022s
W20260709 13:11:10.694621 25227 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58418 (request call id 1457) took 1406 ms (client timeout 1838 ms). Trace:
I20260709 13:11:10.701257 25377 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 2.
I20260709 13:11:10.595860 25376 consensus_queue.cc:260] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:10.685596 26849 leader_election.cc:290] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:10.701419 25227 rpcz_store.cc:269] 0709 13:11:09.288456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.338973 (+ 50517us) service_pool.cc:224] Handling call
0709 13:11:10.626051 (+1287078us) spinlock_profiling.cc:243] Waited 6.87 ms on lock 0x7b5800002a98. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72cb4ab71 00007fd72cb4aa22 00007fd735a63c09 00007fd734bbdee0 00007fd734c870ab 00007fd734c87131 00007fd734c350a0 00007fd734c34984 00007fd72e1af6d4 00007fd72e1af662
0709 13:11:10.694563 (+ 68512us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15791488}
I20260709 13:11:10.707469 25908 raft_consensus.cc:2468] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 3.
I20260709 13:11:10.674500 26827 consensus_queue.cc:260] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:10.721515 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:10.721738 26761 raft_consensus.cc:493] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.722548 26761 raft_consensus.cc:515] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:10.726882 25376 raft_consensus.cc:3060] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:10.701205 26808 raft_consensus.cc:515] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:11:10.732304 26808 leader_election.cc:290] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361)
I20260709 13:11:10.732733 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:10.734504 25228 raft_consensus.cc:1240] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:10.734333 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:10.735239 25222 raft_consensus.cc:2376] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 2. Re-sending same reply.
I20260709 13:11:10.735740 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:10.736853 25222 raft_consensus.cc:1275] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:10.736984 25224 raft_consensus.cc:1275] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:10.737408 25228 raft_consensus.cc:1275] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:10.707944 26772 raft_consensus.cc:697] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 4 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:10.738485 25230 raft_consensus.cc:1240] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:10.739298 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:10.740307 25229 raft_consensus.cc:1240] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:10.712154 25225 raft_consensus.cc:1240] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:10.688083 25126 catalog_manager.cc:5697] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 1 to 2, leader changed from 79d99c0e498349bda74127365219e468 (127.23.140.67) to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 2 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:10.712302 26680 raft_consensus.cc:3060] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:10.744539 25270 leader_election.cc:304] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:10.687508 26804 raft_consensus.cc:515] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:10.695880 26816 raft_consensus.cc:3060] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:10.725631 26761 leader_election.cc:290] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:10.770048 26808 raft_consensus.cc:2749] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:10.774629 25907 raft_consensus.cc:1240] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:10.778411 26553 leader_election.cc:290] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:10.780131 25226 raft_consensus.cc:1240] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:10.779808 26559 consensus_queue.cc:260] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:10.781960 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:10.782817 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:10.783543 25899 raft_consensus.cc:2376] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 3. Re-sending same reply.
W20260709 13:11:10.791635 25874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:10.794407 26827 raft_consensus.cc:3060] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:10.796882 26868 raft_consensus.cc:515] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:10.711760 26836 raft_consensus.cc:515] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:10.809482 25903 raft_consensus.cc:1275] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:10.810719 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:10.812217 25905 raft_consensus.cc:1240] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 3. Current term is 4. Ops: []
W20260709 13:11:10.816238 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:10.696637 25128 rpcz_store.cc:276] 0709 13:11:05.690202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:05.690403 (+   201us) service_pool.cc:224] Handling call
0709 13:11:10.674019 (+4983616us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:08.622060 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:08.633324 (+ 11264us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:08.633366 (+    42us) write_op.cc:435] Acquired schema lock
0709 13:11:08.633382 (+    16us) tablet.cc:662] Decoding operations
0709 13:11:08.633995 (+   613us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:08.634048 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:08.634072 (+    24us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:11:08.634398 (+   326us) tablet.cc:701] Row locks acquired
0709 13:11:08.634415 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:11:08.634569 (+   154us) write_op.cc:270] Start()
0709 13:11:08.634695 (+   126us) write_op.cc:276] Timestamp: P: 1783602668634524 usec, L: 0
0709 13:11:08.634718 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:11:08.635437 (+   719us) log.cc:844] Serialized 1433 byte log entry
0709 13:11:09.120936 (+485499us) op_driver.cc:464] REPLICATION: finished
0709 13:11:09.278857 (+157921us) write_op.cc:301] APPLY: starting
0709 13:11:09.285081 (+  6224us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:09.345051 (+ 59970us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:09.379014 (+ 33963us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:09.469131 (+ 90117us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:09.469306 (+   175us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:11:09.469355 (+    49us) write_op.cc:312] APPLY: finished
0709 13:11:09.469579 (+   224us) log.cc:844] Serialized 35 byte log entry
0709 13:11:09.469765 (+   186us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:09.469865 (+   100us) write_op.cc:454] Released schema lock
0709 13:11:09.469910 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:09.470228 (+   318us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:09.470260 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":17980,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":94426,"apply.run_cpu_time_us":2526,"apply.run_wall_time_us":242072,"num_ops":3,"prepare.queue_time_us":429169,"prepare.run_cpu_time_us":3372,"prepare.run_wall_time_us":13665,"replication_time_us":427679,"thread_start_us":362555,"threads_started":2}]]}
I20260709 13:11:10.781554 26559 raft_consensus.cc:3060] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:10.805712 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:10.826351 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:10.825893 25126 catalog_manager.cc:5697] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 1 to 2, leader changed from 79d99c0e498349bda74127365219e468 (127.23.140.67) to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 2 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:10.827867 25225 raft_consensus.cc:1275] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:10.827980 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:10.834183 25271 leader_election.cc:304] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:10.835162 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:10.836288 25900 raft_consensus.cc:1275] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:11:10.838765 25195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:10.838966 25901 raft_consensus.cc:2393] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 4: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:11:10.840435 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:10.841495 25899 raft_consensus.cc:2468] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 3.
W20260709 13:11:10.858085 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 155834us
W20260709 13:11:10.859786 25194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:10.864363 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:10.873080 25907 raft_consensus.cc:2468] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 2.
I20260709 13:11:10.865995 26772 consensus_queue.cc:237] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:10.869356 25226 raft_consensus.cc:1275] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:11:10.871142 26891 log.cc:927] Time spent T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.073s	user 0.002s	sys 0.000s
I20260709 13:11:10.871838 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:11:10.874758 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 50181.2us
W20260709 13:11:10.868206 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:10.876052 25376 raft_consensus.cc:1275] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:11:10.879307 25376 pending_rounds.cc:85] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468: Aborting all ops after (but not including) 2
I20260709 13:11:10.824188 26815 raft_consensus.cc:493] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.879706 25376 pending_rounds.cc:107] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:11:10.884164 25376 raft_consensus.cc:2889] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:10.878109 25126 catalog_manager.cc:5697] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce reported cstate change: config changed from index 2 to 3, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
W20260709 13:11:10.886431 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:10.887224 25345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:10.888195 25900 raft_consensus.cc:1240] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:10.884418 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:10.892346 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:10.894326 25905 raft_consensus.cc:2468] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 3.
I20260709 13:11:10.896731 26861 raft_consensus.cc:2804] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:10.897347 26861 raft_consensus.cc:493] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.897703 26861 raft_consensus.cc:3060] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:10.898252 25222 raft_consensus.cc:1275] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:10.885178 26761 consensus_queue.cc:1048] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:11:10.899592 25195 leader_election.cc:304] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: da445ce82dc4467f95f4fa52297eaa19
W20260709 13:11:10.896910 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:10.903180 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:10.903517 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:10.891381 26815 raft_consensus.cc:515] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:10.904568 26863 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:11:10.906999 25195 leader_election.cc:304] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:11:10.912711 26868 leader_election.cc:290] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:10.916833 26832 raft_consensus.cc:2804] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:10.917398 25222 raft_consensus.cc:1240] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 4 LEADER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:10.917862 25126 catalog_manager.cc:5697] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 1 to 2, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 2 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
I20260709 13:11:10.919080 26701 consensus_queue.cc:1059] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:11:10.920943 26701 raft_consensus.cc:3055] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:10.921348 26701 raft_consensus.cc:740] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:10.921586 25224 raft_consensus.cc:1275] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:10.922386 26701 consensus_queue.cc:260] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:10.923650 26701 raft_consensus.cc:3060] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:10.924211 26836 leader_election.cc:290] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:10.917361 26832 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.919821 25901 raft_consensus.cc:1275] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:11:10.913656 25344 leader_election.cc:304] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:10.928928 26816 consensus_queue.cc:1048] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:11:10.932232 26553 raft_consensus.cc:493] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.932859 26553 raft_consensus.cc:515] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:10.934002 26761 consensus_queue.cc:1048] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:10.934855 26615 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.935464 26615 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:10.937423 26815 leader_election.cc:290] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:10.937942 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:10.942456 26615 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:10.944666 26768 raft_consensus.cc:2749] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:10.945968 26553 leader_election.cc:290] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:10.926947 26832 raft_consensus.cc:3060] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:10.950055 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:10.943238 25873 leader_election.cc:304] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:10.962692 26814 consensus_queue.cc:1048] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:10.963178 25195 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:10.964888 25195 leader_election.cc:304] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:10.965929 26842 raft_consensus.cc:2749] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:10.966712 26842 raft_consensus.cc:2749] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:10.968091 25195 leader_election.cc:304] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:10.969062 25371 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 3.
W20260709 13:11:10.973021 25873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:10.977216 25873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:10.957501 26836 consensus_queue.cc:1059] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:11:10.974043 26804 leader_election.cc:290] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:10.979975 26772 consensus_queue.cc:1048] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:10.975329 25271 leader_election.cc:304] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:10.981771 26772 consensus_queue.cc:1048] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:11:10.982590 26892 log.cc:927] Time spent T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:11:10.982714 26839 raft_consensus.cc:3060] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:10.982755 25271 leader_election.cc:304] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
W20260709 13:11:10.969493 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 58603.4us
I20260709 13:11:10.979781 26836 raft_consensus.cc:3055] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:10.942095 26837 raft_consensus.cc:2804] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:10.992321 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:10.992825 25371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36264 (request call id 1164) took 1093 ms. Trace:
I20260709 13:11:10.992347 26819 consensus_queue.cc:1059] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:10.995371 26819 raft_consensus.cc:3055] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:10.995765 26819 raft_consensus.cc:740] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:10.997090 26819 consensus_queue.cc:260] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:10.998044 26786 raft_consensus.cc:493] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.998323 25225 raft_consensus.cc:1240] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:10.998739 26786 raft_consensus.cc:515] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:11.000063 25229 raft_consensus.cc:1240] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:11.001160 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:11.001901 26559 raft_consensus.cc:493] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.002849 25874 leader_election.cc:304] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:11:11.001928 25226 raft_consensus.cc:2468] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 3.
I20260709 13:11:11.004655 26862 raft_consensus.cc:2804] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:11.005092 26862 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:11.005309 25376 raft_consensus.cc:1240] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:11.005568 26862 raft_consensus.cc:3060] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:11.007138 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:11.007007 26825 consensus_queue.cc:1059] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:10.997560 26839 raft_consensus.cc:2749] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:11.008291 26825 raft_consensus.cc:3055] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:11.008723 26825 raft_consensus.cc:740] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:11.010250 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:11.010007 26825 consensus_queue.cc:260] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:11.011391 26825 raft_consensus.cc:3060] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:10.986863 26836 raft_consensus.cc:740] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:11.003031 26559 raft_consensus.cc:515] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:11.012108 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:10.993261 25371 rpcz_store.cc:276] 0709 13:11:09.899499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.899608 (+   109us) service_pool.cc:224] Handling call
0709 13:11:10.992591 (+1092983us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b540024cf54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:10.992751 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2457063168}
I20260709 13:11:11.000074 25379 raft_consensus.cc:1240] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:11:11.023124 26866 raft_consensus.cc:2804] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:11:11.024514 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 56501.7us
I20260709 13:11:11.025053 26866 raft_consensus.cc:697] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:11.025390 26768 consensus_queue.cc:1059] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:11.026427 25195 leader_election.cc:304] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:11.018213 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:11.027308 26680 raft_consensus.cc:2749] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:11.024561 26836 consensus_queue.cc:260] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:11.027479 25376 raft_consensus.cc:2393] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 2: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:11.016371 25222 raft_consensus.cc:1240] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:11.026103 26866 consensus_queue.cc:237] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:11.030877 26772 raft_consensus.cc:493] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:11.031018 25271 leader_election.cc:304] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:11.031723 26768 raft_consensus.cc:3055] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:11.032271 26768 raft_consensus.cc:740] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:11.031675 26772 raft_consensus.cc:515] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:11.033035 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:11.031039 26797 raft_consensus.cc:2804] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:11.034286 26797 raft_consensus.cc:493] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:11.034680 26797 raft_consensus.cc:3060] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:11.034734 26772 leader_election.cc:290] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:10.998512 26819 raft_consensus.cc:3060] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:11.036024 25271 leader_election.cc:304] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:11:11.037073 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:11:11.037333 25873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.036294 25344 leader_election.cc:304] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:11.001525 26786 leader_election.cc:290] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:11.019148 26839 raft_consensus.cc:2749] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:11.039572 26553 raft_consensus.cc:2749] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:11.015319 26837 raft_consensus.cc:493] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:11.041352 25195 leader_election.cc:304] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:11.039520 26704 consensus_queue.cc:1059] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:11:11.042869 25372 raft_consensus.cc:2410] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:11:11.044857 25270 leader_election.cc:304] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:11.035211 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:11.048622 25900 raft_consensus.cc:2468] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 3.
I20260709 13:11:11.052029 26836 raft_consensus.cc:3060] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:11.053267 25194 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.140.66:33127 timed out after 1.923s (SENT) [suppressed 35 similar messages]
I20260709 13:11:11.054004 26842 raft_consensus.cc:2749] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:11.055557 25195 leader_election.cc:304] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:11.055599 26559 leader_election.cc:290] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:11.056452 26842 raft_consensus.cc:2749] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:11.056913 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:11.059098 26704 raft_consensus.cc:2804] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:11.059445 26808 raft_consensus.cc:3055] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:11.059741 26704 raft_consensus.cc:697] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 2 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:11.059949 26808 raft_consensus.cc:740] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:11.060179 26796 raft_consensus.cc:2804] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:11.060606 26796 raft_consensus.cc:493] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:11.061038 26796 raft_consensus.cc:3060] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:11.060827 26704 consensus_queue.cc:237] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:11.061095 26808 consensus_queue.cc:260] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:11.062132 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:11.062292 26760 consensus_queue.cc:1059] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:11.062697 26763 consensus_queue.cc:1048] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:11.063161 25305 raft_consensus.cc:2468] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 3.
I20260709 13:11:11.063385 26615 raft_consensus.cc:3055] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:11.063838 26615 raft_consensus.cc:740] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:11.064254 26842 raft_consensus.cc:493] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:11.064862 26842 raft_consensus.cc:515] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:11.064886 26615 consensus_queue.cc:260] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:11:11.065797 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:11.066547 25304 raft_consensus.cc:3060] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:11.067135 26842 leader_election.cc:290] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:11.067229 25301 raft_consensus.cc:1275] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:11:11.067911 26808 raft_consensus.cc:3060] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:11.068074 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:11.068542 26615 raft_consensus.cc:3060] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:11.068681 25305 raft_consensus.cc:2468] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 3.
I20260709 13:11:11.072228 26837 raft_consensus.cc:3060] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:11.064875 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:11.073509 25195 leader_election.cc:304] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:11.074258 25300 raft_consensus.cc:3060] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:11.059156 25271 leader_election.cc:304] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
W20260709 13:11:11.075796 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 53513.1us
I20260709 13:11:11.078895 25345 leader_election.cc:304] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:11.090812 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:11.091725 25270 leader_election.cc:304] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:11.093799 25872 leader_election.cc:304] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:11.095148 26863 consensus_queue.cc:1059] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:11.095402 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:11.099227 25304 raft_consensus.cc:2468] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 4.
I20260709 13:11:11.033277 26768 consensus_queue.cc:260] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:11.091003 25344 leader_election.cc:304] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
W20260709 13:11:11.102701 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 49491.3us
I20260709 13:11:11.096323 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:11.104746 25872 leader_election.cc:304] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:11:11.107252 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 48222.3us
I20260709 13:11:11.078439 25223 raft_consensus.cc:2468] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 4.
I20260709 13:11:11.102169 26816 raft_consensus.cc:2804] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:11.099898 26863 raft_consensus.cc:3055] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:11.102537 26839 raft_consensus.cc:2749] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:11.103717 26804 raft_consensus.cc:2804] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:11.100148 26815 consensus_queue.cc:1048] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:11:11.105463 25296 raft_consensus.cc:2468] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 2.
I20260709 13:11:11.110383 26868 raft_consensus.cc:2804] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:11.113955 26786 raft_consensus.cc:2804] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:11.109941 26842 raft_consensus.cc:2804] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:11.109174 26559 raft_consensus.cc:2749] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:11:11.124866 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.115252 26886 raft_consensus.cc:2804] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:11.114244 26816 raft_consensus.cc:493] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:11.116487 26863 raft_consensus.cc:740] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:11.118218 26804 raft_consensus.cc:493] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:11.132422 26814 consensus_queue.cc:1059] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:11:11.132683 25114 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d56909a48cf841eb99365741e9e29e93 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 79d99c0e498349bda74127365219e468 (127.23.140.67:34091) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 79d99c0e498349bda74127365219e468 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:11:11.133523 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:11.134123 25301 raft_consensus.cc:2393] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 4: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
W20260709 13:11:11.141166 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 82422.1us
W20260709 13:11:11.142160 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.110587 26761 consensus_queue.cc:1048] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:11:11.134629 26868 raft_consensus.cc:697] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:11.146852 25872 leader_election.cc:304] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:11.129207 26768 raft_consensus.cc:3060] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:11.127979 26786 raft_consensus.cc:493] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
W20260709 13:11:11.144682 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 108588us
I20260709 13:11:11.120218 26848 consensus_queue.cc:1048] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:11:11.131026 26842 raft_consensus.cc:493] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:11.131808 26886 raft_consensus.cc:493] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:11.122704 26553 consensus_queue.cc:1048] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:11:11.140180 26816 raft_consensus.cc:3060] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:11.140113 26804 raft_consensus.cc:3060] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:11.170251 26828 raft_consensus.cc:493] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.171108 26828 raft_consensus.cc:515] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:11.177980 25305 raft_consensus.cc:2468] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 2.
I20260709 13:11:11.178097 26868 consensus_queue.cc:237] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:11.157318 26886 raft_consensus.cc:3060] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:11.206707 26822 raft_consensus.cc:3055] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:11.207353 26822 raft_consensus.cc:740] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:11.153581 26817 raft_consensus.cc:2804] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:11.208508 26817 raft_consensus.cc:493] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:11.209050 26817 raft_consensus.cc:3060] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:11.146606 25902 raft_consensus.cc:2468] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 4.
I20260709 13:11:11.156411 26842 raft_consensus.cc:3060] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:11.214350 26895 log.cc:927] Time spent T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 13:11:11.192391 26863 consensus_queue.cc:260] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:11.192914 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:11.154044 26786 raft_consensus.cc:3060] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:11.200017 25872 leader_election.cc:304] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:11.217792 25344 leader_election.cc:304] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:11.219664 25195 leader_election.cc:304] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
W20260709 13:11:11.231508 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 73090.4us
I20260709 13:11:11.235870 25300 raft_consensus.cc:2468] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 4.
I20260709 13:11:11.233060 26559 raft_consensus.cc:2804] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:11.193125 26832 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:11.232856 26863 raft_consensus.cc:3060] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:11.163293 26861 raft_consensus.cc:515] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:11.249503 26815 raft_consensus.cc:2804] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:11.261515 26559 raft_consensus.cc:493] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:11.258652 26852 raft_consensus.cc:2749] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:11:11.271458 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 107821us
I20260709 13:11:11.208765 26822 consensus_queue.cc:260] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:11.273301 26559 raft_consensus.cc:3060] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:11.261821 26553 consensus_queue.cc:1048] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:11:11.281226 26828 leader_election.cc:290] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:11.288909 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.261951 26839 consensus_queue.cc:1048] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:11:11.267843 26772 consensus_queue.cc:1048] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
W20260709 13:11:11.294380 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 66476.2us
W20260709 13:11:11.309103 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.269670 25296 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 3.
I20260709 13:11:11.295867 26763 consensus_queue.cc:1059] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:11:11.296348 26797 raft_consensus.cc:515] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:11.302636 26832 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:11.302820 26814 consensus_queue.cc:1048] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:11.311631 26852 raft_consensus.cc:493] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:11.312094 26846 consensus_queue.cc:1048] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
W20260709 13:11:11.320569 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.275939 26816 raft_consensus.cc:515] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:11.319759 26615 raft_consensus.cc:493] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:11.321024 25270 leader_election.cc:304] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:11.324224 26680 raft_consensus.cc:493] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.326146 26852 raft_consensus.cc:515] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:11.326524 26680 raft_consensus.cc:515] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:11.327929 26828 raft_consensus.cc:493] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:11.328469 26828 raft_consensus.cc:515] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:11.349885 25195 leader_election.cc:304] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:11:11.364542 26615 raft_consensus.cc:515] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:11.368134 26849 consensus_queue.cc:1059] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:11.364394 26832 raft_consensus.cc:2804] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:11.369407 26832 raft_consensus.cc:493] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:11.370003 25270 leader_election.cc:304] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:11.347520 26883 raft_consensus.cc:493] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.314386 26796 raft_consensus.cc:515] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:11.379503 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.347796 26763 raft_consensus.cc:2804] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:11.371178 25345 leader_election.cc:304] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:11.395355 26797 leader_election.cc:290] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:11.398335 26837 raft_consensus.cc:515] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:11.400488 26837 leader_election.cc:290] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:11.402290 26883 raft_consensus.cc:515] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:11:11.403702 26886 raft_consensus.cc:515] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:11.404430 26883 leader_election.cc:290] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:11.405009 26883 raft_consensus.cc:3055] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:11.404675 26842 raft_consensus.cc:515] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:11.405335 26883 raft_consensus.cc:740] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:11.381048 26862 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:11.406292 26886 leader_election.cc:290] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:11.406517 25871 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.407572 26862 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:11.408419 26886 raft_consensus.cc:2804] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:11:11.408607 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 46031.8us
I20260709 13:11:11.408826 26886 raft_consensus.cc:493] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:11.409210 26886 raft_consensus.cc:3060] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:11.409432 25345 leader_election.cc:304] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:11.410260 26768 raft_consensus.cc:2749] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:11.411386 25345 leader_election.cc:400] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 election: Vote denied by peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361) with higher term. Message: Invalid argument: T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 3. Current term is 4.
I20260709 13:11:11.411669 25345 leader_election.cc:403] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:11:11.412189 26768 raft_consensus.cc:2749] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361) with higher term. Message: Invalid argument: T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 3. Current term is 4.
I20260709 13:11:11.413654 26768 consensus_queue.cc:1048] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:11.414070 26797 raft_consensus.cc:493] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.414577 26797 raft_consensus.cc:515] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:11.415386 26828 leader_election.cc:290] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:11.416111 26822 raft_consensus.cc:3060] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:11.416527 26797 leader_election.cc:290] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:11.419091 26883 consensus_queue.cc:260] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:11.420506 26768 consensus_queue.cc:1059] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:11.421281 26701 consensus_queue.cc:1048] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:11.421738 26863 raft_consensus.cc:3055] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:11.421659 26827 consensus_queue.cc:1059] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:11.422297 26863 raft_consensus.cc:740] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:11.423506 26863 consensus_queue.cc:260] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:11.423882 26701 consensus_queue.cc:1059] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:11.424955 26863 raft_consensus.cc:3060] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:11.371996 26832 raft_consensus.cc:3060] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:11.433925 26772 raft_consensus.cc:2804] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:11.436064 26816 leader_election.cc:290] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:11.437991 26846 consensus_queue.cc:1048] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:11.420231 26886 raft_consensus.cc:515] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:11.442463 25901 raft_consensus.cc:2468] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 3.
I20260709 13:11:11.443190 26886 leader_election.cc:290] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:11.444157 26886 raft_consensus.cc:3055] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:11.444358 25907 raft_consensus.cc:2393] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 4: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:11:11.444625 26886 raft_consensus.cc:740] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:11.406111 25224 raft_consensus.cc:2468] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 3.
W20260709 13:11:11.457437 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 188352us
I20260709 13:11:11.456867 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:11:11.460115 25872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.465698 25872 leader_election.cc:304] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:11.449388 26772 raft_consensus.cc:697] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 4 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:11.453471 26763 raft_consensus.cc:697] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 4 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
W20260709 13:11:11.506925 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 145225us
I20260709 13:11:11.506067 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:11.499049 26862 raft_consensus.cc:2804] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:11.516739 25227 raft_consensus.cc:1240] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 2. Current term is 3. Ops: [2.3-2.3]
I20260709 13:11:11.516901 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:11.497587 26815 raft_consensus.cc:697] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:11.502197 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:11.522208 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:11.522262 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:11.523458 25228 raft_consensus.cc:3060] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:11.524996 25229 raft_consensus.cc:1275] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:11:11.512403 26797 consensus_queue.cc:1048] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:11:11.534442 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:11.525238 26862 raft_consensus.cc:697] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:11.538236 26772 consensus_queue.cc:237] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:11.538821 26862 consensus_queue.cc:237] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:11.539561 26817 raft_consensus.cc:515] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:11.542513 26559 raft_consensus.cc:515] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:11.544293 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.544724 26559 leader_election.cc:290] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:11.545019 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.544766 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:11.545680 26763 consensus_queue.cc:237] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:11.509393 26886 consensus_queue.cc:260] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:11.548030 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:11.550068 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:11.551084 25224 raft_consensus.cc:2393] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 2: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:11.544837 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:11.552042 25222 raft_consensus.cc:3060] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:11.555249 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:11.524613 26796 leader_election.cc:290] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:11.555891 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:11.527046 26804 raft_consensus.cc:515] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:11.556985 26852 leader_election.cc:290] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:11.558050 25873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.525350 25229 pending_rounds.cc:85] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce: Aborting all ops after (but not including) 4
I20260709 13:11:11.561993 25229 pending_rounds.cc:107] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce: Aborting uncommitted NO_OP operation due to leader change: 2.5
W20260709 13:11:11.562273 25195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.562289 25229 raft_consensus.cc:2889] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:11:11.563994 25271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.555962 25225 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 3.
W20260709 13:11:11.565120 25194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.565193 25906 raft_consensus.cc:2368] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 3. Current term is 4.
W20260709 13:11:11.566337 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 144306us
W20260709 13:11:11.571844 25271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.574584 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:11.575179 25300 raft_consensus.cc:3060] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:11.577366 25194 leader_election.cc:304] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:11.575575 26852 raft_consensus.cc:493] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.579654 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:11.579939 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:11.580295 25905 raft_consensus.cc:3060] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:11.580096 26852 raft_consensus.cc:515] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:11.580542 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:11.581075 25225 raft_consensus.cc:3060] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:11.580693 25298 raft_consensus.cc:2410] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 3 because replica has last-logged OpId of term: 2 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:11:11.579658 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:11.565964 26861 leader_election.cc:290] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:11.588600 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:11.586858 25345 leader_election.cc:304] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:11.590844 25298 raft_consensus.cc:1240] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:11:11.581105 26704 raft_consensus.cc:493] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:11.597000 26827 raft_consensus.cc:2804] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:11.587900 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:11.598819 25302 raft_consensus.cc:3060] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:11.598138 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:11.597636 26827 raft_consensus.cc:697] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 3 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:11.602628 26827 consensus_queue.cc:237] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:11.602727 26815 consensus_queue.cc:237] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:11.598073 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:11.605930 25299 raft_consensus.cc:2410] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 3 because replica has last-logged OpId of term: 2 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:11:11.612764 25194 leader_election.cc:304] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:11.611135 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:11.613440 25270 leader_election.cc:304] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:11.619997 25301 raft_consensus.cc:1240] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 4 LEADER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:11:11.621460 25228 raft_consensus.cc:2468] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 4.
W20260709 13:11:11.625481 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.628919 25228 raft_consensus.cc:1275] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:11.633862 25300 raft_consensus.cc:2468] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 4.
I20260709 13:11:11.634979 25370 raft_consensus.cc:1240] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:11.635319 25299 raft_consensus.cc:1240] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:11.638355 25379 raft_consensus.cc:1275] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:11:11.637640 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:11.641105 25872 leader_election.cc:304] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:11.638785 25379 pending_rounds.cc:85] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468: Aborting all ops after (but not including) 1
I20260709 13:11:11.642994 25379 pending_rounds.cc:107] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:11:11.643289 25379 raft_consensus.cc:2889] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:11.644893 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:11.645670 25229 raft_consensus.cc:2393] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 6: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:11.648229 25874 leader_election.cc:304] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:11.613842 26842 leader_election.cc:290] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:11.597000 26704 raft_consensus.cc:515] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:11.626005 26796 raft_consensus.cc:2804] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:11.651960 25345 leader_election.cc:304] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:11.628046 26817 leader_election.cc:290] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 3 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:11.625207 26849 raft_consensus.cc:2749] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:11.668934 25371 raft_consensus.cc:1275] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:11.660012 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:11.660982 25372 raft_consensus.cc:1275] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:11.661731 25345 leader_election.cc:304] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:11.662251 26863 raft_consensus.cc:2804] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:11.636224 26615 leader_election.cc:290] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:11.657506 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 55464us
I20260709 13:11:11.658564 25228 raft_consensus.cc:1275] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:11.673947 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:11.675952 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:11:11.679358 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.679598 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:11.681420 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:11.657871 26836 raft_consensus.cc:2804] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:11.687139 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:11.683631 25301 raft_consensus.cc:1240] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:11.685339 25300 raft_consensus.cc:1240] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:11.655304 26852 leader_election.cc:290] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:11.657472 26796 raft_consensus.cc:493] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:11.657829 26825 raft_consensus.cc:2804] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:11.636719 26832 raft_consensus.cc:515] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:11.692783 25372 raft_consensus.cc:2393] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 3: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:11.672549 26863 raft_consensus.cc:493] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:11.655048 26909 consensus_queue.cc:1048] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:11:11.701164 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:11.702616 25298 raft_consensus.cc:2468] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 2.
I20260709 13:11:11.680550 26559 raft_consensus.cc:2749] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:11.707684 25301 raft_consensus.cc:1240] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:11:11.708420 25225 raft_consensus.cc:2468] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 4.
I20260709 13:11:11.687295 26836 raft_consensus.cc:493] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:11.711079 25195 leader_election.cc:336] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 1.674s (SENT)
I20260709 13:11:11.691157 26796 raft_consensus.cc:3060] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:11.712339 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:11.710079 25225 raft_consensus.cc:1240] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:11:11.672216 26786 raft_consensus.cc:515] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:11.711633 25195 leader_election.cc:304] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:11.718894 25376 raft_consensus.cc:1240] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 2 LEADER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:11.718936 25299 raft_consensus.cc:1240] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:11:11.700250 26863 raft_consensus.cc:3060] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:11.700062 26825 raft_consensus.cc:697] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
W20260709 13:11:11.780273 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 57419.2us
I20260709 13:11:11.780858 25225 raft_consensus.cc:1240] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:11:11.713208 26836 raft_consensus.cc:3060] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:11.785296 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:11.786595 25298 raft_consensus.cc:1240] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 4 LEADER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 13:11:11.787034 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.787539 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:11.707370 26920 raft_consensus.cc:2749] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:11:11.795537 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 97300.5us
I20260709 13:11:11.798060 26916 raft_consensus.cc:2749] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:11.799603 25299 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2"
dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
 from {username='slave'} at 127.0.0.1:57256
I20260709 13:11:11.839123 25299 raft_consensus.cc:493] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:11.839555 25299 raft_consensus.cc:3060] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:11.803504 25222 raft_consensus.cc:2468] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 4.
I20260709 13:11:11.810943 25905 raft_consensus.cc:2468] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 5.
W20260709 13:11:11.837685 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.842427 25908 raft_consensus.cc:1240] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:11:11.842410 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:11.843904 25305 raft_consensus.cc:2393] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 6: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:11.845067 25345 leader_election.cc:304] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:11.723735 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:11.850235 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:11.845003 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:11:11.853194 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 44050.4us
I20260709 13:11:11.856344 26825 consensus_queue.cc:237] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:11.857007 26704 leader_election.cc:290] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:11.843842 25222 raft_consensus.cc:1275] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:11:11.867229 25301 raft_consensus.cc:1240] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:11:11.870249 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:11.873960 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:11:11.849574 25871 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:11.853929 26904 log.cc:927] Time spent T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:11:11.879133 25270 leader_election.cc:304] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:11.882881 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:11.884799 25305 raft_consensus.cc:2410] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 3 because replica has last-logged OpId of term: 2 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:11:11.888233 25270 leader_election.cc:304] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:11.891325 25370 raft_consensus.cc:1240] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:11.895042 25376 raft_consensus.cc:1240] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:11.886693 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:11.898644 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:11.892966 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:11.899214 25305 raft_consensus.cc:2376] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 2. Re-sending same reply.
I20260709 13:11:11.899683 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:11.901062 25370 raft_consensus.cc:3055] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:11.897507 25345 leader_election.cc:304] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:11.901415 25370 raft_consensus.cc:740] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:11.905876 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:11.904881 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
W20260709 13:11:11.917061 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 50447.2us
I20260709 13:11:11.909948 25373 raft_consensus.cc:2393] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 3: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:11.918404 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:11.920972 25376 raft_consensus.cc:2468] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 2.
I20260709 13:11:11.916663 25370 consensus_queue.cc:260] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:11.897524 26827 raft_consensus.cc:2804] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:11.920565 25270 leader_election.cc:304] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:11.924245 25305 raft_consensus.cc:1275] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:11.902305 26822 raft_consensus.cc:2749] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:11.907132 26615 raft_consensus.cc:2749] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:11.926721 25303 raft_consensus.cc:1275] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:11.896101 26553 consensus_queue.cc:1048] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:11:11.928874 25301 raft_consensus.cc:1240] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:11.931950 25300 raft_consensus.cc:1275] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:11:11.928514 26924 log.cc:927] Time spent T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.210s	user 0.000s	sys 0.001s
I20260709 13:11:11.940855 25302 raft_consensus.cc:2468] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 3.
I20260709 13:11:11.935048 25345 leader_election.cc:304] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:11.936463 26921 raft_consensus.cc:493] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.936853 26914 consensus_queue.cc:1048] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
W20260709 13:11:11.939224 26926 log.cc:927] Time spent T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.231s	user 0.000s	sys 0.000s
I20260709 13:11:11.939476 25299 raft_consensus.cc:515] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:11.949116 25370 raft_consensus.cc:3060] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:11.905318 26763 consensus_queue.cc:1048] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:11:11.951381 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:11.962085 25299 leader_election.cc:290] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:11.950008 26925 log.cc:927] Time spent T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.274s	user 0.001s	sys 0.000s
I20260709 13:11:11.936503 25221 raft_consensus.cc:1275] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:11.933866 26827 raft_consensus.cc:697] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 3 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:11.940253 26861 raft_consensus.cc:2749] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:11.952769 26559 raft_consensus.cc:2804] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:11:11.979815 25872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.984797 26944 raft_consensus.cc:493] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.985661 26944 raft_consensus.cc:515] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:11.988806 26944 leader_election.cc:290] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:11.990528 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:11.993335 25297 raft_consensus.cc:2468] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 3.
I20260709 13:11:11.994560 25270 leader_election.cc:304] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:11:11.995157 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 68482.2us
I20260709 13:11:11.964097 26922 raft_consensus.cc:2804] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:11.996943 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:11.934394 26923 consensus_queue.cc:1059] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.203s
I20260709 13:11:11.978372 26786 leader_election.cc:290] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:11.952966 26921 raft_consensus.cc:515] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:11.991621 25296 raft_consensus.cc:1240] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:11:11.994318 26916 raft_consensus.cc:493] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:12.019418 25370 raft_consensus.cc:1275] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:11:12.050541 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
W20260709 13:11:12.051000 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 56490.3us
I20260709 13:11:12.053658 25299 raft_consensus.cc:2368] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 3. Current term is 4.
W20260709 13:11:12.054270 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:12.053043 25370 pending_rounds.cc:85] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468: Aborting all ops after (but not including) 1
I20260709 13:11:12.056701 25370 pending_rounds.cc:107] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:11:12.057065 25370 raft_consensus.cc:2889] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:11.993880 26574 consensus_queue.cc:1059] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:11:11.997917 26761 consensus_queue.cc:1059] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:11:12.071702 26916 raft_consensus.cc:515] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:12.074045 26916 leader_election.cc:290] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:12.049153 26941 log.cc:927] Time spent T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:11:12.076211 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:12.077456 25299 raft_consensus.cc:2393] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 4: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:12.017590 26559 raft_consensus.cc:697] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 3 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:12.048502 26827 consensus_queue.cc:237] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:12.080704 26945 consensus_queue.cc:1059] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:12.081728 26945 raft_consensus.cc:3055] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:12.082072 26945 raft_consensus.cc:740] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:12.082893 26945 consensus_queue.cc:260] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:12.077499 26923 consensus_queue.cc:1059] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:12.083961 26945 raft_consensus.cc:3060] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:12.070678 26938 log.cc:927] Time spent T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 13:11:12.080369 26559 consensus_queue.cc:237] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:11:12.087143 26761 raft_consensus.cc:3055] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:12.087528 26761 raft_consensus.cc:740] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:12.088063 26836 raft_consensus.cc:515] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:12.088326 26761 consensus_queue.cc:260] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:12.090977 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:12.092300 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:12.092986 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:11:12.093773 26936 log.cc:927] Time spent T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:11:12.094211 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:12.079023 26921 leader_election.cc:290] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:12.080717 25345 leader_election.cc:304] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:12.100128 25298 raft_consensus.cc:2468] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 3.
I20260709 13:11:12.002328 26680 leader_election.cc:290] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:12.102041 25194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:12.102147 25223 raft_consensus.cc:1240] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 1. Current term is 2. Ops: []
W20260709 13:11:12.102804 26768 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:11:12.102860 25227 raft_consensus.cc:1240] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:12.126420 25194 leader_election.cc:304] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:12.126911 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:12.127331 25194 leader_election.cc:304] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:12.127748 25227 raft_consensus.cc:2393] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 2: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:12.128115 26842 raft_consensus.cc:2804] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:12.128646 26842 raft_consensus.cc:697] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 2 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:12.128854 26919 raft_consensus.cc:2749] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:12.129639 26842 consensus_queue.cc:237] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:12.103863 26836 leader_election.cc:290] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:12.103688 26796 raft_consensus.cc:515] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:12.105376 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:12.106360 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:12.106906 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:12.107362 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:12.107915 25224 raft_consensus.cc:1275] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:12.108201 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:12.108402 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:12.109064 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:12.089555 26761 raft_consensus.cc:3060] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:12.115900 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:12.116087 25343 leader_election.cc:304] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:12.116612 26923 raft_consensus.cc:3055] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:12.117136 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:12.143666 25299 raft_consensus.cc:2468] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 2.
I20260709 13:11:12.118257 25303 raft_consensus.cc:1240] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:12.119979 25271 leader_election.cc:304] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:12.123049 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:12.124866 26760 raft_consensus.cc:3055] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:12.016180 26553 raft_consensus.cc:2804] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:12.142632 25194 leader_election.cc:304] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:11:12.128132 26935 log.cc:927] Time spent T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.131s	user 0.002s	sys 0.000s
I20260709 13:11:12.146878 25271 leader_election.cc:304] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:12.148911 25225 raft_consensus.cc:2393] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 2: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:12.154836 25194 leader_election.cc:304] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:12.142495 25379 raft_consensus.cc:2468] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 2.
I20260709 13:11:12.159152 25271 leader_election.cc:304] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:12.160420 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:12.161782 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:12.162300 25194 leader_election.cc:400] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 election: Vote denied by peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127) with higher term. Message: Invalid argument: T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 3. Current term is 4.
I20260709 13:11:12.162659 25194 leader_election.cc:403] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:11:12.163275 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:12.147485 26786 raft_consensus.cc:2804] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:12.165591 25271 leader_election.cc:304] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:12.149807 26814 raft_consensus.cc:2749] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:12.146720 26923 raft_consensus.cc:740] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:12.166872 25271 leader_election.cc:304] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:12.177188 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:12.178175 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:12.179221 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:12.179744 25372 raft_consensus.cc:2393] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 2: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:12.180351 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:12.181075 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:12.182159 25372 raft_consensus.cc:1240] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:11:12.183422 25372 raft_consensus.cc:1240] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:11:12.161494 26950 raft_consensus.cc:3060] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:12.153492 26553 raft_consensus.cc:493] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:12.156414 26919 raft_consensus.cc:2749] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:12.148725 26760 raft_consensus.cc:740] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:12.187896 25271 leader_election.cc:304] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:12.161957 26701 raft_consensus.cc:2749] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:12.192471 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:12.169163 26922 raft_consensus.cc:697] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 2 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:12.165151 26852 raft_consensus.cc:2749] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:12.149989 26916 consensus_queue.cc:1059] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:11:12.190065 25372 raft_consensus.cc:1240] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 1. Current term is 2. Ops: []
W20260709 13:11:12.192041 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 137079us
I20260709 13:11:12.184988 25223 raft_consensus.cc:2393] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 2: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:12.193265 26836 raft_consensus.cc:493] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.184566 26861 consensus_queue.cc:1048] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:11:12.195336 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:12.195935 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:12.195696 26760 consensus_queue.cc:260] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:12.198359 26923 consensus_queue.cc:260] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:12.149627 26920 consensus_queue.cc:1048] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:11:12.200227 26827 consensus_queue.cc:1059] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:12.165304 26797 raft_consensus.cc:2749] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127) with higher term. Message: Invalid argument: T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 3. Current term is 4.
I20260709 13:11:12.167228 26763 raft_consensus.cc:2749] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:12.254037 26763 consensus_queue.cc:1059] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:12.254781 26763 consensus_queue.cc:1059] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:12.167346 26914 raft_consensus.cc:2749] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:12.256019 26914 raft_consensus.cc:493] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.256471 26914 raft_consensus.cc:515] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:12.158493 26680 consensus_queue.cc:1048] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:11:12.191767 26574 raft_consensus.cc:2749] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:12.204035 26814 raft_consensus.cc:2804] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:12.193991 26553 raft_consensus.cc:3060] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:12.263046 26863 raft_consensus.cc:515] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:12.265112 26863 leader_election.cc:290] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:12.244412 25377 raft_consensus.cc:1240] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:11:12.193886 26912 consensus_queue.cc:1048] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:11:12.266731 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:12.253043 26959 raft_consensus.cc:493] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.268098 26950 raft_consensus.cc:2749] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:12.268009 26959 raft_consensus.cc:515] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:12.268620 25873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:12.271831 26959 leader_election.cc:290] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:12.276413 25344 leader_election.cc:304] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
W20260709 13:11:12.277343 25114 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d56909a48cf841eb99365741e9e29e93 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 79d99c0e498349bda74127365219e468 (127.23.140.67:34091) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 79d99c0e498349bda74127365219e468 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:11:12.277981 26923 raft_consensus.cc:3060] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:12.278575 25343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:12.279170 25373 raft_consensus.cc:2468] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 2.
I20260709 13:11:12.249264 25379 raft_consensus.cc:3060] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:12.250960 25372 raft_consensus.cc:1240] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:12.282816 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:12.284109 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:12.284759 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:12.284880 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:12.285154 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:12.252928 26827 raft_consensus.cc:3055] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:12.285898 26827 raft_consensus.cc:740] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:12.285966 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:12.286629 25904 raft_consensus.cc:1240] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:12.287087 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:12.286832 26827 consensus_queue.cc:260] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:12.288079 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:12.288132 26827 raft_consensus.cc:3060] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:12.291586 26886 raft_consensus.cc:3060] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:12.296484 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:12.297111 25371 raft_consensus.cc:2468] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 3.
I20260709 13:11:12.297495 25229 raft_consensus.cc:1240] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:11:12.298061 25371 raft_consensus.cc:3055] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:12.298390 25371 raft_consensus.cc:740] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:12.299422 25229 raft_consensus.cc:1240] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:11:12.299153 25371 consensus_queue.cc:260] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:12.300041 25371 raft_consensus.cc:3060] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:12.300437 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:12.302666 26816 raft_consensus.cc:3055] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:12.302978 26883 raft_consensus.cc:3060] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:12.303052 26816 raft_consensus.cc:740] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:12.304430 26701 raft_consensus.cc:2804] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:12.304183 26816 consensus_queue.cc:260] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:12.304945 26701 raft_consensus.cc:697] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 5 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:12.305889 26701 consensus_queue.cc:237] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:12.306504 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:12.260352 26914 leader_election.cc:290] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:12.316727 26948 log.cc:927] Time spent T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.337s	user 0.005s	sys 0.000s
I20260709 13:11:12.319594 26832 leader_election.cc:290] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:12.319515 26553 raft_consensus.cc:515] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:12.248399 26836 raft_consensus.cc:515] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:12.324256 26836 leader_election.cc:290] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:12.202800 26768 consensus_queue.cc:1059] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 13:11:12.326438 26786 raft_consensus.cc:493] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:12.327071 26786 raft_consensus.cc:3060] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:12.333153 25195 leader_election.cc:400] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 election: Vote denied by peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085) with higher term. Message: Invalid argument: T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 3. Current term is 4.
I20260709 13:11:12.303006 26559 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.320714 25374 raft_consensus.cc:2468] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 2.
I20260709 13:11:12.338272 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:12.312747 25379 raft_consensus.cc:2468] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 3.
I20260709 13:11:12.308403 25375 raft_consensus.cc:2468] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 2.
W20260709 13:11:12.344056 25343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:12.352980 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:12.354039 26814 raft_consensus.cc:697] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 4 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:12.354974 26814 consensus_queue.cc:237] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:12.358333 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:12.358945 25224 raft_consensus.cc:3060] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:12.359460 25371 raft_consensus.cc:1275] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:12.361903 26957 raft_consensus.cc:493] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.362534 26957 raft_consensus.cc:515] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:12.363796 26944 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:11:12.369519 26760 raft_consensus.cc:3060] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:12.385249 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 182904us
I20260709 13:11:12.388206 25271 leader_election.cc:304] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:11:12.404861 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:12.337378 26559 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:12.326452 26768 raft_consensus.cc:3055] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:12.409319 25303 raft_consensus.cc:1275] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:11:12.417553 25230 raft_consensus.cc:2468] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 3.
I20260709 13:11:12.421264 26615 consensus_queue.cc:1048] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:12.423460 26863 consensus_queue.cc:1059] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:12.424335 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:12.424886 25299 raft_consensus.cc:3060] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:12.426777 26553 leader_election.cc:290] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:12.431810 26808 consensus_queue.cc:1059] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:12.432008 26559 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:12.432884 26808 consensus_queue.cc:1059] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:12.433904 26796 leader_election.cc:290] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:12.434511 26796 raft_consensus.cc:3055] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:12.434876 26796 raft_consensus.cc:740] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:12.437999 26796 consensus_queue.cc:260] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:12.439208 26796 raft_consensus.cc:3060] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:12.447635 25872 leader_election.cc:304] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:12.442430 25303 raft_consensus.cc:1275] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:12.373929 26832 consensus_queue.cc:1059] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.092s
I20260709 13:11:12.401916 26836 consensus_queue.cc:1048] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:11:12.457084 25379 raft_consensus.cc:1275] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:11:12.459978 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:12.460187 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:12.460665 26804 leader_election.cc:290] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:12.461498 25374 raft_consensus.cc:1275] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:12.461378 26956 consensus_queue.cc:1048] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:12.463760 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:12.468794 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:12.476733 26574 consensus_queue.cc:1048] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:12.477730 26945 raft_consensus.cc:3055] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:12.478189 26945 raft_consensus.cc:740] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:12.478418 26959 raft_consensus.cc:3055] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:12.478856 26959 raft_consensus.cc:740] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
W20260709 13:11:12.481341 25195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:12.420006 26950 raft_consensus.cc:2804] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:12.418346 26768 raft_consensus.cc:740] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:12.493633 25299 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 4.
I20260709 13:11:12.479705 26959 consensus_queue.cc:260] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:12.497848 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:12.498782 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:12.479060 26945 consensus_queue.cc:260] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:12.504499 26804 consensus_queue.cc:1048] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:12.516551 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:12.507673 26817 consensus_queue.cc:1048] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:12.467279 26910 raft_consensus.cc:2804] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:12.511602 25195 leader_election.cc:304] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:12.529071 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:12.680871 25379 raft_consensus.cc:2393] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 2: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:12.483073 26832 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:12.682958 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 236401us
I20260709 13:11:12.684092 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:12.684459 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:12.684654 25299 raft_consensus.cc:3060] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:12.685041 25230 raft_consensus.cc:2468] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 2.
W20260709 13:11:12.676759 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 173587us
I20260709 13:11:12.467470 26868 consensus_queue.cc:1048] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:11:12.686410 25303 raft_consensus.cc:1240] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:12.687888 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
W20260709 13:11:12.689214 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 177675us
I20260709 13:11:12.690289 25195 leader_election.cc:304] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:12.691710 25195 leader_election.cc:304] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:12.693298 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:12.530407 26815 raft_consensus.cc:493] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:12.529153 26950 raft_consensus.cc:697] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 4 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:12.694285 25298 raft_consensus.cc:2468] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 2.
I20260709 13:11:12.697263 25305 raft_consensus.cc:1240] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:12.693646 26832 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:12.900884 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:12.893170 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:12.689213 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:12.698563 26910 raft_consensus.cc:697] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:12.894462 26916 raft_consensus.cc:2749] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:12.533056 26922 consensus_queue.cc:237] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:12.893857 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:12.704869 26957 leader_election.cc:290] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:12.698643 26945 raft_consensus.cc:3060] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:12.769797 26768 consensus_queue.cc:260] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:11:12.696157 26959 raft_consensus.cc:3060] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:12.894699 26965 raft_consensus.cc:2749] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:12.909729 25195 leader_election.cc:304] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:12.911566 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:12.912444 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:12.911840 26950 consensus_queue.cc:237] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
W20260709 13:11:12.908488 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 222233us
W20260709 13:11:13.071461 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:12.899883 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:12.919948 25299 raft_consensus.cc:2468] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 3.
I20260709 13:11:12.921258 25378 raft_consensus.cc:2468] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 2.
I20260709 13:11:12.946636 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
W20260709 13:11:12.893664 26827 consensus_meta.cc:287] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.604s	user 0.000s	sys 0.010s
I20260709 13:11:12.964838 25373 raft_consensus.cc:1240] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:12.967684 25908 raft_consensus.cc:2468] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 3.
I20260709 13:11:12.896618 26883 raft_consensus.cc:2749] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:12.903602 25226 raft_consensus.cc:2468] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 4.
W20260709 13:11:12.947666 26796 consensus_meta.cc:287] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.505s	user 0.007s	sys 0.002s
W20260709 13:11:12.948112 26761 consensus_meta.cc:287] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.799s	user 0.011s	sys 0.011s
I20260709 13:11:12.922935 26804 raft_consensus.cc:493] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.051225 25374 raft_consensus.cc:2393] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 3: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:13.051684 26574 raft_consensus.cc:493] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:13.060027 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 150419us
I20260709 13:11:13.003866 25296 raft_consensus.cc:1240] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:13.039202 26914 raft_consensus.cc:493] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.066918 25222 raft_consensus.cc:2393] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 2: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:13.060459 26957 raft_consensus.cc:493] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:12.914716 26815 raft_consensus.cc:515] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:13.108106 25230 raft_consensus.cc:2393] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 2: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:13.126456 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:13.112789 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:12.960817 26861 raft_consensus.cc:3055] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:13.059669 26772 raft_consensus.cc:3055] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:13.132440 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:13.059268 26816 raft_consensus.cc:3060] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:13.125156 25297 raft_consensus.cc:1275] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:13.115494 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:13.142673 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:13.143533 25230 raft_consensus.cc:2410] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:11:13.146440 25304 raft_consensus.cc:2468] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 2.
I20260709 13:11:13.148485 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:13.149972 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:11:13.152971 26969 log.cc:927] Time spent T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:11:13.150629 25379 raft_consensus.cc:2468] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 2.
I20260709 13:11:13.119343 26919 raft_consensus.cc:2749] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:13.125686 26827 raft_consensus.cc:493] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.177583 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
W20260709 13:11:13.171137 25194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:13.173454 26886 consensus_meta.cc:287] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.881s	user 0.006s	sys 0.003s
W20260709 13:11:13.174688 26786 consensus_meta.cc:287] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.847s	user 0.010s	sys 0.005s
I20260709 13:11:13.134832 26772 raft_consensus.cc:740] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
W20260709 13:11:13.182714 25194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.138082 26861 raft_consensus.cc:740] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:13.119050 26804 raft_consensus.cc:515] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:13.125077 26912 consensus_queue.cc:1048] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 13:11:13.206879 26953 raft_consensus.cc:493] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:13.212570 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:13.207495 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:13.130820 26914 raft_consensus.cc:515] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:13.216619 26963 consensus_queue.cc:1048] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.105s
I20260709 13:11:13.215744 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:13.223255 25194 leader_election.cc:304] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:13.228907 25195 leader_election.cc:304] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:13.224532 25376 raft_consensus.cc:2468] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 3.
I20260709 13:11:13.130187 26574 raft_consensus.cc:515] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:13.142047 26957 raft_consensus.cc:515] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:13.240512 25300 raft_consensus.cc:2468] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 2.
I20260709 13:11:13.225435 26910 consensus_queue.cc:237] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:13.246769 25379 raft_consensus.cc:2468] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 2.
I20260709 13:11:13.247207 26957 leader_election.cc:290] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:13.246616 26772 consensus_queue.cc:260] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:13.228897 25374 raft_consensus.cc:2376] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 2. Re-sending same reply.
I20260709 13:11:13.247939 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:13.248031 26772 raft_consensus.cc:3060] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:13.248447 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:13.248934 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:13.249027 25374 raft_consensus.cc:2468] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 2.
I20260709 13:11:13.231606 26921 raft_consensus.cc:493] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.202641 26786 raft_consensus.cc:515] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:13.236776 26815 leader_election.cc:290] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:13.280617 25378 raft_consensus.cc:2468] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 2.
I20260709 13:11:13.255904 26914 leader_election.cc:290] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:13.263906 26574 leader_election.cc:290] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:13.237376 26953 raft_consensus.cc:515] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:13.266811 26832 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:13.252197 25224 consensus_meta.cc:287] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 0.893s	user 0.014s	sys 0.003s
I20260709 13:11:13.273973 26861 consensus_queue.cc:260] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:13.275384 26786 leader_election.cc:290] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:13.229826 26883 raft_consensus.cc:493] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:13.202190 26827 raft_consensus.cc:515] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:13.251092 26760 consensus_meta.cc:287] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.881s	user 0.008s	sys 0.008s
I20260709 13:11:13.250247 26921 raft_consensus.cc:515] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:13.337296 26827 leader_election.cc:290] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:13.339898 25370 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 3.
I20260709 13:11:13.282336 26842 raft_consensus.cc:2749] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:13.282858 25195 leader_election.cc:304] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:13.286259 25305 raft_consensus.cc:1275] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:11:13.288692 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 65374.3us
I20260709 13:11:13.299862 25298 raft_consensus.cc:1240] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:13.257553 26804 leader_election.cc:290] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:13.312880 25271 leader_election.cc:304] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:13.316726 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:13.349481 25299 raft_consensus.cc:2468] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 2.
I20260709 13:11:13.249517 25379 raft_consensus.cc:2468] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 2.
I20260709 13:11:13.286520 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:13.282402 26919 consensus_queue.cc:1059] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
W20260709 13:11:13.344337 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 61571.2us
I20260709 13:11:13.321635 26832 raft_consensus.cc:2804] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:13.360816 25303 raft_consensus.cc:2468] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 4.
I20260709 13:11:13.314461 25224 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 4.
I20260709 13:11:13.366631 26919 consensus_queue.cc:1059] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:13.369704 25195 leader_election.cc:304] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:13.368280 26953 leader_election.cc:290] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:13.300550 26965 consensus_queue.cc:1059] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 13:11:13.352505 26842 raft_consensus.cc:2749] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:13.354945 26760 raft_consensus.cc:2749] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:13.358415 26832 raft_consensus.cc:493] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.334259 26883 raft_consensus.cc:515] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:13.383693 25343 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.017s	sys 0.062s
W20260709 13:11:13.389441 25343 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.017s	sys 0.062s
I20260709 13:11:13.394531 25195 leader_election.cc:304] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
W20260709 13:11:13.395397 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 872501us
I20260709 13:11:13.396199 25195 leader_election.cc:304] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:11:13.411188 25344 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.737s	user 0.032s	sys 0.086s
W20260709 13:11:13.420742 25344 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.032s	sys 0.086s
W20260709 13:11:13.399447 25343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:13.424857 25343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.380256 25224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54000 (request call id 232) took 1038 ms. Trace:
I20260709 13:11:13.371066 26916 consensus_queue.cc:1048] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:11:13.387355 26832 raft_consensus.cc:3060] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:13.413784 26965 raft_consensus.cc:2749] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:13.410845 26827 raft_consensus.cc:493] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:13.412848 26953 raft_consensus.cc:493] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.420961 26919 raft_consensus.cc:493] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.393697 26842 raft_consensus.cc:493] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:13.397336 26959 consensus_queue.cc:1059] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.056s
W20260709 13:11:13.470160 25372 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.018s	sys 0.012s
W20260709 13:11:13.461962 25872 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.775s	user 0.018s	sys 0.011s
W20260709 13:11:13.473548 25872 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.787s	user 0.018s	sys 0.011s
W20260709 13:11:13.477133 25906 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.011s	user 0.050s	sys 0.096s
W20260709 13:11:13.477496 25906 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.011s	user 0.050s	sys 0.096s
W20260709 13:11:13.478470 25371 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.784s	user 0.012s	sys 0.018s
W20260709 13:11:13.478914 25371 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.784s	user 0.012s	sys 0.018s
W20260709 13:11:13.462512 25873 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.776s	user 0.002s	sys 0.035s
W20260709 13:11:13.494019 25873 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.808s	user 0.002s	sys 0.035s
W20260709 13:11:13.470504 25372 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.018s	sys 0.012s
I20260709 13:11:13.435983 25224 rpcz_store.cc:276] 0709 13:11:12.335308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.358051 (+ 22743us) service_pool.cc:224] Handling call
0709 13:11:13.373648 (+1015597us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:13.458810 26886 raft_consensus.cc:493] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.470867 26842 raft_consensus.cc:515] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:13.517257 26842 leader_election.cc:290] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:13.522847 26921 leader_election.cc:290] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:13.499953 26914 raft_consensus.cc:493] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.537357 25373 raft_consensus.cc:2410] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:11:13.479521 26559 raft_consensus.cc:493] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:13.545101 26559 raft_consensus.cc:515] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:13.522336 26842 raft_consensus.cc:2749] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:13.542683 26883 leader_election.cc:290] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:13.546919 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:13.500834 26953 raft_consensus.cc:515] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:13.547780 25224 raft_consensus.cc:2468] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 3.
I20260709 13:11:13.549156 26953 leader_election.cc:290] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:13.464200 26827 raft_consensus.cc:515] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:13.551402 26827 leader_election.cc:290] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:13.469156 26919 raft_consensus.cc:515] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:13.553145 26909 raft_consensus.cc:493] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.553375 26919 leader_election.cc:290] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:13.521366 26786 raft_consensus.cc:493] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.553670 26909 raft_consensus.cc:515] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:13.554157 26786 raft_consensus.cc:515] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:13.555316 25377 raft_consensus.cc:1275] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:13.555804 26909 leader_election.cc:290] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:13.556661 26786 leader_election.cc:290] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:13.511337 26965 raft_consensus.cc:2749] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:13.521868 26886 raft_consensus.cc:515] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:13.557457 25194 leader_election.cc:304] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:13.559017 26886 leader_election.cc:290] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:13.559214 26965 raft_consensus.cc:2804] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:13.559666 26965 raft_consensus.cc:493] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.560117 26965 raft_consensus.cc:3060] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:13.560544 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:13.549062 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:13.561506 25904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50056 (request call id 392) took 1070 ms. Trace:
I20260709 13:11:13.562043 25224 raft_consensus.cc:2468] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 2.
I20260709 13:11:13.561995 25904 rpcz_store.cc:276] 0709 13:11:12.491257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.498741 (+  7484us) service_pool.cc:224] Handling call
0709 13:11:13.560432 (+1061691us) spinlock_profiling.cc:243] Waited 36.7 ms on lock 0x7b58001a3198. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72cb4af8c 00007fd72cb4aef6 0000000000375939 00007fd734bbe1e0 00007fd734c870c4 00007fd734c87131 00007fd734c350a0 00007fd734c34984 00007fd72e1af6d4 00007fd72e1af662
0709 13:11:13.561416 (+   984us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":84500736}
W20260709 13:11:13.542218 25226 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54000 (request call id 220) took 2034 ms (client timeout 1838 ms). Trace:
W20260709 13:11:13.554445 25376 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36264 (request call id 1176) took 1447 ms (client timeout 1882 ms). Trace:
W20260709 13:11:13.565629 25226 rpcz_store.cc:269] 0709 13:11:11.508736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:11.508896 (+   160us) service_pool.cc:224] Handling call
0709 13:11:13.542044 (+2033148us) spinlock_profiling.cc:243] Waited 993 ms on lock 0x7b540025dfd4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:13.542151 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2284119808}
I20260709 13:11:13.545629 26914 raft_consensus.cc:515] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:13.566195 25376 rpcz_store.cc:269] 0709 13:11:12.107001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.107118 (+   117us) service_pool.cc:224] Handling call
0709 13:11:13.554233 (+1447115us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54001b53d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:13.554374 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2451898752}
I20260709 13:11:13.571595 25377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36264 (request call id 1196) took 1380 ms. Trace:
I20260709 13:11:13.563805 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:13.574219 25376 raft_consensus.cc:1275] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:13.572011 25377 rpcz_store.cc:276] 0709 13:11:12.187509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.267598 (+ 80089us) service_pool.cc:224] Handling call
0709 13:11:13.554903 (+1287305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:13.555733 (+   830us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:13.557635 (+  1902us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b54001b53d0. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6e8ad 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:13.568106 (+ 10471us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2959817472}
I20260709 13:11:13.576335 26852 raft_consensus.cc:3055] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:13.576742 26852 raft_consensus.cc:740] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:13.577395 26914 leader_election.cc:290] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:13.577664 26852 consensus_queue.cc:260] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:13.581159 25376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56308 (request call id 186) took 1042 ms. Trace:
I20260709 13:11:13.581918 25376 rpcz_store.cc:276] 0709 13:11:12.533174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:13.573419 (+1040245us) service_pool.cc:224] Handling call
0709 13:11:13.573821 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:13.575194 (+  1373us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:13.575447 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:13.584827 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:13.585354 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:13.585892 25298 raft_consensus.cc:2376] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 79d99c0e498349bda74127365219e468 in term 3. Re-sending same reply.
I20260709 13:11:13.588413 25271 leader_election.cc:304] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:13.589679 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:13.590215 25376 raft_consensus.cc:1275] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:13.590377 25299 raft_consensus.cc:2393] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 4: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:11:13.591537 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:13.592052 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:13.592682 25298 raft_consensus.cc:2468] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 2.
I20260709 13:11:13.591565 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:13.592146 25305 raft_consensus.cc:2376] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 3. Re-sending same reply.
I20260709 13:11:13.594750 25377 raft_consensus.cc:1275] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:11:13.596618 26816 raft_consensus.cc:493] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.597107 26816 raft_consensus.cc:515] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:13.597632 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:13.599100 26816 leader_election.cc:290] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:13.600054 25370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56308 (request call id 183) took 1067 ms. Trace:
I20260709 13:11:13.590047 26814 raft_consensus.cc:493] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.600610 25370 rpcz_store.cc:276] 0709 13:11:12.532236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:13.105653 (+573417us) service_pool.cc:224] Handling call
0709 13:11:13.599903 (+494250us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b540024cf54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:13.600002 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":489012480}
I20260709 13:11:13.600958 26814 raft_consensus.cc:515] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:13.601528 26965 raft_consensus.cc:515] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:13.603029 26814 leader_election.cc:290] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:13.604593 25376 raft_consensus.cc:1240] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:13.600040 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:13.520977 26922 raft_consensus.cc:493] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
W20260709 13:11:13.607475 25228 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.027s	sys 0.040s
I20260709 13:11:13.599138 25373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56308 (request call id 185) took 1066 ms. Trace:
I20260709 13:11:13.607986 25373 rpcz_store.cc:276] 0709 13:11:12.532873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:13.110158 (+577285us) service_pool.cc:224] Handling call
0709 13:11:13.598959 (+488801us) spinlock_profiling.cc:243] Waited 400 ms on lock 0x7b540009ced4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:13.599085 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":919715072}
I20260709 13:11:13.589498 26852 raft_consensus.cc:3060] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:13.609026 26553 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.118s	user 0.009s	sys 0.016s
I20260709 13:11:13.595486 25377 pending_rounds.cc:85] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468: Aborting all ops after (but not including) 4
I20260709 13:11:13.613294 25377 pending_rounds.cc:107] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:11:13.613690 25377 raft_consensus.cc:2889] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:13.614053 25194 leader_election.cc:304] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:13.615105 25194 leader_election.cc:304] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:11:13.616222 25271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:13.607864 25228 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.027s	sys 0.040s
I20260709 13:11:13.623003 26919 raft_consensus.cc:2804] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:11:13.619000 26704 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.722s	user 0.004s	sys 0.029s
W20260709 13:11:13.633133 26704 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.005s	sys 0.029s
I20260709 13:11:13.633890 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:13.634640 25302 raft_consensus.cc:3060] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:13.619122 26553 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.123s	user 0.009s	sys 0.016s
W20260709 13:11:13.622879 25342 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.938s	user 0.007s	sys 0.020s
I20260709 13:11:13.623523 26816 raft_consensus.cc:2804] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:11:13.641601 25342 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.957s	user 0.007s	sys 0.020s
W20260709 13:11:13.640874 25223 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.021s	sys 0.048s
W20260709 13:11:13.643137 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:13.638548 25375 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.148s	user 0.003s	sys 0.028s
W20260709 13:11:13.648164 25375 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.157s	user 0.003s	sys 0.028s
I20260709 13:11:13.625174 26919 raft_consensus.cc:493] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.625398 26804 raft_consensus.cc:493] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.609159 26922 raft_consensus.cc:515] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:13.650173 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.637880 26883 raft_consensus.cc:2804] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:11:13.638974 26849 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.776s	user 0.001s	sys 0.019s
I20260709 13:11:13.637589 26761 raft_consensus.cc:493] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:13.648398 25223 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.022s	sys 0.048s
I20260709 13:11:13.656172 26923 raft_consensus.cc:493] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
W20260709 13:11:13.672906 25229 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.012s	sys 0.010s
I20260709 13:11:13.648557 26965 leader_election.cc:290] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:13.656684 26919 raft_consensus.cc:3060] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:13.673458 25229 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.013s	sys 0.010s
W20260709 13:11:13.670447 26849 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.881s	user 0.002s	sys 0.020s
I20260709 13:11:13.673542 25302 raft_consensus.cc:2468] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 3.
I20260709 13:11:13.663527 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:13.647099 26816 raft_consensus.cc:493] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.690310 25194 leader_election.cc:304] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:13.671722 26977 raft_consensus.cc:493] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:13.675843 25221 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.012s	sys 0.032s
I20260709 13:11:13.691282 26965 raft_consensus.cc:3055] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:13.672080 26883 raft_consensus.cc:697] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 3 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
W20260709 13:11:13.700340 25227 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.671s	user 0.001s	sys 0.024s
W20260709 13:11:13.708232 25227 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.741s	user 0.001s	sys 0.025s
W20260709 13:11:13.735662 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.664413 26804 raft_consensus.cc:515] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:13.671965 26761 raft_consensus.cc:515] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:13.698065 26816 raft_consensus.cc:3060] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:13.672577 26923 raft_consensus.cc:515] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:13.703524 25221 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.012s	sys 0.032s
I20260709 13:11:13.744784 26849 raft_consensus.cc:493] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:13.705309 25224 raft_consensus.cc:2468] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 3.
W20260709 13:11:13.700677 26615 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.786s	user 0.012s	sys 0.013s
I20260709 13:11:13.704273 26842 raft_consensus.cc:2804] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:13.705078 26965 raft_consensus.cc:740] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:13.707427 26977 raft_consensus.cc:515] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:13.783604 26842 raft_consensus.cc:697] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 3 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:13.786350 25271 leader_election.cc:304] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:11:13.780457 26615 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.866s	user 0.013s	sys 0.014s
I20260709 13:11:13.789496 26914 raft_consensus.cc:2804] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:13.792582 26914 raft_consensus.cc:493] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.792305 26842 consensus_queue.cc:237] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:13.793012 26914 raft_consensus.cc:3060] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:13.785657 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:13.787653 25221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54000 (request call id 231) took 1452 ms. Trace:
W20260709 13:11:13.818744 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.778069 26849 raft_consensus.cc:515] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:13.834600 25270 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.718s	user 0.014s	sys 0.027s
W20260709 13:11:13.836496 25230 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.021s	sys 0.030s
W20260709 13:11:13.838398 25230 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.021s	sys 0.030s
W20260709 13:11:13.833036 25222 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.017s	sys 0.025s
W20260709 13:11:13.847473 25270 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.014s	sys 0.027s
I20260709 13:11:13.791700 26883 consensus_queue.cc:237] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:13.833343 26922 leader_election.cc:290] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:13.849386 26916 raft_consensus.cc:493] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:13.848471 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 742815us
W20260709 13:11:13.856562 26992 log.cc:927] Time spent T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:11:13.823468 26965 consensus_queue.cc:260] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:13.866844 25345 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.863s	user 0.018s	sys 0.042s
W20260709 13:11:13.867611 25345 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.864s	user 0.018s	sys 0.042s
W20260709 13:11:13.869506 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 473376us
I20260709 13:11:13.855860 25270 leader_election.cc:304] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:13.871451 25195 leader_election.cc:304] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
W20260709 13:11:13.850795 25222 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.017s	sys 0.025s
W20260709 13:11:13.867133 26971 log.cc:927] Time spent T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.412s	user 0.000s	sys 0.005s
I20260709 13:11:13.892262 25195 leader_election.cc:304] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:13.874969 25270 leader_election.cc:304] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
W20260709 13:11:13.898250 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:13.902315 26910 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.010s	sys 0.014s
I20260709 13:11:13.872555 26923 leader_election.cc:290] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:13.898685 25378 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.008s	sys 0.015s
W20260709 13:11:13.933610 25378 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.009s	sys 0.015s
I20260709 13:11:13.875327 26922 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
W20260709 13:11:13.934753 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.934762 25372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36254 (request call id 1554) took 1477 ms. Trace:
I20260709 13:11:13.938925 26922 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:13.877071 26808 raft_consensus.cc:2749] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:13.877923 26965 raft_consensus.cc:3060] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:13.882099 26761 leader_election.cc:290] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:13.930262 26910 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.010s	sys 0.015s
I20260709 13:11:13.858405 26916 raft_consensus.cc:515] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:13.928369 26615 raft_consensus.cc:2749] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:13.928648 26704 raft_consensus.cc:493] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:13.907760 26980 consensus_queue.cc:1048] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:11:13.934605 26849 leader_election.cc:290] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:13.928800 25270 leader_election.cc:304] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:13.940176 26768 raft_consensus.cc:3060] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:13.934898 25224 raft_consensus.cc:1275] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:11:13.938117 26981 log.cc:927] Time spent T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
I20260709 13:11:13.939491 25372 rpcz_store.cc:276] 0709 13:11:12.457179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.458017 (+   838us) service_pool.cc:224] Handling call
0709 13:11:12.460273 (+  2256us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:12.497066 (+ 36793us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:12.497100 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:12.528776 (+ 31676us) log.cc:844] Serialized 26 byte log entry
0709 13:11:13.498131 (+969355us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:11:13.498187 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:13.498287 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:13.543712 (+ 45425us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b4800280158. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd734b98aa1 00007fd734b8fb37 00007fd734b8f9ca 00007fd734c8726f 00007fd734c86f37 00007fd734c9b55c 00007fd734c9b508 00007fd734c9b488 00007fd734c9b443 00007fd734c9a6ec 00007fd733bc4a96
0709 13:11:13.933992 (+390280us) raft_consensus.cc:1685] finished
0709 13:11:13.934022 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:13.934699 (+   677us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36440,"raft.queue_time_us":36935,"raft.run_cpu_time_us":11606,"raft.run_wall_time_us":1033533,"spinlock_wait_cycles":373257088,"thread_start_us":588723,"threads_started":1,"wal-append.queue_time_us":1014654}
W20260709 13:11:13.940829 26701 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.006s	sys 0.034s
W20260709 13:11:13.954924 25345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:13.956543 25297 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.009s	sys 0.025s
I20260709 13:11:13.891095 26979 consensus_queue.cc:1048] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:11:13.933036 26804 leader_election.cc:290] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:13.950006 26995 log.cc:927] Time spent T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:11:13.933805 26989 raft_consensus.cc:493] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:13.946801 26983 raft_consensus.cc:493] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:13.936081 26832 raft_consensus.cc:515] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:13.970624 25297 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.009s	sys 0.026s
I20260709 13:11:13.938939 26914 raft_consensus.cc:515] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:13.977521 25343 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.014s	sys 0.013s
I20260709 13:11:13.963416 26615 raft_consensus.cc:2764] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
W20260709 13:11:13.969887 26701 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.007s	sys 0.034s
I20260709 13:11:14.007941 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:14.025424 25376 raft_consensus.cc:2468] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 4.
I20260709 13:11:14.025777 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:13.967623 26849 raft_consensus.cc:2804] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:11:14.022289 25114 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d56909a48cf841eb99365741e9e29e93 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 79d99c0e498349bda74127365219e468 (127.23.140.67:34091) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 79d99c0e498349bda74127365219e468 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:11:14.016816 25345 leader_election.cc:304] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:14.030010 26849 raft_consensus.cc:493] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:14.030453 26849 raft_consensus.cc:3060] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:14.031213 26914 leader_election.cc:290] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:14.032537 26863 raft_consensus.cc:2749] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:13.963232 26704 raft_consensus.cc:515] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:13.970409 26910 raft_consensus.cc:493] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
W20260709 13:11:14.020330 25343 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.015s	sys 0.013s
W20260709 13:11:14.048018 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 603720us
I20260709 13:11:14.048858 25343 leader_election.cc:304] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:14.020548 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:13.971259 26921 raft_consensus.cc:493] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.053742 26923 raft_consensus.cc:2804] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:14.054216 26923 raft_consensus.cc:493] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:14.053999 26921 raft_consensus.cc:515] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:14.054648 26923 raft_consensus.cc:3060] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:14.055145 25371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36254 (request call id 1549) took 1599 ms. Trace:
I20260709 13:11:14.056231 26921 leader_election.cc:290] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:14.055522 25371 rpcz_store.cc:276] 0709 13:11:12.455741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.455902 (+   161us) service_pool.cc:224] Handling call
0709 13:11:12.456350 (+   448us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:12.491228 (+ 34878us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:12.491256 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:12.491617 (+   361us) log.cc:844] Serialized 26 byte log entry
0709 13:11:13.479352 (+987735us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:11:13.479395 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:13.479482 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:14.054948 (+575466us) raft_consensus.cc:1685] finished
0709 13:11:14.054967 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:14.055090 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34454,"raft.queue_time_us":40205,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":39246,"thread_start_us":784634,"threads_started":1,"wal-append.queue_time_us":1169708}
I20260709 13:11:14.057971 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:14.058470 26861 raft_consensus.cc:3060] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:14.059003 26814 raft_consensus.cc:493] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.059227 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:14.059535 26814 raft_consensus.cc:515] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:11:14.060714 27001 consensus_queue.cc:1048] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:14.061709 26814 leader_election.cc:290] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:14.062124 26964 raft_consensus.cc:493] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:14.062789 26814 raft_consensus.cc:493] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.062880 26964 raft_consensus.cc:515] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:14.063328 26982 log.cc:927] Time spent T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:11:14.063390 26814 raft_consensus.cc:515] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:14.064755 25230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1427) took 1135 ms. Trace:
I20260709 13:11:14.061934 26973 raft_consensus.cc:493] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.065609 25375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36254 (request call id 1550) took 1609 ms. Trace:
I20260709 13:11:14.065981 26973 raft_consensus.cc:515] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:14.065166 25230 rpcz_store.cc:276] 0709 13:11:12.930236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:13.164768 (+234532us) service_pool.cc:224] Handling call
0709 13:11:13.165162 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:13.203147 (+ 37985us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:13.203175 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:13.208815 (+  5640us) log.cc:844] Serialized 26 byte log entry
0709 13:11:13.839991 (+631176us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:11:13.840068 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:13.840171 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:14.064556 (+224385us) raft_consensus.cc:1685] finished
0709 13:11:14.064576 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:14.064702 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15211,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":9664,"thread_start_us":611590,"threads_started":1,"wal-append.queue_time_us":833734}
I20260709 13:11:14.066064 25375 rpcz_store.cc:276] 0709 13:11:12.456099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.456205 (+   106us) service_pool.cc:224] Handling call
0709 13:11:12.466433 (+ 10228us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:12.490165 (+ 23732us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:12.490195 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:12.490627 (+   432us) log.cc:844] Serialized 26 byte log entry
0709 13:11:13.546131 (+1055504us) spinlock_profiling.cc:243] Waited 18.5 ms on lock 0x7b4800280158. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd734b98aa1 00007fd734b8fb37 00007fd734b8f9ca 00007fd734c8726f 00007fd734c86f37 00007fd734c9b55c 00007fd734c9b508 00007fd734c9b488 00007fd734c9b443 00007fd734c9a6ec 00007fd733bc4a96
0709 13:11:13.655339 (+109208us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:13.655396 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:13.655489 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:14.062764 (+407275us) spinlock_profiling.cc:243] Waited 7.36 ms on lock 0x7b4400022b4c. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72caa8c85 00007fd72caa96a2 00007fd72f81b1db 00007fd72f816aaf 00007fd72f80a86e 00007fd72f809bb6 00007fd72f8097d8 00007fd72f813221 00007fd72f8131d9 00007fd72f813169
0709 13:11:14.065418 (+  2654us) raft_consensus.cc:1685] finished
0709 13:11:14.065443 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:14.065558 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8522,"raft.run_cpu_time_us":24407,"raft.run_wall_time_us":1048648,"spinlock_wait_cycles":59388672,"thread_start_us":1164297,"threads_started":1,"wal-append.queue_time_us":1456716}
I20260709 13:11:14.062076 26990 raft_consensus.cc:493] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:14.068284 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:14.068181 26990 raft_consensus.cc:515] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:14.069638 26704 leader_election.cc:290] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:14.070552 25270 leader_election.cc:304] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:11:14.070852 26832 leader_election.cc:290] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:14.070994 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:14.071547 26832 raft_consensus.cc:493] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.072032 26832 raft_consensus.cc:515] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:14.072610 26559 leader_election.cc:290] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:14.071686 25230 raft_consensus.cc:2468] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 2.
I20260709 13:11:14.075132 25300 raft_consensus.cc:1240] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
W20260709 13:11:14.077997 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 61252.6us
I20260709 13:11:14.080500 25345 leader_election.cc:304] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:11:14.085569 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.972590 26977 leader_election.cc:290] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:14.006387 26827 raft_consensus.cc:493] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.006470 26786 raft_consensus.cc:493] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.996210 26987 raft_consensus.cc:2749] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:14.117586 25228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1421) took 1219 ms. Trace:
I20260709 13:11:14.110599 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:13.823065 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:14.118139 25228 rpcz_store.cc:276] 0709 13:11:12.898206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.898337 (+   131us) service_pool.cc:224] Handling call
0709 13:11:12.898615 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:12.898961 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:12.898987 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:12.946599 (+ 47612us) log.cc:844] Serialized 26 byte log entry
0709 13:11:13.617704 (+671105us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:11:13.617768 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:13.617854 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:14.117292 (+499438us) raft_consensus.cc:1685] finished
0709 13:11:14.117330 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:14.117512 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23817,"raft.queue_time_us":15829,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":41510,"thread_start_us":555347,"threads_started":1,"wal-append.queue_time_us":827077}
I20260709 13:11:14.040575 26804 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:14.017499 25906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50058 (request call id 474) took 1545 ms. Trace:
I20260709 13:11:14.047456 26910 raft_consensus.cc:515] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:14.051723 26615 raft_consensus.cc:493] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.053093 25343 leader_election.cc:304] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:14.075654 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:14.107510 25345 leader_election.cc:304] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:14.158564 25230 raft_consensus.cc:2393] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 4: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:11:14.141682 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:11:14.039582 25379 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.011s	sys 0.023s
W20260709 13:11:14.160152 25379 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.780s	user 0.011s	sys 0.023s
I20260709 13:11:14.074146 26808 raft_consensus.cc:2804] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:11:14.161177 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 108137us
I20260709 13:11:14.161373 25228 raft_consensus.cc:2393] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 3: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:14.162443 25343 leader_election.cc:304] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:14.163120 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:14.116688 26916 leader_election.cc:290] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:14.112128 26921 raft_consensus.cc:2749] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:14.164644 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:14.164788 25343 leader_election.cc:304] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:14.017843 26989 raft_consensus.cc:515] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:14.151549 25906 rpcz_store.cc:276] 0709 13:11:12.448811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.449435 (+   624us) service_pool.cc:224] Handling call
0709 13:11:12.465837 (+ 16402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:12.466016 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:11:13.477976 (+1011960us) log.cc:844] Serialized 14 byte log entry
0709 13:11:13.993832 (+515856us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:13.993899 (+    67us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:13.993952 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:13.994028 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:13.994174 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":991140,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":52,"raft.queue_time_us":33134,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":12866,"thread_start_us":1511245,"threads_started":2}
I20260709 13:11:14.021246 26983 raft_consensus.cc:515] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:14.170334 25230 raft_consensus.cc:2468] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 3.
I20260709 13:11:14.179565 25126 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40020 (request call id 262) took 7809 ms. Trace:
W20260709 13:11:14.181571 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 74160us
I20260709 13:11:14.182690 25345 leader_election.cc:304] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:14.184511 25345 leader_election.cc:304] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:14.133850 26827 raft_consensus.cc:515] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:14.172000 26950 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.007s	sys 0.016s
I20260709 13:11:14.178632 26808 raft_consensus.cc:697] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 3 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:14.167618 26997 raft_consensus.cc:2804] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:14.172315 26977 raft_consensus.cc:2804] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:14.174571 26959 raft_consensus.cc:493] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:14.139746 26786 raft_consensus.cc:515] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:13.823307 25221 rpcz_store.cc:276] 0709 13:11:12.334962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.364529 (+ 29567us) service_pool.cc:224] Handling call
0709 13:11:12.364989 (+   460us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:12.365438 (+   449us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:12.365495 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:12.366131 (+   636us) log.cc:844] Serialized 26 byte log entry
0709 13:11:12.508251 (+142120us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:12.946542 (+438291us) log.cc:844] Serialized 14 byte log entry
0709 13:11:13.774112 (+827570us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:13.777457 (+  3345us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:13.779668 (+  2211us) raft_consensus.cc:1685] finished
0709 13:11:13.781088 (+  1420us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:13.786619 (+  5531us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":876406,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":55221,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":9804,"thread_start_us":1225361,"threads_started":3,"wal-append.queue_time_us":136396}
I20260709 13:11:14.189347 25343 leader_election.cc:304] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:14.163347 26814 leader_election.cc:290] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:14.200294 25230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58418 (request call id 1495) took 1137 ms. Trace:
I20260709 13:11:14.186362 26922 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:14.222700 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:14.191543 26914 raft_consensus.cc:493] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:14.223433 25221 raft_consensus.cc:2468] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 3.
I20260709 13:11:14.223590 26914 raft_consensus.cc:515] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:14.224058 26827 leader_election.cc:290] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:14.224628 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:14.225399 25221 raft_consensus.cc:2468] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 4.
I20260709 13:11:14.158572 26804 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:14.227221 26886 raft_consensus.cc:493] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.227767 26886 raft_consensus.cc:515] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:11:14.229116 26804 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:14.206748 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:14.190698 26704 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.230090 25305 raft_consensus.cc:3060] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:14.230379 26704 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:14.232769 26704 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:14.163514 26615 raft_consensus.cc:515] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:14.205925 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:14.186519 27005 raft_consensus.cc:2804] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:14.182097 25126 rpcz_store.cc:276] 0709 13:11:06.370163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.370325 (+   162us) service_pool.cc:224] Handling call
0709 13:11:07.191164 (+820839us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x7b540034ec54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd9090 00007fd72fc77f3a 00007fd735a2e1cc 00007fd735b2c37e 00007fd733fed2a4 00007fd733fed232 00007fd733fed161 00007fd733fed0dc 00007fd733fec392 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:14.179494 (+6988330us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:11.148137 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:11.181716 (+ 33579us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:11.181799 (+    83us) write_op.cc:435] Acquired schema lock
0709 13:11:11.181842 (+    43us) tablet.cc:662] Decoding operations
0709 13:11:11.183401 (+  1559us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:11.183570 (+   169us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:11.183603 (+    33us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:11:11.222083 (+ 38480us) tablet.cc:701] Row locks acquired
0709 13:11:11.247532 (+ 25449us) write_op.cc:260] PREPARE: finished
0709 13:11:11.262547 (+ 15015us) write_op.cc:270] Start()
0709 13:11:11.293892 (+ 31345us) write_op.cc:276] Timestamp: P: 1783602671259313 usec, L: 0
0709 13:11:11.309506 (+ 15614us) op_driver.cc:348] REPLICATION: starting
0709 13:11:11.367197 (+ 57691us) log.cc:844] Serialized 2918 byte log entry
0709 13:11:11.930002 (+562805us) op_driver.cc:464] REPLICATION: finished
0709 13:11:12.194242 (+264240us) write_op.cc:301] APPLY: starting
0709 13:11:12.204866 (+ 10624us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:12.257789 (+ 52923us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:12.259830 (+  2041us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:12.262624 (+  2794us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:12.262926 (+   302us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 13:11:12.263000 (+    74us) write_op.cc:312] APPLY: finished
0709 13:11:12.263309 (+   309us) log.cc:844] Serialized 59 byte log entry
0709 13:11:12.263502 (+   193us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:12.263613 (+   111us) write_op.cc:454] Released schema lock
0709 13:11:12.263672 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:12.264046 (+   374us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:12.264076 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":349193,"reported_tablets":15,"spinlock_wait_cycles":499370752,"child_traces":[["op",{"apply.queue_time_us":231448,"apply.run_cpu_time_us":3712,"apply.run_wall_time_us":91441,"num_ops":7,"prepare.queue_time_us":157757,"prepare.run_cpu_time_us":20992,"prepare.run_wall_time_us":461238,"raft.queue_time_us":190092,"raft.run_cpu_time_us":47604,"raft.run_wall_time_us":254207,"replication_time_us":598022,"thread_start_us":520775,"threads_started":4,"wal-append.queue_time_us":259526,"wal-append.run_cpu_time_us":47188,"wal-append.run_wall_time_us":1628547}]]}
I20260709 13:11:14.198088 26832 leader_election.cc:290] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:14.194058 26953 raft_consensus.cc:2749] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:14.191921 26849 raft_consensus.cc:515] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:14.189836 26559 raft_consensus.cc:2804] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:14.225929 26814 raft_consensus.cc:493] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.202602 25225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1423) took 1303 ms. Trace:
I20260709 13:11:14.226166 27002 raft_consensus.cc:2804] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:14.226601 26914 leader_election.cc:290] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:14.254278 25228 raft_consensus.cc:1240] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 3. Current term is 4. Ops: []
W20260709 13:11:14.255122 25194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:14.249213 25225 rpcz_store.cc:276] 0709 13:11:12.898926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.899057 (+   131us) service_pool.cc:224] Handling call
0709 13:11:12.899439 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:12.946169 (+ 46730us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:12.946201 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:13.533463 (+587262us) spinlock_profiling.cc:243] Waited 70.2 ms on lock 0x7b2c000014c8. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72e568a11 00007fd72e578372 00007fd72fcaaa01 00007fd72fc6f43a 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2
0709 13:11:13.533894 (+   431us) log.cc:844] Serialized 26 byte log entry
0709 13:11:13.993474 (+459580us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:11:13.993519 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:13.993585 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:14.193931 (+200346us) raft_consensus.cc:1685] finished
0709 13:11:14.193955 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:14.202532 (+  8577us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2058,"raft.queue_time_us":33455,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":85706,"spinlock_wait_cycles":161459968,"thread_start_us":459214,"threads_started":1,"wal-append.queue_time_us":658071}
I20260709 13:11:14.260953 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:11:14.204653 25304 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.017s	sys 0.008s
W20260709 13:11:14.200877 26950 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.007s	sys 0.016s
I20260709 13:11:14.198343 26921 raft_consensus.cc:2749] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:14.236428 26615 leader_election.cc:290] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:14.236688 26768 raft_consensus.cc:493] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.238672 25379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36254 (request call id 1560) took 1748 ms. Trace:
W20260709 13:11:14.239053 25874 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.008s	sys 0.025s
I20260709 13:11:14.221064 25230 rpcz_store.cc:276] 0709 13:11:13.062553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.179977 (+1117424us) service_pool.cc:224] Handling call
0709 13:11:14.199624 (+ 19647us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:14.199858 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:14.199900 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:14.199960 (+    60us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:14.200006 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:14.200083 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:14.200220 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:14.190136 25223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1425) took 1269 ms. Trace:
I20260709 13:11:14.237270 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:14.245270 25305 raft_consensus.cc:2468] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 3.
W20260709 13:11:14.240356 26852 consensus_meta.cc:287] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 0.629s	user 0.013s	sys 0.000s
I20260709 13:11:14.189869 26701 consensus_queue.cc:1048] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:11:14.212569 26997 raft_consensus.cc:697] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 3 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
W20260709 13:11:14.262703 25304 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.018s	sys 0.008s
I20260709 13:11:14.249789 27005 raft_consensus.cc:697] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 4 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
W20260709 13:11:14.275979 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 347325us
I20260709 13:11:14.224584 26959 raft_consensus.cc:515] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:14.335155 27008 log.cc:927] Time spent T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:11:14.251428 26814 raft_consensus.cc:515] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:14.261775 25225 raft_consensus.cc:2468] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 3.
I20260709 13:11:14.249975 26559 raft_consensus.cc:493] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:14.337006 26559 raft_consensus.cc:3060] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:14.337869 26814 leader_election.cc:290] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:14.283337 25874 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.009s	sys 0.025s
W20260709 13:11:14.339214 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 715149us
I20260709 13:11:14.341179 25227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1419) took 1642 ms. Trace:
I20260709 13:11:14.281289 25379 rpcz_store.cc:276] 0709 13:11:12.500638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:13.355597 (+854959us) service_pool.cc:224] Handling call
0709 13:11:13.356006 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:13.356454 (+   448us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:13.356494 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:13.357028 (+   534us) log.cc:844] Serialized 26 byte log entry
0709 13:11:14.160726 (+803698us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:11:14.160788 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:14.160885 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:14.238478 (+ 77593us) raft_consensus.cc:1685] finished
0709 13:11:14.238497 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:14.238618 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":120,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":5396,"thread_start_us":780814,"threads_started":1,"wal-append.queue_time_us":871419}
I20260709 13:11:14.344738 25904 raft_consensus.cc:3060] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 LEARNER]: Advancing to term 3
I20260709 13:11:14.341542 25227 rpcz_store.cc:276] 0709 13:11:12.699008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.906413 (+207405us) service_pool.cc:224] Handling call
0709 13:11:12.961557 (+ 55144us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:13.710623 (+749066us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:13.710667 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:13.769297 (+ 58630us) log.cc:844] Serialized 26 byte log entry
0709 13:11:14.089049 (+319752us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:11:14.089159 (+   110us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:14.089241 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:14.340987 (+251746us) raft_consensus.cc:1685] finished
0709 13:11:14.341005 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:14.341128 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5702,"raft.queue_time_us":82040,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":8873,"thread_start_us":1048721,"threads_started":2,"wal-append.queue_time_us":564187}
I20260709 13:11:14.347365 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:14.347951 25227 raft_consensus.cc:2468] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 3.
I20260709 13:11:14.348747 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:14.349467 25227 raft_consensus.cc:2410] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:11:14.350056 26919 consensus_meta.cc:287] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 0.660s	user 0.007s	sys 0.004s
I20260709 13:11:14.350164 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:14.350454 26919 raft_consensus.cc:515] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:14.351831 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:14.352843 25901 raft_consensus.cc:2393] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 4: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
W20260709 13:11:14.283629 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 382503us
I20260709 13:11:14.286955 25872 leader_election.cc:304] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:14.225879 26808 consensus_queue.cc:237] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:14.295573 25224 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 2.
I20260709 13:11:14.295625 25195 leader_election.cc:304] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:14.287485 26768 raft_consensus.cc:515] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:14.298166 25222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1426) took 1376 ms. Trace:
W20260709 13:11:14.280550 25374 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.765s	user 0.016s	sys 0.030s
I20260709 13:11:14.284310 25223 rpcz_store.cc:276] 0709 13:11:12.921072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:13.068280 (+147208us) service_pool.cc:224] Handling call
0709 13:11:13.068672 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:13.068904 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:11:13.672641 (+603737us) log.cc:844] Serialized 14 byte log entry
0709 13:11:14.179453 (+506812us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:14.182779 (+  3326us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:14.185099 (+  2320us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:14.189937 (+  4838us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:14.190074 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":316230,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":26,"raft.queue_time_us":21702,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":5853,"thread_start_us":1084588,"threads_started":2}
I20260709 13:11:14.294823 25221 raft_consensus.cc:2468] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 2.
I20260709 13:11:14.371353 25908 raft_consensus.cc:1275] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:14.300573 26990 leader_election.cc:290] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:14.301928 26998 log.cc:927] Time spent T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:11:14.301491 26997 consensus_queue.cc:237] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:14.302563 27010 log.cc:927] Time spent T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 13:11:14.304050 25128 catalog_manager.cc:5697] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 1 to 4, leader changed from 79d99c0e498349bda74127365219e468 (127.23.140.67) to 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68). New cstate: current_term: 4 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:11:14.369889 25374 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.853s	user 0.016s	sys 0.031s
I20260709 13:11:14.359967 26909 raft_consensus.cc:493] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
W20260709 13:11:14.311626 27007 log.cc:927] Time spent T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:11:14.313983 27005 consensus_queue.cc:237] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:14.316381 26786 leader_election.cc:290] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:14.317597 26916 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.317713 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:14.404623 25230 raft_consensus.cc:3060] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:14.321024 26816 consensus_meta.cc:287] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.548s	user 0.006s	sys 0.002s
I20260709 13:11:14.324497 26964 leader_election.cc:290] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:14.275620 26804 raft_consensus.cc:493] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:14.328805 26973 leader_election.cc:290] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:14.329711 26849 leader_election.cc:290] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:14.332620 26983 leader_election.cc:290] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:14.281822 26922 raft_consensus.cc:493] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.281507 27002 raft_consensus.cc:697] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 2 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:14.288290 26827 raft_consensus.cc:493] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:14.352767 26919 leader_election.cc:290] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:14.278882 26832 raft_consensus.cc:493] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.423344 26832 raft_consensus.cc:515] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:14.354599 25378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36254 (request call id 1559) took 1865 ms. Trace:
W20260709 13:11:14.354668 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 67831.7us
W20260709 13:11:14.427558 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:14.359218 25228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1429) took 1008 ms. Trace:
I20260709 13:11:14.427953 25228 rpcz_store.cc:276] 0709 13:11:13.350725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.184234 (+833509us) service_pool.cc:224] Handling call
0709 13:11:14.184671 (+   437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:14.254808 (+ 70137us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:14.359033 (+104225us) spinlock_profiling.cc:243] Waited 69.4 ms on lock 0x7b54002cd8d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:14.359169 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":159509888}
I20260709 13:11:14.363790 25225 raft_consensus.cc:1275] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:11:14.372450 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 76842.1us
I20260709 13:11:14.430563 25195 leader_election.cc:304] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:14.374511 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:14.374408 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:14.355320 26979 raft_consensus.cc:493] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:14.309158 26886 leader_election.cc:290] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:14.378666 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:14.431660 25906 raft_consensus.cc:2468] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 3.
I20260709 13:11:14.364048 26980 raft_consensus.cc:2749] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:14.311242 26910 leader_election.cc:290] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:14.364485 26923 raft_consensus.cc:515] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:14.383998 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:14.397740 26909 raft_consensus.cc:515] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:14.427217 26786 raft_consensus.cc:493] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.382457 25296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57272 (request call id 1261) took 1093 ms. Trace:
I20260709 13:11:14.392241 27023 consensus_queue.cc:1059] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:14.372067 26965 raft_consensus.cc:2804] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:14.380887 25128 catalog_manager.cc:5697] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:11:14.433065 26849 raft_consensus.cc:2749] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:14.418901 25226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1428) took 1457 ms. Trace:
I20260709 13:11:14.466560 25226 rpcz_store.cc:276] 0709 13:11:12.961542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:13.570749 (+609207us) service_pool.cc:224] Handling call
0709 13:11:13.571110 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:13.571350 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:11:13.584145 (+ 12795us) log.cc:844] Serialized 14 byte log entry
0709 13:11:14.418410 (+834265us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:14.418476 (+    66us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:14.418536 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:14.418728 (+   192us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:14.418851 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":18267,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":154727,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":4908,"thread_start_us":833848,"threads_started":2,"wal-append.queue_time_us":617872}
I20260709 13:11:14.404031 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:14.407352 27021 raft_consensus.cc:493] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:14.446318 26989 leader_election.cc:290] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:14.417872 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:14.408272 26816 raft_consensus.cc:515] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:14.495852 27021 raft_consensus.cc:515] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:14.408335 26987 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:14.434474 25195 leader_election.cc:304] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:14.439350 25225 raft_consensus.cc:1275] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:14.446964 25907 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 1.
I20260709 13:11:14.437307 25378 rpcz_store.cc:276] 0709 13:11:12.489580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:13.323460 (+833880us) service_pool.cc:224] Handling call
0709 13:11:13.323781 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:13.324004 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:11:13.934174 (+610170us) log.cc:844] Serialized 14 byte log entry
0709 13:11:14.354307 (+420133us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:14.354355 (+    48us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:14.354401 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:14.354458 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:14.354549 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":846117,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":1658,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":7456,"thread_start_us":1029478,"threads_started":2}
I20260709 13:11:14.387753 26768 leader_election.cc:290] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:14.364048 25222 rpcz_store.cc:276] 0709 13:11:12.921440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:13.140458 (+219018us) service_pool.cc:224] Handling call
0709 13:11:13.140836 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:13.141105 (+   269us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:11:13.900346 (+759241us) log.cc:844] Serialized 14 byte log entry
0709 13:11:14.286504 (+386158us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:14.289498 (+  2994us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:14.297867 (+  8369us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:14.297957 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:14.298098 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9375,"prepare.queue_time_us":244203,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":3238,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":5355,"thread_start_us":1103313,"threads_started":2}
I20260709 13:11:14.450522 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:11:14.456523 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 272056us
I20260709 13:11:14.409152 26916 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:14.504936 25345 leader_election.cc:304] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:14.505071 25908 raft_consensus.cc:2410] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:11:14.506300 26916 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:14.457177 25297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57272 (request call id 1262) took 1173 ms. Trace:
I20260709 13:11:14.506556 26768 raft_consensus.cc:2804] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:14.506964 25297 rpcz_store.cc:276] 0709 13:11:13.284070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:13.284265 (+   195us) service_pool.cc:224] Handling call
0709 13:11:13.284649 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:13.288084 (+  3435us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:13.288126 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:13.311318 (+ 23192us) log.cc:844] Serialized 26 byte log entry
0709 13:11:14.018683 (+707365us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:11:14.018721 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:14.018782 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:14.456889 (+438107us) raft_consensus.cc:1685] finished
0709 13:11:14.456915 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:14.457104 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2976,"raft.queue_time_us":3577,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":135,"thread_start_us":656572,"threads_started":1,"wal-append.queue_time_us":818752}
W20260709 13:11:14.463210 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 257207us
I20260709 13:11:14.393082 27020 consensus_queue.cc:1048] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:11:14.418159 26804 raft_consensus.cc:515] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:14.465881 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 229548us
I20260709 13:11:14.514457 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:14.514950 25227 raft_consensus.cc:1240] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:11:14.515092 25226 raft_consensus.cc:2468] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 4.
I20260709 13:11:14.515542 26804 leader_election.cc:290] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:14.463572 25128 catalog_manager.cc:5697] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:11:14.420809 26922 raft_consensus.cc:515] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:14.517673 25128 catalog_manager.cc:5697] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 1 to 2, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 2 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:11:14.519214 26922 leader_election.cc:290] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:14.450040 26832 leader_election.cc:290] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:14.426913 26827 raft_consensus.cc:515] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:14.519942 25128 catalog_manager.cc:5697] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 1 to 3, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68). New cstate: current_term: 3 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:14.521718 26827 leader_election.cc:290] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:14.450870 26919 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:14.463207 25221 raft_consensus.cc:1275] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:14.529201 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:14.529764 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:14.530568 25221 raft_consensus.cc:2468] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 6.
I20260709 13:11:14.506219 25345 leader_election.cc:304] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:14.531745 25345 leader_election.cc:304] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:14.532514 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:14.533324 25304 raft_consensus.cc:2468] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 4.
I20260709 13:11:14.447021 25901 raft_consensus.cc:2468] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 3.
I20260709 13:11:14.534281 26886 raft_consensus.cc:3060] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:14.534785 26827 raft_consensus.cc:2804] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:14.534925 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:14.535226 26827 raft_consensus.cc:493] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:14.535924 25297 raft_consensus.cc:1275] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 3. (term mismatch)
I20260709 13:11:14.536283 25297 pending_rounds.cc:85] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19: Aborting all ops after (but not including) 2
I20260709 13:11:14.536494 25297 pending_rounds.cc:107] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19: Aborting uncommitted NO_OP operation due to leader change: 2.3
I20260709 13:11:14.536698 25297 raft_consensus.cc:2889] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:14.521042 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:14.538228 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:14.538331 25907 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 1.
I20260709 13:11:14.538502 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:14.507217 26768 raft_consensus.cc:493] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:14.539355 26768 raft_consensus.cc:3060] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:14.539988 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:14.521477 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:14.540086 26983 raft_consensus.cc:493] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:14.541134 25225 raft_consensus.cc:2468] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 2.
I20260709 13:11:14.541198 26983 raft_consensus.cc:515] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:14.528247 25194 leader_election.cc:304] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:14.543068 25305 raft_consensus.cc:1240] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:14.544093 26983 leader_election.cc:290] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:14.544394 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:14.544872 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:14.545110 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:14.545632 25221 raft_consensus.cc:2393] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 3: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:14.546201 26973 raft_consensus.cc:493] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:14.546934 26973 raft_consensus.cc:515] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:14.549134 26919 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:14.550127 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:14.551839 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:14.535959 26827 raft_consensus.cc:3060] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:14.568246 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:14.567971 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:14.568929 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:14.573000 26919 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:14.573455 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:14.573688 25376 raft_consensus.cc:2468] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 1.
I20260709 13:11:14.574329 25298 raft_consensus.cc:2393] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 3: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:14.552523 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:14.569846 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:14.558674 25128 catalog_manager.cc:5697] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 2 to 3, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68). New cstate: current_term: 3 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:14.554620 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:14.578893 25370 raft_consensus.cc:2393] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 2: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:14.579685 25297 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 2.
I20260709 13:11:14.566886 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:14.564736 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:14.556625 25225 raft_consensus.cc:2468] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 2.
I20260709 13:11:14.581881 25374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36254 (request call id 1561) took 2078 ms. Trace:
I20260709 13:11:14.555656 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:11:14.582123 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 147757us
I20260709 13:11:14.582738 26989 raft_consensus.cc:2804] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:14.583029 25195 leader_election.cc:304] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:14.583623 26989 raft_consensus.cc:697] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 2 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:14.584755 25376 raft_consensus.cc:1240] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:14.585389 27001 raft_consensus.cc:2804] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:14.579434 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:14.586089 27001 raft_consensus.cc:697] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 2 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:14.586591 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:14.587236 27001 consensus_queue.cc:237] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:14.584647 26989 consensus_queue.cc:237] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:14.590262 25378 raft_consensus.cc:2468] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 2.
I20260709 13:11:14.591274 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:14.576911 25128 catalog_manager.cc:5697] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 1 to 2, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68). New cstate: current_term: 2 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:11:14.587018 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 53051.8us
I20260709 13:11:14.589203 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:14.593497 25873 leader_election.cc:304] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
W20260709 13:11:14.593924 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 65804.5us
I20260709 13:11:14.595044 25873 leader_election.cc:304] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:14.596411 26832 raft_consensus.cc:2804] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:14.596835 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:14.596975 26832 raft_consensus.cc:697] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 3 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:14.597576 27020 raft_consensus.cc:2804] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:14.598009 27020 raft_consensus.cc:493] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:14.598390 27020 raft_consensus.cc:3060] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:14.582396 25374 rpcz_store.cc:276] 0709 13:11:12.503506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:13.398105 (+894599us) service_pool.cc:224] Handling call
0709 13:11:13.463082 (+ 64977us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:13.500039 (+ 36957us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:11:13.891803 (+391764us) spinlock_profiling.cc:243] Waited 8.29 ms on lock 0x7b4400022b4c. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72caa8c85 00007fd72caa96a2 00007fd72f81b1db 00007fd72f816aaf 00007fd72cb650ac 00007fd7359bfab9 00007fd72cb8169b 00007fd72cb7f93f 00007fd72cb7f455 00007fd7336673c7
0709 13:11:14.388202 (+496399us) log.cc:844] Serialized 14 byte log entry
0709 13:11:14.581429 (+193227us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:14.581503 (+    74us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:14.581553 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:14.581689 (+   136us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:14.581823 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":689530,"prepare.run_cpu_time_us":1976,"prepare.run_wall_time_us":11643,"raft.queue_time_us":94,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":86,"spinlock_wait_cycles":19064576,"thread_start_us":1056959,"threads_started":2}
I20260709 13:11:14.601075 25374 raft_consensus.cc:1275] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:14.602471 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:14.603536 25297 raft_consensus.cc:2410] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:11:14.603384 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:14.602057 26832 consensus_queue.cc:237] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:14.604193 25221 raft_consensus.cc:2468] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 3.
I20260709 13:11:14.584965 25195 leader_election.cc:304] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:14.555042 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:14.451231 26980 consensus_queue.cc:1048] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:11:14.465646 26977 raft_consensus.cc:697] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 2 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:14.650696 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:11:14.640479 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 212853us
I20260709 13:11:14.462643 26965 raft_consensus.cc:493] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:14.435889 26979 raft_consensus.cc:515] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:14.592742 25128 catalog_manager.cc:5697] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 2 to 3, leader changed from 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 3 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:11:14.491640 26990 raft_consensus.cc:493] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.657694 25224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1435) took 1099 ms. Trace:
I20260709 13:11:14.661674 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:14.636927 25229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1424) took 1737 ms. Trace:
I20260709 13:11:14.549484 26973 leader_election.cc:290] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:14.497913 26816 leader_election.cc:290] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:14.663446 25128 catalog_manager.cc:5697] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 1 to 4, leader changed from 79d99c0e498349bda74127365219e468 (127.23.140.67) to 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68). New cstate: current_term: 4 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:14.648706 25271 leader_election.cc:304] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:14.460585 26786 raft_consensus.cc:515] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:14.501303 27021 leader_election.cc:290] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:14.631186 27023 raft_consensus.cc:3055] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:11:14.699224 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 114313us
W20260709 13:11:14.699858 25194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:14.577529 26886 raft_consensus.cc:2749] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:14.703675 25227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1430) took 1348 ms. Trace:
I20260709 13:11:14.717135 25227 rpcz_store.cc:276] 0709 13:11:13.355417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.350799 (+995382us) service_pool.cc:224] Handling call
0709 13:11:14.351079 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:14.515557 (+164478us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:14.703396 (+187839us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b540004b854. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:14.703615 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":376187648}
W20260709 13:11:14.703987 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 55436.3us
I20260709 13:11:14.663249 25224 rpcz_store.cc:276] 0709 13:11:13.558430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.365545 (+807115us) service_pool.cc:224] Handling call
0709 13:11:14.365824 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:14.366016 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:11:14.377735 (+ 11719us) log.cc:844] Serialized 14 byte log entry
0709 13:11:14.655721 (+277986us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:14.655800 (+    79us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:14.655858 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:14.655942 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:14.657613 (+  1671us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":13114,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":39,"raft.queue_time_us":7550,"thread_start_us":276913,"threads_started":1}
I20260709 13:11:14.681887 25229 rpcz_store.cc:276] 0709 13:11:12.899938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.900078 (+   140us) service_pool.cc:224] Handling call
0709 13:11:12.900439 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:12.900662 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:11:13.686544 (+785882us) log.cc:844] Serialized 14 byte log entry
0709 13:11:14.636417 (+949873us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:14.636500 (+    83us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:14.636566 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:14.636665 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:14.636838 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":484246,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":7179,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":5662,"thread_start_us":1672603,"threads_started":3,"wal-append.queue_time_us":615912}
I20260709 13:11:14.719449 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:14.651090 26916 raft_consensus.cc:2764] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:11:14.719453 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:14.681322 26965 raft_consensus.cc:3060] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:14.650715 26852 raft_consensus.cc:493] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:14.719921 25271 leader_election.cc:304] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:14.737200 25224 raft_consensus.cc:2393] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 2: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:14.723356 25229 raft_consensus.cc:2410] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:11:14.743491 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:14.744864 25227 raft_consensus.cc:2468] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 6.
I20260709 13:11:14.746933 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:14.747816 25229 raft_consensus.cc:2410] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:11:14.749812 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:14.750247 25906 raft_consensus.cc:1275] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:11:14.754384 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 68030.4us
I20260709 13:11:14.755270 25345 leader_election.cc:304] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:14.756623 25345 leader_election.cc:304] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
W20260709 13:11:14.766026 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 46184.1us
I20260709 13:11:14.774739 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:14.767208 25271 leader_election.cc:304] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:14.775686 25227 raft_consensus.cc:2393] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 4: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:14.780055 25224 raft_consensus.cc:1240] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:14.781605 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:11:14.785166 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 190169us
I20260709 13:11:14.786916 25873 leader_election.cc:304] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:14.712996 26973 raft_consensus.cc:2804] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:14.710436 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:11:14.796464 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 142558us
I20260709 13:11:14.715371 27023 raft_consensus.cc:740] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:14.810353 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:14.717386 26959 leader_election.cc:290] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:14.811632 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 123494us
I20260709 13:11:14.684154 26922 consensus_queue.cc:1048] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.093s
I20260709 13:11:14.652815 26987 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:14.812418 25344 leader_election.cc:304] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:14.743017 27021 raft_consensus.cc:493] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:14.809588 25271 leader_election.cc:304] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:11:14.855528 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 71209.1us
I20260709 13:11:14.758112 26919 raft_consensus.cc:493] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:14.812927 25377 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 4.
I20260709 13:11:14.684799 26990 raft_consensus.cc:515] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:14.662348 27002 consensus_queue.cc:237] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:14.774739 26852 raft_consensus.cc:515] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:14.807405 26989 consensus_queue.cc:1048] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.327s
I20260709 13:11:15.025588 27030 raft_consensus.cc:2804] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:11:14.960392 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 148042us
I20260709 13:11:15.135203 27030 raft_consensus.cc:493] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:15.135661 26990 leader_election.cc:290] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:15.136077 25344 leader_election.cc:304] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:15.136648 26909 leader_election.cc:290] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:14.925423 26977 consensus_queue.cc:237] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:15.018009 26996 log.cc:927] Time spent T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:11:14.817307 26945 consensus_queue.cc:1048] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.322s
I20260709 13:11:14.811662 26914 raft_consensus.cc:493] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:15.140656 26987 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:14.813628 26921 raft_consensus.cc:2804] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:11:14.983255 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:14.878121 27054 raft_consensus.cc:2804] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:15.141458 26921 raft_consensus.cc:493] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:15.141896 27054 raft_consensus.cc:493] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:14.813249 26863 raft_consensus.cc:2804] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:14.837203 26842 raft_consensus.cc:493] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.960058 26983 raft_consensus.cc:493] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.053004 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:11:14.900303 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 90744.7us
I20260709 13:11:15.135735 27030 raft_consensus.cc:3060] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:14.779515 27028 raft_consensus.cc:2804] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:14.900295 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:15.148154 25224 raft_consensus.cc:1275] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:11:14.952558 25904 consensus_meta.cc:287] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent flushing consensus metadata: real 0.607s	user 0.005s	sys 0.007s
W20260709 13:11:15.143260 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 335445us
I20260709 13:11:14.925668 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:14.924948 26910 consensus_queue.cc:1059] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.221s
I20260709 13:11:14.807237 26973 raft_consensus.cc:493] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:14.975984 27033 raft_consensus.cc:493] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:15.169795 25344 leader_election.cc:304] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:15.083422 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:15.170632 25872 leader_election.cc:304] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:15.140828 26914 raft_consensus.cc:515] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:15.143230 27034 raft_consensus.cc:2804] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:11:15.177986 25230 consensus_meta.cc:287] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 0.773s	user 0.003s	sys 0.008s
I20260709 13:11:14.819635 26808 raft_consensus.cc:2804] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:15.143708 26923 leader_election.cc:290] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:15.151087 26863 raft_consensus.cc:493] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:14.979830 27049 raft_consensus.cc:2804] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:15.142078 26921 raft_consensus.cc:3060] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:15.142724 27054 raft_consensus.cc:3060] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:15.164131 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:14.877962 26953 consensus_queue.cc:1059] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.291s
I20260709 13:11:15.297626 26953 raft_consensus.cc:3055] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:15.298053 26953 raft_consensus.cc:740] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
W20260709 13:11:15.298285 27042 log.cc:927] Time spent T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.322s	user 0.000s	sys 0.001s
I20260709 13:11:15.298833 25195 leader_election.cc:304] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:15.298938 26953 consensus_queue.cc:260] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:15.300050 25195 leader_election.cc:304] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:15.300170 26953 raft_consensus.cc:3060] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:15.302147 25301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46556 (request call id 187) took 1229 ms. Trace:
W20260709 13:11:15.302619 27045 log.cc:927] Time spent T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 13:11:15.155901 26919 raft_consensus.cc:515] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:15.302580 25301 rpcz_store.cc:276] 0709 13:11:14.072238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.072380 (+   142us) service_pool.cc:224] Handling call
0709 13:11:14.072710 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:14.073099 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:14.073127 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:14.073589 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 13:11:14.327419 (+253830us) spinlock_profiling.cc:243] Waited 5.76 ms on lock 0x7b48000438d8. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd734b98aa1 00007fd734b8fb37 00007fd734b8f9ca 00007fd734c8726f 00007fd734c86f37 00007fd734c9b55c 00007fd734c9b508 00007fd734c9b488 00007fd734c9b443 00007fd734c9a6ec 00007fd733bc4a96
0709 13:11:14.466727 (+139308us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:14.466766 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:14.466850 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:15.301813 (+834963us) raft_consensus.cc:1685] finished
0709 13:11:15.301833 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:15.302070 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18498,"raft.run_cpu_time_us":3873,"raft.run_wall_time_us":216375,"spinlock_wait_cycles":13246336,"thread_start_us":392725,"threads_started":1,"wal-append.queue_time_us":1222038}
I20260709 13:11:15.303980 27031 raft_consensus.cc:493] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.304443 26989 raft_consensus.cc:2749] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:15.305164 26919 leader_election.cc:290] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:15.305377 27053 log.cc:927] Time spent T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:11:15.306663 27050 log.cc:927] Time spent T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:11:15.160524 27028 raft_consensus.cc:493] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:15.307924 27028 raft_consensus.cc:3060] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:15.304466 27031 raft_consensus.cc:515] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:15.309365 26559 consensus_meta.cc:287] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.972s	user 0.007s	sys 0.000s
I20260709 13:11:15.309873 27031 leader_election.cc:290] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:15.310061 27041 log.cc:927] Time spent T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.497s	user 0.000s	sys 0.001s
I20260709 13:11:15.310453 27031 raft_consensus.cc:493] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:15.310726 25227 raft_consensus.cc:2468] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 2.
I20260709 13:11:15.310990 27031 raft_consensus.cc:515] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:15.313148 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:15.309623 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:15.314168 27031 leader_election.cc:290] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:15.314500 25378 raft_consensus.cc:2393] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 3: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
W20260709 13:11:15.314682 26768 consensus_meta.cc:287] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.775s	user 0.012s	sys 0.001s
W20260709 13:11:15.180083 27024 log.cc:927] Time spent T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.533s	user 0.001s	sys 0.000s
I20260709 13:11:15.149613 26886 raft_consensus.cc:493] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:15.315361 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:15.315498 26886 raft_consensus.cc:515] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:15.316358 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:15.316933 25378 raft_consensus.cc:2468] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 4.
I20260709 13:11:15.179615 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:11:15.225142 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 55437.1us
I20260709 13:11:14.458575 25296 rpcz_store.cc:276] 0709 13:11:13.283724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:13.287525 (+  3801us) service_pool.cc:224] Handling call
0709 13:11:13.352820 (+ 65295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:13.443469 (+ 90649us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:13.451702 (+  8233us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:13.528467 (+ 76765us) log.cc:844] Serialized 26 byte log entry
0709 13:11:13.998104 (+469637us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:14.005529 (+  7425us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:14.071050 (+ 65521us) spinlock_profiling.cc:243] Waited 58.9 ms on lock 0x7b540029a754. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:14.071111 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:14.364094 (+292983us) raft_consensus.cc:1685] finished
0709 13:11:14.364113 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:14.376446 (+ 12333us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3287,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":2686,"spinlock_wait_cycles":135397248,"thread_start_us":438699,"threads_started":1,"wal-append.queue_time_us":677650}
I20260709 13:11:15.159876 26983 raft_consensus.cc:515] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:15.240327 25230 raft_consensus.cc:2468] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 4.
W20260709 13:11:15.239984 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 69447.9us
I20260709 13:11:15.156067 26842 raft_consensus.cc:515] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:15.156176 27021 raft_consensus.cc:515] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:15.185521 26973 raft_consensus.cc:3060] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:15.268661 25379 raft_consensus.cc:2468] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 2.
I20260709 13:11:15.318598 25230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58422 (request call id 1440) took 1123 ms. Trace:
I20260709 13:11:15.324713 25230 rpcz_store.cc:276] 0709 13:11:14.195172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.317353 (+122181us) service_pool.cc:224] Handling call
0709 13:11:15.318544 (+1001191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:15.325150 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:15.325868 25379 raft_consensus.cc:3060] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:15.233898 25904 raft_consensus.cc:1275] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 LEARNER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 3. (term mismatch)
I20260709 13:11:15.246428 26979 leader_election.cc:290] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:15.230258 27033 raft_consensus.cc:515] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:15.305287 26989 raft_consensus.cc:2749] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:15.243885 27034 raft_consensus.cc:493] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:15.317474 26886 leader_election.cc:290] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:15.317974 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:15.429168 25225 raft_consensus.cc:2468] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 4.
I20260709 13:11:15.375044 25904 pending_rounds.cc:85] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6: Aborting all ops after (but not including) 2
I20260709 13:11:15.245216 26808 raft_consensus.cc:493] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:15.321329 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:15.375661 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:15.296229 26945 raft_consensus.cc:2804] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:15.323562 25227 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 2.
I20260709 13:11:15.257073 26863 raft_consensus.cc:3060] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:15.252950 26786 leader_election.cc:290] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:15.252877 27035 raft_consensus.cc:2804] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:15.256664 27049 raft_consensus.cc:493] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:15.415019 25195 leader_election.cc:304] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:15.416731 25907 raft_consensus.cc:1275] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:15.317713 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
W20260709 13:11:15.437397 25128 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.002s	sys 0.024s
I20260709 13:11:15.449316 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:15.450450 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:15.267704 26804 raft_consensus.cc:2804] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:15.461521 25904 pending_rounds.cc:107] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6: Aborting uncommitted NO_OP operation due to leader change: 2.3
I20260709 13:11:15.320298 26983 leader_election.cc:290] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:11:15.467410 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 308700us
I20260709 13:11:15.473922 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:15.464704 25908 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 1.
I20260709 13:11:15.319692 26923 consensus_queue.cc:1048] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.185s
I20260709 13:11:15.309742 26559 raft_consensus.cc:515] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:15.374495 26768 raft_consensus.cc:515] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:15.643031 25299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57272 (request call id 1279) took 1073 ms. Trace:
I20260709 13:11:15.542567 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:15.591176 25226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1453) took 1047 ms. Trace:
I20260709 13:11:15.451540 27034 raft_consensus.cc:3060] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:15.476004 25379 raft_consensus.cc:2468] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 4.
I20260709 13:11:15.431305 25223 raft_consensus.cc:1240] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:15.534693 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:15.661339 25230 raft_consensus.cc:2393] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 4: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:15.455384 26990 raft_consensus.cc:493] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.657084 25299 rpcz_store.cc:276] 0709 13:11:14.569602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.573233 (+  3631us) service_pool.cc:224] Handling call
0709 13:11:14.573883 (+   650us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:15.134483 (+560600us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:15.134520 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:15.134573 (+    53us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:15.134624 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:15.642730 (+508106us) spinlock_profiling.cc:243] Waited 560 ms on lock 0x7b54004015d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:15.642787 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:15.642950 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":180224,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":74,"spinlock_wait_cycles":1288427904}
I20260709 13:11:15.468657 26808 raft_consensus.cc:3060] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:15.690868 25345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:15.697743 25376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36254 (request call id 1566) took 1113 ms. Trace:
I20260709 13:11:15.657441 25226 rpcz_store.cc:276] 0709 13:11:14.544033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.679718 (+135685us) service_pool.cc:224] Handling call
0709 13:11:14.680125 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:14.796153 (+116028us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:11:14.852302 (+ 56149us) log.cc:844] Serialized 14 byte log entry
0709 13:11:14.852508 (+   206us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:14.852553 (+    45us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:14.852594 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:15.590850 (+738256us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b5400088ed4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:15.590917 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:15.591099 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":56676,"raft.queue_time_us":615,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":28403,"spinlock_wait_cycles":291148800}
I20260709 13:11:15.661024 25225 raft_consensus.cc:2468] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 3.
I20260709 13:11:15.662022 27049 raft_consensus.cc:3060] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:15.694043 26990 raft_consensus.cc:515] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:15.659271 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:15.696290 26852 leader_election.cc:290] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:15.698174 25376 rpcz_store.cc:276] 0709 13:11:14.584424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.594724 (+ 10300us) service_pool.cc:224] Handling call
0709 13:11:14.595487 (+   763us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:14.596645 (+  1158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:14.596672 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:14.606854 (+ 10182us) log.cc:844] Serialized 26 byte log entry
0709 13:11:15.158937 (+552083us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:11:15.168699 (+  9762us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:15.170110 (+  1411us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:15.697548 (+527438us) raft_consensus.cc:1685] finished
0709 13:11:15.697566 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:15.697688 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":183,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":98,"thread_start_us":445478,"threads_started":1,"wal-append.queue_time_us":774661}
W20260709 13:11:15.588703 27020 consensus_meta.cc:287] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent flushing consensus metadata: real 0.990s	user 0.011s	sys 0.001s
W20260709 13:11:15.701047 25342 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.004s	sys 0.050s
W20260709 13:11:15.719136 25342 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.004s	sys 0.050s
W20260709 13:11:15.399724 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 376832us
I20260709 13:11:15.721287 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:11:15.657847 25128 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.841s	user 0.008s	sys 0.028s
W20260709 13:11:15.700874 25269 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.740s	user 0.002s	sys 0.017s
W20260709 13:11:15.722622 25269 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.761s	user 0.002s	sys 0.017s
I20260709 13:11:15.692934 25227 raft_consensus.cc:2393] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 4: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
W20260709 13:11:15.580276 27038 log.cc:927] Time spent T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.533s	user 0.008s	sys 0.002s
I20260709 13:11:15.661931 25271 leader_election.cc:304] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:11:15.731376 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 69501us
I20260709 13:11:15.661935 26804 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:15.550034 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:15.738981 25874 leader_election.cc:304] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:11:15.663353 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
W20260709 13:11:15.712033 25372 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.996s	user 0.009s	sys 0.017s
W20260709 13:11:15.740485 25372 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.027s	user 0.009s	sys 0.017s
I20260709 13:11:15.716967 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:15.700124 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:15.742847 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:15.466275 26945 raft_consensus.cc:493] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
W20260709 13:11:15.717657 25270 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.757s	user 0.007s	sys 0.014s
I20260709 13:11:15.470836 26922 raft_consensus.cc:493] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.559891 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:15.656143 27035 raft_consensus.cc:493] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:15.318951 26914 leader_election.cc:290] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:15.497422 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:15.724658 26997 raft_consensus.cc:493] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.666082 26842 leader_election.cc:290] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:15.706123 27002 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.022s	sys 0.032s
I20260709 13:11:15.583771 27033 leader_election.cc:290] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:15.642205 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:15.733530 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:15.739575 27031 raft_consensus.cc:2804] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:11:15.638937 27039 log.cc:927] Time spent T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.724s	user 0.011s	sys 0.008s
I20260709 13:11:15.715905 27001 raft_consensus.cc:2749] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:11:15.750237 25270 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.789s	user 0.008s	sys 0.014s
I20260709 13:11:15.757058 25345 leader_election.cc:304] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:15.792273 25373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:36248 (request call id 81) took 1211 ms. Trace:
I20260709 13:11:15.751055 25379 raft_consensus.cc:1275] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:11:15.728071 26827 consensus_meta.cc:287] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 1.149s	user 0.010s	sys 0.001s
I20260709 13:11:15.724602 27060 raft_consensus.cc:493] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
W20260709 13:11:15.550926 25115 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 275226661cc840559134f8c9e5b15719 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 1f539ba21487460085b837e7529a78ce is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:11:15.773654 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:15.802732 25908 raft_consensus.cc:2468] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 5.
I20260709 13:11:15.803854 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:11:15.774298 25194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:15.754294 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 339323us
I20260709 13:11:15.806296 25195 leader_election.cc:304] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:15.778110 25376 raft_consensus.cc:1240] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:11:15.807247 25376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36264 (request call id 1220) took 1044 ms. Trace:
I20260709 13:11:15.807564 25376 rpcz_store.cc:276] 0709 13:11:14.763078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.777486 (+1014408us) service_pool.cc:224] Handling call
0709 13:11:15.777878 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:15.807008 (+ 29130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:15.807198 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:15.808043 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:15.691236 25904 raft_consensus.cc:2889] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:11:15.780509 25229 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.902s	user 0.032s	sys 0.033s
I20260709 13:11:15.738092 26804 raft_consensus.cc:3060] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:15.781061 25271 leader_election.cc:304] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:15.757733 25899 raft_consensus.cc:2468] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 3.
I20260709 13:11:15.753084 26945 raft_consensus.cc:3060] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:15.788208 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:15.794688 25379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36264 (request call id 1216) took 1033 ms. Trace:
I20260709 13:11:15.795635 25373 rpcz_store.cc:276] 0709 13:11:14.580870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.581058 (+   188us) service_pool.cc:224] Handling call
0709 13:11:15.780252 (+1199194us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b540024cf54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc75735 00007fd72fc6d9fa 00007fd734c354c9 00007fd72e1b1c54 00007fd72e1b1be2 00007fd72e1b1b11 00007fd72e1b1a8c 00007fd72e1b0d42 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:15.792191 (+ 11939us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":463349504}
I20260709 13:11:15.760565 27058 raft_consensus.cc:2804] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:15.758451 27035 raft_consensus.cc:3060] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:15.785778 27002 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.022s	sys 0.033s
I20260709 13:11:15.730492 27020 raft_consensus.cc:515] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:15.809265 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:15.703363 27023 consensus_queue.cc:260] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:15.758046 25221 raft_consensus.cc:2376] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 4. Re-sending same reply.
I20260709 13:11:15.814936 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:15.789428 27031 raft_consensus.cc:493] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:15.832474 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:15.787266 26997 raft_consensus.cc:515] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:15.817833 27075 raft_consensus.cc:493] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.785133 25374 raft_consensus.cc:2468] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 4.
I20260709 13:11:15.819371 25907 raft_consensus.cc:2468] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 3.
I20260709 13:11:15.819268 25379 rpcz_store.cc:276] 0709 13:11:14.761807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.744612 (+982805us) service_pool.cc:224] Handling call
0709 13:11:15.744967 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:15.794413 (+ 49446us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:15.794625 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:15.758268 27032 consensus_queue.cc:1048] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:11:15.794370 26772 raft_consensus.cc:493] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.753736 27062 consensus_queue.cc:1059] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.067s
I20260709 13:11:15.757786 26922 raft_consensus.cc:515] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:15.823868 25227 pending_rounds.cc:85] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce: Aborting all ops after (but not including) 6
I20260709 13:11:15.801271 27033 raft_consensus.cc:2804] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:11:15.818463 25115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 317305us
I20260709 13:11:15.826063 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:15.836890 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:15.827325 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:15.839180 25299 raft_consensus.cc:2393] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 2: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
W20260709 13:11:15.829154 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 48192.8us
I20260709 13:11:15.810927 27069 raft_consensus.cc:493] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:15.811045 25229 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.932s	user 0.033s	sys 0.033s
I20260709 13:11:15.811699 25195 leader_election.cc:304] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:15.787724 27070 consensus_queue.cc:1048] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:11:15.792420 27048 consensus_queue.cc:1048] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:11:15.802196 26827 raft_consensus.cc:515] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:16.004542 25227 pending_rounds.cc:107] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 13:11:16.004858 25271 leader_election.cc:304] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:15.819221 27001 raft_consensus.cc:2804] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:15.903080 25372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56308 (request call id 207) took 1351 ms. Trace:
W20260709 13:11:16.031103 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 219449us
I20260709 13:11:16.031042 25227 raft_consensus.cc:2889] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:15.807590 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:16.034667 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:16.030643 25372 rpcz_store.cc:276] 0709 13:11:14.551926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.577981 (+ 26055us) service_pool.cc:224] Handling call
0709 13:11:14.578281 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:14.578625 (+   344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:14.578650 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:14.579115 (+   465us) log.cc:844] Serialized 26 byte log entry
0709 13:11:15.740971 (+1161856us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:15.741030 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:15.741127 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:15.902857 (+161730us) raft_consensus.cc:1685] finished
0709 13:11:15.902874 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:15.903015 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6409,"raft.queue_time_us":883,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":32352,"thread_start_us":1027191,"threads_started":1,"wal-append.queue_time_us":1221680}
I20260709 13:11:16.036293 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:15.858378 25905 raft_consensus.cc:1240] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:16.032877 25195 leader_election.cc:304] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:16.037070 25372 raft_consensus.cc:1240] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:15.836323 27029 raft_consensus.cc:493] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:16.061830 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 57056.7us
I20260709 13:11:16.062186 25371 raft_consensus.cc:3060] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:16.033623 25229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58418 (request call id 1512) took 1428 ms. Trace:
W20260709 13:11:15.846541 27044 log.cc:927] Time spent T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
W20260709 13:11:15.900416 27040 log.cc:927] Time spent T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 1.021s	user 0.006s	sys 0.008s
I20260709 13:11:15.841864 27031 raft_consensus.cc:3060] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:15.964399 26990 leader_election.cc:290] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:15.953567 26768 leader_election.cc:290] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:16.038210 27055 raft_consensus.cc:2804] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:16.065462 27074 consensus_queue.cc:1048] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:11:15.859050 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:15.819995 27060 raft_consensus.cc:515] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:16.112555 25345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:16.072861 26977 raft_consensus.cc:493] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:15.839201 26989 raft_consensus.cc:493] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.074817 25230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54000 (request call id 237) took 1293 ms. Trace:
I20260709 13:11:15.902056 25223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58418 (request call id 1503) took 2019 ms. Trace:
I20260709 13:11:16.007822 26559 leader_election.cc:290] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:16.007285 27002 raft_consensus.cc:493] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:15.904605 25904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50060 (request call id 302) took 1552 ms. Trace:
I20260709 13:11:16.031688 26842 raft_consensus.cc:493] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.074179 25271 leader_election.cc:304] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:16.007895 27033 raft_consensus.cc:493] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:16.096087 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:11:16.134160 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 60060us
I20260709 13:11:15.858029 27020 leader_election.cc:290] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 5 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:16.034075 27001 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:16.074401 25229 rpcz_store.cc:276] 0709 13:11:14.605656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.776459 (+170803us) service_pool.cc:224] Handling call
0709 13:11:14.776762 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:14.808019 (+ 31257us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:14.808052 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:14.808598 (+   546us) log.cc:844] Serialized 26 byte log entry
0709 13:11:16.033318 (+1224720us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:16.033356 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:16.033420 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:16.033459 (+    39us) raft_consensus.cc:1685] finished
0709 13:11:16.033470 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:16.033569 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7190,"raft.queue_time_us":28606,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":166,"thread_start_us":1154468,"threads_started":1,"wal-append.queue_time_us":1004845}
I20260709 13:11:16.138852 25371 raft_consensus.cc:2468] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 3.
I20260709 13:11:16.037585 25374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36264 (request call id 1217) took 1275 ms. Trace:
I20260709 13:11:16.060042 27075 raft_consensus.cc:515] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:16.069072 26615 raft_consensus.cc:3055] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:16.068421 26816 raft_consensus.cc:2804] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:16.034034 25899 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 1.
I20260709 13:11:16.111617 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:16.180346 25226 raft_consensus.cc:3060] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:15.900483 27023 raft_consensus.cc:3060] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:15.859210 27034 raft_consensus.cc:515] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:16.116957 25230 rpcz_store.cc:276] 0709 13:11:14.781560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.706984 (+925424us) service_pool.cc:224] Handling call
0709 13:11:15.727407 (+ 20423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:15.745691 (+ 18284us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:15.745739 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:15.772221 (+ 26482us) log.cc:844] Serialized 26 byte log entry
0709 13:11:16.004020 (+231799us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:16.004087 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:16.004195 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:16.074615 (+ 70420us) raft_consensus.cc:1685] finished
0709 13:11:16.074638 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:16.074761 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":113,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":18395,"thread_start_us":210061,"threads_started":1,"wal-append.queue_time_us":290304}
I20260709 13:11:16.032941 26772 raft_consensus.cc:515] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:16.113389 26863 consensus_meta.cc:287] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.559s	user 0.007s	sys 0.004s
I20260709 13:11:16.045768 27069 raft_consensus.cc:515] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:16.112635 27055 raft_consensus.cc:697] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 4 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
W20260709 13:11:16.137960 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 105174us
I20260709 13:11:16.085011 27029 raft_consensus.cc:515] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:16.126547 27054 consensus_meta.cc:287] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent flushing consensus metadata: real 0.745s	user 0.011s	sys 0.002s
I20260709 13:11:15.969302 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:16.135177 25271 leader_election.cc:304] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:16.178891 25375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56308 (request call id 200) took 1631 ms. Trace:
W20260709 13:11:16.181536 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 230298us
W20260709 13:11:16.214684 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 79601.3us
I20260709 13:11:16.217213 25872 leader_election.cc:304] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:16.214584 25375 rpcz_store.cc:276] 0709 13:11:14.547568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.549859 (+  2291us) service_pool.cc:224] Handling call
0709 13:11:14.550266 (+   407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:14.550684 (+   418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:14.550723 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:14.551297 (+   574us) log.cc:844] Serialized 26 byte log entry
0709 13:11:14.777232 (+225935us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:14.777269 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:14.777331 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:16.178585 (+1401254us) raft_consensus.cc:1685] finished
0709 13:11:16.178613 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:16.178806 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2201,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":114,"thread_start_us":225621,"threads_started":1,"wal-append.queue_time_us":1145374}
I20260709 13:11:16.188911 26827 leader_election.cc:290] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:16.124920 27058 raft_consensus.cc:697] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:16.189414 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:16.135155 27033 raft_consensus.cc:3060] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:16.146610 27001 raft_consensus.cc:3060] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:16.195749 25304 raft_consensus.cc:2393] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 4: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:16.177071 26615 raft_consensus.cc:740] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:16.222990 25271 leader_election.cc:304] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:16.197300 26772 leader_election.cc:290] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:16.197695 26863 raft_consensus.cc:515] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:16.261530 26863 leader_election.cc:290] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:16.262212 27079 raft_consensus.cc:2804] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:16.146713 27032 raft_consensus.cc:2804] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:11:16.182297 26953 consensus_meta.cc:287] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.882s	user 0.012s	sys 0.002s
I20260709 13:11:16.263361 27032 raft_consensus.cc:493] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:16.263787 27032 raft_consensus.cc:3060] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:16.120476 26852 raft_consensus.cc:2749] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:16.206178 27069 leader_election.cc:290] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:16.205777 27055 consensus_queue.cc:237] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:16.179721 26816 raft_consensus.cc:493] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:16.120781 26977 raft_consensus.cc:515] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:16.127836 26989 raft_consensus.cc:515] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:16.276724 27080 raft_consensus.cc:2804] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:16.277223 27080 raft_consensus.cc:493] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:16.277618 27080 raft_consensus.cc:3060] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:16.278357 26989 leader_election.cc:290] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:16.278893 26989 raft_consensus.cc:493] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:16.279323 26989 raft_consensus.cc:515] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:16.281271 26989 leader_election.cc:290] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:16.281881 26804 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:16.283905 26804 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:16.257405 26979 raft_consensus.cc:3060] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:16.220737 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:16.286616 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:16.287104 26977 leader_election.cc:290] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:16.287195 25375 raft_consensus.cc:2468] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 2.
I20260709 13:11:16.288223 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:16.289136 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:16.289618 25375 raft_consensus.cc:2468] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 4.
I20260709 13:11:16.293707 27080 raft_consensus.cc:515] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:16.294711 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:16.295749 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:16.296408 27080 leader_election.cc:290] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:16.145990 26842 raft_consensus.cc:515] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:16.203680 27020 raft_consensus.cc:493] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.297390 27020 raft_consensus.cc:515] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:16.298978 26842 leader_election.cc:290] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:16.299367 27020 leader_election.cc:290] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:16.253286 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:16.300544 25372 raft_consensus.cc:2468] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 4.
I20260709 13:11:16.130518 25904 rpcz_store.cc:276] 0709 13:11:14.341031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.344144 (+  3113us) service_pool.cc:224] Handling call
0709 13:11:14.344550 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:15.848058 (+1503508us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:15.893835 (+ 45777us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:16.219511 26965 consensus_meta.cc:287] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 1.401s	user 0.012s	sys 0.001s
I20260709 13:11:16.258623 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:16.259207 26615 consensus_queue.cc:260] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:16.266472 25378 raft_consensus.cc:2410] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:11:16.217227 26914 raft_consensus.cc:2804] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:16.270511 25226 raft_consensus.cc:2468] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 4.
I20260709 13:11:16.181136 25374 rpcz_store.cc:276] 0709 13:11:14.762141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.361599 (+599458us) service_pool.cc:224] Handling call
0709 13:11:16.033294 (+671695us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:16.276892 27086 consensus_queue.cc:1059] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 13:11:16.296428 25375 raft_consensus.cc:2393] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 4: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:16.247058 25221 raft_consensus.cc:2468] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 4.
I20260709 13:11:16.301963 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:16.327697 25372 raft_consensus.cc:2468] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 1.
I20260709 13:11:16.328573 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:16.132540 27002 raft_consensus.cc:515] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:16.121134 25223 rpcz_store.cc:276] 0709 13:11:13.882608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.397391 (+514783us) service_pool.cc:224] Handling call
0709 13:11:15.328306 (+930915us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:15.710385 (+382079us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:15.901813 (+191428us) spinlock_profiling.cc:243] Waited 890 ms on lock 0x7b54000893d0. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6e8ad 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:15.901994 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2047645952}
W20260709 13:11:16.222640 25270 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 1.536s (SENT) [suppressed 21 similar messages]
I20260709 13:11:16.324747 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:16.326370 25195 leader_election.cc:304] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
W20260709 13:11:16.333029 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 110429us
I20260709 13:11:16.333609 25195 leader_election.cc:304] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468
W20260709 13:11:16.330052 25377 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56308 (request call id 205) took 1778 ms (client timeout 1593 ms). Trace:
W20260709 13:11:16.334584 25377 rpcz_store.cc:269] 0709 13:11:14.551396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.554789 (+  3393us) service_pool.cc:224] Handling call
0709 13:11:16.325630 (+1770841us) spinlock_profiling.cc:243] Waited 199 ms on lock 0x7b540024cf54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:16.329975 (+  4345us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":457020672}
I20260709 13:11:16.335455 25195 leader_election.cc:304] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:11:16.335647 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:16.336715 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:16.274596 26816 raft_consensus.cc:3060] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:16.217520 27085 consensus_queue.cc:1048] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.101s
I20260709 13:11:16.338896 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:16.339116 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:16.340255 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:16.340873 25372 raft_consensus.cc:2468] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 2.
I20260709 13:11:16.302007 26979 raft_consensus.cc:2749] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:16.343356 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:16.344816 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:16.344964 25195 leader_election.cc:304] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:16.313402 26997 leader_election.cc:290] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:16.220557 27054 raft_consensus.cc:515] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:16.311663 25222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1447) took 1796 ms. Trace:
I20260709 13:11:16.344177 26842 raft_consensus.cc:2804] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:16.348901 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:16.346590 25372 raft_consensus.cc:2468] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 3.
I20260709 13:11:16.350492 25375 raft_consensus.cc:2393] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 7: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
W20260709 13:11:16.333249 26973 consensus_meta.cc:287] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.916s	user 0.007s	sys 0.004s
I20260709 13:11:16.349884 27086 raft_consensus.cc:2804] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:16.353842 27075 leader_election.cc:290] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:16.355934 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:16.356678 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:16.357343 26772 consensus_queue.cc:1059] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:16.352523 27079 raft_consensus.cc:697] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 4 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:16.381050 27029 leader_election.cc:290] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:16.368999 27086 raft_consensus.cc:493] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:16.381875 27086 raft_consensus.cc:3060] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:16.381073 26772 raft_consensus.cc:3055] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:16.357386 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:16.360795 27001 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:16.335318 27021 leader_election.cc:290] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:16.366940 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:16.386703 25372 raft_consensus.cc:2468] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 1.
I20260709 13:11:16.335525 26852 raft_consensus.cc:2749] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:16.339550 26990 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.365191 25377 raft_consensus.cc:3060] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:16.315999 26965 raft_consensus.cc:515] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:16.347229 26615 raft_consensus.cc:3060] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:16.350131 27080 raft_consensus.cc:493] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.381183 25900 raft_consensus.cc:2393] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 2: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:11:16.359979 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:16.382867 26772 raft_consensus.cc:740] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:16.369566 25903 raft_consensus.cc:2410] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:11:16.399361 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:16.400133 25374 raft_consensus.cc:2468] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 3.
I20260709 13:11:16.400422 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:16.401105 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:16.363391 26989 raft_consensus.cc:3055] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:16.403064 26989 raft_consensus.cc:740] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:16.404135 26989 consensus_queue.cc:260] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:16.405347 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:16.405310 26989 raft_consensus.cc:3060] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:16.406142 27060 leader_election.cc:290] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:16.406968 26914 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:16.369040 27085 raft_consensus.cc:2749] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:16.411286 25224 raft_consensus.cc:1240] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:16.351123 25270 leader_election.cc:304] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
W20260709 13:11:16.395005 27049 consensus_meta.cc:287] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent flushing consensus metadata: real 0.662s	user 0.011s	sys 0.000s
I20260709 13:11:16.390570 25195 leader_election.cc:304] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:16.365036 26842 raft_consensus.cc:493] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:16.394951 25230 raft_consensus.cc:2468] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 2.
I20260709 13:11:16.379849 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:16.398947 27001 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:16.410660 27030 consensus_meta.cc:287] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 1.239s	user 0.012s	sys 0.000s
W20260709 13:11:16.416855 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 65809.2us
I20260709 13:11:16.422816 25377 raft_consensus.cc:2468] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 3.
I20260709 13:11:16.425107 25195 leader_election.cc:304] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:16.413743 25374 raft_consensus.cc:2393] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 4: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:16.381729 27079 consensus_queue.cc:237] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:16.399312 26921 consensus_meta.cc:287] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 1.024s	user 0.009s	sys 0.002s
I20260709 13:11:16.383116 26973 raft_consensus.cc:515] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:11:16.444797 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:16.445006 25195 leader_election.cc:304] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:16.458220 25377 raft_consensus.cc:2468] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 3.
I20260709 13:11:16.410311 26914 raft_consensus.cc:3060] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:16.399395 27080 raft_consensus.cc:515] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:16.452308 25345 leader_election.cc:304] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:16.424198 26842 raft_consensus.cc:3060] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:16.394260 26990 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:16.435029 27034 leader_election.cc:290] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:16.477490 25378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36264 (request call id 1218) took 1715 ms. Trace:
I20260709 13:11:16.478041 25378 rpcz_store.cc:276] 0709 13:11:14.762468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.720409 (+957941us) service_pool.cc:224] Handling call
0709 13:11:16.477220 (+756811us) spinlock_profiling.cc:243] Waited 544 ms on lock 0x7b54000b9354. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:16.477414 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1250691456}
I20260709 13:11:16.423935 27090 raft_consensus.cc:2749] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:16.441592 26852 raft_consensus.cc:2804] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:16.465384 25345 leader_election.cc:304] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
W20260709 13:11:16.490075 27026 log.cc:927] Time spent T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 1.682s	user 0.011s	sys 0.011s
I20260709 13:11:16.463578 27029 raft_consensus.cc:493] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:16.473384 26953 raft_consensus.cc:2804] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:16.454483 26989 raft_consensus.cc:2804] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:16.468374 27091 raft_consensus.cc:2804] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:11:16.472702 27083 log.cc:927] Time spent T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.171s	user 0.002s	sys 0.000s
W20260709 13:11:16.479688 25370 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36264 (request call id 1227) took 1714 ms (client timeout 1684 ms). Trace:
W20260709 13:11:16.529345 25370 rpcz_store.cc:269] 0709 13:11:14.765184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.469790 (+1704606us) service_pool.cc:211] Skipping call since client already timed out
0709 13:11:16.479604 (+  9814us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:11:16.499023 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 59075.4us
I20260709 13:11:16.426554 27049 raft_consensus.cc:515] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:16.506013 25345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:16.455554 27086 raft_consensus.cc:515] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:16.464071 26921 raft_consensus.cc:515] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:16.475999 25900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50060 (request call id 317) took 1455 ms. Trace:
W20260709 13:11:16.502995 27005 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.456s	user 0.004s	sys 0.034s
I20260709 13:11:16.396687 27058 consensus_queue.cc:237] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:16.530146 27091 raft_consensus.cc:493] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
W20260709 13:11:16.488968 27046 log.cc:927] Time spent T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 1.243s	user 0.003s	sys 0.000s
I20260709 13:11:16.501272 25904 raft_consensus.cc:2410] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:11:16.451831 27030 raft_consensus.cc:515] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:16.505129 26808 consensus_meta.cc:287] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.785s	user 0.015s	sys 0.000s
I20260709 13:11:16.485033 25901 raft_consensus.cc:1240] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:16.524914 25228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1438) took 2343 ms. Trace:
I20260709 13:11:16.591645 25228 rpcz_store.cc:276] 0709 13:11:14.181905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.429081 (+247176us) service_pool.cc:224] Handling call
0709 13:11:14.429335 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:15.138574 (+709239us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:15.138603 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:15.138643 (+    40us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:15.138671 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:16.524654 (+1385983us) spinlock_profiling.cc:243] Waited 709 ms on lock 0x7b54000884d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:16.524700 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:16.524852 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1630681984}
I20260709 13:11:16.543533 26953 raft_consensus.cc:697] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 4 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:16.491499 25374 raft_consensus.cc:1240] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:16.533705 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:16.473692 26863 consensus_queue.cc:1059] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:11:16.501596 26852 raft_consensus.cc:493] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:16.504738 27095 raft_consensus.cc:493] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.490732 26965 leader_election.cc:290] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:16.541515 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:16.492056 25378 raft_consensus.cc:1240] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:16.492759 27080 leader_election.cc:290] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:16.546365 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 289463us
I20260709 13:11:16.486007 27034 consensus_queue.cc:1048] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:11:16.609409 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:16.562783 27091 raft_consensus.cc:3060] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:16.514226 26559 raft_consensus.cc:2804] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:16.524441 26989 raft_consensus.cc:493] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:16.591127 25902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50060 (request call id 312) took 2135 ms. Trace:
I20260709 13:11:16.553210 25302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46556 (request call id 186) took 2474 ms. Trace:
I20260709 13:11:16.469950 27001 raft_consensus.cc:493] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
W20260709 13:11:16.553021 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 99599.6us
W20260709 13:11:16.553551 27005 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.506s	user 0.004s	sys 0.034s
I20260709 13:11:16.561200 25224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54000 (request call id 236) took 1780 ms. Trace:
I20260709 13:11:16.638388 25224 rpcz_store.cc:276] 0709 13:11:14.781289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.158126 (+376837us) service_pool.cc:224] Handling call
0709 13:11:15.158441 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:16.411798 (+1253357us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:16.560860 (+149062us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b5400041854. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:16.561124 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2880755456}
I20260709 13:11:16.639608 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:16.539597 27021 raft_consensus.cc:493] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
W20260709 13:11:16.566670 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 321622us
I20260709 13:11:16.497817 26772 consensus_queue.cc:260] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:16.516012 27029 raft_consensus.cc:515] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:16.362857 25222 rpcz_store.cc:276] 0709 13:11:14.512215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.516648 (+  4433us) service_pool.cc:224] Handling call
0709 13:11:15.971919 (+1455271us) spinlock_profiling.cc:243] Waited 901 us on lock 0x7b5800002a98. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72cb4ab71 00007fd72cb4aa22 00007fd735a63c09 00007fd734bbdee0 00007fd734c870ab 00007fd734c87131 00007fd734c48fc0 00007fd734c33929 00007fd734c333d2 00007fd72e1aabd4
0709 13:11:16.037969 (+ 66050us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:16.215956 (+177987us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:16.217911 (+  1955us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:16.245626 (+ 27715us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:11:16.246430 (+   804us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:16.268331 (+ 21901us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:16.308243 (+ 39912us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":23409,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":10014,"spinlock_wait_cycles":2072960,"thread_start_us":123009,"threads_started":1}
W20260709 13:11:16.494285 27028 consensus_meta.cc:287] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 1.186s	user 0.007s	sys 0.005s
I20260709 13:11:16.558086 27054 leader_election.cc:290] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:16.546916 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 96085.5us
I20260709 13:11:16.639350 27060 raft_consensus.cc:3055] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:16.616605 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:16.617933 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:16.663851 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:16.619022 27095 raft_consensus.cc:515] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:16.621673 25228 raft_consensus.cc:1240] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:16.601945 25221 raft_consensus.cc:2393] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 4: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:16.592744 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:16.515442 27075 raft_consensus.cc:493] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:16.683495 27075 raft_consensus.cc:515] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:16.684376 26945 consensus_meta.cc:287] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.851s	user 0.009s	sys 0.000s
I20260709 13:11:16.684813 26945 raft_consensus.cc:515] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:16.685918 25223 raft_consensus.cc:3060] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:16.661170 27028 raft_consensus.cc:515] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:16.687947 27028 leader_election.cc:290] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:16.688473 27086 leader_election.cc:290] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:16.648092 27001 raft_consensus.cc:515] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:16.689739 25301 raft_consensus.cc:2368] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 4. Current term is 5.
I20260709 13:11:16.629446 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:16.549548 25900 rpcz_store.cc:276] 0709 13:11:15.020654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.021784 (+  1130us) service_pool.cc:224] Handling call
0709 13:11:16.475685 (+1453901us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400276ad4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:16.475913 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2442996480}
I20260709 13:11:16.690613 27001 leader_election.cc:290] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:16.601581 25904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50058 (request call id 488) took 1018 ms. Trace:
I20260709 13:11:16.628836 25302 rpcz_store.cc:276] 0709 13:11:14.071920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.072050 (+   130us) service_pool.cc:224] Handling call
0709 13:11:14.072422 (+   372us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:14.072791 (+   369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:14.072819 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:14.073422 (+   603us) log.cc:844] Serialized 52 byte log entry
0709 13:11:14.428724 (+355302us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:14.428777 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:14.428871 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:16.397175 (+1968304us) spinlock_profiling.cc:243] Waited 5.55 ms on lock 0x7b4400022b4c. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72caa8c85 00007fd72caa96a2 00007fd72f81b1db 00007fd72f816aaf 00007fd72f80a86e 00007fd72f809bb6 00007fd72f8097d8 00007fd72f813221 00007fd72f8131d9 00007fd72f813169
0709 13:11:16.542249 (+145074us) raft_consensus.cc:1685] finished
0709 13:11:16.542270 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:16.546507 (+  4237us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1854,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":45542,"spinlock_wait_cycles":12772736,"thread_start_us":354877,"threads_started":1,"wal-append.queue_time_us":505858}
I20260709 13:11:16.557928 27108 raft_consensus.cc:493] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:16.642522 25874 leader_election.cc:304] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:16.554173 27032 raft_consensus.cc:515] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:16.593506 26808 raft_consensus.cc:515] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:16.595981 25115 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 275226661cc840559134f8c9e5b15719 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 1f539ba21487460085b837e7529a78ce is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:11:16.628419 26989 raft_consensus.cc:3060] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:16.620805 26559 raft_consensus.cc:493] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:16.614710 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:16.668268 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:16.671516 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:16.682163 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:16.780298 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:16.781001 25370 raft_consensus.cc:3060] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:16.682796 25903 raft_consensus.cc:1275] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:16.783139 25903 raft_consensus.cc:3060] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:16.682682 27005 consensus_queue.cc:1059] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:16.689564 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:16.786314 25226 raft_consensus.cc:2468] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 1.
I20260709 13:11:16.606364 26852 raft_consensus.cc:3060] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:16.700410 25908 raft_consensus.cc:2410] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:11:16.647357 27103 raft_consensus.cc:493] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.662020 27060 raft_consensus.cc:740] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:16.685588 27075 leader_election.cc:290] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:16.666859 26973 leader_election.cc:290] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:16.770061 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 161120us
I20260709 13:11:16.646477 27021 raft_consensus.cc:515] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:16.650934 26953 consensus_queue.cc:237] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:16.788069 25378 raft_consensus.cc:2393] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 4: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:16.654528 26768 consensus_queue.cc:1048] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.113s
I20260709 13:11:16.792475 25225 raft_consensus.cc:2410] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:11:16.768914 26980 raft_consensus.cc:493] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:16.777688 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 135265us
I20260709 13:11:16.777951 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:16.791563 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
W20260709 13:11:16.800836 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 130821us
I20260709 13:11:17.115290 25874 leader_election.cc:304] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:17.116677 27054 raft_consensus.cc:2749] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:17.117055 25874 leader_election.cc:304] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:11:17.118597 27048 consensus_queue.cc:1059] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:17.119546 25222 raft_consensus.cc:2468] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 2.
I20260709 13:11:17.111495 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:17.119933 27048 raft_consensus.cc:3055] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:17.120530 27048 raft_consensus.cc:740] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:16.799319 27108 raft_consensus.cc:515] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:17.121044 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:17.121343 27048 consensus_queue.cc:260] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:17.122121 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:17.122799 27048 raft_consensus.cc:3060] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:17.123127 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:17.123255 27049 leader_election.cc:290] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:17.123380 27108 leader_election.cc:290] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:17.123699 25378 raft_consensus.cc:2468] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 4.
W20260709 13:11:16.787621 25115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 193746us
I20260709 13:11:17.118623 25270 leader_election.cc:304] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:16.810333 25375 raft_consensus.cc:1275] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:17.124670 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:17.129387 25378 raft_consensus.cc:2468] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 4.
I20260709 13:11:17.118784 25874 leader_election.cc:304] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:17.131031 25378 raft_consensus.cc:1240] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:16.751039 25904 rpcz_store.cc:276] 0709 13:11:15.580475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.347998 (+767523us) service_pool.cc:224] Handling call
0709 13:11:16.598364 (+250366us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:16.628700 25902 rpcz_store.cc:276] 0709 13:11:14.430533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.432282 (+  1749us) service_pool.cc:224] Handling call
0709 13:11:14.449192 (+ 16910us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:14.774300 (+325108us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:14.782741 (+  8441us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:14.807701 (+ 24960us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:14.813402 (+  5701us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:16.544794 (+1731392us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b54003570d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:16.547419 (+  2625us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:16.562701 (+ 15282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":623836928}
I20260709 13:11:16.787786 26559 raft_consensus.cc:3060] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:16.858047 27093 log.cc:927] Time spent T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.311s	user 0.001s	sys 0.000s
I20260709 13:11:17.125702 25370 raft_consensus.cc:2410] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:11:16.799853 27023 raft_consensus.cc:2804] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:17.129385 25375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36264 (request call id 1235) took 1413 ms. Trace:
W20260709 13:11:17.092638 26886 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.010s	sys 0.007s
W20260709 13:11:17.096184 27109 log.cc:927] Time spent T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.295s	user 0.000s	sys 0.000s
I20260709 13:11:17.105297 27030 leader_election.cc:290] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:17.136140 25270 leader_election.cc:304] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:16.801851 26816 raft_consensus.cc:515] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:17.141289 25375 rpcz_store.cc:276] 0709 13:11:15.715626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.788322 (+1072696us) service_pool.cc:224] Handling call
0709 13:11:16.797386 (+  9064us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:17.129078 (+331692us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:17.129329 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:17.159483 25375 raft_consensus.cc:1240] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:17.143821 25370 pending_rounds.cc:85] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468: Aborting all ops after (but not including) 4
W20260709 13:11:17.095501 27097 log.cc:927] Time spent T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:11:17.101222 26921 leader_election.cc:290] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:16.855089 26863 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:17.156720 25270 leader_election.cc:304] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:17.160590 25370 pending_rounds.cc:107] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:11:17.177129 25370 raft_consensus.cc:2889] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:17.135109 27075 raft_consensus.cc:2749] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:11:17.140946 27033 consensus_meta.cc:287] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.879s	user 0.007s	sys 0.003s
W20260709 13:11:17.155730 26886 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.014s	sys 0.007s
W20260709 13:11:17.166852 27035 consensus_meta.cc:287] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 1.325s	user 0.011s	sys 0.002s
W20260709 13:11:17.165622 25871 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:17.134068 26989 raft_consensus.cc:515] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:17.158267 27023 raft_consensus.cc:697] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:17.193563 25270 leader_election.cc:304] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:17.135686 27049 raft_consensus.cc:3060] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:17.174933 26945 leader_election.cc:290] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:17.101642 27060 consensus_queue.cc:260] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:17.197184 27096 log.cc:927] Time spent T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.493s	user 0.000s	sys 0.001s
I20260709 13:11:17.182210 27102 raft_consensus.cc:2804] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:17.203855 25228 raft_consensus.cc:1240] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:11:17.191562 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:17.198266 26973 raft_consensus.cc:2804] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:17.181116 26863 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:17.209878 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 54726.3us
I20260709 13:11:17.200800 27075 raft_consensus.cc:2804] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:17.202585 26808 leader_election.cc:290] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:17.204609 27102 raft_consensus.cc:493] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:16.856755 27103 raft_consensus.cc:515] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:17.215721 26615 consensus_meta.cc:287] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.819s	user 0.010s	sys 0.000s
I20260709 13:11:17.215698 27001 raft_consensus.cc:493] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:17.219504 27001 raft_consensus.cc:515] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:17.220242 26863 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:17.220788 27021 leader_election.cc:290] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:17.221673 26989 leader_election.cc:290] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:17.205288 27032 leader_election.cc:290] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:17.130180 26980 raft_consensus.cc:515] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:17.229806 27043 raft_consensus.cc:2804] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:17.230309 27043 raft_consensus.cc:493] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:17.230674 27043 raft_consensus.cc:3060] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:17.215970 27112 log.cc:927] Time spent T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 13:11:17.222131 25374 raft_consensus.cc:3060] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:17.211128 26973 raft_consensus.cc:493] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:17.190052 27033 raft_consensus.cc:515] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:11:17.192421 27035 raft_consensus.cc:515] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:17.238154 25195 leader_election.cc:304] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:17.217425 27060 raft_consensus.cc:3060] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:17.245061 25873 leader_election.cc:304] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:17.244045 25195 leader_election.cc:304] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:17.217281 27102 raft_consensus.cc:3060] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:17.222782 27075 raft_consensus.cc:697] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 3 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:17.251261 25195 leader_election.cc:304] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:17.257997 27055 consensus_queue.cc:1059] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:17.258848 27086 raft_consensus.cc:3055] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:17.259353 27086 raft_consensus.cc:740] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:17.260056 25195 leader_election.cc:304] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:17.260818 27055 raft_consensus.cc:2804] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:17.260329 27086 consensus_queue.cc:260] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:17.261193 27055 raft_consensus.cc:493] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:17.261605 27055 raft_consensus.cc:3060] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:17.261955 27086 raft_consensus.cc:3060] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:17.255604 27108 raft_consensus.cc:2804] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:17.263336 27108 raft_consensus.cc:493] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:17.263731 27108 raft_consensus.cc:3060] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:17.264585 25195 leader_election.cc:304] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:17.244736 26973 raft_consensus.cc:3060] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:17.235666 27001 leader_election.cc:290] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:17.216677 27095 leader_election.cc:290] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:17.250416 27021 raft_consensus.cc:2804] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:17.250344 27058 raft_consensus.cc:2749] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:17.252779 27054 consensus_queue.cc:1059] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:11:17.275676 25375 raft_consensus.cc:1240] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 4 LEADER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:17.267244 27115 raft_consensus.cc:2804] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:17.274385 27021 raft_consensus.cc:493] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:17.277760 27079 raft_consensus.cc:493] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.276289 27001 raft_consensus.cc:2804] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:17.275424 27075 consensus_queue.cc:237] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:17.280589 27002 leader_election.cc:290] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:17.282079 27115 raft_consensus.cc:493] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:17.304804 27091 consensus_meta.cc:287] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 0.665s	user 0.006s	sys 0.000s
I20260709 13:11:17.285727 26980 leader_election.cc:290] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:17.293987 27021 raft_consensus.cc:3060] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:17.272083 27023 consensus_queue.cc:237] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:17.296011 26816 leader_election.cc:290] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:17.296047 27001 raft_consensus.cc:493] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:17.318596 27035 leader_election.cc:290] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:17.319257 27116 log.cc:927] Time spent T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
W20260709 13:11:17.319820 27037 log.cc:927] Time spent T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 1.853s	user 0.003s	sys 0.000s
I20260709 13:11:17.306095 27095 consensus_queue.cc:1048] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:11:17.320658 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:17.321269 25378 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 4.
I20260709 13:11:17.322978 25378 raft_consensus.cc:1240] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 3 LEADER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:11:17.309654 27115 raft_consensus.cc:3060] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:17.329069 25223 consensus_meta.cc:287] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 0.643s	user 0.009s	sys 0.000s
I20260709 13:11:17.329454 25223 raft_consensus.cc:2468] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 7.
I20260709 13:11:17.297408 27079 raft_consensus.cc:515] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:17.322207 27001 raft_consensus.cc:3060] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:17.337929 27043 raft_consensus.cc:515] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:17.329916 25903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50060 (request call id 321) took 1496 ms. Trace:
I20260709 13:11:17.314703 27091 raft_consensus.cc:515] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:17.349879 26914 consensus_meta.cc:287] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.877s	user 0.011s	sys 0.000s
W20260709 13:11:17.347532 27031 consensus_meta.cc:287] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 1.237s	user 0.010s	sys 0.002s
I20260709 13:11:17.363436 25194 leader_election.cc:304] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:17.365195 27095 raft_consensus.cc:2749] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:17.368572 25345 leader_election.cc:304] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
W20260709 13:11:17.371686 25194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:17.372182 27033 leader_election.cc:290] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:17.372803 27033 raft_consensus.cc:2804] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:17.372933 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:17.346076 25903 rpcz_store.cc:276] 0709 13:11:15.833369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.782561 (+949192us) service_pool.cc:224] Handling call
0709 13:11:16.782974 (+   413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:17.329533 (+546559us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:17.329569 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:17.329613 (+    44us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:17.329651 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:17.329717 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:17.329860 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":33591,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":955,"thread_start_us":35306,"threads_started":1}
I20260709 13:11:17.374253 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:17.374609 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:17.374778 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:17.374979 25229 raft_consensus.cc:2393] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 3: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:17.375856 27103 leader_election.cc:290] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:17.379120 26922 leader_election.cc:290] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:17.376745 27033 raft_consensus.cc:697] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 7 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:17.389039 27033 consensus_queue.cc:237] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:17.390609 25229 raft_consensus.cc:1240] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:17.394079 25301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46556 (request call id 197) took 1593 ms. Trace:
I20260709 13:11:17.394464 25301 rpcz_store.cc:276] 0709 13:11:15.801006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.801155 (+   149us) service_pool.cc:224] Handling call
0709 13:11:16.405179 (+604024us) spinlock_profiling.cc:243] Waited 5.94 ms on lock 0x7b5800114098. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72cb4ab71 00007fd72cb4aa22 00007fd735a63c09 00007fd734bbdee0 00007fd734c870ab 00007fd734c87131 00007fd734c350a0 00007fd734c34984 00007fd72e1af6d4 00007fd72e1af662
0709 13:11:17.393907 (+988728us) spinlock_profiling.cc:243] Waited 284 ms on lock 0x7b54004001d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:17.394029 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":665904768}
W20260709 13:11:17.389717 26852 consensus_meta.cc:287] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 0.581s	user 0.005s	sys 0.005s
I20260709 13:11:17.399070 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:17.379457 27043 leader_election.cc:290] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 3 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:17.351052 27102 raft_consensus.cc:515] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:17.410872 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:17.360224 26914 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:17.411906 25225 raft_consensus.cc:2393] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 5: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:17.377707 27031 raft_consensus.cc:515] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:17.417577 27132 log.cc:927] Time spent T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:11:17.405632 26852 raft_consensus.cc:515] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:17.405217 27091 leader_election.cc:290] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:17.420989 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
W20260709 13:11:17.421777 27063 log.cc:927] Time spent T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 1.628s	user 0.004s	sys 0.000s
I20260709 13:11:17.433903 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:17.437808 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:17.437815 25300 raft_consensus.cc:1240] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:17.435859 25906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50058 (request call id 496) took 1219 ms. Trace:
I20260709 13:11:17.442044 25906 rpcz_store.cc:276] 0709 13:11:16.216866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.419088 (+1202222us) service_pool.cc:224] Handling call
0709 13:11:17.435476 (+ 16388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:17.435645 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:17.435673 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:17.435700 (+    27us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:17.435718 (+    18us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:17.435750 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:17.435819 (+    69us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:17.448297 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:17.448925 25230 raft_consensus.cc:3060] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:17.451056 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:17.433648 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:17.460711 27049 raft_consensus.cc:2749] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:17.450588 26953 consensus_queue.cc:1059] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.011s
W20260709 13:11:17.465222 26842 consensus_meta.cc:287] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 0.986s	user 0.009s	sys 0.002s
I20260709 13:11:17.465819 26842 raft_consensus.cc:515] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:17.468369 25229 raft_consensus.cc:1240] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:17.455255 27134 raft_consensus.cc:493] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:17.479702 26973 raft_consensus.cc:515] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:17.492287 25905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50058 (request call id 486) took 2017 ms. Trace:
I20260709 13:11:17.485185 27079 leader_election.cc:290] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:17.492892 25905 rpcz_store.cc:276] 0709 13:11:15.475288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.475444 (+   156us) service_pool.cc:224] Handling call
0709 13:11:15.550287 (+ 74843us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:16.072859 (+522572us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:17.491984 (+1419125us) spinlock_profiling.cc:243] Waited 308 ms on lock 0x7b54004b4bd4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:17.492212 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":707958528}
I20260709 13:11:17.471755 27033 raft_consensus.cc:3055] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:17.494175 25222 raft_consensus.cc:2393] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 3: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:17.472095 26842 leader_election.cc:290] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:17.504577 26852 leader_election.cc:290] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:17.481863 26973 leader_election.cc:290] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:17.507879 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:17.512791 25370 raft_consensus.cc:3060] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:17.501240 25344 connection.cc:256] RPC call timeout handler was delayed by -1.1647672449998936s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1988s for a response
I20260709 13:11:17.482007 27108 raft_consensus.cc:515] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:17.481652 27001 raft_consensus.cc:515] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:17.483490 27134 raft_consensus.cc:515] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:17.535708 27134 leader_election.cc:290] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:17.500458 26989 raft_consensus.cc:493] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.508565 26953 raft_consensus.cc:493] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.535897 27001 leader_election.cc:290] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:17.536585 26989 raft_consensus.cc:515] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:17.536594 26953 raft_consensus.cc:515] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:17.516264 27115 raft_consensus.cc:515] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:17.509367 27033 raft_consensus.cc:740] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:17.540071 25230 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 3.
I20260709 13:11:17.523379 26786 raft_consensus.cc:493] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.550599 26914 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:17.550374 27033 consensus_queue.cc:260] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:17.550726 26786 raft_consensus.cc:515] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:17.551196 26953 leader_election.cc:290] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:17.551555 27033 raft_consensus.cc:3060] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:17.552286 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:17.552976 26786 leader_election.cc:290] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:17.511798 25374 raft_consensus.cc:2468] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 5.
I20260709 13:11:17.557808 27102 leader_election.cc:290] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:17.530072 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:11:17.566121 25899 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50056 (request call id 394) took 1845 ms (client timeout 2194 ms). Trace:
W20260709 13:11:17.566501 25899 rpcz_store.cc:269] 0709 13:11:15.720884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.497194 (+1776310us) service_pool.cc:224] Handling call
0709 13:11:17.566062 (+ 68868us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:17.569883 27138 log.cc:927] Time spent T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:11:17.531505 26923 raft_consensus.cc:493] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
W20260709 13:11:17.570465 27137 log.cc:927] Time spent T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:11:17.570807 26923 raft_consensus.cc:515] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:17.572260 25225 raft_consensus.cc:1240] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:17.500604 26559 raft_consensus.cc:515] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:17.575690 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:17.576525 25226 raft_consensus.cc:2468] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 3.
I20260709 13:11:17.577666 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:17.573614 25370 raft_consensus.cc:2468] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 4.
I20260709 13:11:17.579478 25873 leader_election.cc:304] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
W20260709 13:11:17.565039 27143 log.cc:927] Time spent T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:11:17.510354 27055 raft_consensus.cc:515] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:17.584456 27115 leader_election.cc:290] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:17.589834 25376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36264 (request call id 1224) took 2825 ms. Trace:
I20260709 13:11:17.590204 25376 rpcz_store.cc:276] 0709 13:11:14.764338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.808365 (+1044027us) service_pool.cc:224] Handling call
0709 13:11:15.808632 (+   267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:16.066714 (+258082us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:16.066746 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:16.069224 (+  2478us) log.cc:844] Serialized 26 byte log entry
0709 13:11:16.306767 (+237543us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:11:16.307242 (+   475us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:17.581951 (+1274709us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b5400311fd4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:17.581998 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:17.582041 (+    43us) raft_consensus.cc:1685] finished
0709 13:11:17.582053 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:17.589776 (+  7723us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":300,"raft.queue_time_us":2479,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":22656,"spinlock_wait_cycles":592015744,"thread_start_us":192593,"threads_started":1,"wal-append.queue_time_us":287267,"wal-append.run_cpu_time_us":1484,"wal-append.run_wall_time_us":1009274}
W20260709 13:11:17.585145 25871 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:17.581429 25345 leader_election.cc:304] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:17.562757 26914 raft_consensus.cc:493] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:17.594924 27140 log.cc:927] Time spent T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 13:11:17.578157 25222 raft_consensus.cc:3060] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:17.588424 25223 raft_consensus.cc:2393] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 4: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:17.580233 27031 leader_election.cc:290] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:17.611192 25345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:17.589344 26980 raft_consensus.cc:2804] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:17.609412 27023 raft_consensus.cc:493] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.609993 27035 raft_consensus.cc:2804] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:17.618937 26980 raft_consensus.cc:697] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:17.619479 25373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36254 (request call id 1575) took 2451 ms. Trace:
I20260709 13:11:17.620572 26559 leader_election.cc:290] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:17.588217 27021 raft_consensus.cc:515] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:17.612151 27108 leader_election.cc:290] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:17.627750 25373 rpcz_store.cc:276] 0709 13:11:15.168299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.826489 (+658190us) service_pool.cc:224] Handling call
0709 13:11:15.826800 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:16.007491 (+180691us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:11:16.007528 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:16.007579 (+    51us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:11:16.007620 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:17.619235 (+1611615us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b54002878d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:17.619278 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:17.619425 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2049,"raft.queue_time_us":2524,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":6344,"spinlock_wait_cycles":409917312}
I20260709 13:11:17.603248 26914 raft_consensus.cc:515] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:17.631634 26980 consensus_queue.cc:237] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:17.632825 26914 leader_election.cc:290] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:17.634187 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:17.634732 27062 raft_consensus.cc:493] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:17.634990 25301 raft_consensus.cc:2410] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:11:17.630231 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:17.636742 25226 raft_consensus.cc:2393] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 5: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:17.636610 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:17.636986 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:17.637405 25304 raft_consensus.cc:2368] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 2. Current term is 3.
I20260709 13:11:17.637595 25297 raft_consensus.cc:2393] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 4: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:17.638427 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:17.638731 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:17.639110 25304 raft_consensus.cc:2393] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 7: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:17.639307 25299 raft_consensus.cc:2468] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 4.
I20260709 13:11:17.640079 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:17.641013 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:17.642045 25303 raft_consensus.cc:1240] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:17.643062 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:17.643748 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:17.644225 25298 raft_consensus.cc:2393] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 3: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:17.646742 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:17.639825 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:17.647554 25303 raft_consensus.cc:2410] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:11:17.647603 25304 raft_consensus.cc:2468] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 2.
I20260709 13:11:17.648483 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:17.648576 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:17.648898 25304 raft_consensus.cc:3060] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:17.649348 25299 raft_consensus.cc:2410] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:11:17.650472 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:17.651664 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:17.652280 25302 raft_consensus.cc:2393] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 7: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:17.652423 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:17.654203 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:17.656246 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:17.656827 25298 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 2.
I20260709 13:11:17.662665 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:17.627408 27035 raft_consensus.cc:493] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:17.663473 25303 raft_consensus.cc:2410] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:11:17.627295 27023 raft_consensus.cc:515] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:17.668646 25305 raft_consensus.cc:1275] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:17.683640 25302 raft_consensus.cc:1275] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:17.694546 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:17.771302 25195 leader_election.cc:304] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:17.772270 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:17.773098 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:17.773295 25298 raft_consensus.cc:2393] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 4: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:17.773728 25225 raft_consensus.cc:2468] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 4.
I20260709 13:11:17.701658 25344 leader_election.cc:304] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:17.774629 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:17.704821 25304 raft_consensus.cc:2468] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 4.
W20260709 13:11:17.775533 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 73995.1us
I20260709 13:11:17.776316 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:17.777312 25304 raft_consensus.cc:2393] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 3: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:17.715739 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:17.622066 25902 raft_consensus.cc:2468] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 3.
I20260709 13:11:17.701644 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:17.779582 25228 raft_consensus.cc:2393] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 4: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:17.781388 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:17.781984 25226 raft_consensus.cc:3060] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:17.791520 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:17.792516 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:17.792546 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:17.793401 25297 raft_consensus.cc:2468] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 4.
I20260709 13:11:17.715786 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:17.716156 27115 raft_consensus.cc:493] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:17.784358 25298 raft_consensus.cc:1240] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 3 LEADER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:17.668742 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:17.799124 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:17.801630 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:17.802822 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:17.684593 25903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50060 (request call id 322) took 1828 ms. Trace:
W20260709 13:11:17.789971 27054 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.003s	sys 0.020s
I20260709 13:11:17.778386 27060 raft_consensus.cc:2749] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:17.779208 27108 raft_consensus.cc:2749] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:17.806124 25297 raft_consensus.cc:2393] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 4: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:17.783751 27001 raft_consensus.cc:493] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.782954 27055 leader_election.cc:290] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:17.778577 27035 raft_consensus.cc:3060] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:17.812389 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:17.813025 25298 raft_consensus.cc:1275] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:17.655642 27062 raft_consensus.cc:515] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:17.830916 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:17.795491 26923 leader_election.cc:290] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:17.780870 27033 consensus_queue.cc:1048] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:11:17.830978 25226 raft_consensus.cc:2468] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 4.
I20260709 13:11:17.832327 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:11:17.821965 25194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:17.847584 25907 raft_consensus.cc:2468] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 4.
W20260709 13:11:17.848285 25907 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50056 (request call id 396) took 2126 ms (client timeout 2401 ms). Trace:
W20260709 13:11:17.848603 25907 rpcz_store.cc:269] 0709 13:11:15.721383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.251073 (+529690us) service_pool.cc:224] Handling call
0709 13:11:17.832191 (+1581118us) spinlock_profiling.cc:243] Waited 3.65 ms on lock 0x7b58001a3198. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72cb4ab71 00007fd72cb4aa22 00007fd735a63c09 00007fd734bbdee0 00007fd734c870ab 00007fd734c87131 00007fd734c350a0 00007fd734c34984 00007fd72e1af6d4 00007fd72e1af662
0709 13:11:17.848216 (+ 16025us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8386816}
I20260709 13:11:17.849047 27108 raft_consensus.cc:493] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.849730 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:17.849556 27108 raft_consensus.cc:515] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:17.850446 25907 raft_consensus.cc:2393] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 2: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:11:17.851142 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:17.851775 27108 leader_election.cc:290] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:17.852088 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:17.848623 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:17.854115 25296 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 4.
I20260709 13:11:17.852595 25907 raft_consensus.cc:3060] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:17.829679 27001 raft_consensus.cc:515] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:17.857797 26989 leader_election.cc:290] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:17.858635 27001 leader_election.cc:290] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:17.860065 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:17.861428 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:17.862084 25905 raft_consensus.cc:3060] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:17.864287 25373 raft_consensus.cc:1275] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:11:17.873466 25377 raft_consensus.cc:1275] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:17.874712 25226 raft_consensus.cc:1275] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:17.874379 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:17.807065 27115 raft_consensus.cc:515] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:11:17.840560 27021 leader_election.cc:290] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:17.808743 27134 raft_consensus.cc:493] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:17.842324 27035 raft_consensus.cc:515] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:17.883924 25228 raft_consensus.cc:2468] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 2.
W20260709 13:11:17.890079 25371 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36264 (request call id 1219) took 3110 ms (client timeout 2526 ms). Trace:
W20260709 13:11:17.897132 25374 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36264 (request call id 1246) took 1331 ms (client timeout 1611 ms). Trace:
I20260709 13:11:17.898480 25227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58418 (request call id 1527) took 2091 ms. Trace:
I20260709 13:11:17.923004 25227 rpcz_store.cc:276] 0709 13:11:15.806670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.134718 (+328048us) service_pool.cc:224] Handling call
0709 13:11:16.179955 (+ 45237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:16.307956 (+128001us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:16.308000 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:16.308058 (+    58us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:16.308101 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:17.898244 (+1590143us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b54000889d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:17.898290 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:17.898422 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":293804928}
I20260709 13:11:17.901171 25370 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119"
dest_uuid: "79d99c0e498349bda74127365219e468"
mode: GRACEFUL
new_leader_uuid: "1f539ba21487460085b837e7529a78ce"
 from {username='slave'} at 127.0.0.1:59274
I20260709 13:11:17.903124 25375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56308 (request call id 213) took 1361 ms. Trace:
I20260709 13:11:17.924350 25370 raft_consensus.cc:606] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Received request to transfer leadership to TS 1f539ba21487460085b837e7529a78ce
I20260709 13:11:17.924325 25375 rpcz_store.cc:276] 0709 13:11:16.541662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.169462 (+627800us) service_pool.cc:224] Handling call
0709 13:11:17.169842 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:17.276907 (+107065us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:17.902857 (+625950us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b5400307854. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:17.903062 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":242964736}
I20260709 13:11:17.904578 26559 consensus_queue.cc:1048] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:11:17.905021 25908 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50058 (request call id 495) took 2106 ms (client timeout 1795 ms). Trace:
I20260709 13:11:17.906234 25900 raft_consensus.cc:1275] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:11:17.906787 26910 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:17.907128 26953 consensus_queue.cc:1059] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:17.909207 27062 leader_election.cc:290] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:17.918002 25905 raft_consensus.cc:2468] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 4.
W20260709 13:11:17.921700 25371 rpcz_store.cc:269] 0709 13:11:14.762795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.473661 (+710866us) service_pool.cc:224] Handling call
0709 13:11:17.872930 (+2399269us) spinlock_profiling.cc:243] Waited 400 ms on lock 0x7b540003a7d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:17.873038 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":920689536}
I20260709 13:11:17.925163 25370 raft_consensus.cc:614] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:17.926750 25345 leader_election.cc:304] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
W20260709 13:11:17.928305 25908 rpcz_store.cc:269] 0709 13:11:15.798761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.825703 (+ 26942us) service_pool.cc:224] Handling call
0709 13:11:17.904798 (+2079095us) spinlock_profiling.cc:243] Waited 659 ms on lock 0x7b54003589d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:17.904937 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1514951424}
I20260709 13:11:17.929891 25900 pending_rounds.cc:85] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6: Aborting all ops after (but not including) 4
I20260709 13:11:17.940025 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:17.875488 27043 consensus_queue.cc:1048] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:11:17.944175 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:17.927772 27001 raft_consensus.cc:493] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.944942 25900 pending_rounds.cc:107] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:11:17.948899 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:17.980165 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:17.808164 25903 rpcz_store.cc:276] 0709 13:11:15.856349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.375787 (+1519438us) service_pool.cc:224] Handling call
0709 13:11:17.376140 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:17.408047 (+ 31907us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:17.410284 (+  2237us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:17.462555 (+ 52271us) log.cc:844] Serialized 26 byte log entry
0709 13:11:17.582435 (+119880us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:17.592063 (+  9628us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:17.603775 (+ 11712us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:17.684355 (+ 80580us) raft_consensus.cc:1685] finished
0709 13:11:17.684381 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:17.684529 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":75,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":4582,"thread_start_us":64682,"threads_started":1,"wal-append.queue_time_us":135367}
I20260709 13:11:17.943992 27002 raft_consensus.cc:3055] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:17.983506 27002 raft_consensus.cc:740] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:17.983644 27029 leader_election.cc:290] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:17.986900 25377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36264 (request call id 1237) took 1742 ms. Trace:
I20260709 13:11:17.987344 25377 rpcz_store.cc:276] 0709 13:11:16.244323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.466305 (+221982us) service_pool.cc:224] Handling call
0709 13:11:17.873128 (+1406823us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:17.874056 (+   928us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:17.986699 (+112643us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b540003a7d0. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6e8ad 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:17.986838 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3234685824}
I20260709 13:11:17.991052 25224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1463) took 1359 ms. Trace:
I20260709 13:11:17.991590 25224 rpcz_store.cc:276] 0709 13:11:16.631910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.776687 (+144777us) service_pool.cc:224] Handling call
0709 13:11:17.985183 (+1208496us) spinlock_profiling.cc:243] Waited 1.15 ms on lock 0x7b5800002a98. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72cb4ab71 00007fd72cb4aa22 00007fd735a63c09 00007fd734bbdee0 00007fd734c870ab 00007fd734c87131 00007fd734c48fc0 00007fd734c33929 00007fd734c333d2 00007fd72e1aabd4
0709 13:11:17.985379 (+   196us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:17.985557 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:17.985586 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:17.985628 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:17.985661 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:17.985721 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:17.990976 (+  5255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2653952}
W20260709 13:11:17.994652 25345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:17.996085 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:17.998155 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:17.999001 25371 raft_consensus.cc:3060] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:18.003854 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:18.008924 25373 raft_consensus.cc:1275] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:18.019409 25300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46556 (request call id 201) took 2191 ms. Trace:
I20260709 13:11:17.945008 27033 raft_consensus.cc:2804] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:17.978642 25900 raft_consensus.cc:2889] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:18.023680 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:18.025301 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:17.922676 27134 raft_consensus.cc:515] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:18.019960 25300 rpcz_store.cc:276] 0709 13:11:15.827854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.828223 (+   369us) service_pool.cc:224] Handling call
0709 13:11:15.847395 (+ 19172us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:17.439091 (+1591696us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:18.019155 (+580064us) spinlock_profiling.cc:243] Waited 1.59 s on lock 0x7b54002fb054. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:18.019348 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3657019648}
I20260709 13:11:17.938793 27135 consensus_queue.cc:1059] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.082s
I20260709 13:11:18.128497 27035 leader_election.cc:290] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:17.939728 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:18.129585 25296 raft_consensus.cc:2410] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:11:17.922758 25374 rpcz_store.cc:269] 0709 13:11:16.565528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.664232 (+ 98704us) service_pool.cc:224] Handling call
0709 13:11:17.896968 (+1232736us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b54000e4cd4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:17.897075 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":256344832}
I20260709 13:11:18.144580 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:18.146624 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:11:18.023227 25115 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 275226661cc840559134f8c9e5b15719 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 1f539ba21487460085b837e7529a78ce is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:11:18.138433 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:18.177219 25297 raft_consensus.cc:2393] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 3: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:18.139530 25304 raft_consensus.cc:1275] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:18.147684 25376 raft_consensus.cc:2393] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 3: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:18.152628 25195 leader_election.cc:304] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:18.162091 25379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56308 (request call id 208) took 2438 ms. Trace:
I20260709 13:11:18.162451 25901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50058 (request call id 481) took 2843 ms. Trace:
I20260709 13:11:18.163477 25373 raft_consensus.cc:2393] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 5: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:18.178213 25379 rpcz_store.cc:276] 0709 13:11:15.699828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.037944 (+338116us) service_pool.cc:224] Handling call
0709 13:11:16.038227 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:16.125454 (+ 87227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:16.125489 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:16.125539 (+    50us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:16.125573 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:18.138090 (+2012517us) spinlock_profiling.cc:243] Waited 87 ms on lock 0x7b54004592d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:18.138136 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:18.138243 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":200163072}
I20260709 13:11:18.192463 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:18.193152 25373 raft_consensus.cc:3060] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:18.189416 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:18.198273 25376 raft_consensus.cc:3060] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:18.198836 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:18.199383 25227 raft_consensus.cc:3060] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:18.074122 27033 raft_consensus.cc:493] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:18.200469 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:17.940802 26910 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:18.207197 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:18.208137 25379 raft_consensus.cc:2393] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 5: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:18.208051 25271 leader_election.cc:304] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
W20260709 13:11:18.164918 27150 log.cc:927] Time spent T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.229s	user 0.000s	sys 0.005s
I20260709 13:11:18.209415 27062 raft_consensus.cc:2749] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:18.210830 25271 leader_election.cc:304] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:18.196667 26989 raft_consensus.cc:2749] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:18.163578 27021 consensus_queue.cc:1048] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:11:18.212868 27031 raft_consensus.cc:2749] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:18.191461 25901 rpcz_store.cc:276] 0709 13:11:15.319637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.325420 (+  5783us) service_pool.cc:224] Handling call
0709 13:11:16.484791 (+1159371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:16.600316 (+115525us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:18.133928 (+1533612us) spinlock_profiling.cc:243] Waited 974 ms on lock 0x7b5400276ad0. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6e8ad 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:18.162382 (+ 28454us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2240503552}
I20260709 13:11:18.215961 25907 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 3.
W20260709 13:11:18.197137 25115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 173957us
I20260709 13:11:18.206297 27135 consensus_queue.cc:1243] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer 79d99c0e498349bda74127365219e468 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:11:18.211783 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:18.217579 27135 raft_consensus.cc:3055] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:18.218011 27135 raft_consensus.cc:740] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:18.218060 25370 raft_consensus.cc:3060] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:18.218750 27033 raft_consensus.cc:3060] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:18.223760 25222 consensus_meta.cc:287] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 0.614s	user 0.010s	sys 0.000s
W20260709 13:11:18.224259 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 86114.6us
I20260709 13:11:18.224560 25222 raft_consensus.cc:1275] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:18.225023 25874 leader_election.cc:304] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:11:18.202518 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:18.225997 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:18.226467 27021 raft_consensus.cc:493] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.226715 25374 raft_consensus.cc:3060] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:18.226974 27021 raft_consensus.cc:515] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:18.163772 27029 consensus_queue.cc:1048] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 13:11:18.216138 25271 leader_election.cc:304] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:18.231220 27070 raft_consensus.cc:2749] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:18.225364 25227 raft_consensus.cc:2468] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 4.
I20260709 13:11:18.233942 25271 leader_election.cc:304] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:18.235075 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:18.227386 25874 leader_election.cc:304] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:18.246704 25301 raft_consensus.cc:2393] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 4: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:18.013957 27001 raft_consensus.cc:515] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:18.248034 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
W20260709 13:11:18.252521 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 367774us
I20260709 13:11:18.254401 25376 raft_consensus.cc:2468] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 4.
W20260709 13:11:18.203289 25871 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:18.281960 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:18.283174 25376 raft_consensus.cc:2410] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:11:18.284121 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:18.286827 25376 raft_consensus.cc:2376] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 3. Re-sending same reply.
I20260709 13:11:18.288614 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:18.294654 25373 raft_consensus.cc:2468] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 4.
I20260709 13:11:18.311426 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:18.312098 25376 raft_consensus.cc:3060] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:11:18.307147 25370 raft_consensus.cc:2468] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 5.
I20260709 13:11:18.335184 25371 raft_consensus.cc:2468] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 5.
I20260709 13:11:18.203917 26990 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:18.339316 25376 raft_consensus.cc:2468] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 3.
I20260709 13:11:18.357456 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:18.355415 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:18.226029 27048 raft_consensus.cc:2804] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:18.367758 25195 leader_election.cc:304] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:18.369488 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:18.370100 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:18.370529 25907 raft_consensus.cc:2410] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:11:18.371470 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:18.371608 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:18.372745 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:18.373881 27048 raft_consensus.cc:493] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:18.374387 27048 raft_consensus.cc:3060] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:18.382229 27155 log.cc:927] Time spent T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.368s	user 0.000s	sys 0.001s
I20260709 13:11:18.384141 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:18.385937 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:18.387012 25226 raft_consensus.cc:1275] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:18.387539 25907 raft_consensus.cc:2410] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:11:18.390848 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 50719.3us
I20260709 13:11:18.395712 25195 leader_election.cc:304] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:18.236102 27023 leader_election.cc:290] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:18.259160 27159 raft_consensus.cc:2749] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:18.247989 27070 consensus_queue.cc:1059] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.151s
I20260709 13:11:18.356338 27115 leader_election.cc:290] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:18.403462 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:18.412176 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:18.438865 25228 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 1.
I20260709 13:11:18.397707 25195 leader_election.cc:304] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:18.442487 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:18.443971 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:18.425467 25221 raft_consensus.cc:1240] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:18.459259 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:18.459489 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:11:18.464205 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 66582.6us
I20260709 13:11:18.404803 26989 raft_consensus.cc:2749] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:18.471833 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:18.403817 27058 raft_consensus.cc:3055] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:18.404361 27029 raft_consensus.cc:3060] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:18.399348 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:18.487582 25371 raft_consensus.cc:2393] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 3: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
W20260709 13:11:18.496236 25905 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.005s	sys 0.032s
I20260709 13:11:18.470448 27115 raft_consensus.cc:2749] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:18.472611 27062 raft_consensus.cc:2749] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:18.501691 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:18.511333 27157 consensus_queue.cc:1048] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:11:18.515137 25905 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.005s	sys 0.032s
I20260709 13:11:18.516302 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:18.518416 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:18.519080 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:18.521410 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:18.522796 25371 raft_consensus.cc:2410] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:11:18.547551 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:18.503389 27058 raft_consensus.cc:740] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:18.550455 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:18.556322 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
W20260709 13:11:18.554219 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 318466us
I20260709 13:11:18.557348 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:18.558171 25371 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 1.
I20260709 13:11:18.558228 25271 leader_election.cc:304] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:11:18.559265 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:18.562251 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
W20260709 13:11:18.575063 25908 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.017s	sys 0.013s
W20260709 13:11:18.578912 25908 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.017s	sys 0.013s
I20260709 13:11:18.581164 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:18.573115 25270 leader_election.cc:304] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:18.585307 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:18.587705 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:18.594466 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:18.598539 25371 raft_consensus.cc:2468] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 3.
I20260709 13:11:18.599408 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:18.603833 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:18.605101 25297 raft_consensus.cc:2468] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 4.
W20260709 13:11:18.612545 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 54386.4us
I20260709 13:11:18.577045 27070 consensus_queue.cc:1048] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:11:18.605876 26964 raft_consensus.cc:2749] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:18.621394 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:18.579221 27058 consensus_queue.cc:260] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:18.617067 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:18.624817 27070 consensus_queue.cc:1059] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:18.658505 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
W20260709 13:11:18.607206 25902 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50056 (request call id 404) took 1467 ms (client timeout 1782 ms). Trace:
I20260709 13:11:18.742720 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:18.632695 26964 raft_consensus.cc:2804] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:11:18.662585 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 113669us
W20260709 13:11:18.654675 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 67304.4us
I20260709 13:11:18.746372 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:18.746829 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:18.633855 27001 leader_election.cc:290] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:18.634483 25298 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.018s	sys 0.024s
I20260709 13:11:18.621873 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:18.647856 25271 leader_election.cc:304] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
W20260709 13:11:18.749251 25343 leader_election.cc:336] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Timed out: RequestConsensusVote RPC to 127.23.140.66:33127 timed out after 1.541s (SENT)
I20260709 13:11:18.748219 26964 raft_consensus.cc:493] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:18.753135 26964 raft_consensus.cc:3060] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:18.753433 27156 log.cc:927] Time spent T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
W20260709 13:11:18.758222 25223 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58418 (request call id 1536) took 1385 ms (client timeout 1546 ms). Trace:
W20260709 13:11:18.758776 25223 rpcz_store.cc:269] 0709 13:11:17.372501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.372641 (+   140us) service_pool.cc:224] Handling call
0709 13:11:18.758041 (+1385400us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b5400420c54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:18.758165 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":455817472}
I20260709 13:11:18.758226 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:18.761895 25376 raft_consensus.cc:1240] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:18.763258 25376 raft_consensus.cc:1240] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 4. Current term is 5. Ops: [3.3-4.4]
W20260709 13:11:18.764509 27158 log.cc:927] Time spent T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.209s	user 0.000s	sys 0.002s
I20260709 13:11:18.764609 25376 raft_consensus.cc:1240] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 3. Current term is 4. Ops: []
W20260709 13:11:18.766922 27163 log.cc:927] Time spent T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 13:11:18.767503 25376 raft_consensus.cc:1240] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 4. Current term is 5. Ops: []
W20260709 13:11:18.768769 27165 log.cc:927] Time spent T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
W20260709 13:11:18.750340 25298 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.769s	user 0.051s	sys 0.062s
I20260709 13:11:18.769912 25379 raft_consensus.cc:1240] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:18.770215 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:18.771175 25379 raft_consensus.cc:1275] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:11:18.771533 25379 pending_rounds.cc:85] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468: Aborting all ops after (but not including) 2
I20260709 13:11:18.771749 25379 pending_rounds.cc:107] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:11:18.771971 25379 raft_consensus.cc:2889] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:18.751294 25343 leader_election.cc:304] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:18.774204 26922 raft_consensus.cc:2749] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:11:18.775502 25343 leader_election.cc:336] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Timed out: RequestConsensusVote RPC to 127.23.140.66:33127 timed out after 1.575s (SENT)
I20260709 13:11:18.779091 25299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57272 (request call id 1284) took 1115 ms. Trace:
I20260709 13:11:18.779474 25299 rpcz_store.cc:276] 0709 13:11:17.664132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.664269 (+   137us) service_pool.cc:224] Handling call
0709 13:11:17.777337 (+113068us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:17.777576 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:11:17.790805 (+ 13229us) log.cc:844] Serialized 14 byte log entry
0709 13:11:17.924337 (+133532us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:17.924391 (+    54us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:17.924439 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:17.924508 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:18.778933 (+854425us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b54002ca450. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6e8ad 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:18.779037 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":422,"prepare.queue_time_us":16411,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":90,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":4594,"spinlock_wait_cycles":259375872,"thread_start_us":133185,"threads_started":1,"wal-append.queue_time_us":809051}
W20260709 13:11:18.780897 25374 consensus_meta.cc:287] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.554s	user 0.008s	sys 0.000s
I20260709 13:11:18.781212 25374 raft_consensus.cc:2468] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 5.
I20260709 13:11:18.781482 25299 raft_consensus.cc:1240] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:18.742846 27070 consensus_queue.cc:1243] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer 6c4b021f3f9e41adb75e870a08ad88b6 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:11:18.750592 25303 raft_consensus.cc:2393] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 3: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:18.782837 27178 raft_consensus.cc:2749] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:18.782579 26914 consensus_queue.cc:1059] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:18.629626 27033 raft_consensus.cc:515] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:18.801474 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:18.781893 25376 raft_consensus.cc:1240] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:18.789409 25195 leader_election.cc:304] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:18.790071 25873 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:18.790218 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:18.806255 25371 raft_consensus.cc:2393] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 4: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:18.795667 25379 raft_consensus.cc:1240] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:18.748032 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:18.805430 25195 leader_election.cc:304] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:18.795182 25299 raft_consensus.cc:1240] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:18.807333 25370 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 4.
W20260709 13:11:18.821874 25194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:18.750670 27029 raft_consensus.cc:2749] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:18.821847 25303 raft_consensus.cc:1240] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:18.823504 25195 leader_election.cc:304] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:18.824896 25377 raft_consensus.cc:2393] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 3: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:18.825959 25195 leader_election.cc:304] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:18.827860 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:18.829603 25297 raft_consensus.cc:2393] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 5: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
W20260709 13:11:18.742069 25902 rpcz_store.cc:269] 0709 13:11:17.138348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.374350 (+236002us) service_pool.cc:224] Handling call
0709 13:11:18.597877 (+1223527us) spinlock_profiling.cc:243] Waited 23.8 ms on lock 0x7b54003e3854. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:18.604828 (+  6951us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":54698880}
I20260709 13:11:18.820111 27159 raft_consensus.cc:2804] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:18.831995 25299 raft_consensus.cc:1240] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 2. Current term is 3. Ops: []
W20260709 13:11:18.832762 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 83404.9us
I20260709 13:11:18.818010 27001 raft_consensus.cc:2804] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:18.840453 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:18.830034 27115 raft_consensus.cc:2804] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:18.841255 25373 raft_consensus.cc:2393] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 4: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:11:18.830993 26989 raft_consensus.cc:2804] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:11:18.845496 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 88354.2us
I20260709 13:11:18.846001 25373 raft_consensus.cc:1275] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:18.847980 25373 raft_consensus.cc:1275] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:18.849478 25370 raft_consensus.cc:1240] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:18.849669 25303 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea"
dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:57250
I20260709 13:11:18.849815 25270 leader_election.cc:304] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:18.850234 25303 raft_consensus.cc:606] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Received request to transfer leadership
I20260709 13:11:18.850643 25303 raft_consensus.cc:614] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:18.834427 27159 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
W20260709 13:11:18.852907 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 205144us
I20260709 13:11:18.839041 27029 raft_consensus.cc:2804] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:18.854117 25373 raft_consensus.cc:1240] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 4 LEADER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:18.862782 25301 raft_consensus.cc:2468] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 4.
I20260709 13:11:18.843020 27001 raft_consensus.cc:697] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 4 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:18.863056 25195 leader_election.cc:304] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:18.864866 25270 leader_election.cc:304] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:18.857366 27159 raft_consensus.cc:3060] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:18.843276 27048 raft_consensus.cc:515] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:18.885874 25270 leader_election.cc:304] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:18.867347 27169 raft_consensus.cc:2749] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:18.897346 25906 raft_consensus.cc:2393] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 5: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:11:18.885130 27122 raft_consensus.cc:2804] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:11:18.898373 27179 log.cc:927] Time spent T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:11:18.892604 26990 raft_consensus.cc:2749] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:18.911908 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:18.913822 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:18.915975 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:18.916654 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:18.918630 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:18.897078 27029 raft_consensus.cc:697] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 5 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:18.920375 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:18.927601 25299 raft_consensus.cc:2468] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 3.
I20260709 13:11:18.928495 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:18.928860 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:18.905956 27122 raft_consensus.cc:493] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:18.930199 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:18.930465 27122 raft_consensus.cc:3060] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:18.930753 25301 raft_consensus.cc:3060] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:18.923563 27162 log.cc:927] Time spent T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:11:18.932034 25908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50060 (request call id 331) took 1092 ms. Trace:
I20260709 13:11:18.932394 25908 rpcz_store.cc:276] 0709 13:11:17.840033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.936119 (+ 96086us) service_pool.cc:224] Handling call
0709 13:11:17.936408 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:17.936597 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:17.936620 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:17.937009 (+   389us) log.cc:844] Serialized 26 byte log entry
0709 13:11:18.579488 (+642479us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:18.579555 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:18.579652 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:18.931838 (+352186us) raft_consensus.cc:1685] finished
0709 13:11:18.931859 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:18.931978 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":642169,"threads_started":1,"wal-append.queue_time_us":894936}
I20260709 13:11:18.930474 27190 raft_consensus.cc:2804] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:18.934396 27190 raft_consensus.cc:697] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 3 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:18.934108 27001 consensus_queue.cc:237] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:18.934674 27192 consensus_queue.cc:1048] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:18.935369 27190 consensus_queue.cc:237] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:18.936625 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:18.919055 27184 consensus_queue.cc:1059] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:11:18.922227 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:18.922909 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:18.939083 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:18.923528 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:18.939757 25298 raft_consensus.cc:2393] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 7: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:18.924116 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:18.929548 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:18.924341 26964 raft_consensus.cc:515] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:18.886596 27168 consensus_queue.cc:1059] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:11:18.896755 27033 leader_election.cc:290] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:18.928524 25303 raft_consensus.cc:1275] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:11:19.013867 26808 consensus_queue.cc:1059] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:19.014729 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:19.015697 25303 raft_consensus.cc:2393] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 3: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:19.016520 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:18.941313 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:19.019768 25299 raft_consensus.cc:1275] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:11:19.020790 26979 raft_consensus.cc:493] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:19.021461 26979 raft_consensus.cc:515] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:19.013651 27168 raft_consensus.cc:3055] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:19.022827 27168 raft_consensus.cc:740] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:19.024024 26979 leader_election.cc:290] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:19.023777 27168 consensus_queue.cc:260] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:19.017568 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:19.064764 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:19.065564 25299 raft_consensus.cc:2368] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 2. Current term is 3.
I20260709 13:11:18.942021 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:18.947986 25301 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 3.
I20260709 13:11:19.005374 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:19.005175 27029 consensus_queue.cc:237] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:19.006495 27048 leader_election.cc:290] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 5 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:19.006647 26964 leader_election.cc:290] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:19.007510 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:19.073868 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:19.008153 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:19.074666 25297 raft_consensus.cc:3060] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:19.074836 25298 raft_consensus.cc:2410] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:11:19.008742 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:18.901852 27115 raft_consensus.cc:697] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 4 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:18.913733 26989 raft_consensus.cc:697] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 5 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
W20260709 13:11:19.071995 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 186337us
W20260709 13:11:19.072455 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 169892us
I20260709 13:11:19.074079 25305 raft_consensus.cc:2410] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:11:19.007699 27177 log.cc:927] Time spent T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:11:19.075857 25300 raft_consensus.cc:2376] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 79d99c0e498349bda74127365219e468 in term 4. Re-sending same reply.
W20260709 13:11:19.076844 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 184103us
I20260709 13:11:19.079386 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
W20260709 13:11:19.080911 25194 leader_election.cc:336] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Timed out: RequestConsensusVote RPC to 127.23.140.66:33127 timed out after 1.774s (SENT)
I20260709 13:11:19.081445 25194 leader_election.cc:304] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:19.083073 25298 raft_consensus.cc:2393] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 3: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:19.085381 27195 raft_consensus.cc:2749] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:19.090159 27122 raft_consensus.cc:515] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:19.092463 27122 leader_election.cc:290] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:19.087648 25195 leader_election.cc:304] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:19.094461 27048 raft_consensus.cc:493] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:19.101302 27194 consensus_queue.cc:1059] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:19.140074 26953 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
W20260709 13:11:19.140342 25175 auto_rebalancer.cc:893] Removing replace marker failed: Replica da445ce82dc4467f95f4fa52297eaa19 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
W20260709 13:11:19.140942 25175 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 13:11:19.140596 26953 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:19.141259 25175 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:11:19.139585 25344 leader_election.cc:304] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:19.143676 25344 leader_election.cc:304] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:19.101814 25297 raft_consensus.cc:2468] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 4.
I20260709 13:11:19.102174 25872 leader_election.cc:304] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:11:19.146270 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 44186.8us
I20260709 13:11:19.146955 25872 leader_election.cc:304] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:19.147994 25872 leader_election.cc:304] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:19.102734 27115 consensus_queue.cc:237] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:19.103648 27196 consensus_queue.cc:1048] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:19.103909 25194 leader_election.cc:304] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:19.108876 26989 consensus_queue.cc:237] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:19.066962 27159 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:19.115023 27197 consensus_queue.cc:1059] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:19.163331 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:19.163512 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:19.163923 25301 raft_consensus.cc:2468] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 4.
I20260709 13:11:19.164283 25305 raft_consensus.cc:2468] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 4.
I20260709 13:11:19.116096 26772 raft_consensus.cc:3060] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:19.117614 27185 raft_consensus.cc:493] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.118829 26964 consensus_queue.cc:1059] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:19.119668 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:19.120026 25222 raft_consensus.cc:1240] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:19.120589 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:19.140645 27194 raft_consensus.cc:3055] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:19.171036 25227 raft_consensus.cc:2468] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 4.
I20260709 13:11:19.121019 27178 consensus_queue.cc:1059] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:19.121376 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:19.121775 27080 raft_consensus.cc:3055] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:19.150303 26559 raft_consensus.cc:493] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.123070 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:19.124806 27169 consensus_queue.cc:1059] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:19.125198 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:19.182286 25226 raft_consensus.cc:2393] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 7: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:19.124814 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:19.128748 27180 consensus_queue.cc:1059] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:19.129704 26808 consensus_queue.cc:1048] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:19.130350 25343 leader_election.cc:304] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:11:19.183682 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 96114.8us
I20260709 13:11:19.136485 27002 consensus_queue.cc:260] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:19.137307 25902 raft_consensus.cc:1240] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:19.150777 25298 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07"
dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
mode: GRACEFUL
new_leader_uuid: "79d99c0e498349bda74127365219e468"
 from {username='slave'} at 127.0.0.1:35660
I20260709 13:11:19.186602 25298 raft_consensus.cc:606] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Received request to transfer leadership to TS 79d99c0e498349bda74127365219e468
I20260709 13:11:19.187142 25298 raft_consensus.cc:614] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:19.152185 25344 leader_election.cc:304] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:19.160252 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:19.161031 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:19.150151 26827 raft_consensus.cc:3060] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:19.159488 26923 raft_consensus.cc:2749] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:19.162914 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:19.139305 26768 raft_consensus.cc:493] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.150265 27048 raft_consensus.cc:515] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:19.172385 25228 raft_consensus.cc:3060] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:19.122612 27184 consensus_queue.cc:1048] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:19.177728 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:19.150425 27054 raft_consensus.cc:2749] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:19.179812 27190 raft_consensus.cc:2804] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:19.194698 27190 raft_consensus.cc:697] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 5 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:19.158736 26979 raft_consensus.cc:2749] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:19.132661 25345 leader_election.cc:304] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
W20260709 13:11:19.186558 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 56279.6us
W20260709 13:11:19.225394 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 92783.9us
I20260709 13:11:19.153395 27191 raft_consensus.cc:2749] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:19.188531 25344 leader_election.cc:304] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
W20260709 13:11:19.187543 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 83728.1us
I20260709 13:11:19.188825 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:19.226871 25194 leader_election.cc:304] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:19.227306 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:19.227931 25227 raft_consensus.cc:3060] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:19.185742 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:19.190488 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:19.174638 27194 raft_consensus.cc:740] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
W20260709 13:11:19.167071 25270 leader_election.cc:336] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085): Timed out: RequestConsensusVote RPC to 127.23.140.68:34085 timed out after 1.614s (SENT)
I20260709 13:11:19.173715 27080 raft_consensus.cc:740] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:19.181521 25223 raft_consensus.cc:3060] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:19.183718 27122 raft_consensus.cc:3055] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:19.250169 27122 raft_consensus.cc:740] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:19.251044 27122 consensus_queue.cc:260] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:19.252276 27122 raft_consensus.cc:3060] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:19.184878 27023 raft_consensus.cc:493] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.254081 27023 raft_consensus.cc:515] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:19.255637 27134 leader_election.cc:290] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:19.256062 27023 leader_election.cc:290] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:19.180492 27029 raft_consensus.cc:2804] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:19.256883 27029 raft_consensus.cc:493] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:19.256701 27194 consensus_queue.cc:260] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:19.189692 26786 raft_consensus.cc:2749] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:19.257989 27194 raft_consensus.cc:3060] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:19.191211 27033 raft_consensus.cc:2804] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:19.258647 27033 raft_consensus.cc:697] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 4 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:19.199323 27002 raft_consensus.cc:3060] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:19.259696 25377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36264 (request call id 1254) took 1264 ms. Trace:
I20260709 13:11:19.259534 27033 consensus_queue.cc:237] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:19.260106 25377 rpcz_store.cc:276] 0709 13:11:17.995695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.995831 (+   136us) service_pool.cc:224] Handling call
0709 13:11:19.259502 (+1263671us) spinlock_profiling.cc:243] Waited 828 ms on lock 0x7b5400306e54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:19.259640 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1903832832}
I20260709 13:11:19.200949 26910 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:19.184633 26559 raft_consensus.cc:515] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:19.261547 25901 raft_consensus.cc:2376] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 3. Re-sending same reply.
I20260709 13:11:19.215866 27048 leader_election.cc:290] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:19.198526 26953 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:19.262691 27164 log.cc:927] Time spent T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.651s	user 0.000s	sys 0.006s
I20260709 13:11:19.262972 26953 consensus_queue.cc:1048] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:19.216647 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:19.257277 27021 leader_election.cc:290] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:19.264552 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:19.265674 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:19.266242 25222 raft_consensus.cc:3060] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:19.202308 27135 consensus_queue.cc:260] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:19.267549 27135 raft_consensus.cc:3060] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:19.213030 25296 raft_consensus.cc:2393] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 4: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:19.268940 26923 raft_consensus.cc:2804] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:19.150877 25872 leader_election.cc:304] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:19.269456 26923 raft_consensus.cc:697] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 3 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:19.196089 26768 raft_consensus.cc:515] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:19.181640 27185 raft_consensus.cc:515] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:19.235149 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:19.216765 27159 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:19.281210 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 130395us
I20260709 13:11:19.228488 27205 raft_consensus.cc:493] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.236498 27206 raft_consensus.cc:2749] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:19.239073 25194 leader_election.cc:304] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:11:19.284397 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 45384.8us
I20260709 13:11:19.245239 25227 raft_consensus.cc:2468] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 3.
I20260709 13:11:19.285073 25194 leader_election.cc:304] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:19.285686 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:11:19.246919 27198 log.cc:927] Time spent T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:11:19.246551 27080 consensus_queue.cc:260] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:19.257256 27029 raft_consensus.cc:3060] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:19.271843 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:11:19.235598 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 68554.2us
I20260709 13:11:19.205421 25228 raft_consensus.cc:2410] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:11:19.272418 25905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50060 (request call id 332) took 1346 ms. Trace:
I20260709 13:11:19.270468 26923 consensus_queue.cc:237] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:19.280263 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 93106.8us
W20260709 13:11:19.337291 25874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:19.338055 25874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:19.234236 26977 raft_consensus.cc:2804] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:19.340981 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:19.341619 25304 raft_consensus.cc:2468] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 3.
W20260709 13:11:19.344462 25270 leader_election.cc:336] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085): Timed out: RequestConsensusVote RPC to 127.23.140.68:34085 timed out after 1.808s (SENT)
I20260709 13:11:19.331101 25905 rpcz_store.cc:276] 0709 13:11:17.926034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.942435 (+ 16401us) service_pool.cc:224] Handling call
0709 13:11:17.944347 (+  1912us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:17.978310 (+ 33963us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:17.978357 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:17.980190 (+  1833us) log.cc:844] Serialized 26 byte log entry
0709 13:11:18.518438 (+538248us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:18.783799 (+265361us) log.cc:844] Serialized 14 byte log entry
0709 13:11:18.784060 (+   261us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:18.784155 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:19.262185 (+478030us) spinlock_profiling.cc:243] Waited 18 ms on lock 0x7b4400022b4c. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72caa8c85 00007fd72caa96a2 00007fd72f81b1db 00007fd72f816aaf 00007fd72f80a86e 00007fd72f809bb6 00007fd72f8097d8 00007fd72f813221 00007fd72f8131d9 00007fd72f813169
0709 13:11:19.272058 (+  9873us) raft_consensus.cc:1685] finished
0709 13:11:19.272205 (+   147us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:19.272353 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37218,"prepare.queue_time_us":324786,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":3496,"raft.queue_time_us":83086,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":81230,"spinlock_wait_cycles":41428224,"thread_start_us":797581,"threads_started":2,"wal-append.queue_time_us":597820}
I20260709 13:11:19.346262 25270 leader_election.cc:304] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:19.332401 25872 leader_election.cc:304] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
W20260709 13:11:19.312093 25873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:19.345118 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:11:19.350760 25270 leader_election.cc:336] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085): Timed out: RequestConsensusVote RPC to 127.23.140.68:34085 timed out after 1.924s (SENT)
I20260709 13:11:19.350534 25872 leader_election.cc:304] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:11:19.353157 27080 raft_consensus.cc:3060] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:19.353513 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:19.354387 25901 raft_consensus.cc:2468] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 3.
I20260709 13:11:19.305655 25194 leader_election.cc:304] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:19.356683 27134 raft_consensus.cc:2749] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:11:19.356798 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 51220.9us
I20260709 13:11:19.356741 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:19.357923 27134 consensus_queue.cc:1048] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:19.358600 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:19.281980 27048 raft_consensus.cc:2749] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:19.283390 26559 leader_election.cc:290] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:19.363452 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:19.287739 27021 raft_consensus.cc:2749] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:19.366206 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:19.369343 25228 raft_consensus.cc:1240] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:19.373911 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:19.369503 25300 raft_consensus.cc:1275] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:11:19.364746 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 182728us
I20260709 13:11:19.288213 27001 raft_consensus.cc:2749] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:19.374637 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:19.366576 27023 raft_consensus.cc:2804] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:19.375914 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:19.340660 25374 raft_consensus.cc:1240] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:19.360306 27031 raft_consensus.cc:2749] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:19.377482 25905 raft_consensus.cc:1240] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:11:19.375571 25271 leader_election.cc:304] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:19.348377 27193 raft_consensus.cc:493] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.410725 25228 raft_consensus.cc:1240] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 4 LEADER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:19.341876 27049 consensus_queue.cc:1059] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:11:19.364406 26964 consensus_queue.cc:1059] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:11:19.382107 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
W20260709 13:11:19.421150 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 232683us
I20260709 13:11:19.374626 25194 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:19.366305 27191 raft_consensus.cc:2804] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:19.418777 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:19.326647 26910 consensus_queue.cc:1059] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
W20260709 13:11:19.421516 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 46027.8us
I20260709 13:11:19.430092 25271 leader_election.cc:304] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:19.371268 26977 raft_consensus.cc:697] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 4 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
W20260709 13:11:19.422909 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 197094us
I20260709 13:11:19.341051 27159 consensus_queue.cc:1059] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:11:19.289037 27205 raft_consensus.cc:515] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:19.422626 25899 raft_consensus.cc:3060] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:11:19.422201 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
W20260709 13:11:19.430708 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 59140.3us
I20260709 13:11:19.445812 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:19.419411 27023 raft_consensus.cc:697] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:19.428884 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:19.449795 25194 leader_election.cc:304] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:19.432214 27191 raft_consensus.cc:493] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:19.446835 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:11:19.445714 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 219505us
I20260709 13:11:19.433111 27021 raft_consensus.cc:2749] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:19.449915 27213 consensus_queue.cc:1059] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:11:19.432087 27193 raft_consensus.cc:515] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:11:19.373008 27190 consensus_queue.cc:237] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:19.464090 25194 leader_election.cc:304] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:19.496845 25229 raft_consensus.cc:1240] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 5 LEADER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:19.485672 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:19.366536 27210 consensus_queue.cc:1059] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.098s
I20260709 13:11:19.447422 27202 raft_consensus.cc:493] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:19.524183 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:11:19.525182 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 61201.1us
I20260709 13:11:19.450795 25296 raft_consensus.cc:1275] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:11:19.452129 27207 raft_consensus.cc:2804] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:19.491438 27169 raft_consensus.cc:2749] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:19.453872 27209 raft_consensus.cc:3055] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:19.527429 25194 leader_election.cc:304] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:19.532040 27134 raft_consensus.cc:493] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:19.534122 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:19.538266 25905 raft_consensus.cc:1240] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:11:19.486653 27191 raft_consensus.cc:3060] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:19.492096 27206 raft_consensus.cc:2749] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:11:19.556694 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 121919us
W20260709 13:11:19.557468 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 127427us
W20260709 13:11:19.583416 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 154738us
I20260709 13:11:19.585263 25343 leader_election.cc:304] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:19.526633 26989 raft_consensus.cc:2749] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:19.586004 25271 leader_election.cc:304] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:19.530361 27207 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:19.590283 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:11:19.593358 27220 log.cc:927] Time spent T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:11:19.594753 26827 raft_consensus.cc:2749] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:19.595584 27207 raft_consensus.cc:3060] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:19.529022 27209 raft_consensus.cc:740] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:19.596832 27209 consensus_queue.cc:260] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:19.598327 27209 raft_consensus.cc:3060] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:19.602530 27207 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:19.604730 27207 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:19.605358 25302 raft_consensus.cc:2468] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 4.
I20260709 13:11:19.606635 25900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50060 (request call id 320) took 3807 ms. Trace:
I20260709 13:11:19.607046 25900 rpcz_store.cc:276] 0709 13:11:15.799526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.690544 (+891018us) service_pool.cc:224] Handling call
0709 13:11:17.905844 (+1215300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:18.126903 (+221059us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:19.606418 (+1479515us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54003589d0. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6e8ad 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:19.606572 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2794126080}
I20260709 13:11:19.609215 25271 leader_election.cc:304] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:19.524041 27159 consensus_queue.cc:1048] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:11:19.632859 25271 leader_election.cc:304] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:19.635401 25271 leader_election.cc:304] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:11:19.589654 27216 log.cc:927] Time spent T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:11:19.636214 25271 leader_election.cc:304] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:19.579806 26768 leader_election.cc:290] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:19.640439 25271 leader_election.cc:304] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:19.638196 25195 leader_election.cc:304] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:19.649443 25377 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4"
dest_uuid: "79d99c0e498349bda74127365219e468"
mode: GRACEFUL
new_leader_uuid: "1f539ba21487460085b837e7529a78ce"
 from {username='slave'} at 127.0.0.1:59274
I20260709 13:11:19.650034 25377 raft_consensus.cc:606] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Received request to transfer leadership to TS 1f539ba21487460085b837e7529a78ce
I20260709 13:11:19.650332 25377 raft_consensus.cc:614] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:19.535756 27134 raft_consensus.cc:515] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:19.609064 27090 raft_consensus.cc:493] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.637490 27207 consensus_queue.cc:1059] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:11:19.453841 26977 consensus_queue.cc:237] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:19.611435 27169 raft_consensus.cc:2749] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:19.530928 27202 raft_consensus.cc:515] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:19.659188 25195 leader_election.cc:304] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:19.638008 27208 raft_consensus.cc:2749] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:19.638334 26772 raft_consensus.cc:2749] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:19.652644 27070 raft_consensus.cc:3055] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:19.642010 27031 raft_consensus.cc:2749] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:19.684290 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:19.709853 25377 raft_consensus.cc:2376] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 5. Re-sending same reply.
I20260709 13:11:19.655634 25903 raft_consensus.cc:1240] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:19.652230 27223 raft_consensus.cc:2804] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:19.653489 26964 raft_consensus.cc:2749] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:11:19.689906 27214 log.cc:927] Time spent T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:11:19.691728 27202 leader_election.cc:290] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:19.656281 26808 consensus_queue.cc:1059] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:11:19.692836 27193 leader_election.cc:290] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:19.693603 27205 leader_election.cc:290] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:19.694841 27134 leader_election.cc:290] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:19.679085 27090 raft_consensus.cc:515] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:19.631393 27023 consensus_queue.cc:237] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:19.697585 27222 raft_consensus.cc:3055] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:19.736610 27222 raft_consensus.cc:740] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:19.736919 27191 raft_consensus.cc:515] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:19.643425 25221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54000 (request call id 259) took 1498 ms. Trace:
I20260709 13:11:19.632592 27185 leader_election.cc:290] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:19.701373 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:19.711273 27029 raft_consensus.cc:515] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:19.738453 25226 raft_consensus.cc:2393] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 6: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:19.737912 25221 rpcz_store.cc:276] 0709 13:11:18.141144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.142606 (+  1462us) service_pool.cc:224] Handling call
0709 13:11:18.162819 (+ 20213us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:18.496377 (+333558us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:19.608797 (+1112420us) spinlock_profiling.cc:243] Waited 237 ms on lock 0x7b54000eb5d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:19.639821 (+ 31024us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":543983872}
I20260709 13:11:19.739240 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:19.739352 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:19.739791 25226 raft_consensus.cc:3060] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:19.740018 25221 raft_consensus.cc:2468] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 2.
I20260709 13:11:19.741102 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:19.706072 27070 raft_consensus.cc:740] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:19.742336 27070 consensus_queue.cc:260] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:19.679319 27226 raft_consensus.cc:2749] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:11:19.732097 25114 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d56909a48cf841eb99365741e9e29e93 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 79d99c0e498349bda74127365219e468 (127.23.140.67:34091) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 79d99c0e498349bda74127365219e468 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:11:19.740131 27029 leader_election.cc:290] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:19.744427 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 89246.4us
I20260709 13:11:19.744484 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:19.638772 27211 consensus_queue.cc:1048] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.069s
I20260709 13:11:19.701335 27169 consensus_queue.cc:1059] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:11:19.748203 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:19.729632 27206 raft_consensus.cc:3060] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:19.760274 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:19.770509 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:19.770777 25301 raft_consensus.cc:2393] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 7: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:19.682636 27212 consensus_queue.cc:1048] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:11:19.747907 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:19.760799 25225 raft_consensus.cc:2393] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 5: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:19.747535 25227 raft_consensus.cc:1240] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:19.731196 27223 raft_consensus.cc:697] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 3 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:19.766984 25298 raft_consensus.cc:2410] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:11:19.743270 27070 raft_consensus.cc:3060] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:19.778968 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:19.769922 25378 raft_consensus.cc:1240] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:19.771107 25375 raft_consensus.cc:2468] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 3.
I20260709 13:11:19.771936 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:19.775521 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:19.753559 25226 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 2.
I20260709 13:11:19.776316 25906 raft_consensus.cc:2393] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 4: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:11:19.741669 25221 raft_consensus.cc:2468] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 3.
I20260709 13:11:19.782492 27223 consensus_queue.cc:237] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:19.737498 27222 consensus_queue.cc:260] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:19.785246 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:19.786010 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:19.743588 25901 raft_consensus.cc:2468] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 3.
I20260709 13:11:19.787995 25226 raft_consensus.cc:1275] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:19.780339 25300 raft_consensus.cc:2468] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 2.
W20260709 13:11:19.776944 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 117841us
W20260709 13:11:19.789937 25271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:19.790140 25226 raft_consensus.cc:1240] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 2. Current term is 3. Ops: []
W20260709 13:11:19.790393 25271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:19.791236 25195 leader_election.cc:304] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:11:19.792706 25226 raft_consensus.cc:1275] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:19.779644 25297 raft_consensus.cc:2468] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 2.
I20260709 13:11:19.797359 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:19.800112 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:19.800729 25297 raft_consensus.cc:2468] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 2.
W20260709 13:11:19.800887 27122 consensus_meta.cc:287] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.548s	user 0.007s	sys 0.006s
I20260709 13:11:19.801630 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:19.802031 25376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36254 (request call id 1609) took 1402 ms. Trace:
I20260709 13:11:19.802174 25297 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 3.
I20260709 13:11:19.802416 25376 rpcz_store.cc:276] 0709 13:11:18.399553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.768648 (+369095us) service_pool.cc:224] Handling call
0709 13:11:18.781661 (+ 13013us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:18.819385 (+ 37724us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:19.801851 (+982466us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b54003110d0. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6e8ad 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:19.801976 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29168512}
W20260709 13:11:19.805334 27135 consensus_meta.cc:287] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent flushing consensus metadata: real 0.537s	user 0.007s	sys 0.002s
I20260709 13:11:19.806006 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:19.806770 25300 raft_consensus.cc:2393] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 3: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:19.807976 27169 consensus_queue.cc:1243] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer 1f539ba21487460085b837e7529a78ce log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 13:11:19.808679 25222 consensus_meta.cc:287] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 0.542s	user 0.008s	sys 0.000s
I20260709 13:11:19.809065 25222 raft_consensus.cc:2468] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 3.
I20260709 13:11:19.809417 27191 leader_election.cc:290] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:19.768465 27231 raft_consensus.cc:493] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.810456 26990 raft_consensus.cc:3055] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:19.810539 27231 raft_consensus.cc:515] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:19.811021 26990 raft_consensus.cc:740] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
W20260709 13:11:19.776610 25223 consensus_meta.cc:287] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 0.529s	user 0.008s	sys 0.001s
I20260709 13:11:19.811592 25223 raft_consensus.cc:2468] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 5.
I20260709 13:11:19.812026 25899 raft_consensus.cc:2468] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 5.
I20260709 13:11:19.811896 26990 consensus_queue.cc:260] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:19.812588 27231 leader_election.cc:290] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:19.780612 26964 raft_consensus.cc:493] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:19.812988 27209 consensus_queue.cc:1048] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:19.813290 26990 raft_consensus.cc:3060] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:19.806023 25908 raft_consensus.cc:1275] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:19.793475 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:19.816030 25230 raft_consensus.cc:1240] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:19.816164 25296 raft_consensus.cc:1275] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:19.818557 25227 raft_consensus.cc:3060] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:19.818677 25271 leader_election.cc:304] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:19.819434 25230 raft_consensus.cc:1275] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:11:19.819802 25230 pending_rounds.cc:85] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce: Aborting all ops after (but not including) 1
I20260709 13:11:19.820070 25230 pending_rounds.cc:107] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:11:19.820338 25230 raft_consensus.cc:2889] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:19.820483 25271 leader_election.cc:304] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:19.821158 27238 raft_consensus.cc:2804] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:19.821607 27238 raft_consensus.cc:697] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 5 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:19.822520 27238 consensus_queue.cc:237] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:19.826000 25227 raft_consensus.cc:2468] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 5.
I20260709 13:11:19.826133 27122 consensus_queue.cc:1059] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:19.827178 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:19.827481 27175 raft_consensus.cc:3055] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:19.827162 27122 consensus_queue.cc:1048] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:19.827889 27175 raft_consensus.cc:740] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:19.829039 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:19.828723 27175 consensus_queue.cc:260] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:19.829581 25376 raft_consensus.cc:2468] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 4.
I20260709 13:11:19.826002 27237 raft_consensus.cc:2804] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:19.830336 27237 raft_consensus.cc:697] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 3 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:19.831257 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:19.831243 27237 consensus_queue.cc:237] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:19.832890 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:19.835211 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:19.835794 25370 raft_consensus.cc:2468] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 3.
I20260709 13:11:19.836501 27175 raft_consensus.cc:3060] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:19.834575 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:19.840237 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:19.895617 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:19.818495 27195 raft_consensus.cc:2749] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:19.813331 26964 raft_consensus.cc:515] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:19.910737 25195 leader_election.cc:304] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:19.912135 25370 raft_consensus.cc:1275] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:19.924767 27190 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:19.834244 27239 raft_consensus.cc:2804] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:19.945744 27081 raft_consensus.cc:3055] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:19.925799 27168 raft_consensus.cc:3060] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:19.952566 27001 raft_consensus.cc:2749] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:19.952330 25195 leader_election.cc:304] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:19.979005 27190 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:19.981271 27239 raft_consensus.cc:697] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 3 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:19.985339 25195 leader_election.cc:304] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:19.999895 25376 raft_consensus.cc:1275] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:20.021072 25195 leader_election.cc:304] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:20.023901 27185 raft_consensus.cc:2804] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:19.983593 27081 raft_consensus.cc:740] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:20.006269 26989 raft_consensus.cc:3060] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:20.024583 27185 raft_consensus.cc:697] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 5 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
W20260709 13:11:20.068863 25872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.070971 27070 raft_consensus.cc:493] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:20.107537 27134 raft_consensus.cc:2804] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:20.106596 27081 consensus_queue.cc:260] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:20.132287 27081 raft_consensus.cc:3060] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:20.105123 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 84120us
I20260709 13:11:20.136580 25195 leader_election.cc:304] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:20.127149 27134 raft_consensus.cc:493] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:20.145663 27134 raft_consensus.cc:3060] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:20.151314 25871 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:20.153127 27002 consensus_meta.cc:287] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.893s	user 0.004s	sys 0.009s
I20260709 13:11:20.127318 27070 raft_consensus.cc:515] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:20.153825 25371 raft_consensus.cc:2468] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 6.
I20260709 13:11:20.155828 27070 leader_election.cc:290] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:20.157562 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:20.119261 27185 consensus_queue.cc:237] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:20.169951 27190 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:20.170739 26964 leader_election.cc:290] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:20.046926 27239 consensus_queue.cc:237] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:20.178776 25345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.180371 27206 raft_consensus.cc:2749] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:20.181504 25230 raft_consensus.cc:1240] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:20.195282 25222 raft_consensus.cc:1240] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:20.197446 26964 consensus_queue.cc:1059] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:20.199725 27206 raft_consensus.cc:493] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.200464 27206 raft_consensus.cc:515] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:20.203630 27206 leader_election.cc:290] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:20.226542 25343 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.020s	sys 0.045s
W20260709 13:11:20.226964 25343 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.020s	sys 0.045s
W20260709 13:11:20.227521 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 642285us
I20260709 13:11:20.228323 25343 leader_election.cc:304] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:20.229341 27002 raft_consensus.cc:2749] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:20.229629 25343 leader_election.cc:304] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:20.258455 25343 leader_election.cc:304] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:20.259711 25343 leader_election.cc:304] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:20.261742 25343 leader_election.cc:304] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:20.260439 27002 raft_consensus.cc:2749] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:20.265211 26559 raft_consensus.cc:2749] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:20.266155 27134 raft_consensus.cc:515] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:20.261536 26922 raft_consensus.cc:2749] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:20.267767 26989 raft_consensus.cc:2749] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:20.261554 27029 consensus_queue.cc:1048] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:11:20.268252 27134 leader_election.cc:290] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:20.269052 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:20.270550 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:20.262596 27242 raft_consensus.cc:2749] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:20.249652 27205 raft_consensus.cc:493] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
W20260709 13:11:20.274369 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.274441 27205 raft_consensus.cc:515] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:20.275624 25298 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af9115771e334c95a7dec25c698514dc"
dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
mode: GRACEFUL
new_leader_uuid: "1f539ba21487460085b837e7529a78ce"
 from {username='slave'} at 127.0.0.1:35660
I20260709 13:11:20.276635 27205 leader_election.cc:290] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:20.254133 27190 raft_consensus.cc:493] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.277235 27190 raft_consensus.cc:515] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:20.279620 27190 leader_election.cc:290] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:20.279875 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:20.286966 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:20.287719 25906 raft_consensus.cc:2410] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:11:20.288534 25874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.273489 25222 raft_consensus.cc:1240] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:20.289031 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:20.289613 27194 consensus_queue.cc:1048] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:20.291329 25222 raft_consensus.cc:1275] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:11:20.285991 27043 consensus_queue.cc:1048] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:11:20.288417 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:20.257930 27233 consensus_queue.cc:1048] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:11:20.291126 25874 leader_election.cc:304] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:11:20.292809 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:20.293887 25874 leader_election.cc:304] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:11:20.296342 27117 raft_consensus.cc:3055] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:20.295375 27081 raft_consensus.cc:2804] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:20.296828 27117 raft_consensus.cc:740] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:20.296995 27081 raft_consensus.cc:493] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:20.297384 27081 raft_consensus.cc:3060] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:20.297689 27117 consensus_queue.cc:260] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:20.298858 27117 raft_consensus.cc:3060] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:20.294525 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:20.301478 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:20.302027 25900 raft_consensus.cc:2376] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 5. Re-sending same reply.
I20260709 13:11:20.302583 25229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1473) took 1183 ms. Trace:
I20260709 13:11:20.295867 27180 raft_consensus.cc:3055] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:20.303520 27180 raft_consensus.cc:740] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:20.281386 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:20.304283 27180 consensus_queue.cc:260] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:20.305202 27180 raft_consensus.cc:3060] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:20.295842 27194 raft_consensus.cc:2804] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:20.305095 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:20.306012 27194 raft_consensus.cc:493] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:20.306160 25375 raft_consensus.cc:3060] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:20.306411 27194 raft_consensus.cc:3060] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:20.294181 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
W20260709 13:11:20.314139 25873 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.855s	user 0.006s	sys 0.023s
W20260709 13:11:20.314549 25873 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.856s	user 0.006s	sys 0.023s
W20260709 13:11:20.315801 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.319326 27081 raft_consensus.cc:515] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:20.320273 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 861308us
I20260709 13:11:20.325697 25899 raft_consensus.cc:2468] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 3.
I20260709 13:11:20.326468 25222 raft_consensus.cc:1240] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:20.303149 25229 rpcz_store.cc:276] 0709 13:11:19.118829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.121010 (+  2181us) service_pool.cc:224] Handling call
0709 13:11:19.121290 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:19.505946 (+384656us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:20.302298 (+796352us) spinlock_profiling.cc:243] Waited 373 ms on lock 0x7b5400194e54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:20.302517 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":857249536}
I20260709 13:11:20.294180 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:20.328182 27194 raft_consensus.cc:515] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:20.262979 25343 leader_election.cc:304] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:11:20.406527 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 65785.3us
I20260709 13:11:20.407241 25375 raft_consensus.cc:2468] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 5.
I20260709 13:11:20.333592 27223 raft_consensus.cc:493] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
W20260709 13:11:20.403519 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:20.425935 25373 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.022s	sys 0.026s
W20260709 13:11:20.426365 25373 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.022s	sys 0.026s
I20260709 13:11:20.428632 25195 leader_election.cc:304] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
W20260709 13:11:20.434273 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 171350us
I20260709 13:11:20.435285 25343 leader_election.cc:304] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:20.436710 25343 leader_election.cc:304] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:20.336776 27081 leader_election.cc:290] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 3 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:20.334213 27239 raft_consensus.cc:493] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
W20260709 13:11:20.446575 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.441471 25270 leader_election.cc:304] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:20.405287 27043 raft_consensus.cc:493] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.335466 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:20.454550 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:20.476428 25229 raft_consensus.cc:2468] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 4.
I20260709 13:11:20.412109 27190 raft_consensus.cc:493] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.343772 27020 raft_consensus.cc:493] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.445392 27209 raft_consensus.cc:493] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.443806 27242 raft_consensus.cc:493] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:20.444355 27002 raft_consensus.cc:2749] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:20.443346 26559 raft_consensus.cc:2749] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:20.443588 26922 raft_consensus.cc:2749] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:20.448501 27237 raft_consensus.cc:2804] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:20.424448 27054 consensus_queue.cc:1048] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
W20260709 13:11:20.485072 27246 log.cc:927] Time spent T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:11:20.484602 27122 raft_consensus.cc:2749] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:20.444123 27223 raft_consensus.cc:515] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:20.451241 26990 consensus_queue.cc:1059] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:11:20.512979 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:20.523905 27194 leader_election.cc:290] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:20.484822 27043 raft_consensus.cc:515] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:20.478621 27239 raft_consensus.cc:515] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:20.534530 26827 raft_consensus.cc:1064] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468: attempting to promote NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 to VOTER
I20260709 13:11:20.543078 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:20.548185 27222 raft_consensus.cc:3060] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:20.550668 27058 raft_consensus.cc:3060] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:20.564117 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:20.564960 25379 raft_consensus.cc:2468] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 4.
I20260709 13:11:20.567682 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:20.568491 25305 raft_consensus.cc:2468] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 5.
I20260709 13:11:20.570756 26979 raft_consensus.cc:3055] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:20.571316 26979 raft_consensus.cc:740] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:20.572346 26979 consensus_queue.cc:260] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:20.570808 27188 raft_consensus.cc:3055] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:20.574450 27188 raft_consensus.cc:740] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:20.575798 25374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36254 (request call id 1620) took 2141 ms. Trace:
I20260709 13:11:20.575433 27188 consensus_queue.cc:260] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:20.576920 27188 raft_consensus.cc:3060] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:20.576309 25374 rpcz_store.cc:276] 0709 13:11:18.434735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.801064 (+366329us) service_pool.cc:224] Handling call
0709 13:11:19.283609 (+482545us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:19.421045 (+137436us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:20.575510 (+1154465us) spinlock_profiling.cc:243] Waited 440 ms on lock 0x7b5400306e50. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6e8ad 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:20.575714 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1013036416}
I20260709 13:11:20.579391 25908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50060 (request call id 333) took 1445 ms. Trace:
I20260709 13:11:20.579867 25908 rpcz_store.cc:276] 0709 13:11:19.133825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.134397 (+   572us) service_pool.cc:224] Handling call
0709 13:11:19.134777 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:19.814177 (+679400us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:20.579104 (+764927us) spinlock_profiling.cc:243] Waited 671 ms on lock 0x7b5400710f54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:20.579322 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1542969728}
I20260709 13:11:20.580917 25374 raft_consensus.cc:1275] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:20.583073 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:20.588661 26772 raft_consensus.cc:3055] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:20.589169 26772 raft_consensus.cc:740] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:20.597625 26772 consensus_queue.cc:260] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:20.598898 26772 raft_consensus.cc:3060] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:20.599983 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:20.600682 25904 raft_consensus.cc:2468] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 4.
I20260709 13:11:20.601284 25904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50060 (request call id 337) took 1011 ms. Trace:
I20260709 13:11:20.601614 25904 rpcz_store.cc:276] 0709 13:11:19.590146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.608041 (+ 17895us) service_pool.cc:224] Handling call
0709 13:11:20.599810 (+991769us) spinlock_profiling.cc:243] Waited 1.77 ms on lock 0x7b58001a3198. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72cb4ab71 00007fd72cb4aa22 00007fd735a63c09 00007fd734bbdee0 00007fd734c870ab 00007fd734c87131 00007fd734c350a0 00007fd734c34984 00007fd72e1af6d4 00007fd72e1af662
0709 13:11:20.601224 (+  1414us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4070272}
I20260709 13:11:20.609980 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:20.610898 25379 raft_consensus.cc:2468] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 4.
I20260709 13:11:20.537484 26827 consensus_queue.cc:237] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:20.617837 27090 leader_election.cc:290] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:20.620398 25901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50058 (request call id 500) took 1262 ms. Trace:
I20260709 13:11:20.620678 25905 raft_consensus.cc:1275] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:20.622352 25901 rpcz_store.cc:276] 0709 13:11:19.358260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.358360 (+   100us) service_pool.cc:224] Handling call
0709 13:11:20.620189 (+1261829us) spinlock_profiling.cc:243] Waited 371 ms on lock 0x7b5400640354. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:20.620337 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":853449472}
I20260709 13:11:20.626163 26964 raft_consensus.cc:3055] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:20.626710 26964 raft_consensus.cc:740] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:20.627743 26964 consensus_queue.cc:260] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:20.629230 26964 raft_consensus.cc:3060] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:20.501412 27209 raft_consensus.cc:515] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:20.649412 27228 raft_consensus.cc:493] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:20.652396 27245 log.cc:927] Time spent T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 13:11:20.653399 27223 leader_election.cc:290] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:20.653649 27254 log.cc:927] Time spent T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
I20260709 13:11:20.654204 27043 leader_election.cc:290] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:20.499925 27020 raft_consensus.cc:515] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:20.521849 27002 consensus_queue.cc:1048] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.137s
I20260709 13:11:20.655154 27239 leader_election.cc:290] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:20.655793 25907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50058 (request call id 510) took 1254 ms. Trace:
I20260709 13:11:20.682180 25907 rpcz_store.cc:276] 0709 13:11:19.402324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.418475 (+ 16151us) service_pool.cc:224] Handling call
0709 13:11:20.655623 (+1237148us) spinlock_profiling.cc:243] Waited 352 ms on lock 0x7b5400357d54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:20.655740 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":810318080}
W20260709 13:11:20.658259 27248 log.cc:927] Time spent T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 13:11:20.515427 27237 raft_consensus.cc:697] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 5 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:20.500317 27190 raft_consensus.cc:515] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:20.676165 27251 log.cc:927] Time spent T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.227s	user 0.000s	sys 0.001s
I20260709 13:11:20.507808 27242 raft_consensus.cc:515] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:20.686640 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 259580us
I20260709 13:11:20.688520 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:20.688797 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:20.689109 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:20.689438 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:20.691632 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:20.692291 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:20.692570 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:20.694308 25905 raft_consensus.cc:2393] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 3: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:11:20.697661 25344 leader_election.cc:304] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
W20260709 13:11:20.700167 25874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.693351 25908 raft_consensus.cc:2468] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 4.
I20260709 13:11:20.685503 27043 raft_consensus.cc:493] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.702865 25874 leader_election.cc:304] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:11:20.677874 27228 raft_consensus.cc:515] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:20.703438 26997 raft_consensus.cc:2804] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:20.706295 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:20.714826 27221 raft_consensus.cc:2804] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:20.724502 26997 raft_consensus.cc:493] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:20.715157 26559 raft_consensus.cc:493] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:20.701031 27212 consensus_queue.cc:1048] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:11:20.730872 27221 raft_consensus.cc:493] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:20.734721 26997 raft_consensus.cc:3060] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:20.714313 27043 raft_consensus.cc:515] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:20.734638 27209 leader_election.cc:290] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:20.756507 27221 raft_consensus.cc:3060] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:20.726083 27237 consensus_queue.cc:237] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:20.768038 27219 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.159s	user 0.028s	sys 0.014s
I20260709 13:11:20.771472 27242 leader_election.cc:290] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:20.777552 27257 log.cc:927] Time spent T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
W20260709 13:11:20.775271 27256 log.cc:927] Time spent T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:11:20.814795 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:20.818202 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:11:20.818936 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:20.820446 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:20.821075 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:20.821094 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 344211us
I20260709 13:11:20.822948 25223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1498) took 1004 ms. Trace:
I20260709 13:11:20.824470 25270 leader_election.cc:304] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:20.823451 25223 rpcz_store.cc:276] 0709 13:11:19.818714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.818862 (+   148us) service_pool.cc:224] Handling call
0709 13:11:19.928075 (+109213us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:19.980663 (+ 52588us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:19.980711 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:19.981330 (+   619us) log.cc:844] Serialized 26 byte log entry
0709 13:11:20.442797 (+461467us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:20.442850 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:20.442967 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:20.822319 (+379352us) raft_consensus.cc:1685] finished
0709 13:11:20.822352 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:20.822704 (+   352us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2425,"raft.queue_time_us":13809,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":24810,"thread_start_us":431240,"threads_started":1,"wal-append.queue_time_us":725268}
I20260709 13:11:20.816717 25222 raft_consensus.cc:2468] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 4.
I20260709 13:11:20.826411 25297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57272 (request call id 1336) took 1033 ms. Trace:
I20260709 13:11:20.826871 25297 rpcz_store.cc:276] 0709 13:11:19.792610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.802868 (+ 10258us) service_pool.cc:224] Handling call
0709 13:11:19.803175 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:19.817250 (+ 14075us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:19.817283 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:19.817723 (+   440us) log.cc:844] Serialized 26 byte log entry
0709 13:11:20.253332 (+435609us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:11:20.253388 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:20.253475 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:20.821404 (+567929us) raft_consensus.cc:1685] finished
0709 13:11:20.821446 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:20.826117 (+  4671us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":120137,"raft.queue_time_us":16072,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":20688,"thread_start_us":435185,"threads_started":1,"wal-append.queue_time_us":526290}
I20260709 13:11:20.830721 25270 leader_election.cc:304] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:20.831017 25229 raft_consensus.cc:2468] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 3.
I20260709 13:11:20.813086 25195 leader_election.cc:304] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:20.833469 25270 leader_election.cc:304] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:20.834522 25195 leader_election.cc:304] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:20.836303 25195 leader_election.cc:304] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
W20260709 13:11:20.839427 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 392208us
I20260709 13:11:20.840688 25343 leader_election.cc:304] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:20.847229 25343 leader_election.cc:304] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:20.849793 25343 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:11:20.852397 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.854630 25194 leader_election.cc:304] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:20.836395 25270 leader_election.cc:304] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
W20260709 13:11:20.864487 25871 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.865690 25901 raft_consensus.cc:2468] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 5.
I20260709 13:11:20.865908 25899 raft_consensus.cc:1275] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:20.867652 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:20.747887 26559 raft_consensus.cc:515] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:20.872584 26772 raft_consensus.cc:3060] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:20.902225 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:20.771618 27238 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.946s	user 0.012s	sys 0.031s
W20260709 13:11:20.910251 27238 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.085s	user 0.012s	sys 0.031s
I20260709 13:11:20.911157 25298 raft_consensus.cc:606] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 5 LEADER]: Received request to transfer leadership to TS 1f539ba21487460085b837e7529a78ce
I20260709 13:11:20.911409 26953 raft_consensus.cc:3060] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:20.873524 26964 raft_consensus.cc:2749] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:20.922339 27029 raft_consensus.cc:2749] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:20.923449 27029 raft_consensus.cc:2749] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:20.924877 27134 raft_consensus.cc:2804] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:20.925549 27134 raft_consensus.cc:493] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:20.765509 27215 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.159s	user 0.021s	sys 0.015s
I20260709 13:11:20.942515 27264 raft_consensus.cc:2749] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:11:20.774675 27219 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.166s	user 0.029s	sys 0.014s
W20260709 13:11:20.946416 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 61916.6us
I20260709 13:11:20.951725 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:20.952557 25907 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 3.
W20260709 13:11:20.953346 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.926038 27134 raft_consensus.cc:3060] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:20.940847 25345 leader_election.cc:304] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:11:20.968084 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 110403us
I20260709 13:11:20.970113 27212 raft_consensus.cc:493] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.970232 27238 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.970985 27212 raft_consensus.cc:515] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:20.971186 27238 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:20.953743 27117 raft_consensus.cc:2749] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:20.984643 26923 consensus_queue.cc:1048] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:11:20.986480 27258 raft_consensus.cc:493] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.987253 27258 raft_consensus.cc:515] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:20.988651 26559 leader_election.cc:290] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:20.991035 26827 raft_consensus.cc:2749] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:11:20.993710 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 157545us
I20260709 13:11:20.994819 27190 leader_election.cc:290] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:20.996140 25270 leader_election.cc:304] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
W20260709 13:11:20.997591 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 143437us
W20260709 13:11:20.997961 27215 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.357s	user 0.021s	sys 0.015s
I20260709 13:11:20.999300 27117 raft_consensus.cc:2749] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:20.999658 25194 leader_election.cc:304] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:21.002624 25270 leader_election.cc:304] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:11:21.003660 27043 leader_election.cc:290] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:21.003919 27117 raft_consensus.cc:2804] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:21.004488 27117 raft_consensus.cc:697] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 3 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:21.004789 27266 raft_consensus.cc:2749] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:20.999804 27262 raft_consensus.cc:2749] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:21.005874 27117 consensus_queue.cc:237] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:21.008280 25195 leader_election.cc:304] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:21.008626 26989 consensus_queue.cc:1048] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:20.980826 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:21.009876 25901 raft_consensus.cc:1275] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 LEARNER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:11:21.018020 27212 leader_election.cc:290] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:21.012997 27249 raft_consensus.cc:2749] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:11:21.015940 25872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.016592 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:21.025933 27237 raft_consensus.cc:2804] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:21.019562 27258 leader_election.cc:290] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:21.028265 27238 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:21.034233 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.031576 26772 raft_consensus.cc:2749] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:21.034009 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:21.042474 25343 leader_election.cc:400] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Vote denied by peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127) with higher term. Message: Invalid argument: T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 2. Current term is 3.
I20260709 13:11:21.015955 26997 raft_consensus.cc:515] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:21.053407 27048 raft_consensus.cc:3055] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:21.054072 27048 raft_consensus.cc:740] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:21.055446 26997 leader_election.cc:290] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:21.055383 27048 consensus_queue.cc:260] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:21.056849 27048 raft_consensus.cc:3060] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:21.058122 27197 raft_consensus.cc:3055] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:21.058568 27197 raft_consensus.cc:740] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:21.048700 25343 leader_election.cc:403] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:11:21.061897 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 60467.8us
W20260709 13:11:21.062945 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 54777.5us
I20260709 13:11:21.068342 27115 raft_consensus.cc:493] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.068980 27115 raft_consensus.cc:515] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:21.069339 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:21.070412 25301 raft_consensus.cc:2393] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 4: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:21.061060 27197 consensus_queue.cc:260] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:21.073629 25874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.073819 27115 leader_election.cc:290] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:21.078342 27178 raft_consensus.cc:493] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.079129 25194 leader_election.cc:304] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:11:21.079015 27178 raft_consensus.cc:515] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:21.080950 25194 leader_election.cc:304] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:11:21.082973 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 142445us
I20260709 13:11:21.082983 25301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57272 (request call id 1333) took 1279 ms. Trace:
I20260709 13:11:21.083945 27249 raft_consensus.cc:2804] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:21.085563 27249 raft_consensus.cc:493] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:21.086047 27249 raft_consensus.cc:3060] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:21.086724 27188 consensus_meta.cc:287] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent flushing consensus metadata: real 0.507s	user 0.014s	sys 0.002s
I20260709 13:11:21.083593 25301 rpcz_store.cc:276] 0709 13:11:19.791838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.792038 (+   200us) service_pool.cc:224] Handling call
0709 13:11:21.031206 (+1239168us) spinlock_profiling.cc:243] Waited 1.86 ms on lock 0x7b5800114098. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72cb4ab71 00007fd72cb4aa22 00007fd735a63c09 00007fd734bbdee0 00007fd734c870ab 00007fd734c87131 00007fd734c350a0 00007fd734c34984 00007fd72e1af6d4 00007fd72e1af662
0709 13:11:21.071647 (+ 40441us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4278144}
I20260709 13:11:21.089427 27115 raft_consensus.cc:3060] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:21.092428 27222 consensus_meta.cc:287] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.543s	user 0.012s	sys 0.007s
I20260709 13:11:21.093304 25371 raft_consensus.cc:2468] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 3.
W20260709 13:11:21.098875 27269 log.cc:927] Time spent T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.319s	user 0.001s	sys 0.001s
I20260709 13:11:21.084055 26997 raft_consensus.cc:2749] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127) with higher term. Message: Invalid argument: T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 2. Current term is 3.
W20260709 13:11:21.103080 27274 log.cc:927] Time spent T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.324s	user 0.004s	sys 0.000s
I20260709 13:11:21.103492 25230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1500) took 1153 ms. Trace:
I20260709 13:11:21.103893 25230 rpcz_store.cc:276] 0709 13:11:19.949557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.949817 (+   260us) service_pool.cc:224] Handling call
0709 13:11:19.950174 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:20.181890 (+231716us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:21.103009 (+921119us) spinlock_profiling.cc:243] Waited 231 ms on lock 0x7b5400196254. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:21.103295 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":531632512}
I20260709 13:11:21.106168 27193 consensus_queue.cc:1048] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:21.081246 27178 leader_election.cc:290] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:21.115710 27197 raft_consensus.cc:3060] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:21.116073 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
W20260709 13:11:21.116456 27281 log.cc:927] Time spent T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:11:21.117113 25297 raft_consensus.cc:2410] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:11:21.110957 25372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56308 (request call id 237) took 1408 ms. Trace:
I20260709 13:11:21.117902 25372 rpcz_store.cc:276] 0709 13:11:19.702074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.705622 (+  3548us) service_pool.cc:224] Handling call
0709 13:11:19.705984 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:19.787017 (+ 81033us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:19.787047 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:19.787086 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:19.787114 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:21.110425 (+1323311us) spinlock_profiling.cc:243] Waited 80.8 ms on lock 0x7b5400306454. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:21.110496 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:21.110734 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":185924480}
I20260709 13:11:21.127552 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:21.129705 27221 raft_consensus.cc:515] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:21.132251 24113 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:11:21.132835 26979 raft_consensus.cc:3060] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:21.135661 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:21.137202 24113 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:21.154844 25298 raft_consensus.cc:1240] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:21.158001 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:21.159817 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:21.129364 27249 raft_consensus.cc:515] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:21.107239 27134 raft_consensus.cc:515] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:21.178313 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:21.178624 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:11:21.178982 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 149488us
I20260709 13:11:21.176033 25229 raft_consensus.cc:1240] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:11:21.173949 25904 raft_consensus.cc:2393] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 5: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:11:21.178699 25128 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33566 (request call id 175) took 8864 ms. Trace:
I20260709 13:11:21.203114 25297 raft_consensus.cc:2468] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 2.
I20260709 13:11:21.178481 27115 raft_consensus.cc:2749] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:21.198908 26953 raft_consensus.cc:2749] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:21.178052 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:21.157091 26772 consensus_queue.cc:1048] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:11:21.209156 27021 raft_consensus.cc:2749] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:21.209527 25194 leader_election.cc:304] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:21.213193 26922 consensus_queue.cc:1048] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:11:21.214129 27157 raft_consensus.cc:493] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:21.214267 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:21.215008 25301 raft_consensus.cc:3060] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:21.214730 27157 raft_consensus.cc:515] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:21.220755 27233 consensus_queue.cc:1059] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.002s
W20260709 13:11:21.221053 25115 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 275226661cc840559134f8c9e5b15719 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 1f539ba21487460085b837e7529a78ce is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:11:21.222321 25345 leader_election.cc:304] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:21.223142 27237 raft_consensus.cc:493] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:21.223616 27237 raft_consensus.cc:3060] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:21.225453 25298 raft_consensus.cc:1275] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:11:21.225849 25298 pending_rounds.cc:85] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19: Aborting all ops after (but not including) 3
W20260709 13:11:21.225786 25227 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58422 (request call id 1494) took 1464 ms (client timeout 1812 ms). Trace:
W20260709 13:11:21.226235 25227 rpcz_store.cc:269] 0709 13:11:19.761574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.775230 (+ 13656us) service_pool.cc:224] Handling call
0709 13:11:21.225447 (+1450217us) spinlock_profiling.cc:243] Waited 37.1 ms on lock 0x7b540004b854. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:21.225596 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":85372288}
W20260709 13:11:21.228042 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.220242 25343 leader_election.cc:304] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:21.230600 27219 raft_consensus.cc:2804] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:21.231069 27219 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:21.231544 27219 raft_consensus.cc:3060] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:21.231969 25222 raft_consensus.cc:1240] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:21.232192 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:21.233510 25299 raft_consensus.cc:2468] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 5.
I20260709 13:11:21.229444 26989 raft_consensus.cc:3060] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:21.219450 25305 raft_consensus.cc:2468] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 4.
I20260709 13:11:21.236446 27221 leader_election.cc:290] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 5 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:21.236706 25872 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.140.66:33127 timed out after 1.739s (SENT) [suppressed 71 similar messages]
I20260709 13:11:21.226240 25298 pending_rounds.cc:107] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:11:21.238197 25298 raft_consensus.cc:2889] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:21.240579 27157 leader_election.cc:290] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:21.244987 25301 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 5.
W20260709 13:11:21.246235 25873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.250710 25343 leader_election.cc:304] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:21.237505 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:21.258828 27222 raft_consensus.cc:2749] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:11:21.261039 25902 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50058 (request call id 502) took 1896 ms (client timeout 1601 ms). Trace:
I20260709 13:11:21.257665 26953 raft_consensus.cc:2749] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:21.245904 27115 raft_consensus.cc:3055] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:21.262626 27115 raft_consensus.cc:740] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:21.262882 27196 raft_consensus.cc:493] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:21.261473 25902 rpcz_store.cc:269] 0709 13:11:19.364854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.366151 (+  1297us) service_pool.cc:224] Handling call
0709 13:11:21.237186 (+1871035us) spinlock_profiling.cc:243] Waited 7.81 ms on lock 0x7b58001a3198. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72cb4ab71 00007fd72cb4aa22 00007fd735a63c09 00007fd734bbdee0 00007fd734c870ab 00007fd734c87131 00007fd734c350a0 00007fd734c34984 00007fd72e1af6d4 00007fd72e1af662
0709 13:11:21.260918 (+ 23732us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17954048}
I20260709 13:11:21.263492 27196 raft_consensus.cc:515] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:21.266474 27196 leader_election.cc:290] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:21.270573 25223 raft_consensus.cc:1240] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 4 LEADER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:21.273061 27048 raft_consensus.cc:493] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.273702 27048 raft_consensus.cc:515] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:21.275887 27048 leader_election.cc:290] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:21.276494 27002 consensus_queue.cc:1048] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:21.278218 27002 consensus_queue.cc:1048] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:11:21.279654 27280 log.cc:927] Time spent T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.372s	user 0.003s	sys 0.000s
I20260709 13:11:21.279158 25126 catalog_manager.cc:5697] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 3 to 4, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 4 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:11:21.282222 27276 log.cc:927] Time spent T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.500s	user 0.000s	sys 0.002s
I20260709 13:11:21.263517 27115 consensus_queue.cc:260] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:21.283532 27115 raft_consensus.cc:3060] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:21.284396 25371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36264 (request call id 1300) took 1007 ms. Trace:
W20260709 13:11:21.284569 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.284909 25371 rpcz_store.cc:276] 0709 13:11:20.276783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:20.542756 (+265973us) service_pool.cc:224] Handling call
0709 13:11:21.284145 (+741389us) spinlock_profiling.cc:243] Waited 549 ms on lock 0x7b540033ed54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:21.284298 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1263015168}
I20260709 13:11:21.287199 25229 raft_consensus.cc:1275] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:11:21.287377 27272 log.cc:927] Time spent T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.506s	user 0.002s	sys 0.000s
I20260709 13:11:21.273108 27020 leader_election.cc:290] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:21.260040 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:21.289240 25305 raft_consensus.cc:3060] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:21.289522 25230 raft_consensus.cc:1275] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:11:21.291308 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:21.295475 25195 leader_election.cc:304] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:11:21.295117 27233 raft_consensus.cc:493] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:21.296877 27233 raft_consensus.cc:515] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:21.298029 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 49447.3us
I20260709 13:11:21.299141 27233 leader_election.cc:290] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:21.299424 25345 leader_election.cc:304] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:21.300060 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:21.300746 25905 raft_consensus.cc:2468] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 3.
I20260709 13:11:21.301489 25227 raft_consensus.cc:1240] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 5 LEADER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:21.302627 27222 consensus_queue.cc:1059] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:21.303220 26953 raft_consensus.cc:2749] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:21.303820 27222 raft_consensus.cc:3055] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:21.304224 27222 raft_consensus.cc:740] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:21.307380 25271 leader_election.cc:304] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:21.308472 27031 consensus_queue.cc:1059] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:21.309434 27266 raft_consensus.cc:2804] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:21.309983 27266 raft_consensus.cc:697] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 5 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:21.310158 26964 raft_consensus.cc:3055] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:21.310650 26964 raft_consensus.cc:740] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:21.310972 27266 consensus_queue.cc:237] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:21.311657 26964 consensus_queue.cc:260] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:21.312433 25302 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57272 (request call id 1292) took 3542 ms (client timeout 2135 ms). Trace:
I20260709 13:11:21.313030 26964 raft_consensus.cc:3060] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:21.312848 25302 rpcz_store.cc:269] 0709 13:11:17.769627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.771006 (+  1379us) service_pool.cc:224] Handling call
0709 13:11:21.312082 (+3541076us) spinlock_profiling.cc:243] Waited 1.81 s on lock 0x7b54000f9e54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:21.312225 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4167228160}
I20260709 13:11:21.314160 27209 raft_consensus.cc:493] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.314448 25302 raft_consensus.cc:1275] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:21.314694 27209 raft_consensus.cc:515] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:21.316668 25302 raft_consensus.cc:1275] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:21.316830 27209 leader_election.cc:290] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:21.305382 27222 consensus_queue.cc:260] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:21.318965 27222 raft_consensus.cc:3060] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:21.317763 25304 raft_consensus.cc:3055] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:21.323700 25304 raft_consensus.cc:740] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:21.326491 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:21.327330 25374 raft_consensus.cc:3060] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:21.330892 25300 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 2.
I20260709 13:11:21.328181 25304 consensus_queue.cc:260] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:21.343412 25297 raft_consensus.cc:1275] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:11:21.345659 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:21.346904 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 94584.4us
I20260709 13:11:21.347851 25343 leader_election.cc:304] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:21.348006 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:21.349232 25343 leader_election.cc:304] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:21.350150 27249 leader_election.cc:290] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:21.296152 25126 catalog_manager.cc:5697] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 1 to 2, leader changed from 79d99c0e498349bda74127365219e468 (127.23.140.67) to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 2 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
W20260709 13:11:21.387516 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 98832.8us
W20260709 13:11:21.388335 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 139837us
W20260709 13:11:21.390245 25872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.392067 27001 raft_consensus.cc:2804] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:21.342530 26989 raft_consensus.cc:2749] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:21.398661 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:11:21.400404 27270 log.cc:927] Time spent T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.621s	user 0.001s	sys 0.001s
I20260709 13:11:21.402098 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:11:21.406100 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.409358 25305 raft_consensus.cc:2468] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 5.
I20260709 13:11:21.408456 25194 leader_election.cc:304] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:11:21.200652 25128 rpcz_store.cc:276] 0709 13:11:12.291346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.291530 (+   184us) service_pool.cc:224] Handling call
0709 13:11:21.143661 (+8852131us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:15.788413 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:16.035252 (+246839us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:16.038859 (+  3607us) write_op.cc:435] Acquired schema lock
0709 13:11:16.056087 (+ 17228us) tablet.cc:662] Decoding operations
0709 13:11:16.317288 (+261201us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:16.326282 (+  8994us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:16.332499 (+  6217us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:11:16.440544 (+108045us) tablet.cc:701] Row locks acquired
0709 13:11:16.440563 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:11:16.440695 (+   132us) write_op.cc:270] Start()
0709 13:11:16.452380 (+ 11685us) write_op.cc:276] Timestamp: P: 1783602676440654 usec, L: 0
0709 13:11:16.452414 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 13:11:16.515902 (+ 63488us) log.cc:844] Serialized 3664 byte log entry
0709 13:11:17.126938 (+611036us) op_driver.cc:464] REPLICATION: finished
0709 13:11:17.263278 (+136340us) write_op.cc:301] APPLY: starting
0709 13:11:17.263361 (+    83us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:17.263582 (+   221us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:17.263692 (+   110us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:17.316149 (+ 52457us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:17.334262 (+ 18113us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 13:11:17.335597 (+  1335us) write_op.cc:312] APPLY: finished
0709 13:11:17.348702 (+ 13105us) log.cc:844] Serialized 71 byte log entry
0709 13:11:17.353798 (+  5096us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:17.380805 (+ 27007us) write_op.cc:454] Released schema lock
0709 13:11:17.392082 (+ 11277us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:17.396326 (+  4244us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:17.396368 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":123968,"reported_tablets":19,"child_traces":[["op",{"apply.queue_time_us":123622,"apply.run_cpu_time_us":5694,"apply.run_wall_time_us":132990,"num_ops":9,"prepare.queue_time_us":922770,"prepare.run_cpu_time_us":40720,"prepare.run_wall_time_us":877145,"raft.queue_time_us":445582,"raft.run_cpu_time_us":11697,"raft.run_wall_time_us":75293,"replication_time_us":671897,"thread_start_us":1185645,"threads_started":4,"wal-append.queue_time_us":148354,"wal-append.run_cpu_time_us":27025,"wal-append.run_wall_time_us":1707703}]]}
I20260709 13:11:21.413723 27021 raft_consensus.cc:2804] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:21.386257 27197 raft_consensus.cc:493] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:21.386512 27002 raft_consensus.cc:2749] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:21.416536 25230 raft_consensus.cc:2468] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 4.
I20260709 13:11:21.418756 27239 raft_consensus.cc:493] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:21.419533 25194 leader_election.cc:304] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:11:21.419697 27202 raft_consensus.cc:2804] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:21.397400 25902 raft_consensus.cc:1240] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:21.418589 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:21.421819 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:21.427595 25223 raft_consensus.cc:2393] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 5: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:21.418545 25228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1489) took 2285 ms. Trace:
I20260709 13:11:21.424665 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:21.429718 25304 raft_consensus.cc:3060] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:21.421617 27021 raft_consensus.cc:493] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:21.427001 25126 catalog_manager.cc:5697] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:21.428297 25379 raft_consensus.cc:2468] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 6.
I20260709 13:11:21.435588 25222 raft_consensus.cc:2410] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:11:21.436875 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.427943 25228 rpcz_store.cc:276] 0709 13:11:19.130406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.425267 (+294861us) service_pool.cc:224] Handling call
0709 13:11:19.425569 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:19.425784 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:19.425816 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:21.298118 (+1872302us) spinlock_profiling.cc:243] Waited 8.24 ms on lock 0x7b2c000014c8. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72e568a11 00007fd72e578372 00007fd72fcaaa01 00007fd72fc6f43a 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2
0709 13:11:21.298601 (+   483us) log.cc:844] Serialized 26 byte log entry
0709 13:11:21.394066 (+ 95465us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:11:21.394103 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:21.394187 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:21.396126 (+  1939us) raft_consensus.cc:1685] finished
0709 13:11:21.396146 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:21.415982 (+ 19836us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18948864,"thread_start_us":95070,"threads_started":1,"wal-append.queue_time_us":95443}
I20260709 13:11:21.441108 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:21.441582 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:21.441777 25370 raft_consensus.cc:2468] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 3.
I20260709 13:11:21.435876 27021 raft_consensus.cc:3060] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:21.442492 27185 raft_consensus.cc:3060] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:21.446704 25221 raft_consensus.cc:1240] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:21.448057 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:21.448926 25373 raft_consensus.cc:2393] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 5: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:21.449695 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:21.450726 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:21.453863 27242 raft_consensus.cc:2749] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:11:21.455119 25872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.455755 27192 consensus_queue.cc:1048] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:11:21.456630 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 107496us
I20260709 13:11:21.457414 25343 leader_election.cc:304] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:21.458809 25343 leader_election.cc:304] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:21.459589 27002 raft_consensus.cc:2764] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 13:11:21.460186 27002 raft_consensus.cc:2749] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:21.461977 25343 leader_election.cc:304] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:21.430238 27134 leader_election.cc:290] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:21.463330 27001 raft_consensus.cc:493] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:21.463793 27001 raft_consensus.cc:3060] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:21.464834 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:21.428231 27202 raft_consensus.cc:493] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:21.466089 27202 raft_consensus.cc:3060] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:21.467682 25194 leader_election.cc:304] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:21.422303 27117 raft_consensus.cc:493] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:21.425230 26989 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:21.483224 25228 raft_consensus.cc:1275] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:21.471455 27021 raft_consensus.cc:515] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:21.433552 27196 raft_consensus.cc:2804] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:21.471429 25372 raft_consensus.cc:2468] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 1.
W20260709 13:11:21.466789 27259 log.cc:927] Time spent T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.688s	user 0.004s	sys 0.004s
I20260709 13:11:21.489846 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:21.489495 27196 raft_consensus.cc:493] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:21.499902 27196 raft_consensus.cc:3060] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:21.499617 25126 catalog_manager.cc:5697] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 1 to 3, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 3 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
I20260709 13:11:21.501902 26989 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:21.430495 27219 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:21.504359 26989 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:21.506107 25225 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58422 (request call id 1479) took 2363 ms (client timeout 2950 ms). Trace:
W20260709 13:11:21.506539 25225 rpcz_store.cc:269] 0709 13:11:19.125841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.271619 (+145778us) service_pool.cc:224] Handling call
0709 13:11:21.431559 (+2159940us) spinlock_profiling.cc:243] Waited 413 ms on lock 0x7b5400435154. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:21.489507 (+ 57948us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":949744512}
I20260709 13:11:21.508148 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:21.431783 27197 raft_consensus.cc:515] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:21.493476 27002 raft_consensus.cc:2749] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:21.488736 27239 raft_consensus.cc:515] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:21.484570 27249 raft_consensus.cc:2804] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:21.511534 27249 raft_consensus.cc:493] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:21.511902 27249 raft_consensus.cc:3060] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:21.511963 27239 leader_election.cc:290] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:21.499784 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:21.501379 25126 catalog_manager.cc:5697] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 2 to 3, leader changed from 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 3 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:21.520038 25226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1499) took 1590 ms. Trace:
I20260709 13:11:21.523414 25304 raft_consensus.cc:1275] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:11:21.525275 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.528460 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:11:21.528755 25871 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.529498 27021 leader_election.cc:290] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:21.530144 27021 raft_consensus.cc:493] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:21.530046 27237 raft_consensus.cc:515] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:21.530726 27021 raft_consensus.cc:515] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:21.532171 27237 leader_election.cc:290] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:21.532825 27021 leader_election.cc:290] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:21.532907 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 70997.7us
I20260709 13:11:21.534583 25376 raft_consensus.cc:1240] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:21.534494 25343 leader_election.cc:304] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:21.536434 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:21.520475 25226 rpcz_store.cc:276] 0709 13:11:19.834199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.835688 (+  1489us) service_pool.cc:224] Handling call
0709 13:11:19.835972 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:19.847093 (+ 11121us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:19.847135 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:19.847667 (+   532us) log.cc:844] Serialized 26 byte log entry
0709 13:11:21.307808 (+1460141us) spinlock_profiling.cc:243] Waited 64.8 ms on lock 0x7b18003f9220. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72cb64e07 00007fd7359bfab9 00007fd72cb8169b 00007fd72cb7f93f 00007fd72cb81c02 00007fd72f80920b 00007fd72f80ed23 00007fd72f80f0d1 00007fd72fc2aa0f
0709 13:11:21.391573 (+ 83765us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:11:21.391617 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:21.391753 (+   136us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:21.396308 (+  4555us) raft_consensus.cc:1685] finished
0709 13:11:21.396330 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:21.424313 (+ 27983us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":99,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":24250,"spinlock_wait_cycles":149046656,"thread_start_us":83505,"threads_started":1,"wal-append.queue_time_us":1543924}
I20260709 13:11:21.534229 25126 catalog_manager.cc:5697] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 2 to 3, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 3 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:21.544001 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 52539.2us
I20260709 13:11:21.506107 27219 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:21.548998 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 117864us
I20260709 13:11:21.555903 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:21.557160 25370 raft_consensus.cc:1275] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:21.560382 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:21.561074 25195 leader_election.cc:304] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:11:21.547399 27031 raft_consensus.cc:493] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:21.569805 25195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.572606 25343 leader_election.cc:304] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:21.574025 25378 raft_consensus.cc:1275] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:21.574539 25126 catalog_manager.cc:5697] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 2 to 4, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 4 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
I20260709 13:11:21.575766 26772 consensus_queue.cc:1048] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:21.575582 26964 consensus_queue.cc:1048] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:21.578006 25304 raft_consensus.cc:1275] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:11:21.585098 25377 raft_consensus.cc:2410] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:11:21.579689 27239 consensus_queue.cc:1048] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:21.583585 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:21.585180 25379 raft_consensus.cc:2468] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 3.
I20260709 13:11:21.586719 25297 raft_consensus.cc:3060] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:21.587775 27190 raft_consensus.cc:493] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.588189 27197 leader_election.cc:290] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:21.588375 27190 raft_consensus.cc:515] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:21.590107 25343 leader_election.cc:304] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:21.590590 27190 leader_election.cc:290] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:21.590808 26827 raft_consensus.cc:2749] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:21.591022 27228 leader_election.cc:290] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:21.591483 25343 leader_election.cc:304] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:21.591688 26827 raft_consensus.cc:2804] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:21.592267 26827 raft_consensus.cc:493] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:21.592761 26827 raft_consensus.cc:3060] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:21.593035 25343 leader_election.cc:304] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:21.593462 27211 raft_consensus.cc:2804] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:21.593922 27211 raft_consensus.cc:493] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:21.594070 25372 raft_consensus.cc:1275] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:11:21.594324 27211 raft_consensus.cc:3060] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:21.594583 25126 catalog_manager.cc:5697] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 1 to 3, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68). New cstate: current_term: 3 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:11:21.595587 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:21.595870 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:21.596392 25300 raft_consensus.cc:2393] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 4: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:21.596657 25302 raft_consensus.cc:2393] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 5: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:21.561646 26922 raft_consensus.cc:493] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:21.598006 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:21.597640 25302 raft_consensus.cc:1275] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:21.597971 27242 raft_consensus.cc:2749] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:21.602941 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:21.602767 27249 raft_consensus.cc:515] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:21.604566 25271 leader_election.cc:304] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:21.604733 26827 raft_consensus.cc:515] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:21.538096 27117 raft_consensus.cc:515] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:21.615914 25297 raft_consensus.cc:2468] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 3.
I20260709 13:11:21.616839 25301 raft_consensus.cc:2468] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 4.
I20260709 13:11:21.617579 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:21.596101 25126 catalog_manager.cc:5697] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 1 to 2, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 2 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:21.621254 25299 raft_consensus.cc:1240] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:21.621888 25303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57272 (request call id 1334) took 1774 ms. Trace:
I20260709 13:11:21.622738 25271 leader_election.cc:304] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:21.581087 27212 raft_consensus.cc:2749] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:21.624536 25873 leader_election.cc:304] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:21.623075 25903 raft_consensus.cc:1240] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:11:21.624652 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:21.558769 27233 consensus_queue.cc:1048] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 13:11:21.586727 27021 raft_consensus.cc:2804] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:21.637924 25126 catalog_manager.cc:5697] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 2 to 4, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 4 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
W20260709 13:11:21.640729 27268 log.cc:927] Time spent T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.860s	user 0.001s	sys 0.008s
I20260709 13:11:21.641324 26922 raft_consensus.cc:515] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:21.641469 27202 raft_consensus.cc:515] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:21.642974 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:21.643630 27202 leader_election.cc:290] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:21.643690 26922 leader_election.cc:290] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:21.644861 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:11:21.625182 27286 log.cc:927] Time spent T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:11:21.646795 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:21.657086 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:21.657264 25379 raft_consensus.cc:2468] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 5.
I20260709 13:11:21.643648 25899 raft_consensus.cc:2468] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 4.
I20260709 13:11:21.627197 27197 raft_consensus.cc:2749] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:21.655118 27196 raft_consensus.cc:515] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:11:21.671020 25305 raft_consensus.cc:1240] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:21.672128 27196 leader_election.cc:290] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:21.674124 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:21.658408 27209 raft_consensus.cc:2804] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:21.675518 27209 raft_consensus.cc:493] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:21.675884 27209 raft_consensus.cc:3060] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:21.659678 27185 raft_consensus.cc:2749] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:21.678416 25902 raft_consensus.cc:1275] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:11:21.678586 25225 raft_consensus.cc:1240] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:21.678773 27238 raft_consensus.cc:493] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.679296 27238 raft_consensus.cc:515] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:21.680136 25224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58418 (request call id 1561) took 3484 ms. Trace:
I20260709 13:11:21.680841 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:21.681423 27238 leader_election.cc:290] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:21.662328 25872 leader_election.cc:336] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Timed out: RequestConsensusVote RPC to 127.23.140.66:33127 timed out after 2.155s (SENT)
I20260709 13:11:21.684122 25221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54000 (request call id 267) took 2236 ms. Trace:
I20260709 13:11:21.684489 25872 leader_election.cc:304] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:21.684576 25221 rpcz_store.cc:276] 0709 13:11:19.448156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.782552 (+334396us) service_pool.cc:224] Handling call
0709 13:11:21.446300 (+1663748us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:21.447243 (+   943us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:21.683904 (+236661us) spinlock_profiling.cc:243] Waited 1.65 s on lock 0x7b5400435150. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6e8ad 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:21.684051 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3799758720}
I20260709 13:11:21.669021 27258 raft_consensus.cc:2804] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:21.628069 25303 rpcz_store.cc:276] 0709 13:11:19.792092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.792192 (+   100us) service_pool.cc:224] Handling call
0709 13:11:21.266423 (+1474231us) spinlock_profiling.cc:243] Waited 1.77 ms on lock 0x7b5800114098. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72cb4ab71 00007fd72cb4aa22 00007fd735a63c09 00007fd734bbdee0 00007fd734c870ab 00007fd734c87131 00007fd734c48fc0 00007fd734c33929 00007fd734c333d2 00007fd72e1aabd4
0709 13:11:21.266746 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:21.318357 (+ 51611us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:21.318383 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:21.318965 (+   582us) log.cc:844] Serialized 26 byte log entry
0709 13:11:21.407939 (+ 88974us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:21.422173 (+ 14234us) log.cc:844] Serialized 14 byte log entry
0709 13:11:21.422315 (+   142us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:21.422359 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:21.561518 (+139159us) raft_consensus.cc:1685] finished
0709 13:11:21.566155 (+  4637us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:21.566312 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65073,"prepare.queue_time_us":12427,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":54668,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":3332,"spinlock_wait_cycles":4060544,"thread_start_us":88603,"threads_started":1,"wal-append.queue_time_us":73697}
I20260709 13:11:21.680514 25224 rpcz_store.cc:276] 0709 13:11:18.195870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.196107 (+   237us) service_pool.cc:224] Handling call
0709 13:11:19.611283 (+1415176us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:19.611575 (+   292us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:19.611602 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:19.641069 (+ 29467us) log.cc:844] Serialized 26 byte log entry
0709 13:11:21.096565 (+1455496us) spinlock_profiling.cc:243] Waited 1.65 ms on lock 0x7b18003d5d00. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72cb64e07 00007fd7359bfab9 00007fd72cb8169b 00007fd72cb7f93f 00007fd72cb81c02 00007fd72f80920b 00007fd72f80ed23 00007fd72f80f0d1 00007fd72fc2aa0f
0709 13:11:21.177453 (+ 80888us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:21.177497 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:21.177609 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:21.252192 (+ 74583us) raft_consensus.cc:1685] finished
0709 13:11:21.252216 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:21.679869 (+427653us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b54000eb5d0. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6e8ad 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:21.679964 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":19879,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":6620,"spinlock_wait_cycles":3257588992,"thread_start_us":46517,"threads_started":1,"wal-append.queue_time_us":1580927}
I20260709 13:11:21.659837 25297 raft_consensus.cc:1240] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:11:21.647828 27021 raft_consensus.cc:493] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:21.688107 25126 catalog_manager.cc:5697] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 2 to 3, leader changed from 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 3 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:21.693835 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:21.621623 27031 raft_consensus.cc:515] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:21.715135 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.733438 25372 raft_consensus.cc:1275] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:11:21.734645 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 84946us
I20260709 13:11:21.736259 25304 raft_consensus.cc:3060] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:21.695955 27021 raft_consensus.cc:3060] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:21.693588 27258 raft_consensus.cc:493] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:21.733474 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
W20260709 13:11:21.743461 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 119012us
I20260709 13:11:21.744827 25371 raft_consensus.cc:2393] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 5: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:21.746573 25195 leader_election.cc:304] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:21.748701 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:21.750367 25126 catalog_manager.cc:5697] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 2 to 3, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 3 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:21.752148 25298 raft_consensus.cc:2468] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 4.
I20260709 13:11:21.702414 25374 raft_consensus.cc:2468] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 4.
I20260709 13:11:21.754908 25873 leader_election.cc:304] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:21.757014 26827 leader_election.cc:290] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:21.758112 27023 raft_consensus.cc:2749] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:21.761986 25872 leader_election.cc:304] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:21.733960 25903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50060 (request call id 339) took 1014 ms. Trace:
I20260709 13:11:21.772981 25373 raft_consensus.cc:1240] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:21.774537 25873 leader_election.cc:304] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:21.742000 27258 raft_consensus.cc:3060] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:21.782320 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.784171 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:21.783425 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:21.786175 25371 raft_consensus.cc:3060] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:21.786744 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:21.784699 25873 leader_election.cc:304] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce
W20260709 13:11:21.790354 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 43899.3us
W20260709 13:11:21.791749 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.776396 27228 raft_consensus.cc:2749] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:21.749524 27265 consensus_queue.cc:1059] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:11:21.780987 27196 raft_consensus.cc:2804] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:21.773211 26964 raft_consensus.cc:493] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.795894 25376 raft_consensus.cc:2393] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 4: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:21.804760 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:21.785526 27157 raft_consensus.cc:2749] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:21.804111 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:21.809809 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:21.787312 25302 raft_consensus.cc:2376] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 2. Re-sending same reply.
I20260709 13:11:21.797740 25126 catalog_manager.cc:5697] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 1 to 2, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 2 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:21.805181 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:21.805421 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:21.814426 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:21.814706 25225 raft_consensus.cc:1240] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 3. Current term is 5. Ops: []
I20260709 13:11:21.821981 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:21.824607 25126 catalog_manager.cc:5697] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 3 to 5, leader changed from 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 5 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:21.823275 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 61438.8us
I20260709 13:11:21.823479 25222 raft_consensus.cc:1240] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:21.823885 27221 raft_consensus.cc:2804] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:21.822080 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:21.826896 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:21.800323 27196 raft_consensus.cc:493] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:21.833623 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:21.829962 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:21.834699 25301 raft_consensus.cc:2410] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:11:21.830775 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:21.834050 25126 catalog_manager.cc:5697] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 2 to 4, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 4 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
I20260709 13:11:21.831727 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:21.831566 25195 leader_election.cc:304] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:11:21.831902 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:21.833022 25226 raft_consensus.cc:1275] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:21.833182 25224 raft_consensus.cc:2393] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 5: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:21.812580 27188 raft_consensus.cc:2749] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:21.832016 25375 raft_consensus.cc:1275] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:21.810515 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
W20260709 13:11:21.835062 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 50427us
I20260709 13:11:21.839521 25873 leader_election.cc:304] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:21.837888 25223 raft_consensus.cc:2393] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 5: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:21.829329 27221 raft_consensus.cc:493] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:21.838682 27185 consensus_queue.cc:1059] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:11:21.776631 25903 rpcz_store.cc:276] 0709 13:11:20.692537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:20.694339 (+  1802us) service_pool.cc:224] Handling call
0709 13:11:21.622337 (+927998us) spinlock_profiling.cc:243] Waited 1.12 ms on lock 0x7b58001a3198. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72cb4ab71 00007fd72cb4aa22 00007fd735a63c09 00007fd734bbdee0 00007fd734c870ab 00007fd734c87131 00007fd734c48fc0 00007fd734c33929 00007fd734c333d2 00007fd72e1aabd4
0709 13:11:21.622641 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:21.655121 (+ 32480us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:21.700023 (+ 44902us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2565888}
W20260709 13:11:21.845103 27301 log.cc:927] Time spent T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 13:11:21.844779 27221 raft_consensus.cc:3060] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:21.824780 27249 leader_election.cc:290] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:21.846220 25304 raft_consensus.cc:2468] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 5.
I20260709 13:11:21.847607 25873 leader_election.cc:304] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:21.824787 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:11:21.854909 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.829414 27266 raft_consensus.cc:493] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.867818 25305 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 3.
I20260709 13:11:21.836781 27196 raft_consensus.cc:3060] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:21.869122 25873 leader_election.cc:304] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
W20260709 13:11:21.870376 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.876613 25223 raft_consensus.cc:1240] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:21.870847 27228 raft_consensus.cc:493] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:21.881254 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.878567 26979 raft_consensus.cc:2804] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:21.846236 27189 raft_consensus.cc:2804] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:21.870986 27265 consensus_queue.cc:1059] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:11:21.837138 25296 raft_consensus.cc:2468] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 4.
I20260709 13:11:21.849972 25126 catalog_manager.cc:5697] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 2 to 3, leader changed from 79d99c0e498349bda74127365219e468 (127.23.140.67) to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 3 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
W20260709 13:11:21.887176 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 44278.2us
I20260709 13:11:21.842096 25899 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 3.
I20260709 13:11:21.878840 27266 raft_consensus.cc:515] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:21.895277 25345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.871183 27157 raft_consensus.cc:2749] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:21.838616 27202 consensus_queue.cc:1048] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:11:21.889407 25902 raft_consensus.cc:2393] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 5: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:11:21.900163 27266 leader_election.cc:290] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:21.900453 27238 consensus_queue.cc:1059] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:21.891451 27189 raft_consensus.cc:493] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:21.838769 26964 raft_consensus.cc:515] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:21.886734 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:21.904266 25305 raft_consensus.cc:1240] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:21.846272 27237 consensus_queue.cc:1048] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:11:21.842137 27212 consensus_queue.cc:1048] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:11:21.916849 25296 raft_consensus.cc:1240] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:21.916855 27134 consensus_queue.cc:1048] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:21.884503 26979 raft_consensus.cc:493] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:21.884421 27228 raft_consensus.cc:515] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:21.922042 25302 raft_consensus.cc:2468] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 2.
I20260709 13:11:21.928478 25305 raft_consensus.cc:1240] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 4. Current term is 5. Ops: [3.5-4.6]
W20260709 13:11:21.930657 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.922073 26979 raft_consensus.cc:3060] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:21.932753 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.928381 27221 raft_consensus.cc:515] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:21.911319 27249 consensus_queue.cc:1048] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:11:21.934775 27221 leader_election.cc:290] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:21.913653 27189 raft_consensus.cc:3060] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:21.887220 26827 consensus_queue.cc:1059] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:11:21.913489 27265 raft_consensus.cc:2749] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:21.903115 27192 consensus_queue.cc:1048] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:11:21.924837 25126 catalog_manager.cc:5697] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 2 to 4, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 4 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
W20260709 13:11:21.937494 27252 log.cc:927] Time spent T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:11:21.908157 27185 consensus_queue.cc:1048] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:11:21.928602 27157 raft_consensus.cc:3055] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:21.971093 25305 raft_consensus.cc:1240] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 5 LEADER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:21.923180 27031 leader_election.cc:290] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:21.983165 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 115073us
W20260709 13:11:21.983347 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 81162.6us
I20260709 13:11:21.993697 25305 raft_consensus.cc:1240] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:21.942408 27233 consensus_queue.cc:1048] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:11:21.995080 25194 leader_election.cc:304] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:21.994462 27202 consensus_queue.cc:1048] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 13:11:22.006538 26964 leader_election.cc:290] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:22.007670 27031 raft_consensus.cc:493] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.008201 27031 raft_consensus.cc:515] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:22.008813 27023 raft_consensus.cc:3055] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:22.009191 27023 raft_consensus.cc:740] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:21.980574 27157 raft_consensus.cc:740] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:21.986512 25126 catalog_manager.cc:5697] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:11:22.013109 25194 leader_election.cc:304] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:11:21.991366 27001 consensus_meta.cc:287] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 0.527s	user 0.008s	sys 0.004s
W20260709 13:11:22.023628 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 154585us
I20260709 13:11:22.032250 27265 consensus_queue.cc:1059] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:22.033874 27221 raft_consensus.cc:3055] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:22.034368 27221 raft_consensus.cc:740] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:22.035522 27221 consensus_queue.cc:260] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:22.037864 25873 leader_election.cc:304] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce
W20260709 13:11:21.993257 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 123487us
I20260709 13:11:22.024797 27202 raft_consensus.cc:2804] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:21.977862 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:22.045063 27202 raft_consensus.cc:493] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:22.045593 27202 raft_consensus.cc:3060] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:22.010299 27258 raft_consensus.cc:515] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:22.054905 27157 consensus_queue.cc:260] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:22.055838 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:22.057192 25371 raft_consensus.cc:2468] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 7.
I20260709 13:11:22.057211 25370 raft_consensus.cc:1240] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:11:22.026016 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:22.058806 25373 raft_consensus.cc:2410] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:11:22.066666 25345 leader_election.cc:304] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:22.074970 25126 catalog_manager.cc:5697] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 1 to 2, leader changed from 79d99c0e498349bda74127365219e468 (127.23.140.67) to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 2 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
I20260709 13:11:22.077011 25345 leader_election.cc:304] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:22.055724 27258 leader_election.cc:290] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:22.051234 27228 leader_election.cc:290] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:11:22.086097 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 185964us
W20260709 13:11:22.087673 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 185009us
I20260709 13:11:22.074260 26997 raft_consensus.cc:2749] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:22.074055 27212 consensus_queue.cc:1059] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:11:22.080281 27157 raft_consensus.cc:3060] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:22.089347 27002 consensus_queue.cc:1048] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:11:22.077564 27238 raft_consensus.cc:493] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.102712 25300 raft_consensus.cc:1275] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:11:22.101100 25304 raft_consensus.cc:1275] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:11:22.057353 27001 raft_consensus.cc:515] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:22.081212 27314 raft_consensus.cc:2804] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:11:22.103610 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 58460.6us
I20260709 13:11:22.108035 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:22.108194 25872 leader_election.cc:304] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:22.082056 26989 raft_consensus.cc:493] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.073400 26922 consensus_queue.cc:1059] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:11:22.103101 25300 pending_rounds.cc:85] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19: Aborting all ops after (but not including) 5
I20260709 13:11:22.112303 25300 pending_rounds.cc:107] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:11:22.112643 25300 raft_consensus.cc:2889] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:22.114132 25302 raft_consensus.cc:1240] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 3 LEADER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:11:22.094090 27222 raft_consensus.cc:2749] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:22.116340 27319 raft_consensus.cc:2804] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:22.116839 27319 raft_consensus.cc:697] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 3 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:22.116915 26989 raft_consensus.cc:515] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:22.117977 26979 raft_consensus.cc:515] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:22.119084 26989 leader_election.cc:290] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:22.123787 26979 leader_election.cc:290] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 3 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:22.111922 27211 consensus_meta.cc:287] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.517s	user 0.007s	sys 0.004s
I20260709 13:11:22.100037 27031 leader_election.cc:290] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:22.119761 25900 raft_consensus.cc:2368] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 2. Current term is 3.
I20260709 13:11:22.169432 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:22.170451 25305 raft_consensus.cc:2468] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 5.
I20260709 13:11:22.172169 25195 leader_election.cc:304] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:11:22.065063 27023 consensus_queue.cc:260] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:22.174108 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 136399us
W20260709 13:11:22.174535 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 97616.2us
I20260709 13:11:22.176622 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:22.115031 26997 raft_consensus.cc:493] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
W20260709 13:11:22.183840 25873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:22.184223 25873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:22.184558 25873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:22.187264 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 79181.3us
I20260709 13:11:22.115075 27238 raft_consensus.cc:515] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:22.207515 25195 leader_election.cc:304] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:22.210506 25305 raft_consensus.cc:1240] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:11:22.168572 27314 raft_consensus.cc:697] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:22.220101 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:22.182163 27029 raft_consensus.cc:2804] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:22.168150 27202 raft_consensus.cc:515] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:22.168296 27192 consensus_queue.cc:1048] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:11:22.226399 25300 raft_consensus.cc:1240] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:22.188109 27031 raft_consensus.cc:493] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.229110 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:22.247113 25223 raft_consensus.cc:2468] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 3.
I20260709 13:11:22.229229 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:22.181996 26979 consensus_queue.cc:1059] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:11:22.231989 27315 raft_consensus.cc:2749] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:22.232944 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:22.264655 25229 raft_consensus.cc:2368] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 6. Current term is 7.
I20260709 13:11:22.264824 25375 raft_consensus.cc:2468] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 3.
I20260709 13:11:22.236716 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:22.236662 27314 consensus_queue.cc:237] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:22.220880 27023 raft_consensus.cc:3060] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:22.225775 27029 raft_consensus.cc:493] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:22.121452 27319 consensus_queue.cc:237] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:22.274650 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
W20260709 13:11:22.275010 27321 log.cc:927] Time spent T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:11:22.228861 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:22.295177 27189 raft_consensus.cc:515] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:22.295858 25374 raft_consensus.cc:3060] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:22.297341 27189 leader_election.cc:290] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:22.297480 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:22.298050 25300 raft_consensus.cc:3060] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:22.298946 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:22.299579 25904 raft_consensus.cc:2468] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 5.
I20260709 13:11:22.220389 26989 raft_consensus.cc:2749] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:22.173331 27211 raft_consensus.cc:515] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:22.240260 26997 raft_consensus.cc:515] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:22.302510 25372 raft_consensus.cc:1240] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:22.303454 27211 leader_election.cc:290] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:22.286299 27238 leader_election.cc:290] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:22.303700 26997 leader_election.cc:290] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:11:22.304430 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:22.305172 27021 consensus_meta.cc:287] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 0.535s	user 0.006s	sys 0.003s
W20260709 13:11:22.305955 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 117891us
I20260709 13:11:22.278659 27031 raft_consensus.cc:515] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:22.282719 27029 raft_consensus.cc:3060] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:22.287303 27317 log.cc:927] Time spent T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
W20260709 13:11:22.288129 27327 log.cc:927] Time spent T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
W20260709 13:11:22.288341 27209 consensus_meta.cc:287] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.612s	user 0.011s	sys 0.000s
I20260709 13:11:22.308424 25872 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:11:22.289150 27001 leader_election.cc:290] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:22.293023 27196 raft_consensus.cc:515] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:22.294205 25375 raft_consensus.cc:2368] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 6. Current term is 7.
I20260709 13:11:22.294040 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:22.294552 27329 raft_consensus.cc:3055] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:22.275532 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:11:22.321908 25874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.330637 25300 raft_consensus.cc:2468] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 6.
I20260709 13:11:22.329650 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:22.333453 25379 raft_consensus.cc:3060] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:22.306594 27202 leader_election.cc:290] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:22.335376 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:22.305576 27021 raft_consensus.cc:515] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:22.336120 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
W20260709 13:11:22.341274 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.336653 25300 raft_consensus.cc:3060] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:22.338220 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.354171 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:22.357156 27315 raft_consensus.cc:2804] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:11:22.357780 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 51081.1us
I20260709 13:11:22.358147 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:22.358762 25872 leader_election.cc:304] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:22.359087 25375 raft_consensus.cc:2468] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 4.
I20260709 13:11:22.360090 25872 leader_election.cc:304] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:22.360351 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:22.361335 25375 raft_consensus.cc:3060] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:22.325030 27329 raft_consensus.cc:740] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:22.364076 25305 raft_consensus.cc:2393] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 4: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
W20260709 13:11:22.367271 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.368913 25224 raft_consensus.cc:2393] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 4: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:22.370131 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:22.370890 25301 raft_consensus.cc:2468] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 5.
I20260709 13:11:22.318456 27209 raft_consensus.cc:515] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:22.383937 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:22.384754 25301 raft_consensus.cc:3060] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:22.381456 25300 raft_consensus.cc:2468] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 5.
I20260709 13:11:22.387940 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:22.360502 25374 raft_consensus.cc:2468] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 6.
I20260709 13:11:22.366299 27339 raft_consensus.cc:2749] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:22.367589 26979 raft_consensus.cc:2749] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:22.367062 27315 raft_consensus.cc:697] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:22.386147 27328 raft_consensus.cc:493] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.390187 27202 raft_consensus.cc:493] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.403798 26989 raft_consensus.cc:493] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.422917 26989 raft_consensus.cc:515] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:22.425279 26989 leader_election.cc:290] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:22.435942 27117 leader_election.cc:290] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:22.436563 27031 leader_election.cc:290] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:22.438292 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:22.439018 25907 raft_consensus.cc:3060] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:22.440579 27202 raft_consensus.cc:515] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:22.442857 27202 leader_election.cc:290] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:22.443620 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:22.444231 25228 raft_consensus.cc:2468] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 3.
I20260709 13:11:22.445264 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:22.446542 27315 consensus_queue.cc:237] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:22.386327 27329 consensus_queue.cc:260] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:22.449657 25230 raft_consensus.cc:1240] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:22.447084 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:22.452196 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:22.446575 25194 leader_election.cc:304] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:22.452196 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:22.472110 25297 raft_consensus.cc:2468] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 3.
I20260709 13:11:22.464500 25379 raft_consensus.cc:2468] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 3.
I20260709 13:11:22.468176 25375 raft_consensus.cc:2468] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 4.
I20260709 13:11:22.451851 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:22.480690 25227 raft_consensus.cc:1275] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:22.469646 25225 raft_consensus.cc:2468] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 5.
I20260709 13:11:22.467530 25271 leader_election.cc:304] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:11:22.485472 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:22.488138 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.411841 25899 raft_consensus.cc:1240] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 LEADER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:11:22.500722 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:22.504369 25297 raft_consensus.cc:2468] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 5.
I20260709 13:11:22.502218 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:22.506388 25230 raft_consensus.cc:2468] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 5.
I20260709 13:11:22.451876 27209 leader_election.cc:290] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:22.453075 27021 leader_election.cc:290] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:22.435945 27196 leader_election.cc:290] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:22.499066 26989 raft_consensus.cc:2804] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:22.512791 25222 raft_consensus.cc:1240] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:22.502858 26964 raft_consensus.cc:2804] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:22.513737 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:22.502012 27002 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.516546 25227 raft_consensus.cc:3060] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:22.405776 27328 raft_consensus.cc:515] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:22.509879 27211 raft_consensus.cc:493] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.520058 26989 raft_consensus.cc:697] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 5 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:22.517225 26964 raft_consensus.cc:493] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:22.527581 25904 raft_consensus.cc:1240] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:11:22.567420 25379 raft_consensus.cc:1240] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 4. Current term is 5. Ops: []
W20260709 13:11:22.578459 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 131950us
W20260709 13:11:22.552038 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 69001.6us
I20260709 13:11:22.584448 25301 raft_consensus.cc:2468] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 5.
I20260709 13:11:22.586789 25379 raft_consensus.cc:1240] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:22.544930 26964 raft_consensus.cc:3060] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:22.588714 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 71570.8us
I20260709 13:11:22.588160 25194 leader_election.cc:304] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:22.596424 25194 leader_election.cc:304] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:22.596627 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:22.599512 25375 raft_consensus.cc:1240] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:22.579345 27329 raft_consensus.cc:3060] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:22.526722 27002 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:22.531615 27211 raft_consensus.cc:515] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:22.604420 25194 leader_election.cc:304] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:22.587361 27031 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.609985 25194 leader_election.cc:304] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:22.610885 25194 leader_election.cc:304] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:22.611795 25194 leader_election.cc:304] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:11:22.629675 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:22.600946 27202 raft_consensus.cc:2804] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:22.589895 27117 consensus_queue.cc:1059] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:11:22.630548 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:22.589730 27238 consensus_queue.cc:1048] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:11:22.636098 27322 raft_consensus.cc:2804] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:22.639004 27322 raft_consensus.cc:493] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:22.639369 27322 raft_consensus.cc:3060] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:22.614452 27189 raft_consensus.cc:2804] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:22.641000 27189 raft_consensus.cc:493] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:22.641355 27189 raft_consensus.cc:3060] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:22.613052 27115 raft_consensus.cc:2804] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:22.643884 25907 raft_consensus.cc:2468] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 7.
I20260709 13:11:22.613308 27233 raft_consensus.cc:2804] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:22.645255 25227 raft_consensus.cc:2468] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 5.
I20260709 13:11:22.647708 27325 raft_consensus.cc:493] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:22.628701 27209 raft_consensus.cc:493] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.614578 27334 raft_consensus.cc:2804] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:11:22.648196 27348 log.cc:927] Time spent T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:11:22.615082 27031 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:22.628285 26922 consensus_queue.cc:1059] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:11:22.670912 27221 raft_consensus.cc:3060] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:22.671427 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:22.672020 25908 raft_consensus.cc:2468] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 5.
I20260709 13:11:22.652132 27209 raft_consensus.cc:515] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:22.673193 25903 raft_consensus.cc:1275] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 13:11:22.673341 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:22.652292 27325 raft_consensus.cc:515] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:22.674618 25902 raft_consensus.cc:1275] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:22.653623 25901 raft_consensus.cc:1240] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:22.675671 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:22.675873 27325 leader_election.cc:290] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:22.676196 27222 raft_consensus.cc:3055] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:22.676760 27222 raft_consensus.cc:740] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:22.642627 27202 raft_consensus.cc:697] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 6 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:22.662923 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:22.678304 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:22.664438 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:22.678610 27202 consensus_queue.cc:237] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:22.679771 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:22.676307 25303 raft_consensus.cc:3060] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:22.642015 26989 consensus_queue.cc:237] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:22.678398 25375 raft_consensus.cc:2468] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 4.
I20260709 13:11:22.648563 27115 raft_consensus.cc:493] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:22.682101 27115 raft_consensus.cc:3060] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:22.682335 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:22.682916 25375 raft_consensus.cc:2468] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 5.
I20260709 13:11:22.686365 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:22.673599 25903 pending_rounds.cc:85] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6: Aborting all ops after (but not including) 6
W20260709 13:11:22.687930 25873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.667924 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:22.673029 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:22.697620 25908 raft_consensus.cc:2468] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 5.
I20260709 13:11:22.680357 25378 raft_consensus.cc:2468] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 5.
I20260709 13:11:22.651846 27334 raft_consensus.cc:493] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:22.691653 25270 leader_election.cc:304] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:22.700169 27334 raft_consensus.cc:3060] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:22.701990 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:22.705006 25379 raft_consensus.cc:1275] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:11:22.718750 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:22.718851 25270 leader_election.cc:304] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:22.720718 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:22.705405 25379 pending_rounds.cc:85] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468: Aborting all ops after (but not including) 1
I20260709 13:11:22.724552 25379 pending_rounds.cc:107] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:11:22.724876 25379 raft_consensus.cc:2889] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:22.699249 25903 pending_rounds.cc:107] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 13:11:22.725608 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:22.733196 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:22.733712 25371 raft_consensus.cc:2468] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 4.
I20260709 13:11:22.718971 27117 raft_consensus.cc:2804] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:11:22.730434 27178 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.043s	user 0.011s	sys 0.012s
I20260709 13:11:22.727569 27325 raft_consensus.cc:493] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.677582 27222 consensus_queue.cc:260] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:22.727618 26979 raft_consensus.cc:493] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.728545 25903 raft_consensus.cc:2889] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:22.741616 25378 raft_consensus.cc:1275] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:11:22.747859 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.750780 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:22.751423 25371 raft_consensus.cc:2468] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 4.
W20260709 13:11:22.738513 27178 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.051s	user 0.012s	sys 0.012s
I20260709 13:11:22.753031 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:22.754133 25379 raft_consensus.cc:1275] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:11:22.756265 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.726186 27238 consensus_queue.cc:1048] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:11:22.736231 27328 leader_election.cc:290] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:22.736706 27117 raft_consensus.cc:493] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:22.757675 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 124751us
I20260709 13:11:22.762758 27211 leader_election.cc:290] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:22.763291 27178 raft_consensus.cc:3055] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:22.764181 27209 leader_election.cc:290] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:22.766083 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:22.736176 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:22.741099 26772 raft_consensus.cc:2804] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:22.774202 27178 raft_consensus.cc:740] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:22.776741 27324 consensus_queue.cc:1048] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:22.776952 27178 consensus_queue.cc:260] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:22.778400 27178 raft_consensus.cc:3060] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:22.725299 27320 consensus_queue.cc:1059] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:11:22.784125 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:22.774845 25194 leader_election.cc:304] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:22.798928 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:22.799965 25375 raft_consensus.cc:2393] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 3: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:11:22.774178 27117 raft_consensus.cc:3060] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:22.782979 26772 raft_consensus.cc:493] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:22.848950 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:22.849515 25375 raft_consensus.cc:3060] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:22.750377 27325 raft_consensus.cc:515] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:22.795758 27193 raft_consensus.cc:2804] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:22.755754 26979 raft_consensus.cc:515] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:22.847726 27002 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:22.836403 27233 raft_consensus.cc:697] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 5 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:22.877622 25375 raft_consensus.cc:2468] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 4.
I20260709 13:11:22.878258 25300 raft_consensus.cc:2468] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 3.
I20260709 13:11:22.851284 26772 raft_consensus.cc:3060] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:22.884371 25302 raft_consensus.cc:1240] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:22.850735 27211 raft_consensus.cc:493] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:22.854430 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:22.885998 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:22.861109 27320 raft_consensus.cc:493] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:22.892407 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:22.893025 25375 raft_consensus.cc:3060] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:22.895705 27325 leader_election.cc:290] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:22.893049 27031 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:22.877399 27334 raft_consensus.cc:515] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:22.898413 27334 leader_election.cc:290] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:22.898480 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:22.899730 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:22.900799 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:22.901664 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:22.902627 25375 raft_consensus.cc:2468] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 5.
I20260709 13:11:22.903342 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:22.904157 25304 raft_consensus.cc:2393] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 4: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
W20260709 13:11:22.904783 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.912180 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:22.912832 25226 raft_consensus.cc:2468] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 4.
W20260709 13:11:22.917339 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:22.921360 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.888406 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:22.921422 26964 raft_consensus.cc:515] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:22.862794 27322 raft_consensus.cc:515] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:22.928572 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:22.882717 27193 raft_consensus.cc:697] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 5 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
W20260709 13:11:22.907126 27157 consensus_meta.cc:287] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent flushing consensus metadata: real 0.801s	user 0.019s	sys 0.001s
I20260709 13:11:22.974120 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:22.974845 25226 raft_consensus.cc:2468] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 3.
I20260709 13:11:22.976090 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:11:22.979732 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.909638 27002 raft_consensus.cc:493] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.982627 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:22.955207 25195 leader_election.cc:304] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:22.897208 27189 raft_consensus.cc:515] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:22.951018 25874 leader_election.cc:304] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:22.909994 25903 raft_consensus.cc:2468] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 4.
I20260709 13:11:22.986862 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:22.988598 27157 raft_consensus.cc:2804] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:22.909730 27320 raft_consensus.cc:515] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:22.990860 27157 raft_consensus.cc:493] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:22.991343 27157 raft_consensus.cc:3060] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:22.991427 25298 raft_consensus.cc:3060] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:22.992492 27320 leader_election.cc:290] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:22.994580 27363 log.cc:927] Time spent T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:11:22.995571 27322 leader_election.cc:290] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:22.995944 27189 leader_election.cc:290] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:22.988483 27212 raft_consensus.cc:493] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.998293 27115 raft_consensus.cc:515] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:22.998371 27212 raft_consensus.cc:515] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:11:23.000330 27115 leader_election.cc:290] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:22.984251 25296 raft_consensus.cc:1240] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:11:23.000994 27212 leader_election.cc:290] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:11:23.002226 27359 log.cc:927] Time spent T 00000000000000000000000000000000 P 5140a3161b944724a989995efdc4a818: Append to log took a long time: real 0.097s	user 0.003s	sys 0.000s
I20260709 13:11:23.001647 27193 consensus_queue.cc:237] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:23.015014 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:22.986672 25874 leader_election.cc:400] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 election: Vote denied by peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361) with higher term. Message: Invalid argument: T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 6. Current term is 7.
I20260709 13:11:23.002877 26979 leader_election.cc:290] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:23.005982 25298 raft_consensus.cc:2468] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 3.
I20260709 13:11:22.892558 27211 raft_consensus.cc:515] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:23.015867 25874 leader_election.cc:403] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:11:23.009406 25343 leader_election.cc:304] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:11:23.011070 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 55987.3us
I20260709 13:11:23.009733 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:22.986172 27002 raft_consensus.cc:515] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:23.013103 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:23.034976 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:11:23.040171 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 160929us
I20260709 13:11:23.023897 26827 raft_consensus.cc:2749] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:23.042233 25375 raft_consensus.cc:2468] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 3.
I20260709 13:11:23.045455 25303 raft_consensus.cc:2468] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 3.
I20260709 13:11:23.028469 27023 raft_consensus.cc:2749] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361) with higher term. Message: Invalid argument: T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 6. Current term is 7.
I20260709 13:11:23.046962 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:23.049158 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:23.050470 25905 raft_consensus.cc:3060] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:23.050510 25906 raft_consensus.cc:3060] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:23.051364 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:23.026700 27369 raft_consensus.cc:2804] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:23.054003 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
W20260709 13:11:23.042054 27029 consensus_meta.cc:287] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 0.719s	user 0.011s	sys 0.002s
I20260709 13:11:23.059283 25370 raft_consensus.cc:2368] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 3. Current term is 4.
I20260709 13:11:23.046312 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:23.066596 25901 raft_consensus.cc:2368] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 3. Current term is 4.
I20260709 13:11:23.060700 27029 raft_consensus.cc:515] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:23.055024 27369 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:23.069813 27196 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.070086 27369 raft_consensus.cc:3060] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:23.070523 27029 leader_election.cc:290] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:23.070395 27196 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:23.073191 27196 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:23.075547 27338 consensus_queue.cc:1048] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:23.061785 26827 consensus_queue.cc:1059] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:11:23.062873 27360 log.cc:927] Time spent T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:11:23.063174 27320 consensus_queue.cc:1059] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:23.001672 27233 consensus_queue.cc:237] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:11:23.063917 27205 raft_consensus.cc:493] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:23.058161 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:23.061852 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:23.078401 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:23.075734 27211 leader_election.cc:290] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:23.081000 25343 leader_election.cc:304] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:23.081673 25371 raft_consensus.cc:2468] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 3.
I20260709 13:11:23.084877 25378 raft_consensus.cc:3060] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:23.087451 25226 raft_consensus.cc:3060] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:23.059685 27192 raft_consensus.cc:493] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:23.088753 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:23.086153 27320 consensus_queue.cc:1243] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer 79d99c0e498349bda74127365219e468 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:11:23.083010 26772 raft_consensus.cc:515] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:23.076366 25115 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 275226661cc840559134f8c9e5b15719 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 1f539ba21487460085b837e7529a78ce is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:11:23.104185 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:23.081799 27117 raft_consensus.cc:515] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:23.087499 27212 consensus_queue.cc:1048] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:11:23.102208 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:23.126694 25226 raft_consensus.cc:2468] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 5.
I20260709 13:11:23.127292 27117 leader_election.cc:290] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:23.114981 26964 leader_election.cc:290] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:23.132160 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:23.133831 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:23.134513 25376 raft_consensus.cc:3060] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:23.107689 27192 raft_consensus.cc:515] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:23.087824 27205 raft_consensus.cc:515] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:23.147994 25270 leader_election.cc:304] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:23.151250 26772 leader_election.cc:290] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:23.152212 26772 raft_consensus.cc:2749] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:23.154917 25900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50060 (request call id 355) took 1330 ms. Trace:
I20260709 13:11:23.166198 27219 raft_consensus.cc:3055] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:23.166693 27219 raft_consensus.cc:740] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:23.166751 27242 raft_consensus.cc:3055] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:23.167301 27242 raft_consensus.cc:740] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:23.167658 27219 consensus_queue.cc:260] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:23.168228 27205 leader_election.cc:290] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:23.168109 27242 consensus_queue.cc:260] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:23.168669 27219 raft_consensus.cc:3060] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:23.169327 27242 raft_consensus.cc:3060] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:23.164419 25906 raft_consensus.cc:2468] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 6.
I20260709 13:11:23.153242 27157 raft_consensus.cc:515] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:23.174453 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:23.174387 27369 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:23.179359 25904 raft_consensus.cc:2468] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 4.
I20260709 13:11:23.159489 25900 rpcz_store.cc:276] 0709 13:11:21.824364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:21.876302 (+ 51938us) service_pool.cc:224] Handling call
0709 13:11:23.154602 (+1278300us) spinlock_profiling.cc:243] Waited 74.3 ms on lock 0x7b5400276ad4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:23.154827 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":170983808}
I20260709 13:11:23.180274 25376 raft_consensus.cc:2468] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 4.
I20260709 13:11:23.155337 27338 raft_consensus.cc:2804] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:23.182483 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:23.182777 25373 raft_consensus.cc:3060] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:23.186182 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 105214us
I20260709 13:11:23.187433 25226 raft_consensus.cc:2393] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 6: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:23.187644 25378 raft_consensus.cc:2468] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 4.
I20260709 13:11:23.212179 25343 leader_election.cc:304] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:23.205332 25270 leader_election.cc:304] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:23.166235 27002 leader_election.cc:290] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:23.213860 25270 leader_election.cc:304] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:23.208951 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:23.185201 25271 leader_election.cc:304] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:23.213176 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:23.208033 27239 raft_consensus.cc:3055] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:23.215343 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:23.215871 25270 leader_election.cc:304] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:23.207978 26964 raft_consensus.cc:493] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:23.208441 27332 raft_consensus.cc:493] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:23.215041 27117 raft_consensus.cc:2749] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:23.220432 25270 leader_election.cc:304] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:23.219941 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:23.220117 25271 leader_election.cc:304] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:23.224677 27190 raft_consensus.cc:3055] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:23.225189 27190 raft_consensus.cc:740] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:23.226468 27192 leader_election.cc:290] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:23.227294 27209 raft_consensus.cc:2749] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:23.228895 27157 leader_election.cc:290] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:23.231199 27369 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:23.233935 25270 leader_election.cc:304] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:23.211223 27338 raft_consensus.cc:493] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:23.219216 25376 raft_consensus.cc:2468] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 3.
I20260709 13:11:23.226056 27190 consensus_queue.cc:260] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:23.234163 25195 leader_election.cc:304] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:11:23.239950 25378 raft_consensus.cc:2393] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 4: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:23.239915 25873 leader_election.cc:304] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:23.268244 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:23.236702 25343 leader_election.cc:304] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:23.238030 25905 raft_consensus.cc:2468] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 4.
I20260709 13:11:23.270313 25195 leader_election.cc:400] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 election: Vote denied by peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085) with higher term. Message: Invalid argument: T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 3. Current term is 4.
I20260709 13:11:23.270659 25195 leader_election.cc:403] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:11:23.254894 25271 leader_election.cc:304] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:23.218586 27375 raft_consensus.cc:2804] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:23.272518 25271 leader_election.cc:304] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:23.273627 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:23.272652 25270 leader_election.cc:304] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:23.222096 26772 raft_consensus.cc:2804] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:23.241196 27338 raft_consensus.cc:3060] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:23.217031 27212 consensus_queue.cc:1059] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 13:11:23.216331 26827 raft_consensus.cc:2749] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:23.222167 27238 consensus_queue.cc:1059] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 13:11:23.223635 26964 raft_consensus.cc:515] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:23.219022 27239 raft_consensus.cc:740] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:23.275671 25270 leader_election.cc:304] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:23.265796 27209 raft_consensus.cc:2749] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:23.229441 27332 raft_consensus.cc:515] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:23.283349 25195 leader_election.cc:304] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
W20260709 13:11:23.280903 25873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:23.418191 25873 leader_election.cc:400] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 election: Vote denied by peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091) with higher term. Message: Invalid argument: T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 6. Current term is 7.
I20260709 13:11:23.419237 25873 leader_election.cc:304] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:23.357726 25299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57256 (request call id 1490) took 1708 ms. Trace:
W20260709 13:11:23.347846 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:23.271837 27369 raft_consensus.cc:2804] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:23.267588 27325 raft_consensus.cc:2804] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:11:23.404093 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:23.421383 25226 raft_consensus.cc:1240] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 3 LEADER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:23.436354 25230 raft_consensus.cc:1240] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 5 LEADER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 4. Current term is 5. Ops: [2.2-4.3]
W20260709 13:11:23.442312 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 159551us
I20260709 13:11:23.443006 25195 leader_election.cc:304] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:23.436671 25873 leader_election.cc:304] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:23.446393 25230 raft_consensus.cc:1240] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:23.271552 27320 raft_consensus.cc:2749] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:11:23.348409 27382 log.cc:927] Time spent T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:11:23.450052 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:23.451043 25228 raft_consensus.cc:1240] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:23.274940 27375 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:23.332763 27157 raft_consensus.cc:2764] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:11:23.414580 26989 raft_consensus.cc:493] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.336856 27202 raft_consensus.cc:493] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:23.279044 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:23.279778 27178 raft_consensus.cc:2749] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:23.290678 27190 raft_consensus.cc:3060] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:23.419896 25299 rpcz_store.cc:276] 0709 13:11:21.649275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:21.687273 (+ 37998us) service_pool.cc:224] Handling call
0709 13:11:21.707526 (+ 20253us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:21.739859 (+ 32333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:21.739891 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:21.755399 (+ 15508us) log.cc:844] Serialized 26 byte log entry
0709 13:11:21.903716 (+148317us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:21.913707 (+  9991us) log.cc:844] Serialized 14 byte log entry
0709 13:11:22.076304 (+162597us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:22.076419 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:22.455786 (+379367us) spinlock_profiling.cc:243] Waited 3.4 ms on lock 0x7b180022b9a0. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72cb502a6 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72cb823f3 00007fd72cb847c1
0709 13:11:23.355588 (+899802us) spinlock_profiling.cc:243] Waited 2.45 ms on lock 0x7b180022b9a0. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72cb823f3 00007fd72cb847c1 00007fd72cb84779 00007fd72cb84709 00007fd72cb846d1 00007fd72cb839cd 000000000038f354 000000000038f199 00007fd72cb6583a
0709 13:11:23.357482 (+  1894us) raft_consensus.cc:1685] finished
0709 13:11:23.357503 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:23.357647 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":9786,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":72800,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":1846,"spinlock_wait_cycles":13439232,"thread_start_us":275815,"threads_started":2,"wal-append.queue_time_us":205727}
I20260709 13:11:23.445462 26979 raft_consensus.cc:2804] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:23.333920 27233 raft_consensus.cc:3060] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:23.487854 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:23.518095 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:23.280586 26772 raft_consensus.cc:493] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:23.486275 25230 raft_consensus.cc:1240] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 5 LEADER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 3. Current term is 5. Ops: [3.4-3.4]
I20260709 13:11:23.347723 27335 raft_consensus.cc:2804] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:23.338315 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:23.333189 27205 raft_consensus.cc:493] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.347532 27383 raft_consensus.cc:2749] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:23.493422 27369 raft_consensus.cc:697] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 7 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
W20260709 13:11:23.515821 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 233913us
I20260709 13:11:23.534783 25271 leader_election.cc:304] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:23.442217 27322 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:23.521958 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:23.449292 27238 raft_consensus.cc:2804] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:23.338104 27002 consensus_queue.cc:1059] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.156s
I20260709 13:11:23.489192 27265 raft_consensus.cc:2804] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:23.545440 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:23.546717 25297 raft_consensus.cc:1275] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:23.526561 27335 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:23.462427 27325 raft_consensus.cc:697] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 5 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:23.464118 27370 raft_consensus.cc:2804] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:23.490703 27375 raft_consensus.cc:3060] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:23.496343 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 53427.2us
I20260709 13:11:23.479555 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:23.515276 27212 raft_consensus.cc:493] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:23.526764 26772 raft_consensus.cc:3060] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:23.517194 27357 raft_consensus.cc:2804] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:23.547681 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:23.550622 25195 leader_election.cc:304] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:11:23.530468 27031 raft_consensus.cc:2749] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:23.556274 25373 raft_consensus.cc:1275] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:11:23.536617 27157 consensus_queue.cc:1048] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:11:23.541960 27322 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:23.583382 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:23.582484 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:23.536531 27205 raft_consensus.cc:515] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:23.516441 26989 raft_consensus.cc:515] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:23.590238 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:23.627538 25303 raft_consensus.cc:3060] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:23.533202 26979 raft_consensus.cc:697] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:23.550087 27335 raft_consensus.cc:3060] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:23.539846 27238 raft_consensus.cc:493] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:23.582154 27265 raft_consensus.cc:697] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:23.644228 27265 consensus_queue.cc:237] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:23.607491 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:23.536170 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:23.591255 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:23.647148 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:23.647234 25304 raft_consensus.cc:3060] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:23.650738 27386 log.cc:927] Time spent T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:11:23.651803 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:11:23.544461 27340 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.024s	user 0.015s	sys 0.031s
I20260709 13:11:23.541325 27266 raft_consensus.cc:2804] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:23.556679 27212 raft_consensus.cc:515] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:23.615048 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 64492.5us
I20260709 13:11:23.619189 25372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36264 (request call id 1318) took 1877 ms. Trace:
W20260709 13:11:23.619968 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 77418us
I20260709 13:11:23.676625 25372 rpcz_store.cc:276] 0709 13:11:21.741437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:21.741901 (+   464us) service_pool.cc:224] Handling call
0709 13:11:21.766155 (+ 24254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:22.302859 (+536704us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:23.618878 (+1316019us) spinlock_profiling.cc:243] Waited 536 ms on lock 0x7b540009c4d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:23.619107 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1233078016}
I20260709 13:11:23.625077 25305 raft_consensus.cc:2393] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 6: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
W20260709 13:11:23.629310 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 78837.5us
I20260709 13:11:23.629443 27394 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.680150 25229 raft_consensus.cc:2468] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 4.
I20260709 13:11:23.624239 27370 raft_consensus.cc:697] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 6 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
W20260709 13:11:23.630376 27387 log.cc:927] Time spent T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:11:23.626230 27357 raft_consensus.cc:697] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 4 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:23.634478 25228 raft_consensus.cc:1240] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:23.643237 27238 raft_consensus.cc:3060] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:23.617873 27002 raft_consensus.cc:3055] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:23.620343 27368 raft_consensus.cc:2804] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:11:23.626740 27385 log.cc:927] Time spent T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.278s	user 0.000s	sys 0.001s
W20260709 13:11:23.656989 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 212121us
I20260709 13:11:23.704016 25873 leader_election.cc:304] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:23.679164 27266 raft_consensus.cc:697] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 5 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:23.670687 25230 raft_consensus.cc:2393] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 5: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
W20260709 13:11:23.672626 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:23.680594 27383 raft_consensus.cc:493] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
W20260709 13:11:23.653587 27340 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.137s	user 0.021s	sys 0.034s
I20260709 13:11:23.690100 25304 raft_consensus.cc:2468] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 4.
I20260709 13:11:23.716595 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:23.690698 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:23.717666 25905 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 5.
W20260709 13:11:23.691730 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 416159us
I20260709 13:11:23.719043 25270 leader_election.cc:304] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
W20260709 13:11:23.680064 27348 log.cc:927] Time spent T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:11:23.666568 25303 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 4.
I20260709 13:11:23.612155 27369 consensus_queue.cc:237] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:23.534356 27202 raft_consensus.cc:515] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:23.710709 25344 leader_election.cc:400] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 election: Vote denied by peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085) with higher term. Message: Invalid argument: T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 2. Current term is 3.
I20260709 13:11:23.731524 25344 leader_election.cc:403] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:11:23.693197 27002 raft_consensus.cc:740] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:23.627260 27325 consensus_queue.cc:237] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:23.730167 27324 raft_consensus.cc:3055] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:23.735810 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:23.739701 27324 raft_consensus.cc:740] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:23.716053 27332 leader_election.cc:290] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:23.754230 27370 consensus_queue.cc:237] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:23.752513 27357 consensus_queue.cc:237] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:23.794562 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 75639us
I20260709 13:11:23.729143 26772 raft_consensus.cc:515] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:23.795202 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:23.708532 27115 consensus_queue.cc:1048] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:11:23.795439 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:23.712096 27221 raft_consensus.cc:2804] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:11:23.794549 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 51450.3us
I20260709 13:11:23.693109 27394 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:23.809553 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 102170us
I20260709 13:11:23.814220 25227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1537) took 1157 ms. Trace:
I20260709 13:11:23.815410 25270 leader_election.cc:304] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:23.796319 26922 raft_consensus.cc:2749] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085) with higher term. Message: Invalid argument: T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 2. Current term is 3.
I20260709 13:11:23.819758 25303 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 2.
I20260709 13:11:23.818148 25227 rpcz_store.cc:276] 0709 13:11:22.657122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:22.690034 (+ 32912us) service_pool.cc:224] Handling call
0709 13:11:22.690432 (+   398us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:22.722281 (+ 31849us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:22.722325 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:22.722998 (+   673us) log.cc:844] Serialized 52 byte log entry
0709 13:11:23.232686 (+509688us) spinlock_profiling.cc:243] Waited 9.48 ms on lock 0x7b18003715c0. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72cb64e07 00007fd7359bfab9 00007fd72cb8169b 00007fd72cb7f93f 00007fd72cb81c02 00007fd72f80920b 00007fd72f80ed23 00007fd72f80f0d1 00007fd72fc2aa0f
0709 13:11:23.338852 (+106166us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:23.414383 (+ 75531us) log.cc:844] Serialized 14 byte log entry
0709 13:11:23.415085 (+   702us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:23.415190 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:23.807734 (+392544us) raft_consensus.cc:1685] finished
0709 13:11:23.814001 (+  6267us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:23.814156 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35378,"prepare.queue_time_us":60037,"prepare.run_cpu_time_us":778,"prepare.run_wall_time_us":23097,"raft.queue_time_us":33561,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":26049,"spinlock_wait_cycles":21801216,"thread_start_us":105926,"threads_started":1,"wal-append.queue_time_us":630278}
I20260709 13:11:23.823053 25297 raft_consensus.cc:2393] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 6: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:23.720959 27383 raft_consensus.cc:515] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:23.841830 27322 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:23.841955 27002 consensus_queue.cc:260] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:23.822325 27031 raft_consensus.cc:2749] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:23.842897 27188 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.739568 26979 consensus_queue.cc:237] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:23.843569 27188 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:23.829355 27197 raft_consensus.cc:493] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:23.846164 27197 raft_consensus.cc:515] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:23.849342 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:23.798695 27393 raft_consensus.cc:2804] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:23.852479 25270 leader_election.cc:304] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:23.821521 27221 raft_consensus.cc:493] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:23.874624 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:23.885562 25270 leader_election.cc:304] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:23.849049 27188 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:23.863149 27393 raft_consensus.cc:493] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:23.848312 27197 leader_election.cc:290] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:23.862246 27031 raft_consensus.cc:2749] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:23.820792 27178 consensus_queue.cc:1048] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 13:11:23.882292 27221 raft_consensus.cc:3060] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:23.874147 26922 raft_consensus.cc:493] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.907896 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:23.864069 27368 raft_consensus.cc:697] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 4 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:23.901561 26827 raft_consensus.cc:493] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.923622 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:23.911657 27197 raft_consensus.cc:493] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.908452 27393 raft_consensus.cc:3060] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:23.930562 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:11:23.932363 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 78450.2us
I20260709 13:11:23.933341 25270 leader_election.cc:304] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
W20260709 13:11:23.926074 27242 consensus_meta.cc:287] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.756s	user 0.012s	sys 0.000s
I20260709 13:11:23.939329 25270 leader_election.cc:304] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:23.882547 27266 consensus_queue.cc:237] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:23.923677 26827 raft_consensus.cc:515] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:23.925165 27389 raft_consensus.cc:2804] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:23.927922 27212 leader_election.cc:290] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:23.865183 27324 consensus_queue.cc:260] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:23.942524 27031 raft_consensus.cc:2749] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:23.930663 27405 raft_consensus.cc:493] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.919795 26922 raft_consensus.cc:515] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:23.929401 26979 consensus_queue.cc:1048] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:11:23.961803 27390 raft_consensus.cc:493] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.976152 25899 raft_consensus.cc:2468] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 5.
I20260709 13:11:23.977489 27395 raft_consensus.cc:493] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.980033 26827 leader_election.cc:290] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:23.981285 27338 consensus_meta.cc:287] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.537s	user 0.000s	sys 0.007s
W20260709 13:11:23.963306 27398 log.cc:927] Time spent T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:11:23.965942 26772 leader_election.cc:290] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:23.936012 27335 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:23.954833 27325 raft_consensus.cc:2749] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:23.934815 27197 raft_consensus.cc:515] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:23.956975 27211 raft_consensus.cc:3055] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:23.967644 25270 leader_election.cc:304] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:23.947585 27394 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:23.952806 27205 leader_election.cc:290] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:23.949098 27242 consensus_queue.cc:1059] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:11:23.976069 27390 raft_consensus.cc:515] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:23.967553 27202 leader_election.cc:290] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:23.998901 25304 raft_consensus.cc:2368] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 5. Current term is 6.
I20260709 13:11:23.978116 27395 raft_consensus.cc:515] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:23.998688 25270 leader_election.cc:304] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
W20260709 13:11:24.003223 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 73904.6us
I20260709 13:11:23.989480 27340 raft_consensus.cc:493] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.949678 27401 consensus_queue.cc:1048] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.176s
I20260709 13:11:23.988669 27389 raft_consensus.cc:697] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 4 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:23.994839 27211 raft_consensus.cc:740] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:23.996311 27178 raft_consensus.cc:2749] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:24.008560 27412 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.010686 27412 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:24.009290 27325 raft_consensus.cc:2749] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:24.009732 27407 raft_consensus.cc:493] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:24.013200 27407 raft_consensus.cc:515] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:24.014565 27412 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:24.015357 27407 leader_election.cc:290] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:24.007476 26827 consensus_queue.cc:1059] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:11:24.016351 26827 consensus_queue.cc:1243] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Peer 1f539ba21487460085b837e7529a78ce log is divergent from this leader: its last log entry 5.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:11:24.017732 27335 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:24.019403 25270 leader_election.cc:304] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:24.009008 25345 leader_election.cc:304] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:24.021585 27412 raft_consensus.cc:2749] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:24.022289 27412 consensus_queue.cc:1059] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:24.022955 27335 raft_consensus.cc:2804] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:24.023052 27412 consensus_queue.cc:1243] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Peer 1f539ba21487460085b837e7529a78ce log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:11:24.023428 27335 raft_consensus.cc:493] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.023787 27415 raft_consensus.cc:493] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:24.000409 27394 raft_consensus.cc:493] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.002409 27233 raft_consensus.cc:2749] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085) with higher term. Message: Invalid argument: T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 3. Current term is 4.
I20260709 13:11:24.006325 27242 consensus_queue.cc:1243] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [LEADER]: Peer 1f539ba21487460085b837e7529a78ce log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:11:23.981704 27338 raft_consensus.cc:515] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:24.025213 25345 leader_election.cc:304] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:24.028756 25872 leader_election.cc:304] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:24.001029 27238 raft_consensus.cc:515] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:23.966620 27405 raft_consensus.cc:515] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:24.031002 25296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46556 (request call id 227) took 2349 ms. Trace:
I20260709 13:11:24.033535 27265 raft_consensus.cc:493] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:24.034289 25298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57256 (request call id 1505) took 1150 ms. Trace:
W20260709 13:11:24.033948 27392 log.cc:927] Time spent T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 13:11:24.023554 27221 raft_consensus.cc:515] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:24.053319 27405 leader_election.cc:290] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:24.053407 27221 leader_election.cc:290] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:24.054231 27265 raft_consensus.cc:515] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:24.051452 27211 consensus_queue.cc:260] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:24.055737 27211 raft_consensus.cc:3060] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:24.056679 27265 leader_election.cc:290] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:24.053855 25296 rpcz_store.cc:276] 0709 13:11:21.681232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:21.917903 (+236671us) service_pool.cc:224] Handling call
0709 13:11:21.918246 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:23.001101 (+1082855us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:24.029264 (+1028163us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b5400099054. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:24.030925 (+  1661us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2321588608}
I20260709 13:11:24.023851 27335 raft_consensus.cc:3060] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:23.967103 27368 consensus_queue.cc:237] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:24.038439 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:24.038959 26979 raft_consensus.cc:2804] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:24.039611 27242 raft_consensus.cc:2749] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:24.067301 25907 raft_consensus.cc:1240] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:24.040499 25345 leader_election.cc:304] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:24.043437 27222 raft_consensus.cc:3060] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:11:24.044483 27390 leader_election.cc:290] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:24.007298 27212 consensus_queue.cc:1059] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:11:24.045223 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:24.045742 26922 leader_election.cc:290] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:24.081928 25873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:24.024398 27415 raft_consensus.cc:515] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:24.061721 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:24.058022 25298 rpcz_store.cc:276] 0709 13:11:22.884071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:22.901461 (+ 17390us) service_pool.cc:224] Handling call
0709 13:11:24.034134 (+1132673us) spinlock_profiling.cc:243] Waited 89.2 ms on lock 0x7b54001f18d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:24.034227 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":205061888}
I20260709 13:11:24.088153 25298 raft_consensus.cc:1240] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 13:11:24.066866 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:24.070358 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:24.089308 25907 raft_consensus.cc:3060] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:24.073107 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:24.029961 27394 raft_consensus.cc:515] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:24.073196 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:24.073709 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:24.078526 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
W20260709 13:11:24.104369 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:24.104765 25908 raft_consensus.cc:2393] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 6: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:24.105602 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:24.081475 25900 raft_consensus.cc:1240] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:11:24.047115 27375 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:24.126758 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
W20260709 13:11:24.084323 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 43896.5us
W20260709 13:11:24.127462 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 56876.5us
I20260709 13:11:24.100135 25907 raft_consensus.cc:2468] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 6.
I20260709 13:11:24.067574 26979 raft_consensus.cc:493] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.130491 25270 leader_election.cc:304] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:24.131081 25906 raft_consensus.cc:1240] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:24.132074 25270 leader_election.cc:304] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:24.070999 25899 raft_consensus.cc:2468] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 5.
I20260709 13:11:24.082247 27389 consensus_queue.cc:237] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:24.104194 27242 raft_consensus.cc:2749] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:24.145711 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:24.146750 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:24.150965 25370 raft_consensus.cc:2468] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 4.
I20260709 13:11:24.147482 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:24.151635 25374 raft_consensus.cc:3060] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:24.077250 27393 raft_consensus.cc:515] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:24.007994 27340 raft_consensus.cc:515] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:24.133617 27401 consensus_queue.cc:1059] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:11:24.142990 27117 raft_consensus.cc:2804] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:24.127106 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:24.125986 26922 raft_consensus.cc:3055] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:24.131373 26979 raft_consensus.cc:3060] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:24.133773 27320 raft_consensus.cc:2749] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:24.127406 25902 raft_consensus.cc:2468] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 7.
I20260709 13:11:24.169325 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:24.170173 25873 leader_election.cc:304] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:24.171609 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:24.173990 25297 raft_consensus.cc:1240] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:24.182682 25374 raft_consensus.cc:2468] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 4.
I20260709 13:11:24.183859 25304 raft_consensus.cc:1240] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:11:24.185086 25304 raft_consensus.cc:1275] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
I20260709 13:11:24.176368 27117 raft_consensus.cc:697] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 6 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:24.187129 27117 consensus_queue.cc:237] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:24.188048 25195 leader_election.cc:304] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:24.191665 25195 leader_election.cc:304] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:24.194442 25297 raft_consensus.cc:1275] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:11:24.168995 26922 raft_consensus.cc:740] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:24.196688 26922 consensus_queue.cc:260] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:24.198266 26922 raft_consensus.cc:3060] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:24.202261 25297 raft_consensus.cc:1240] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:24.168226 27325 raft_consensus.cc:3055] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:24.202898 26772 consensus_queue.cc:1059] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:11:24.181720 27329 raft_consensus.cc:2804] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:24.211134 25304 raft_consensus.cc:1275] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:24.180932 27242 raft_consensus.cc:493] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:24.215057 25195 leader_election.cc:304] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:24.192574 27197 leader_election.cc:290] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:24.203437 27221 raft_consensus.cc:493] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:24.239521 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:24.205888 27357 raft_consensus.cc:2749] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:24.206279 27325 raft_consensus.cc:740] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:24.212656 27329 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.210115 27031 raft_consensus.cc:3055] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:24.210466 27237 raft_consensus.cc:2749] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:11:24.247264 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:24.250366 27205 raft_consensus.cc:2749] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:24.250628 27370 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:24.207279 27405 consensus_queue.cc:1048] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:11:24.273669 25195 leader_election.cc:400] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 election: Vote denied by peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091) with higher term. Message: Invalid argument: T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 3. Current term is 4.
I20260709 13:11:24.278692 25195 leader_election.cc:304] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:24.290158 25195 leader_election.cc:304] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:24.269210 27329 raft_consensus.cc:3060] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:24.270969 27031 raft_consensus.cc:740] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:24.244948 27221 raft_consensus.cc:515] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:24.297303 25195 leader_election.cc:304] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:24.273734 27338 leader_election.cc:290] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:11:24.300874 25345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:24.304435 25195 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:24.246253 27242 raft_consensus.cc:515] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:24.254181 27335 raft_consensus.cc:515] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:24.294221 27237 raft_consensus.cc:2804] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:24.308435 25195 leader_election.cc:304] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:24.298791 27357 raft_consensus.cc:2749] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:24.324198 27404 raft_consensus.cc:2749] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:24.279143 27370 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:24.307466 27021 raft_consensus.cc:2749] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:24.329345 27237 raft_consensus.cc:697] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 4 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:24.331560 27237 consensus_queue.cc:237] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:24.332298 27242 leader_election.cc:290] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:24.332880 27423 raft_consensus.cc:493] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:24.333396 27423 raft_consensus.cc:515] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:24.322126 27393 leader_election.cc:290] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:24.335533 27423 leader_election.cc:290] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:24.337190 27185 consensus_queue.cc:1059] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:24.342368 25371 raft_consensus.cc:1275] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:11:24.343756 25195 leader_election.cc:304] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:11:24.345142 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:24.346195 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:24.346910 25371 raft_consensus.cc:2468] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 5.
I20260709 13:11:24.347333 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:24.314942 27368 raft_consensus.cc:2749] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:24.352047 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:24.355182 25230 raft_consensus.cc:2468] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 3.
I20260709 13:11:24.349764 27115 raft_consensus.cc:3055] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:24.356410 27115 raft_consensus.cc:740] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:24.320685 27415 leader_election.cc:290] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:24.358309 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:24.358860 25224 raft_consensus.cc:3060] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:24.359830 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:24.360582 25370 raft_consensus.cc:2410] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:11:24.361342 25227 raft_consensus.cc:1275] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:11:24.361670 25227 pending_rounds.cc:85] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce: Aborting all ops after (but not including) 5
I20260709 13:11:24.361905 25227 pending_rounds.cc:107] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:11:24.362119 25227 raft_consensus.cc:2889] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:24.364035 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:24.364744 25373 raft_consensus.cc:2393] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 4: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:24.366719 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:24.367519 25222 raft_consensus.cc:2468] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 3.
I20260709 13:11:24.321532 27375 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:24.376464 25228 raft_consensus.cc:1275] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:11:24.357445 27115 consensus_queue.cc:260] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:24.381037 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:24.381417 27115 raft_consensus.cc:3060] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:24.385653 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:11:24.385972 27413 log.cc:927] Time spent T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.244s	user 0.001s	sys 0.001s
I20260709 13:11:24.386580 25902 raft_consensus.cc:2410] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:11:24.387761 25903 raft_consensus.cc:3060] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Advancing to term 5
W20260709 13:11:24.387889 27426 log.cc:927] Time spent T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:11:24.310704 27325 consensus_queue.cc:260] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:24.373907 27425 raft_consensus.cc:493] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:24.378032 27322 raft_consensus.cc:2804] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:24.408928 25373 raft_consensus.cc:1275] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:24.410140 27188 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:24.423262 25378 raft_consensus.cc:1275] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:11:24.423888 25378 pending_rounds.cc:85] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468: Aborting all ops after (but not including) 3
I20260709 13:11:24.424099 25378 pending_rounds.cc:107] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 3.4
I20260709 13:11:24.425540 25378 raft_consensus.cc:2917] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Aborting config change with OpId 3.4: Aborted: Op aborted by new leader
I20260709 13:11:24.396471 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:24.439514 25378 raft_consensus.cc:2889] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:24.440367 25373 raft_consensus.cc:1275] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:11:24.339715 27031 consensus_queue.cc:260] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:24.398698 25900 raft_consensus.cc:2468] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 5.
W20260709 13:11:24.447176 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 76280.7us
I20260709 13:11:24.452358 25375 raft_consensus.cc:1275] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:24.448588 27325 raft_consensus.cc:3060] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:24.461050 27335 leader_election.cc:290] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:24.445842 27322 raft_consensus.cc:697] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 5 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:24.427349 27188 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:24.451135 27411 raft_consensus.cc:493] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.457401 27370 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:24.426111 27425 raft_consensus.cc:515] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:24.458873 27031 raft_consensus.cc:3060] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:24.481387 27370 raft_consensus.cc:493] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:24.498878 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:24.487032 27221 leader_election.cc:290] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:24.520639 27434 raft_consensus.cc:493] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.470095 27411 raft_consensus.cc:515] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
W20260709 13:11:24.500303 27428 log.cc:927] Time spent T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:11:24.500910 27370 raft_consensus.cc:515] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:24.500397 27425 leader_election.cc:290] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:24.526479 25903 raft_consensus.cc:1275] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:11:24.527062 27322 consensus_queue.cc:237] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:24.530423 27329 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:24.534209 25224 raft_consensus.cc:2468] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 4.
I20260709 13:11:24.538095 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:24.534380 26979 raft_consensus.cc:515] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:24.545446 25302 raft_consensus.cc:1275] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:11:24.542258 27434 raft_consensus.cc:515] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:24.544108 27188 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:24.574601 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:24.576104 25908 raft_consensus.cc:2368] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 4. Current term is 5.
I20260709 13:11:24.562345 25901 raft_consensus.cc:2393] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 4: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:11:24.577180 25302 raft_consensus.cc:2393] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 4: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
W20260709 13:11:24.566768 27400 log.cc:927] Time spent T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.643s	user 0.004s	sys 0.000s
I20260709 13:11:24.557329 25903 pending_rounds.cc:85] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6: Aborting all ops after (but not including) 3
I20260709 13:11:24.587821 27329 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 5 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:24.562175 26979 leader_election.cc:290] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:24.588295 25903 pending_rounds.cc:107] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 3.4
I20260709 13:11:24.591436 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:24.573231 27370 leader_election.cc:290] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:24.591893 25298 raft_consensus.cc:1275] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:11:24.596342 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:24.597172 25374 raft_consensus.cc:2410] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:11:24.591643 25303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57272 (request call id 1399) took 1043 ms. Trace:
I20260709 13:11:24.592137 27434 leader_election.cc:290] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:24.597975 25303 rpcz_store.cc:276] 0709 13:11:23.548003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:23.741620 (+193617us) service_pool.cc:224] Handling call
0709 13:11:24.591468 (+849848us) spinlock_profiling.cc:243] Waited 3.46 ms on lock 0x7b54001694d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:24.591589 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7955712}
I20260709 13:11:24.592646 25370 raft_consensus.cc:3060] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:24.615981 25271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:24.615860 25370 raft_consensus.cc:2468] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 5.
I20260709 13:11:24.616712 25874 leader_election.cc:304] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
W20260709 13:11:24.609349 27429 log.cc:927] Time spent T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.278s	user 0.000s	sys 0.001s
I20260709 13:11:24.600056 25903 raft_consensus.cc:2917] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Aborting config change with OpId 3.4: Aborted: Op aborted by new leader
I20260709 13:11:24.623929 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:24.633996 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:24.634145 25900 raft_consensus.cc:2468] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 5.
I20260709 13:11:24.634760 25902 raft_consensus.cc:2393] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 3: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
W20260709 13:11:24.637364 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:24.638636 25377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36264 (request call id 1342) took 1540 ms. Trace:
I20260709 13:11:24.631104 27192 raft_consensus.cc:493] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.639403 27266 consensus_queue.cc:1059] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:24.639947 27192 raft_consensus.cc:515] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:24.641844 25903 raft_consensus.cc:2889] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:24.642168 27192 leader_election.cc:290] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:24.645723 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:24.646344 25228 raft_consensus.cc:1240] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:24.647701 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:24.650471 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:24.622010 27434 raft_consensus.cc:2804] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:24.639015 25377 rpcz_store.cc:276] 0709 13:11:23.098485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:23.227606 (+129121us) service_pool.cc:224] Handling call
0709 13:11:23.227899 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:23.470465 (+242566us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:23.470495 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:23.470530 (+    35us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:23.470561 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:24.638439 (+1167878us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x7b540009bfd4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:24.638479 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:24.638579 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":539629824}
I20260709 13:11:24.662371 27434 raft_consensus.cc:697] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:24.648458 25230 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 2.
I20260709 13:11:24.652410 25228 raft_consensus.cc:2393] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 6: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:24.651712 27196 raft_consensus.cc:493] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.659643 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:24.660228 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:24.660401 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:24.660983 25899 raft_consensus.cc:1275] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:24.664104 26979 consensus_queue.cc:1048] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:11:24.663285 27434 consensus_queue.cc:237] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:24.668150 25372 raft_consensus.cc:2468] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 5.
I20260709 13:11:24.670562 27196 raft_consensus.cc:515] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:11:24.674906 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:24.621327 27329 consensus_queue.cc:1048] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:11:24.680900 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:24.681571 25372 raft_consensus.cc:2468] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 5.
I20260709 13:11:24.679677 27196 leader_election.cc:290] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:24.683840 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:24.684355 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:24.684608 25224 raft_consensus.cc:3060] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:24.685084 25229 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 5.
I20260709 13:11:24.685173 27209 raft_consensus.cc:493] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.685639 27209 raft_consensus.cc:515] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:24.687036 25904 raft_consensus.cc:1275] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:24.687639 25904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50056 (request call id 444) took 1009 ms. Trace:
I20260709 13:11:24.687776 27209 leader_election.cc:290] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:24.688004 25904 rpcz_store.cc:276] 0709 13:11:23.678342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:23.679304 (+   962us) service_pool.cc:224] Handling call
0709 13:11:24.686547 (+1007243us) spinlock_profiling.cc:243] Waited 2.89 ms on lock 0x7b58001a3198. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72cb4ab71 00007fd72cb4aeee 0000000000375939 00007fd734bbe1e0 00007fd734c870c4 00007fd734c87131 00007fd734c48fc0 00007fd734c33929 00007fd734c333d2 00007fd72e1aabd4
0709 13:11:24.686698 (+   151us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:24.687397 (+   699us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:24.687584 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6657792}
I20260709 13:11:24.703660 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:24.704598 25229 raft_consensus.cc:2468] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 4.
I20260709 13:11:24.723263 25224 raft_consensus.cc:2468] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 4.
I20260709 13:11:24.726356 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:24.733179 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:24.735775 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:24.726541 27407 raft_consensus.cc:493] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:24.750419 25224 raft_consensus.cc:1275] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:11:24.751092 25372 raft_consensus.cc:1275] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:24.768567 27239 consensus_queue.cc:260] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:11:24.770094 25301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57272 (request call id 1394) took 1223 ms. Trace:
I20260709 13:11:24.770503 25301 rpcz_store.cc:276] 0709 13:11:23.546576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:23.546718 (+   142us) service_pool.cc:224] Handling call
0709 13:11:24.769896 (+1223178us) spinlock_profiling.cc:243] Waited 998 ms on lock 0x7b54000f8f54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:24.770036 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2294900992}
I20260709 13:11:24.772542 25371 raft_consensus.cc:1275] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:11:24.785056 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:24.779048 27239 raft_consensus.cc:3060] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:24.763530 27407 raft_consensus.cc:515] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:24.791901 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:24.795452 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:24.802932 25229 raft_consensus.cc:1240] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:24.808907 27002 raft_consensus.cc:3060] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:24.811486 27238 leader_election.cc:290] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:24.819043 25271 leader_election.cc:304] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:24.820329 27407 leader_election.cc:290] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:24.821617 27238 raft_consensus.cc:2749] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:24.823488 25271 leader_election.cc:304] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:24.824729 27238 raft_consensus.cc:2804] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:24.825201 27238 raft_consensus.cc:493] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.825628 27238 raft_consensus.cc:3060] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:24.832270 25344 leader_election.cc:304] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:24.834064 27425 raft_consensus.cc:2804] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:24.834602 27425 raft_consensus.cc:493] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.836608 25271 leader_election.cc:304] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:24.837687 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:24.837994 25228 raft_consensus.cc:1275] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:24.844508 25222 raft_consensus.cc:2393] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 4: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:24.845961 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:24.846748 25228 raft_consensus.cc:3060] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:11:24.835027 27425 raft_consensus.cc:3060] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:24.849942 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:24.854195 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:24.856083 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:24.854781 25195 leader_election.cc:304] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:11:24.860118 25195 leader_election.cc:304] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:11:24.849120 26772 raft_consensus.cc:2804] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:24.870781 26964 leader_election.cc:290] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:24.871186 27196 raft_consensus.cc:2804] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:24.883351 26989 leader_election.cc:290] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:24.884321 27394 leader_election.cc:290] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:24.885079 27238 raft_consensus.cc:515] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:24.855084 27117 consensus_queue.cc:1048] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:11:24.899601 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:24.900229 25378 raft_consensus.cc:2468] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 4.
I20260709 13:11:24.881428 27196 raft_consensus.cc:493] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.902375 25228 raft_consensus.cc:2468] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 5.
I20260709 13:11:24.881228 27322 raft_consensus.cc:2804] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:24.905552 25874 leader_election.cc:304] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:11:24.891906 26772 raft_consensus.cc:697] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 4 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:24.913929 26979 raft_consensus.cc:2804] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:24.908322 27196 raft_consensus.cc:3060] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:24.886162 27357 consensus_queue.cc:1048] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:11:24.931397 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:24.890955 27189 consensus_queue.cc:1048] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:11:24.892051 26989 consensus_queue.cc:1048] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:11:24.948637 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:24.908104 27322 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:24.955833 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:24.948980 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:24.953456 25194 leader_election.cc:304] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:24.963517 25301 raft_consensus.cc:1275] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:24.967916 25194 leader_election.cc:400] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 election: Vote denied by peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127) with higher term. Message: Invalid argument: T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 5. Current term is 6.
I20260709 13:11:24.970701 25228 raft_consensus.cc:1275] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:11:24.973708 27448 log.cc:927] Time spent T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:11:24.974074 25300 raft_consensus.cc:1275] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:24.914933 27329 consensus_queue.cc:1048] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
W20260709 13:11:24.965119 27134 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.838s	user 0.020s	sys 0.012s
I20260709 13:11:24.959674 26979 raft_consensus.cc:697] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:24.971974 27404 raft_consensus.cc:2749] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:11:25.007128 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:24.981546 27134 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.877s	user 0.021s	sys 0.013s
I20260709 13:11:25.015499 25299 raft_consensus.cc:2410] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:11:25.015272 27239 consensus_queue.cc:1048] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:25.016199 27390 raft_consensus.cc:493] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.968566 27322 raft_consensus.cc:3060] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:25.022109 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:25.022745 25229 raft_consensus.cc:3060] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:25.027833 26979 consensus_queue.cc:237] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:25.030337 25373 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759"
dest_uuid: "79d99c0e498349bda74127365219e468"
mode: GRACEFUL
new_leader_uuid: "1f539ba21487460085b837e7529a78ce"
 from {username='slave'} at 127.0.0.1:59274
I20260709 13:11:25.031049 25373 raft_consensus.cc:606] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Received request to transfer leadership to TS 1f539ba21487460085b837e7529a78ce
I20260709 13:11:25.031386 25373 raft_consensus.cc:614] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:25.013305 27209 raft_consensus.cc:493] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:25.031817 27209 raft_consensus.cc:515] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:25.034952 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:25.036005 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:25.042181 25373 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489"
dest_uuid: "79d99c0e498349bda74127365219e468"
mode: GRACEFUL
new_leader_uuid: "da445ce82dc4467f95f4fa52297eaa19"
 from {username='slave'} at 127.0.0.1:59274
I20260709 13:11:25.042831 25373 raft_consensus.cc:606] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 4 LEADER]: Received request to transfer leadership to TS da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:25.043777 25901 raft_consensus.cc:1275] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:25.046644 25904 raft_consensus.cc:1275] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:25.017120 27266 raft_consensus.cc:493] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.017717 26964 raft_consensus.cc:493] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.067464 25373 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119"
dest_uuid: "79d99c0e498349bda74127365219e468"
mode: GRACEFUL
new_leader_uuid: "1f539ba21487460085b837e7529a78ce"
 from {username='slave'} at 127.0.0.1:59274
I20260709 13:11:25.068092 25373 raft_consensus.cc:606] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Received request to transfer leadership to TS 1f539ba21487460085b837e7529a78ce
I20260709 13:11:25.068475 25373 raft_consensus.cc:614] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:25.063978 26964 raft_consensus.cc:515] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:25.073045 27452 log.cc:927] Time spent T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:11:25.076730 25373 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff"
dest_uuid: "79d99c0e498349bda74127365219e468"
mode: GRACEFUL
new_leader_uuid: "1f539ba21487460085b837e7529a78ce"
 from {username='slave'} at 127.0.0.1:59274
I20260709 13:11:25.041857 27390 raft_consensus.cc:515] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:25.051785 26989 consensus_queue.cc:1048] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:11:25.054899 27185 consensus_queue.cc:1048] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:11:25.087839 27390 leader_election.cc:290] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:25.052098 27266 raft_consensus.cc:515] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:11:25.105897 25223 raft_consensus.cc:1275] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:11:25.083376 27031 raft_consensus.cc:493] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:25.050557 26772 consensus_queue.cc:237] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:25.118866 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 194135us
I20260709 13:11:25.099479 27329 raft_consensus.cc:493] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.068267 27425 raft_consensus.cc:515] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:25.125490 25345 leader_election.cc:304] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:25.121824 25904 raft_consensus.cc:1275] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:25.136689 25373 raft_consensus.cc:606] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Received request to transfer leadership to TS 1f539ba21487460085b837e7529a78ce
I20260709 13:11:25.137128 25373 raft_consensus.cc:614] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:25.127525 27209 leader_election.cc:290] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:25.139254 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 170466us
I20260709 13:11:25.140098 25194 leader_election.cc:304] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:25.121423 27390 consensus_queue.cc:1048] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:11:25.125324 27031 raft_consensus.cc:515] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:25.127961 27329 raft_consensus.cc:515] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:25.148420 26989 raft_consensus.cc:2749] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:25.157006 27458 consensus_queue.cc:1048] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:25.159526 27370 consensus_queue.cc:1048] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:25.157919 27202 consensus_queue.cc:1048] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:25.159062 27189 consensus_queue.cc:1059] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:11:25.160259 25299 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57256 (request call id 1509) took 1606 ms (client timeout 1849 ms). Trace:
I20260709 13:11:25.151355 27332 raft_consensus.cc:2764] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:11:25.157362 27404 consensus_queue.cc:1048] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:11:25.168352 25299 rpcz_store.cc:269] 0709 13:11:23.554163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:23.646873 (+ 92710us) service_pool.cc:224] Handling call
0709 13:11:25.156516 (+1509643us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b54000f8054. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:25.160186 (+  3670us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3144946048}
I20260709 13:11:25.163105 25229 raft_consensus.cc:2468] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 5.
I20260709 13:11:25.183061 27031 leader_election.cc:290] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:25.183094 27455 log.cc:927] Time spent T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:11:25.189000 27425 leader_election.cc:290] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:25.190116 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:25.190733 25904 raft_consensus.cc:3060] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:25.161919 27462 consensus_queue.cc:1059] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:11:25.193686 27462 raft_consensus.cc:3055] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:25.194026 27462 raft_consensus.cc:740] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:25.194784 27462 consensus_queue.cc:260] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:25.195096 25872 leader_election.cc:304] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:25.195909 27462 raft_consensus.cc:3060] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:25.160306 27383 leader_election.cc:290] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:25.199681 25904 raft_consensus.cc:2468] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 8.
I20260709 13:11:25.173923 25271 leader_election.cc:304] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:25.200719 27157 raft_consensus.cc:2749] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:25.201893 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:11:25.203471 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:25.200764 27329 leader_election.cc:290] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:25.205294 27031 raft_consensus.cc:493] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.219139 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:25.205819 27390 raft_consensus.cc:2804] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:11:25.226079 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 68008.9us
I20260709 13:11:25.237573 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:25.240302 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:25.240931 25298 raft_consensus.cc:2368] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 5. Current term is 6.
I20260709 13:11:25.240990 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:11:25.241930 25271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:25.242409 25194 leader_election.cc:304] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:25.244081 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:25.215571 27265 raft_consensus.cc:493] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:25.246764 25305 raft_consensus.cc:1240] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:25.251021 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:25.243345 27423 raft_consensus.cc:493] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.260042 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:25.261870 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:25.261610 27465 raft_consensus.cc:493] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.265848 27465 raft_consensus.cc:515] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:25.266965 27461 log.cc:927] Time spent T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:11:25.245003 27390 raft_consensus.cc:697] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 5 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:25.270255 25194 leader_election.cc:304] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:25.264986 25298 raft_consensus.cc:2468] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 4.
I20260709 13:11:25.246474 27425 raft_consensus.cc:493] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:25.235805 27031 raft_consensus.cc:515] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:25.259543 27189 raft_consensus.cc:2749] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:25.259909 27332 raft_consensus.cc:493] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.258502 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:25.269966 27383 raft_consensus.cc:493] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.267966 27465 leader_election.cc:290] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:25.287767 27471 raft_consensus.cc:493] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.296838 27466 consensus_queue.cc:1048] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:25.300261 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:25.303020 25376 raft_consensus.cc:1275] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 2. (term mismatch)
I20260709 13:11:25.303372 25376 pending_rounds.cc:85] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468: Aborting all ops after (but not including) 1
I20260709 13:11:25.303618 25376 pending_rounds.cc:107] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:11:25.303848 25376 raft_consensus.cc:2889] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:25.304173 25376 pending_rounds.cc:107] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:11:25.304414 25376 raft_consensus.cc:2889] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:25.304840 27238 leader_election.cc:290] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:25.305598 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:25.289921 25296 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 2.
I20260709 13:11:25.273981 27202 raft_consensus.cc:3060] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:25.307991 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:25.314397 25300 raft_consensus.cc:2468] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 4.
I20260709 13:11:25.311496 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:25.312672 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:25.320768 25304 raft_consensus.cc:1240] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:25.321373 25300 raft_consensus.cc:1275] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:25.325066 25299 raft_consensus.cc:1240] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:25.330921 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:25.331151 25345 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:25.275560 27458 consensus_queue.cc:1048] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:11:25.262741 27265 raft_consensus.cc:515] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:25.333784 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:25.272060 27423 raft_consensus.cc:515] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:25.339450 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 130939us
I20260709 13:11:25.340847 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:25.314579 27209 raft_consensus.cc:493] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.345533 25872 leader_election.cc:304] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:25.338481 25344 leader_election.cc:304] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:25.305578 27383 raft_consensus.cc:515] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:25.315316 27002 raft_consensus.cc:493] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:25.347873 25872 leader_election.cc:304] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:25.283177 27425 raft_consensus.cc:515] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:25.332964 27465 raft_consensus.cc:2749] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:25.356923 25345 leader_election.cc:304] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:25.286229 27332 raft_consensus.cc:515] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:25.360772 27332 leader_election.cc:290] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:25.360776 25343 leader_election.cc:304] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:25.362551 25343 leader_election.cc:304] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:25.316936 27196 raft_consensus.cc:515] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:25.349896 27434 raft_consensus.cc:2749] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:25.376791 27239 raft_consensus.cc:493] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:25.316838 27471 raft_consensus.cc:515] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:25.345005 27404 consensus_queue.cc:1059] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:11:25.347510 27370 consensus_queue.cc:1048] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:11:25.369617 27332 raft_consensus.cc:2804] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:25.352860 27369 consensus_queue.cc:1059] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:11:25.379823 27465 raft_consensus.cc:2749] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:11:25.403127 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 46289.6us
I20260709 13:11:25.363101 27002 raft_consensus.cc:515] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:25.389655 27395 leader_election.cc:290] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:25.406498 27404 raft_consensus.cc:3055] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:25.399273 27434 raft_consensus.cc:2749] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:25.348377 27390 consensus_queue.cc:237] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:25.406893 27469 log.cc:927] Time spent T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:11:25.390825 27470 consensus_queue.cc:1048] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:11:25.400816 27332 raft_consensus.cc:697] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 8 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:25.424394 27411 leader_election.cc:290] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:25.354369 27209 raft_consensus.cc:515] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:11:25.396011 27239 raft_consensus.cc:515] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:25.429711 27324 raft_consensus.cc:3060] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:25.456063 27239 leader_election.cc:290] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:25.431085 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:25.456759 27423 leader_election.cc:290] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:25.432452 27465 raft_consensus.cc:2749] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:25.428996 27383 leader_election.cc:290] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:25.426515 27031 leader_election.cc:290] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:25.430773 27471 leader_election.cc:290] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:25.458112 27265 leader_election.cc:290] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:25.436668 27407 raft_consensus.cc:2804] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:25.433712 27266 leader_election.cc:290] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361)
I20260709 13:11:25.459103 27407 raft_consensus.cc:697] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 3 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:25.460402 27407 consensus_queue.cc:237] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:25.436893 27002 leader_election.cc:290] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:25.441620 27404 raft_consensus.cc:740] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:25.448297 27425 leader_election.cc:290] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:25.453421 27196 leader_election.cc:290] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:25.454034 27332 consensus_queue.cc:237] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:25.454427 27411 raft_consensus.cc:493] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.468025 27322 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:25.499758 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:25.456063 27209 leader_election.cc:290] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:25.518884 25373 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 4.
I20260709 13:11:25.439180 27202 raft_consensus.cc:2749] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:11:25.537698 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 175197us
W20260709 13:11:25.540434 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 201817us
I20260709 13:11:25.541793 25230 raft_consensus.cc:1240] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:25.543241 25343 leader_election.cc:304] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:25.544421 25343 leader_election.cc:304] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:25.545390 25373 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88"
dest_uuid: "79d99c0e498349bda74127365219e468"
mode: GRACEFUL
new_leader_uuid: "1f539ba21487460085b837e7529a78ce"
 from {username='slave'} at 127.0.0.1:59274
I20260709 13:11:25.545898 25905 raft_consensus.cc:1275] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:25.548156 27340 leader_election.cc:290] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:25.549922 27002 raft_consensus.cc:2749] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:25.558547 25905 raft_consensus.cc:1240] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:11:25.565620 25343 leader_election.cc:304] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:25.567471 25343 leader_election.cc:400] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 election: Vote denied by peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127) with higher term. Message: Invalid argument: T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 5. Current term is 6.
I20260709 13:11:25.567911 25343 leader_election.cc:403] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:11:25.520730 27411 raft_consensus.cc:515] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:25.600581 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:25.601261 25905 raft_consensus.cc:3060] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:25.601151 25343 leader_election.cc:304] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:25.569018 27002 raft_consensus.cc:2749] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:25.568308 27480 raft_consensus.cc:2749] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:25.613576 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:11:25.619485 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 271671us
W20260709 13:11:25.634819 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:25.640450 25905 raft_consensus.cc:2468] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 6.
I20260709 13:11:25.659595 25195 leader_election.cc:400] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Vote denied by peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085) with higher term. Message: Invalid argument: T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 4. Current term is 5.
I20260709 13:11:25.661792 25195 leader_election.cc:403] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:25.693818 25223 raft_consensus.cc:1275] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:11:25.555832 27404 consensus_queue.cc:260] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:25.611392 27486 raft_consensus.cc:3060] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:25.567042 25115 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 275226661cc840559134f8c9e5b15719 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 1f539ba21487460085b837e7529a78ce is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:11:25.696295 25195 leader_election.cc:304] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:11:25.702930 25376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36264 (request call id 1352) took 1552 ms. Trace:
I20260709 13:11:25.703114 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:25.703848 25225 raft_consensus.cc:2393] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 4: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:25.703327 25376 rpcz_store.cc:276] 0709 13:11:24.150438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:24.150564 (+   126us) service_pool.cc:224] Handling call
0709 13:11:24.167617 (+ 17053us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:25.304829 (+1137212us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:25.702681 (+397852us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54000b9354. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:25.702865 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2610438528}
W20260709 13:11:25.708940 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 107891us
I20260709 13:11:25.710224 25378 raft_consensus.cc:1275] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:25.710508 25343 leader_election.cc:304] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:11:25.712611 25195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:25.714569 25195 leader_election.cc:304] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:25.718670 25873 leader_election.cc:304] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
W20260709 13:11:25.718010 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 150463us
I20260709 13:11:25.726255 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:25.726802 25376 raft_consensus.cc:3060] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:25.702571 27233 raft_consensus.cc:2749] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085) with higher term. Message: Invalid argument: T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 4. Current term is 5.
I20260709 13:11:25.697860 27479 raft_consensus.cc:2749] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:25.731784 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:25.733618 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:25.734223 25378 raft_consensus.cc:3060] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:25.720772 27189 raft_consensus.cc:2804] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:11:25.714265 25115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 144061us
I20260709 13:11:25.709018 27357 consensus_queue.cc:1059] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:11:25.758284 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:25.724336 27266 raft_consensus.cc:493] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:25.759110 25372 raft_consensus.cc:1240] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:11:25.759171 25377 raft_consensus.cc:2410] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 3 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:11:25.761363 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:25.726014 27239 raft_consensus.cc:493] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
W20260709 13:11:25.734965 27405 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.000s	sys 0.013s
I20260709 13:11:25.735354 27480 raft_consensus.cc:2804] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:25.752414 25376 raft_consensus.cc:2468] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 6.
I20260709 13:11:25.721575 27462 consensus_queue.cc:1048] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:11:25.774816 25378 raft_consensus.cc:2468] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 5.
I20260709 13:11:25.746315 27196 raft_consensus.cc:2749] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:25.798009 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:25.799189 25376 raft_consensus.cc:2410] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:11:25.801225 25378 raft_consensus.cc:1240] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:11:25.800230 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:25.811390 25372 raft_consensus.cc:2468] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 3.
I20260709 13:11:25.811304 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:25.812867 25377 raft_consensus.cc:2468] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 6.
W20260709 13:11:25.775552 27405 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.000s	sys 0.014s
I20260709 13:11:25.764204 27189 raft_consensus.cc:697] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 6 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:25.825285 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:25.770239 27484 raft_consensus.cc:493] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:25.827324 27189 consensus_queue.cc:237] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:25.778028 27480 raft_consensus.cc:493] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:25.836783 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:25.775684 27239 raft_consensus.cc:515] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:25.776754 27266 raft_consensus.cc:515] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:25.860760 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 147004us
I20260709 13:11:25.864279 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:25.856467 27480 raft_consensus.cc:3060] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:25.865309 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 145585us
I20260709 13:11:25.887804 25377 raft_consensus.cc:1275] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:11:25.891749 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:25.865860 27411 leader_election.cc:290] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:25.892648 25372 raft_consensus.cc:2468] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 2.
I20260709 13:11:25.855134 27484 raft_consensus.cc:515] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:25.902776 25372 raft_consensus.cc:1275] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:25.907636 25373 raft_consensus.cc:606] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 3 LEADER]: Received request to transfer leadership to TS 1f539ba21487460085b837e7529a78ce
W20260709 13:11:25.921208 27488 log.cc:927] Time spent T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 13:11:25.925083 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:11:25.926855 27491 log.cc:927] Time spent T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:11:25.962977 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:25.963949 25377 raft_consensus.cc:2468] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 5.
I20260709 13:11:25.966835 27319 raft_consensus.cc:493] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.973225 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:25.974144 25372 raft_consensus.cc:2410] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:11:25.976534 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:25.976596 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:25.977483 25227 raft_consensus.cc:2393] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 3: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:25.967445 27319 raft_consensus.cc:515] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:25.997999 27495 log.cc:927] Time spent T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:11:26.007289 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:26.008800 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:26.009562 25374 raft_consensus.cc:3060] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:26.010040 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:26.010653 25230 raft_consensus.cc:2468] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 5.
W20260709 13:11:25.999647 27489 log.cc:927] Time spent T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:11:26.013773 26989 raft_consensus.cc:3055] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:11:26.014518 27324 consensus_meta.cc:287] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.559s	user 0.014s	sys 0.000s
I20260709 13:11:26.015403 25377 raft_consensus.cc:1275] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:11:26.015842 26979 raft_consensus.cc:2804] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:11:26.015985 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 292853us
I20260709 13:11:26.017083 26964 leader_election.cc:290] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:26.020473 25872 leader_election.cc:304] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:26.020756 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:26.021623 25371 raft_consensus.cc:2468] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 4.
I20260709 13:11:26.023228 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:26.024747 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:26.025377 25372 raft_consensus.cc:3060] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:11:26.022898 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:26.026829 25371 raft_consensus.cc:2468] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 5.
I20260709 13:11:26.028586 25374 raft_consensus.cc:2468] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 6.
I20260709 13:11:26.024969 25297 raft_consensus.cc:2468] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 3.
I20260709 13:11:26.034376 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:26.035315 25374 raft_consensus.cc:2410] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 6 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:11:26.038012 25377 raft_consensus.cc:1275] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:11:26.038281 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:26.036242 27401 raft_consensus.cc:493] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.039295 27496 consensus_queue.cc:1048] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:11:26.039788 27401 raft_consensus.cc:515] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:26.030531 27411 raft_consensus.cc:493] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.040767 27484 leader_election.cc:290] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:26.041106 27500 log.cc:927] Time spent T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 13:11:26.042228 27319 leader_election.cc:290] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:26.038971 25379 raft_consensus.cc:2468] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 3.
I20260709 13:11:26.019757 26989 raft_consensus.cc:740] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
W20260709 13:11:26.038061 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 326075us
I20260709 13:11:26.041085 27411 raft_consensus.cc:515] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:26.047648 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 158051us
I20260709 13:11:26.047748 25372 raft_consensus.cc:2468] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 5.
I20260709 13:11:26.051095 27497 consensus_queue.cc:1048] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:11:26.054822 27492 log.cc:927] Time spent T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
W20260709 13:11:26.056356 27501 log.cc:927] Time spent T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:11:26.058068 27266 leader_election.cc:290] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:26.067701 27115 raft_consensus.cc:3055] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:26.024770 27395 consensus_queue.cc:1048] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:11:26.068315 27115 raft_consensus.cc:740] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:26.067576 27325 raft_consensus.cc:493] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
W20260709 13:11:26.074864 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:26.071060 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 50675.3us
I20260709 13:11:26.029268 27480 raft_consensus.cc:515] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:26.092067 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:26.069258 27115 consensus_queue.cc:260] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:26.089265 27325 raft_consensus.cc:515] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:26.095255 27115 raft_consensus.cc:3060] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:26.095358 27479 raft_consensus.cc:993] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468: : Instructing follower da445ce82dc4467f95f4fa52297eaa19 to start an election
I20260709 13:11:26.095618 25906 raft_consensus.cc:1275] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:11:26.095918 27479 raft_consensus.cc:1081] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 4 LEADER]: Signalling peer da445ce82dc4467f95f4fa52297eaa19 to start an election
I20260709 13:11:26.096665 27325 leader_election.cc:290] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:26.097273 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:26.098388 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:26.099674 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:26.104408 25908 raft_consensus.cc:2393] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 4: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:11:26.099239 25903 raft_consensus.cc:2410] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:11:26.106227 27395 raft_consensus.cc:2804] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:26.106529 27265 raft_consensus.cc:493] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.106714 27475 raft_consensus.cc:493] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:26.107115 27265 raft_consensus.cc:515] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:26.107257 27475 raft_consensus.cc:515] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:26.108409 25271 leader_election.cc:304] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:26.109196 27475 leader_election.cc:290] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:26.110882 25300 raft_consensus.cc:1240] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:26.112040 27266 raft_consensus.cc:2804] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:26.112445 27266 raft_consensus.cc:493] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:26.112803 27266 raft_consensus.cc:3060] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:26.074532 27383 raft_consensus.cc:493] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.119817 27002 raft_consensus.cc:493] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:26.120143 27383 raft_consensus.cc:515] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:26.125488 27002 raft_consensus.cc:515] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:26.125880 27324 raft_consensus.cc:493] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.126447 27324 raft_consensus.cc:515] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:26.127279 27411 leader_election.cc:290] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:26.127817 27383 leader_election.cc:290] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:26.128173 27002 leader_election.cc:290] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:26.127764 26989 consensus_queue.cc:260] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:26.128942 27324 leader_election.cc:290] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:26.129201 27329 raft_consensus.cc:493] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:26.129693 27329 raft_consensus.cc:515] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:26.106681 27395 raft_consensus.cc:493] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:26.109848 27476 consensus_queue.cc:1059] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:11:26.109633 27265 leader_election.cc:290] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:26.142489 27480 leader_election.cc:290] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:11:26.133718 25271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:26.112852 27157 consensus_queue.cc:1048] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:11:26.146991 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:26.147761 25303 raft_consensus.cc:2468] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 2.
I20260709 13:11:26.149346 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:26.135416 27178 raft_consensus.cc:493] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.151326 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:26.135417 27394 raft_consensus.cc:493] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:26.135592 27484 raft_consensus.cc:493] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.166625 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:26.136116 27395 raft_consensus.cc:3060] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:26.116789 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:11:26.138417 27487 log.cc:927] Time spent T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.237s	user 0.001s	sys 0.000s
I20260709 13:11:26.139142 27476 raft_consensus.cc:3055] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:11:26.139905 27504 log.cc:927] Time spent T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
W20260709 13:11:26.141129 25297 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46556 (request call id 252) took 1642 ms (client timeout 2103 ms). Trace:
I20260709 13:11:26.151232 27178 raft_consensus.cc:515] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:26.147094 27401 leader_election.cc:290] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:26.135481 27209 raft_consensus.cc:493] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:26.160347 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 109841us
W20260709 13:11:26.181227 25297 rpcz_store.cc:269] 0709 13:11:24.498470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:24.498613 (+   143us) service_pool.cc:224] Handling call
0709 13:11:26.140968 (+1642355us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b54002de1d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:26.141074 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3491596544}
I20260709 13:11:26.135821 27117 raft_consensus.cc:493] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:26.167398 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:26.128945 26989 raft_consensus.cc:3060] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:26.181552 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:26.189414 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:26.190132 25374 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 4.
I20260709 13:11:26.169044 26979 raft_consensus.cc:697] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:26.173992 27381 raft_consensus.cc:493] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.197291 25376 raft_consensus.cc:1275] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:26.192868 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:26.175552 27476 raft_consensus.cc:740] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:26.201452 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:26.202756 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:26.205816 25301 raft_consensus.cc:2410] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:11:26.202216 25302 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489"
dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
 from {username='slave'} at 127.0.0.1:57256
I20260709 13:11:26.207911 25302 raft_consensus.cc:493] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:26.208261 25302 raft_consensus.cc:3060] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:26.168710 27394 raft_consensus.cc:515] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:26.174615 27484 raft_consensus.cc:515] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:26.175060 27266 raft_consensus.cc:515] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
W20260709 13:11:26.211911 27511 log.cc:927] Time spent T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:11:26.238329 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:26.239022 25301 raft_consensus.cc:2468] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 4.
I20260709 13:11:26.241335 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:26.241997 26979 consensus_queue.cc:237] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:26.246273 27394 leader_election.cc:290] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:26.191371 27209 raft_consensus.cc:515] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:26.268489 25302 raft_consensus.cc:515] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:26.273308 25302 leader_election.cc:290] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:25.708639 27369 consensus_queue.cc:1175] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" responder_term: 5 status { last_received { term: 4 index: 6 } last_committed_idx: 6 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:11:26.270241 27515 log.cc:927] Time spent T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 13:11:26.270591 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:26.271613 27266 leader_election.cc:290] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361)
I20260709 13:11:26.269532 27209 leader_election.cc:290] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:26.273865 27178 leader_election.cc:290] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:26.287868 25126 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40034 (request call id 260) took 8159 ms. Trace:
I20260709 13:11:26.293578 27239 leader_election.cc:290] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:26.194484 27117 raft_consensus.cc:515] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:26.296505 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 44356us
I20260709 13:11:26.236887 27517 consensus_queue.cc:1048] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 13:11:26.342955 25304 raft_consensus.cc:1240] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:26.300907 25301 raft_consensus.cc:1240] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 4. Current term is 5. Ops: []
W20260709 13:11:26.333737 25195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:26.345723 25195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:26.346246 25195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:26.347635 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:26.351012 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:26.353140 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:26.354700 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:26.353232 25872 leader_election.cc:304] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:26.356154 25302 raft_consensus.cc:2468] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 3.
I20260709 13:11:26.288308 25126 rpcz_store.cc:276] 0709 13:11:18.128006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.128500 (+   494us) service_pool.cc:224] Handling call
0709 13:11:26.287794 (+8159294us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:22.404507 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:22.410964 (+  6457us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:22.411021 (+    57us) write_op.cc:435] Acquired schema lock
0709 13:11:22.411049 (+    28us) tablet.cc:662] Decoding operations
0709 13:11:22.597785 (+186736us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:22.617370 (+ 19585us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:22.628841 (+ 11471us) tablet.cc:685] Acquiring locks for 19 operations
0709 13:11:22.667047 (+ 38206us) tablet.cc:701] Row locks acquired
0709 13:11:22.667092 (+    45us) write_op.cc:260] PREPARE: finished
0709 13:11:22.667267 (+   175us) write_op.cc:270] Start()
0709 13:11:22.667437 (+   170us) write_op.cc:276] Timestamp: P: 1783602682667200 usec, L: 0
0709 13:11:22.667455 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:11:22.668143 (+   688us) log.cc:844] Serialized 7554 byte log entry
0709 13:11:23.128002 (+459859us) op_driver.cc:464] REPLICATION: finished
0709 13:11:23.358323 (+230321us) write_op.cc:301] APPLY: starting
0709 13:11:23.358437 (+   114us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:23.358808 (+   371us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:23.378216 (+ 19408us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:23.636032 (+257816us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:23.642712 (+  6680us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=19
0709 13:11:23.642760 (+    48us) write_op.cc:312] APPLY: finished
0709 13:11:23.643183 (+   423us) log.cc:844] Serialized 132 byte log entry
0709 13:11:23.691424 (+ 48241us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:23.707957 (+ 16533us) write_op.cc:454] Released schema lock
0709 13:11:23.720737 (+ 12780us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:23.804682 (+ 83945us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:23.807764 (+  3082us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1070359,"reported_tablets":33,"child_traces":[["op",{"apply.queue_time_us":211254,"apply.run_cpu_time_us":8717,"apply.run_wall_time_us":458326,"num_ops":19,"prepare.queue_time_us":153024,"prepare.run_cpu_time_us":10464,"prepare.run_wall_time_us":331037,"raft.queue_time_us":42610,"raft.run_cpu_time_us":16390,"raft.run_wall_time_us":123673,"replication_time_us":450032,"spinlock_wait_cycles":1916672,"thread_start_us":308116,"threads_started":4,"wal-append.queue_time_us":217999,"wal-append.run_cpu_time_us":9848,"wal-append.run_wall_time_us":1755419}]]}
I20260709 13:11:26.354107 25297 raft_consensus.cc:2468] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 5.
I20260709 13:11:26.288820 27395 raft_consensus.cc:515] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:26.359723 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:26.207506 27381 raft_consensus.cc:515] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
W20260709 13:11:26.543144 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 330868us
I20260709 13:11:26.362564 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:26.351791 27476 consensus_queue.cc:260] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:26.998988 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 645777us
I20260709 13:11:26.364075 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:11:26.665459 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:26.360957 24113 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:11:26.363776 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:26.362952 25230 raft_consensus.cc:1275] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:11:27.006578 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 654509us
I20260709 13:11:27.045176 25223 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 5.
W20260709 13:11:27.045462 25270 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 2.102s (SENT) [suppressed 15 similar messages]
I20260709 13:11:27.048089 24113 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:27.049903 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:11:26.840442 27486 consensus_meta.cc:287] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 1.130s	user 0.011s	sys 0.000s
I20260709 13:11:27.051908 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:11:27.052524 25271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:26.845542 27524 log.cc:927] Time spent T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.258s	user 0.001s	sys 0.000s
I20260709 13:11:26.360320 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:27.058020 25906 raft_consensus.cc:3060] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:27.056900 25222 raft_consensus.cc:2468] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 4.
W20260709 13:11:27.059245 25228 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.008s	sys 0.014s
W20260709 13:11:27.059643 25228 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.008s	sys 0.014s
W20260709 13:11:27.051164 27530 log.cc:927] Time spent T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:11:26.417649 27239 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:26.999051 26989 consensus_meta.cc:287] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 0.806s	user 0.009s	sys 0.002s
I20260709 13:11:26.546571 27002 raft_consensus.cc:493] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.442674 27498 raft_consensus.cc:1064] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce: attempting to promote NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 to VOTER
I20260709 13:11:26.686684 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:26.351145 27407 raft_consensus.cc:493] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:27.051853 27383 raft_consensus.cc:493] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.056998 27516 raft_consensus.cc:493] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:26.838547 27484 leader_election.cc:290] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:27.071043 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 653812us
I20260709 13:11:27.051522 27117 leader_election.cc:290] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:26.587675 27329 leader_election.cc:290] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:27.075212 25902 raft_consensus.cc:2410] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:11:26.440562 27470 raft_consensus.cc:2804] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:27.060242 27486 raft_consensus.cc:2749] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127) with higher term. Message: Invalid argument: T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 5. Current term is 6.
I20260709 13:11:27.058108 26964 raft_consensus.cc:493] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:27.069803 25299 raft_consensus.cc:1275] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:27.109438 25907 raft_consensus.cc:2468] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 3.
I20260709 13:11:27.111385 25906 raft_consensus.cc:2468] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 6.
I20260709 13:11:27.147430 25904 raft_consensus.cc:1240] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:27.089500 25899 raft_consensus.cc:2393] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 5: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:11:27.128017 25903 raft_consensus.cc:2393] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 6: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
W20260709 13:11:27.091327 27498 raft_consensus.cc:1068] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce: Unable to promote non-voter 6c4b021f3f9e41adb75e870a08ad88b6: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:11:27.075899 27002 raft_consensus.cc:515] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:27.115047 27470 raft_consensus.cc:493] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:27.074287 27239 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:27.123160 27517 raft_consensus.cc:493] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.081873 27407 raft_consensus.cc:515] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:27.082279 27383 raft_consensus.cc:515] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:27.166396 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:27.165676 25370 raft_consensus.cc:2468] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 6.
I20260709 13:11:27.171622 25371 raft_consensus.cc:2376] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 6. Re-sending same reply.
I20260709 13:11:27.171979 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:27.148168 25904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50058 (request call id 553) took 1072 ms. Trace:
I20260709 13:11:27.167299 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:27.115427 27466 consensus_queue.cc:1059] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:11:27.202145 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:27.203354 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:27.086668 27516 raft_consensus.cc:515] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:27.169651 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:27.204747 25376 raft_consensus.cc:2376] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 5. Re-sending same reply.
I20260709 13:11:27.205765 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:27.206986 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:27.208081 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:27.171109 25343 leader_election.cc:304] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:27.161939 27486 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:27.112133 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:27.162741 27537 raft_consensus.cc:493] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:27.231045 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:27.231855 25379 raft_consensus.cc:2468] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 4.
W20260709 13:11:27.232049 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 60988.9us
I20260709 13:11:27.166879 27470 raft_consensus.cc:3060] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:27.123555 26964 raft_consensus.cc:515] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:27.230199 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:27.240476 25371 raft_consensus.cc:2468] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 2.
I20260709 13:11:27.246403 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:27.166718 27185 consensus_queue.cc:1048] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 13:11:27.238960 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:27.246356 25376 raft_consensus.cc:2468] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 3.
W20260709 13:11:27.252841 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 186821us
I20260709 13:11:27.254043 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:27.256325 25371 raft_consensus.cc:2410] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:11:27.247398 25373 raft_consensus.cc:2468] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 5.
I20260709 13:11:27.169519 27517 raft_consensus.cc:515] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:27.259248 25379 raft_consensus.cc:1275] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:11:27.239435 27486 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:27.264771 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 219314us
I20260709 13:11:27.265894 25270 leader_election.cc:304] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:27.235095 25343 leader_election.cc:304] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:27.269454 27319 raft_consensus.cc:3055] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:27.257622 27381 leader_election.cc:290] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:27.200202 25904 rpcz_store.cc:276] 0709 13:11:26.076106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:26.091714 (+ 15608us) service_pool.cc:224] Handling call
0709 13:11:27.122400 (+1030686us) spinlock_profiling.cc:243] Waited 4.46 ms on lock 0x7b58001a3198. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72cb4ab71 00007fd72cb4aa22 00007fd735a63c09 00007fd734bbdee0 00007fd734c870ab 00007fd734c87131 00007fd734c48fc0 00007fd734c33929 00007fd734c333d2 00007fd72e1aabd4
0709 13:11:27.147229 (+ 24829us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:27.147895 (+   666us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:27.148089 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10248960}
W20260709 13:11:27.262902 27525 log.cc:927] Time spent T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:11:27.240563 27537 raft_consensus.cc:515] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:27.259771 27395 leader_election.cc:290] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 5 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:27.265684 27531 log.cc:927] Time spent T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
W20260709 13:11:27.323232 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 238836us
I20260709 13:11:27.328719 25270 leader_election.cc:304] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:27.327540 25195 leader_election.cc:304] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
W20260709 13:11:27.330518 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 243207us
I20260709 13:11:27.271675 27031 raft_consensus.cc:2749] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:27.270134 27319 raft_consensus.cc:740] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:27.324844 27539 raft_consensus.cc:2804] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:27.331877 27395 raft_consensus.cc:493] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.336323 27542 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:27.379933 27545 log.cc:927] Time spent T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 13:11:27.380426 26964 leader_election.cc:290] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:27.380743 27538 log.cc:927] Time spent T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:11:27.380977 27544 raft_consensus.cc:493] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.320942 27117 consensus_queue.cc:1048] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:11:27.343436 27383 leader_election.cc:290] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:27.344051 27539 raft_consensus.cc:493] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:27.344534 26772 raft_consensus.cc:2749] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:27.383618 25374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56308 (request call id 292) took 1198 ms. Trace:
I20260709 13:11:27.397555 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:27.395509 27539 raft_consensus.cc:3060] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:27.398960 25378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36264 (request call id 1377) took 1064 ms. Trace:
I20260709 13:11:27.399353 25378 rpcz_store.cc:276] 0709 13:11:26.334249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:26.334978 (+   729us) service_pool.cc:224] Handling call
0709 13:11:26.335234 (+   256us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:26.351807 (+ 16573us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:26.351834 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:26.352236 (+   402us) log.cc:844] Serialized 26 byte log entry
0709 13:11:27.007503 (+655267us) spinlock_profiling.cc:243] Waited 2.48 ms on lock 0x7b1800369700. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72cb64e07 00007fd7359bfab9 00007fd72cb8169b 00007fd72cb7f93f 00007fd72cb81c02 00007fd72f80920b 00007fd72f80ed23 00007fd72f80f0d1 00007fd72fc2aa0f
0709 13:11:27.164494 (+156991us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:27.164534 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:27.164612 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:27.398653 (+234041us) raft_consensus.cc:1685] finished
0709 13:11:27.398674 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:27.398898 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20478,"raft.queue_time_us":20243,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":98,"spinlock_wait_cycles":5700480,"thread_start_us":156634,"threads_started":1,"wal-append.queue_time_us":893123}
W20260709 13:11:27.397957 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 70532.5us
I20260709 13:11:27.398130 27551 raft_consensus.cc:2804] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:27.402308 25195 leader_election.cc:304] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:27.402632 27551 raft_consensus.cc:493] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:27.403229 27551 raft_consensus.cc:3060] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:27.404217 27462 raft_consensus.cc:2804] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:27.404608 27462 raft_consensus.cc:493] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:27.404942 27462 raft_consensus.cc:3060] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:27.405409 27548 consensus_queue.cc:1048] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:27.406414 27313 consensus_queue.cc:1048] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:27.407572 25195 leader_election.cc:304] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:27.409379 27196 raft_consensus.cc:2804] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:27.409798 27196 raft_consensus.cc:493] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:27.410189 27196 raft_consensus.cc:3060] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:27.411496 27529 log.cc:927] Time spent T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 13:11:27.412883 25377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56308 (request call id 289) took 1228 ms. Trace:
I20260709 13:11:27.413129 27462 raft_consensus.cc:515] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:11:27.413239 25377 rpcz_store.cc:276] 0709 13:11:26.184254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:26.184729 (+   475us) service_pool.cc:224] Handling call
0709 13:11:26.191228 (+  6499us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:26.195930 (+  4702us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:26.195958 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:26.200735 (+  4777us) log.cc:844] Serialized 26 byte log entry
0709 13:11:26.284117 (+ 83382us) spinlock_profiling.cc:243] Waited 1.1 ms on lock 0x7b180046c720. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72cb64e07 00007fd7359bfab9 00007fd72cb8169b 00007fd72cb7f93f 00007fd72cb81c02 00007fd72f80920b 00007fd72f80ed23 00007fd72f80f0d1 00007fd72fc2aa0f
0709 13:11:26.533393 (+249276us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:26.533450 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:26.533541 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:27.412572 (+879031us) raft_consensus.cc:1685] finished
0709 13:11:27.412592 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:27.412820 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3337,"raft.queue_time_us":965,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":6059,"spinlock_wait_cycles":2540800,"thread_start_us":249037,"threads_started":1,"wal-append.queue_time_us":957836}
I20260709 13:11:27.415743 27462 leader_election.cc:290] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:27.394816 25374 rpcz_store.cc:276] 0709 13:11:26.185107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:26.192625 (+  7518us) service_pool.cc:224] Handling call
0709 13:11:26.195449 (+  2824us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:26.202087 (+  6638us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:26.202133 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:26.205664 (+  3531us) log.cc:844] Serialized 26 byte log entry
0709 13:11:26.999325 (+793661us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:27.265986 (+266661us) log.cc:844] Serialized 14 byte log entry
0709 13:11:27.383352 (+117366us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:27.383422 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:27.383465 (+    43us) raft_consensus.cc:1685] finished
0709 13:11:27.383476 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:27.383575 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":380292,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":90536,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":27275,"thread_start_us":715373,"threads_started":3,"wal-append.queue_time_us":782546}
I20260709 13:11:27.418426 27498 consensus_queue.cc:1048] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:27.419257 25899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50058 (request call id 560) took 1162 ms. Trace:
I20260709 13:11:27.419675 25899 rpcz_store.cc:276] 0709 13:11:26.256781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:26.256950 (+   169us) service_pool.cc:224] Handling call
0709 13:11:27.419062 (+1162112us) spinlock_profiling.cc:243] Waited 792 ms on lock 0x7b54003589d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:27.419197 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1820467968}
I20260709 13:11:27.420770 27516 leader_election.cc:290] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:27.381919 27322 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:27.419651 27462 consensus_queue.cc:1048] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:11:27.421603 27239 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:27.422778 27486 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:27.360742 27319 consensus_queue.cc:260] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:27.424508 27319 raft_consensus.cc:3060] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:27.424681 27196 raft_consensus.cc:515] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:27.427510 27462 raft_consensus.cc:493] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:27.428059 27462 raft_consensus.cc:515] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:27.429343 27196 leader_election.cc:290] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:27.429610 27517 leader_election.cc:290] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:27.429860 27322 raft_consensus.cc:493] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:27.430094 27462 leader_election.cc:290] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:27.387756 27395 raft_consensus.cc:515] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:27.432459 27322 raft_consensus.cc:515] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:27.430433 27539 raft_consensus.cc:515] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:27.432909 27544 raft_consensus.cc:515] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:27.433964 27395 leader_election.cc:290] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:27.431313 25300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57272 (request call id 1436) took 1317 ms. Trace:
I20260709 13:11:27.434649 27322 leader_election.cc:290] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:27.432685 27551 raft_consensus.cc:515] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:27.431787 25195 leader_election.cc:304] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:11:27.436381 27544 leader_election.cc:290] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:27.436950 27196 raft_consensus.cc:2804] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:27.388689 27542 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:27.437704 27196 raft_consensus.cc:697] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 6 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:27.439081 27196 consensus_queue.cc:237] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:27.391678 27117 consensus_queue.cc:1243] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer 6c4b021f3f9e41adb75e870a08ad88b6 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:11:27.434947 25300 rpcz_store.cc:276] 0709 13:11:26.113563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:26.113892 (+   329us) service_pool.cc:224] Handling call
0709 13:11:26.114168 (+   276us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:26.116725 (+  2557us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:26.116753 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:26.117263 (+   510us) log.cc:844] Serialized 52 byte log entry
0709 13:11:26.418006 (+300743us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:26.579316 (+161310us) log.cc:844] Serialized 14 byte log entry
0709 13:11:26.687335 (+108019us) spinlock_profiling.cc:243] Waited 2.32 ms on lock 0x7b180025fba0. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72cb823f3 00007fd72cb847c1 00007fd72cb84779 00007fd72cb84709 00007fd72cb846d1 00007fd72cb839cd 000000000038f354 000000000038f199 00007fd72cb6583a
0709 13:11:27.005905 (+318570us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:27.005982 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:27.400458 (+394476us) spinlock_profiling.cc:243] Waited 17.9 ms on lock 0x7b180025fba0. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72cb82522 00007fd72cb847c1 00007fd72cb84779 00007fd72cb84709 00007fd72cb846d1 00007fd72cb839cd 000000000038f354 000000000038f199 00007fd72cb6583a
0709 13:11:27.431093 (+ 30635us) raft_consensus.cc:1685] finished
0709 13:11:27.431116 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:27.431255 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5752,"prepare.queue_time_us":168480,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":11012,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":10044,"spinlock_wait_cycles":46402560,"thread_start_us":250988,"threads_started":1,"wal-append.queue_time_us":942604}
W20260709 13:11:27.441480 27490 log.cc:927] Time spent T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 1.512s	user 0.002s	sys 0.014s
I20260709 13:11:27.379317 27332 raft_consensus.cc:2804] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:11:27.445358 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 48411.6us
I20260709 13:11:27.449987 25194 leader_election.cc:304] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:11:27.454290 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 219258us
I20260709 13:11:27.455363 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:27.456051 25343 leader_election.cc:304] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:27.397946 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:27.398440 27002 leader_election.cc:290] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:27.459661 25302 raft_consensus.cc:2393] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 4: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:27.462206 27539 leader_election.cc:290] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:27.462714 27551 leader_election.cc:290] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:27.463225 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:27.469278 25297 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 5.
I20260709 13:11:27.471475 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:27.472488 25228 raft_consensus.cc:2368] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 5. Current term is 6.
I20260709 13:11:27.467299 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:27.474306 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:27.475222 25228 raft_consensus.cc:2368] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 4. Current term is 5.
I20260709 13:11:27.476178 25302 raft_consensus.cc:1275] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:11:27.476899 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:27.478621 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:27.482435 25302 raft_consensus.cc:1275] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:11:27.483407 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:27.439095 27542 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:27.453902 27332 raft_consensus.cc:493] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:27.485291 25302 pending_rounds.cc:85] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19: Aborting all ops after (but not including) 5
I20260709 13:11:27.486483 25230 raft_consensus.cc:2410] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:11:27.448719 27486 raft_consensus.cc:493] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:27.487278 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:27.508849 25228 raft_consensus.cc:2468] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 3.
I20260709 13:11:27.510259 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:27.510838 25297 raft_consensus.cc:3060] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:27.506419 27551 raft_consensus.cc:493] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:27.521234 27551 raft_consensus.cc:515] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:27.524873 25271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:27.457846 27462 raft_consensus.cc:2804] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:27.505218 25302 pending_rounds.cc:107] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:11:27.506837 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:27.507802 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:27.504541 27002 raft_consensus.cc:2804] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:11:27.540982 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:27.545581 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 64771.5us
I20260709 13:11:27.555627 25270 leader_election.cc:304] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:27.556978 25270 leader_election.cc:304] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:27.549716 25227 raft_consensus.cc:2393] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 5: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:27.539547 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:27.534734 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:27.532804 25296 raft_consensus.cc:2393] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 5: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:27.506511 27332 raft_consensus.cc:3060] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:27.550871 25302 raft_consensus.cc:2889] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:27.559234 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:27.560575 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:27.564709 25222 raft_consensus.cc:2393] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 5: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:27.571041 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:27.572036 25230 raft_consensus.cc:2468] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 4.
I20260709 13:11:27.571094 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:27.573035 25270 leader_election.cc:304] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:27.574546 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:27.540774 27551 leader_election.cc:290] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:27.576182 25302 raft_consensus.cc:2393] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 6: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:27.584995 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:27.585954 25226 raft_consensus.cc:1240] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:27.536464 27466 raft_consensus.cc:493] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.550750 27462 raft_consensus.cc:493] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:27.589774 25221 raft_consensus.cc:1275] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:11:27.520282 27486 raft_consensus.cc:515] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:27.558543 27313 raft_consensus.cc:493] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.561705 26772 raft_consensus.cc:2749] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:27.592191 25298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57272 (request call id 1428) took 2271 ms. Trace:
W20260709 13:11:27.574054 27552 log.cc:927] Time spent T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:11:27.597711 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:11:27.637909 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 82608.7us
I20260709 13:11:27.610745 27470 raft_consensus.cc:515] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:27.638334 25900 raft_consensus.cc:2393] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 5: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
W20260709 13:11:27.638788 25900 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50060 (request call id 384) took 1451 ms (client timeout 1515 ms). Trace:
W20260709 13:11:27.639163 25900 rpcz_store.cc:269] 0709 13:11:26.186975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:26.191138 (+  4163us) service_pool.cc:224] Handling call
0709 13:11:27.597553 (+1406415us) spinlock_profiling.cc:243] Waited 2.94 ms on lock 0x7b58001a3198. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72cb4ab71 00007fd72cb4aa22 00007fd735a63c09 00007fd734bbdee0 00007fd734c870ab 00007fd734c87131 00007fd734c350a0 00007fd734c34984 00007fd72e1af6d4 00007fd72e1af662
0709 13:11:27.638718 (+ 41165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6763264}
I20260709 13:11:27.599339 25225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54000 (request call id 322) took 1236 ms. Trace:
I20260709 13:11:27.535022 27115 raft_consensus.cc:493] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:27.639544 27313 raft_consensus.cc:515] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:27.640380 27115 raft_consensus.cc:515] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:27.640151 25225 rpcz_store.cc:276] 0709 13:11:26.362888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:26.363757 (+   869us) service_pool.cc:224] Handling call
0709 13:11:26.483172 (+119415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:27.086319 (+603147us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:11:27.086355 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:27.093916 (+  7561us) log.cc:844] Serialized 26 byte log entry
0709 13:11:27.598757 (+504841us) spinlock_profiling.cc:243] Waited 1.62 ms on lock 0x7b180036d000. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72f8174bc 00007fd72cb6548b 00007fd7359bfab9 00007fd72cb8169b 00007fd72cb7f93f 00007fd72cb81c02 00007fd72f80920b 00007fd72f80ed23 00007fd72f80f0d1
0709 13:11:27.598921 (+   164us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:27.598960 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:27.599033 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:27.599078 (+    45us) raft_consensus.cc:1685] finished
0709 13:11:27.599091 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:27.599281 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":636305,"raft.queue_time_us":603187,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":21413,"spinlock_wait_cycles":3723008,"thread_start_us":156173,"threads_started":1,"wal-append.queue_time_us":154618}
I20260709 13:11:27.641893 26964 raft_consensus.cc:493] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:27.642535 27115 leader_election.cc:290] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:27.642395 26964 raft_consensus.cc:515] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:27.642421 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:27.628405 25298 rpcz_store.cc:276] 0709 13:11:25.320768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:25.322412 (+  1644us) service_pool.cc:224] Handling call
0709 13:11:25.322853 (+   441us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:11:25.393801 (+ 70948us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:25.393850 (+    49us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:11:25.394582 (+   732us) log.cc:844] Serialized 78 byte log entry
0709 13:11:25.718601 (+324019us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:25.730861 (+ 12260us) log.cc:844] Serialized 14 byte log entry
0709 13:11:25.736399 (+  5538us) log.cc:844] Serialized 14 byte log entry
0709 13:11:26.062976 (+326577us) spinlock_profiling.cc:243] Waited 6.97 ms on lock 0x7b18003c0d60. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72cafcc0a 00007fd73623c219 00007fd72cb84a40 00007fd72cb7f4e4 00007fd72cb7f455 00007fd72fc67060 00007fd72fc79716 00007fd72fc8a287 00007fd72fc8a208
0709 13:11:26.063153 (+   177us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:26.063219 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:26.142734 (+ 79515us) spinlock_profiling.cc:243] Waited 8.49 ms on lock 0x7b18003c0d60. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72cb82522 00007fd72cb847c1 00007fd72cb84779 00007fd72cb84709 00007fd72cb846d1 00007fd72cb839cd 000000000038f354 000000000038f199 00007fd72cb6583a
0709 13:11:26.684873 (+542139us) spinlock_profiling.cc:243] Waited 4.18 ms on lock 0x7b48000438d8. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd734b98aa1 00007fd734b8fb37 00007fd734b8f9ca 00007fd734c8726f 00007fd734c86f37 00007fd734c9b55c 00007fd734c9b508 00007fd734c9b488 00007fd734c9b443 00007fd734c9a6ec 00007fd733bc4a96
0709 13:11:27.440765 (+755892us) spinlock_profiling.cc:243] Waited 2.74 ms on lock 0x7b4400022b4c. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72caa8c85 00007fd72caa96a2 00007fd72f81b1db 00007fd72f816aaf 00007fd72f80a86e 00007fd72f809bb6 00007fd72f8097d8 00007fd72f813221 00007fd72f8131d9 00007fd72f813169
0709 13:11:27.591985 (+151220us) raft_consensus.cc:1685] finished
0709 13:11:27.592006 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:27.592138 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":347471,"prepare.queue_time_us":418628,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":69,"raft.queue_time_us":379314,"raft.run_cpu_time_us":4827,"raft.run_wall_time_us":1332332,"spinlock_wait_cycles":51466496,"thread_start_us":252443,"threads_started":2,"wal-append.queue_time_us":374901}
I20260709 13:11:27.602845 25227 raft_consensus.cc:1275] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:27.554359 27002 raft_consensus.cc:493] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:27.574999 27553 consensus_queue.cc:1048] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:11:27.609267 27239 raft_consensus.cc:2749] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:27.609721 25270 leader_election.cc:304] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:27.579851 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:11:27.650964 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:27.651006 25270 leader_election.cc:304] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:27.651790 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:11:27.652412 25370 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36254 (request call id 1669) took 1910 ms (client timeout 1902 ms). Trace:
I20260709 13:11:27.652912 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:27.626210 25297 raft_consensus.cc:2468] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 5.
I20260709 13:11:27.631431 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:27.655618 25229 raft_consensus.cc:2468] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 3.
I20260709 13:11:27.656435 25874 leader_election.cc:304] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:27.656664 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:27.632130 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:27.634063 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:27.575223 27117 raft_consensus.cc:2749] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:27.652855 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:27.667191 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:27.667407 25908 raft_consensus.cc:2410] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:11:27.630219 27462 raft_consensus.cc:3060] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:27.630452 27466 raft_consensus.cc:515] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:27.676422 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:27.676527 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:27.677637 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:27.677852 27539 raft_consensus.cc:493] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.647109 27002 raft_consensus.cc:3060] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:27.678332 27539 raft_consensus.cc:515] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:27.666306 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:27.636700 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:27.681766 25230 raft_consensus.cc:2410] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:11:27.558921 27537 leader_election.cc:290] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:27.683887 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:27.643121 27486 leader_election.cc:290] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:27.684739 25222 raft_consensus.cc:2468] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 4.
I20260709 13:11:27.657635 25229 raft_consensus.cc:2393] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 6: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:27.660944 25128 catalog_manager.cc:5697] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 1 to 4, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 4 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
I20260709 13:11:27.685716 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:27.665200 25874 leader_election.cc:304] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
W20260709 13:11:27.652824 25370 rpcz_store.cc:269] 0709 13:11:25.739419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:25.740587 (+  1168us) service_pool.cc:224] Handling call
0709 13:11:27.649535 (+1908948us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b54001b5dd4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:27.649608 (+    73us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3181335424}
W20260709 13:11:27.675298 25908 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50060 (request call id 385) took 1482 ms (client timeout 1964 ms). Trace:
I20260709 13:11:27.686769 25298 raft_consensus.cc:2410] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:11:27.686681 25128 catalog_manager.cc:5697] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 2 to 4, leader changed from 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 4 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:27.687289 25908 rpcz_store.cc:269] 0709 13:11:26.193222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:26.193375 (+   153us) service_pool.cc:224] Handling call
0709 13:11:27.652695 (+1459320us) spinlock_profiling.cc:243] Waited 3.75 ms on lock 0x7b58001a3198. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72cb4ab71 00007fd72cb4aa22 00007fd735a63c09 00007fd734bbdee0 00007fd734c870ab 00007fd734c87131 00007fd734c350a0 00007fd734c34984 00007fd72e1af6d4 00007fd72e1af662
0709 13:11:27.675239 (+ 22544us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8616320}
I20260709 13:11:27.689579 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:27.689805 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:27.690445 25228 raft_consensus.cc:2410] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:11:27.694115 27486 raft_consensus.cc:493] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:27.694645 27486 raft_consensus.cc:515] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:27.696969 27486 leader_election.cc:290] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:27.666657 27544 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.697973 27395 raft_consensus.cc:2804] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:27.697714 27544 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:27.698381 27395 raft_consensus.cc:493] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:27.698800 27395 raft_consensus.cc:3060] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:27.699038 27407 leader_election.cc:290] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:27.699893 27544 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:27.666126 27031 raft_consensus.cc:2749] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:27.692595 25128 catalog_manager.cc:5697] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 1 to 3, leader changed from 79d99c0e498349bda74127365219e468 (127.23.140.67) to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 3 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:27.703529 27539 leader_election.cc:290] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:27.705547 25128 catalog_manager.cc:5697] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 1 to 4, leader changed from 79d99c0e498349bda74127365219e468 (127.23.140.67) to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 4 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:27.677703 27466 leader_election.cc:290] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:27.681111 27557 raft_consensus.cc:493] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:27.680840 27512 raft_consensus.cc:2804] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:27.682652 26772 raft_consensus.cc:2804] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:11:27.744760 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 88319.9us
I20260709 13:11:27.748028 25874 leader_election.cc:304] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:11:27.674008 27484 consensus_queue.cc:1048] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:11:27.751349 25907 raft_consensus.cc:1275] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:11:27.753531 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 105864us
I20260709 13:11:27.752627 25271 leader_election.cc:304] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:27.680976 27513 consensus_queue.cc:1048] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:11:27.758966 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:27.759161 25344 leader_election.cc:304] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:27.756151 25128 catalog_manager.cc:5697] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 3 to 4, leader changed from 79d99c0e498349bda74127365219e468 (127.23.140.67) to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 4 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:27.761174 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:27.762331 25298 raft_consensus.cc:2410] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:11:27.764076 25128 catalog_manager.cc:5697] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 1 to 4, leader changed from 79d99c0e498349bda74127365219e468 (127.23.140.67) to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 4 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:27.765841 26979 raft_consensus.cc:2804] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:27.770746 26979 raft_consensus.cc:493] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:27.765282 25128 catalog_manager.cc:5697] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 1 to 2, leader changed from 79d99c0e498349bda74127365219e468 (127.23.140.67) to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 2 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
I20260709 13:11:27.773738 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:27.771126 26979 raft_consensus.cc:3060] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:27.799945 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 145142us
I20260709 13:11:27.689564 27332 raft_consensus.cc:515] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:27.800868 25270 leader_election.cc:304] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:27.749123 27512 raft_consensus.cc:493] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:27.802032 25270 leader_election.cc:304] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:27.802295 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:27.803124 25298 raft_consensus.cc:2393] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 6: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:27.751672 26772 raft_consensus.cc:493] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:27.756346 27466 raft_consensus.cc:493] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:27.809500 25195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:27.758342 27539 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:27.745886 27239 consensus_queue.cc:1048] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 13:11:27.781275 27553 raft_consensus.cc:2749] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:11:27.821509 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 68938.7us
I20260709 13:11:27.823063 25375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36254 (request call id 1670) took 2082 ms. Trace:
I20260709 13:11:27.782089 27517 raft_consensus.cc:493] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:27.824141 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:27.830433 25298 raft_consensus.cc:2468] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 4.
I20260709 13:11:27.807634 27512 raft_consensus.cc:3060] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:27.810112 26772 raft_consensus.cc:3060] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:27.826584 25375 rpcz_store.cc:276] 0709 13:11:25.740869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:25.741535 (+   666us) service_pool.cc:224] Handling call
0709 13:11:25.760765 (+ 19230us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:25.772798 (+ 12033us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:25.772841 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:25.773294 (+   453us) log.cc:844] Serialized 26 byte log entry
0709 13:11:25.887499 (+114205us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:27.706465 (+1818966us) spinlock_profiling.cc:243] Waited 1.32 ms on lock 0x7b1800398da0. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72f8174bc 00007fd72cb6548b 00007fd7359bfab9 00007fd72cb8169b 00007fd72cb7f93f 00007fd72cb7f455 00007fd7336673c7 00007fd72fc799a7 00007fd72fc890bf
0709 13:11:27.741954 (+ 35489us) log.cc:844] Serialized 14 byte log entry
0709 13:11:27.810910 (+ 68956us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:27.810973 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:27.811007 (+    34us) raft_consensus.cc:1685] finished
0709 13:11:27.822795 (+ 11788us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:27.822988 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":72786,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":12419,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":28593,"spinlock_wait_cycles":3030400,"thread_start_us":200165,"threads_started":3,"wal-append.queue_time_us":176072,"wal-append.run_cpu_time_us":2791,"wal-append.run_wall_time_us":1338020}
I20260709 13:11:27.849205 27568 raft_consensus.cc:2804] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:27.849632 27568 raft_consensus.cc:493] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:27.850005 27568 raft_consensus.cc:3060] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:27.771204 27238 consensus_queue.cc:1048] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:11:27.745002 27557 raft_consensus.cc:515] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:27.893546 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:27.847868 27556 raft_consensus.cc:493] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:27.827522 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:27.821820 27466 raft_consensus.cc:515] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:27.856678 27031 raft_consensus.cc:2749] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:27.948289 27031 raft_consensus.cc:493] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:27.890884 27484 consensus_queue.cc:1048] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:11:27.856980 27564 raft_consensus.cc:2804] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:27.949477 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:27.956105 25906 raft_consensus.cc:2393] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 5: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:11:27.952764 25907 raft_consensus.cc:2468] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 5.
I20260709 13:11:27.890164 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:27.828606 27539 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:27.848515 27565 consensus_queue.cc:1059] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.120s
I20260709 13:11:27.897027 27516 raft_consensus.cc:493] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.848209 27517 raft_consensus.cc:515] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:27.946533 27458 raft_consensus.cc:493] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
W20260709 13:11:27.950822 27562 log.cc:927] Time spent T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:11:27.959256 27564 raft_consensus.cc:493] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:27.953394 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:27.968515 27551 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.950012 27322 consensus_queue.cc:1048] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.028s
W20260709 13:11:27.979898 27523 log.cc:927] Time spent T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 13:11:27.967960 27031 raft_consensus.cc:515] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:27.995432 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:11:27.993882 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 166876us
W20260709 13:11:27.980355 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 178390us
I20260709 13:11:28.052495 26772 raft_consensus.cc:515] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:28.053910 25270 leader_election.cc:304] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:28.055135 25271 leader_election.cc:304] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:28.006192 27551 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:27.959511 25899 raft_consensus.cc:2468] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 8.
I20260709 13:11:27.978412 26964 leader_election.cc:290] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:27.987525 27313 leader_election.cc:290] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:27.954972 27556 raft_consensus.cc:515] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:28.064877 26772 leader_election.cc:290] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:28.067509 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 119696us
W20260709 13:11:28.067597 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 381801us
I20260709 13:11:27.987052 27238 raft_consensus.cc:493] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:27.980813 27564 raft_consensus.cc:3060] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:28.008637 27549 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:28.050424 27498 raft_consensus.cc:493] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:28.050323 27537 raft_consensus.cc:493] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:28.081564 27561 raft_consensus.cc:493] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.084062 27517 leader_election.cc:290] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:28.086869 26772 raft_consensus.cc:2749] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:27.980333 27516 raft_consensus.cc:515] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:28.070186 26964 raft_consensus.cc:3055] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:27.980592 27458 raft_consensus.cc:515] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:28.106243 25305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57272 (request call id 1435) took 1996 ms. Trace:
I20260709 13:11:28.058029 27002 raft_consensus.cc:515] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:28.114816 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 64202.8us
W20260709 13:11:28.115536 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:28.117457 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:28.120616 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 66868.7us
I20260709 13:11:28.092629 27554 raft_consensus.cc:493] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:28.121793 25270 leader_election.cc:304] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:28.061893 26979 raft_consensus.cc:515] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:28.106748 25305 rpcz_store.cc:276] 0709 13:11:26.109600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:26.113180 (+  3580us) service_pool.cc:224] Handling call
0709 13:11:26.120346 (+  7166us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:26.129557 (+  9211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:26.129589 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:26.130056 (+   467us) log.cc:844] Serialized 26 byte log entry
0709 13:11:27.595993 (+1465937us) spinlock_profiling.cc:243] Waited 17.5 ms on lock 0x7b180023be40. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72f8174bc 00007fd72cb6548b 00007fd7359bfab9 00007fd72cb8169b 00007fd72cb7f93f 00007fd72cb81c02 00007fd72f80920b 00007fd72f80ed23 00007fd72f80f0d1
0709 13:11:27.596140 (+   147us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:27.596178 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:27.596248 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:27.706430 (+110182us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b180023be40. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72cb823f3 00007fd72cb847c1 00007fd72cb84779 00007fd72cb84709 00007fd72cb846d1 00007fd72cb839cd 000000000038f354 000000000038f199 00007fd72cb6583a
0709 13:11:28.105991 (+399561us) raft_consensus.cc:1685] finished
0709 13:11:28.106020 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:28.106173 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8871,"raft.queue_time_us":10205,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":19193,"spinlock_wait_cycles":64238336,"thread_start_us":27185,"threads_started":1,"wal-append.queue_time_us":27505}
I20260709 13:11:28.086956 27238 raft_consensus.cc:515] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:28.104584 26964 raft_consensus.cc:740] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
W20260709 13:11:28.140683 27574 log.cc:927] Time spent T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:11:28.141783 27185 raft_consensus.cc:493] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.142344 27185 raft_consensus.cc:515] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:28.143224 27472 raft_consensus.cc:493] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.143841 27472 raft_consensus.cc:515] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:28.145587 27031 leader_election.cc:290] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:28.146602 25301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57256 (request call id 1539) took 1908 ms. Trace:
W20260709 13:11:28.146951 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 91910.3us
I20260709 13:11:28.147008 25301 rpcz_store.cc:276] 0709 13:11:26.240066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:26.240176 (+   110us) service_pool.cc:224] Handling call
0709 13:11:26.240486 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:26.345079 (+104593us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:28.146323 (+1801244us) spinlock_profiling.cc:243] Waited 60.2 ms on lock 0x7b54001e8f54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:28.146534 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":138379648}
I20260709 13:11:28.147732 25270 leader_election.cc:304] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:28.132560 25345 leader_election.cc:400] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 election: Vote denied by peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361) with higher term. Message: Invalid argument: T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 5. Current term is 6.
I20260709 13:11:28.101130 27576 raft_consensus.cc:493] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:28.114866 27577 raft_consensus.cc:2749] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:28.151268 25345 leader_election.cc:400] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361) with higher term. Message: Invalid argument: T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 4. Current term is 5.
I20260709 13:11:28.096841 27537 raft_consensus.cc:515] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:28.153625 25345 leader_election.cc:403] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:28.124565 27332 leader_election.cc:290] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:28.157425 25345 leader_election.cc:304] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:28.095393 27568 raft_consensus.cc:515] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:28.134209 27544 raft_consensus.cc:493] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:28.097055 27561 raft_consensus.cc:515] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:28.170893 27458 leader_election.cc:290] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:28.094682 27498 raft_consensus.cc:515] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:28.171741 27395 raft_consensus.cc:515] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:28.173503 27002 leader_election.cc:290] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:28.173214 27462 raft_consensus.cc:515] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:28.095223 27549 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:28.173739 27470 leader_election.cc:290] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:28.212587 26979 leader_election.cc:290] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 5 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:28.213551 27472 leader_election.cc:290] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:28.214425 27549 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:28.215058 25225 raft_consensus.cc:1240] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:28.152752 27512 raft_consensus.cc:515] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:28.146188 27031 consensus_queue.cc:1048] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:11:28.211297 27238 leader_election.cc:290] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:28.211967 27556 leader_election.cc:290] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:28.125730 27554 raft_consensus.cc:515] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:28.212148 27462 leader_election.cc:290] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:28.227428 25298 raft_consensus.cc:1240] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 5. Current term is 6. Ops: []
W20260709 13:11:28.229475 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 61640.7us
I20260709 13:11:28.233204 25345 leader_election.cc:304] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:28.157298 27576 raft_consensus.cc:515] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:28.234041 27551 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:28.235051 25345 leader_election.cc:304] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:28.235777 27576 leader_election.cc:290] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:28.235842 27556 raft_consensus.cc:2749] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:28.236634 27556 raft_consensus.cc:3060] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:28.160234 27553 raft_consensus.cc:2749] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361) with higher term. Message: Invalid argument: T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 4. Current term is 5.
I20260709 13:11:28.233789 27238 consensus_queue.cc:1048] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:28.235790 27404 raft_consensus.cc:3060] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:28.238492 27568 leader_election.cc:290] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:28.217486 26964 consensus_queue.cc:260] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:28.244240 27561 leader_election.cc:290] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:28.244468 27556 raft_consensus.cc:2749] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:28.246227 27539 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:28.247695 27537 leader_election.cc:290] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:28.247627 27564 raft_consensus.cc:515] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:28.249548 27516 leader_election.cc:290] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:28.249617 27498 leader_election.cc:290] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:28.205120 27544 raft_consensus.cc:515] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:28.252002 27512 leader_election.cc:290] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:28.253676 27544 leader_election.cc:290] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:28.255998 25345 leader_election.cc:304] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:28.205616 27577 raft_consensus.cc:2749] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:28.205006 27332 raft_consensus.cc:2749] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:11:28.336800 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 53107.6us
W20260709 13:11:28.338320 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 188782us
W20260709 13:11:28.356724 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 305567us
W20260709 13:11:28.359285 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 208330us
I20260709 13:11:28.364295 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:28.365144 25229 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 4.
I20260709 13:11:28.365432 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:28.394397 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:28.396669 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:28.397343 25230 raft_consensus.cc:3060] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:28.402527 25224 raft_consensus.cc:2410] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:11:28.416422 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:28.417299 25227 raft_consensus.cc:2468] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 6.
I20260709 13:11:28.427027 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:28.335898 27002 raft_consensus.cc:2749] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:28.434937 25195 leader_election.cc:304] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:11:28.427865 25299 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 4.
W20260709 13:11:28.435685 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 179772us
I20260709 13:11:28.436582 25345 leader_election.cc:304] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:28.435158 25270 leader_election.cc:304] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
W20260709 13:11:28.401051 27434 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.014s	sys 0.028s
I20260709 13:11:28.426334 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:28.397861 27583 raft_consensus.cc:493] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:28.452948 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:28.452907 25270 leader_election.cc:304] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:28.451664 25345 leader_election.cc:304] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:28.412056 27370 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.455586 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:28.457113 25229 raft_consensus.cc:2468] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 5.
I20260709 13:11:28.417711 27564 leader_election.cc:290] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:28.458323 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:28.454746 25270 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
W20260709 13:11:28.450767 27434 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.015s	sys 0.028s
I20260709 13:11:28.453962 25300 raft_consensus.cc:2468] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 3.
I20260709 13:11:28.469090 25229 raft_consensus.cc:2468] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 5.
I20260709 13:11:28.460150 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:28.456053 27134 raft_consensus.cc:2804] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:28.470757 27554 leader_election.cc:290] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:28.470700 27590 raft_consensus.cc:2749] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:28.481066 27134 raft_consensus.cc:493] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:28.485328 27134 raft_consensus.cc:3060] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:28.449594 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:28.460454 27370 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:28.478850 25345 leader_election.cc:304] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:28.492286 25345 leader_election.cc:304] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:28.493697 25345 leader_election.cc:304] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:28.453148 27578 raft_consensus.cc:2804] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:28.453624 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:28.482921 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:28.480619 27002 raft_consensus.cc:2749] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:28.472149 25270 leader_election.cc:304] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:28.481082 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:28.508324 25229 raft_consensus.cc:3060] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:28.508437 25270 leader_election.cc:304] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:28.456648 27568 raft_consensus.cc:2804] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:28.452879 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:28.495997 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:28.514622 25270 leader_election.cc:304] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:28.499025 25345 leader_election.cc:304] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:28.501587 27332 raft_consensus.cc:2749] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:28.502621 27554 raft_consensus.cc:2749] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:28.504926 27592 raft_consensus.cc:2804] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:28.452620 27544 raft_consensus.cc:2749] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:28.517066 25345 leader_election.cc:304] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:28.524040 25229 raft_consensus.cc:2468] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 4.
I20260709 13:11:28.515049 27568 raft_consensus.cc:493] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:28.525290 25227 raft_consensus.cc:2393] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 5: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:28.458724 27583 raft_consensus.cc:515] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:28.567874 25230 raft_consensus.cc:2468] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 4.
I20260709 13:11:28.598349 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:11:28.597774 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 80781us
W20260709 13:11:28.565563 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 51015.1us
I20260709 13:11:28.516201 27590 raft_consensus.cc:2749] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:28.573889 27564 raft_consensus.cc:2749] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:28.478415 25899 raft_consensus.cc:1240] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:28.596683 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:28.597162 25874 leader_election.cc:304] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:11:28.598433 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:28.612195 25229 raft_consensus.cc:3060] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:28.599575 25345 leader_election.cc:304] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:28.599862 25270 leader_election.cc:304] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:28.525494 27598 raft_consensus.cc:2749] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:28.604043 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:28.515784 25296 raft_consensus.cc:2468] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 5.
I20260709 13:11:28.604076 27002 raft_consensus.cc:2749] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:28.618086 25227 raft_consensus.cc:3060] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:28.618520 25230 raft_consensus.cc:2393] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 4: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:11:28.582674 27486 raft_consensus.cc:2749] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:28.621477 25345 leader_election.cc:304] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:28.624235 25905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50056 (request call id 466) took 2284 ms. Trace:
W20260709 13:11:28.624532 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.625497 25345 leader_election.cc:304] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:28.623860 27544 raft_consensus.cc:2749] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:28.596609 27592 raft_consensus.cc:493] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:28.655491 25227 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 6.
I20260709 13:11:28.635185 25229 raft_consensus.cc:2468] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 5.
I20260709 13:11:28.646533 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:28.624585 25905 rpcz_store.cc:276] 0709 13:11:26.334916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:26.335023 (+   107us) service_pool.cc:224] Handling call
0709 13:11:26.335234 (+   211us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:28.481139 (+2145905us) spinlock_profiling.cc:243] Waited 2.77 ms on lock 0x7b2c0014a1e8. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72df1f291 00007fd72df3a0ca 00007fd72fc684ad 00007fd72fc6ee1b 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2
0709 13:11:28.481233 (+    94us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:11:28.486588 (+  5355us) log.cc:844] Serialized 14 byte log entry
0709 13:11:28.618236 (+131648us) log.cc:844] Serialized 14 byte log entry
0709 13:11:28.618715 (+   479us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:28.618800 (+    85us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:28.618912 (+   112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:28.618998 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:28.619375 (+   377us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":8595,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":58,"raft.queue_time_us":266,"spinlock_wait_cycles":13750528,"thread_start_us":130380,"threads_started":1}
I20260709 13:11:28.657608 25874 leader_election.cc:304] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:11:28.595757 27576 raft_consensus.cc:493] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:28.605250 27568 raft_consensus.cc:3060] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:28.661433 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:28.596390 27577 raft_consensus.cc:2749] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:28.634989 25345 leader_election.cc:304] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:28.662705 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:28.619905 27542 raft_consensus.cc:493] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:28.680579 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:28.667675 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:28.623974 27571 raft_consensus.cc:2804] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:28.692616 25227 raft_consensus.cc:2468] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 4.
I20260709 13:11:28.634249 27537 raft_consensus.cc:2749] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:11:28.694096 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 59269.3us
I20260709 13:11:28.660811 27590 raft_consensus.cc:2749] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:28.697398 25345 leader_election.cc:304] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:28.661726 27486 raft_consensus.cc:2804] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:28.660504 27592 raft_consensus.cc:3060] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:28.664865 27516 raft_consensus.cc:2804] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:28.711678 25345 leader_election.cc:304] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:28.698169 27544 raft_consensus.cc:2804] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:28.697083 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:28.665257 27576 raft_consensus.cc:515] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:28.701596 27571 raft_consensus.cc:697] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:28.703977 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:28.718257 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:28.715610 25345 leader_election.cc:304] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
W20260709 13:11:28.723429 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 123627us
I20260709 13:11:28.725368 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
W20260709 13:11:28.726179 27600 log.cc:927] Time spent T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
W20260709 13:11:28.726918 27601 log.cc:927] Time spent T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:11:28.704476 27486 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:28.730145 25270 leader_election.cc:304] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:28.699851 27542 raft_consensus.cc:515] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:28.734546 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:28.716180 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:28.724203 27332 raft_consensus.cc:2804] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:28.740903 25270 leader_election.cc:304] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:28.718278 27544 raft_consensus.cc:493] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:28.719781 27554 raft_consensus.cc:2804] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:28.742668 25378 raft_consensus.cc:2468] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 5.
I20260709 13:11:28.760510 25270 leader_election.cc:304] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:28.760407 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:28.761178 25378 raft_consensus.cc:2468] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 3.
I20260709 13:11:28.762140 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:28.733269 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:28.746862 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:28.763422 25370 raft_consensus.cc:3060] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:28.763551 25371 raft_consensus.cc:2468] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 4.
I20260709 13:11:28.734545 27537 raft_consensus.cc:2804] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:28.747989 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:28.750018 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:28.750185 27571 consensus_queue.cc:237] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:28.771948 25377 raft_consensus.cc:3060] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:28.772086 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:28.750602 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:28.772953 25378 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 4.
I20260709 13:11:28.773135 25379 raft_consensus.cc:3060] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:28.752583 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:28.744168 27564 raft_consensus.cc:2804] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:28.723961 27516 raft_consensus.cc:697] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:28.755931 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:28.768201 25270 leader_election.cc:304] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:28.741712 27486 raft_consensus.cc:3060] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:28.783571 25371 raft_consensus.cc:1275] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:28.778726 25378 raft_consensus.cc:1240] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:28.759151 27544 raft_consensus.cc:3060] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:28.787060 25906 raft_consensus.cc:1275] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:11:28.759402 27554 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:28.786170 27598 raft_consensus.cc:2804] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:28.794549 27583 leader_election.cc:290] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:28.778239 27584 raft_consensus.cc:2804] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:28.780092 27590 consensus_queue.cc:1048] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:11:28.792210 25370 raft_consensus.cc:2468] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 6.
I20260709 13:11:28.807838 27466 leader_election.cc:290] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:28.765182 27332 raft_consensus.cc:697] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 4 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:28.810892 25377 raft_consensus.cc:2468] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 5.
I20260709 13:11:28.770744 27537 raft_consensus.cc:493] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:28.822186 25379 raft_consensus.cc:2468] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 6.
I20260709 13:11:28.779778 27564 raft_consensus.cc:493] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:28.779354 27610 raft_consensus.cc:2804] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:28.811689 27554 raft_consensus.cc:3060] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:28.816937 27598 raft_consensus.cc:493] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:28.825978 27584 raft_consensus.cc:493] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:28.832424 27537 raft_consensus.cc:3060] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:28.867475 25224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58422 (request call id 1600) took 1219 ms. Trace:
I20260709 13:11:28.867689 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:28.829886 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:28.877785 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:28.868610 27134 raft_consensus.cc:515] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:28.878260 27512 consensus_queue.cc:1048] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:28.879012 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:28.869072 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:28.870077 27516 consensus_queue.cc:237] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:28.879873 27134 leader_election.cc:290] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:28.880769 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:11:28.860855 25270 connection.cc:256] RPC call timeout handler was delayed by -1.125389843999983s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15860000000000002s for a response
I20260709 13:11:28.868372 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:28.830439 27565 raft_consensus.cc:493] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:28.874809 25224 rpcz_store.cc:276] 0709 13:11:27.648125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:27.677406 (+ 29281us) service_pool.cc:224] Handling call
0709 13:11:28.867267 (+1189861us) spinlock_profiling.cc:243] Waited 724 ms on lock 0x7b5400421b54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:28.867416 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1664917248}
I20260709 13:11:28.875120 25379 raft_consensus.cc:2468] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 6.
I20260709 13:11:28.838939 27564 raft_consensus.cc:3060] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:28.879894 25378 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 2.
I20260709 13:11:28.884654 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:28.885028 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:28.872879 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:28.882889 25270 leader_election.cc:304] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:28.833869 27610 raft_consensus.cc:493] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:28.890264 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:28.886737 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:28.890400 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:28.952275 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:28.952862 25371 raft_consensus.cc:2468] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 5.
I20260709 13:11:28.953488 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:28.876113 27584 raft_consensus.cc:3060] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:28.954623 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:28.954622 25378 raft_consensus.cc:2468] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 4.
I20260709 13:11:28.960414 25297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57256 (request call id 1544) took 1315 ms. Trace:
I20260709 13:11:28.960712 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:11:28.956764 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 80025.7us
I20260709 13:11:28.960772 25297 rpcz_store.cc:276] 0709 13:11:27.644681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:27.654971 (+ 10290us) service_pool.cc:224] Handling call
0709 13:11:28.949662 (+1294691us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b5800114098. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72cb4ab71 00007fd72cb4aa22 00007fd735a63c09 00007fd734bbdee0 00007fd734c870ab 00007fd734c87131 00007fd734c350a0 00007fd734c34984 00007fd72e1af6d4 00007fd72e1af662
0709 13:11:28.960364 (+ 10702us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29857152}
I20260709 13:11:28.872527 27576 leader_election.cc:290] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:28.874774 27598 raft_consensus.cc:3060] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:28.962342 25872 leader_election.cc:304] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:28.911509 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:28.975239 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:28.984229 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:28.984683 25872 leader_election.cc:304] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:28.882077 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:11:28.936878 27536 log.cc:927] Time spent T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 1.698s	user 0.005s	sys 0.000s
I20260709 13:11:28.875977 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:28.984844 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:28.971648 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:28.882054 27329 consensus_queue.cc:1048] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.101s
I20260709 13:11:28.985821 27622 raft_consensus.cc:3060] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:28.924350 27590 raft_consensus.cc:2749] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:28.989349 25378 raft_consensus.cc:2393] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 5: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:28.923197 27332 consensus_queue.cc:237] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:28.992871 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:28.993613 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:28.993901 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:28.987004 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:28.994485 25902 raft_consensus.cc:3060] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:28.994809 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:28.995618 25221 raft_consensus.cc:1240] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:11:28.987322 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:11:29.003579 27611 log.cc:927] Time spent T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:11:28.960330 27610 raft_consensus.cc:3060] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:29.008337 27568 raft_consensus.cc:515] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:29.009434 25301 raft_consensus.cc:3060] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:29.012205 27486 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:28.888362 27565 raft_consensus.cc:515] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:28.979192 27476 raft_consensus.cc:3060] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:28.995956 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:29.016618 25301 raft_consensus.cc:2468] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 4.
I20260709 13:11:29.025743 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:29.028796 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:28.989136 27516 raft_consensus.cc:2804] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:11:29.058014 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.099923 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:29.105463 25904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50060 (request call id 388) took 1285 ms. Trace:
I20260709 13:11:29.103686 27486 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:29.074265 25296 raft_consensus.cc:2393] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 5: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:11:29.061367 27516 raft_consensus.cc:697] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:29.099169 27537 raft_consensus.cc:515] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:29.114015 27466 raft_consensus.cc:493] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:29.124348 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:29.110644 27322 raft_consensus.cc:493] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.125742 27322 raft_consensus.cc:515] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:29.128098 27322 leader_election.cc:290] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:29.129148 27590 consensus_queue.cc:1059] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:29.109318 25904 rpcz_store.cc:276] 0709 13:11:27.819839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:27.822161 (+  2322us) service_pool.cc:224] Handling call
0709 13:11:27.882594 (+ 60433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:28.056386 (+173792us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:28.059615 (+  3229us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:28.064803 (+  5188us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:28.067623 (+  2820us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:29.105116 (+1037493us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b54003570d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:29.105185 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:29.105389 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":282278272}
I20260709 13:11:29.106112 27565 leader_election.cc:290] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:29.130272 27576 raft_consensus.cc:3055] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:29.130635 27576 raft_consensus.cc:740] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:29.132558 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:29.118654 27554 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:29.138731 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 152951us
I20260709 13:11:29.139849 25370 raft_consensus.cc:2393] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 5: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:29.140486 27576 consensus_queue.cc:260] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:29.142341 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:29.143368 25378 raft_consensus.cc:1275] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:29.147326 27576 raft_consensus.cc:3060] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:29.147804 27516 consensus_queue.cc:237] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:29.152377 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:29.154915 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:29.155114 25377 raft_consensus.cc:2393] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 6: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:29.154379 27622 raft_consensus.cc:2749] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:29.157950 25906 raft_consensus.cc:2468] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 6.
I20260709 13:11:29.158772 25223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1586) took 1575 ms. Trace:
I20260709 13:11:29.159173 25223 rpcz_store.cc:276] 0709 13:11:27.583168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:27.583371 (+   203us) service_pool.cc:224] Handling call
0709 13:11:27.583751 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:27.644550 (+ 60799us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:27.644580 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:27.644620 (+    40us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:27.644652 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:29.158545 (+1513893us) spinlock_profiling.cc:243] Waited 60.6 ms on lock 0x7b540024c554. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:29.158591 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:29.158717 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":139393792}
I20260709 13:11:29.160974 25906 raft_consensus.cc:1240] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 LEADER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:29.162653 26964 raft_consensus.cc:3060] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:29.163193 27610 raft_consensus.cc:515] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:29.165089 25907 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50056 (request call id 472) took 1391 ms (client timeout 1766 ms). Trace:
I20260709 13:11:29.165369 27610 leader_election.cc:290] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:29.171275 25906 pending_rounds.cc:85] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6: Aborting all ops after (but not including) 4
I20260709 13:11:29.172780 25906 pending_rounds.cc:107] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:11:29.173044 25906 raft_consensus.cc:2889] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:11:29.165539 25907 rpcz_store.cc:269] 0709 13:11:27.773265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:27.773480 (+   215us) service_pool.cc:224] Handling call
0709 13:11:29.164934 (+1391454us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b54006e1254. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:29.165034 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":409915264}
I20260709 13:11:29.171181 25195 leader_election.cc:304] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:29.175988 25195 leader_election.cc:304] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:29.176209 27369 raft_consensus.cc:2804] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:29.176744 27369 raft_consensus.cc:493] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:29.145963 27592 raft_consensus.cc:515] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:29.178802 25902 raft_consensus.cc:2468] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 5.
I20260709 13:11:29.135005 27466 raft_consensus.cc:515] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:29.179847 27322 raft_consensus.cc:2804] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:29.180298 27322 raft_consensus.cc:493] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:29.180683 27322 raft_consensus.cc:3060] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:29.181468 27466 leader_election.cc:290] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:29.184502 27598 raft_consensus.cc:515] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:29.170192 25296 raft_consensus.cc:3060] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:29.189893 27613 log.cc:927] Time spent T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.360s	user 0.001s	sys 0.005s
I20260709 13:11:29.191388 27185 leader_election.cc:290] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:29.177546 25195 leader_election.cc:304] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:29.185497 25270 leader_election.cc:304] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:29.193650 26772 raft_consensus.cc:2749] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:29.196640 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:29.197224 25375 raft_consensus.cc:3060] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:29.198788 27537 leader_election.cc:290] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:29.199009 27602 log.cc:927] Time spent T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.494s	user 0.004s	sys 0.000s
I20260709 13:11:29.195178 27499 raft_consensus.cc:2804] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:29.200652 27592 leader_election.cc:290] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:29.200582 27499 raft_consensus.cc:493] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:29.150483 27564 raft_consensus.cc:515] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:29.202034 25270 leader_election.cc:304] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:29.203797 26772 raft_consensus.cc:2749] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:29.204222 25270 leader_election.cc:304] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:29.177222 27369 raft_consensus.cc:3060] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:29.203711 27499 raft_consensus.cc:3060] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:29.209949 25270 leader_election.cc:304] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:29.210960 25873 leader_election.cc:304] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:29.202226 25229 raft_consensus.cc:1240] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:29.213419 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:29.211521 25270 leader_election.cc:304] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:29.220395 26772 raft_consensus.cc:2804] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:29.220790 26772 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:29.221184 26772 raft_consensus.cc:3060] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:29.215289 25375 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 6.
I20260709 13:11:29.223183 25195 leader_election.cc:304] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:29.224386 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:29.226562 25195 leader_election.cc:304] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:29.213164 27239 raft_consensus.cc:2749] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:29.203588 27546 raft_consensus.cc:493] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:29.169431 27544 raft_consensus.cc:515] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:29.228972 25375 raft_consensus.cc:2410] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for term 7 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:11:29.228758 25270 leader_election.cc:304] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:29.235610 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:29.216617 27610 raft_consensus.cc:2749] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:29.229813 27233 raft_consensus.cc:2804] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:29.237519 27239 consensus_queue.cc:1059] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:11:29.238416 27239 raft_consensus.cc:3055] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:29.233392 27589 consensus_queue.cc:1059] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:11:29.238848 27239 raft_consensus.cc:740] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:29.239725 27239 consensus_queue.cc:260] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:29.233687 27313 raft_consensus.cc:2804] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:29.240896 27239 raft_consensus.cc:3060] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:29.241176 27313 raft_consensus.cc:697] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 6 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:29.242084 27313 consensus_queue.cc:237] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:29.244601 27542 leader_election.cc:290] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:29.246347 27590 raft_consensus.cc:2804] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:29.246685 27554 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:29.246905 27589 raft_consensus.cc:3055] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:29.246961 27590 raft_consensus.cc:697] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 5 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:29.247505 27589 raft_consensus.cc:740] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:29.247270 27583 consensus_queue.cc:1048] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:29.260659 27590 consensus_queue.cc:237] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:29.261139 27589 consensus_queue.cc:260] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:29.249055 25873 leader_election.cc:304] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:29.262351 27589 raft_consensus.cc:3060] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:29.262725 27497 raft_consensus.cc:2804] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:29.195336 27584 raft_consensus.cc:515] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:29.263330 27497 raft_consensus.cc:697] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:29.265208 25299 raft_consensus.cc:2393] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 6: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:29.267225 25303 raft_consensus.cc:2468] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 6.
I20260709 13:11:29.268435 25379 raft_consensus.cc:2468] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 5.
I20260709 13:11:29.270141 26772 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:29.229622 27547 consensus_queue.cc:1048] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:11:29.230821 27630 raft_consensus.cc:2749] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:29.265836 27233 raft_consensus.cc:697] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 6 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:29.288269 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:29.274947 27620 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.284510 27598 leader_election.cc:290] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:29.299130 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 71041.3us
I20260709 13:11:29.300297 25195 leader_election.cc:304] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:29.234887 27546 raft_consensus.cc:515] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:29.303207 25195 leader_election.cc:304] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:29.305159 25300 raft_consensus.cc:2410] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:11:29.305279 25195 leader_election.cc:304] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:29.311160 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:29.311633 25374 raft_consensus.cc:2376] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 5. Re-sending same reply.
I20260709 13:11:29.264326 27497 consensus_queue.cc:237] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:29.319854 25303 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57272 (request call id 1442) took 2978 ms (client timeout 1753 ms). Trace:
W20260709 13:11:29.320391 25303 rpcz_store.cc:269] 0709 13:11:26.340941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:26.341035 (+    94us) service_pool.cc:224] Handling call
0709 13:11:29.319673 (+2978638us) spinlock_profiling.cc:243] Waited 2.89 s on lock 0x7b54000f9954. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:29.319778 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6647019776}
I20260709 13:11:29.321388 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:29.324090 25303 raft_consensus.cc:2393] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 4: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:29.322714 25302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57272 (request call id 1450) took 1678 ms. Trace:
I20260709 13:11:29.324776 25302 rpcz_store.cc:276] 0709 13:11:27.643881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:27.663948 (+ 20067us) service_pool.cc:224] Handling call
0709 13:11:29.322083 (+1658135us) spinlock_profiling.cc:243] Waited 4.07 ms on lock 0x7b5800114098. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72cb4ab71 00007fd72cb4aa22 00007fd735a63c09 00007fd734bbdee0 00007fd734c870ab 00007fd734c87131 00007fd734c48fc0 00007fd734c33929 00007fd734c333d2 00007fd72e1aabd4
0709 13:11:29.322247 (+   164us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:29.322412 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:29.322437 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:29.322479 (+    42us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:29.322515 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:29.322569 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:29.322664 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9363328}
I20260709 13:11:29.326161 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:29.329979 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:29.331023 27332 raft_consensus.cc:493] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.331502 27332 raft_consensus.cc:515] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:29.332979 25296 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 6.
I20260709 13:11:29.307397 27466 raft_consensus.cc:2804] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:29.334088 27466 raft_consensus.cc:493] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:29.334461 27466 raft_consensus.cc:3060] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:29.333664 27395 leader_election.cc:290] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 5 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:29.342058 27584 leader_election.cc:290] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:29.343286 27546 leader_election.cc:290] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:29.306418 27561 raft_consensus.cc:2804] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:29.310654 27313 raft_consensus.cc:2804] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:29.347831 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:29.350718 27322 raft_consensus.cc:515] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:29.351426 27544 leader_election.cc:290] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:29.352836 27322 leader_election.cc:290] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:29.352953 27499 raft_consensus.cc:515] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:29.300053 27620 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:29.353384 27233 consensus_queue.cc:237] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:11:29.354139 25297 raft_consensus.cc:2410] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:11:29.347046 27561 raft_consensus.cc:493] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:29.354902 27561 raft_consensus.cc:3060] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:29.358739 25302 raft_consensus.cc:2376] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 6. Re-sending same reply.
I20260709 13:11:29.359577 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:29.360667 25374 raft_consensus.cc:2468] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 4.
I20260709 13:11:29.361548 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:29.362731 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:29.363987 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:29.365017 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:29.365556 25374 raft_consensus.cc:3055] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:29.365986 25374 raft_consensus.cc:740] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:29.361263 27369 raft_consensus.cc:515] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:29.367523 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:29.368007 25303 raft_consensus.cc:2468] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 4.
I20260709 13:11:29.368443 25343 leader_election.cc:304] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:29.369985 25343 leader_election.cc:304] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:29.371796 25343 leader_election.cc:304] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:29.376166 25343 leader_election.cc:304] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:29.377976 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:29.378634 25303 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 4.
I20260709 13:11:29.379150 25343 leader_election.cc:304] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:29.374503 27383 raft_consensus.cc:2804] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:29.380272 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:29.382984 27383 raft_consensus.cc:493] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:29.383356 27383 raft_consensus.cc:3060] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:29.383479 27369 leader_election.cc:290] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:29.383957 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:29.386344 25296 raft_consensus.cc:2393] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 4: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:29.387286 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:29.387543 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:29.388151 25303 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 2.
I20260709 13:11:29.381096 25305 raft_consensus.cc:2393] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 5: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:29.388978 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:29.390233 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:29.390928 25305 raft_consensus.cc:2393] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 6: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:29.391607 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:29.392211 25305 raft_consensus.cc:2393] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 5: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:29.392900 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:29.393383 25305 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 2.
I20260709 13:11:29.380659 27537 raft_consensus.cc:2804] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:29.394110 27537 raft_consensus.cc:493] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:29.394450 27537 raft_consensus.cc:3060] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:29.394479 25296 raft_consensus.cc:2468] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 6.
I20260709 13:11:29.394867 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:29.395421 25900 raft_consensus.cc:1240] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:29.395843 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:29.396117 25378 raft_consensus.cc:1240] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:29.396869 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:29.397673 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:29.397899 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:29.398345 25900 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 3.
I20260709 13:11:29.398602 25370 raft_consensus.cc:2393] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 6: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:29.399364 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:29.399925 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:29.400496 25908 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 3.
I20260709 13:11:29.400485 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:29.359027 27313 raft_consensus.cc:493] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:29.398509 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:29.389737 25303 raft_consensus.cc:2410] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:11:29.402575 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:29.395406 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:29.403673 25343 leader_election.cc:304] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:29.366802 25374 consensus_queue.cc:260] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:29.405056 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:29.400267 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:29.405740 25874 leader_election.cc:304] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:29.407992 25378 raft_consensus.cc:1240] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:29.409734 25378 raft_consensus.cc:1240] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:11:29.410473 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:29.413089 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:29.413659 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:29.414358 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:29.498942 25370 raft_consensus.cc:3060] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:29.499760 25303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57256 (request call id 1556) took 1042 ms. Trace:
I20260709 13:11:29.500036 25303 rpcz_store.cc:276] 0709 13:11:28.457150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:29.499191 (+1042041us) service_pool.cc:224] Handling call
0709 13:11:29.499441 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:29.499568 (+   127us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:29.499583 (+    15us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:29.499610 (+    27us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:29.499633 (+    23us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:29.499664 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:29.499722 (+    58us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:29.501176 25303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57256 (request call id 1558) took 1017 ms. Trace:
I20260709 13:11:29.501381 25303 rpcz_store.cc:276] 0709 13:11:28.484238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:29.500659 (+1016421us) service_pool.cc:224] Handling call
0709 13:11:29.500869 (+   210us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:29.500971 (+   102us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:29.500986 (+    15us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:29.501010 (+    24us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:29.501027 (+    17us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:29.501057 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:29.501119 (+    62us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:29.410269 27002 consensus_queue.cc:1059] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:11:29.407675 27554 consensus_queue.cc:1059] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:11:29.417533 27497 raft_consensus.cc:2749] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:29.338871 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:29.407509 27313 raft_consensus.cc:3060] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:29.503575 25303 raft_consensus.cc:1240] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:29.429409 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:29.506114 25296 raft_consensus.cc:2468] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 6.
I20260709 13:11:29.506767 27370 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:29.432312 27548 consensus_queue.cc:1048] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:29.448287 25301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57256 (request call id 1550) took 1054 ms. Trace:
I20260709 13:11:29.508626 25301 rpcz_store.cc:276] 0709 13:11:28.393398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:28.397901 (+  4503us) service_pool.cc:224] Handling call
0709 13:11:29.448081 (+1050180us) spinlock_profiling.cc:243] Waited 559 ms on lock 0x7b54001e9e54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:29.448211 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1286262656}
I20260709 13:11:29.509881 25301 raft_consensus.cc:1240] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 2. Current term is 3. Ops: []
W20260709 13:11:29.510723 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 81569us
I20260709 13:11:29.464776 25300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57256 (request call id 1555) took 1010 ms. Trace:
I20260709 13:11:29.467368 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:29.468333 27561 raft_consensus.cc:515] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:29.468700 25226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54000 (request call id 331) took 1362 ms. Trace:
I20260709 13:11:29.466919 27499 leader_election.cc:290] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:29.476411 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.478382 27549 raft_consensus.cc:493] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:29.479527 27578 raft_consensus.cc:493] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:29.480110 25371 raft_consensus.cc:1240] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 13:11:29.472448 27631 log.cc:927] Time spent T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.336s	user 0.000s	sys 0.002s
I20260709 13:11:29.479813 27537 raft_consensus.cc:515] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:29.484797 25298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57272 (request call id 1453) took 1833 ms. Trace:
I20260709 13:11:29.425698 27466 raft_consensus.cc:515] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:29.481807 27564 leader_election.cc:290] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:29.407493 27486 raft_consensus.cc:2804] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:29.439225 27383 raft_consensus.cc:515] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:29.510973 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 106349us
I20260709 13:11:29.489497 27542 consensus_queue.cc:1059] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:29.511075 25301 raft_consensus.cc:1240] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:29.523496 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:29.522966 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:29.511299 25300 rpcz_store.cc:276] 0709 13:11:28.454259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:28.480290 (+ 26031us) service_pool.cc:224] Handling call
0709 13:11:29.464530 (+984240us) spinlock_profiling.cc:243] Waited 799 ms on lock 0x7b540018d8d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:29.464702 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1838342912}
I20260709 13:11:29.526110 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:29.523835 25370 raft_consensus.cc:2468] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 3.
I20260709 13:11:29.516286 25298 rpcz_store.cc:276] 0709 13:11:27.650976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:27.831174 (+180198us) service_pool.cc:224] Handling call
0709 13:11:27.862095 (+ 30921us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:28.232494 (+370399us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:29.484581 (+1252087us) spinlock_profiling.cc:243] Waited 365 ms on lock 0x7b540018ced4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:29.484742 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":839576320}
I20260709 13:11:29.511792 25226 rpcz_store.cc:276] 0709 13:11:28.106704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:28.106865 (+   161us) service_pool.cc:224] Handling call
0709 13:11:28.107165 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:28.217066 (+109901us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:11:28.396514 (+179448us) log.cc:844] Serialized 14 byte log entry
0709 13:11:28.487386 (+ 90872us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:28.487432 (+    46us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:28.487478 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:29.198457 (+710979us) spinlock_profiling.cc:243] Waited 2.1 ms on lock 0x7b4400022b4c. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72caa8c85 00007fd72caa96a2 00007fd72f81b1db 00007fd72f816aaf 00007fd72f80a86e 00007fd72f809bb6 00007fd72f8097d8 00007fd72f813221 00007fd72f8131d9 00007fd72f813169
0709 13:11:29.468425 (+269968us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b54000884d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:29.468484 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:29.468633 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":348506,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":41,"raft.queue_time_us":1740,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":13799,"spinlock_wait_cycles":257114112,"thread_start_us":232692,"threads_started":2,"wal-append.queue_time_us":227110}
I20260709 13:11:29.523559 25195 leader_election.cc:304] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:29.517800 27466 leader_election.cc:290] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:29.519649 27537 leader_election.cc:290] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:29.511593 25903 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 3.
I20260709 13:11:29.529357 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:29.513391 27561 leader_election.cc:290] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:29.549506 25195 leader_election.cc:304] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:29.513690 27578 raft_consensus.cc:3060] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:29.535190 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:29.535655 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:29.536278 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:29.537194 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:29.529963 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:29.547051 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:29.512773 27499 raft_consensus.cc:1064] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce: attempting to promote NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 to VOTER
I20260709 13:11:29.517704 27486 raft_consensus.cc:493] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:29.579103 27233 raft_consensus.cc:2804] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:29.519593 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:29.516031 27620 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:29.785058 25296 raft_consensus.cc:1240] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:29.672116 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:29.784649 25299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57256 (request call id 1559) took 1287 ms. Trace:
I20260709 13:11:29.745383 25194 leader_election.cc:304] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:11:29.778263 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 374785us
I20260709 13:11:29.787737 25299 rpcz_store.cc:276] 0709 13:11:28.497143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:28.752354 (+255211us) service_pool.cc:224] Handling call
0709 13:11:29.784377 (+1032023us) spinlock_profiling.cc:243] Waited 491 ms on lock 0x7b54001e8a54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:29.784570 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1129032576}
I20260709 13:11:29.659308 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:29.726353 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:29.686630 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:29.739517 25225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58418 (request call id 1629) took 1744 ms. Trace:
I20260709 13:11:29.579516 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:11:29.579236 25903 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50060 (request call id 390) took 1734 ms (client timeout 1543 ms). Trace:
I20260709 13:11:29.678191 25900 raft_consensus.cc:2393] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 5: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:11:29.513526 27549 raft_consensus.cc:515] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:29.670701 27580 raft_consensus.cc:2804] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:29.519204 27383 leader_election.cc:290] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:29.818034 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:11:29.682476 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 133041us
I20260709 13:11:29.820590 25195 leader_election.cc:304] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:29.822769 25195 leader_election.cc:304] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:29.787397 25223 raft_consensus.cc:3060] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:29.790937 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:29.676939 25303 raft_consensus.cc:1240] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:29.661633 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:29.824375 25229 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 2.
W20260709 13:11:29.648598 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.672717 27561 raft_consensus.cc:3060] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:29.779781 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 370220us
I20260709 13:11:29.791970 25225 rpcz_store.cc:276] 0709 13:11:27.994712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:27.997919 (+  3207us) service_pool.cc:224] Handling call
0709 13:11:28.056819 (+ 58900us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:28.215445 (+158626us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:29.739201 (+1523756us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b5400436054. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:29.739428 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":363439488}
I20260709 13:11:29.518507 27542 raft_consensus.cc:3055] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:29.799763 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:29.801059 27585 raft_consensus.cc:2749] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:29.715946 27557 leader_election.cc:290] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:29.800319 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:29.802793 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:29.845464 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:29.801651 27233 raft_consensus.cc:697] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 5 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:29.788970 25343 leader_election.cc:304] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:11:29.849141 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 60256us
I20260709 13:11:29.850652 25343 leader_election.cc:304] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:29.851879 25343 leader_election.cc:304] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:29.804132 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:29.852847 25299 raft_consensus.cc:2393] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 7: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:29.853790 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:29.854717 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:29.855326 25299 raft_consensus.cc:2393] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 6: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:29.804621 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:29.858421 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:29.807627 25228 raft_consensus.cc:2393] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 4: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:29.725641 25222 raft_consensus.cc:2468] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 6.
I20260709 13:11:29.859736 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:29.860461 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:29.860962 25222 raft_consensus.cc:3060] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:29.862846 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:29.864283 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:29.865417 25301 raft_consensus.cc:1275] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:11:29.819339 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:29.788594 27486 raft_consensus.cc:3060] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:29.793041 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 47755.2us
I20260709 13:11:29.874596 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:29.875607 25296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57272 (request call id 1468) took 1090 ms. Trace:
I20260709 13:11:29.875963 25296 rpcz_store.cc:276] 0709 13:11:28.784944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:29.507509 (+722565us) service_pool.cc:224] Handling call
0709 13:11:29.784856 (+277347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:29.786550 (+  1694us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:29.875420 (+ 88870us) spinlock_profiling.cc:243] Waited 277 ms on lock 0x7b54001e8a50. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6e8ad 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:29.875551 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":637140352}
I20260709 13:11:29.725935 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:29.715250 27568 leader_election.cc:290] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:29.831453 25195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.818885 25304 raft_consensus.cc:2468] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 5.
I20260709 13:11:29.562592 25899 raft_consensus.cc:2468] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 4.
I20260709 13:11:29.838217 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:29.837106 25373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36264 (request call id 1389) took 1100 ms. Trace:
W20260709 13:11:29.843598 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.845510 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:29.883370 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:29.883890 25375 raft_consensus.cc:3060] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:29.847771 27544 raft_consensus.cc:2749] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:29.882164 25373 rpcz_store.cc:276] 0709 13:11:28.736239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:28.736353 (+   114us) service_pool.cc:224] Handling call
0709 13:11:28.736615 (+   262us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:28.744720 (+  8105us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:28.744755 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:28.745195 (+   440us) log.cc:844] Serialized 26 byte log entry
0709 13:11:28.875192 (+129997us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:29.723118 (+847926us) spinlock_profiling.cc:243] Waited 2.35 ms on lock 0x7b1800285a60. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72cb64e07 00007fd7359bfab9 00007fd72cb8169b 00007fd72cb7f93f 00007fd72cb7f455 00007fd7336673c7 00007fd72fc799a7 00007fd72fc890bf 00007fd72fc89038
0709 13:11:29.825098 (+101980us) log.cc:844] Serialized 14 byte log entry
0709 13:11:29.835812 (+ 10714us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:29.836000 (+   188us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:29.836061 (+    61us) raft_consensus.cc:1685] finished
0709 13:11:29.836159 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:29.836379 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17892,"prepare.queue_time_us":57953,"prepare.run_cpu_time_us":6452,"prepare.run_wall_time_us":35163,"raft.queue_time_us":18350,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":10831,"spinlock_wait_cycles":5414656,"thread_start_us":184281,"threads_started":2,"wal-append.queue_time_us":155123}
I20260709 13:11:29.888347 26772 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:29.871222 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:29.857515 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:29.857508 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:29.886886 25194 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:29.873960 25226 raft_consensus.cc:2393] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 6: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:29.813103 25902 raft_consensus.cc:2468] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 6.
I20260709 13:11:29.817420 27580 raft_consensus.cc:493] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:29.667662 27313 raft_consensus.cc:515] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:29.825181 27597 raft_consensus.cc:2749] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:29.929549 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:29.839082 27192 raft_consensus.cc:3060] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:29.838095 27340 raft_consensus.cc:2749] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:29.838013 27542 raft_consensus.cc:740] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:29.893042 25222 raft_consensus.cc:2410] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:11:29.898962 25376 raft_consensus.cc:1240] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:11:29.902069 27644 raft_consensus.cc:2749] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:29.900199 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
W20260709 13:11:29.911177 27618 log.cc:927] Time spent T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:11:29.911607 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:29.912874 25229 raft_consensus.cc:2468] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 6.
I20260709 13:11:29.979008 25297 raft_consensus.cc:3060] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:29.979346 25376 raft_consensus.cc:1240] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:11:29.926471 25375 raft_consensus.cc:2468] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 4.
I20260709 13:11:29.927842 25195 leader_election.cc:304] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:29.930485 25227 raft_consensus.cc:1275] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:29.836377 27189 consensus_queue.cc:1059] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:11:29.930516 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
W20260709 13:11:29.986219 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 58478.7us
I20260709 13:11:29.986606 25225 raft_consensus.cc:2368] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for earlier term 3. Current term is 4.
I20260709 13:11:29.933123 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:29.987013 25195 leader_election.cc:304] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:11:29.807096 25903 rpcz_store.cc:269] 0709 13:11:27.844897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:27.847019 (+  2122us) service_pool.cc:224] Handling call
0709 13:11:29.467225 (+1620206us) spinlock_profiling.cc:243] Waited 8.15 ms on lock 0x7b58001a3198. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72cb4ae9c 00007fd72cb4aa5b 00007fd735a63c09 00007fd734bbdee0 00007fd734c870ab 00007fd734c87131 00007fd734c350a0 00007fd734c34984 00007fd72e1af6d4 00007fd72e1af662
0709 13:11:29.562944 (+ 95719us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18739968}
I20260709 13:11:29.934242 26772 raft_consensus.cc:493] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.987903 26772 raft_consensus.cc:515] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:29.937124 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 50322.3us
I20260709 13:11:29.899189 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:29.988921 25379 raft_consensus.cc:3060] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:29.888260 27407 raft_consensus.cc:2749] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:11:29.952543 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.995556 25376 raft_consensus.cc:1240] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 2. Current term is 3. Ops: []
W20260709 13:11:29.959534 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 57266.9us
I20260709 13:11:29.973850 25224 raft_consensus.cc:1240] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:29.915292 27592 raft_consensus.cc:2749] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:29.928224 27580 raft_consensus.cc:3060] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:29.988104 25195 leader_election.cc:304] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:29.936735 25226 raft_consensus.cc:1240] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:30.001732 25227 raft_consensus.cc:1240] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:29.939879 27622 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:29.973117 27404 raft_consensus.cc:2804] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:30.028854 25228 raft_consensus.cc:1240] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:30.036221 25379 raft_consensus.cc:2468] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 7.
I20260709 13:11:30.037282 25343 leader_election.cc:304] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:30.042659 25225 raft_consensus.cc:1275] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:11:29.991037 27322 raft_consensus.cc:2749] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:30.060541 25230 raft_consensus.cc:1240] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:30.028113 27404 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:30.065550 26772 leader_election.cc:290] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:30.050578 27592 raft_consensus.cc:2749] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:30.053364 27189 raft_consensus.cc:2749] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:30.073575 25297 raft_consensus.cc:2468] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 7.
W20260709 13:11:30.084887 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 256001us
I20260709 13:11:30.066087 27404 raft_consensus.cc:3060] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:30.043731 27589 consensus_queue.cc:1059] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:11:29.989984 27233 consensus_queue.cc:237] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:30.040053 27622 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:30.108201 27313 leader_election.cc:290] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:30.109014 25303 raft_consensus.cc:1275] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:11:30.110438 25303 raft_consensus.cc:1275] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:11:30.113682 25374 raft_consensus.cc:3060] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:30.115279 27192 raft_consensus.cc:2749] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:30.115929 25227 raft_consensus.cc:1240] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:30.120355 25374 raft_consensus.cc:2468] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 5.
W20260709 13:11:30.122119 27578 consensus_meta.cc:287] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.543s	user 0.000s	sys 0.009s
I20260709 13:11:30.122582 27578 raft_consensus.cc:515] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:30.123750 25299 raft_consensus.cc:1240] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:30.124874 27578 leader_election.cc:290] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:30.126617 27659 log.cc:927] Time spent T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:11:30.127388 27589 raft_consensus.cc:3055] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:30.127764 27589 raft_consensus.cc:740] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:30.128516 27589 consensus_queue.cc:260] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:30.053537 27542 consensus_queue.cc:260] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:30.123348 27656 log.cc:927] Time spent T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.313s	user 0.001s	sys 0.002s
I20260709 13:11:30.096948 27571 consensus_queue.cc:1059] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:11:30.134431 27332 leader_election.cc:290] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:30.105789 27549 leader_election.cc:290] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:30.129587 27589 raft_consensus.cc:3060] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:30.162055 25345 leader_election.cc:304] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:30.163925 25345 leader_election.cc:304] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:30.180593 25221 raft_consensus.cc:2468] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 5.
I20260709 13:11:30.195067 25345 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:30.196318 27480 raft_consensus.cc:2804] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:30.196813 27480 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:30.197160 27480 raft_consensus.cc:3060] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:30.197230 27648 consensus_queue.cc:1059] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:30.198553 27653 raft_consensus.cc:3055] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:30.199005 27653 raft_consensus.cc:740] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:30.199873 27653 consensus_queue.cc:260] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:30.201478 27653 raft_consensus.cc:3060] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:30.206514 27480 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:30.212281 25873 leader_election.cc:304] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:30.213454 27517 raft_consensus.cc:2749] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:30.044695 25343 leader_election.cc:304] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:30.215966 27644 raft_consensus.cc:2749] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:11:30.217046 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 172413us
I20260709 13:11:30.217782 27480 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:30.218834 25270 leader_election.cc:304] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:30.220427 27578 raft_consensus.cc:2749] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:30.224936 25375 raft_consensus.cc:1275] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 5. (term mismatch)
I20260709 13:11:30.225332 25375 pending_rounds.cc:85] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468: Aborting all ops after (but not including) 4
I20260709 13:11:30.225589 25375 pending_rounds.cc:107] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:11:30.225841 25375 raft_consensus.cc:2889] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:30.173651 25223 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 5.
I20260709 13:11:30.238507 27517 consensus_queue.cc:1059] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:30.238794 25873 leader_election.cc:304] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:30.239574 27517 raft_consensus.cc:3055] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:30.239954 27517 raft_consensus.cc:740] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:30.240702 27517 consensus_queue.cc:260] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:30.241916 27586 raft_consensus.cc:2749] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:30.242875 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
W20260709 13:11:30.243539 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:30.243507 27517 raft_consensus.cc:3060] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:30.244969 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:30.246079 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:30.246688 25903 raft_consensus.cc:3060] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:11:30.246827 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:30.256969 27622 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:11:30.259261 27651 log.cc:927] Time spent T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.347s	user 0.000s	sys 0.001s
W20260709 13:11:30.261435 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 64437.1us
W20260709 13:11:30.263342 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:30.257740 27597 raft_consensus.cc:3055] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:30.315959 27597 raft_consensus.cc:740] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:30.316030 25345 leader_election.cc:304] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:30.316823 27340 raft_consensus.cc:2749] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:30.279009 25125 catalog_manager.cc:5697] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 2 to 4, leader changed from 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 4 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:11:30.317232 25345 leader_election.cc:304] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:30.317986 27340 raft_consensus.cc:2804] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:30.318426 27340 raft_consensus.cc:697] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 6 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:30.318799 25125 catalog_manager.cc:5697] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 3 to 4, leader changed from 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 4 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:11:30.319222 27340 consensus_queue.cc:237] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:30.320438 25125 catalog_manager.cc:5697] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
W20260709 13:11:30.285032 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 46392us
I20260709 13:11:30.293012 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:30.323545 25297 raft_consensus.cc:2393] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 5: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:30.296581 25301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57272 (request call id 1474) took 1463 ms. Trace:
I20260709 13:11:30.324523 25301 rpcz_store.cc:276] 0709 13:11:28.832889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:29.531708 (+698819us) service_pool.cc:224] Handling call
0709 13:11:29.864982 (+333274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:29.866829 (+  1847us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:30.296360 (+429531us) spinlock_profiling.cc:243] Waited 333 ms on lock 0x7b54000f9950. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6e8ad 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:30.296511 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":765592960}
I20260709 13:11:30.300557 25270 leader_election.cc:304] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:30.326189 27577 raft_consensus.cc:2804] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:30.326586 27577 raft_consensus.cc:493] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:30.326952 27577 raft_consensus.cc:3060] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:30.310150 27499 consensus_queue.cc:237] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 3, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:30.327749 25270 leader_election.cc:304] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:30.329629 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:30.314724 25271 leader_election.cc:400] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 election: Vote denied by peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361) with higher term. Message: Invalid argument: T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for earlier term 3. Current term is 4.
I20260709 13:11:30.331156 25271 leader_election.cc:403] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:11:30.332854 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:30.334189 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:30.334646 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:30.332605 27578 raft_consensus.cc:2749] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:30.337013 25270 leader_election.cc:304] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:30.343716 27578 raft_consensus.cc:2749] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:30.351518 26772 raft_consensus.cc:2749] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361) with higher term. Message: Invalid argument: T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for earlier term 3. Current term is 4.
I20260709 13:11:30.352118 27568 consensus_queue.cc:1059] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:30.352996 27568 raft_consensus.cc:3055] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:30.353364 27568 raft_consensus.cc:740] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:30.354206 27568 consensus_queue.cc:260] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:30.355433 27568 raft_consensus.cc:3060] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:30.357666 25374 raft_consensus.cc:1240] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:30.357960 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:30.321658 25125 catalog_manager.cc:5697] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:11:30.359988 25379 raft_consensus.cc:1240] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:30.362464 26772 consensus_queue.cc:1059] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:30.363292 26772 raft_consensus.cc:3055] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:30.363622 26772 raft_consensus.cc:740] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:30.363811 27590 consensus_queue.cc:1059] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:30.364715 27564 raft_consensus.cc:3055] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:30.365096 27564 raft_consensus.cc:740] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:30.364508 26772 consensus_queue.cc:260] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:30.348836 25270 leader_election.cc:304] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:30.377812 26772 raft_consensus.cc:3060] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:30.396225 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
W20260709 13:11:30.397914 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 49847.7us
W20260709 13:11:30.399055 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:30.400060 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:30.400619 25301 raft_consensus.cc:3060] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:30.401777 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:30.403379 25270 leader_election.cc:304] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:30.405185 25304 raft_consensus.cc:1275] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:30.365952 27564 consensus_queue.cc:260] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:30.227584 27332 raft_consensus.cc:2749] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:30.231753 27556 raft_consensus.cc:2749] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:30.367045 27319 raft_consensus.cc:2764] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 13:11:30.412966 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 95764.9us
I20260709 13:11:30.424049 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:30.428036 26772 raft_consensus.cc:2749] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:30.428035 25375 raft_consensus.cc:2468] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 5.
I20260709 13:11:30.429023 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
W20260709 13:11:30.436075 27661 log.cc:927] Time spent T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.339s	user 0.000s	sys 0.001s
I20260709 13:11:30.437274 25372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36264 (request call id 1381) took 1707 ms. Trace:
I20260709 13:11:30.437629 25372 rpcz_store.cc:276] 0709 13:11:28.729572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:28.729691 (+   119us) service_pool.cc:224] Handling call
0709 13:11:28.732851 (+  3160us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:28.733169 (+   318us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:28.733193 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:28.733632 (+   439us) log.cc:844] Serialized 26 byte log entry
0709 13:11:29.740946 (+1007314us) spinlock_profiling.cc:243] Waited 9.23 ms on lock 0x7b1800172120. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72cb64e07 00007fd7359bfab9 00007fd72cb8169b 00007fd72cb7f93f 00007fd72cb81c02 00007fd72f80920b 00007fd72f80ed23 00007fd72f80f0d1 00007fd72fc2aa0f
0709 13:11:29.847505 (+106559us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:29.847564 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:29.847669 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:30.436987 (+589318us) raft_consensus.cc:1685] finished
0709 13:11:30.437005 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:30.437202 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":428,"raft.queue_time_us":11136,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":8044,"spinlock_wait_cycles":21225344,"thread_start_us":106323,"threads_started":1,"wal-append.queue_time_us":1319494}
I20260709 13:11:30.441944 27597 consensus_queue.cc:260] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:30.443343 27597 raft_consensus.cc:3060] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:30.443660 27609 raft_consensus.cc:493] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.444044 25903 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 5.
I20260709 13:11:30.429304 25345 leader_election.cc:304] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:30.445868 27556 raft_consensus.cc:2749] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:30.449071 27381 raft_consensus.cc:3055] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:30.418008 27578 raft_consensus.cc:2749] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:30.449486 27381 raft_consensus.cc:740] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:30.444217 27609 raft_consensus.cc:515] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:30.425251 27564 raft_consensus.cc:3060] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:30.417637 25301 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 5.
I20260709 13:11:30.457309 27580 raft_consensus.cc:515] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:30.515738 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:30.552320 25194 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.000s	sys 0.018s
W20260709 13:11:30.552866 25194 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.000s	sys 0.018s
W20260709 13:11:30.564910 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:30.454624 27668 consensus_queue.cc:1048] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:11:30.577138 25376 raft_consensus.cc:1240] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 5. Current term is 6. Ops: []
W20260709 13:11:30.553184 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 519124us
W20260709 13:11:30.629769 25195 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.067s	sys 0.118s
W20260709 13:11:30.714567 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:30.573230 27542 raft_consensus.cc:3060] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:30.730808 25873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:30.714587 25300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57272 (request call id 1485) took 1009 ms. Trace:
I20260709 13:11:30.525640 27578 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.734371 25300 rpcz_store.cc:276] 0709 13:11:29.705000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:30.079211 (+374211us) service_pool.cc:224] Handling call
0709 13:11:30.089502 (+ 10291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:30.089711 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:11:30.103133 (+ 13422us) log.cc:844] Serialized 14 byte log entry
0709 13:11:30.587245 (+484112us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:30.714275 (+127030us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:30.714327 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:30.714398 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:30.714529 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":13194,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":163,"thread_start_us":483314,"threads_started":1}
W20260709 13:11:30.735955 25195 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.085s	sys 0.135s
W20260709 13:11:30.752854 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 764752us
W20260709 13:11:30.640460 27233 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.005s	sys 0.009s
I20260709 13:11:30.757468 25195 leader_election.cc:304] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
W20260709 13:11:30.767556 25872 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.001s	sys 0.013s
I20260709 13:11:30.773326 25379 raft_consensus.cc:1275] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:11:30.787899 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:11:30.768266 25378 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.005s	sys 0.010s
W20260709 13:11:30.767800 27233 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.006s	sys 0.009s
I20260709 13:11:30.780925 25195 leader_election.cc:304] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
W20260709 13:11:30.799849 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:30.772495 25374 raft_consensus.cc:1240] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 2. Current term is 3. Ops: []
W20260709 13:11:30.770076 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 50134.7us
W20260709 13:11:30.791931 25378 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.006s	sys 0.010s
I20260709 13:11:30.801627 25374 raft_consensus.cc:1240] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 4. Current term is 5. Ops: []
W20260709 13:11:30.792500 25872 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.001s	sys 0.013s
I20260709 13:11:30.803716 25372 raft_consensus.cc:1240] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 13:11:30.805722 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 721052us
I20260709 13:11:30.797636 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:30.809146 25379 raft_consensus.cc:1275] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:11:30.780594 25296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46556 (request call id 285) took 1451 ms. Trace:
W20260709 13:11:30.810755 25872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:30.811527 25872 leader_election.cc:304] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:11:30.810041 25296 rpcz_store.cc:276] 0709 13:11:29.329274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:29.914033 (+584759us) service_pool.cc:224] Handling call
0709 13:11:29.946943 (+ 32910us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:29.947209 (+   266us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:11:30.408115 (+460906us) log.cc:844] Serialized 14 byte log entry
0709 13:11:30.780268 (+372153us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:30.780321 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:30.780366 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:30.780427 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:30.780535 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":63556,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":1043,"raft.run_wall_time_us":12693,"thread_start_us":766911,"threads_started":2}
I20260709 13:11:30.813061 25374 raft_consensus.cc:1275] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:11:30.813666 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:30.778620 27383 raft_consensus.cc:493] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
W20260709 13:11:30.815610 27512 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.902s	user 0.004s	sys 0.019s
I20260709 13:11:30.763698 27578 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:30.848253 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:30.842900 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 443307us
I20260709 13:11:30.846028 27370 raft_consensus.cc:2804] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:30.816555 27462 raft_consensus.cc:2804] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:30.850142 25270 leader_election.cc:304] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:30.822126 27649 raft_consensus.cc:493] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.852072 25270 leader_election.cc:304] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:30.792168 27466 consensus_queue.cc:1059] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 13:11:30.798516 27630 consensus_queue.cc:1048] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:11:30.761071 27381 consensus_queue.cc:260] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:30.854750 26772 raft_consensus.cc:2749] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:30.858031 26772 raft_consensus.cc:493] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.858484 26772 raft_consensus.cc:515] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:30.813109 27622 consensus_queue.cc:1059] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:11:30.860643 26772 leader_election.cc:290] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:30.847529 27512 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.960s	user 0.005s	sys 0.019s
I20260709 13:11:30.862869 27512 consensus_queue.cc:1048] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:11:30.864187 27670 log.cc:927] Time spent T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.291s	user 0.000s	sys 0.000s
I20260709 13:11:30.856088 25270 leader_election.cc:304] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:30.865012 26772 raft_consensus.cc:2749] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:30.865375 25302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46556 (request call id 283) took 1680 ms. Trace:
I20260709 13:11:30.865804 25302 rpcz_store.cc:276] 0709 13:11:29.184946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:29.882124 (+697178us) service_pool.cc:224] Handling call
0709 13:11:29.882746 (+   622us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:29.921047 (+ 38301us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:29.921093 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:29.921650 (+   557us) log.cc:844] Serialized 26 byte log entry
0709 13:11:30.150130 (+228480us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:30.150187 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:30.150285 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:30.865132 (+714847us) raft_consensus.cc:1685] finished
0709 13:11:30.865158 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:30.865311 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72112,"raft.queue_time_us":38883,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":8713,"thread_start_us":228080,"threads_started":1,"wal-append.queue_time_us":554510}
I20260709 13:11:30.870260 27580 leader_election.cc:290] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:30.873914 27609 leader_election.cc:290] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:30.874668 27434 raft_consensus.cc:2804] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:30.875341 25376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36264 (request call id 1427) took 1348 ms. Trace:
I20260709 13:11:30.875974 27434 raft_consensus.cc:493] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:30.876253 27675 raft_consensus.cc:3055] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:30.876525 27434 raft_consensus.cc:3060] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:30.876837 27675 raft_consensus.cc:740] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:30.878073 27675 consensus_queue.cc:260] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:30.875748 25376 rpcz_store.cc:276] 0709 13:11:29.527136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:29.997479 (+470343us) service_pool.cc:224] Handling call
0709 13:11:30.033288 (+ 35809us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:30.617445 (+584157us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:30.875116 (+257671us) spinlock_profiling.cc:243] Waited 544 ms on lock 0x7b54000bac54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:30.875287 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1250147072}
I20260709 13:11:30.877933 27580 consensus_queue.cc:1048] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:11:30.880776 25371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36264 (request call id 1416) took 1549 ms. Trace:
I20260709 13:11:30.880951 27578 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:30.881157 25371 rpcz_store.cc:276] 0709 13:11:29.331491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:29.887544 (+556053us) service_pool.cc:224] Handling call
0709 13:11:29.887824 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:29.935001 (+ 47177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:29.935034 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:29.935475 (+   441us) log.cc:844] Serialized 26 byte log entry
0709 13:11:30.410206 (+474731us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:30.419583 (+  9377us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:30.419710 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:30.470228 (+ 50518us) spinlock_profiling.cc:243] Waited 24.7 ms on lock 0x7b4800280158. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd734b98aa1 00007fd734b8fb37 00007fd734b8f9ca 00007fd734c8726f 00007fd734c86f37 00007fd734c9b55c 00007fd734c9b508 00007fd734c9b488 00007fd734c9b443 00007fd734c9a6ec 00007fd733bc4a96
0709 13:11:30.880514 (+410286us) raft_consensus.cc:1685] finished
0709 13:11:30.880536 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:30.880720 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46777,"raft.queue_time_us":57546,"raft.run_cpu_time_us":3432,"raft.run_wall_time_us":494445,"spinlock_wait_cycles":56886656,"thread_start_us":390615,"threads_started":1,"wal-append.queue_time_us":871130}
I20260709 13:11:30.882437 25270 leader_election.cc:304] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:30.883540 27578 raft_consensus.cc:2749] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:30.848013 27548 raft_consensus.cc:493] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:30.884948 27561 consensus_meta.cc:287] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 1.045s	user 0.007s	sys 0.003s
I20260709 13:11:30.885365 27561 raft_consensus.cc:2749] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:30.885144 27548 raft_consensus.cc:515] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:30.852247 27462 raft_consensus.cc:493] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:30.898038 27462 raft_consensus.cc:3060] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:30.898528 27683 raft_consensus.cc:3055] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:30.899044 27683 raft_consensus.cc:740] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:30.899346 27548 leader_election.cc:290] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:30.900110 27683 consensus_queue.cc:260] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:30.902040 27683 raft_consensus.cc:3060] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:30.887943 27517 consensus_meta.cc:287] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent flushing consensus metadata: real 0.643s	user 0.008s	sys 0.006s
I20260709 13:11:30.903674 25908 raft_consensus.cc:2410] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:11:30.904332 27466 consensus_queue.cc:1059] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:30.905331 27233 raft_consensus.cc:3055] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:30.577832 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:30.821735 27497 consensus_queue.cc:1059] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:11:30.888780 25377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36254 (request call id 1717) took 1561 ms. Trace:
I20260709 13:11:30.850232 27544 raft_consensus.cc:493] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.891491 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:30.906183 25377 rpcz_store.cc:276] 0709 13:11:29.327639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:29.480029 (+152390us) service_pool.cc:224] Handling call
0709 13:11:29.480355 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:29.785146 (+304791us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:11:29.926209 (+141063us) log.cc:844] Serialized 14 byte log entry
0709 13:11:30.467956 (+541747us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:30.558628 (+ 90672us) log.cc:844] Serialized 26 byte log entry
0709 13:11:30.558833 (+   205us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:30.559226 (+   393us) log.cc:844] Serialized 14 byte log entry
0709 13:11:30.569360 (+ 10134us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:30.569470 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:30.888585 (+319115us) raft_consensus.cc:1685] finished
0709 13:11:30.888605 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:30.888726 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":101028,"prepare.queue_time_us":292345,"prepare.run_cpu_time_us":109,"prepare.run_wall_time_us":2041,"raft.queue_time_us":253819,"raft.run_cpu_time_us":372,"raft.run_wall_time_us":13092,"thread_start_us":810652,"threads_started":3,"wal-append.queue_time_us":905164}
I20260709 13:11:30.906392 27544 raft_consensus.cc:515] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:30.910524 25344 leader_election.cc:304] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:30.910692 27381 raft_consensus.cc:3060] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:30.911659 27480 raft_consensus.cc:2749] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:30.912107 27544 leader_election.cc:290] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:11:30.906119 27589 consensus_meta.cc:287] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 0.662s	user 0.009s	sys 0.000s
W20260709 13:11:30.913574 27486 consensus_meta.cc:287] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 1.012s	user 0.009s	sys 0.001s
I20260709 13:11:30.906675 27497 raft_consensus.cc:3055] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:30.914608 27497 raft_consensus.cc:740] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:30.916035 27497 consensus_queue.cc:260] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:30.890980 25125 catalog_manager.cc:5697] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:30.893283 25270 leader_election.cc:304] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
W20260709 13:11:30.893920 27666 log.cc:927] Time spent T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 13:11:30.853585 27620 raft_consensus.cc:2749] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:30.918634 25270 leader_election.cc:304] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:30.918942 27620 raft_consensus.cc:2749] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:30.918421 25125 catalog_manager.cc:5697] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:30.919610 27620 raft_consensus.cc:2749] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:30.919713 25270 leader_election.cc:304] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:30.920497 27620 raft_consensus.cc:2749] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:30.919914 25125 catalog_manager.cc:5697] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 1 to 3, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 3 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:11:30.921190 25270 leader_election.cc:304] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:30.853303 27370 raft_consensus.cc:697] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 4 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:30.921919 27620 raft_consensus.cc:2804] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:30.922459 27620 raft_consensus.cc:697] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 3 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:30.922601 27370 consensus_queue.cc:237] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:30.923338 27620 consensus_queue.cc:237] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:30.923897 25270 leader_election.cc:304] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:30.924599 27568 raft_consensus.cc:2749] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:30.905711 27233 raft_consensus.cc:740] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:30.926273 27233 consensus_queue.cc:260] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:30.926774 27568 consensus_queue.cc:1059] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:11:30.917649 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:30.865473 27577 consensus_meta.cc:287] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.538s	user 0.009s	sys 0.000s
I20260709 13:11:30.847462 27383 raft_consensus.cc:515] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:30.927899 27578 raft_consensus.cc:3055] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:30.928301 27578 raft_consensus.cc:740] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:30.929400 27383 leader_election.cc:290] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:30.929109 27578 consensus_queue.cc:260] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:30.858672 27649 raft_consensus.cc:515] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:30.931532 27649 leader_election.cc:290] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:30.879426 27675 raft_consensus.cc:3060] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:30.887066 27404 consensus_meta.cc:287] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 0.780s	user 0.004s	sys 0.014s
I20260709 13:11:30.932816 27404 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:30.935447 27404 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:30.927670 27577 raft_consensus.cc:515] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:30.937016 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:30.939706 27577 leader_election.cc:290] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:30.944593 27578 raft_consensus.cc:3060] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:30.914155 27486 raft_consensus.cc:515] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:30.948230 25270 leader_election.cc:304] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:30.950623 25270 leader_election.cc:304] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:30.956749 25128 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40026 (request call id 240) took 9408 ms. Trace:
W20260709 13:11:30.958067 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:30.960500 25271 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.011s	sys 0.008s
W20260709 13:11:30.960929 25271 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.011s	sys 0.008s
I20260709 13:11:30.963203 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:30.965612 25371 raft_consensus.cc:2393] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 5: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:30.982869 25343 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:30.993376 25343 leader_election.cc:304] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:30.921427 25125 catalog_manager.cc:5697] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 1 to 2, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68). New cstate: current_term: 2 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:30.999166 25125 catalog_manager.cc:5697] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 2 to 4, leader changed from 79d99c0e498349bda74127365219e468 (127.23.140.67) to 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68). New cstate: current_term: 4 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:31.002146 25370 raft_consensus.cc:1240] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:30.917652 27497 raft_consensus.cc:3060] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:31.001389 25125 catalog_manager.cc:5697] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:31.004719 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:31.008906 25372 raft_consensus.cc:1275] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:30.796087 27340 raft_consensus.cc:493] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:31.006273 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:31.013942 25377 raft_consensus.cc:2468] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 6.
I20260709 13:11:31.006705 26772 raft_consensus.cc:493] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
W20260709 13:11:30.979226 27499 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.010s	sys 0.007s
I20260709 13:11:31.010272 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:30.965407 27686 raft_consensus.cc:2749] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:30.993515 27577 raft_consensus.cc:2804] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:31.015127 26772 raft_consensus.cc:515] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:31.015964 25305 raft_consensus.cc:2410] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:11:31.005529 27609 raft_consensus.cc:493] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:31.005841 27590 raft_consensus.cc:493] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:31.017503 25296 raft_consensus.cc:1275] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:11:31.017827 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:30.997174 27383 raft_consensus.cc:2749] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:30.992954 27586 raft_consensus.cc:493] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:31.012676 27564 consensus_meta.cc:287] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.548s	user 0.007s	sys 0.002s
I20260709 13:11:31.023685 25125 catalog_manager.cc:5697] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 1 to 3, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68). New cstate: current_term: 3 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:30.997845 27649 raft_consensus.cc:2804] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:31.023372 25297 raft_consensus.cc:3060] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:31.017380 27499 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.010s	sys 0.007s
W20260709 13:11:31.028378 27684 log.cc:927] Time spent T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.091s	user 0.002s	sys 0.000s
I20260709 13:11:30.957299 25128 rpcz_store.cc:276] 0709 13:11:21.548622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:21.548809 (+   187us) service_pool.cc:224] Handling call
0709 13:11:30.956658 (+9407849us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:27.872773 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:27.873465 (+   692us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:27.873508 (+    43us) write_op.cc:435] Acquired schema lock
0709 13:11:27.873535 (+    27us) tablet.cc:662] Decoding operations
0709 13:11:27.950671 (+ 77136us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:27.950747 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:27.950789 (+    42us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:11:27.951441 (+   652us) tablet.cc:701] Row locks acquired
0709 13:11:27.951462 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:11:27.951612 (+   150us) write_op.cc:270] Start()
0709 13:11:27.951743 (+   131us) write_op.cc:276] Timestamp: P: 1783602687951567 usec, L: 0
0709 13:11:27.951775 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 13:11:28.069146 (+117371us) log.cc:844] Serialized 2861 byte log entry
0709 13:11:28.732942 (+663796us) op_driver.cc:464] REPLICATION: finished
0709 13:11:28.873977 (+141035us) write_op.cc:301] APPLY: starting
0709 13:11:28.881731 (+  7754us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:28.890297 (+  8566us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:28.890416 (+   119us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:28.992893 (+102477us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:28.993092 (+   199us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 13:11:28.993133 (+    41us) write_op.cc:312] APPLY: finished
0709 13:11:28.993390 (+   257us) log.cc:844] Serialized 59 byte log entry
0709 13:11:28.993542 (+   152us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:28.993658 (+   116us) write_op.cc:454] Released schema lock
0709 13:11:28.993705 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:28.994104 (+   399us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:28.994128 (+    24us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4275,"reported_tablets":38,"spinlock_wait_cycles":148352,"child_traces":[["op",{"apply.queue_time_us":111682,"apply.run_cpu_time_us":3673,"apply.run_wall_time_us":132367,"num_ops":7,"prepare.queue_time_us":65211,"prepare.run_cpu_time_us":25437,"prepare.run_wall_time_us":404356,"raft.queue_time_us":223377,"raft.run_cpu_time_us":10963,"raft.run_wall_time_us":56782,"replication_time_us":771111,"thread_start_us":391462,"threads_started":4,"wal-append.queue_time_us":342968,"wal-append.run_cpu_time_us":83872,"wal-append.run_wall_time_us":1584857}]]}
I20260709 13:11:30.993574 27568 raft_consensus.cc:493] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:31.020641 27577 raft_consensus.cc:493] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.040851 25370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36264 (request call id 1428) took 1513 ms. Trace:
W20260709 13:11:31.043577 27687 log.cc:927] Time spent T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
W20260709 13:11:31.044821 27688 log.cc:927] Time spent T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:11:31.050504 25370 rpcz_store.cc:276] 0709 13:11:29.527432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:30.016061 (+488629us) service_pool.cc:224] Handling call
0709 13:11:30.049361 (+ 33300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:31.002673 (+953312us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:31.040532 (+ 37859us) spinlock_profiling.cc:243] Waited 952 ms on lock 0x7b540024d954. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:31.040775 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2190651136}
I20260709 13:11:31.086427 25297 raft_consensus.cc:2468] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 6.
W20260709 13:11:31.089874 27689 log.cc:927] Time spent T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.151s	user 0.002s	sys 0.000s
I20260709 13:11:31.032382 27381 raft_consensus.cc:493] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.072429 27577 raft_consensus.cc:3060] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:31.022998 27340 raft_consensus.cc:515] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:31.029654 27590 raft_consensus.cc:515] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:31.029361 27609 raft_consensus.cc:515] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:31.032461 27586 raft_consensus.cc:515] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:31.091746 27434 raft_consensus.cc:515] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:31.071758 27649 raft_consensus.cc:697] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 5 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:31.090409 27564 raft_consensus.cc:493] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:31.064785 27568 raft_consensus.cc:515] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:31.134573 25301 raft_consensus.cc:2468] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 4.
I20260709 13:11:31.115497 27381 raft_consensus.cc:515] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:31.155128 27690 log.cc:927] Time spent T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.215s	user 0.002s	sys 0.000s
I20260709 13:11:31.126824 27564 raft_consensus.cc:515] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
W20260709 13:11:31.165565 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 344397us
I20260709 13:11:31.159981 27486 leader_election.cc:290] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:31.168540 27542 consensus_queue.cc:1059] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:11:31.181504 27620 consensus_queue.cc:1048] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:11:31.162781 27649 consensus_queue.cc:237] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:31.189208 27590 leader_election.cc:290] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:31.191787 27568 leader_election.cc:290] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:31.237571 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:31.239730 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 435808us
W20260709 13:11:31.242368 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 430746us
I20260709 13:11:31.243757 25373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36254 (request call id 1722) took 1895 ms. Trace:
W20260709 13:11:31.245151 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 221672us
I20260709 13:11:31.246218 25378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36254 (request call id 1721) took 1917 ms. Trace:
I20260709 13:11:31.246456 25270 leader_election.cc:304] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:31.246749 25378 rpcz_store.cc:276] 0709 13:11:29.328240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:29.498713 (+170473us) service_pool.cc:224] Handling call
0709 13:11:29.505133 (+  6420us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:29.905849 (+400716us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:11:30.802306 (+896457us) log.cc:844] Serialized 14 byte log entry
0709 13:11:31.111687 (+309381us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:31.112295 (+   608us) log.cc:844] Serialized 26 byte log entry
0709 13:11:31.112506 (+   211us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:31.112552 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:31.112643 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:31.245577 (+132934us) raft_consensus.cc:1685] finished
0709 13:11:31.245634 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:31.245999 (+   365us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76056,"prepare.queue_time_us":192530,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":213292,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":3961,"thread_start_us":1389762,"threads_started":3,"wal-append.queue_time_us":379675}
I20260709 13:11:31.251019 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:31.257109 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:31.259250 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:31.260618 25304 raft_consensus.cc:2393] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 5: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
W20260709 13:11:31.264613 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 453016us
W20260709 13:11:31.266228 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:31.190001 27434 leader_election.cc:290] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 5 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:31.261451 25194 leader_election.cc:304] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:31.265192 25195 leader_election.cc:304] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:31.244392 25373 rpcz_store.cc:276] 0709 13:11:29.347871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:29.888353 (+540482us) service_pool.cc:224] Handling call
0709 13:11:29.888624 (+   271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:29.959658 (+ 71034us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:11:30.563771 (+604113us) log.cc:844] Serialized 14 byte log entry
0709 13:11:31.121529 (+557758us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:31.122046 (+   517us) log.cc:844] Serialized 26 byte log entry
0709 13:11:31.122210 (+   164us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:31.122256 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:31.122353 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:31.242791 (+120438us) raft_consensus.cc:1685] finished
0709 13:11:31.242889 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:31.243390 (+   501us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":173145,"prepare.queue_time_us":141102,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":84984,"raft.run_cpu_time_us":282,"raft.run_wall_time_us":28019,"thread_start_us":854734,"threads_started":2,"wal-append.queue_time_us":471711}
I20260709 13:11:31.294382 27369 consensus_queue.cc:1059] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:31.296517 27589 raft_consensus.cc:493] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:31.297027 27561 raft_consensus.cc:493] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.297565 27589 raft_consensus.cc:515] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:31.311949 27675 raft_consensus.cc:3055] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:31.297565 27369 raft_consensus.cc:2804] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:31.315748 27675 raft_consensus.cc:740] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:31.319715 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:31.321480 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:31.322651 25223 raft_consensus.cc:2468] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 6.
I20260709 13:11:31.326263 27676 consensus_queue.cc:1048] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:31.328851 27676 consensus_queue.cc:1048] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:31.332047 27695 consensus_queue.cc:1059] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:11:31.332602 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:31.333565 25229 raft_consensus.cc:2468] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 5.
I20260709 13:11:31.334486 25872 leader_election.cc:304] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:31.338680 27702 raft_consensus.cc:2804] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:31.339217 27702 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.339609 27702 raft_consensus.cc:3060] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:31.344784 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:31.298022 27561 raft_consensus.cc:515] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:31.346174 25299 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 6.
I20260709 13:11:31.338475 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:31.346172 27589 leader_election.cc:290] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:31.351372 27561 leader_election.cc:290] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:31.353473 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:31.358137 27686 raft_consensus.cc:493] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
W20260709 13:11:31.358381 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 97133.5us
I20260709 13:11:31.359685 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:31.359318 27686 raft_consensus.cc:515] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:31.360713 25229 raft_consensus.cc:2468] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 5.
I20260709 13:11:31.359696 25194 leader_election.cc:304] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:31.362226 27578 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:31.322891 27675 consensus_queue.cc:260] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:31.363024 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:31.363240 27578 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:31.366168 27369 raft_consensus.cc:697] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 7 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:31.369516 25343 leader_election.cc:304] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:31.369406 27404 raft_consensus.cc:3055] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:31.370234 26772 leader_election.cc:290] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:31.370312 27404 raft_consensus.cc:740] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:31.371196 27556 raft_consensus.cc:2804] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:31.371984 27556 raft_consensus.cc:697] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 6 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:31.372087 27404 consensus_queue.cc:260] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:31.374109 27693 raft_consensus.cc:2749] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:31.375599 27564 leader_election.cc:290] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:31.375707 27654 consensus_queue.cc:1048] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:31.330204 27676 consensus_queue.cc:1243] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer 79d99c0e498349bda74127365219e468 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:11:31.367530 27568 raft_consensus.cc:493] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:31.364675 27675 raft_consensus.cc:3060] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:31.393486 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 65840.2us
I20260709 13:11:31.363274 27548 raft_consensus.cc:2749] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:31.395131 25222 raft_consensus.cc:2468] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 4.
I20260709 13:11:31.400177 27340 leader_election.cc:290] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:31.403311 27586 leader_election.cc:290] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:31.406908 25194 leader_election.cc:304] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:31.395045 27669 raft_consensus.cc:2749] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:31.394342 27369 consensus_queue.cc:237] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:31.373567 27556 consensus_queue.cc:237] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:31.380686 27568 raft_consensus.cc:515] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:31.418692 25271 leader_election.cc:304] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:31.411468 27654 raft_consensus.cc:493] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:31.415172 27404 raft_consensus.cc:3060] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:31.422843 27654 raft_consensus.cc:515] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:31.431366 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:11:31.426469 25871 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:31.429821 27577 raft_consensus.cc:515] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:31.436432 25902 raft_consensus.cc:1240] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:31.436338 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:11:31.442371 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 84748.9us
W20260709 13:11:31.442049 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 99344.8us
I20260709 13:11:31.447330 27597 raft_consensus.cc:2749] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:31.449229 27620 raft_consensus.cc:2804] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:31.449570 27686 leader_election.cc:290] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:31.436488 27589 raft_consensus.cc:493] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.459231 27486 raft_consensus.cc:493] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:31.453418 27620 raft_consensus.cc:493] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.462548 27620 raft_consensus.cc:3060] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:31.462396 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 178696us
I20260709 13:11:31.463510 27381 leader_election.cc:290] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:31.463754 25872 leader_election.cc:304] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:31.464380 27568 leader_election.cc:290] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:31.464859 27669 raft_consensus.cc:3060] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:31.468523 27462 consensus_meta.cc:287] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 0.555s	user 0.007s	sys 0.011s
I20260709 13:11:31.471438 27233 raft_consensus.cc:3060] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:31.469061 27462 raft_consensus.cc:515] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:31.481562 25872 leader_election.cc:304] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:31.465896 27609 leader_election.cc:290] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:31.489212 27517 raft_consensus.cc:3055] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:31.494999 27381 consensus_queue.cc:1059] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:11:31.496312 27381 raft_consensus.cc:3055] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:31.496724 27381 raft_consensus.cc:740] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:31.489666 27517 raft_consensus.cc:740] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:31.499284 27669 raft_consensus.cc:2749] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:31.499205 27517 consensus_queue.cc:260] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:31.502115 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:31.503655 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:31.444973 27702 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:31.513144 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 106534us
I20260709 13:11:31.516211 25271 leader_election.cc:304] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:31.429222 27548 consensus_queue.cc:1059] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 13:11:31.460639 27686 raft_consensus.cc:493] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:31.486006 27462 leader_election.cc:290] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:31.521982 27383 raft_consensus.cc:493] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:31.522655 25223 raft_consensus.cc:1240] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:31.523120 25229 raft_consensus.cc:1240] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:31.523346 27512 raft_consensus.cc:2749] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:31.524065 25195 leader_election.cc:304] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:31.521982 27486 raft_consensus.cc:515] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:31.524674 25226 raft_consensus.cc:1275] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:31.515676 27381 consensus_queue.cc:260] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:31.526388 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:31.527081 27609 raft_consensus.cc:2804] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:31.528612 25222 raft_consensus.cc:1275] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:11:31.525496 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:31.530508 27654 leader_election.cc:290] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:31.543650 25271 leader_election.cc:304] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:31.547930 25378 raft_consensus.cc:2468] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 5.
I20260709 13:11:31.555783 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:31.543428 27609 raft_consensus.cc:493] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:31.558600 27609 raft_consensus.cc:3060] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:31.558915 27517 raft_consensus.cc:3060] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:31.559465 27686 raft_consensus.cc:515] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:31.561842 25344 leader_election.cc:304] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:31.562107 25194 leader_election.cc:304] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:31.563196 27577 leader_election.cc:290] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:31.566035 27577 raft_consensus.cc:493] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.566223 25370 raft_consensus.cc:2393] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 3: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:31.553875 27564 raft_consensus.cc:2749] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:31.566624 27577 raft_consensus.cc:515] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:31.567469 27480 raft_consensus.cc:493] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
W20260709 13:11:31.567600 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 43741.2us
I20260709 13:11:31.568521 27319 raft_consensus.cc:3055] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:31.568158 27480 raft_consensus.cc:515] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:31.568984 27319 raft_consensus.cc:740] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:31.569155 27702 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:31.570197 27370 raft_consensus.cc:3060] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:31.570096 27319 consensus_queue.cc:260] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:31.570533 27578 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:31.571542 27319 raft_consensus.cc:3060] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:31.571477 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 90027.9us
I20260709 13:11:31.573010 25872 leader_election.cc:304] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:31.574209 27686 leader_election.cc:290] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:31.576311 27462 raft_consensus.cc:2804] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:31.576795 27462 raft_consensus.cc:493] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.577243 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:31.577569 25271 leader_election.cc:304] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:31.578089 25378 raft_consensus.cc:3060] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:31.578250 25195 leader_election.cc:304] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:31.578604 27578 raft_consensus.cc:2804] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:31.579030 27578 raft_consensus.cc:493] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.579389 27578 raft_consensus.cc:3060] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:31.580646 27512 raft_consensus.cc:2749] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:31.580894 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:31.542164 27589 raft_consensus.cc:515] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:31.591732 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:31.592557 25300 raft_consensus.cc:2468] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 6.
I20260709 13:11:31.593185 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:31.593372 27499 raft_consensus.cc:2764] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:11:31.593892 25371 raft_consensus.cc:3060] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:31.594238 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:31.594735 25223 raft_consensus.cc:1275] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:31.596032 25195 leader_election.cc:304] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:31.600394 25377 raft_consensus.cc:2393] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 5: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:31.600724 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:31.555986 27340 raft_consensus.cc:493] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:31.577232 27462 raft_consensus.cc:3060] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:31.543112 27383 raft_consensus.cc:515] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:31.606626 27381 raft_consensus.cc:3060] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:31.607256 25195 leader_election.cc:304] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:31.608031 27597 raft_consensus.cc:2749] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:31.582616 27486 leader_election.cc:290] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:31.612020 25229 raft_consensus.cc:2393] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 3: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:31.606657 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:31.613298 25270 leader_election.cc:304] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:31.601167 27556 raft_consensus.cc:3060] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:31.621987 27702 raft_consensus.cc:2804] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:11:31.622638 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 116051us
I20260709 13:11:31.629640 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:31.630043 25872 leader_election.cc:304] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:31.629693 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:31.631464 25221 raft_consensus.cc:3060] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:31.626662 27702 raft_consensus.cc:493] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:31.632126 27702 raft_consensus.cc:3060] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:31.632382 27383 leader_election.cc:290] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:31.630900 27512 raft_consensus.cc:2749] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:31.633117 25872 leader_election.cc:304] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:31.633069 27669 consensus_queue.cc:1059] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:31.638458 27683 consensus_queue.cc:1048] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:31.639704 27669 raft_consensus.cc:3055] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:31.640092 27669 raft_consensus.cc:740] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:31.633998 27499 raft_consensus.cc:2749] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:31.615304 27686 raft_consensus.cc:493] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.642305 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:31.642442 27686 raft_consensus.cc:515] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:31.643085 25224 raft_consensus.cc:2393] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 6: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:31.626725 27340 raft_consensus.cc:515] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:31.635607 27512 raft_consensus.cc:2749] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:31.644632 27686 leader_election.cc:290] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:31.647236 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:31.647929 25908 raft_consensus.cc:3060] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:31.648404 25115 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 275226661cc840559134f8c9e5b15719 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 1f539ba21487460085b837e7529a78ce is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:11:31.651876 27434 consensus_queue.cc:1048] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:31.652783 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:31.653975 27586 consensus_queue.cc:1059] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:31.654198 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:31.654524 25900 raft_consensus.cc:1275] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 LEARNER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:11:31.655227 27586 raft_consensus.cc:3055] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:31.626485 25343 leader_election.cc:304] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:31.655593 27586 raft_consensus.cc:740] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:31.655846 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:31.656611 27586 consensus_queue.cc:260] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:31.638159 27480 leader_election.cc:290] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:31.627715 27577 leader_election.cc:290] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:31.670848 27702 raft_consensus.cc:515] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:31.641126 27669 consensus_queue.cc:260] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:31.679280 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:31.680224 27669 raft_consensus.cc:3060] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:31.683458 27383 raft_consensus.cc:2804] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:31.683871 27383 raft_consensus.cc:493] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.684237 27383 raft_consensus.cc:3060] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:31.684055 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:31.685676 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:31.686841 25907 raft_consensus.cc:1275] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:31.687443 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:31.688181 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:31.689092 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:31.689685 25343 leader_election.cc:304] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:31.690399 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:31.653474 27434 consensus_queue.cc:1048] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:11:31.691323 27480 raft_consensus.cc:2804] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:31.691767 27480 raft_consensus.cc:493] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:31.692217 27480 raft_consensus.cc:3060] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:31.696712 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:31.701414 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 88161us
I20260709 13:11:31.707868 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:31.709282 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:31.682266 27609 raft_consensus.cc:515] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:31.743872 25300 raft_consensus.cc:1275] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:11:31.764200 25908 raft_consensus.cc:2468] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 7.
I20260709 13:11:31.715024 25221 raft_consensus.cc:2468] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 7.
I20260709 13:11:31.759431 25270 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
W20260709 13:11:31.807718 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 48429.4us
I20260709 13:11:31.715268 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:31.811054 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:11:31.815017 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 67774us
I20260709 13:11:31.783440 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:11:31.746412 27714 log.cc:927] Time spent T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 13:11:31.716219 27586 raft_consensus.cc:3060] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:31.766466 27695 consensus_queue.cc:1048] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:11:31.808080 27512 raft_consensus.cc:493] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:31.821420 27544 raft_consensus.cc:493] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:31.821215 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:31.822080 27544 raft_consensus.cc:515] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:31.822676 25301 raft_consensus.cc:2468] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 6.
I20260709 13:11:31.823487 27512 raft_consensus.cc:515] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:31.749212 27654 raft_consensus.cc:493] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:31.821220 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:31.759263 25900 raft_consensus.cc:2468] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 5.
I20260709 13:11:31.699478 27577 consensus_queue.cc:1048] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.118s
I20260709 13:11:31.832304 25343 leader_election.cc:304] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:31.824363 27544 leader_election.cc:290] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:31.746987 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:31.816303 27564 raft_consensus.cc:3060] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:31.777626 27686 raft_consensus.cc:493] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:31.835589 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:31.846791 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:31.847110 25375 raft_consensus.cc:2410] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:11:31.713665 27480 raft_consensus.cc:515] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:31.820068 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:31.714926 27620 raft_consensus.cc:515] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:31.766422 27578 raft_consensus.cc:515] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:31.830852 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:31.835378 27517 raft_consensus.cc:493] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:31.868700 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:31.868561 25304 raft_consensus.cc:2468] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 6.
I20260709 13:11:31.872504 25302 raft_consensus.cc:2393] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 6: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:31.851934 27544 raft_consensus.cc:2804] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:31.870697 25271 leader_election.cc:304] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:31.879037 27620 leader_election.cc:290] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:31.880461 25296 raft_consensus.cc:1240] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:31.882722 25300 raft_consensus.cc:2468] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 6.
I20260709 13:11:31.888124 27332 raft_consensus.cc:493] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:31.888974 25903 raft_consensus.cc:2468] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 5.
I20260709 13:11:31.890175 27609 leader_election.cc:290] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:31.900254 25301 raft_consensus.cc:2393] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 3: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:31.901254 25378 raft_consensus.cc:2468] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 6.
I20260709 13:11:31.867851 27649 raft_consensus.cc:493] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:31.903853 26772 raft_consensus.cc:2804] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:31.906195 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:31.907027 25299 raft_consensus.cc:1240] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:31.896804 25370 raft_consensus.cc:2468] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 6.
I20260709 13:11:31.915179 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:31.894850 27544 raft_consensus.cc:493] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:31.899207 27404 raft_consensus.cc:493] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.871286 27319 consensus_queue.cc:1059] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:11:31.920476 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:31.873095 27686 raft_consensus.cc:515] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:31.914057 27589 leader_election.cc:290] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:31.874200 27654 raft_consensus.cc:515] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:31.946740 27718 log.cc:927] Time spent T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
W20260709 13:11:31.948035 27721 log.cc:927] Time spent T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:11:31.923697 27466 consensus_queue.cc:1048] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:11:31.921561 27544 raft_consensus.cc:3060] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:31.878239 27709 consensus_queue.cc:1048] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:11:31.910082 27517 raft_consensus.cc:515] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:31.923708 27332 raft_consensus.cc:515] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:11:31.979375 27517 leader_election.cc:290] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:31.979735 27332 leader_election.cc:290] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:31.922755 27702 leader_election.cc:290] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:31.931953 27404 raft_consensus.cc:515] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:31.984756 27404 leader_election.cc:290] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:31.974311 27512 leader_election.cc:290] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:31.989034 25376 raft_consensus.cc:2468] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 5.
I20260709 13:11:31.912695 27649 raft_consensus.cc:515] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:31.921046 27486 raft_consensus.cc:493] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:31.994951 27706 raft_consensus.cc:493] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:31.996017 25224 raft_consensus.cc:2468] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 5.
I20260709 13:11:31.997015 25271 leader_election.cc:304] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:31.958724 27609 raft_consensus.cc:493] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:31.999949 27486 raft_consensus.cc:515] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:31.999728 27480 leader_election.cc:290] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:31.989331 27544 raft_consensus.cc:515] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:32.010157 26772 raft_consensus.cc:697] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 7 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
W20260709 13:11:32.010861 25871 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:31.969256 27462 raft_consensus.cc:515] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:31.997327 27706 raft_consensus.cc:515] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:32.015949 27691 raft_consensus.cc:2804] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:32.031720 27649 leader_election.cc:290] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:32.034261 27706 leader_election.cc:290] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:32.034494 27370 raft_consensus.cc:2749] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:32.036456 27462 leader_election.cc:290] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:32.037093 27556 raft_consensus.cc:2749] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:32.021131 27609 raft_consensus.cc:515] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:32.039989 27654 leader_election.cc:290] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:32.040558 27609 leader_election.cc:290] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:32.042672 27486 leader_election.cc:290] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:32.044135 27381 raft_consensus.cc:493] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:32.044814 27381 raft_consensus.cc:515] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:32.045734 27383 raft_consensus.cc:515] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:32.042848 27340 leader_election.cc:290] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:32.054991 27691 raft_consensus.cc:697] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 5 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:32.056145 27691 consensus_queue.cc:237] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:32.058686 27686 leader_election.cc:290] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:32.058911 27544 leader_election.cc:290] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:32.054406 27383 leader_election.cc:290] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:32.074132 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:32.075048 25371 raft_consensus.cc:2468] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 7.
I20260709 13:11:32.028123 26772 consensus_queue.cc:237] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:32.047093 27381 leader_election.cc:290] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:32.091063 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:32.091836 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:32.093317 25371 raft_consensus.cc:2393] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 3: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
W20260709 13:11:32.091818 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 183389us
I20260709 13:11:32.096712 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:32.097985 25302 raft_consensus.cc:1240] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:32.102397 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:32.104120 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:32.106750 25229 raft_consensus.cc:2393] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 4: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:32.103070 25299 raft_consensus.cc:2376] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 6. Re-sending same reply.
I20260709 13:11:32.109300 25378 raft_consensus.cc:1275] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:11:32.083575 27480 raft_consensus.cc:493] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.110271 25304 raft_consensus.cc:1240] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:32.111881 25872 leader_election.cc:304] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
W20260709 13:11:32.113183 27727 log.cc:927] Time spent T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.119s	user 0.003s	sys 0.000s
I20260709 13:11:32.113294 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:32.115273 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:32.116077 27738 raft_consensus.cc:2804] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:32.116556 27738 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:32.116991 27738 raft_consensus.cc:3060] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:32.118413 25370 pending_rounds.cc:85] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468: Aborting all ops after (but not including) 1
I20260709 13:11:32.091205 27578 leader_election.cc:290] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:32.116844 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:32.121429 25300 raft_consensus.cc:1240] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:32.122081 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:32.122582 25298 raft_consensus.cc:2393] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 5: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:32.120643 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:32.106189 27649 raft_consensus.cc:493] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.118762 25370 pending_rounds.cc:107] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:11:32.130998 25370 raft_consensus.cc:2889] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:32.117920 27586 consensus_queue.cc:1059] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:11:32.132200 27370 raft_consensus.cc:493] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:32.132853 27370 raft_consensus.cc:515] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:32.133550 27480 raft_consensus.cc:515] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:32.134030 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:32.134979 27370 leader_election.cc:290] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:32.132879 27586 raft_consensus.cc:3055] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:32.135674 27586 raft_consensus.cc:740] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:32.135761 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:32.136559 25375 raft_consensus.cc:3060] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:32.136884 27586 consensus_queue.cc:260] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:32.138029 27649 raft_consensus.cc:515] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:32.139241 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:32.159005 25298 raft_consensus.cc:2468] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 4.
I20260709 13:11:32.160202 27649 leader_election.cc:290] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:32.161417 27586 raft_consensus.cc:3060] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:32.162223 25378 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "275226661cc840559134f8c9e5b15719"
dest_uuid: "79d99c0e498349bda74127365219e468"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:36248
I20260709 13:11:32.162935 25378 raft_consensus.cc:606] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 5 LEADER]: Received request to transfer leadership
I20260709 13:11:32.143602 25304 raft_consensus.cc:1275] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:11:32.143744 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:32.142859 25226 raft_consensus.cc:1275] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:11:32.165918 25225 raft_consensus.cc:2468] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 5.
I20260709 13:11:32.144722 25303 raft_consensus.cc:1275] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:32.144582 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:32.146229 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:32.146152 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:32.147066 27733 raft_consensus.cc:493] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.148082 25297 raft_consensus.cc:1275] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:11:32.151585 27735 raft_consensus.cc:493] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:32.152138 25345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:32.151962 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:32.152420 25899 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 3.
I20260709 13:11:32.105242 27512 consensus_queue.cc:1048] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:11:32.153811 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:11:32.155194 27730 log.cc:927] Time spent T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.181s	user 0.002s	sys 0.000s
I20260709 13:11:32.157055 27676 raft_consensus.cc:3055] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:11:32.162494 27725 log.cc:927] Time spent T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
I20260709 13:11:32.174304 27676 raft_consensus.cc:740] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:32.174670 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:32.175294 25228 raft_consensus.cc:2376] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 79d99c0e498349bda74127365219e468 in term 5. Re-sending same reply.
I20260709 13:11:32.175295 27676 consensus_queue.cc:260] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:32.176209 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:32.176966 25228 raft_consensus.cc:2368] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 6. Current term is 7.
I20260709 13:11:32.176903 27676 raft_consensus.cc:3060] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:32.178332 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:32.178864 25228 raft_consensus.cc:3060] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:32.167639 25300 raft_consensus.cc:3060] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:32.135900 27480 leader_election.cc:290] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:32.183812 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:32.180593 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:32.171666 25305 raft_consensus.cc:2393] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 5: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:32.169130 25224 raft_consensus.cc:2468] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 6.
I20260709 13:11:32.184906 25226 raft_consensus.cc:2468] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 6.
I20260709 13:11:32.187027 25230 raft_consensus.cc:2393] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 3: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:32.187481 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:32.187850 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:32.188282 25225 raft_consensus.cc:2393] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 6: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:32.188990 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:32.189493 27564 raft_consensus.cc:2749] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:32.171540 27733 raft_consensus.cc:515] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:32.190136 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:32.190649 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:32.191985 27733 leader_election.cc:290] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:32.192981 25221 raft_consensus.cc:1275] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:11:32.194167 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:11:32.199712 25195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:32.199960 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:11:32.169631 25270 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.140.68:34085 timed out after 2.168s (SENT) [suppressed 23 similar messages]
I20260709 13:11:32.200834 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:32.203126 25300 raft_consensus.cc:2468] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 6.
W20260709 13:11:32.214931 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 82979.1us
I20260709 13:11:32.214763 25228 raft_consensus.cc:2468] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 5.
I20260709 13:11:32.218714 25375 raft_consensus.cc:2468] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 6.
I20260709 13:11:32.219321 25873 leader_election.cc:304] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:32.221154 25230 raft_consensus.cc:2393] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 6: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:32.178196 27609 raft_consensus.cc:493] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:32.224880 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:32.224334 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:32.236457 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:32.238979 25229 raft_consensus.cc:2393] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 6: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:32.217348 27564 raft_consensus.cc:493] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.252219 25224 raft_consensus.cc:2468] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 3.
I20260709 13:11:32.250696 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:32.206331 27735 raft_consensus.cc:515] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:32.259104 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:32.259794 25229 raft_consensus.cc:2368] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 5. Current term is 6.
I20260709 13:11:32.260459 25345 leader_election.cc:304] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:32.261045 27735 leader_election.cc:290] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:32.248454 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:32.266269 27686 raft_consensus.cc:493] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.266103 27564 raft_consensus.cc:515] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:32.266901 27741 raft_consensus.cc:2804] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:32.266834 27686 raft_consensus.cc:515] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:32.267624 27741 raft_consensus.cc:697] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:32.268241 27564 leader_election.cc:290] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:32.268651 27741 consensus_queue.cc:237] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:32.269625 27686 leader_election.cc:290] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:32.276203 25226 raft_consensus.cc:2468] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 4.
I20260709 13:11:32.278434 25270 leader_election.cc:304] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:32.280794 25270 leader_election.cc:304] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:32.255335 27609 raft_consensus.cc:515] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:32.283404 27609 leader_election.cc:290] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:32.249188 27578 raft_consensus.cc:493] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.284515 27578 raft_consensus.cc:515] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:32.248878 27691 raft_consensus.cc:493] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.286181 27691 raft_consensus.cc:515] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:32.288174 27691 leader_election.cc:290] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:32.289162 27620 consensus_queue.cc:1048] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:32.290599 27620 raft_consensus.cc:2749] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:32.291145 27620 raft_consensus.cc:2749] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:32.292475 25270 leader_election.cc:304] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:32.297253 25302 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 3.
I20260709 13:11:32.304379 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:32.305007 25300 raft_consensus.cc:2468] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 5.
I20260709 13:11:32.306095 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:32.300633 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:11:32.305989 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 49769.5us
I20260709 13:11:32.308247 25305 raft_consensus.cc:1275] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:11:32.309482 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:32.307233 25297 raft_consensus.cc:2468] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 3.
I20260709 13:11:32.310362 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:32.311578 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:32.312484 25300 raft_consensus.cc:2393] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 5: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
W20260709 13:11:32.346884 25873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:32.305606 27735 raft_consensus.cc:2749] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:32.347949 26772 raft_consensus.cc:493] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.346560 25195 leader_election.cc:304] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:32.318660 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:32.351365 25303 raft_consensus.cc:2393] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 6: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:32.318720 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:32.353363 27383 raft_consensus.cc:493] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:32.353883 27564 raft_consensus.cc:2804] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:32.354192 27578 leader_election.cc:290] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:32.354481 27564 raft_consensus.cc:697] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 7 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:32.354905 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:32.354298 27383 raft_consensus.cc:515] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:32.355499 27564 consensus_queue.cc:237] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:32.356122 27486 raft_consensus.cc:493] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:32.356837 27383 leader_election.cc:290] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:32.356621 27486 raft_consensus.cc:515] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:32.357533 27691 raft_consensus.cc:493] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:32.358026 27691 raft_consensus.cc:515] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:32.358809 27486 leader_election.cc:290] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:32.359998 27691 leader_election.cc:290] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:32.360080 25343 leader_election.cc:304] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:32.361477 27381 raft_consensus.cc:2804] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:32.310083 27649 consensus_queue.cc:1048] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:11:32.354298 25903 raft_consensus.cc:2410] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:11:32.361778 25343 leader_election.cc:304] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:32.396538 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:11:32.396823 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 104462us
W20260709 13:11:32.381122 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 67419.2us
I20260709 13:11:32.398931 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:32.400090 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:32.400900 25224 raft_consensus.cc:2393] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 9: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:32.401765 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:32.403779 25376 raft_consensus.cc:2368] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for earlier term 5. Current term is 6.
I20260709 13:11:32.402040 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:32.405265 25373 raft_consensus.cc:3060] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:32.402179 25377 raft_consensus.cc:1275] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:11:32.408090 25899 raft_consensus.cc:1275] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:11:32.384481 25296 raft_consensus.cc:2468] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 6.
I20260709 13:11:32.351521 27233 raft_consensus.cc:493] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.348330 27340 consensus_queue.cc:1059] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:11:32.385996 27677 raft_consensus.cc:2804] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:32.414775 27677 raft_consensus.cc:697] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 6 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:32.414775 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:32.415529 25378 raft_consensus.cc:2468] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 4.
I20260709 13:11:32.415856 27677 consensus_queue.cc:237] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:32.416383 25376 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "275226661cc840559134f8c9e5b15719"
dest_uuid: "79d99c0e498349bda74127365219e468"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:36248
I20260709 13:11:32.416893 25376 raft_consensus.cc:606] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 5 LEADER]: Received request to transfer leadership
I20260709 13:11:32.373906 26772 raft_consensus.cc:515] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:32.362108 27586 raft_consensus.cc:493] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.303179 27738 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:32.349169 27676 consensus_queue.cc:1048] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:11:32.394881 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:32.410558 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:32.398612 25270 leader_election.cc:304] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:11:32.413643 25371 raft_consensus.cc:1275] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:32.413552 27233 raft_consensus.cc:515] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:32.414170 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:32.411211 27735 raft_consensus.cc:2804] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:32.429396 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:32.361871 27381 raft_consensus.cc:493] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:32.430895 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:32.431591 25222 raft_consensus.cc:2468] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 5.
I20260709 13:11:32.434042 25228 raft_consensus.cc:2468] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 5.
I20260709 13:11:32.439246 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:32.441205 25375 raft_consensus.cc:2393] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 5: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:32.423393 27649 raft_consensus.cc:493] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.447036 26772 leader_election.cc:290] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:32.450068 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:32.434587 27340 consensus_queue.cc:1243] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [LEADER]: Peer 1f539ba21487460085b837e7529a78ce log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:11:32.442904 27381 raft_consensus.cc:3060] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:32.453169 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:32.453848 25905 raft_consensus.cc:2468] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 5.
I20260709 13:11:32.456274 27738 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:32.456627 25874 leader_election.cc:304] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:32.443799 27691 raft_consensus.cc:2804] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:32.458317 27691 raft_consensus.cc:697] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 5 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:32.459338 27691 consensus_queue.cc:237] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:32.462420 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 63882.2us
I20260709 13:11:32.463155 25270 leader_election.cc:304] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:32.464289 27754 raft_consensus.cc:2749] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:32.464869 25270 leader_election.cc:304] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:32.466204 25305 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f"
dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
mode: GRACEFUL
new_leader_uuid: "1f539ba21487460085b837e7529a78ce"
 from {username='slave'} at 127.0.0.1:35660
I20260709 13:11:32.423729 27586 raft_consensus.cc:515] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:32.466971 25305 raft_consensus.cc:606] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Received request to transfer leadership to TS 1f539ba21487460085b837e7529a78ce
I20260709 13:11:32.469516 25305 raft_consensus.cc:614] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:32.470625 25874 leader_election.cc:304] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:32.471306 25270 leader_election.cc:304] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:32.474165 26772 raft_consensus.cc:2749] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:32.438354 27735 raft_consensus.cc:493] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:32.474861 25874 leader_election.cc:304] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:11:32.476038 25195 leader_election.cc:304] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:11:32.477414 25270 leader_election.cc:304] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:32.480623 25375 raft_consensus.cc:1275] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:32.483695 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:32.486282 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:32.488099 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:32.488947 25371 raft_consensus.cc:2468] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 5.
I20260709 13:11:32.493172 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:32.493974 25905 raft_consensus.cc:3060] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:32.472332 27586 leader_election.cc:290] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:32.497776 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:32.498278 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:32.472520 27738 raft_consensus.cc:2749] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:32.499782 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:32.501205 25222 raft_consensus.cc:2468] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 5.
I20260709 13:11:32.476140 27735 raft_consensus.cc:3060] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:32.503103 25343 leader_election.cc:304] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:32.499990 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:32.508124 25301 raft_consensus.cc:2468] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 4.
I20260709 13:11:32.505256 25298 raft_consensus.cc:2468] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 3.
I20260709 13:11:32.511330 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:32.511924 25227 raft_consensus.cc:3060] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:32.495754 27512 raft_consensus.cc:2804] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:32.514194 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:32.514595 27512 raft_consensus.cc:493] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:32.514750 25305 raft_consensus.cc:2376] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 6. Re-sending same reply.
I20260709 13:11:32.515005 27512 raft_consensus.cc:3060] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:32.515636 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:32.516273 27712 raft_consensus.cc:2804] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:32.516706 27712 raft_consensus.cc:493] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:32.517035 27712 raft_consensus.cc:3060] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:32.478149 27578 raft_consensus.cc:2749] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:32.509598 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:32.518522 25230 raft_consensus.cc:2393] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 6: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:32.519215 25905 raft_consensus.cc:2468] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 6.
I20260709 13:11:32.519845 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:32.521938 27233 leader_election.cc:290] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:32.522081 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:32.476387 27754 raft_consensus.cc:493] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.450424 27649 raft_consensus.cc:515] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:32.491226 27577 raft_consensus.cc:493] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:32.530472 25228 raft_consensus.cc:1275] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:11:32.492965 27568 raft_consensus.cc:2749] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:32.475581 27340 consensus_queue.cc:1048] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:11:32.540077 25343 leader_election.cc:304] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:32.545295 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:32.546190 25222 raft_consensus.cc:2468] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 4.
I20260709 13:11:32.526130 27741 raft_consensus.cc:3060] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:32.549077 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:32.550772 25296 raft_consensus.cc:2368] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 4. Current term is 5.
I20260709 13:11:32.536523 27383 raft_consensus.cc:2804] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:32.564203 27383 raft_consensus.cc:493] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:32.564666 27383 raft_consensus.cc:3060] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:32.560910 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:32.565254 25375 raft_consensus.cc:2468] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 5.
I20260709 13:11:32.565833 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:32.566500 25298 raft_consensus.cc:2468] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 3.
W20260709 13:11:32.572237 25114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 109557us
I20260709 13:11:32.561129 27332 raft_consensus.cc:2804] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:32.578662 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:32.579568 25296 raft_consensus.cc:2393] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 4: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:32.581470 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:32.584005 25298 raft_consensus.cc:3060] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:32.531105 27754 raft_consensus.cc:515] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:32.561666 27556 consensus_queue.cc:1048] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:11:32.575933 27676 consensus_queue.cc:1059] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:11:32.585357 27742 raft_consensus.cc:493] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.585930 27742 raft_consensus.cc:515] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:32.588708 27742 leader_election.cc:290] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:32.590067 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:32.592396 25299 raft_consensus.cc:1275] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:11:32.594179 27735 raft_consensus.cc:515] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:11:32.595921 27462 raft_consensus.cc:3055] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:32.596354 27462 raft_consensus.cc:740] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:32.597157 27735 leader_election.cc:290] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:32.597088 27462 consensus_queue.cc:260] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:32.561781 27499 consensus_queue.cc:1059] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:11:32.630645 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:32.597820 27735 consensus_queue.cc:1048] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:32.544380 27577 raft_consensus.cc:515] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:32.607474 25227 raft_consensus.cc:2468] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 6.
I20260709 13:11:32.611588 25304 raft_consensus.cc:2468] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 6.
W20260709 13:11:32.635516 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 84892.1us
I20260709 13:11:32.651113 25194 leader_election.cc:304] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:11:32.658459 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:32.657609 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 86014.5us
I20260709 13:11:32.605054 27381 raft_consensus.cc:515] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:32.678690 25298 raft_consensus.cc:2468] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 5.
W20260709 13:11:32.684806 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 133067us
I20260709 13:11:32.686026 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:32.686869 25227 raft_consensus.cc:2468] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 5.
I20260709 13:11:32.691212 25370 raft_consensus.cc:1240] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:32.630510 27512 raft_consensus.cc:515] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:32.695513 25345 leader_election.cc:304] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:32.700394 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:32.701180 25375 raft_consensus.cc:2468] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 5.
I20260709 13:11:32.685648 27499 raft_consensus.cc:3060] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:32.704108 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:32.702087 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:32.702907 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:32.705474 25227 raft_consensus.cc:2468] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 3.
I20260709 13:11:32.705526 25270 leader_election.cc:304] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:32.706830 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:32.707000 26772 raft_consensus.cc:2749] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:32.707355 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:32.707468 25376 raft_consensus.cc:2468] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 2.
I20260709 13:11:32.708006 25371 raft_consensus.cc:2468] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 4.
I20260709 13:11:32.708140 25270 leader_election.cc:304] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:32.705173 25372 raft_consensus.cc:2468] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 5.
I20260709 13:11:32.709270 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
W20260709 13:11:32.714097 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 49810.1us
I20260709 13:11:32.717929 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:32.718217 25270 leader_election.cc:304] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:32.717408 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:32.699447 27332 raft_consensus.cc:697] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 6 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:32.733053 25270 leader_election.cc:400] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 election: Vote denied by peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091) with higher term. Message: Invalid argument: T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for earlier term 5. Current term is 6.
I20260709 13:11:32.748131 25373 raft_consensus.cc:2468] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 6.
I20260709 13:11:32.736867 25270 leader_election.cc:304] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:32.751331 25378 raft_consensus.cc:1240] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:32.753515 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:32.755692 25270 leader_election.cc:304] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:32.707633 27669 consensus_queue.cc:1059] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:11:32.717348 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:32.767109 27383 raft_consensus.cc:515] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:32.718050 27649 leader_election.cc:290] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:32.769131 27383 leader_election.cc:290] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:32.738174 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:32.770772 25901 raft_consensus.cc:2376] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 5. Re-sending same reply.
I20260709 13:11:32.770960 27499 raft_consensus.cc:2749] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:32.772439 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:32.773689 25224 raft_consensus.cc:2393] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 4: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:32.726285 27686 raft_consensus.cc:2804] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:11:32.757802 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 67592.4us
I20260709 13:11:32.756510 27564 consensus_queue.cc:1048] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:11:32.758971 27609 raft_consensus.cc:2804] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:32.759311 27381 leader_election.cc:290] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:32.759853 27466 consensus_queue.cc:1048] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:11:32.763227 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 53270.6us
W20260709 13:11:32.764009 27760 log.cc:927] Time spent T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:11:32.764657 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:32.765123 27669 consensus_queue.cc:1243] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer da445ce82dc4467f95f4fa52297eaa19 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:11:32.715242 27765 raft_consensus.cc:2749] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:32.765511 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:32.774490 25270 leader_election.cc:304] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:32.731721 27691 raft_consensus.cc:2804] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:32.765511 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:32.794118 25872 leader_election.cc:400] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 election: Vote denied by peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127) with higher term. Message: Invalid argument: T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 4. Current term is 5.
I20260709 13:11:32.794216 25227 raft_consensus.cc:2468] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 6.
W20260709 13:11:32.779320 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 61582.8us
W20260709 13:11:32.783699 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 71001.2us
I20260709 13:11:32.795405 25194 leader_election.cc:304] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:32.755302 27703 raft_consensus.cc:2804] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:32.798818 27703 raft_consensus.cc:493] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:32.799216 27703 raft_consensus.cc:3060] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:32.799432 27754 leader_election.cc:290] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:32.800105 27691 raft_consensus.cc:697] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 6 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:32.801020 27691 consensus_queue.cc:237] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:32.796159 25374 raft_consensus.cc:2393] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 4: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:32.806017 27332 consensus_queue.cc:237] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:32.807719 27703 raft_consensus.cc:515] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:32.790773 25270 leader_election.cc:304] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:32.812088 27462 raft_consensus.cc:3060] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:32.835538 27703 leader_election.cc:290] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:32.835898 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 45226.1us
I20260709 13:11:32.771806 27741 raft_consensus.cc:2749] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:32.783943 27609 raft_consensus.cc:493] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:32.781875 27686 raft_consensus.cc:493] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:32.830560 27772 raft_consensus.cc:2804] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:32.831319 25304 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119"
dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
mode: GRACEFUL
new_leader_uuid: "1f539ba21487460085b837e7529a78ce"
 from {username='slave'} at 127.0.0.1:35660
I20260709 13:11:32.837723 25194 leader_election.cc:304] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:32.847882 25304 raft_consensus.cc:606] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Received request to transfer leadership to TS 1f539ba21487460085b837e7529a78ce
I20260709 13:11:32.848279 25304 raft_consensus.cc:614] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:32.831856 27712 raft_consensus.cc:515] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:32.832487 27761 consensus_queue.cc:1048] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:32.833150 27499 consensus_queue.cc:1048] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:32.837225 25874 leader_election.cc:304] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:32.836608 25270 leader_election.cc:304] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:32.796631 27568 raft_consensus.cc:2804] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:32.836189 27703 raft_consensus.cc:2804] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:32.849677 27772 raft_consensus.cc:493] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:32.854211 25270 leader_election.cc:304] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
W20260709 13:11:32.854288 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 79473.2us
I20260709 13:11:32.854830 25874 leader_election.cc:304] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
W20260709 13:11:32.856513 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 73079.9us
I20260709 13:11:32.862810 25345 leader_election.cc:400] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 election: Vote denied by peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361) with higher term. Message: Invalid argument: T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 6. Current term is 7.
I20260709 13:11:32.862921 25872 leader_election.cc:304] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:32.863212 25345 leader_election.cc:403] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:11:32.849128 27609 raft_consensus.cc:3060] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:32.848927 27686 raft_consensus.cc:3060] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:32.867468 27556 raft_consensus.cc:2749] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361) with higher term. Message: Invalid argument: T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 6. Current term is 7.
I20260709 13:11:32.868582 25345 leader_election.cc:304] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:32.869236 27765 raft_consensus.cc:2804] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:32.869590 27765 raft_consensus.cc:493] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:32.869956 27765 raft_consensus.cc:3060] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:32.866292 27772 raft_consensus.cc:3060] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:32.874400 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:32.875082 25901 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 5.
I20260709 13:11:32.877027 25345 leader_election.cc:304] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:32.858615 27754 raft_consensus.cc:2804] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:32.857331 27517 raft_consensus.cc:2749] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:32.880924 25345 leader_election.cc:304] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:32.879701 25872 leader_election.cc:304] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:32.861788 27703 raft_consensus.cc:493] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:32.856173 27577 leader_election.cc:290] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:32.882361 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:32.882673 25194 leader_election.cc:304] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:32.893388 25345 leader_election.cc:304] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:32.858472 27568 raft_consensus.cc:493] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:32.884034 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:32.878455 27340 raft_consensus.cc:2749] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:32.870484 27586 raft_consensus.cc:2804] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:32.886597 25373 raft_consensus.cc:1240] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:32.859890 27767 raft_consensus.cc:2749] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:32.884627 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:32.875982 27620 raft_consensus.cc:2804] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:32.866459 27233 consensus_queue.cc:1048] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:11:32.865833 27434 raft_consensus.cc:2749] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:32.881491 27754 raft_consensus.cc:493] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:32.891721 25374 raft_consensus.cc:2468] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 7.
I20260709 13:11:32.885975 27381 raft_consensus.cc:2749] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:32.890623 27512 leader_election.cc:290] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:32.891232 27703 raft_consensus.cc:3060] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:32.884181 27676 consensus_queue.cc:1048] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:11:32.896857 27568 raft_consensus.cc:3060] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:32.897943 27773 raft_consensus.cc:2749] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:32.891433 27383 consensus_queue.cc:1048] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:11:32.920149 25304 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5"
dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
mode: GRACEFUL
new_leader_uuid: "79d99c0e498349bda74127365219e468"
 from {username='slave'} at 127.0.0.1:35660
I20260709 13:11:32.932013 25304 raft_consensus.cc:606] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 6 LEADER]: Received request to transfer leadership to TS 79d99c0e498349bda74127365219e468
I20260709 13:11:32.900796 27586 raft_consensus.cc:493] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:32.928359 25375 raft_consensus.cc:2468] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 4.
I20260709 13:11:32.903918 27742 raft_consensus.cc:2749] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:32.915596 27754 raft_consensus.cc:3060] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:32.915475 27620 raft_consensus.cc:697] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 6 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:32.942145 27586 raft_consensus.cc:3060] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:32.954121 25305 raft_consensus.cc:2368] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 5. Current term is 6.
W20260709 13:11:32.960990 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 80774.2us
W20260709 13:11:32.968200 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 88567us
I20260709 13:11:32.949641 27695 raft_consensus.cc:3055] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:32.969816 27695 raft_consensus.cc:740] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:32.970047 27620 consensus_queue.cc:237] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:32.967145 25901 raft_consensus.cc:1240] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:32.970626 27695 consensus_queue.cc:260] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:32.971896 27695 raft_consensus.cc:3060] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:32.969486 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 76141us
I20260709 13:11:32.975596 25270 leader_election.cc:304] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:32.978681 25301 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87"
dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
mode: GRACEFUL
new_leader_uuid: "1f539ba21487460085b837e7529a78ce"
 from {username='slave'} at 127.0.0.1:35660
I20260709 13:11:32.979984 25345 leader_election.cc:304] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:32.981336 27733 raft_consensus.cc:3055] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:32.981724 27733 raft_consensus.cc:740] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:32.982599 27733 consensus_queue.cc:260] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:32.983731 27733 raft_consensus.cc:3060] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:32.985924 27781 raft_consensus.cc:2749] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:11:32.987776 27775 log.cc:927] Time spent T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
W20260709 13:11:32.988705 27778 log.cc:927] Time spent T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
W20260709 13:11:32.990388 25114 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d56909a48cf841eb99365741e9e29e93 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 79d99c0e498349bda74127365219e468 (127.23.140.67:34091) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 79d99c0e498349bda74127365219e468 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:11:33.000739 27434 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.966877 27578 consensus_queue.cc:1059] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:11:33.004416 25907 raft_consensus.cc:1275] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:11:33.007581 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:11:32.997584 27724 log.cc:927] Time spent T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 1.114s	user 0.004s	sys 0.007s
I20260709 13:11:33.026427 27578 raft_consensus.cc:3055] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:33.026859 27578 raft_consensus.cc:740] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:33.027745 27578 consensus_queue.cc:260] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:33.028862 27578 raft_consensus.cc:3060] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:33.034057 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 58529.2us
I20260709 13:11:33.034852 25270 leader_election.cc:304] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:11:33.006903 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:33.036021 25270 leader_election.cc:304] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:33.037418 27691 raft_consensus.cc:2804] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:33.001317 27434 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:33.037923 27691 raft_consensus.cc:697] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 5 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:33.038023 26772 raft_consensus.cc:2749] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:33.038887 27691 consensus_queue.cc:237] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:33.039943 27434 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:33.043159 27686 raft_consensus.cc:515] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:33.043334 27564 consensus_queue.cc:1048] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:33.045624 25379 raft_consensus.cc:1275] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:33.046494 26772 raft_consensus.cc:493] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.076105 26772 raft_consensus.cc:515] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:33.047386 25302 raft_consensus.cc:1275] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:11:33.065367 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 167733us
I20260709 13:11:33.082064 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:33.082926 25226 raft_consensus.cc:2468] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 4.
I20260709 13:11:33.083978 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:33.088116 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:33.004819 27586 raft_consensus.cc:515] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:33.090124 25222 raft_consensus.cc:2393] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 3: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:33.095227 26772 leader_election.cc:290] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:33.099040 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:33.100740 27609 raft_consensus.cc:515] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:33.102319 27686 leader_election.cc:290] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:33.102835 27609 leader_election.cc:290] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:33.104417 27568 raft_consensus.cc:515] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:33.105985 27789 consensus_queue.cc:1048] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:33.107111 27568 leader_election.cc:290] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:33.110225 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:33.111516 25376 raft_consensus.cc:3060] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:33.111703 25904 raft_consensus.cc:1275] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:33.110591 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:33.116183 25371 raft_consensus.cc:3060] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:11:33.117831 27765 raft_consensus.cc:515] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:33.118664 25376 raft_consensus.cc:2468] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 6.
I20260709 13:11:33.118950 25270 leader_election.cc:304] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:33.119932 27765 leader_election.cc:290] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:33.120185 25270 leader_election.cc:304] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:33.121337 25270 leader_election.cc:304] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:33.121960 27586 leader_election.cc:290] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:33.122267 27609 raft_consensus.cc:2749] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:33.122789 25902 raft_consensus.cc:2393] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 6: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:11:33.123126 27686 raft_consensus.cc:2804] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:33.123510 27686 raft_consensus.cc:493] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:33.123598 25195 leader_election.cc:304] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:11:33.123929 27686 raft_consensus.cc:3060] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:33.124871 27564 raft_consensus.cc:2804] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:33.125381 27564 raft_consensus.cc:697] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 4 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:33.126127 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:33.126242 27564 consensus_queue.cc:237] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:33.126739 25227 raft_consensus.cc:2468] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 5.
I20260709 13:11:33.127316 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:33.115391 27787 consensus_queue.cc:1048] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:33.127949 25226 raft_consensus.cc:3060] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:33.103008 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:33.143114 25379 raft_consensus.cc:2468] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 3.
I20260709 13:11:33.130537 25270 leader_election.cc:304] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:33.141924 25370 raft_consensus.cc:1275] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:11:33.089706 27544 raft_consensus.cc:3055] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:33.145680 25270 leader_election.cc:304] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:33.145102 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:33.146512 26772 consensus_queue.cc:1048] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:33.152942 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:33.153676 25227 raft_consensus.cc:3060] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:33.160813 25229 raft_consensus.cc:2468] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 6.
I20260709 13:11:33.163700 25371 raft_consensus.cc:2468] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 4.
I20260709 13:11:33.165009 25226 raft_consensus.cc:2468] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 6.
I20260709 13:11:33.146201 27544 raft_consensus.cc:740] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:33.177229 25227 raft_consensus.cc:2468] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 6.
I20260709 13:11:33.115341 27703 raft_consensus.cc:515] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:33.166440 27620 raft_consensus.cc:2804] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:33.160495 27695 consensus_queue.cc:1059] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:11:33.183785 27783 raft_consensus.cc:2804] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:33.167865 27499 raft_consensus.cc:493] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.171849 27568 raft_consensus.cc:2804] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:33.194510 25343 leader_election.cc:304] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:33.183779 27762 raft_consensus.cc:493] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.198733 27762 raft_consensus.cc:515] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:33.201413 27762 leader_election.cc:290] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:33.196754 27233 raft_consensus.cc:3055] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:33.202183 27233 raft_consensus.cc:740] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:33.203118 27233 consensus_queue.cc:260] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:33.204510 27233 raft_consensus.cc:3060] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:33.214424 25227 raft_consensus.cc:1240] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:33.197234 27499 raft_consensus.cc:515] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:33.218482 27499 leader_election.cc:290] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:33.212389 27783 raft_consensus.cc:697] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 6 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:33.220919 27783 consensus_queue.cc:237] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:33.221958 27754 raft_consensus.cc:515] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:33.224058 27754 leader_election.cc:290] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:33.224568 25301 raft_consensus.cc:606] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Received request to transfer leadership to TS 1f539ba21487460085b837e7529a78ce
I20260709 13:11:33.224958 25301 raft_consensus.cc:614] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:33.225462 27544 consensus_queue.cc:260] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:33.226583 27544 raft_consensus.cc:3060] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:33.228951 27703 leader_election.cc:290] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:33.195479 27620 raft_consensus.cc:697] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 6 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:33.231376 27620 consensus_queue.cc:237] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:33.191702 27568 raft_consensus.cc:493] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:33.235684 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:11:33.242467 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 96893.8us
I20260709 13:11:33.190168 27512 raft_consensus.cc:493] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:33.244786 25229 raft_consensus.cc:1275] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:11:33.249526 25228 raft_consensus.cc:1275] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:11:33.249907 25228 pending_rounds.cc:85] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce: Aborting all ops after (but not including) 6
I20260709 13:11:33.250136 25228 pending_rounds.cc:107] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:11:33.250443 25228 raft_consensus.cc:2889] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:33.250830 25194 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:11:33.255008 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:33.255856 25229 raft_consensus.cc:2393] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 4: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:33.188762 27772 raft_consensus.cc:515] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:33.244048 27568 raft_consensus.cc:3060] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:33.258092 25270 leader_election.cc:304] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:33.257790 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:33.261626 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:33.262203 25229 raft_consensus.cc:3060] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:33.262610 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:33.268654 25222 raft_consensus.cc:3060] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:33.258101 27703 raft_consensus.cc:493] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.259795 27499 raft_consensus.cc:2804] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:33.255998 27597 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.272537 25874 leader_election.cc:304] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:11:33.273028 27738 raft_consensus.cc:493] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:33.273900 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:33.275723 25874 leader_election.cc:304] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:11:33.281764 25227 raft_consensus.cc:2468] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 4.
I20260709 13:11:33.249221 27332 raft_consensus.cc:2764] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
W20260709 13:11:33.283936 25270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:33.282130 25874 leader_election.cc:304] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:11:33.286010 25874 leader_election.cc:304] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:11:33.286964 25222 raft_consensus.cc:2468] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 6.
I20260709 13:11:33.288165 25226 raft_consensus.cc:1240] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:33.288206 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:33.288281 27794 raft_consensus.cc:2804] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:33.290216 27794 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:33.290510 25229 raft_consensus.cc:2468] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 4.
I20260709 13:11:33.290704 27794 raft_consensus.cc:3060] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:33.268344 27712 leader_election.cc:290] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:33.274154 27499 raft_consensus.cc:697] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 3 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:33.248678 27512 raft_consensus.cc:515] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:33.275249 27586 raft_consensus.cc:2804] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:33.302250 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:33.306221 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:33.306382 25298 raft_consensus.cc:3060] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:33.302505 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:33.287010 27609 raft_consensus.cc:2804] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:33.296654 27434 raft_consensus.cc:2804] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:33.318917 27434 raft_consensus.cc:697] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:33.319933 27434 consensus_queue.cc:237] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:33.322139 27556 raft_consensus.cc:2764] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 13:11:33.322988 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 128567us
I20260709 13:11:33.323508 27512 leader_election.cc:290] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:33.324342 27654 raft_consensus.cc:2804] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:33.324743 27654 raft_consensus.cc:493] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:33.325071 27654 raft_consensus.cc:3060] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:33.325240 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:33.308362 27586 raft_consensus.cc:493] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:33.328573 27586 raft_consensus.cc:3060] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:33.330302 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:33.273981 27703 raft_consensus.cc:515] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:11:33.332187 27686 raft_consensus.cc:515] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:33.307267 25899 raft_consensus.cc:3060] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:33.308537 25297 raft_consensus.cc:2368] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 6. Current term is 7.
I20260709 13:11:33.310110 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:33.275971 27738 raft_consensus.cc:515] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:33.334017 25299 raft_consensus.cc:3060] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:33.336120 27738 leader_election.cc:290] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:33.336196 27544 raft_consensus.cc:493] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:33.297441 27793 raft_consensus.cc:493] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.336936 27793 raft_consensus.cc:515] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:33.338692 27383 raft_consensus.cc:993] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468: : Instructing follower 6c4b021f3f9e41adb75e870a08ad88b6 to start an election
I20260709 13:11:33.339078 27793 leader_election.cc:290] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:33.339162 27383 raft_consensus.cc:1081] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 5 LEADER]: Signalling peer 6c4b021f3f9e41adb75e870a08ad88b6 to start an election
I20260709 13:11:33.313601 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:33.342031 25302 raft_consensus.cc:3060] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:33.315253 27797 raft_consensus.cc:493] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.274569 27597 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:33.323614 25343 leader_election.cc:304] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:11:33.342677 25872 leader_election.cc:336] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Timed out: RequestConsensusVote RPC to 127.23.140.66:33127 timed out after 1.587s (SENT)
I20260709 13:11:33.333519 27703 leader_election.cc:290] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361)
I20260709 13:11:33.369333 25302 raft_consensus.cc:2468] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 7.
I20260709 13:11:33.354018 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:33.337270 27332 raft_consensus.cc:493] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:33.316718 27772 leader_election.cc:290] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:33.392886 27586 raft_consensus.cc:515] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:33.394039 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:33.395155 25370 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "275226661cc840559134f8c9e5b15719"
dest_uuid: "79d99c0e498349bda74127365219e468"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:36248
I20260709 13:11:33.395702 25370 raft_consensus.cc:606] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 5 LEADER]: Received request to transfer leadership
I20260709 13:11:33.344494 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:33.288969 27517 raft_consensus.cc:2804] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:11:33.321563 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 341595us
I20260709 13:11:33.400691 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:33.400952 25345 leader_election.cc:400] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 election: Vote denied by peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361) with higher term. Message: Invalid argument: T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 5. Current term is 6.
I20260709 13:11:33.401358 25345 leader_election.cc:403] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:11:33.307108 25271 leader_election.cc:304] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:33.337023 27544 raft_consensus.cc:515] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:33.354839 25343 leader_election.cc:304] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:33.356086 25899 raft_consensus.cc:2468] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 6.
W20260709 13:11:33.402917 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 60257.3us
I20260709 13:11:33.353984 27654 raft_consensus.cc:515] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:33.389542 27686 leader_election.cc:290] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:33.390009 27332 raft_consensus.cc:515] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:33.399111 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:33.365979 25299 raft_consensus.cc:2468] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 4.
W20260709 13:11:33.408541 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 53807us
I20260709 13:11:33.355068 27486 raft_consensus.cc:2804] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:11:33.397861 27776 log.cc:927] Time spent T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.410s	user 0.000s	sys 0.002s
I20260709 13:11:33.417128 25343 leader_election.cc:304] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:11:33.418183 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 111144us
I20260709 13:11:33.424544 25298 raft_consensus.cc:2468] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 6.
I20260709 13:11:33.428548 25271 leader_election.cc:304] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:33.358819 27741 consensus_queue.cc:1059] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:11:33.412422 27765 raft_consensus.cc:2804] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:33.413007 27517 raft_consensus.cc:697] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:33.410125 27609 raft_consensus.cc:697] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 4 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:33.417964 27486 raft_consensus.cc:493] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:33.435582 25345 leader_election.cc:304] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:33.417659 27649 raft_consensus.cc:2749] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361) with higher term. Message: Invalid argument: T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 5. Current term is 6.
I20260709 13:11:33.442066 27544 leader_election.cc:290] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:33.396593 25904 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "275226661cc840559134f8c9e5b15719"
dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
 from {username='slave'} at 127.0.0.1:50060
I20260709 13:11:33.445186 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:33.429860 27564 raft_consensus.cc:2749] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:33.353701 27499 consensus_queue.cc:237] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:33.459093 27517 consensus_queue.cc:237] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:33.461328 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:33.434125 27381 raft_consensus.cc:2804] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:33.462211 25901 raft_consensus.cc:2368] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 5. Current term is 6.
I20260709 13:11:33.448588 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:33.463352 25372 raft_consensus.cc:3060] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:33.438828 27765 raft_consensus.cc:493] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:33.466682 27765 raft_consensus.cc:3060] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:33.467693 27794 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:33.448923 27586 leader_election.cc:290] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:33.470938 25904 raft_consensus.cc:493] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:33.471433 25904 raft_consensus.cc:3060] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:33.472550 27609 consensus_queue.cc:237] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:33.475296 27556 raft_consensus.cc:2804] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:33.475603 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:33.475920 27556 raft_consensus.cc:697] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 4 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:33.476269 25378 raft_consensus.cc:3060] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:33.478847 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:33.480996 25344 leader_election.cc:400] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085) with higher term. Message: Invalid argument: T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 5. Current term is 6.
I20260709 13:11:33.481321 25344 leader_election.cc:403] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:33.449234 27654 leader_election.cc:290] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:33.450839 27686 raft_consensus.cc:2749] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:33.485849 27381 raft_consensus.cc:697] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 6 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:33.486965 27381 consensus_queue.cc:237] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:33.425220 27383 consensus_queue.cc:1048] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:11:33.462002 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:33.474735 27735 raft_consensus.cc:493] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
W20260709 13:11:33.453934 25194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:33.370191 27797 raft_consensus.cc:515] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:33.489881 25374 raft_consensus.cc:2393] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 5: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:33.453362 25271 leader_election.cc:304] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:33.438118 27340 raft_consensus.cc:493] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:33.447045 27486 raft_consensus.cc:3060] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:33.519796 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 66464.1us
I20260709 13:11:33.531349 25378 raft_consensus.cc:2468] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 8.
I20260709 13:11:33.537719 25271 leader_election.cc:304] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
W20260709 13:11:33.543244 25175 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:11:33.543831 25175 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 275226661cc840559134f8c9e5b15719 already in progress
W20260709 13:11:33.544135 25175 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 275226661cc840559134f8c9e5b15719 already in progress
I20260709 13:11:33.545890 27771 raft_consensus.cc:493] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:33.546383 27794 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:33.546520 27771 raft_consensus.cc:515] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:33.547747 25904 raft_consensus.cc:515] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:33.548883 27771 leader_election.cc:290] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:33.553598 25904 leader_election.cc:290] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:33.476987 27556 consensus_queue.cc:237] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:33.555478 27797 leader_election.cc:290] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:33.558353 25376 raft_consensus.cc:1275] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:11:33.498030 27676 raft_consensus.cc:493] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.498270 27654 raft_consensus.cc:3060] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:11:33.496929 27738 raft_consensus.cc:493] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:33.582409 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 146895us
I20260709 13:11:33.584028 25345 leader_election.cc:304] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:33.585487 25345 leader_election.cc:304] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:33.535130 27686 raft_consensus.cc:2749] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:33.586798 27806 raft_consensus.cc:3060] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:33.587671 27738 raft_consensus.cc:515] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:33.593237 25345 leader_election.cc:304] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:33.595177 25345 leader_election.cc:304] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:33.599815 25345 leader_election.cc:304] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:33.607896 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:33.608686 25300 raft_consensus.cc:3060] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:33.610606 25271 leader_election.cc:304] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:33.588012 27649 raft_consensus.cc:2749] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:33.534080 27340 raft_consensus.cc:515] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:33.617581 25270 leader_election.cc:304] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:33.518070 27735 raft_consensus.cc:515] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:33.594383 27812 raft_consensus.cc:2749] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:33.598423 27383 raft_consensus.cc:2804] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:33.626225 25300 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 6.
I20260709 13:11:33.588871 27676 raft_consensus.cc:515] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:33.603938 27480 raft_consensus.cc:2749] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:33.629698 25345 leader_election.cc:304] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:33.611814 27544 raft_consensus.cc:2749] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:33.637481 25372 raft_consensus.cc:2468] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 7.
I20260709 13:11:33.638844 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:33.604620 27797 consensus_queue.cc:1048] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:11:33.653105 27597 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:33.653673 27564 consensus_queue.cc:1048] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:33.631973 27620 consensus_queue.cc:1048] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:11:33.639974 27793 raft_consensus.cc:2749] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:11:33.658548 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:33.641713 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:33.642771 25302 raft_consensus.cc:1240] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:33.625206 27781 raft_consensus.cc:2804] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:33.659242 25300 raft_consensus.cc:3060] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:33.618903 27787 consensus_queue.cc:1048] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:11:33.635059 27649 consensus_queue.cc:1048] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:11:33.644524 27812 raft_consensus.cc:2804] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:33.646036 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:33.647646 27340 leader_election.cc:290] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:33.648156 27480 raft_consensus.cc:493] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:33.648962 27332 leader_election.cc:290] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:33.627712 27383 raft_consensus.cc:493] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:33.657542 27735 leader_election.cc:290] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:33.669090 25298 raft_consensus.cc:1240] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:33.668200 27805 raft_consensus.cc:493] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:33.622843 27568 raft_consensus.cc:515] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:33.677222 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:33.678491 27480 raft_consensus.cc:515] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:11:33.680871 25372 raft_consensus.cc:1275] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:11:33.682088 25901 raft_consensus.cc:1275] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:11:33.679960 27383 raft_consensus.cc:3060] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:33.692242 27597 raft_consensus.cc:493] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:33.692862 27597 raft_consensus.cc:515] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:33.694875 27597 leader_election.cc:290] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:33.695686 27779 raft_consensus.cc:3055] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:33.696102 27779 raft_consensus.cc:740] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:33.700322 25300 raft_consensus.cc:2468] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 6.
I20260709 13:11:33.704362 27779 consensus_queue.cc:260] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:33.705092 27676 leader_election.cc:290] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:33.705864 27779 raft_consensus.cc:3060] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:33.695683 27806 raft_consensus.cc:2749] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:33.709913 27597 raft_consensus.cc:493] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:33.710472 27597 raft_consensus.cc:515] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:33.710963 27383 raft_consensus.cc:515] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:33.712376 27597 leader_election.cc:290] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:33.714403 25270 leader_election.cc:304] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:33.716325 27609 raft_consensus.cc:2804] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:33.716817 27609 raft_consensus.cc:697] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 7 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:33.717136 27797 consensus_queue.cc:1048] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:33.658469 27486 raft_consensus.cc:515] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:33.713181 27383 leader_election.cc:290] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:33.681247 27812 raft_consensus.cc:697] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 6 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
W20260709 13:11:33.731003 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 101355us
I20260709 13:11:33.731945 25345 leader_election.cc:304] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:33.681092 27781 raft_consensus.cc:697] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 8 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:33.696674 27703 raft_consensus.cc:493] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:33.743564 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:33.717623 27609 consensus_queue.cc:237] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:33.747741 25298 raft_consensus.cc:1275] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:11:33.749485 25300 raft_consensus.cc:1240] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:11:33.740521 27735 raft_consensus.cc:2804] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:33.756562 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:33.741984 27738 leader_election.cc:290] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:33.718772 27805 raft_consensus.cc:515] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:33.760231 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:33.760936 25229 raft_consensus.cc:2393] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 6: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:11:33.762540 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:33.739353 27765 raft_consensus.cc:515] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:33.764467 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
W20260709 13:11:33.774503 27819 log.cc:927] Time spent T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:11:33.777966 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:33.778859 25901 raft_consensus.cc:2368] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 5. Current term is 6.
I20260709 13:11:33.782538 27806 raft_consensus.cc:493] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:33.783152 27806 raft_consensus.cc:515] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:33.785329 27806 leader_election.cc:290] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:33.785020 27781 consensus_queue.cc:237] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:33.786273 27812 consensus_queue.cc:237] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:33.788152 24113 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:11:33.788614 27765 leader_election.cc:290] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:33.742112 27703 raft_consensus.cc:515] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:33.790567 27486 leader_election.cc:290] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:33.791431 27703 leader_election.cc:290] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:33.791734 27568 leader_election.cc:290] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:33.765244 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:33.792939 27654 raft_consensus.cc:2749] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085) with higher term. Message: Invalid argument: T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 5. Current term is 6.
I20260709 13:11:33.791765 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:33.795768 25874 leader_election.cc:304] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:33.796955 25874 leader_election.cc:304] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:33.798071 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:33.799685 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:33.801323 25344 leader_election.cc:400] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085) with higher term. Message: Invalid argument: T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 5. Current term is 6.
I20260709 13:11:33.801695 25344 leader_election.cc:403] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:33.755214 27735 raft_consensus.cc:493] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:33.806452 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:33.809123 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:33.807595 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:33.839432 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:33.842674 25301 raft_consensus.cc:1240] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:11:33.843008 27597 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.844417 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:33.845237 25221 raft_consensus.cc:2393] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 5: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:33.844419 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:33.835690 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:33.845907 25227 raft_consensus.cc:2368] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 5. Current term is 6.
I20260709 13:11:33.844486 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:33.848088 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:33.848824 25228 raft_consensus.cc:3060] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:33.859086 25229 raft_consensus.cc:2468] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 6.
I20260709 13:11:33.807207 27741 raft_consensus.cc:2749] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:33.833781 27733 raft_consensus.cc:2749] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:33.801801 27794 raft_consensus.cc:493] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.838198 27735 raft_consensus.cc:3060] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:33.865677 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 47356.4us
W20260709 13:11:33.873690 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 72504.8us
I20260709 13:11:33.868721 25195 leader_election.cc:304] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:11:33.875902 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:33.877921 27486 raft_consensus.cc:3060] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:11:33.882756 25370 raft_consensus.cc:1240] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:11:33.877993 27817 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.883421 27805 leader_election.cc:290] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:33.883817 27817 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:33.884289 25376 raft_consensus.cc:1240] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:11:33.886816 25379 raft_consensus.cc:1240] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:11:33.890165 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:33.890720 25224 raft_consensus.cc:3060] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:33.890717 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:33.891465 25301 raft_consensus.cc:2468] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 6.
I20260709 13:11:33.892764 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:33.893386 25379 raft_consensus.cc:2410] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:11:33.894981 25375 raft_consensus.cc:1240] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:33.903626 25379 raft_consensus.cc:1240] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:33.904836 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:33.908223 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:33.869951 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:33.807061 27797 consensus_queue.cc:1048] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 13:11:33.864588 27676 consensus_queue.cc:1059] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:11:33.920948 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:33.885594 27818 raft_consensus.cc:493] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.878901 27556 raft_consensus.cc:493] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:33.890100 27772 raft_consensus.cc:2804] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:33.926661 25370 raft_consensus.cc:1275] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:11:33.924882 25228 raft_consensus.cc:2468] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 7.
I20260709 13:11:33.947546 25228 raft_consensus.cc:1275] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:33.929569 25375 raft_consensus.cc:1240] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:33.868436 27597 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:33.942685 27578 raft_consensus.cc:993] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19: : Instructing follower 79d99c0e498349bda74127365219e468 to start an election
I20260709 13:11:33.950606 25228 raft_consensus.cc:1275] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:33.954659 25874 leader_election.cc:304] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:11:33.959502 25301 raft_consensus.cc:1240] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 8 LEADER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:34.001202 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:34.030894 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:33.889703 27794 raft_consensus.cc:515] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:34.037698 25224 raft_consensus.cc:2468] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 6.
I20260709 13:11:34.047566 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:34.103960 25379 raft_consensus.cc:1240] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:34.050076 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:34.089951 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:34.145538 25297 raft_consensus.cc:1240] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:34.159061 25223 raft_consensus.cc:2468] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 5.
W20260709 13:11:34.090183 27822 log.cc:927] Time spent T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.216s	user 0.000s	sys 0.001s
W20260709 13:11:34.122146 27826 log.cc:927] Time spent T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 13:11:34.031179 27779 raft_consensus.cc:2804] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:34.022090 27772 raft_consensus.cc:697] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 6 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:34.171391 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:33.955121 27556 raft_consensus.cc:515] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:34.183210 27772 consensus_queue.cc:237] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:33.944473 27818 raft_consensus.cc:515] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:34.141255 27480 leader_election.cc:290] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:34.092262 27733 consensus_queue.cc:1048] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.083s
I20260709 13:11:34.203085 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:34.323128 25370 raft_consensus.cc:1275] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:34.323237 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:34.203154 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:34.329988 25305 raft_consensus.cc:2468] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 6.
W20260709 13:11:34.334203 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 374675us
W20260709 13:11:34.264302 27826 log.cc:927] Time spent T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:11:34.342473 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:34.343449 25908 raft_consensus.cc:1240] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:34.176301 27805 raft_consensus.cc:1081] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 6 LEADER]: Signalling peer 79d99c0e498349bda74127365219e468 to start an election
I20260709 13:11:34.169178 27568 raft_consensus.cc:493] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:34.349932 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:34.321079 27817 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:34.234782 27823 log.cc:927] Time spent T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.313s	user 0.001s	sys 0.000s
I20260709 13:11:34.351444 25370 raft_consensus.cc:3060] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:34.279315 27828 log.cc:927] Time spent T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
W20260709 13:11:34.278661 27820 log.cc:927] Time spent T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:11:34.294507 27512 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.210350 27779 raft_consensus.cc:697] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
W20260709 13:11:34.365024 27829 log.cc:927] Time spent T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:11:34.388098 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:34.391708 25374 raft_consensus.cc:2468] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 6.
I20260709 13:11:34.386669 27794 leader_election.cc:290] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:34.402667 27779 consensus_queue.cc:237] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:34.354609 27568 raft_consensus.cc:515] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:34.438994 25374 raft_consensus.cc:1275] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:11:34.443765 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 99756.6us
I20260709 13:11:34.444536 25874 leader_election.cc:304] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:11:34.447273 27597 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:34.447696 27568 leader_election.cc:290] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:34.448997 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:34.449585 25374 raft_consensus.cc:3060] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:34.450400 25297 raft_consensus.cc:2468] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 7.
I20260709 13:11:34.452776 27794 raft_consensus.cc:2804] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:34.453295 27794 raft_consensus.cc:697] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:34.440137 27840 consensus_queue.cc:1048] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
W20260709 13:11:34.462329 27831 log.cc:927] Time spent T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:11:34.472759 25370 raft_consensus.cc:2468] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 6.
W20260709 13:11:34.477818 27825 log.cc:927] Time spent T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260709 13:11:34.393884 27512 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:34.478124 27833 log.cc:927] Time spent T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:11:34.486011 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:34.493252 25370 raft_consensus.cc:2393] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 6: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
W20260709 13:11:34.494519 25377 consensus_meta.cc:287] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.587s	user 0.008s	sys 0.001s
I20260709 13:11:34.494856 25377 raft_consensus.cc:2468] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 6.
I20260709 13:11:34.488749 24113 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:11:34.484683 27735 consensus_meta.cc:287] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.565s	user 0.007s	sys 0.003s
I20260709 13:11:34.478547 27556 leader_election.cc:290] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:34.497047 27839 log.cc:927] Time spent T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:11:34.501637 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
W20260709 13:11:34.504778 27804 log.cc:927] Time spent T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.909s	user 0.000s	sys 0.009s
I20260709 13:11:34.507082 27818 leader_election.cc:290] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:34.507668 27794 consensus_queue.cc:237] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:34.510694 27512 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:34.511119 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:34.554814 25372 raft_consensus.cc:3060] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:34.518568 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:34.506286 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:34.518498 27381 raft_consensus.cc:493] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.521507 27480 consensus_queue.cc:1059] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:34.523030 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:34.523658 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:34.519546 27735 raft_consensus.cc:515] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:34.526674 27840 consensus_queue.cc:1048] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:34.528235 27233 raft_consensus.cc:3055] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:34.582247 25370 raft_consensus.cc:1275] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:34.562877 25345 leader_election.cc:304] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:34.565718 25379 raft_consensus.cc:2468] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 5.
W20260709 13:11:34.599066 27827 log.cc:927] Time spent T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.248s	user 0.001s	sys 0.000s
I20260709 13:11:34.619760 25378 raft_consensus.cc:3060] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:34.626364 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 63589.7us
I20260709 13:11:34.634356 25372 raft_consensus.cc:2468] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 7.
W20260709 13:11:34.634635 25194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:34.635607 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:34.636245 25379 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 3.
I20260709 13:11:34.637941 25345 leader_election.cc:400] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361) with higher term. Message: Invalid argument: T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 5. Current term is 6.
I20260709 13:11:34.640564 25378 raft_consensus.cc:2468] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 5.
I20260709 13:11:34.584487 27233 raft_consensus.cc:740] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:34.638685 25345 leader_election.cc:304] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:34.654415 27817 raft_consensus.cc:2764] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 13:11:34.577579 27381 raft_consensus.cc:515] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:34.655752 25345 leader_election.cc:304] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:34.641521 27771 raft_consensus.cc:493] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:34.666721 27466 raft_consensus.cc:493] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:34.668377 27817 raft_consensus.cc:2804] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:34.667865 25902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50058 (request call id 604) took 1406 ms. Trace:
W20260709 13:11:34.676692 27486 consensus_meta.cc:287] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.770s	user 0.008s	sys 0.003s
I20260709 13:11:34.667493 27771 raft_consensus.cc:515] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:34.684674 27597 raft_consensus.cc:493] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
W20260709 13:11:34.694979 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 157005us
I20260709 13:11:34.675971 27466 raft_consensus.cc:515] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:34.692263 27842 log.cc:927] Time spent T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 13:11:34.699431 27779 consensus_queue.cc:1048] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:34.701618 25873 leader_election.cc:304] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:34.702499 27779 raft_consensus.cc:2804] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:34.702908 27779 raft_consensus.cc:493] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:34.703277 27779 raft_consensus.cc:3060] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:34.703431 27771 leader_election.cc:290] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:34.691311 27486 raft_consensus.cc:2749] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085) with higher term. Message: Invalid argument: T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 5. Current term is 6.
I20260709 13:11:34.708359 25374 raft_consensus.cc:2468] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 6.
I20260709 13:11:34.673632 27233 consensus_queue.cc:260] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:34.716929 25371 raft_consensus.cc:2468] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 6.
I20260709 13:11:34.711534 27654 raft_consensus.cc:2749] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:34.689288 27817 raft_consensus.cc:697] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 5 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:34.725911 27381 leader_election.cc:290] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:34.715309 27466 leader_election.cc:290] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:34.726751 27499 raft_consensus.cc:493] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.727241 27499 raft_consensus.cc:515] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:34.729238 27499 leader_election.cc:290] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:34.730733 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:34.731385 25908 raft_consensus.cc:2468] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 9.
I20260709 13:11:34.714694 27787 raft_consensus.cc:493] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.732270 27787 raft_consensus.cc:515] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:34.737874 27787 leader_election.cc:290] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:34.708827 27597 raft_consensus.cc:515] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:34.741945 27466 raft_consensus.cc:493] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.742466 27466 raft_consensus.cc:515] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:34.743216 27597 leader_election.cc:290] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:34.744335 27466 leader_election.cc:290] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:34.747933 25344 leader_election.cc:304] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:34.687459 25902 rpcz_store.cc:276] 0709 13:11:33.251708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:33.258159 (+  6451us) service_pool.cc:224] Handling call
0709 13:11:33.263298 (+  5139us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:33.263719 (+   421us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:11:33.263755 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:33.315060 (+ 51305us) spinlock_profiling.cc:243] Waited 5.13 ms on lock 0x7b2c00012be8. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72e568a11 00007fd72e578372 00007fd72fcaaa01 00007fd72fc6f43a 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2
0709 13:11:33.315461 (+   401us) log.cc:844] Serialized 26 byte log entry
0709 13:11:33.415002 (+ 99541us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:33.429088 (+ 14086us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:33.431503 (+  2415us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:34.504280 (+1072777us) spinlock_profiling.cc:243] Waited 8.55 ms on lock 0x7b4400022b4c. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72caa8c85 00007fd72caa96a2 00007fd72f81b1db 00007fd72f816aaf 00007fd72f80a86e 00007fd72f809bb6 00007fd72f8097d8 00007fd72f813221 00007fd72f8131d9 00007fd72f813169
0709 13:11:34.651187 (+146907us) raft_consensus.cc:1685] finished
0709 13:11:34.651220 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:34.658030 (+  6810us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2256,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"spinlock_wait_cycles":31471744,"thread_start_us":91907,"threads_started":1,"wal-append.queue_time_us":204446}
I20260709 13:11:34.754688 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:34.756963 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:34.757565 25229 raft_consensus.cc:2468] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 5.
I20260709 13:11:34.760092 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:34.763800 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:34.764453 25230 raft_consensus.cc:3060] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:34.763878 27817 consensus_queue.cc:237] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:34.766469 25904 raft_consensus.cc:1275] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:11:34.767791 27779 raft_consensus.cc:515] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:34.768187 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:34.769126 27381 raft_consensus.cc:2804] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:34.769516 27381 raft_consensus.cc:493] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:34.769637 25905 raft_consensus.cc:1275] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:34.769912 27381 raft_consensus.cc:3060] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:34.770813 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:34.746227 27568 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:34.771950 27568 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:34.773931 27568 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:34.776722 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:34.777405 25904 raft_consensus.cc:2468] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 6.
I20260709 13:11:34.779501 25230 raft_consensus.cc:2468] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 7.
I20260709 13:11:34.781975 27779 leader_election.cc:290] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:34.785835 25343 leader_election.cc:400] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 election: Vote denied by peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127) with higher term. Message: Invalid argument: T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 6. Current term is 7.
I20260709 13:11:34.786684 25343 leader_election.cc:304] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
W20260709 13:11:34.787894 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 132203us
I20260709 13:11:34.788045 25343 leader_election.cc:304] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:34.792433 25222 raft_consensus.cc:1275] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:11:34.789587 25229 raft_consensus.cc:1275] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:11:34.793669 25229 pending_rounds.cc:85] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce: Aborting all ops after (but not including) 3
I20260709 13:11:34.793991 25229 pending_rounds.cc:107] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:11:34.794269 25229 raft_consensus.cc:2889] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:34.792155 25225 raft_consensus.cc:1275] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:11:34.793394 25343 leader_election.cc:304] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:34.798859 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:34.807447 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:34.810701 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:34.811578 25229 raft_consensus.cc:2468] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 4.
I20260709 13:11:34.803213 27556 raft_consensus.cc:2804] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:34.805790 27480 raft_consensus.cc:2804] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:34.803380 27649 raft_consensus.cc:2804] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:34.808209 27676 raft_consensus.cc:493] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.818295 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:34.818542 25376 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5"
dest_uuid: "79d99c0e498349bda74127365219e468"
 from {username='slave'} at 127.0.0.1:36254
I20260709 13:11:34.805545 27771 raft_consensus.cc:493] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.807021 27609 raft_consensus.cc:493] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:34.827273 25229 raft_consensus.cc:1275] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:34.827509 25195 leader_election.cc:304] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:34.829979 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:34.830535 25227 raft_consensus.cc:3060] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:34.824249 25376 raft_consensus.cc:493] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:34.831499 25376 raft_consensus.cc:3060] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:34.834690 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:34.825860 27556 raft_consensus.cc:697] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 7 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:34.840927 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:34.841825 25229 raft_consensus.cc:3060] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:34.838877 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:34.843870 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:34.816226 27848 consensus_queue.cc:1059] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:11:34.846072 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:34.849332 25227 raft_consensus.cc:2468] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 5.
I20260709 13:11:34.834940 27735 leader_election.cc:290] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:34.838101 27597 raft_consensus.cc:493] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.854883 25223 raft_consensus.cc:1275] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:11:34.853075 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:34.840282 27783 raft_consensus.cc:2749] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:34.831190 27676 raft_consensus.cc:515] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:34.835696 27466 consensus_queue.cc:1059] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 13:11:34.831934 27771 raft_consensus.cc:515] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:34.866051 25376 raft_consensus.cc:515] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:34.832922 27849 consensus_queue.cc:1059] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:11:34.832317 27609 raft_consensus.cc:515] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:34.879895 25229 raft_consensus.cc:2468] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 5.
I20260709 13:11:34.882258 25376 leader_election.cc:290] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:34.883963 25225 raft_consensus.cc:1275] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:11:34.852344 27850 consensus_queue.cc:1059] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:11:34.867395 27779 raft_consensus.cc:493] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
W20260709 13:11:34.885723 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 45368.3us
I20260709 13:11:34.868058 27597 raft_consensus.cc:515] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:34.903591 25378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36254 (request call id 1793) took 1094 ms. Trace:
I20260709 13:11:34.904060 25378 rpcz_store.cc:276] 0709 13:11:33.806940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:33.807354 (+   414us) service_pool.cc:224] Handling call
0709 13:11:34.901116 (+1093762us) spinlock_profiling.cc:243] Waited 783 ms on lock 0x7b540033f254. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:34.901230 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1801962880}
I20260709 13:11:34.908496 27771 leader_election.cc:290] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:34.891251 27499 raft_consensus.cc:3055] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:34.914988 25195 leader_election.cc:304] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:34.881940 27556 consensus_queue.cc:237] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:34.888289 27779 raft_consensus.cc:515] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:34.919487 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 63029us
W20260709 13:11:34.922860 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 100173us
I20260709 13:11:34.925514 27486 raft_consensus.cc:493] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.915092 27499 raft_consensus.cc:740] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:34.930639 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:34.926018 27486 raft_consensus.cc:515] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:34.931640 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:34.932350 27597 leader_election.cc:290] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:34.933365 27486 leader_election.cc:290] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:34.933487 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:34.934101 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:34.922271 27848 consensus_queue.cc:1059] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:11:34.943728 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:34.944502 25379 raft_consensus.cc:3060] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:34.946033 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:34.946820 25372 raft_consensus.cc:2468] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 6.
I20260709 13:11:34.959015 25194 leader_election.cc:304] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:34.959787 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:34.960386 25229 raft_consensus.cc:2468] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 5.
I20260709 13:11:34.960433 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:34.889993 27783 consensus_queue.cc:1048] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:11:34.965332 27850 raft_consensus.cc:2749] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:35.000581 25229 raft_consensus.cc:1275] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:34.987239 27794 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.958626 27480 raft_consensus.cc:697] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 6 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:34.998478 27649 raft_consensus.cc:697] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 4 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
W20260709 13:11:35.015602 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 56672.4us
I20260709 13:11:35.018947 27866 raft_consensus.cc:2749] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:34.986178 27860 consensus_queue.cc:1059] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:11:35.010318 27676 leader_election.cc:290] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:35.008417 27851 raft_consensus.cc:493] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.014164 27609 leader_election.cc:290] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:35.033782 27858 log.cc:927] Time spent T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 13:11:35.035624 27851 raft_consensus.cc:515] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:35.012830 27794 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:35.003233 27499 consensus_queue.cc:260] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:35.047621 27233 raft_consensus.cc:3060] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:35.047369 27381 raft_consensus.cc:515] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:35.049768 27381 leader_election.cc:290] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:35.053059 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:35.055109 27860 consensus_queue.cc:1048] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:35.055639 27499 raft_consensus.cc:3060] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:35.057153 27480 consensus_queue.cc:237] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:11:35.058487 25297 raft_consensus.cc:1275] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:11:35.059695 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:35.060529 25298 raft_consensus.cc:2393] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 5: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:35.066260 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:35.067003 25194 leader_election.cc:304] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:35.073590 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:35.074393 25300 raft_consensus.cc:2393] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 5: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
W20260709 13:11:35.075380 27859 log.cc:927] Time spent T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:11:35.075558 27794 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:11:35.076656 27861 log.cc:927] Time spent T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:11:35.078274 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:35.078572 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:35.079234 25302 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 3.
I20260709 13:11:35.080440 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:35.054683 27578 raft_consensus.cc:493] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:35.088474 27578 raft_consensus.cc:515] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:35.089839 27871 consensus_queue.cc:1048] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:35.090713 27578 leader_election.cc:290] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:35.092717 27771 raft_consensus.cc:3055] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:35.093197 27771 raft_consensus.cc:740] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:35.094322 25301 raft_consensus.cc:2468] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 4.
I20260709 13:11:35.063593 27609 raft_consensus.cc:493] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.064000 27793 raft_consensus.cc:493] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:35.128782 27848 raft_consensus.cc:2749] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:35.165774 27676 raft_consensus.cc:3055] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:35.176440 27676 raft_consensus.cc:740] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:35.177349 27676 consensus_queue.cc:260] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:35.177865 27771 consensus_queue.cc:260] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:35.178660 27676 raft_consensus.cc:3060] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:35.179330 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:35.171237 25377 raft_consensus.cc:3055] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:35.182029 25377 raft_consensus.cc:740] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:35.182348 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:35.161729 27793 raft_consensus.cc:515] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:35.160413 27609 raft_consensus.cc:515] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:35.044768 27649 consensus_queue.cc:237] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:35.129489 27578 raft_consensus.cc:493] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:35.182777 25377 consensus_queue.cc:260] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:35.182915 25226 raft_consensus.cc:2468] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 6.
I20260709 13:11:35.393338 25377 raft_consensus.cc:3060] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:35.394694 27851 leader_election.cc:290] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:35.289580 27787 raft_consensus.cc:493] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.395920 27787 raft_consensus.cc:515] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:35.184202 25225 raft_consensus.cc:3055] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:35.396988 25225 raft_consensus.cc:740] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
W20260709 13:11:35.398151 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 331177us
I20260709 13:11:35.397961 25225 consensus_queue.cc:260] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:35.399121 25225 raft_consensus.cc:3060] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:35.399442 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:35.400211 25227 raft_consensus.cc:2468] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 6.
I20260709 13:11:35.402029 25379 raft_consensus.cc:2468] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 6.
I20260709 13:11:35.402552 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:35.403291 25300 raft_consensus.cc:3060] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:35.404109 25195 leader_election.cc:304] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:11:35.399235 27771 raft_consensus.cc:3060] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:35.406775 25194 leader_election.cc:304] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:11:35.408150 25377 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 6.
I20260709 13:11:35.408841 25874 leader_election.cc:304] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:11:35.413640 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:35.413527 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:35.225032 27840 raft_consensus.cc:493] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.227082 27818 raft_consensus.cc:493] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:35.436112 25195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:35.436863 25300 raft_consensus.cc:2468] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 4.
I20260709 13:11:35.320092 27568 raft_consensus.cc:493] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:35.416877 27870 raft_consensus.cc:2804] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:35.430117 27883 raft_consensus.cc:493] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.415665 27499 consensus_queue.cc:1048] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:11:35.433897 27609 leader_election.cc:290] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:35.418391 25379 raft_consensus.cc:1275] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:11:35.438410 25377 raft_consensus.cc:1240] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 7 LEADER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 6. Current term is 7. Ops: []
W20260709 13:11:35.416744 27812 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:11:35.445355 25194 leader_election.cc:304] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:35.417523 27772 raft_consensus.cc:2804] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:35.466497 27772 raft_consensus.cc:493] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:35.466913 27772 raft_consensus.cc:3060] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:35.456923 25225 raft_consensus.cc:1275] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:11:35.415894 27851 raft_consensus.cc:493] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:35.438027 27783 raft_consensus.cc:493] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.465812 27787 leader_election.cc:290] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:35.443490 27676 raft_consensus.cc:493] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:35.470110 25225 pending_rounds.cc:85] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce: Aborting all ops after (but not including) 3
I20260709 13:11:35.434734 27794 raft_consensus.cc:2804] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:35.403355 27578 raft_consensus.cc:515] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:35.569787 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:35.454785 27870 raft_consensus.cc:493] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:35.561726 25225 pending_rounds.cc:107] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:11:35.573258 25225 raft_consensus.cc:2889] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:11:35.573510 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:35.456586 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:35.437919 27517 consensus_queue.cc:1048] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.121s
W20260709 13:11:35.559623 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 114369us
I20260709 13:11:35.625674 25194 leader_election.cc:304] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:35.635897 25194 leader_election.cc:304] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:11:35.636991 25194 leader_election.cc:304] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:35.452852 27568 raft_consensus.cc:515] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:35.440685 27818 raft_consensus.cc:515] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:35.568957 27794 raft_consensus.cc:493] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:35.453696 27840 raft_consensus.cc:515] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:35.658552 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 229090us
I20260709 13:11:35.550156 27872 consensus_queue.cc:1059] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.190s
I20260709 13:11:35.558048 27609 raft_consensus.cc:493] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:35.649683 27866 raft_consensus.cc:2749] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:35.621850 27870 raft_consensus.cc:3060] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:35.697324 25372 raft_consensus.cc:1240] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:11:35.559098 27873 raft_consensus.cc:2749] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:35.649890 27850 raft_consensus.cc:2804] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:35.702997 25271 leader_election.cc:304] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:11:35.655982 27877 raft_consensus.cc:2749] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:35.564002 27783 raft_consensus.cc:515] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:35.655848 27855 raft_consensus.cc:493] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:35.671272 27794 raft_consensus.cc:3060] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:35.574052 27676 raft_consensus.cc:515] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:35.562335 27851 raft_consensus.cc:515] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:35.670898 27738 raft_consensus.cc:493] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
W20260709 13:11:35.710688 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 72455.9us
I20260709 13:11:35.462459 27883 raft_consensus.cc:515] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:35.741128 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:35.743429 25375 raft_consensus.cc:1275] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:35.747771 27779 leader_election.cc:290] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:35.749110 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:35.750833 25304 raft_consensus.cc:1275] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:11:35.751760 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:35.752450 27783 leader_election.cc:290] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:35.756302 27735 raft_consensus.cc:493] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:35.736737 27480 raft_consensus.cc:493] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:35.764916 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:35.815711 25908 raft_consensus.cc:3060] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:35.765343 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:35.765407 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:35.816862 25907 raft_consensus.cc:3060] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:11:35.774101 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 71106.5us
I20260709 13:11:35.817792 25271 leader_election.cc:304] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:35.819795 25271 leader_election.cc:304] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:35.715703 27850 raft_consensus.cc:493] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:35.786118 25194 leader_election.cc:304] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:11:35.757687 27466 raft_consensus.cc:3055] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:35.809697 25303 raft_consensus.cc:3055] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:35.821264 25303 raft_consensus.cc:740] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:35.750880 27840 leader_election.cc:290] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:35.784163 27586 raft_consensus.cc:493] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.764722 25899 raft_consensus.cc:1240] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:35.829882 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:35.830598 25225 raft_consensus.cc:2368] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 4. Current term is 5.
I20260709 13:11:35.831532 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:35.832195 25227 raft_consensus.cc:2468] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 9.
I20260709 13:11:35.710916 27609 raft_consensus.cc:515] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:35.766500 27855 raft_consensus.cc:515] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:35.825981 25345 leader_election.cc:304] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:35.843690 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:35.844355 25298 raft_consensus.cc:2468] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 6.
I20260709 13:11:35.828430 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:35.833912 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:35.845968 25224 raft_consensus.cc:3060] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:35.835083 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:35.837898 27783 raft_consensus.cc:2804] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:35.822100 25303 consensus_queue.cc:260] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:35.853523 27783 raft_consensus.cc:493] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:35.853873 25303 raft_consensus.cc:3060] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:35.854007 27783 raft_consensus.cc:3060] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:35.822956 27466 raft_consensus.cc:740] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:35.856263 27466 consensus_queue.cc:260] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:35.821609 25901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50060 (request call id 434) took 1308 ms. Trace:
I20260709 13:11:35.857937 25901 rpcz_store.cc:276] 0709 13:11:34.513398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:34.521655 (+  8257us) service_pool.cc:224] Handling call
0709 13:11:35.740964 (+1219309us) spinlock_profiling.cc:243] Waited 3.37 ms on lock 0x7b58001a3198. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72cb4ab71 00007fd72cb4aa22 00007fd735a63c09 00007fd734bbdee0 00007fd734c870ab 00007fd734c87131 00007fd734c350a0 00007fd734c34984 00007fd72e1af6d4 00007fd72e1af662
0709 13:11:35.821526 (+ 80562us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7758720}
I20260709 13:11:35.843539 27586 raft_consensus.cc:515] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:35.859488 27855 leader_election.cc:290] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:35.859606 27884 raft_consensus.cc:493] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.825925 27850 raft_consensus.cc:3060] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:35.860162 27884 raft_consensus.cc:515] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:35.861136 27586 leader_election.cc:290] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:35.862349 27897 raft_consensus.cc:493] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:35.862891 27897 raft_consensus.cc:515] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:35.864969 27880 log.cc:927] Time spent T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.304s	user 0.001s	sys 0.000s
I20260709 13:11:35.806694 27738 raft_consensus.cc:515] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:35.815225 27735 raft_consensus.cc:515] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:35.866492 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:35.867057 25305 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 3.
I20260709 13:11:35.836789 25225 raft_consensus.cc:1275] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:35.850106 25227 raft_consensus.cc:1275] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:35.845937 25304 raft_consensus.cc:2468] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 5.
I20260709 13:11:35.867832 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:11:35.891260 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:35.916010 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:35.916527 27233 consensus_meta.cc:287] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 0.868s	user 0.008s	sys 0.001s
W20260709 13:11:35.916978 27857 log.cc:927] Time spent T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 1.051s	user 0.000s	sys 0.002s
I20260709 13:11:35.918007 27578 leader_election.cc:290] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:35.918547 27578 raft_consensus.cc:2749] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:35.919183 27578 raft_consensus.cc:2749] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:11:35.920230 27881 log.cc:927] Time spent T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 13:11:35.922999 27884 leader_election.cc:290] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:35.865111 27870 raft_consensus.cc:515] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:35.925261 27870 leader_election.cc:290] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:35.857517 27466 raft_consensus.cc:3060] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:35.914448 27738 leader_election.cc:290] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:35.928450 25224 raft_consensus.cc:2468] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 10.
I20260709 13:11:35.930797 27676 leader_election.cc:290] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:35.931093 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:35.931679 25901 raft_consensus.cc:2468] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 5.
I20260709 13:11:35.932840 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:35.872524 25344 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
W20260709 13:11:35.936436 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 108043us
I20260709 13:11:35.938758 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:35.939229 25908 raft_consensus.cc:2468] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 7.
I20260709 13:11:35.951150 25303 raft_consensus.cc:2468] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 7.
I20260709 13:11:35.843703 27882 raft_consensus.cc:2804] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:35.849781 27793 leader_election.cc:290] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:35.966566 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 146848us
I20260709 13:11:35.969094 27883 leader_election.cc:290] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:35.969868 25222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54000 (request call id 383) took 1004 ms. Trace:
I20260709 13:11:35.867776 27735 leader_election.cc:290] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:35.869184 27840 raft_consensus.cc:493] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:35.943806 27779 raft_consensus.cc:493] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.619939 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:11:36.007400 27889 log.cc:927] Time spent T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.184s	user 0.000s	sys 0.000s
I20260709 13:11:36.010715 27818 leader_election.cc:290] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:36.011344 27818 raft_consensus.cc:2749] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:36.011950 27818 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:36.012431 27818 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:35.959471 27783 raft_consensus.cc:515] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:36.018543 27851 leader_election.cc:290] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:36.019093 27851 raft_consensus.cc:493] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.019748 27783 leader_election.cc:290] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:36.019508 27851 raft_consensus.cc:515] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:35.838166 27480 raft_consensus.cc:515] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:35.865636 27897 leader_election.cc:290] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:36.021708 27480 leader_election.cc:290] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:36.022249 27840 raft_consensus.cc:515] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:36.027345 27840 leader_election.cc:290] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:11:36.028689 27772 consensus_meta.cc:287] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 0.561s	user 0.004s	sys 0.004s
I20260709 13:11:36.022399 27779 raft_consensus.cc:515] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:36.022630 27735 raft_consensus.cc:2749] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:35.842247 27812 consensus_queue.cc:1048] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.137s
W20260709 13:11:36.032938 27771 consensus_meta.cc:287] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 0.615s	user 0.003s	sys 0.003s
I20260709 13:11:36.034474 27609 leader_election.cc:290] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:35.995306 25222 rpcz_store.cc:276] 0709 13:11:34.965784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:34.984776 (+ 18992us) service_pool.cc:224] Handling call
0709 13:11:34.985182 (+   406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:35.043177 (+ 57995us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:35.043209 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:35.063798 (+ 20589us) log.cc:844] Serialized 26 byte log entry
0709 13:11:35.681904 (+618106us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:35.681943 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:35.682012 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:35.969651 (+287639us) raft_consensus.cc:1685] finished
0709 13:11:35.969675 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:35.969812 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22669,"raft.queue_time_us":48382,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":2492,"thread_start_us":495792,"threads_started":2,"wal-append.queue_time_us":823098}
I20260709 13:11:36.036247 25228 raft_consensus.cc:1240] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:36.034546 27850 raft_consensus.cc:515] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:36.038599 25221 raft_consensus.cc:1240] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:36.040416 27850 leader_election.cc:290] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:36.041396 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:36.042191 25230 raft_consensus.cc:2468] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 7.
W20260709 13:11:36.044214 27862 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:11:36.045971 25302 raft_consensus.cc:1275] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:11:36.046468 25302 pending_rounds.cc:85] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19: Aborting all ops after (but not including) 3
I20260709 13:11:36.046798 25302 pending_rounds.cc:107] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:11:36.047091 25302 raft_consensus.cc:2889] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:36.047452 27568 leader_election.cc:290] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:36.048650 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:36.049551 25299 raft_consensus.cc:2368] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 4. Current term is 5.
I20260709 13:11:35.971998 27882 raft_consensus.cc:493] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:36.052536 27882 raft_consensus.cc:3060] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:36.057068 25907 raft_consensus.cc:2468] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 10.
I20260709 13:11:36.021500 27851 leader_election.cc:290] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:11:36.059648 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 81274.3us
I20260709 13:11:36.144812 27886 raft_consensus.cc:493] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.145200 25873 leader_election.cc:304] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:36.145445 27886 raft_consensus.cc:515] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:36.146456 27894 raft_consensus.cc:493] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:36.145896 27840 raft_consensus.cc:493] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:36.196064 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 109494us
I20260709 13:11:36.197150 25271 leader_election.cc:304] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:36.211030 25271 leader_election.cc:304] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:11:36.212713 25271 leader_election.cc:304] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:36.183935 27836 raft_consensus.cc:2804] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:36.218611 27898 raft_consensus.cc:493] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.219234 27836 raft_consensus.cc:697] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:36.219306 27898 raft_consensus.cc:515] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:11:36.220208 27836 consensus_queue.cc:237] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:36.122824 25900 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.007s	sys 0.010s
I20260709 13:11:36.147780 27840 raft_consensus.cc:515] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:36.227366 25271 leader_election.cc:304] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:36.230261 27883 raft_consensus.cc:2749] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:36.231148 27900 consensus_queue.cc:1048] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:36.231604 27840 leader_election.cc:290] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:36.146982 27894 raft_consensus.cc:515] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:36.234026 25271 leader_election.cc:304] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:36.234882 25271 leader_election.cc:304] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:36.235476 27884 raft_consensus.cc:2804] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:36.239504 27884 raft_consensus.cc:697] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 5 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:36.240486 27884 consensus_queue.cc:237] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:36.238160 27578 raft_consensus.cc:2804] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:36.241933 27899 raft_consensus.cc:2804] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:36.242271 27578 raft_consensus.cc:493] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:36.242398 27899 raft_consensus.cc:493] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:36.242690 27578 raft_consensus.cc:3060] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:36.242790 27899 raft_consensus.cc:3060] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:36.110870 27793 consensus_queue.cc:1048] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.120s
I20260709 13:11:36.247638 27793 raft_consensus.cc:2804] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:36.248029 27793 raft_consensus.cc:493] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:36.249621 27793 raft_consensus.cc:3060] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:36.250228 27818 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:11:36.251040 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:36.254233 27794 raft_consensus.cc:515] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:36.255846 25904 raft_consensus.cc:2393] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 6: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:11:36.029171 27772 raft_consensus.cc:515] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:36.258317 25301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57256 (request call id 1618) took 1206 ms. Trace:
I20260709 13:11:36.258657 25301 rpcz_store.cc:276] 0709 13:11:35.051806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:35.051943 (+   137us) service_pool.cc:224] Handling call
0709 13:11:36.258095 (+1206152us) spinlock_profiling.cc:243] Waited 27.4 ms on lock 0x7b5400099554. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:36.258226 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":62956416}
I20260709 13:11:36.258540 27772 leader_election.cc:290] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:36.229367 25900 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.760s	user 0.007s	sys 0.010s
I20260709 13:11:36.222199 27568 raft_consensus.cc:2749] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:11:36.295068 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 469133us
W20260709 13:11:36.295083 25195 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.016s	sys 0.052s
W20260709 13:11:36.296339 25195 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.017s	sys 0.052s
I20260709 13:11:36.280354 27586 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
W20260709 13:11:36.296614 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 652440us
I20260709 13:11:36.295805 25345 leader_election.cc:304] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:36.306171 25345 leader_election.cc:400] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 election: Vote denied by peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361) with higher term. Message: Invalid argument: T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 4. Current term is 5.
I20260709 13:11:36.306473 25345 leader_election.cc:403] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:11:36.307014 25271 leader_election.cc:304] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:11:36.307440 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:36.308881 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:36.309126 25345 leader_election.cc:304] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:36.309149 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:36.310191 25229 raft_consensus.cc:2468] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 5.
I20260709 13:11:36.225963 27609 consensus_queue.cc:1048] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.072s
I20260709 13:11:36.319375 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:36.321086 25305 raft_consensus.cc:1275] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:36.321370 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:36.318169 27654 raft_consensus.cc:2804] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:36.255846 27900 consensus_queue.cc:1048] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 13:11:36.292505 27898 leader_election.cc:290] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:36.330258 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:36.330754 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:36.331005 25225 raft_consensus.cc:2468] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 4.
I20260709 13:11:36.331847 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:36.332319 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:36.332959 25229 raft_consensus.cc:2468] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 7.
I20260709 13:11:36.333153 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:36.326494 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:36.333716 25222 raft_consensus.cc:2468] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 8.
I20260709 13:11:36.333995 25230 raft_consensus.cc:2468] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 7.
I20260709 13:11:36.291152 27840 raft_consensus.cc:493] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:36.292395 27512 raft_consensus.cc:493] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
W20260709 13:11:36.295756 27872 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.028s	sys 0.067s
I20260709 13:11:36.226531 27897 consensus_queue.cc:1048] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.077s
I20260709 13:11:36.332429 25224 raft_consensus.cc:2468] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 3.
I20260709 13:11:36.328938 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:36.322214 25297 raft_consensus.cc:2468] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 4.
I20260709 13:11:36.335846 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:36.336403 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:36.344215 25299 raft_consensus.cc:2393] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 6: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:36.315196 27855 raft_consensus.cc:2749] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361) with higher term. Message: Invalid argument: T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 4. Current term is 5.
W20260709 13:11:36.343328 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 470877us
I20260709 13:11:36.324005 27735 raft_consensus.cc:2804] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:36.347875 25230 raft_consensus.cc:1240] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 13:11:36.342020 27872 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.029s	sys 0.067s
I20260709 13:11:36.360638 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:36.315056 27586 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:36.361492 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:36.363008 27586 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:36.318843 27818 consensus_queue.cc:1048] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:11:36.363420 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:36.345513 27840 raft_consensus.cc:515] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:36.327194 27556 consensus_queue.cc:1048] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:11:36.364329 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:36.325003 27771 consensus_queue.cc:1048] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:11:36.365453 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:36.366156 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:36.326397 27568 raft_consensus.cc:2804] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:36.344836 27654 raft_consensus.cc:697] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 5 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:36.367245 27568 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:36.367690 27568 raft_consensus.cc:3060] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:36.367985 27654 consensus_queue.cc:237] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:36.345405 27812 consensus_queue.cc:1059] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:11:36.368734 27735 raft_consensus.cc:697] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 10 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:36.369699 27812 raft_consensus.cc:3055] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:36.369609 27735 consensus_queue.cc:237] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:36.370255 27812 raft_consensus.cc:740] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:36.371340 27812 consensus_queue.cc:260] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:36.372879 27812 raft_consensus.cc:3060] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:36.324425 27383 raft_consensus.cc:493] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:36.376034 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:36.376904 25227 raft_consensus.cc:2410] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:11:36.365597 27840 leader_election.cc:290] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:36.337911 27794 leader_election.cc:290] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:36.381727 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:36.381986 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:36.382592 25227 raft_consensus.cc:3060] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:36.382863 25230 raft_consensus.cc:2468] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 6.
I20260709 13:11:36.346967 27903 raft_consensus.cc:493] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:36.386199 25194 leader_election.cc:304] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:36.391830 25194 leader_election.cc:304] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:36.393026 25194 leader_election.cc:304] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
W20260709 13:11:36.387655 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 287834us
I20260709 13:11:36.390089 27793 raft_consensus.cc:515] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:36.394793 27772 consensus_queue.cc:1048] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:36.396180 27772 raft_consensus.cc:2749] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:36.394366 27872 raft_consensus.cc:2749] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:36.380033 27383 raft_consensus.cc:515] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:36.398197 27872 raft_consensus.cc:2804] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:36.398607 27872 raft_consensus.cc:493] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:36.398952 27872 raft_consensus.cc:3060] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:36.399729 27383 leader_election.cc:290] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:36.400127 25874 leader_election.cc:304] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:11:36.400202 25194 leader_election.cc:304] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:36.401535 25874 leader_election.cc:304] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:11:36.403339 27586 raft_consensus.cc:2804] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:36.403714 27586 raft_consensus.cc:493] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:36.404043 27586 raft_consensus.cc:3060] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:36.404461 27896 raft_consensus.cc:2804] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:36.404858 27896 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:36.405191 27896 raft_consensus.cc:3060] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:36.405836 27742 raft_consensus.cc:493] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:36.406342 27742 raft_consensus.cc:515] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:36.408507 27742 leader_election.cc:290] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:36.342365 27480 consensus_queue.cc:1048] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:11:36.400434 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:36.414597 25194 leader_election.cc:304] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:36.415059 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
W20260709 13:11:36.422302 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:36.426199 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:36.427008 25230 raft_consensus.cc:2393] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 5: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:36.427812 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:36.428798 25230 raft_consensus.cc:2393] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 7: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:36.429786 27783 raft_consensus.cc:2749] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:36.378897 27855 raft_consensus.cc:493] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
W20260709 13:11:36.445562 25343 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.000s	sys 0.016s
W20260709 13:11:36.448004 25343 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.000s	sys 0.016s
W20260709 13:11:36.459421 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:36.475330 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:36.476254 25378 raft_consensus.cc:2468] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 5.
I20260709 13:11:36.482285 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:36.483131 25373 raft_consensus.cc:2468] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 6.
I20260709 13:11:36.427415 27882 raft_consensus.cc:515] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:36.441892 25227 raft_consensus.cc:2468] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 6.
I20260709 13:11:36.440337 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:36.669394 25230 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 5.
I20260709 13:11:36.656742 25344 leader_election.cc:304] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:36.660307 25371 raft_consensus.cc:1275] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:36.681293 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:36.345674 27512 raft_consensus.cc:515] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:36.687587 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:36.704411 25297 raft_consensus.cc:2393] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 6: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:36.704599 27890 raft_consensus.cc:493] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:36.705233 27890 raft_consensus.cc:515] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:36.705852 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:36.706383 25377 raft_consensus.cc:1275] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:36.706494 25302 raft_consensus.cc:2468] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 5.
I20260709 13:11:36.707345 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:36.707451 27890 leader_election.cc:290] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:36.707866 25302 raft_consensus.cc:3060] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:36.708724 27890 raft_consensus.cc:493] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:36.709998 27902 raft_consensus.cc:493] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:36.707363 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:36.710763 27902 raft_consensus.cc:515] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:36.705567 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:36.711321 27872 raft_consensus.cc:515] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:36.712595 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:36.712992 27902 leader_election.cc:290] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:36.713155 25297 raft_consensus.cc:3060] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:36.713490 27872 leader_election.cc:290] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:36.714073 27872 raft_consensus.cc:493] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:36.714759 27871 raft_consensus.cc:493] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.715101 25908 raft_consensus.cc:1275] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:11:36.716821 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 60190.8us
I20260709 13:11:36.717684 25344 leader_election.cc:304] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:36.709224 27890 raft_consensus.cc:515] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:36.730942 25873 leader_election.cc:304] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:36.714509 27872 raft_consensus.cc:515] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:36.418720 27742 raft_consensus.cc:493] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:36.736264 25370 raft_consensus.cc:1240] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 4 LEADER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:36.738296 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:36.739114 25227 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 5.
I20260709 13:11:36.740316 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:36.741026 25378 raft_consensus.cc:2468] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 4.
I20260709 13:11:36.742110 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:36.431996 27794 raft_consensus.cc:493] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.743655 25302 raft_consensus.cc:2468] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 7.
I20260709 13:11:36.751161 25371 raft_consensus.cc:1275] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:36.705560 27812 raft_consensus.cc:493] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.446978 27676 raft_consensus.cc:493] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.756210 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
W20260709 13:11:36.718649 27517 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.031s	sys 0.035s
I20260709 13:11:36.392520 27578 raft_consensus.cc:515] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:36.430903 27895 raft_consensus.cc:2749] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:11:36.764864 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:36.715250 27871 raft_consensus.cc:515] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:36.767825 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:36.767808 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:36.774458 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:36.767498 27906 raft_consensus.cc:493] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.780292 27906 raft_consensus.cc:515] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:36.735826 27742 raft_consensus.cc:515] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:36.782555 27906 leader_election.cc:290] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:11:36.769922 27517 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.031s	sys 0.036s
I20260709 13:11:36.761821 27794 raft_consensus.cc:515] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:36.790221 25901 raft_consensus.cc:3060] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:36.792706 25904 raft_consensus.cc:2468] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 6.
I20260709 13:11:36.793978 27909 raft_consensus.cc:2804] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:36.794536 27909 raft_consensus.cc:697] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 7 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:36.794725 25297 raft_consensus.cc:2468] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 7.
I20260709 13:11:36.795418 27909 consensus_queue.cc:237] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:36.735810 27840 raft_consensus.cc:2804] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:36.821849 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:36.823486 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:36.844770 25227 raft_consensus.cc:2468] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 7.
I20260709 13:11:36.775414 27676 raft_consensus.cc:515] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:36.850984 27872 leader_election.cc:290] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:36.851315 27676 leader_election.cc:290] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:36.775557 27816 raft_consensus.cc:2804] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:36.852017 25299 raft_consensus.cc:2393] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 7: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:36.852129 27816 raft_consensus.cc:493] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:36.852600 27816 raft_consensus.cc:3060] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:36.853148 27578 leader_election.cc:290] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:36.410967 27903 raft_consensus.cc:515] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:36.856415 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:36.876739 25901 raft_consensus.cc:1275] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 13:11:36.717473 27855 raft_consensus.cc:515] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:36.871297 25345 leader_election.cc:304] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:36.879036 25374 raft_consensus.cc:2468] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 8.
I20260709 13:11:36.854403 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:36.885316 25345 leader_election.cc:304] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:36.885488 25230 raft_consensus.cc:2468] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 6.
I20260709 13:11:36.882015 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:36.881095 25901 pending_rounds.cc:85] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6: Aborting all ops after (but not including) 4
W20260709 13:11:36.822372 27891 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.011s	sys 0.061s
I20260709 13:11:36.814090 27840 raft_consensus.cc:493] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
W20260709 13:11:36.888572 25223 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.018s	sys 0.023s
W20260709 13:11:36.898748 25223 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.018s	sys 0.023s
I20260709 13:11:36.899717 25223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58418 (request call id 1718) took 1069 ms. Trace:
I20260709 13:11:36.877991 27906 raft_consensus.cc:493] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.889952 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:36.906644 25230 raft_consensus.cc:2410] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:11:36.906102 25343 leader_election.cc:304] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:36.767221 27812 raft_consensus.cc:515] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:36.886416 25304 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.002s	sys 0.025s
W20260709 13:11:36.898185 25228 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.015s	sys 0.033s
I20260709 13:11:36.821501 27860 raft_consensus.cc:493] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:36.897349 27836 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.003s	sys 0.027s
I20260709 13:11:36.889051 25345 leader_election.cc:304] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
W20260709 13:11:36.879339 27884 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.022s	sys 0.072s
I20260709 13:11:36.880932 27793 leader_election.cc:290] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:36.891963 27891 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.012s	sys 0.063s
I20260709 13:11:36.887687 25901 pending_rounds.cc:107] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 5.5
I20260709 13:11:36.909126 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:11:36.910241 25304 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.002s	sys 0.025s
I20260709 13:11:36.904278 27840 raft_consensus.cc:3060] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:36.910331 25228 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.015s	sys 0.034s
I20260709 13:11:36.890261 27649 raft_consensus.cc:2804] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:36.915290 25901 raft_consensus.cc:2917] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Aborting config change with OpId 5.5: Aborted: Op aborted by new leader
I20260709 13:11:36.900167 25223 rpcz_store.cc:276] 0709 13:11:35.830639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:35.832912 (+  2273us) service_pool.cc:224] Handling call
0709 13:11:35.868352 (+ 35440us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:35.868551 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:11:36.295415 (+426864us) log.cc:844] Serialized 14 byte log entry
0709 13:11:36.899279 (+603864us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:36.899352 (+    73us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:36.899412 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:36.899495 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:36.899649 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":148039,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"thread_start_us":946986,"threads_started":2}
I20260709 13:11:36.918835 25901 raft_consensus.cc:2889] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:36.877985 27586 raft_consensus.cc:515] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:36.911613 27836 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.004s	sys 0.027s
W20260709 13:11:36.916765 27738 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.015s	sys 0.001s
W20260709 13:11:36.913067 27884 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.022s	sys 0.072s
W20260709 13:11:36.916527 27735 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.012s	sys 0.022s
I20260709 13:11:36.927735 25874 leader_election.cc:304] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:11:36.931782 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:11:36.937738 25872 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.005s	sys 0.019s
W20260709 13:11:36.938238 25872 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.005s	sys 0.019s
I20260709 13:11:36.938362 25223 raft_consensus.cc:1275] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:11:36.930457 27738 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.015s	sys 0.001s
I20260709 13:11:36.918678 27649 raft_consensus.cc:493] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:36.941833 25872 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:36.910243 27906 raft_consensus.cc:515] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:37.007858 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:37.014055 25223 raft_consensus.cc:1275] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:11:36.931663 27735 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.012s	sys 0.022s
I20260709 13:11:36.937397 27512 leader_election.cc:290] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:36.912767 27860 raft_consensus.cc:515] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:37.364632 25194 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.140.66:33127 timed out after 1.540s (SENT) [suppressed 8 similar messages]
I20260709 13:11:36.948797 27836 raft_consensus.cc:2804] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:37.370183 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:11:37.324997 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 418923us
I20260709 13:11:37.375138 25224 raft_consensus.cc:2468] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 6.
I20260709 13:11:37.016083 27517 raft_consensus.cc:2804] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:36.950098 27894 leader_election.cc:290] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:37.296478 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:11:37.202838 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:37.376204 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 487238us
I20260709 13:11:37.376308 25224 raft_consensus.cc:1240] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 4. Current term is 5. Ops: [3.3-4.4]
W20260709 13:11:37.372017 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 432490us
I20260709 13:11:37.012207 27872 raft_consensus.cc:493] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:37.119071 27914 log.cc:927] Time spent T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.194s	user 0.000s	sys 0.000s
W20260709 13:11:37.367563 27896 consensus_meta.cc:287] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent flushing consensus metadata: real 0.962s	user 0.000s	sys 0.009s
I20260709 13:11:37.011116 27649 raft_consensus.cc:3060] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:37.134315 27654 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.759s	user 0.004s	sys 0.035s
W20260709 13:11:37.395583 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:37.404541 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:37.016283 27877 raft_consensus.cc:493] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.046547 27875 raft_consensus.cc:493] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.115547 27912 raft_consensus.cc:2804] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:37.129856 27890 leader_election.cc:290] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:37.067902 27882 leader_election.cc:290] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:37.432859 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:37.339040 27925 raft_consensus.cc:493] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:37.378957 27517 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:37.374799 27903 leader_election.cc:290] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:36.996009 27676 consensus_queue.cc:1048] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.400s
I20260709 13:11:37.374461 27812 leader_election.cc:290] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:37.376109 27906 leader_election.cc:290] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:37.382720 25900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50056 (request call id 535) took 1969 ms. Trace:
I20260709 13:11:37.118325 27926 raft_consensus.cc:2749] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:37.090574 27735 consensus_queue.cc:1048] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.314s
I20260709 13:11:37.472843 25299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57272 (request call id 1542) took 1112 ms. Trace:
I20260709 13:11:37.449971 25224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1702) took 1037 ms. Trace:
W20260709 13:11:37.450361 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 85768.3us
W20260709 13:11:37.406280 27654 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.031s	user 0.004s	sys 0.048s
I20260709 13:11:37.397712 27793 raft_consensus.cc:493] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.455479 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:37.504629 25296 raft_consensus.cc:2410] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:11:37.405718 27586 leader_election.cc:290] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:37.408890 27912 raft_consensus.cc:493] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:37.512317 25345 leader_election.cc:304] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:37.399644 27872 raft_consensus.cc:515] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:37.448773 27836 raft_consensus.cc:697] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:37.488768 25299 rpcz_store.cc:276] 0709 13:11:36.360230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:36.360350 (+   120us) service_pool.cc:224] Handling call
0709 13:11:37.472576 (+1112226us) spinlock_profiling.cc:243] Waited 491 ms on lock 0x7b54001699d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:37.472766 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1128254848}
I20260709 13:11:37.488910 25224 rpcz_store.cc:276] 0709 13:11:36.412434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:37.390771 (+978337us) service_pool.cc:224] Handling call
0709 13:11:37.391144 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:37.391429 (+   285us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:11:37.407660 (+ 16231us) log.cc:844] Serialized 14 byte log entry
0709 13:11:37.449570 (+ 41910us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:37.449633 (+    63us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:37.449676 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:37.449763 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:37.449912 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":16030,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":60,"raft.queue_time_us":116,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":132,"thread_start_us":41528,"threads_started":1}
I20260709 13:11:37.524303 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:37.525903 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:37.458395 27517 raft_consensus.cc:3060] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:37.458170 27890 raft_consensus.cc:2804] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:37.508795 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:37.508932 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:37.504330 27871 leader_election.cc:290] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:37.510697 25373 raft_consensus.cc:1275] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:11:37.511264 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "79d99c0e498349bda74127365219e468"
W20260709 13:11:37.542577 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 166637us
I20260709 13:11:37.543576 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:37.455293 27884 raft_consensus.cc:493] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:37.406050 27896 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:37.456306 27851 raft_consensus.cc:476] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 7 LEADER]: Not starting pre-election -- already a leader
I20260709 13:11:37.503710 27931 raft_consensus.cc:493] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.546170 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:37.514183 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:37.547298 25372 raft_consensus.cc:2468] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 5.
W20260709 13:11:37.515064 27916 log.cc:927] Time spent T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.232s	user 0.000s	sys 0.001s
I20260709 13:11:37.517917 27793 raft_consensus.cc:515] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:37.519798 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:37.410379 27877 raft_consensus.cc:515] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:37.467692 27855 leader_election.cc:290] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:37.523253 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 77102.4us
I20260709 13:11:37.592579 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:11:37.522204 25296 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57256 (request call id 1632) took 2336 ms (client timeout 1959 ms). Trace:
I20260709 13:11:37.446250 27875 raft_consensus.cc:515] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:37.532207 25221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58418 (request call id 1715) took 1703 ms. Trace:
I20260709 13:11:37.534982 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:11:37.593674 25296 rpcz_store.cc:269] 0709 13:11:35.172080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:35.173460 (+  1380us) service_pool.cc:224] Handling call
0709 13:11:37.455317 (+2281857us) spinlock_profiling.cc:243] Waited 9.31 ms on lock 0x7b5800114098. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72cb4ab71 00007fd72cb4aa22 00007fd735a63c09 00007fd734bbdee0 00007fd734c870ab 00007fd734c87131 00007fd734c350a0 00007fd734c34984 00007fd72e1af6d4 00007fd72e1af662
0709 13:11:37.508132 (+ 52815us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21412224}
I20260709 13:11:37.597868 25374 raft_consensus.cc:2468] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 6.
I20260709 13:11:37.510100 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:37.544024 25343 leader_election.cc:304] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:37.599081 25371 raft_consensus.cc:2468] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 4.
W20260709 13:11:37.533950 27921 log.cc:927] Time spent T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.256s	user 0.000s	sys 0.001s
I20260709 13:11:37.521628 27912 raft_consensus.cc:3060] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:37.589656 27836 consensus_queue.cc:237] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:37.589723 27931 raft_consensus.cc:515] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:37.457692 27925 raft_consensus.cc:515] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:37.597503 25221 rpcz_store.cc:276] 0709 13:11:35.829152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:35.829342 (+   190us) service_pool.cc:224] Handling call
0709 13:11:35.853563 (+ 24221us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:36.038942 (+185379us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:37.531964 (+1493022us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b54002701d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:37.532151 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":425175808}
I20260709 13:11:37.605311 25908 raft_consensus.cc:1240] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 LEADER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:37.531972 27890 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:37.622767 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:37.636268 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:37.637279 25905 raft_consensus.cc:2368] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for earlier term 7. Current term is 8.
I20260709 13:11:37.627619 27872 leader_election.cc:290] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:37.631187 25224 raft_consensus.cc:2468] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 7.
W20260709 13:11:37.648411 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 126957us
W20260709 13:11:37.633821 27816 consensus_meta.cc:287] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.767s	user 0.013s	sys 0.000s
I20260709 13:11:37.648650 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:37.651553 25377 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 6.
I20260709 13:11:37.649120 25345 leader_election.cc:304] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:37.652155 25221 raft_consensus.cc:2468] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 6.
I20260709 13:11:37.653347 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:37.654101 25221 raft_consensus.cc:2410] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:11:37.654750 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:37.655246 25221 raft_consensus.cc:2468] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 6.
I20260709 13:11:37.656426 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:37.660569 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:37.660984 27875 leader_election.cc:290] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:37.661972 27942 log.cc:927] Time spent T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
W20260709 13:11:37.662792 27932 log.cc:927] Time spent T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260709 13:11:37.664222 25902 raft_consensus.cc:1240] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:37.640914 27890 raft_consensus.cc:3060] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:37.638510 27946 raft_consensus.cc:493] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:37.666751 27946 raft_consensus.cc:515] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:37.668967 27946 leader_election.cc:290] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:37.670747 27896 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:37.549360 27884 raft_consensus.cc:515] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
W20260709 13:11:37.641319 27930 log.cc:927] Time spent T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 13:11:37.672611 25223 raft_consensus.cc:2468] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 2.
I20260709 13:11:37.671548 27945 consensus_queue.cc:1059] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:37.646067 27812 raft_consensus.cc:2804] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:11:37.677687 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 133727us
I20260709 13:11:37.685423 25343 leader_election.cc:304] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:37.606436 27941 raft_consensus.cc:493] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:37.691968 27890 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:37.692437 27917 log.cc:927] Time spent T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.432s	user 0.001s	sys 0.001s
I20260709 13:11:37.462659 25900 rpcz_store.cc:276] 0709 13:11:35.413043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:35.416198 (+  3155us) service_pool.cc:224] Handling call
0709 13:11:35.432706 (+ 16508us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:36.294146 (+861440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:36.303613 (+  9467us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:36.358196 (+ 54583us) log.cc:844] Serialized 26 byte log entry
0709 13:11:36.914943 (+556747us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:36.918284 (+  3341us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:36.928200 (+  9916us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:37.122598 (+194398us) raft_consensus.cc:1685] finished
0709 13:11:37.169433 (+ 46835us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:37.380038 (+210605us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4618,"raft.queue_time_us":135924,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":75506,"thread_start_us":1326858,"threads_started":2,"wal-append.queue_time_us":736058}
I20260709 13:11:37.706668 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:37.673533 27816 raft_consensus.cc:515] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:37.710114 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:37.711530 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:37.718241 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:37.719301 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:11:37.674505 27933 log.cc:927] Time spent T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260709 13:11:37.719470 25904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50056 (request call id 541) took 1305 ms. Trace:
I20260709 13:11:37.679658 27949 raft_consensus.cc:2804] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:37.722574 25904 rpcz_store.cc:276] 0709 13:11:36.414500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:36.414858 (+   358us) service_pool.cc:224] Handling call
0709 13:11:37.719265 (+1304407us) spinlock_profiling.cc:243] Waited 365 ms on lock 0x7b5400511dd4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:37.719394 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":838489856}
W20260709 13:11:37.685322 27899 consensus_meta.cc:287] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 1.442s	user 0.010s	sys 0.001s
I20260709 13:11:37.728420 25345 leader_election.cc:304] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:37.674604 27793 leader_election.cc:290] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:37.685662 27946 raft_consensus.cc:2804] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:11:37.732817 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 47485.7us
I20260709 13:11:37.735757 25376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56308 (request call id 364) took 2789 ms. Trace:
I20260709 13:11:37.695254 27812 raft_consensus.cc:493] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:37.739598 25345 leader_election.cc:304] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:37.736198 25376 rpcz_store.cc:276] 0709 13:11:34.939809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:34.939937 (+   128us) service_pool.cc:224] Handling call
0709 13:11:34.985509 (+ 45572us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:35.000485 (+ 14976us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:35.000521 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:35.000997 (+   476us) log.cc:844] Serialized 26 byte log entry
0709 13:11:37.401872 (+2400875us) spinlock_profiling.cc:243] Waited 1.46 ms on lock 0x7b180044d760. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72cb64e07 00007fd7359bfab9 00007fd72cb8169b 00007fd72cb7f93f 00007fd72cb81c02 00007fd72f80920b 00007fd72f80ed23 00007fd72f80f0d1 00007fd72fc2aa0f
0709 13:11:37.507947 (+106075us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:37.515515 (+  7568us) log.cc:844] Serialized 14 byte log entry
0709 13:11:37.633964 (+118449us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:37.634065 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:37.698339 (+ 64274us) raft_consensus.cc:1685] finished
0709 13:11:37.728827 (+ 30488us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:37.729016 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20745,"prepare.queue_time_us":15316,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":7135,"raft.queue_time_us":172455,"raft.run_cpu_time_us":283,"raft.run_wall_time_us":11447,"spinlock_wait_cycles":3348864,"thread_start_us":189287,"threads_started":2,"wal-append.queue_time_us":2640067}
I20260709 13:11:37.709355 27779 leader_election.cc:290] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:37.709546 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:37.734539 27735 raft_consensus.cc:2749] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:37.734218 27855 consensus_queue.cc:1059] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 13:11:37.743419 27816 leader_election.cc:290] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:37.732366 27906 raft_consensus.cc:3055] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:37.745846 27890 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:37.755642 27945 raft_consensus.cc:493] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.746342 27925 leader_election.cc:290] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:37.746779 27812 raft_consensus.cc:3060] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:37.763892 25221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1703) took 1349 ms. Trace:
I20260709 13:11:37.762645 25902 raft_consensus.cc:2368] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for earlier term 5. Current term is 6.
I20260709 13:11:37.735417 27946 raft_consensus.cc:493] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:37.720634 27941 raft_consensus.cc:515] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:37.735589 27899 raft_consensus.cc:515] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:37.763769 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 312192us
I20260709 13:11:37.742316 27949 raft_consensus.cc:697] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 4 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:37.747661 27654 raft_consensus.cc:2804] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:11:37.770351 27568 consensus_meta.cc:287] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 1.402s	user 0.008s	sys 0.004s
I20260709 13:11:37.765535 27948 raft_consensus.cc:2804] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:37.784139 27884 leader_election.cc:290] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361)
W20260709 13:11:37.788313 27840 consensus_meta.cc:287] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent flushing consensus metadata: real 0.860s	user 0.006s	sys 0.002s
I20260709 13:11:37.781266 25221 rpcz_store.cc:276] 0709 13:11:36.414851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:37.657128 (+1242277us) service_pool.cc:224] Handling call
0709 13:11:37.657396 (+   268us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:37.657709 (+   313us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:37.657734 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:37.692889 (+ 35155us) log.cc:844] Serialized 26 byte log entry
0709 13:11:37.763470 (+ 70581us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:37.763529 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:37.763635 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:37.763685 (+    50us) raft_consensus.cc:1685] finished
0709 13:11:37.763699 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:37.763831 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":162,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":113,"thread_start_us":70078,"threads_started":1,"wal-append.queue_time_us":61716}
I20260709 13:11:37.795271 25228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58418 (request call id 1732) took 1065 ms. Trace:
I20260709 13:11:37.800184 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:37.799335 25229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1704) took 1380 ms. Trace:
I20260709 13:11:37.801923 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:37.813968 25344 leader_election.cc:304] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:37.801154 25906 raft_consensus.cc:1275] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:11:37.826581 25226 raft_consensus.cc:1275] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 13:11:37.800516 25904 raft_consensus.cc:1275] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:11:37.801472 25304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57272 (request call id 1546) took 1440 ms. Trace:
W20260709 13:11:37.846858 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:37.839665 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 99262.8us
W20260709 13:11:37.850452 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:37.851876 25343 leader_election.cc:400] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 election: Vote denied by peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127) with higher term. Message: Invalid argument: T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 4. Current term is 5.
I20260709 13:11:37.846747 27948 raft_consensus.cc:493] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:37.852177 27935 consensus_queue.cc:1048] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:37.852787 27948 raft_consensus.cc:3060] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:37.801474 25903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50056 (request call id 536) took 2369 ms. Trace:
I20260709 13:11:37.814455 25375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56308 (request call id 361) took 3311 ms. Trace:
I20260709 13:11:37.803831 27742 leader_election.cc:290] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:37.846253 27949 consensus_queue.cc:237] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:37.848345 25229 rpcz_store.cc:276] 0709 13:11:36.418485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:37.678974 (+1260489us) service_pool.cc:224] Handling call
0709 13:11:37.679305 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:37.679652 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:11:37.680028 (+   376us) log.cc:844] Serialized 14 byte log entry
0709 13:11:37.754333 (+ 74305us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:37.754871 (+   538us) log.cc:844] Serialized 26 byte log entry
0709 13:11:37.755032 (+   161us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:37.755269 (+   237us) log.cc:844] Serialized 14 byte log entry
0709 13:11:37.757013 (+  1744us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:37.757079 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:37.799047 (+ 41968us) raft_consensus.cc:1685] finished
0709 13:11:37.799079 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:37.799260 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":335,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":76,"raft.queue_time_us":2136,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":3713,"spinlock_wait_cycles":57216,"thread_start_us":73871,"threads_started":1,"wal-append.queue_time_us":116876}
I20260709 13:11:37.814118 27851 consensus_queue.cc:1048] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:11:37.857604 25375 rpcz_store.cc:276] 0709 13:11:34.503421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:34.527615 (+ 24194us) service_pool.cc:224] Handling call
0709 13:11:34.709220 (+181605us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:35.807612 (+1098392us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:36.656581 (+848969us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b5400307854. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:37.814222 (+1157641us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b5400307850. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6e8ad 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:37.814391 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2794584704}
I20260709 13:11:37.852674 25343 leader_election.cc:304] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:37.834489 25873 leader_election.cc:304] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:37.767897 27906 raft_consensus.cc:740] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
W20260709 13:11:37.859179 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 45313.1us
I20260709 13:11:37.847848 25228 rpcz_store.cc:276] 0709 13:11:36.730030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:37.794436 (+1064406us) service_pool.cc:224] Handling call
0709 13:11:37.794749 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:37.794935 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:37.794961 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:37.794999 (+    38us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:37.795028 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:37.795078 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:37.795203 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:37.767438 25900 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 6.
I20260709 13:11:37.864122 25344 leader_election.cc:304] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:37.840842 27654 raft_consensus.cc:493] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:37.850055 25304 rpcz_store.cc:276] 0709 13:11:36.361306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:36.364269 (+  2963us) service_pool.cc:224] Handling call
0709 13:11:36.364570 (+   301us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:36.364983 (+   413us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:11:36.915886 (+550903us) log.cc:844] Serialized 14 byte log entry
0709 13:11:37.336269 (+420383us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:37.375263 (+ 38994us) log.cc:844] Serialized 52 byte log entry
0709 13:11:37.375407 (+   144us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:37.375704 (+   297us) log.cc:844] Serialized 14 byte log entry
0709 13:11:37.375913 (+   209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:37.375993 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:37.801225 (+425232us) raft_consensus.cc:1685] finished
0709 13:11:37.801246 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:37.801390 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":691834,"prepare.run_cpu_time_us":100,"prepare.run_wall_time_us":18304,"raft.queue_time_us":13663,"raft.run_cpu_time_us":497,"raft.run_wall_time_us":40085,"thread_start_us":962824,"threads_started":2,"wal-append.queue_time_us":483050}
I20260709 13:11:37.860406 27935 raft_consensus.cc:2749] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:37.868270 25230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54000 (request call id 391) took 1494 ms. Trace:
I20260709 13:11:37.866940 25221 raft_consensus.cc:1240] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:11:37.769343 27860 leader_election.cc:290] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:37.871089 25221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58418 (request call id 1734) took 1140 ms. Trace:
I20260709 13:11:37.840972 27946 raft_consensus.cc:3060] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:37.866050 25344 leader_election.cc:304] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:37.872608 25221 rpcz_store.cc:276] 0709 13:11:36.730626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:37.849238 (+1118612us) service_pool.cc:224] Handling call
0709 13:11:37.866668 (+ 17430us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:37.870780 (+  4112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:37.871023 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:37.875654 25221 raft_consensus.cc:1275] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:11:37.860976 27480 raft_consensus.cc:2804] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:37.868602 27654 raft_consensus.cc:3060] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:37.881872 25873 leader_election.cc:304] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:37.878201 27742 raft_consensus.cc:2804] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:37.881016 27733 consensus_queue.cc:1048] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:11:37.885977 27899 leader_election.cc:290] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:37.886191 27929 raft_consensus.cc:2749] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:37.846315 27840 raft_consensus.cc:515] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:37.941974 25901 raft_consensus.cc:1240] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:37.942821 27956 consensus_queue.cc:1048] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:11:37.889847 27779 consensus_queue.cc:1048] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:37.888652 27941 leader_election.cc:290] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:37.878811 27480 raft_consensus.cc:493] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:37.949033 27480 raft_consensus.cc:3060] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:37.853669 25903 rpcz_store.cc:276] 0709 13:11:35.413313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:35.416408 (+  3095us) service_pool.cc:224] Handling call
0709 13:11:37.669973 (+2253565us) spinlock_profiling.cc:243] Waited 16.9 ms on lock 0x7b58001a3198. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72cb4ab71 00007fd72cb4aa22 00007fd735a63c09 00007fd734bbdee0 00007fd734c870ab 00007fd734c87131 00007fd734c48fc0 00007fd734c33929 00007fd734c333d2 00007fd72e1aabd4
0709 13:11:37.670167 (+   194us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:37.670556 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:37.670589 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:37.671124 (+   535us) log.cc:844] Serialized 26 byte log entry
0709 13:11:37.739051 (+ 67927us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:37.746520 (+  7469us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:37.762459 (+ 15939us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:37.766997 (+  4538us) raft_consensus.cc:1685] finished
0709 13:11:37.767017 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:37.781579 (+ 14562us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":836,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"spinlock_wait_cycles":38956288,"thread_start_us":56812,"threads_started":1,"wal-append.queue_time_us":71724}
I20260709 13:11:37.880509 27818 raft_consensus.cc:2749] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:37.908592 27742 raft_consensus.cc:493] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:37.939102 27649 consensus_meta.cc:287] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.506s	user 0.011s	sys 0.000s
I20260709 13:11:37.850750 27912 raft_consensus.cc:515] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:37.909862 25343 connection.cc:256] RPC call timeout handler was delayed by -1.1644681749999108s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19590000000000002s for a response
I20260709 13:11:37.946729 27840 leader_election.cc:290] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:37.850508 27568 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:37.971966 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 90169.8us
I20260709 13:11:37.780608 27945 raft_consensus.cc:515] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:37.982698 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:37.995055 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 116330us
I20260709 13:11:38.008546 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:37.796789 27812 raft_consensus.cc:515] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:38.034708 25873 leader_election.cc:304] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:37.980651 27850 raft_consensus.cc:493] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:38.009343 27741 raft_consensus.cc:2749] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:38.117870 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:11:38.148638 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 278206us
I20260709 13:11:38.126520 25229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58418 (request call id 1736) took 1395 ms. Trace:
W20260709 13:11:38.150444 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 115859us
I20260709 13:11:38.118891 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:38.119789 25378 raft_consensus.cc:1275] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 13:11:38.116994 25376 raft_consensus.cc:1240] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:38.120222 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:38.117468 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:38.007170 27742 raft_consensus.cc:3060] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:38.222470 25375 raft_consensus.cc:1240] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:38.222831 25371 raft_consensus.cc:1240] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:38.223712 25873 leader_election.cc:304] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:38.089556 25379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56308 (request call id 376) took 1613 ms. Trace:
I20260709 13:11:38.222604 25229 rpcz_store.cc:276] 0709 13:11:36.731147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:37.856017 (+1124870us) service_pool.cc:224] Handling call
0709 13:11:37.856354 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:37.856674 (+   320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:37.856702 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:37.857123 (+   421us) log.cc:844] Serialized 26 byte log entry
0709 13:11:38.026045 (+168922us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:38.026107 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:38.026207 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:38.126310 (+100103us) raft_consensus.cc:1685] finished
0709 13:11:38.126331 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:38.126464 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":710,"raft.queue_time_us":2628,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":5157,"thread_start_us":168445,"threads_started":1,"wal-append.queue_time_us":267370}
I20260709 13:11:38.229841 25379 rpcz_store.cc:276] 0709 13:11:36.475754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:36.475858 (+   104us) service_pool.cc:224] Handling call
0709 13:11:36.476142 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:36.903468 (+427326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:36.903511 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:36.903568 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:36.903620 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:38.089277 (+1185657us) spinlock_profiling.cc:243] Waited 427 ms on lock 0x7b540024cf54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:38.089329 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:38.089491 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":982188416}
I20260709 13:11:38.235318 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:38.153321 27733 raft_consensus.cc:2804] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:38.106654 27935 raft_consensus.cc:493] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.234532 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:11:38.139433 27517 consensus_meta.cc:287] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent flushing consensus metadata: real 0.595s	user 0.011s	sys 0.000s
I20260709 13:11:38.243757 25375 raft_consensus.cc:2468] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 5.
I20260709 13:11:38.009693 27941 consensus_queue.cc:1048] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.223s
I20260709 13:11:38.094375 27890 raft_consensus.cc:3055] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:38.009828 27649 raft_consensus.cc:515] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:38.244567 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:38.114734 27899 raft_consensus.cc:493] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.104573 27794 leader_election.cc:290] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:11:38.244210 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:38.248869 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:38.106178 27912 leader_election.cc:290] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:38.251556 25378 raft_consensus.cc:2393] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 6: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:38.242153 27779 raft_consensus.cc:2804] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:38.084762 27886 leader_election.cc:290] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:38.104175 27568 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:38.254791 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:38.255381 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:38.103672 27931 leader_election.cc:290] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:38.011787 27948 raft_consensus.cc:515] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:38.260149 25228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54000 (request call id 399) took 1320 ms. Trace:
I20260709 13:11:38.222314 27850 raft_consensus.cc:515] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:38.061398 27946 raft_consensus.cc:515] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:38.243261 27733 raft_consensus.cc:493] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:38.124436 27480 raft_consensus.cc:515] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:38.247038 27929 raft_consensus.cc:493] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.101472 27950 consensus_queue.cc:1048] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.189s
I20260709 13:11:38.243554 27937 consensus_queue.cc:1048] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:11:38.250670 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:38.268373 25228 rpcz_store.cc:276] 0709 13:11:36.940202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:37.861879 (+921677us) service_pool.cc:224] Handling call
0709 13:11:37.862517 (+   638us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:37.862763 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:11:37.872718 (+  9955us) log.cc:844] Serialized 14 byte log entry
0709 13:11:38.259797 (+387079us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:38.259846 (+    49us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:38.259888 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:38.259954 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:38.260082 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":10537,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":83,"thread_start_us":386648,"threads_started":1}
I20260709 13:11:38.127921 27654 raft_consensus.cc:515] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:38.089928 27924 consensus_queue.cc:1048] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.202s
I20260709 13:11:38.250973 27890 raft_consensus.cc:740] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:38.248070 27935 raft_consensus.cc:515] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:38.259562 27779 raft_consensus.cc:493] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:38.008916 27906 consensus_queue.cc:260] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:38.284085 25376 raft_consensus.cc:2468] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 3.
I20260709 13:11:38.256951 27899 raft_consensus.cc:515] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:38.294597 27499 raft_consensus.cc:3055] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:38.295048 27499 raft_consensus.cc:740] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:38.295890 27499 consensus_queue.cc:260] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:38.296805 27499 raft_consensus.cc:3060] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:38.299297 27946 leader_election.cc:290] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:38.299899 25370 raft_consensus.cc:2393] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 5: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:38.300387 27480 leader_election.cc:290] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:38.301957 25899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50056 (request call id 540) took 1890 ms. Trace:
I20260709 13:11:38.277809 27733 raft_consensus.cc:3060] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:38.253233 27517 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:38.302322 25899 rpcz_store.cc:276] 0709 13:11:36.411051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:36.411225 (+   174us) service_pool.cc:224] Handling call
0709 13:11:36.411498 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:36.762475 (+350977us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:36.762506 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:36.762546 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:36.762575 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:38.301514 (+1538939us) spinlock_profiling.cc:243] Waited 351 ms on lock 0x7b54002f4754. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:38.301557 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:38.301689 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":806658304}
I20260709 13:11:38.301975 27948 leader_election.cc:290] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:38.294665 27654 leader_election.cc:290] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:38.309105 27945 leader_election.cc:290] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:38.309490 27812 leader_election.cc:290] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:38.311131 25226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1691) took 2915 ms. Trace:
I20260709 13:11:38.311424 27935 leader_election.cc:290] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:38.311496 25226 rpcz_store.cc:276] 0709 13:11:35.395341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:35.398451 (+  3110us) service_pool.cc:224] Handling call
0709 13:11:37.785948 (+2387497us) spinlock_profiling.cc:243] Waited 2.07 ms on lock 0x7b5800002a98. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72cb4ab71 00007fd72cb4aa22 00007fd735a63c09 00007fd734bbdee0 00007fd734c870ab 00007fd734c87131 00007fd734c48fc0 00007fd734c33929 00007fd734c333d2 00007fd72e1aabd4
0709 13:11:37.826156 (+ 40208us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:37.849087 (+ 22931us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:38.310955 (+461868us) spinlock_profiling.cc:243] Waited 40 ms on lock 0x7b5400002150. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6e8ad 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:38.311077 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":96710656}
I20260709 13:11:38.312448 25223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54000 (request call id 400) took 1371 ms. Trace:
I20260709 13:11:38.312810 25223 rpcz_store.cc:276] 0709 13:11:36.941121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:37.170103 (+228982us) service_pool.cc:224] Handling call
0709 13:11:38.312292 (+1142189us) spinlock_profiling.cc:243] Waited 289 ms on lock 0x7b54002c0bd4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:38.312397 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":663761280}
I20260709 13:11:38.312700 27890 consensus_queue.cc:260] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:38.314023 27890 raft_consensus.cc:3060] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:38.315307 27649 leader_election.cc:290] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:38.316475 27850 leader_election.cc:290] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:38.291381 27779 raft_consensus.cc:3060] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:38.324023 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 195415us
I20260709 13:11:38.284415 27929 raft_consensus.cc:515] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:38.352173 25343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:38.360817 27517 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:38.362910 27899 leader_election.cc:290] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:38.366986 27929 leader_election.cc:290] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:38.374197 25227 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54000 (request call id 397) took 1981 ms (client timeout 1774 ms). Trace:
W20260709 13:11:38.374786 25227 rpcz_store.cc:269] 0709 13:11:36.392619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:36.739883 (+347264us) service_pool.cc:224] Handling call
0709 13:11:38.373988 (+1634105us) spinlock_profiling.cc:243] Waited 66.8 ms on lock 0x7b5400421b54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:38.374116 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":153689344}
I20260709 13:11:38.329599 27742 raft_consensus.cc:515] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:38.355055 27649 raft_consensus.cc:493] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:38.370985 27794 raft_consensus.cc:493] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.403014 27742 leader_election.cc:290] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:38.399935 27794 raft_consensus.cc:515] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:38.398299 27649 raft_consensus.cc:515] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:38.405711 27733 raft_consensus.cc:515] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:38.424685 27962 log.cc:927] Time spent T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 13:11:38.426121 25224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58418 (request call id 1733) took 1695 ms. Trace:
I20260709 13:11:38.426491 25224 rpcz_store.cc:276] 0709 13:11:36.730343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:37.823694 (+1093351us) service_pool.cc:224] Handling call
0709 13:11:37.824097 (+   403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:37.824520 (+   423us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:37.824559 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:37.825099 (+   540us) log.cc:844] Serialized 26 byte log entry
0709 13:11:38.153602 (+328503us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:38.153806 (+   204us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:38.153881 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:38.424102 (+270221us) spinlock_profiling.cc:243] Waited 7.83 ms on lock 0x7b4400022b4c. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72caa8c85 00007fd72caa96a2 00007fd72f81b1db 00007fd72f816aaf 00007fd72f80a86e 00007fd72f809bb6 00007fd72f8097d8 00007fd72f813221 00007fd72f8131d9 00007fd72f813169
0709 13:11:38.425830 (+  1728us) raft_consensus.cc:1685] finished
0709 13:11:38.425850 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:38.426061 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1675,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":10948,"spinlock_wait_cycles":18016640,"thread_start_us":328067,"threads_started":1,"wal-append.queue_time_us":441217}
I20260709 13:11:38.432289 25907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50056 (request call id 539) took 2029 ms. Trace:
I20260709 13:11:38.432662 25907 rpcz_store.cc:276] 0709 13:11:36.402969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:36.409880 (+  6911us) service_pool.cc:224] Handling call
0709 13:11:36.410452 (+   572us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:36.886519 (+476067us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:36.886559 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:36.886599 (+    40us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:36.886630 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:38.432096 (+1545466us) spinlock_profiling.cc:243] Waited 476 ms on lock 0x7b540050ebd4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:38.432135 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:38.432238 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1094342528}
I20260709 13:11:38.408010 27794 leader_election.cc:290] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:38.434517 27733 leader_election.cc:290] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:38.412652 27779 raft_consensus.cc:515] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:38.421139 27649 leader_election.cc:290] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:38.506616 27877 leader_election.cc:290] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:37.868615 25230 rpcz_store.cc:276] 0709 13:11:36.374160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:36.923459 (+549299us) service_pool.cc:224] Handling call
0709 13:11:36.925980 (+  2521us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:36.926210 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:11:36.941302 (+ 15092us) log.cc:844] Serialized 14 byte log entry
0709 13:11:37.747265 (+805963us) spinlock_profiling.cc:243] Waited 6.96 ms on lock 0x7b18002b9ae0. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72cb64e07 00007fd7359bfab9 00007fd72cb8169b 00007fd72cb7f93f 00007fd72cb81c02 00007fd72f80920b 00007fd72f80ed23 00007fd72f80f23a 00007fd72fc79a2a
0709 13:11:37.868037 (+120772us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:37.868079 (+    42us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:37.868109 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:37.868151 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:37.868229 (+    78us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":13490,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":38,"raft.queue_time_us":2745,"spinlock_wait_cycles":16005504,"thread_start_us":117867,"threads_started":1}
I20260709 13:11:38.648824 27883 raft_consensus.cc:493] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.649467 27883 raft_consensus.cc:515] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:38.651566 27883 leader_election.cc:290] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:38.652105 27883 raft_consensus.cc:493] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:38.652765 27883 raft_consensus.cc:515] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:38.654856 27883 leader_election.cc:290] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:38.658277 27883 raft_consensus.cc:493] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.659256 27883 raft_consensus.cc:515] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:38.664798 27883 leader_election.cc:290] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:38.674590 27899 raft_consensus.cc:493] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.675168 27899 raft_consensus.cc:515] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:38.677213 27899 leader_election.cc:290] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:39.032279 27899 raft_consensus.cc:493] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:39.032971 27899 raft_consensus.cc:515] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:39.033465 25303 raft_consensus.cc:1240] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:38.453366 27779 leader_election.cc:290] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 5 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:39.035205 27899 leader_election.cc:290] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:39.035496 25303 raft_consensus.cc:1275] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:11:39.037139 25303 raft_consensus.cc:1240] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:39.038515 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:11:39.040024 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:39.040284 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:39.046149 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:39.047554 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:39.048385 25303 raft_consensus.cc:2393] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 7: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:39.049247 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:39.050784 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:39.051558 25298 raft_consensus.cc:2393] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 5: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:39.053505 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:39.054157 25298 raft_consensus.cc:2468] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 3.
I20260709 13:11:39.055685 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:39.056423 25298 raft_consensus.cc:2368] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 5. Current term is 6.
W20260709 13:11:39.056839 25194 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.003s	sys 0.018s
W20260709 13:11:39.057293 25194 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.003s	sys 0.018s
I20260709 13:11:39.057358 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:39.059823 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:11:39.058524 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 627858us
I20260709 13:11:39.060590 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:39.065137 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:39.067157 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:39.067764 25299 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 6.
I20260709 13:11:39.067831 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:39.068396 25303 raft_consensus.cc:1275] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:39.068609 25304 raft_consensus.cc:2410] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:11:39.069774 25298 raft_consensus.cc:1240] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 13:11:39.073480 25343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:39.074040 25343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:39.074174 25305 raft_consensus.cc:3055] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:39.074558 25305 raft_consensus.cc:740] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:39.075320 25305 consensus_queue.cc:260] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:39.076402 25305 raft_consensus.cc:3060] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:39.084175 25305 raft_consensus.cc:1275] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:11:39.084648 25305 pending_rounds.cc:85] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19: Aborting all ops after (but not including) 3
I20260709 13:11:39.084926 25305 pending_rounds.cc:107] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:11:39.085206 25305 raft_consensus.cc:2889] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:39.085692 27977 raft_consensus.cc:493] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.086258 27977 raft_consensus.cc:515] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:39.087272 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:39.087894 27906 raft_consensus.cc:3060] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:39.088038 25303 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 6.
I20260709 13:11:39.088342 27977 leader_election.cc:290] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:39.089217 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:39.083154 27851 raft_consensus.cc:493] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
W20260709 13:11:39.090440 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:39.091459 25298 raft_consensus.cc:2468] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 4.
I20260709 13:11:39.094221 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
W20260709 13:11:39.095201 25255 heartbeater.cc:646] Failed to heartbeat to 127.23.140.126:37145 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.23.140.126:37145 timed out after 15.000s (SENT)
W20260709 13:11:39.105230 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:39.105646 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:39.106117 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:39.110419 27963 log.cc:927] Time spent T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.817s	user 0.001s	sys 0.005s
I20260709 13:11:39.110869 27977 raft_consensus.cc:493] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.111752 27978 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:39.111387 27977 raft_consensus.cc:515] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:39.112408 27978 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:39.115224 27979 raft_consensus.cc:493] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:39.115852 27979 raft_consensus.cc:515] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:39.116406 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:39.117472 25304 raft_consensus.cc:1240] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:11:39.096720 27976 raft_consensus.cc:493] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.096920 25374 raft_consensus.cc:2410] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:11:39.097153 27851 raft_consensus.cc:515] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:39.097621 25901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50058 (request call id 618) took 1449 ms. Trace:
I20260709 13:11:39.119505 25901 rpcz_store.cc:276] 0709 13:11:37.647971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:37.648139 (+   168us) service_pool.cc:224] Handling call
0709 13:11:37.658669 (+ 10530us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:37.942369 (+283700us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:39.097405 (+1155036us) spinlock_profiling.cc:243] Waited 283 ms on lock 0x7b54004d6554. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:39.097569 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":651048192}
I20260709 13:11:39.119967 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:39.120561 25225 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 5.
I20260709 13:11:39.122395 25225 raft_consensus.cc:1275] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:39.123152 27979 leader_election.cc:290] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:39.124234 25225 raft_consensus.cc:1275] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:11:39.126652 25370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36254 (request call id 1806) took 1012 ms. Trace:
I20260709 13:11:39.127035 25370 rpcz_store.cc:276] 0709 13:11:38.114029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:38.117614 (+  3585us) service_pool.cc:224] Handling call
0709 13:11:39.126471 (+1008857us) spinlock_profiling.cc:243] Waited 67.8 ms on lock 0x7b54002882d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:39.126598 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":156010880}
I20260709 13:11:39.129521 25372 raft_consensus.cc:1240] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:39.129098 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:39.130856 25304 raft_consensus.cc:2468] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 5.
I20260709 13:11:39.131665 27977 leader_election.cc:290] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:39.099670 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:39.100790 25221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58418 (request call id 1741) took 1592 ms. Trace:
I20260709 13:11:39.132314 25221 rpcz_store.cc:276] 0709 13:11:37.508168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:37.877645 (+369477us) service_pool.cc:224] Handling call
0709 13:11:38.313946 (+436301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:38.314100 (+   154us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:38.314131 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:38.314171 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:38.314201 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:38.314258 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:39.100624 (+786366us) spinlock_profiling.cc:243] Waited 436 ms on lock 0x7b54002c0bd0. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6e8ad 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:39.100736 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1002461568}
I20260709 13:11:39.133167 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:39.133997 25225 raft_consensus.cc:3060] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:39.100831 25303 raft_consensus.cc:1275] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:11:39.142284 25221 raft_consensus.cc:1275] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 13:11:39.142264 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:39.142915 25221 pending_rounds.cc:85] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce: Aborting all ops after (but not including) 4
I20260709 13:11:39.143182 25221 pending_rounds.cc:107] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 5.5
I20260709 13:11:39.143450 25221 raft_consensus.cc:2917] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Aborting config change with OpId 5.5: Aborted: Op aborted by new leader
I20260709 13:11:39.143903 25221 raft_consensus.cc:2889] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:39.144518 25230 raft_consensus.cc:1275] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:11:39.145257 25125 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33566 (request call id 176) took 14172 ms (client timeout 15000 ms). Trace:
I20260709 13:11:39.138912 27851 leader_election.cc:290] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:39.146013 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:39.146533 25230 raft_consensus.cc:3060] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:39.147830 25304 raft_consensus.cc:1240] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:39.148569 25299 raft_consensus.cc:1240] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:11:39.148864 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:39.148489 25124 catalog_manager.cc:5697] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 3 to 4, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 4 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:39.149524 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:39.149991 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:39.150548 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:39.151104 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:39.151762 25299 raft_consensus.cc:2410] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:11:39.152025 25297 raft_consensus.cc:2410] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:11:39.152544 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:39.154007 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:39.155018 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:39.156675 25303 raft_consensus.cc:1275] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:11:39.187855 27978 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:39.127334 27976 raft_consensus.cc:515] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:39.158828 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:39.159188 25907 raft_consensus.cc:1240] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:11:39.159718 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:39.194783 27976 leader_election.cc:290] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:39.160199 27894 consensus_queue.cc:1048] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:39.162560 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:39.198290 25226 raft_consensus.cc:3060] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:39.163546 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:39.163750 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:39.164167 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:39.202098 25228 raft_consensus.cc:3060] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:39.202401 25229 raft_consensus.cc:2468] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 6.
I20260709 13:11:39.203356 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:39.204384 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:39.205322 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:39.202131 25222 raft_consensus.cc:3060] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:39.208782 25228 raft_consensus.cc:2468] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 7.
I20260709 13:11:39.222108 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:39.172185 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:39.225685 25302 raft_consensus.cc:3060] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:39.175834 27975 raft_consensus.cc:493] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.177451 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:39.182003 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:39.183547 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:39.185196 27899 raft_consensus.cc:493] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:39.177802 25225 raft_consensus.cc:2468] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 8.
I20260709 13:11:39.378144 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:39.379599 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:39.380213 25225 raft_consensus.cc:3060] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:39.164626 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:39.215515 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:39.382311 25899 raft_consensus.cc:2468] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 2.
I20260709 13:11:39.216900 25226 raft_consensus.cc:2468] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 7.
I20260709 13:11:39.384150 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:39.384886 25226 raft_consensus.cc:3060] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:39.219413 25377 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56308 (request call id 384) took 1711 ms (client timeout 1788 ms). Trace:
I20260709 13:11:39.222168 25222 raft_consensus.cc:2468] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 4.
I20260709 13:11:39.386608 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:39.387310 25222 raft_consensus.cc:2468] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 7.
I20260709 13:11:39.388309 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:39.150600 25124 catalog_manager.cc:5697] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:11:39.157281 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:39.224604 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:39.390552 25229 raft_consensus.cc:3060] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:39.227380 25228 raft_consensus.cc:2468] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 4.
W20260709 13:11:39.227708 25195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:39.229058 25230 raft_consensus.cc:2468] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 5.
I20260709 13:11:39.391570 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:39.392103 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:11:39.392156 25195 connection.cc:256] RPC call timeout handler was delayed by -1.3563020330001336s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15400000000000003s for a response
I20260709 13:11:39.392920 25230 raft_consensus.cc:2410] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:11:39.243392 25374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36254 (request call id 1812) took 1127 ms. Trace:
I20260709 13:11:39.278039 25343 leader_election.cc:304] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:39.389518 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:39.401628 25222 raft_consensus.cc:2468] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 5.
I20260709 13:11:39.402665 25222 raft_consensus.cc:1240] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:39.415369 25228 raft_consensus.cc:2468] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 7.
I20260709 13:11:39.365061 25302 raft_consensus.cc:2468] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 5.
I20260709 13:11:39.366649 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:11:39.367445 25271 connection.cc:256] RPC call timeout handler was delayed by -1.301329729000031s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16510000000000002s for a response
W20260709 13:11:39.423305 25271 connection.cc:256] RPC call timeout handler was delayed by -1.279729728999996s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1675s for a response
W20260709 13:11:39.423663 25271 connection.cc:256] RPC call timeout handler was delayed by -1.2122297290000006s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17500000000000002s for a response
W20260709 13:11:39.424095 25271 connection.cc:256] RPC call timeout handler was delayed by -1.1987297290000924s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1765s for a response
W20260709 13:11:39.424513 25872 leader_election.cc:336] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Timed out: RequestConsensusVote RPC to 127.23.140.66:33127 timed out after 1.714s (SENT)
I20260709 13:11:39.375831 27977 raft_consensus.cc:493] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:39.426239 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
W20260709 13:11:39.385946 25377 rpcz_store.cc:269] 0709 13:11:37.508362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:37.508497 (+   135us) service_pool.cc:224] Handling call
0709 13:11:39.219186 (+1710689us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b54000b9d54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:39.219338 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":273233280}
I20260709 13:11:39.393280 25374 rpcz_store.cc:276] 0709 13:11:38.115998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:38.235050 (+119052us) service_pool.cc:224] Handling call
0709 13:11:39.243164 (+1008114us) spinlock_profiling.cc:243] Waited 840 ms on lock 0x7b5400307d54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:39.243331 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1932950784}
I20260709 13:11:39.397054 25195 leader_election.cc:304] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:11:39.429872 25300 raft_consensus.cc:1240] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:39.436678 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:11:39.437634 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 159656us
I20260709 13:11:39.439424 25343 leader_election.cc:304] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:39.430466 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:39.437791 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:39.430184 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:39.441740 25299 raft_consensus.cc:2393] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 6: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:39.442538 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:39.442654 25302 raft_consensus.cc:1275] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:11:39.443629 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:11:39.444021 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:39.445398 25226 raft_consensus.cc:2410] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:11:39.446836 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:39.449934 25225 raft_consensus.cc:2468] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 5.
I20260709 13:11:39.452167 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:39.453576 25299 raft_consensus.cc:2410] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 6 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:11:39.454402 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:39.456583 25229 raft_consensus.cc:2410] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:11:39.457216 25300 raft_consensus.cc:2393] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 7: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:39.457656 25302 raft_consensus.cc:2468] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 4.
I20260709 13:11:39.457976 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:39.462716 25372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56308 (request call id 396) took 1130 ms. Trace:
I20260709 13:11:39.441629 25124 catalog_manager.cc:5697] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:39.463104 25372 rpcz_store.cc:276] 0709 13:11:38.332570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:38.332675 (+   105us) service_pool.cc:224] Handling call
0709 13:11:39.128565 (+795890us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:39.129960 (+  1395us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:39.462550 (+332590us) spinlock_profiling.cc:243] Waited 795 ms on lock 0x7b54002882d0. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6e8ad 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:39.462663 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1829579136}
I20260709 13:11:39.474560 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:39.475221 25303 raft_consensus.cc:2468] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 5.
I20260709 13:11:39.367674 27988 raft_consensus.cc:493] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.474617 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:39.479434 25124 catalog_manager.cc:5697] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 4 to 5, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 5 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:39.429011 27871 raft_consensus.cc:493] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.429198 27783 raft_consensus.cc:493] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:39.442394 27901 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.441996 27978 raft_consensus.cc:493] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:39.485730 25159 debug-util.cc:398] Leaking SignalData structure 0x7b08002fda80 after lost signal to thread 24116
W20260709 13:11:39.494499 25159 debug-util.cc:398] Leaking SignalData structure 0x7b080027b280 after lost signal to thread 25162
W20260709 13:11:39.487867 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 48523.8us
I20260709 13:11:39.496966 25343 leader_election.cc:304] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:39.242950 27649 consensus_queue.cc:1059] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.236s
I20260709 13:11:39.444021 25900 raft_consensus.cc:2468] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 5.
I20260709 13:11:39.377179 27851 consensus_queue.cc:1048] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.106s
I20260709 13:11:39.377336 27906 consensus_queue.cc:1059] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.106s
W20260709 13:11:39.498052 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:39.500509 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 277179us
I20260709 13:11:39.442201 27899 raft_consensus.cc:515] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:39.502948 25124 catalog_manager.cc:5697] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 4 to 5, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 5 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:39.377003 27975 raft_consensus.cc:515] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:39.512040 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:39.489543 27979 raft_consensus.cc:2804] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:39.465801 27654 raft_consensus.cc:2749] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:11:39.145597 25125 rpcz_store.cc:269] 0709 13:11:24.972360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:25.010070 (+ 37710us) service_pool.cc:224] Handling call
0709 13:11:39.145113 (+14135043us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:31.306326 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:31.307058 (+   732us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:31.307130 (+    72us) write_op.cc:435] Acquired schema lock
0709 13:11:31.307161 (+    31us) tablet.cc:662] Decoding operations
0709 13:11:31.308460 (+  1299us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:31.308564 (+   104us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:31.308590 (+    26us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:11:31.309807 (+  1217us) tablet.cc:701] Row locks acquired
0709 13:11:31.309855 (+    48us) write_op.cc:260] PREPARE: finished
0709 13:11:31.310034 (+   179us) write_op.cc:270] Start()
0709 13:11:31.310191 (+   157us) write_op.cc:276] Timestamp: P: 1783602691309973 usec, L: 0
0709 13:11:31.310227 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 13:11:31.310890 (+   663us) log.cc:844] Serialized 4489 byte log entry
0709 13:11:31.815679 (+504789us) op_driver.cc:464] REPLICATION: finished
0709 13:11:31.995230 (+179551us) write_op.cc:301] APPLY: starting
0709 13:11:31.995337 (+   107us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:31.995569 (+   232us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:31.997501 (+  1932us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:32.125044 (+127543us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:32.125455 (+   411us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 13:11:32.125504 (+    49us) write_op.cc:312] APPLY: finished
0709 13:11:32.125970 (+   466us) log.cc:844] Serialized 83 byte log entry
0709 13:11:32.126168 (+   198us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:32.126315 (+   147us) write_op.cc:454] Released schema lock
0709 13:11:32.126394 (+    79us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:32.126862 (+   468us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:32.126906 (+    44us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2731451,"reported_tablets":23,"child_traces":[["op",{"apply.queue_time_us":166267,"apply.run_cpu_time_us":5558,"apply.run_wall_time_us":131557,"num_ops":11,"prepare.queue_time_us":67483,"prepare.run_cpu_time_us":23915,"prepare.run_wall_time_us":110907,"raft.queue_time_us":129851,"raft.run_cpu_time_us":26674,"raft.run_wall_time_us":204866,"replication_time_us":448887,"thread_start_us":260540,"threads_started":4,"wal-append.queue_time_us":149993,"wal-append.run_cpu_time_us":13279,"wal-append.run_wall_time_us":1675625}]]}
W20260709 13:11:39.520462 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:39.545359 25159 debug-util.cc:398] Leaking SignalData structure 0x7b08002b2260 after lost signal to thread 25254
I20260709 13:11:39.548338 25124 catalog_manager.cc:5697] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 1 to 2, leader changed from 79d99c0e498349bda74127365219e468 (127.23.140.67) to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 2 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:39.550766 25301 raft_consensus.cc:3060] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:39.553340 25194 leader_election.cc:304] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:11:39.554364 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:39.485988 27977 raft_consensus.cc:515] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:39.550179 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 153183us
I20260709 13:11:39.493204 27783 raft_consensus.cc:515] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:39.568467 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 71583.6us
I20260709 13:11:39.492556 27871 raft_consensus.cc:515] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:39.571063 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 109574us
I20260709 13:11:39.570348 25343 leader_election.cc:304] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:39.572940 25343 leader_election.cc:400] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 election: Vote denied by peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127) with higher term. Message: Invalid argument: T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 5. Current term is 6.
I20260709 13:11:39.580770 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:39.555615 27945 raft_consensus.cc:3060] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:39.590600 25159 debug-util.cc:398] Leaking SignalData structure 0x7b08003a8ba0 after lost signal to thread 25329
W20260709 13:11:39.591115 25159 debug-util.cc:398] Leaking SignalData structure 0x7b08003a8dc0 after lost signal to thread 25330
W20260709 13:11:39.592610 25159 debug-util.cc:398] Leaking SignalData structure 0x7b0800348fa0 after lost signal to thread 25403
I20260709 13:11:39.549417 27984 raft_consensus.cc:493] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.504906 27978 raft_consensus.cc:515] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:11:39.618140 25124 catalog_manager.cc:5697] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 1 to 3, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 3 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
I20260709 13:11:39.620302 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:39.627830 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:39.602432 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:39.634478 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:11:39.602977 25159 debug-util.cc:398] Leaking SignalData structure 0x7b08002634a0 after lost signal to thread 25404
I20260709 13:11:39.603806 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:11:39.636083 25159 debug-util.cc:398] Leaking SignalData structure 0x7b08003937a0 after lost signal to thread 25932
I20260709 13:11:39.636289 25907 raft_consensus.cc:2393] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 7: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
W20260709 13:11:39.636425 25159 debug-util.cc:398] Leaking SignalData structure 0x7b08003493a0 after lost signal to thread 25933
I20260709 13:11:39.638115 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:39.638830 25377 raft_consensus.cc:2468] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 5.
I20260709 13:11:39.639959 25124 catalog_manager.cc:5697] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 1 to 3, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 3 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
I20260709 13:11:39.569649 27654 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:39.617242 27851 raft_consensus.cc:2749] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:39.623124 27649 raft_consensus.cc:3055] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:39.646806 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:39.646967 25372 raft_consensus.cc:2468] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 5.
I20260709 13:11:39.654114 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:39.654718 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:39.655594 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:39.654819 25379 raft_consensus.cc:2468] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 7.
I20260709 13:11:39.645843 25124 catalog_manager.cc:5697] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 1 to 3, leader changed from 79d99c0e498349bda74127365219e468 (127.23.140.67) to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 3 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:39.641883 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 72652.9us
W20260709 13:11:39.683624 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 232607us
I20260709 13:11:39.684947 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:39.685683 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:39.686920 25345 leader_election.cc:304] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:39.690423 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:39.686183 25270 leader_election.cc:304] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:39.700402 25374 raft_consensus.cc:2393] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 4: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:39.647548 27976 raft_consensus.cc:2804] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:39.588903 27990 consensus_queue.cc:1048] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.101s
I20260709 13:11:39.647884 27649 raft_consensus.cc:740] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:39.622947 27984 raft_consensus.cc:515] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:39.696022 27992 raft_consensus.cc:493] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.501076 27901 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:39.483583 27988 raft_consensus.cc:515] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:39.715378 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 162135us
I20260709 13:11:39.716889 25194 leader_election.cc:304] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:39.701606 27979 raft_consensus.cc:697] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 6 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:39.698115 27999 raft_consensus.cc:2804] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:39.720742 28002 raft_consensus.cc:2804] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:39.666326 27654 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:39.721858 27998 consensus_queue.cc:1059] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:39.726121 25301 raft_consensus.cc:2468] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 5.
I20260709 13:11:39.721666 27984 leader_election.cc:290] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:39.708148 27976 raft_consensus.cc:697] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 7 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:39.726763 27999 raft_consensus.cc:493] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:39.723291 27995 raft_consensus.cc:493] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.713694 27992 raft_consensus.cc:515] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:39.728642 25305 raft_consensus.cc:2468] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 7.
I20260709 13:11:39.714002 28000 consensus_queue.cc:1048] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:11:39.735888 27999 raft_consensus.cc:3060] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:39.727027 28002 raft_consensus.cc:493] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:39.745187 25270 leader_election.cc:304] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
W20260709 13:11:39.749396 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 162245us
W20260709 13:11:39.750015 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 43781.1us
I20260709 13:11:39.751295 25343 leader_election.cc:304] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:39.729974 27899 leader_election.cc:290] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:39.729462 28006 raft_consensus.cc:2749] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:39.762967 27992 leader_election.cc:290] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:39.766053 27783 leader_election.cc:290] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:39.766283 28001 raft_consensus.cc:2804] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:39.766867 28001 raft_consensus.cc:697] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 7 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:39.747720 27975 leader_election.cc:290] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:39.780723 27991 raft_consensus.cc:2749] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:11:39.787716 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 92809.3us
I20260709 13:11:39.783550 27851 raft_consensus.cc:3055] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:39.785725 28000 raft_consensus.cc:3055] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:39.788897 28000 raft_consensus.cc:740] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
W20260709 13:11:39.789211 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 122549us
I20260709 13:11:39.758266 27984 consensus_queue.cc:1048] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:11:39.790453 27976 consensus_queue.cc:237] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:39.793665 27654 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:39.794332 27654 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:39.794870 27654 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:39.796525 27978 leader_election.cc:290] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:39.797073 27654 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:39.752544 28002 raft_consensus.cc:3060] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:39.802521 28001 consensus_queue.cc:237] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:39.738631 27906 consensus_queue.cc:1048] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:11:39.822022 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:39.823101 25907 raft_consensus.cc:2393] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 4: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:11:39.823793 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:11:39.836185 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 46287.7us
I20260709 13:11:39.788501 27851 raft_consensus.cc:740] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:39.842615 25195 leader_election.cc:304] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:11:39.843528 25195 leader_election.cc:304] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
W20260709 13:11:39.843159 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 91843.2us
W20260709 13:11:39.843226 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 92468.4us
I20260709 13:11:39.846873 25296 raft_consensus.cc:1240] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:39.735401 27649 consensus_queue.cc:260] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:39.857687 25343 leader_election.cc:304] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:11:39.860345 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 420942us
I20260709 13:11:39.819954 27901 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:39.862699 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:39.862810 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:39.863896 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:39.864410 25225 raft_consensus.cc:3060] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:39.864625 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:39.865733 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:39.866178 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:39.866335 25228 raft_consensus.cc:2468] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 10.
I20260709 13:11:39.866703 25226 raft_consensus.cc:3060] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:39.739006 27995 raft_consensus.cc:515] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:39.880702 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:39.882349 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:39.883795 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:39.885015 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:39.886698 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:39.868899 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:39.869333 25229 raft_consensus.cc:1275] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:39.870308 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:39.873082 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:39.873344 28013 raft_consensus.cc:2804] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:39.873858 27978 raft_consensus.cc:2804] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:39.893038 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:39.876374 28002 raft_consensus.cc:515] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:39.877229 25195 leader_election.cc:304] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:39.878321 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:39.878886 27977 leader_election.cc:290] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:39.890054 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:11:39.902192 25872 leader_election.cc:336] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Timed out: RequestConsensusVote RPC to 127.23.140.66:33127 timed out after 1.600s (SENT)
I20260709 13:11:39.897444 28013 raft_consensus.cc:493] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:39.789841 28000 consensus_queue.cc:260] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:39.904239 25226 raft_consensus.cc:2468] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 8.
W20260709 13:11:39.909114 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 163929us
I20260709 13:11:39.900935 28024 raft_consensus.cc:2804] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:39.897598 27978 raft_consensus.cc:493] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:39.859925 27992 consensus_queue.cc:1059] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:11:39.835721 27979 consensus_queue.cc:237] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:39.937351 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:39.945585 25195 leader_election.cc:304] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:39.906795 25225 raft_consensus.cc:2468] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 6.
I20260709 13:11:39.945590 25270 leader_election.cc:304] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
W20260709 13:11:39.941679 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 96019.8us
I20260709 13:11:39.930493 28005 raft_consensus.cc:2764] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 13:11:39.982736 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:39.947728 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 58747.6us
I20260709 13:11:39.994823 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:39.951274 27871 leader_election.cc:290] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:39.993140 25872 leader_election.cc:336] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Timed out: RequestConsensusVote RPC to 127.23.140.66:33127 timed out after 1.550s (SENT)
I20260709 13:11:39.944437 28029 consensus_queue.cc:1048] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 13:11:39.900810 28009 consensus_queue.cc:1048] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 13:11:39.930922 28013 raft_consensus.cc:3060] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:39.998888 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 53406us
I20260709 13:11:40.005715 27977 consensus_queue.cc:1048] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
W20260709 13:11:39.999418 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 51881.7us
I20260709 13:11:39.951479 28022 raft_consensus.cc:1064] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468: attempting to promote NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 to VOTER
W20260709 13:11:40.001691 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 144112us
I20260709 13:11:40.005404 28030 raft_consensus.cc:2749] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:11:40.005965 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 60454.3us
I20260709 13:11:39.952329 28024 raft_consensus.cc:493] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:40.017588 25270 leader_election.cc:304] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:40.018481 25271 leader_election.cc:304] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:11:40.019310 25872 leader_election.cc:336] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Timed out: RequestConsensusVote RPC to 127.23.140.66:33127 timed out after 1.601s (SENT)
I20260709 13:11:40.009740 25345 leader_election.cc:304] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:39.912020 27851 consensus_queue.cc:260] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:40.026664 25195 leader_election.cc:304] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:39.992002 27978 raft_consensus.cc:3060] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:39.999740 28000 raft_consensus.cc:3060] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:40.032152 25195 leader_election.cc:304] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
W20260709 13:11:40.034514 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 285601us
I20260709 13:11:40.017976 28012 raft_consensus.cc:2749] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:11:40.077105 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 55165.8us
I20260709 13:11:40.024626 27871 raft_consensus.cc:2804] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:40.016471 27654 raft_consensus.cc:493] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.075001 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:40.034610 27895 raft_consensus.cc:2749] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:40.070585 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:40.077872 25343 leader_election.cc:304] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:40.085143 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:40.028008 28009 consensus_queue.cc:1059] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:11:40.087100 25907 raft_consensus.cc:2393] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 8: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:11:40.073239 25874 leader_election.cc:304] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:11:40.030575 28024 raft_consensus.cc:3060] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:40.087826 27991 raft_consensus.cc:2804] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:40.075745 27977 raft_consensus.cc:2804] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:40.024964 27975 consensus_queue.cc:1048] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 13:11:40.077481 28030 raft_consensus.cc:2749] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:11:40.142227 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 69094.8us
I20260709 13:11:40.040428 27899 consensus_queue.cc:1059] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
W20260709 13:11:40.152045 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 142373us
I20260709 13:11:40.091054 27851 raft_consensus.cc:3060] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:40.089172 27871 raft_consensus.cc:697] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 8 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:40.089025 28020 raft_consensus.cc:493] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:40.089329 27654 raft_consensus.cc:515] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:40.153555 27894 raft_consensus.cc:2804] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:40.163946 27998 raft_consensus.cc:2804] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:40.169431 27998 raft_consensus.cc:493] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:40.169835 27998 raft_consensus.cc:3060] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:40.170461 28031 log.cc:927] Time spent T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:11:40.158140 27991 raft_consensus.cc:493] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:40.178573 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:40.179670 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:40.160432 27977 raft_consensus.cc:493] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
W20260709 13:11:40.195333 25872 leader_election.cc:336] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Timed out: RequestConsensusVote RPC to 127.23.140.66:33127 timed out after 1.774s (SENT)
I20260709 13:11:40.205219 25872 leader_election.cc:304] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:40.203152 25874 leader_election.cc:304] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:40.140411 27999 raft_consensus.cc:515] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:40.219558 25874 leader_election.cc:304] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:11:40.219332 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:40.221313 25223 raft_consensus.cc:2468] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 6.
I20260709 13:11:40.174626 27894 raft_consensus.cc:493] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:40.140861 28032 consensus_queue.cc:1059] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.110s
W20260709 13:11:40.256019 25194 leader_election.cc:336] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Timed out: RequestConsensusVote RPC to 127.23.140.66:33127 timed out after 1.540s (SENT)
I20260709 13:11:40.198856 27991 raft_consensus.cc:3060] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:40.201256 28002 leader_election.cc:290] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:40.261816 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:11:40.264006 28016 log.cc:927] Time spent T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.259s	user 0.000s	sys 0.001s
I20260709 13:11:40.209074 27977 raft_consensus.cc:3060] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:40.265724 27649 raft_consensus.cc:3060] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:40.199610 28030 raft_consensus.cc:3055] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:11:40.260457 25872 leader_election.cc:336] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Timed out: RequestConsensusVote RPC to 127.23.140.66:33127 timed out after 1.788s (SENT)
W20260709 13:11:40.306130 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 45701us
I20260709 13:11:40.167272 28020 raft_consensus.cc:515] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:40.264499 28021 log.cc:927] Time spent T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:11:40.304595 25899 raft_consensus.cc:2393] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 6: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
W20260709 13:11:40.307787 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 290249us
I20260709 13:11:40.218194 27742 raft_consensus.cc:2749] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:40.199800 27937 consensus_queue.cc:1048] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.076s
W20260709 13:11:40.310907 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 54920.8us
I20260709 13:11:40.270033 27871 consensus_queue.cc:237] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:40.329391 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 310976us
W20260709 13:11:40.331578 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 55475.2us
W20260709 13:11:40.305267 28035 log.cc:927] Time spent T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.155s	user 0.005s	sys 0.009s
I20260709 13:11:40.252692 27894 raft_consensus.cc:3060] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:11:40.333441 25194 leader_election.cc:336] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Timed out: RequestConsensusVote RPC to 127.23.140.66:33127 timed out after 1.673s (SENT)
I20260709 13:11:40.257957 27996 raft_consensus.cc:2804] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:40.223266 28037 raft_consensus.cc:2804] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:40.335736 25194 leader_election.cc:304] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:40.257288 27995 leader_election.cc:290] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:11:40.306047 28025 log.cc:927] Time spent T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.345s	user 0.000s	sys 0.001s
I20260709 13:11:40.336061 25271 leader_election.cc:304] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:40.308903 28030 raft_consensus.cc:740] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:40.354449 28030 consensus_queue.cc:260] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:40.355675 28030 raft_consensus.cc:3060] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:40.358873 27783 raft_consensus.cc:3055] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:40.359273 27783 raft_consensus.cc:740] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:40.360091 27783 consensus_queue.cc:260] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:40.361295 27783 raft_consensus.cc:3060] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:40.364500 27988 leader_election.cc:290] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:40.331130 28002 raft_consensus.cc:493] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:40.269402 28033 consensus_queue.cc:1048] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.070s
I20260709 13:11:40.370047 28002 raft_consensus.cc:515] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:40.374635 27999 leader_election.cc:290] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:40.377866 28045 raft_consensus.cc:493] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.378360 28045 raft_consensus.cc:515] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:40.382745 27654 leader_election.cc:290] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:40.348528 28005 raft_consensus.cc:2749] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:40.383602 27998 raft_consensus.cc:515] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:40.252562 27994 raft_consensus.cc:2749] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:40.258437 27906 consensus_queue.cc:1048] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 13:11:40.372620 28002 leader_election.cc:290] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:40.387351 25899 raft_consensus.cc:1240] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:40.391446 25270 leader_election.cc:304] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:11:40.413021 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:40.385548 27945 consensus_meta.cc:287] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.766s	user 0.011s	sys 0.000s
W20260709 13:11:40.390421 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 300732us
I20260709 13:11:40.310245 28014 consensus_queue.cc:1048] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.041s
W20260709 13:11:40.421139 25343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:40.402264 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 238991us
W20260709 13:11:40.398036 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:40.411199 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 75182.8us
I20260709 13:11:40.390686 27996 raft_consensus.cc:697] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:40.429302 25270 leader_election.cc:304] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:40.424286 28034 consensus_queue.cc:1059] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:11:40.415946 28038 raft_consensus.cc:2804] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:40.383411 28013 raft_consensus.cc:515] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:40.430202 25271 leader_election.cc:304] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:40.419289 27945 raft_consensus.cc:2749] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:11:40.433988 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 94651.8us
I20260709 13:11:40.422436 28014 consensus_queue.cc:1243] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [LEADER]: Peer 1f539ba21487460085b837e7529a78ce log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:11:40.435555 25270 leader_election.cc:304] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
W20260709 13:11:40.439042 25874 leader_election.cc:336] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Timed out: RequestConsensusVote RPC to 127.23.140.65:39361 timed out after 1.854s (SENT)
I20260709 13:11:40.461712 25874 leader_election.cc:304] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:40.422823 28002 raft_consensus.cc:493] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.440600 25271 leader_election.cc:304] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:40.440765 25345 leader_election.cc:304] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:40.433647 27999 raft_consensus.cc:493] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:40.419687 27654 consensus_queue.cc:1059] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:11:40.464428 25343 leader_election.cc:304] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:40.404800 28024 raft_consensus.cc:515] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:40.432214 27851 raft_consensus.cc:493] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:40.436597 28018 consensus_queue.cc:1059] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:11:40.468240 25227 raft_consensus.cc:2393] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 3: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:40.440384 27988 raft_consensus.cc:2804] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:40.442247 27990 raft_consensus.cc:2804] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:40.436074 28038 raft_consensus.cc:493] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:40.472361 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:40.434966 28044 raft_consensus.cc:2804] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:40.477543 25222 raft_consensus.cc:1240] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:40.475122 25345 leader_election.cc:304] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:40.477833 25226 raft_consensus.cc:2393] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 5: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:40.477960 25228 raft_consensus.cc:1240] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:11:40.478552 25345 leader_election.cc:304] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:40.475710 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:40.500100 25225 raft_consensus.cc:2468] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 7.
I20260709 13:11:40.500229 25343 leader_election.cc:304] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:40.475302 27851 raft_consensus.cc:515] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:40.503473 27851 leader_election.cc:290] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:40.505546 27899 raft_consensus.cc:2749] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:40.479858 27988 raft_consensus.cc:493] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:40.507288 27988 raft_consensus.cc:3060] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:40.510665 28018 raft_consensus.cc:3055] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:40.511143 28018 raft_consensus.cc:740] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:40.511974 28018 consensus_queue.cc:260] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:40.513177 28018 raft_consensus.cc:3060] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:40.513396 25114 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 275226661cc840559134f8c9e5b15719 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 79d99c0e498349bda74127365219e468 (127.23.140.67:34091) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 79d99c0e498349bda74127365219e468 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:11:40.514201 27977 raft_consensus.cc:515] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:40.514900 28020 leader_election.cc:290] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:40.468031 27994 raft_consensus.cc:2749] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:40.516170 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:40.517058 25194 leader_election.cc:304] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:40.440613 28033 consensus_queue.cc:1048] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:11:40.442219 27995 consensus_queue.cc:1048] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:11:40.529168 25224 raft_consensus.cc:1240] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:40.527256 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:40.529570 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:40.532224 27906 raft_consensus.cc:2749] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:40.532394 27990 raft_consensus.cc:697] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 7 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:40.480664 27945 raft_consensus.cc:2804] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:40.480363 28044 raft_consensus.cc:493] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:40.468786 28002 raft_consensus.cc:515] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:40.469799 27999 raft_consensus.cc:515] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:40.539695 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:40.481788 28038 raft_consensus.cc:3060] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:40.581346 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 64364.3us
I20260709 13:11:40.582624 25904 raft_consensus.cc:1240] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 3. Current term is 4. Ops: []
W20260709 13:11:40.582542 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 82366.2us
I20260709 13:11:40.582137 25194 leader_election.cc:304] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:40.589200 25343 leader_election.cc:304] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
W20260709 13:11:40.605499 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 170016us
W20260709 13:11:40.600426 25872 leader_election.cc:336] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Timed out: RequestConsensusVote RPC to 127.23.140.66:33127 timed out after 2.177s (SENT)
I20260709 13:11:40.607479 25872 leader_election.cc:304] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:40.532357 28000 raft_consensus.cc:2749] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:40.530484 28046 raft_consensus.cc:2804] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:40.527220 28048 raft_consensus.cc:2804] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:40.591110 27899 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.578209 28044 raft_consensus.cc:3060] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:40.595288 27649 raft_consensus.cc:2749] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:40.574923 27992 consensus_queue.cc:1048] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:11:40.537456 27978 raft_consensus.cc:515] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:40.579533 27945 raft_consensus.cc:493] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:40.608672 27895 raft_consensus.cc:2749] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:40.537920 27894 raft_consensus.cc:515] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:40.648543 25195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:40.639770 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 161252us
I20260709 13:11:40.621460 28017 raft_consensus.cc:2804] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:40.649711 28017 raft_consensus.cc:493] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:40.650230 28017 raft_consensus.cc:3060] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:40.623385 27937 raft_consensus.cc:2749] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 LEARNER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:40.636198 28014 raft_consensus.cc:2804] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:40.649413 25345 leader_election.cc:304] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:40.656904 28037 raft_consensus.cc:493] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:40.658670 28022 raft_consensus.cc:1068] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468: Unable to promote non-voter 6c4b021f3f9e41adb75e870a08ad88b6: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:11:40.636067 28046 raft_consensus.cc:697] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 7 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:40.637550 27998 leader_election.cc:290] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:40.649364 27984 raft_consensus.cc:3055] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:40.657508 28037 raft_consensus.cc:3060] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:40.637884 28045 leader_election.cc:290] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:40.671090 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:40.672006 25224 raft_consensus.cc:3060] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:40.645277 27945 raft_consensus.cc:3060] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:40.670753 25900 raft_consensus.cc:1240] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:40.640167 27899 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:40.669032 27984 raft_consensus.cc:740] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:40.613837 27996 consensus_queue.cc:237] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:40.674031 27895 consensus_queue.cc:1059] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:11:40.697290 27894 leader_election.cc:290] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:40.729626 25224 raft_consensus.cc:2468] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 11.
W20260709 13:11:40.515311 28006 consensus_queue.cc:1175] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "79d99c0e498349bda74127365219e468" responder_term: 4 status { last_received { term: 3 index: 3 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 3. Current term is 4. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:11:40.703276 27977 leader_election.cc:290] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:40.698561 28014 raft_consensus.cc:697] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 5 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:40.744783 28043 raft_consensus.cc:3055] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:11:40.737058 28042 log.cc:927] Time spent T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
I20260709 13:11:40.737879 28024 leader_election.cc:290] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:40.774788 27984 consensus_queue.cc:260] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:40.797621 28053 log.cc:927] Time spent T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 13:11:40.797739 27984 raft_consensus.cc:3060] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:40.802273 27999 leader_election.cc:290] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:40.810096 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 59304.3us
I20260709 13:11:40.663717 27990 consensus_queue.cc:237] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:40.748262 28043 raft_consensus.cc:740] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
W20260709 13:11:40.758520 28051 log.cc:927] Time spent T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 13:11:40.745828 28067 raft_consensus.cc:2804] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:11:40.757759 28057 log.cc:927] Time spent T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
W20260709 13:11:40.815984 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 170449us
I20260709 13:11:40.824059 25270 leader_election.cc:400] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085) with higher term. Message: Invalid argument: T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for earlier term 7. Current term is 8.
I20260709 13:11:40.825192 25270 leader_election.cc:304] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:40.814482 28027 raft_consensus.cc:3055] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:40.846661 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:40.848954 25270 leader_election.cc:304] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
W20260709 13:11:40.850049 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 199920us
I20260709 13:11:40.850817 25345 leader_election.cc:304] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:40.804036 27945 raft_consensus.cc:515] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:40.822422 28002 leader_election.cc:290] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:40.848960 28027 raft_consensus.cc:740] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:40.859542 25345 leader_election.cc:304] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:40.859861 25270 leader_election.cc:304] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:40.860662 25345 leader_election.cc:304] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:40.862126 25270 leader_election.cc:400] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085) with higher term. Message: Invalid argument: T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for earlier term 5. Current term is 6.
I20260709 13:11:40.863297 25270 leader_election.cc:403] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:11:40.862902 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 249420us
I20260709 13:11:40.864295 25270 leader_election.cc:304] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:11:40.853919 27978 leader_election.cc:290] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:40.870821 28061 log.cc:927] Time spent T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:11:40.872989 27988 raft_consensus.cc:515] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:40.850816 27975 raft_consensus.cc:2749] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:40.879766 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:40.881680 25378 raft_consensus.cc:1240] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:40.849865 28067 raft_consensus.cc:697] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 8 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:40.884554 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:40.882342 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:40.883076 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:40.883419 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:40.886909 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:40.887061 25378 raft_consensus.cc:1240] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:40.887184 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:40.854007 27992 raft_consensus.cc:493] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:40.889171 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:40.891059 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:40.891774 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:40.892175 25305 raft_consensus.cc:2393] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 6: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:40.892338 25302 raft_consensus.cc:3060] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:40.892587 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:40.893388 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:40.892067 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:40.754531 28046 consensus_queue.cc:237] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:40.895531 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:40.882129 28068 raft_consensus.cc:3060] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:11:40.877147 28060 raft_consensus.cc:2749] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:40.897387 25345 leader_election.cc:304] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:40.889176 25373 raft_consensus.cc:2468] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 5.
I20260709 13:11:40.862565 28054 raft_consensus.cc:2749] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:40.874405 27998 raft_consensus.cc:2804] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:40.896996 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:40.877022 27999 raft_consensus.cc:2804] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:40.896867 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:40.909509 25345 leader_election.cc:304] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:40.909806 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:40.884869 28039 raft_consensus.cc:2804] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:40.912618 25371 raft_consensus.cc:2410] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:11:40.910135 28022 raft_consensus.cc:2804] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:40.915978 25302 raft_consensus.cc:2468] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 6.
I20260709 13:11:40.911391 28002 raft_consensus.cc:2804] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:40.907169 28001 raft_consensus.cc:493] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.919857 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:40.917971 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:40.921247 25373 raft_consensus.cc:2468] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 5.
I20260709 13:11:40.921679 25378 raft_consensus.cc:2410] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:11:40.855533 28014 consensus_queue.cc:237] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:40.934728 27988 leader_election.cc:290] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:40.935855 27901 raft_consensus.cc:3055] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:40.936260 27901 raft_consensus.cc:740] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
W20260709 13:11:40.937371 28030 consensus_meta.cc:287] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.581s	user 0.009s	sys 0.000s
I20260709 13:11:40.902756 27992 raft_consensus.cc:515] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:40.937793 28027 consensus_queue.cc:260] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:40.938779 28027 raft_consensus.cc:3060] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:40.939810 28058 log.cc:927] Time spent T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.237s	user 0.001s	sys 0.000s
I20260709 13:11:40.940431 27992 leader_election.cc:290] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:40.920159 27998 raft_consensus.cc:697] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 4 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:40.919601 28002 raft_consensus.cc:493] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:40.942392 28002 raft_consensus.cc:3060] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:40.922861 28001 raft_consensus.cc:515] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:40.944283 27999 raft_consensus.cc:697] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 7 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:40.944621 28001 leader_election.cc:290] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:40.945207 27999 consensus_queue.cc:237] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:40.920570 28022 raft_consensus.cc:697] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 5 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:40.885974 28043 consensus_queue.cc:260] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:40.922866 28067 consensus_queue.cc:237] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:40.922137 27906 raft_consensus.cc:2749] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:40.913942 28039 raft_consensus.cc:493] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:40.959194 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:40.959578 25376 raft_consensus.cc:2468] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 7.
I20260709 13:11:40.928982 28037 raft_consensus.cc:515] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:40.930465 27783 consensus_meta.cc:287] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 0.569s	user 0.011s	sys 0.000s
I20260709 13:11:40.930858 27945 leader_election.cc:290] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:40.985026 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:40.985775 25304 raft_consensus.cc:2376] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 6. Re-sending same reply.
I20260709 13:11:40.941819 27998 consensus_queue.cc:237] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:40.923823 25345 leader_election.cc:304] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:40.947842 25373 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69"
dest_uuid: "79d99c0e498349bda74127365219e468"
mode: GRACEFUL
new_leader_uuid: "1f539ba21487460085b837e7529a78ce"
 from {username='slave'} at 127.0.0.1:59274
I20260709 13:11:40.989081 25373 raft_consensus.cc:606] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Received request to transfer leadership to TS 1f539ba21487460085b837e7529a78ce
I20260709 13:11:40.989423 25373 raft_consensus.cc:614] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:40.953433 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:40.946818 28022 consensus_queue.cc:237] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:40.949041 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:40.937502 27899 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:40.925163 27991 consensus_meta.cc:287] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.620s	user 0.009s	sys 0.000s
I20260709 13:11:40.960021 25371 raft_consensus.cc:2468] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 6.
I20260709 13:11:40.947263 28043 raft_consensus.cc:3060] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:40.986375 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:40.961597 28039 raft_consensus.cc:3060] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:40.986042 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:40.934866 28017 raft_consensus.cc:515] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:40.987756 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:40.998149 27945 raft_consensus.cc:3060] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:40.999300 25304 raft_consensus.cc:2468] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 5.
I20260709 13:11:40.990254 25302 raft_consensus.cc:2468] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 6.
I20260709 13:11:41.002626 28068 raft_consensus.cc:2749] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085) with higher term. Message: Invalid argument: T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for earlier term 5. Current term is 6.
I20260709 13:11:40.995205 27991 raft_consensus.cc:515] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:41.003419 25298 raft_consensus.cc:2468] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 6.
I20260709 13:11:41.004711 27991 leader_election.cc:290] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:41.005343 25302 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25e0218933774b319104f23505937179"
dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
mode: GRACEFUL
new_leader_uuid: "1f539ba21487460085b837e7529a78ce"
 from {username='slave'} at 127.0.0.1:35660
I20260709 13:11:41.005950 25302 raft_consensus.cc:606] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Received request to transfer leadership to TS 1f539ba21487460085b837e7529a78ce
I20260709 13:11:41.006251 25302 raft_consensus.cc:614] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:41.007427 27945 raft_consensus.cc:2749] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:40.952083 28048 raft_consensus.cc:697] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 5 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:40.991943 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:40.937117 27901 consensus_queue.cc:260] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:40.994894 25296 raft_consensus.cc:1275] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:11:40.995208 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 71466.5us
I20260709 13:11:41.010870 25302 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0"
dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
mode: GRACEFUL
new_leader_uuid: "1f539ba21487460085b837e7529a78ce"
 from {username='slave'} at 127.0.0.1:35660
I20260709 13:11:41.017769 25302 raft_consensus.cc:606] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Received request to transfer leadership to TS 1f539ba21487460085b837e7529a78ce
I20260709 13:11:41.017822 25345 leader_election.cc:304] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:41.018385 25302 raft_consensus.cc:614] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:41.011900 25372 raft_consensus.cc:1240] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 7. Current term is 8. Ops: [7.3-7.3]
I20260709 13:11:41.012354 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:41.013015 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:41.013489 25374 raft_consensus.cc:1217] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Deduplicated request from leader. Original: 4.5->[5.6-5.6]   Dedup: 5.6->[]
I20260709 13:11:40.961278 28012 consensus_queue.cc:1048] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:11:41.019560 25345 leader_election.cc:304] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:41.020097 25374 raft_consensus.cc:1240] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:11:41.022066 28024 raft_consensus.cc:2749] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:41.022754 28024 raft_consensus.cc:2804] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:41.023212 28024 raft_consensus.cc:493] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:41.020107 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:41.023613 28024 raft_consensus.cc:3060] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:41.024221 25371 raft_consensus.cc:2410] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:11:41.022671 25302 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69"
dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
mode: GRACEFUL
new_leader_uuid: "1f539ba21487460085b837e7529a78ce"
 from {username='slave'} at 127.0.0.1:35660
I20260709 13:11:41.026464 25302 raft_consensus.cc:606] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 8 LEADER]: Received request to transfer leadership to TS 1f539ba21487460085b837e7529a78ce
I20260709 13:11:41.028004 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:41.030297 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:41.030957 25379 raft_consensus.cc:3060] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:41.035337 25296 raft_consensus.cc:1240] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:41.037648 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:41.037919 27901 raft_consensus.cc:3060] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:41.050906 28037 leader_election.cc:290] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:41.051667 25371 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93"
dest_uuid: "79d99c0e498349bda74127365219e468"
mode: GRACEFUL
new_leader_uuid: "1f539ba21487460085b837e7529a78ce"
 from {username='slave'} at 127.0.0.1:59274
I20260709 13:11:41.052310 25371 raft_consensus.cc:606] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Received request to transfer leadership to TS 1f539ba21487460085b837e7529a78ce
I20260709 13:11:41.052621 25371 raft_consensus.cc:614] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:41.054018 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:41.054082 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:41.054838 25904 raft_consensus.cc:3060] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:41.060047 25379 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 4.
W20260709 13:11:41.034308 28009 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.011s	sys 0.003s
I20260709 13:11:41.065006 25375 raft_consensus.cc:2468] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 7.
I20260709 13:11:41.065833 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:41.065173 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:41.072100 28019 raft_consensus.cc:3055] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:41.072587 28019 raft_consensus.cc:740] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:41.073462 28019 consensus_queue.cc:260] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:41.074589 28019 raft_consensus.cc:3060] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:41.076635 28048 consensus_queue.cc:237] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:41.080245 24113 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:11:41.066641 28009 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.700s	user 0.011s	sys 0.004s
I20260709 13:11:41.082024 24113 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:11:41.062549 28018 consensus_meta.cc:287] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.534s	user 0.010s	sys 0.000s
I20260709 13:11:41.087270 25904 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 7.
I20260709 13:11:41.082332 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:41.030189 28002 raft_consensus.cc:515] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:41.088801 25370 raft_consensus.cc:2410] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:11:41.089818 25375 raft_consensus.cc:2393] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 7: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:41.098723 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:41.100265 25378 raft_consensus.cc:1240] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 7 LEADER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:41.099682 25296 raft_consensus.cc:2468] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 7.
I20260709 13:11:41.114331 25874 leader_election.cc:304] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:11:41.117059 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:41.117681 25907 raft_consensus.cc:3060] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:41.119170 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:41.117120 28049 raft_consensus.cc:2804] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:41.124925 25903 raft_consensus.cc:1240] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:41.034387 28038 raft_consensus.cc:515] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:41.133868 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:41.139181 25903 raft_consensus.cc:2368] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 6. Current term is 7.
I20260709 13:11:41.118095 28039 raft_consensus.cc:515] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:41.148587 25301 raft_consensus.cc:2393] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 7: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:41.155529 25195 leader_election.cc:400] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Vote denied by peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085) with higher term. Message: Invalid argument: T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 6. Current term is 7.
I20260709 13:11:41.155859 25195 leader_election.cc:403] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:41.158253 25903 raft_consensus.cc:1275] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:41.162752 25907 raft_consensus.cc:2468] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 6.
W20260709 13:11:41.163496 25195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:41.163936 25373 raft_consensus.cc:1240] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 8 LEADER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:41.167589 28017 leader_election.cc:290] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:41.168120 25371 raft_consensus.cc:1240] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:41.175431 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:41.146283 27945 raft_consensus.cc:493] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:41.150331 28049 raft_consensus.cc:697] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:41.184010 28049 consensus_queue.cc:237] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:41.185618 28000 raft_consensus.cc:1064] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468: attempting to promote NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 to VOTER
W20260709 13:11:41.186188 28000 raft_consensus.cc:1068] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468: Unable to promote non-voter 6c4b021f3f9e41adb75e870a08ad88b6: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:11:41.185242 27945 raft_consensus.cc:515] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:11:41.192926 25296 raft_consensus.cc:2468] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 6.
W20260709 13:11:41.194000 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:41.171308 27976 raft_consensus.cc:3060] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:11:41.196847 27945 leader_election.cc:290] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:41.198176 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:41.206562 25302 raft_consensus.cc:2468] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 6.
I20260709 13:11:41.162992 28020 consensus_queue.cc:1059] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.036s
W20260709 13:11:41.220409 25872 leader_election.cc:336] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Timed out: RequestConsensusVote RPC to 127.23.140.66:33127 timed out after 2.305s (SENT)
I20260709 13:11:41.221040 25872 leader_election.cc:304] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:41.182768 28002 leader_election.cc:290] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:41.199529 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:11:41.179212 28044 consensus_meta.cc:287] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.535s	user 0.010s	sys 0.000s
I20260709 13:11:41.199995 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:41.201499 25300 raft_consensus.cc:1275] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:41.227512 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:11:41.228102 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:41.228199 25300 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 3.
I20260709 13:11:41.229239 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:41.196897 28038 leader_election.cc:290] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:41.213966 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:11:41.224915 28029 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.062s	user 0.019s	sys 0.006s
I20260709 13:11:41.225591 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:41.200790 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:41.200706 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:41.234318 25299 raft_consensus.cc:3060] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:41.238965 28094 raft_consensus.cc:2749] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:41.231566 25300 raft_consensus.cc:2468] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 5.
I20260709 13:11:41.239868 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:41.241060 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:41.230659 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:41.242070 25304 raft_consensus.cc:2468] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 7.
I20260709 13:11:41.195253 28067 raft_consensus.cc:493] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:41.252184 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:41.252967 25303 raft_consensus.cc:2393] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 6: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:41.252681 28067 raft_consensus.cc:515] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:41.253775 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:41.254534 25303 raft_consensus.cc:2410] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:11:41.254609 25372 raft_consensus.cc:1240] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:41.254822 28067 leader_election.cc:290] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:41.255291 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:11:41.222419 28089 log.cc:927] Time spent T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:11:41.242909 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:41.244002 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:41.239928 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:41.231987 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:41.245061 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:41.251050 25299 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 4.
I20260709 13:11:41.255568 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:41.352348 25372 raft_consensus.cc:2376] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 4. Re-sending same reply.
I20260709 13:11:41.353274 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:41.353338 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:41.354651 25302 raft_consensus.cc:2393] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 4: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:41.355839 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:41.355988 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:41.356400 25372 raft_consensus.cc:3060] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:41.356905 25296 raft_consensus.cc:2468] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 6.
I20260709 13:11:41.359547 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:41.360224 25296 raft_consensus.cc:2468] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 7.
I20260709 13:11:41.361142 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:41.362262 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:41.358197 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:41.189803 28017 consensus_queue.cc:1048] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:11:41.362975 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:11:41.233428 28029 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.079s	user 0.019s	sys 0.006s
I20260709 13:11:41.368093 25303 raft_consensus.cc:2468] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 6.
I20260709 13:11:41.364064 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:41.369069 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:41.364128 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:41.365041 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:41.366022 25299 raft_consensus.cc:2468] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 7.
I20260709 13:11:41.219735 27979 raft_consensus.cc:493] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:41.366618 25296 raft_consensus.cc:2468] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 6.
I20260709 13:11:41.357555 25305 raft_consensus.cc:2393] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 8: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:41.357105 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:41.371343 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:41.371824 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:41.370790 25304 raft_consensus.cc:3060] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:41.372586 25296 raft_consensus.cc:3060] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:41.372221 25299 raft_consensus.cc:2468] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 6.
I20260709 13:11:41.373696 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:41.369632 25303 raft_consensus.cc:2468] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 6.
I20260709 13:11:41.374764 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:41.377451 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:41.380308 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:41.383272 25299 raft_consensus.cc:1275] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:41.383737 25302 raft_consensus.cc:2468] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 6.
I20260709 13:11:41.384871 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:41.386794 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:41.392077 25228 raft_consensus.cc:1217] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Deduplicated request from leader. Original: 3.6->[5.7-10.9]   Dedup: 5.7->[8.8-10.9]
I20260709 13:11:41.388743 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:41.392293 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:41.387609 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:41.389982 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:41.392619 25228 raft_consensus.cc:1240] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 10. Current term is 11. Ops: [5.7-10.9]
I20260709 13:11:41.394557 25302 raft_consensus.cc:3060] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:41.395833 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:41.396915 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
W20260709 13:11:41.397487 25227 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54000 (request call id 414) took 1523 ms (client timeout 1854 ms). Trace:
I20260709 13:11:41.398056 25299 raft_consensus.cc:2393] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 6: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
W20260709 13:11:41.397881 25227 rpcz_store.cc:269] 0709 13:11:39.874333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:39.886420 (+ 12087us) service_pool.cc:224] Handling call
0709 13:11:41.397299 (+1510879us) spinlock_profiling.cc:243] Waited 581 ms on lock 0x7b54002c0bd4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:41.397424 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1335231872}
I20260709 13:11:41.399488 25229 raft_consensus.cc:1240] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:11:41.399405 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:41.368382 28039 leader_election.cc:290] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:41.401150 25303 raft_consensus.cc:2468] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 4.
I20260709 13:11:41.403039 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:41.395119 25372 raft_consensus.cc:2468] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 5.
I20260709 13:11:41.233614 28044 raft_consensus.cc:515] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:41.404474 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:11:41.509781 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 289367us
I20260709 13:11:41.510290 25299 raft_consensus.cc:2393] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 6: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:11:41.403785 25221 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 4.
I20260709 13:11:41.512097 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:41.512588 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:41.416448 25226 raft_consensus.cc:1240] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:41.462496 25304 raft_consensus.cc:2468] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 5.
I20260709 13:11:41.459514 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:41.516126 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:41.518270 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:41.518901 25299 raft_consensus.cc:2468] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 7.
I20260709 13:11:41.519622 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:11:41.520406 25872 leader_election.cc:336] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Timed out: RequestConsensusVote RPC to 127.23.140.66:33127 timed out after 1.558s (SENT)
I20260709 13:11:41.521023 25872 leader_election.cc:304] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:41.491302 25377 raft_consensus.cc:2468] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 5.
I20260709 13:11:41.522710 25302 raft_consensus.cc:2468] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 8.
I20260709 13:11:41.529122 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:41.524534 25303 raft_consensus.cc:2393] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 7: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:41.442955 25296 raft_consensus.cc:2468] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 6.
I20260709 13:11:41.531991 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:11:41.532306 25872 leader_election.cc:336] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Timed out: RequestConsensusVote RPC to 127.23.140.66:33127 timed out after 2.173s (SENT)
W20260709 13:11:41.469244 28093 log.cc:927] Time spent T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:11:41.532912 25872 leader_election.cc:304] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:41.536092 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:41.536350 25297 raft_consensus.cc:1240] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:41.537791 25296 raft_consensus.cc:1240] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:11:41.539732 27996 raft_consensus.cc:2749] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:41.540776 28090 raft_consensus.cc:2749] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:41.541514 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:41.541939 27945 raft_consensus.cc:3055] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:41.542501 27945 raft_consensus.cc:740] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:41.543658 27945 consensus_queue.cc:260] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:41.545222 27945 raft_consensus.cc:3060] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:41.510116 28013 leader_election.cc:290] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:41.382210 27979 raft_consensus.cc:515] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:41.525791 28024 raft_consensus.cc:515] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:41.570736 27979 leader_election.cc:290] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:41.571419 25379 raft_consensus.cc:1240] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:41.571079 28024 leader_election.cc:290] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:41.597368 28044 leader_election.cc:290] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:41.525987 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:41.524775 25225 raft_consensus.cc:2393] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 7: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:41.660181 25296 raft_consensus.cc:1240] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 5 LEADER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:41.660955 25304 raft_consensus.cc:1240] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:11:41.667822 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:41.669610 25304 raft_consensus.cc:2468] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 6.
I20260709 13:11:41.673789 25222 raft_consensus.cc:3060] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:41.674990 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:41.690307 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:41.691243 27871 raft_consensus.cc:493] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:41.692356 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:41.690558 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:41.692303 27871 raft_consensus.cc:515] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:41.677321 27979 raft_consensus.cc:493] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:41.712284 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 173267us
I20260709 13:11:41.714833 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:41.718320 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:41.719348 25372 raft_consensus.cc:2393] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 7: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:41.721989 25299 raft_consensus.cc:2376] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 5. Re-sending same reply.
I20260709 13:11:41.727854 27979 raft_consensus.cc:515] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:41.728240 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:41.729094 25370 raft_consensus.cc:2468] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 7.
I20260709 13:11:41.730813 27979 leader_election.cc:290] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:41.726037 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:41.736598 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:41.733253 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:41.740316 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:41.741667 25301 raft_consensus.cc:2393] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 5: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:41.747956 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:41.749328 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:41.752374 28065 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:41.755568 27871 leader_election.cc:290] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:41.756825 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:41.758069 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:41.760151 25374 raft_consensus.cc:1240] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:41.760429 25370 raft_consensus.cc:1275] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:11:41.760876 25370 pending_rounds.cc:85] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468: Aborting all ops after (but not including) 3
I20260709 13:11:41.761250 25370 pending_rounds.cc:107] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:11:41.762236 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:41.762938 25378 raft_consensus.cc:1240] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:11:41.764046 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:41.764578 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:41.764814 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:41.765655 25304 raft_consensus.cc:2368] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 6. Current term is 7.
I20260709 13:11:41.767249 25372 raft_consensus.cc:1275] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:11:41.767633 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:41.768966 25906 raft_consensus.cc:2393] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 4: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:11:41.764102 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:41.767665 25372 pending_rounds.cc:85] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468: Aborting all ops after (but not including) 3
I20260709 13:11:41.769028 25370 raft_consensus.cc:2889] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:41.770906 25373 raft_consensus.cc:2368] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 6. Current term is 7.
I20260709 13:11:41.753660 28065 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:41.764199 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
W20260709 13:11:41.736595 25872 leader_election.cc:336] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Timed out: RequestConsensusVote RPC to 127.23.140.66:33127 timed out after 1.912s (SENT)
I20260709 13:11:41.789287 25872 leader_election.cc:304] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:41.788802 25222 raft_consensus.cc:2468] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 6.
I20260709 13:11:41.792021 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:41.794778 25299 raft_consensus.cc:2468] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 5.
I20260709 13:11:41.800251 25299 raft_consensus.cc:1275] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:11:41.800999 28065 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:41.809204 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:41.804244 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:41.815442 25299 raft_consensus.cc:1240] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 7. Current term is 8. Ops: []
W20260709 13:11:41.820001 27976 consensus_meta.cc:287] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 0.597s	user 0.009s	sys 0.014s
I20260709 13:11:41.820837 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:41.830334 25372 pending_rounds.cc:107] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:11:41.831806 25372 raft_consensus.cc:2889] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:41.836980 25376 raft_consensus.cc:1240] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 5 LEADER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:11:41.838572 25301 raft_consensus.cc:1240] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:11:41.844863 25303 raft_consensus.cc:1275] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:41.846473 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:41.850878 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:41.851523 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:41.853204 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:41.856490 25305 raft_consensus.cc:1240] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:41.858989 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
W20260709 13:11:41.859968 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:41.865172 25873 leader_election.cc:336] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 1.788s (SENT)
I20260709 13:11:41.867022 25873 leader_election.cc:304] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:41.875576 25301 raft_consensus.cc:1240] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:41.893740 28094 raft_consensus.cc:2749] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:41.894726 28094 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:41.895293 28094 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:41.895560 28097 consensus_queue.cc:1059] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:41.873742 27994 raft_consensus.cc:2749] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:41.898120 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:41.899348 25222 raft_consensus.cc:2393] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 5: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:41.900003 28092 consensus_queue.cc:1059] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:11:41.901961 25194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:41.842724 27976 raft_consensus.cc:2749] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085) with higher term. Message: Invalid argument: T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 6. Current term is 7.
I20260709 13:11:41.902557 28049 consensus_queue.cc:1059] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:11:41.897562 28097 raft_consensus.cc:3055] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:41.910820 28097 raft_consensus.cc:740] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:41.919415 25230 raft_consensus.cc:2468] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 6.
I20260709 13:11:41.944983 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:41.984427 28039 raft_consensus.cc:493] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:41.985252 27945 raft_consensus.cc:493] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:41.984579 25229 raft_consensus.cc:1240] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:41.986099 27945 raft_consensus.cc:515] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:42.002969 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 285187us
I20260709 13:11:41.977421 28094 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:11:42.008241 25195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.006544 28073 raft_consensus.cc:493] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:42.008610 27976 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:42.010802 25230 raft_consensus.cc:1240] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:42.003803 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:42.011157 28097 consensus_queue.cc:260] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:42.027673 28097 raft_consensus.cc:3060] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:42.028478 27996 raft_consensus.cc:3055] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:42.018862 25377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36254 (request call id 1822) took 1137 ms. Trace:
I20260709 13:11:42.019726 28073 raft_consensus.cc:515] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:42.029094 25377 rpcz_store.cc:276] 0709 13:11:40.882158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:40.882831 (+   673us) service_pool.cc:224] Handling call
0709 13:11:42.018427 (+1135596us) spinlock_profiling.cc:243] Waited 580 ms on lock 0x7b54003124d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:42.018636 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1334872320}
I20260709 13:11:42.019883 25227 raft_consensus.cc:1240] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:11:42.031350 28073 leader_election.cc:290] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:42.022531 25270 leader_election.cc:304] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:42.026319 25908 raft_consensus.cc:2468] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 7.
I20260709 13:11:42.020897 27976 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:42.028914 25195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.013041 27945 leader_election.cc:290] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:42.049981 28038 raft_consensus.cc:2749] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:42.028949 27996 raft_consensus.cc:740] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
W20260709 13:11:42.054176 25195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.056140 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:42.056391 28018 consensus_queue.cc:1059] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:41.985292 28039 raft_consensus.cc:515] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:42.057313 25902 raft_consensus.cc:1240] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:42.057487 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:42.051810 27976 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:42.063565 25345 leader_election.cc:304] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:42.066262 25906 raft_consensus.cc:2468] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 6.
I20260709 13:11:42.066289 25230 raft_consensus.cc:1240] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:42.067934 25229 raft_consensus.cc:1275] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:11:42.069299 25195 leader_election.cc:304] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:11:42.075549 25225 raft_consensus.cc:1240] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:42.074101 28073 raft_consensus.cc:2804] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:42.087092 25345 leader_election.cc:304] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:42.088054 28090 consensus_queue.cc:1059] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:42.089177 28018 consensus_queue.cc:1059] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:42.098186 27996 consensus_queue.cc:260] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:42.091106 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:42.099493 28018 raft_consensus.cc:3055] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:42.091305 28044 raft_consensus.cc:3055] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:42.099944 28018 raft_consensus.cc:740] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:42.100106 28044 raft_consensus.cc:740] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:42.090265 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:42.101241 25375 raft_consensus.cc:2393] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 4: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:11:42.091917 28073 raft_consensus.cc:697] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 6 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:42.101317 28044 consensus_queue.cc:260] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:42.091663 27649 raft_consensus.cc:2749] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:42.102978 28073 consensus_queue.cc:237] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:42.103003 28044 raft_consensus.cc:3060] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:42.092561 27945 raft_consensus.cc:2749] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:42.093792 25195 leader_election.cc:304] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:11:42.094033 25194 leader_election.cc:304] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:11:42.095024 25270 leader_election.cc:304] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
W20260709 13:11:42.097023 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.098038 27894 consensus_queue.cc:1048] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:42.098820 28022 raft_consensus.cc:493] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.092828 28039 leader_election.cc:290] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:42.099797 25230 raft_consensus.cc:2468] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 7.
I20260709 13:11:42.107553 25195 leader_election.cc:304] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:42.107420 27783 raft_consensus.cc:2804] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:42.109510 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
W20260709 13:11:42.145608 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.146780 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:42.147300 25375 raft_consensus.cc:3060] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:42.163964 25228 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 7.
I20260709 13:11:42.142091 27976 raft_consensus.cc:2804] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:42.141952 27783 raft_consensus.cc:493] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:42.166879 25379 raft_consensus.cc:1240] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 7 LEADER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:42.165120 25345 leader_election.cc:304] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
W20260709 13:11:42.173640 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 123132us
I20260709 13:11:42.151759 28039 raft_consensus.cc:2749] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:42.214251 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
W20260709 13:11:42.240860 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 153385us
I20260709 13:11:42.167655 28018 consensus_queue.cc:260] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:42.245196 25379 raft_consensus.cc:2393] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 7: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:42.246212 28018 raft_consensus.cc:3060] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:42.246646 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 105234us
I20260709 13:11:42.247881 25345 leader_election.cc:304] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:42.250551 27945 raft_consensus.cc:3060] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:42.254124 25344 leader_election.cc:304] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:42.254639 28067 raft_consensus.cc:2749] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:42.257858 27995 consensus_queue.cc:1059] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.118s
I20260709 13:11:42.159533 27649 consensus_queue.cc:1059] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.100s
I20260709 13:11:42.259773 27945 raft_consensus.cc:2749] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:11:42.260210 28113 log.cc:927] Time spent T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:11:42.260706 27945 raft_consensus.cc:2804] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:42.261224 27945 raft_consensus.cc:493] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:42.261721 27945 raft_consensus.cc:3060] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:42.261307 28095 raft_consensus.cc:1064] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468: attempting to promote NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 to VOTER
W20260709 13:11:42.262380 28095 raft_consensus.cc:1068] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468: Unable to promote non-voter 6c4b021f3f9e41adb75e870a08ad88b6: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:11:42.263208 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 217796us
I20260709 13:11:42.263940 27649 raft_consensus.cc:3055] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:42.264068 27995 raft_consensus.cc:3055] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:42.264614 27649 raft_consensus.cc:740] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:42.264176 25873 leader_election.cc:304] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:42.169451 27976 raft_consensus.cc:493] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:42.175009 27783 raft_consensus.cc:3060] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:42.264900 27995 raft_consensus.cc:740] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:42.240546 28065 raft_consensus.cc:493] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.276446 27976 raft_consensus.cc:3060] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:42.282979 25345 leader_election.cc:304] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:42.163857 28022 raft_consensus.cc:515] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:42.284185 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
W20260709 13:11:42.290844 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 183455us
W20260709 13:11:42.290644 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 195858us
I20260709 13:11:42.296371 25345 leader_election.cc:304] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:42.283483 28013 raft_consensus.cc:493] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.323479 25345 leader_election.cc:304] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
W20260709 13:11:42.339176 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 59057.9us
I20260709 13:11:42.320401 27851 raft_consensus.cc:2804] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:11:42.336011 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 111440us
I20260709 13:11:42.314908 28065 raft_consensus.cc:515] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:42.331096 28067 raft_consensus.cc:2804] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:42.326031 27649 consensus_queue.cc:260] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:42.357115 27649 raft_consensus.cc:3060] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:42.344170 27851 raft_consensus.cc:493] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:42.365990 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 46313.5us
I20260709 13:11:42.359901 25270 leader_election.cc:304] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:42.368000 25194 leader_election.cc:304] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:42.370565 25872 leader_election.cc:304] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:42.372179 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:42.372596 25872 leader_election.cc:304] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:11:42.373122 25379 raft_consensus.cc:2393] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 9: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:42.373974 28092 raft_consensus.cc:2749] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:42.378242 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:42.379019 25377 raft_consensus.cc:2393] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 8: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:42.385924 28121 raft_consensus.cc:2804] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:42.386745 28121 raft_consensus.cc:697] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:42.386940 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:42.387184 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:42.387928 25372 raft_consensus.cc:2468] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 5.
I20260709 13:11:42.387856 28121 consensus_queue.cc:237] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:42.390039 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:42.390827 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:42.390971 25379 raft_consensus.cc:2468] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 7.
I20260709 13:11:42.392221 25372 raft_consensus.cc:1275] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:11:42.328390 28013 raft_consensus.cc:515] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:42.393600 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:42.394263 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:42.395021 28038 raft_consensus.cc:2804] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:42.395643 28038 raft_consensus.cc:493] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:42.396260 28038 raft_consensus.cc:3060] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:42.395761 25374 raft_consensus.cc:2376] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 7. Re-sending same reply.
I20260709 13:11:42.398312 25223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58418 (request call id 1769) took 1036 ms. Trace:
I20260709 13:11:42.398769 25223 rpcz_store.cc:276] 0709 13:11:41.362017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:41.362162 (+   145us) service_pool.cc:224] Handling call
0709 13:11:41.362454 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:41.362795 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:41.362821 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:41.363224 (+   403us) log.cc:844] Serialized 26 byte log entry
0709 13:11:42.007344 (+644120us) spinlock_profiling.cc:243] Waited 4 ms on lock 0x7b18002d3f40. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72cb64e07 00007fd7359bfab9 00007fd72cb8169b 00007fd72cb7f93f 00007fd72cb81c02 00007fd72f80920b 00007fd72f80ed23 00007fd72f80f0d1 00007fd72fc2aa0f
0709 13:11:42.254035 (+246691us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:42.254129 (+    94us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:42.254199 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:42.397883 (+143684us) raft_consensus.cc:1685] finished
0709 13:11:42.397905 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:42.398121 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":642,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":4819,"spinlock_wait_cycles":9206528,"thread_start_us":164003,"threads_started":1,"wal-append.queue_time_us":975653}
I20260709 13:11:42.400007 25271 leader_election.cc:304] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:42.368906 27851 raft_consensus.cc:3060] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:42.401455 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:42.403033 28065 leader_election.cc:290] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:42.403240 28039 consensus_queue.cc:1059] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:11:42.409178 28108 log.cc:927] Time spent T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.408s	user 0.013s	sys 0.000s
I20260709 13:11:42.395679 28013 leader_election.cc:290] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:42.366866 28067 raft_consensus.cc:697] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 6 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:42.410879 25375 raft_consensus.cc:2468] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 8.
I20260709 13:11:42.354086 28095 raft_consensus.cc:2749] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:42.398382 28022 leader_election.cc:290] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:42.366622 27894 consensus_queue.cc:1048] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:11:42.415923 27871 raft_consensus.cc:2749] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:11:42.433909 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 92805.3us
W20260709 13:11:42.441960 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 87409.1us
W20260709 13:11:42.446652 25871 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.420915 28018 consensus_queue.cc:1059] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
W20260709 13:11:42.450495 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 50682.4us
I20260709 13:11:42.404301 27995 consensus_queue.cc:260] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:42.456056 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 191989us
I20260709 13:11:42.457815 27937 raft_consensus.cc:2804] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:42.458272 27937 raft_consensus.cc:493] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:42.458645 27937 raft_consensus.cc:3060] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:42.456115 25194 leader_election.cc:304] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:42.464742 27851 raft_consensus.cc:515] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:42.466004 28067 consensus_queue.cc:237] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:42.477871 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 96335.4us
W20260709 13:11:42.478746 25343 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.140.66:33127 timed out after 1.567s (SENT) [suppressed 57 similar messages]
W20260709 13:11:42.483120 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 110606us
I20260709 13:11:42.479976 25343 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:42.480683 28129 raft_consensus.cc:2749] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:42.467335 27851 leader_election.cc:290] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:42.486402 25906 raft_consensus.cc:1275] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:11:42.534713 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 52555.2us
I20260709 13:11:42.487305 25194 leader_election.cc:304] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:42.214594 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:11:42.556295 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 206546us
I20260709 13:11:42.488543 28049 raft_consensus.cc:3055] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:42.490448 28095 raft_consensus.cc:2764] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:11:42.499315 25872 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:42.491684 25343 leader_election.cc:304] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:42.485855 28131 raft_consensus.cc:493] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.574186 28131 raft_consensus.cc:515] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:42.576483 28131 leader_election.cc:290] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:42.553939 28129 raft_consensus.cc:2749] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:42.483316 27945 raft_consensus.cc:515] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:42.503172 25270 leader_election.cc:304] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
W20260709 13:11:42.579114 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 76109.7us
I20260709 13:11:42.579943 25270 leader_election.cc:304] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:42.581360 25270 leader_election.cc:304] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:42.579962 27945 leader_election.cc:290] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:42.582062 28095 raft_consensus.cc:2749] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:42.582393 28038 raft_consensus.cc:515] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:42.583318 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 91777us
I20260709 13:11:42.584116 25343 leader_election.cc:304] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:42.584796 28038 leader_election.cc:290] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:42.510500 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.503494 25376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36254 (request call id 1833) took 1493 ms. Trace:
I20260709 13:11:42.506186 27996 raft_consensus.cc:3060] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:42.516778 27937 raft_consensus.cc:515] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:42.585326 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:42.502688 27994 raft_consensus.cc:3055] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:42.497896 27995 raft_consensus.cc:3060] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:42.564633 28097 consensus_queue.cc:1059] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
W20260709 13:11:42.569588 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 70407.8us
W20260709 13:11:42.569852 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 82662.2us
I20260709 13:11:42.570230 28094 raft_consensus.cc:2749] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:11:42.509722 28124 log.cc:927] Time spent T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:11:42.486763 28127 raft_consensus.cc:2804] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:42.485244 28133 raft_consensus.cc:2804] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:42.606424 28127 raft_consensus.cc:493] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:42.606549 28133 raft_consensus.cc:493] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:42.606940 28127 raft_consensus.cc:3060] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:42.607122 28133 raft_consensus.cc:3060] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:42.603677 25194 leader_election.cc:304] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:42.577957 28018 consensus_queue.cc:1059] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:42.584832 28095 raft_consensus.cc:2749] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:42.512637 25228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58418 (request call id 1785) took 1046 ms. Trace:
I20260709 13:11:42.615406 25228 rpcz_store.cc:276] 0709 13:11:41.466612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:41.511816 (+ 45204us) service_pool.cc:224] Handling call
0709 13:11:42.512375 (+1000559us) spinlock_profiling.cc:243] Waited 403 ms on lock 0x7b54003a6954. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:42.512559 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":926248320}
I20260709 13:11:42.586926 25376 rpcz_store.cc:276] 0709 13:11:41.010475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:41.027446 (+ 16971us) service_pool.cc:224] Handling call
0709 13:11:41.057334 (+ 29888us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:41.837511 (+780177us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:42.482840 (+645329us) spinlock_profiling.cc:243] Waited 779 ms on lock 0x7b540009bfd4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:42.503397 (+ 20557us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1791920000}
I20260709 13:11:42.617162 25377 raft_consensus.cc:2468] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 3.
I20260709 13:11:42.500530 27783 raft_consensus.cc:515] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:42.619414 27783 leader_election.cc:290] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:42.585572 28038 raft_consensus.cc:2749] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:42.561309 28049 raft_consensus.cc:740] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:42.621166 28049 consensus_queue.cc:260] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:42.622493 28049 raft_consensus.cc:3060] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:42.598924 27976 raft_consensus.cc:515] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:42.627209 27976 leader_election.cc:290] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:42.602233 25902 raft_consensus.cc:3060] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:42.598912 27994 raft_consensus.cc:740] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:42.603084 27937 leader_election.cc:290] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:42.603173 25872 leader_election.cc:304] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:42.603825 25128 catalog_manager.cc:5697] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 3 to 6, leader changed from 79d99c0e498349bda74127365219e468 (127.23.140.67) to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 6 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
W20260709 13:11:42.604131 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 147083us
I20260709 13:11:42.610366 28097 raft_consensus.cc:3055] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:42.614648 25343 leader_election.cc:304] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:42.611191 25873 leader_election.cc:304] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce
W20260709 13:11:42.637334 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.638254 28097 raft_consensus.cc:740] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:42.640385 28094 raft_consensus.cc:2804] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:42.640611 25343 leader_election.cc:304] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:42.640874 28097 consensus_queue.cc:260] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:42.641944 27995 raft_consensus.cc:3060] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:42.642666 28097 raft_consensus.cc:3060] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:42.645011 25872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:42.647316 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.640874 28094 raft_consensus.cc:493] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:42.649801 28094 raft_consensus.cc:3060] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:42.652041 25902 raft_consensus.cc:2468] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 7.
I20260709 13:11:42.637984 27994 consensus_queue.cc:260] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:42.653510 28121 raft_consensus.cc:2804] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:42.653873 28044 raft_consensus.cc:2804] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:42.654186 28121 raft_consensus.cc:697] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:42.654338 28044 raft_consensus.cc:493] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:42.654816 28044 raft_consensus.cc:3060] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:42.655176 28121 consensus_queue.cc:237] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:42.657316 25344 leader_election.cc:304] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:42.658028 25194 leader_election.cc:304] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:11:42.658236 28095 raft_consensus.cc:2804] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:42.658845 28095 raft_consensus.cc:697] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 7 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:42.659024 27976 raft_consensus.cc:2804] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:42.659580 25194 leader_election.cc:304] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:42.659602 27976 raft_consensus.cc:697] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 5 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:42.659981 28095 consensus_queue.cc:237] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:42.638041 28136 raft_consensus.cc:2804] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:42.661944 27783 raft_consensus.cc:2749] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:42.662063 28136 raft_consensus.cc:493] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:42.662623 28136 raft_consensus.cc:3060] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:42.663498 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:42.664261 25901 raft_consensus.cc:2393] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 7: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:42.661303 27976 consensus_queue.cc:237] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:42.666169 28134 raft_consensus.cc:2749] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:42.668032 28038 raft_consensus.cc:3055] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:42.668478 28038 raft_consensus.cc:740] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:42.668638 25901 raft_consensus.cc:1240] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:42.669868 27649 raft_consensus.cc:493] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:42.677140 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 66572.9us
I20260709 13:11:42.677770 27649 raft_consensus.cc:515] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:42.679075 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 83050.6us
I20260709 13:11:42.680104 27649 leader_election.cc:290] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:42.682857 25371 raft_consensus.cc:1240] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:42.683095 28132 raft_consensus.cc:3055] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:42.683444 28132 raft_consensus.cc:740] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:42.684886 25375 raft_consensus.cc:1275] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:11:42.684518 28132 consensus_queue.cc:260] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:42.686919 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:42.688567 28134 consensus_queue.cc:1059] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:42.678085 25195 leader_election.cc:304] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
W20260709 13:11:42.690423 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 109199us
I20260709 13:11:42.698724 28067 consensus_queue.cc:1059] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:42.691897 25343 leader_election.cc:304] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:42.740979 28141 raft_consensus.cc:3055] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:42.742511 25194 leader_election.cc:400] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Vote denied by peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127) with higher term. Message: Invalid argument: T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 6. Current term is 7.
W20260709 13:11:42.743024 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 81262.6us
W20260709 13:11:42.756023 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.757592 25270 leader_election.cc:304] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:42.758905 25270 leader_election.cc:304] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:42.759994 25224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58418 (request call id 1782) took 1309 ms. Trace:
I20260709 13:11:42.760198 28024 raft_consensus.cc:3055] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:42.760785 28024 raft_consensus.cc:740] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:42.761384 28067 raft_consensus.cc:2804] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:42.761826 28067 raft_consensus.cc:493] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:42.762176 28067 raft_consensus.cc:3060] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:42.761839 28024 consensus_queue.cc:260] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:42.767122 28024 raft_consensus.cc:3060] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:42.782337 27995 raft_consensus.cc:2749] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:42.759397 28133 raft_consensus.cc:515] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:42.782943 25128 catalog_manager.cc:5697] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 4 to 6, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 6 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
W20260709 13:11:42.760301 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 68484.2us
I20260709 13:11:42.785156 25128 catalog_manager.cc:5697] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 2 to 5, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 5 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
I20260709 13:11:42.741559 28141 raft_consensus.cc:740] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:42.703608 27994 raft_consensus.cc:3060] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:42.700198 28125 consensus_queue.cc:1048] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:42.669406 28038 consensus_queue.cc:260] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:42.694916 27945 raft_consensus.cc:2804] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:42.696913 28018 raft_consensus.cc:493] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:42.698218 28047 raft_consensus.cc:493] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:42.705286 28043 raft_consensus.cc:493] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.698913 27894 consensus_queue.cc:1059] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:42.708402 28094 raft_consensus.cc:515] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:42.700603 28022 consensus_queue.cc:1048] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:42.696974 28039 raft_consensus.cc:3055] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:42.699245 27851 raft_consensus.cc:1064] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468: attempting to promote NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 to VOTER
I20260709 13:11:42.689703 28134 consensus_queue.cc:1059] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 13:11:42.695634 28132 raft_consensus.cc:3060] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:11:42.726627 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 48623.2us
W20260709 13:11:42.792490 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 123217us
I20260709 13:11:42.795150 25228 raft_consensus.cc:1275] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:11:42.760373 25224 rpcz_store.cc:276] 0709 13:11:41.450750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:41.450900 (+   150us) service_pool.cc:224] Handling call
0709 13:11:41.454115 (+  3215us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:41.454360 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:41.454389 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:42.506222 (+1051833us) spinlock_profiling.cc:243] Waited 4.77 ms on lock 0x7b2c000014c8. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72e568a11 00007fd72e578372 00007fd72fcaaa01 00007fd72fc6f43a 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2
0709 13:11:42.506819 (+   597us) log.cc:844] Serialized 26 byte log entry
0709 13:11:42.601489 (+ 94670us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:42.601540 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:42.601662 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:42.759570 (+157908us) raft_consensus.cc:1685] finished
0709 13:11:42.759590 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:42.759814 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10965376,"thread_start_us":94260,"threads_started":1,"wal-append.queue_time_us":247098}
I20260709 13:11:42.797097 25370 raft_consensus.cc:1240] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:42.800479 25343 leader_election.cc:304] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:42.787007 28136 raft_consensus.cc:515] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:11:42.812628 25227 raft_consensus.cc:1275] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:11:42.799028 27945 raft_consensus.cc:493] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:42.815811 28126 raft_consensus.cc:2749] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:11:42.811771 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 57641.7us
I20260709 13:11:42.816735 28043 raft_consensus.cc:515] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:42.818717 28136 leader_election.cc:290] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:42.810634 25128 catalog_manager.cc:5697] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 3 to 6, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 6 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:42.834870 25222 raft_consensus.cc:1275] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:42.836797 25226 raft_consensus.cc:1275] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:11:42.812095 28018 raft_consensus.cc:515] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:42.837709 28142 raft_consensus.cc:2804] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:42.839442 28018 leader_election.cc:290] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:42.841638 28094 leader_election.cc:290] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:42.840030 28018 raft_consensus.cc:2804] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:42.842810 25195 leader_election.cc:304] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
W20260709 13:11:42.843386 25345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.806535 28039 raft_consensus.cc:740] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
W20260709 13:11:42.848312 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 54783.1us
W20260709 13:11:42.823115 27851 raft_consensus.cc:1068] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468: Unable to promote non-voter 6c4b021f3f9e41adb75e870a08ad88b6: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:11:42.826236 27945 raft_consensus.cc:3060] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:42.856835 25228 raft_consensus.cc:1275] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:11:42.855683 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:42.846285 28018 raft_consensus.cc:493] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:42.872455 25128 catalog_manager.cc:5697] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 4 to 5, leader changed from 79d99c0e498349bda74127365219e468 (127.23.140.67) to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 5 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:11:42.864782 27649 raft_consensus.cc:2804] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:42.899936 27649 raft_consensus.cc:493] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:42.900453 27649 raft_consensus.cc:3060] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:42.893080 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:42.904433 25228 raft_consensus.cc:3060] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:42.905498 25345 leader_election.cc:304] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:42.908463 28133 leader_election.cc:290] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:42.909343 27851 raft_consensus.cc:2804] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:42.812907 28047 raft_consensus.cc:515] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:42.896538 28039 consensus_queue.cc:260] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:42.897301 27937 raft_consensus.cc:3055] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:42.897720 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:11:42.898334 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 55607.3us
I20260709 13:11:42.898595 25128 catalog_manager.cc:5697] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 4 to 6, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 6 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
W20260709 13:11:42.912293 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 153459us
I20260709 13:11:42.878756 28038 raft_consensus.cc:3060] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:42.917971 25227 raft_consensus.cc:2468] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 7.
I20260709 13:11:42.924492 25228 raft_consensus.cc:2468] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 7.
I20260709 13:11:42.925040 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:42.891177 28136 raft_consensus.cc:2749] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:42.911341 28018 raft_consensus.cc:3060] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:42.889901 28142 raft_consensus.cc:697] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 7 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:42.923801 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:42.941886 25226 raft_consensus.cc:2468] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 4.
W20260709 13:11:42.927451 25124 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40020 (request call id 263) took 20869 ms (client timeout 15000 ms). Trace:
I20260709 13:11:42.941015 25194 leader_election.cc:304] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:42.946141 25128 catalog_manager.cc:5697] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:42.920612 28126 raft_consensus.cc:493] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.917595 27937 raft_consensus.cc:740] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
W20260709 13:11:42.968762 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 50867.3us
I20260709 13:11:42.922685 28134 consensus_queue.cc:1059] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:11:42.976655 25224 raft_consensus.cc:3060] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:42.988067 25128 catalog_manager.cc:5697] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 2 to 3, leader changed from 79d99c0e498349bda74127365219e468 (127.23.140.67) to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 3 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
W20260709 13:11:43.008154 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 104064us
I20260709 13:11:43.003127 25128 catalog_manager.cc:5697] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 1 to 5, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 5 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
W20260709 13:11:43.016969 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.994956 27851 raft_consensus.cc:697] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 7 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:43.022395 25343 leader_election.cc:304] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
W20260709 13:11:43.028177 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 116034us
I20260709 13:11:43.005844 28039 raft_consensus.cc:3060] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:43.035305 27937 consensus_queue.cc:260] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:43.028332 25128 catalog_manager.cc:5697] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 2 to 4, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 4 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
W20260709 13:11:43.049464 25271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.950446 28141 consensus_queue.cc:260] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:42.970644 28146 consensus_queue.cc:1059] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 13:11:43.024757 28149 raft_consensus.cc:493] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.063663 25224 raft_consensus.cc:2410] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:11:42.944094 25124 rpcz_store.cc:269] 0709 13:11:21.997002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:21.997225 (+   223us) service_pool.cc:224] Handling call
0709 13:11:42.866790 (+20869565us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:39.783718 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:39.784511 (+   793us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:39.784557 (+    46us) write_op.cc:435] Acquired schema lock
0709 13:11:39.784585 (+    28us) tablet.cc:662] Decoding operations
0709 13:11:39.835471 (+ 50886us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:39.840965 (+  5494us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:39.842368 (+  1403us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:11:40.040510 (+198142us) tablet.cc:701] Row locks acquired
0709 13:11:40.063580 (+ 23070us) write_op.cc:260] PREPARE: finished
0709 13:11:40.083147 (+ 19567us) write_op.cc:270] Start()
0709 13:11:40.089295 (+  6148us) write_op.cc:276] Timestamp: P: 1783602700077390 usec, L: 0
0709 13:11:40.094229 (+  4934us) op_driver.cc:348] REPLICATION: starting
0709 13:11:40.251876 (+157647us) log.cc:844] Serialized 3641 byte log entry
0709 13:11:40.908256 (+656380us) op_driver.cc:464] REPLICATION: finished
0709 13:11:41.094178 (+185922us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b18002d4180. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72cb823f3 00007fd72cb847c1 00007fd72cb84779 00007fd72cb84709 00007fd72cb846d1 00007fd72cb839cd 000000000038f354 000000000038f199 00007fd72cb6583a
0709 13:11:41.094316 (+   138us) write_op.cc:301] APPLY: starting
0709 13:11:41.094402 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:41.094608 (+   206us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:41.094632 (+    24us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:41.105838 (+ 11206us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:41.106104 (+   266us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 13:11:41.106160 (+    56us) write_op.cc:312] APPLY: finished
0709 13:11:41.106504 (+   344us) log.cc:844] Serialized 71 byte log entry
0709 13:11:41.110041 (+  3537us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:41.110183 (+   142us) write_op.cc:454] Released schema lock
0709 13:11:41.110232 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:41.149585 (+ 39353us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:41.151227 (+  1642us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5313043,"reported_tablets":33,"child_traces":[["op",{"apply.queue_time_us":91008,"apply.run_cpu_time_us":3204,"apply.run_wall_time_us":36592,"num_ops":9,"prepare.queue_time_us":45568,"prepare.run_cpu_time_us":38630,"prepare.run_wall_time_us":839834,"raft.queue_time_us":117294,"raft.run_cpu_time_us":18998,"raft.run_wall_time_us":119279,"replication_time_us":803025,"spinlock_wait_cycles":37088000,"thread_start_us":462821,"threads_started":4,"wal-append.queue_time_us":373330,"wal-append.run_cpu_time_us":10391,"wal-append.run_wall_time_us":1502776}]]}
I20260709 13:11:43.058007 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:43.001516 28127 raft_consensus.cc:515] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:43.066340 25195 leader_election.cc:304] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:43.006086 27995 consensus_queue.cc:1048] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:11:43.010429 28095 consensus_queue.cc:1048] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:11:43.004109 28126 raft_consensus.cc:515] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:43.022454 27976 consensus_queue.cc:1048] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:11:43.076828 27851 consensus_queue.cc:237] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:43.077822 28121 raft_consensus.cc:493] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:43.078277 28136 raft_consensus.cc:2764] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:11:43.079133 28147 consensus_queue.cc:1048] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:43.081257 28150 raft_consensus.cc:3055] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:43.083822 28152 raft_consensus.cc:3055] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:43.084878 28043 leader_election.cc:290] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:11:43.092600 25873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:43.094811 25872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:43.062099 25128 catalog_manager.cc:5697] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
W20260709 13:11:43.117237 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 63259.1us
W20260709 13:11:43.127388 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 85044us
W20260709 13:11:43.129854 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:43.124485 28149 raft_consensus.cc:515] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:43.140974 28047 leader_election.cc:290] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:43.141989 28149 leader_election.cc:290] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:43.142741 28127 leader_election.cc:290] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:43.143406 28029 consensus_queue.cc:1048] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.075s
W20260709 13:11:43.145663 28144 log.cc:927] Time spent T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
I20260709 13:11:43.121491 28142 consensus_queue.cc:237] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:43.085227 28158 consensus_queue.cc:1048] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
W20260709 13:11:43.152346 28148 log.cc:927] Time spent T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
W20260709 13:11:43.154062 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 123818us
I20260709 13:11:43.155804 25195 leader_election.cc:304] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:43.157316 25195 leader_election.cc:304] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
W20260709 13:11:43.167145 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:43.178869 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 87239.5us
I20260709 13:11:43.128141 28150 raft_consensus.cc:740] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:43.138206 28049 raft_consensus.cc:493] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.137310 28133 raft_consensus.cc:493] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:43.132949 28152 raft_consensus.cc:740] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:43.185936 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:43.186440 25374 raft_consensus.cc:1275] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:11:43.187867 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:43.191131 25906 raft_consensus.cc:2393] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 6: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:11:43.187137 25128 catalog_manager.cc:5697] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
I20260709 13:11:43.158288 28141 raft_consensus.cc:3060] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:43.173211 27783 raft_consensus.cc:2749] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:43.148453 28121 raft_consensus.cc:515] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:43.179512 27976 raft_consensus.cc:2749] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:43.200570 25301 raft_consensus.cc:1275] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:11:43.206405 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:43.128494 28157 consensus_queue.cc:1059] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.073s
W20260709 13:11:43.265614 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 54836.9us
I20260709 13:11:43.266153 25299 raft_consensus.cc:1275] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:11:43.266088 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 108851us
W20260709 13:11:43.266831 25873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:43.210501 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:43.269202 25300 raft_consensus.cc:2468] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 6.
I20260709 13:11:43.208252 28153 raft_consensus.cc:2804] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:43.273423 25128 catalog_manager.cc:5697] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 3 to 5, leader changed from 79d99c0e498349bda74127365219e468 (127.23.140.67) to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 5 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:11:43.188731 28018 raft_consensus.cc:515] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:43.279692 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 77382.5us
I20260709 13:11:43.277240 25128 catalog_manager.cc:5697] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 2 to 4, leader changed from 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 4 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:11:43.178262 28047 consensus_queue.cc:1048] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.093s
I20260709 13:11:43.196130 27649 raft_consensus.cc:515] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:11:43.305328 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:43.319509 25300 raft_consensus.cc:2468] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 9.
I20260709 13:11:43.320336 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:43.320622 27649 leader_election.cc:290] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:43.306253 25376 raft_consensus.cc:1275] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:43.304247 28150 consensus_queue.cc:260] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:43.323004 28150 raft_consensus.cc:3060] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:43.323733 28173 consensus_queue.cc:1059] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:43.324793 28132 raft_consensus.cc:3055] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:43.325186 28132 raft_consensus.cc:740] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:43.273782 28129 raft_consensus.cc:2749] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:43.276043 28125 consensus_queue.cc:1048] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:11:43.326174 28132 consensus_queue.cc:260] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:43.306838 28126 leader_election.cc:290] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:43.308651 28143 log.cc:927] Time spent T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.280s	user 0.001s	sys 0.001s
I20260709 13:11:43.321578 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:43.327574 28132 raft_consensus.cc:3060] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:43.329892 28164 raft_consensus.cc:493] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:43.330451 28164 raft_consensus.cc:515] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:43.332641 28164 leader_election.cc:290] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:43.333771 25296 raft_consensus.cc:1275] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:11:43.336366 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:43.333410 28140 raft_consensus.cc:3055] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:43.337282 28140 raft_consensus.cc:740] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:43.338196 28140 consensus_queue.cc:260] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:43.339457 28140 raft_consensus.cc:3060] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:43.345816 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:43.346553 25296 raft_consensus.cc:2468] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 4.
I20260709 13:11:43.347389 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:11:43.349546 25345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:43.351022 25297 raft_consensus.cc:1275] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:11:43.308821 28097 consensus_meta.cc:287] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent flushing consensus metadata: real 0.666s	user 0.006s	sys 0.003s
I20260709 13:11:43.309190 28153 raft_consensus.cc:697] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 5 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:43.352865 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:43.352723 28153 consensus_queue.cc:237] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:43.309474 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:43.354290 25301 raft_consensus.cc:2468] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 4.
I20260709 13:11:43.355162 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:43.355679 25301 raft_consensus.cc:2468] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 7.
I20260709 13:11:43.310284 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:43.310691 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:43.311177 25195 leader_election.cc:400] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Vote denied by peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091) with higher term. Message: Invalid argument: T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 6. Current term is 7.
I20260709 13:11:43.312346 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:43.313616 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:43.357309 25298 raft_consensus.cc:2468] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 8.
I20260709 13:11:43.313831 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:43.314962 28018 leader_election.cc:290] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:43.317490 25304 raft_consensus.cc:1275] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:43.202826 28049 raft_consensus.cc:515] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:43.206691 28133 raft_consensus.cc:515] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:43.356513 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:43.358220 25303 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 6.
I20260709 13:11:43.376777 25301 raft_consensus.cc:2468] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 7.
I20260709 13:11:43.353639 25297 raft_consensus.cc:2468] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 7.
I20260709 13:11:43.363876 25906 raft_consensus.cc:1275] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:43.321686 27937 raft_consensus.cc:3060] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:43.382262 25270 leader_election.cc:304] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:43.358875 25128 catalog_manager.cc:5697] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:43.363020 28097 raft_consensus.cc:493] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:43.418112 25128 catalog_manager.cc:5697] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:43.419751 25298 raft_consensus.cc:1275] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:11:43.424799 28161 log.cc:927] Time spent T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 13:11:43.427877 25872 leader_election.cc:336] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Timed out: RequestConsensusVote RPC to 127.23.140.66:33127 timed out after 2.219s (SENT)
I20260709 13:11:43.428503 25872 leader_election.cc:304] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:43.429527 27894 raft_consensus.cc:2749] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:43.430516 28097 raft_consensus.cc:515] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:43.435053 28133 leader_election.cc:290] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:43.415285 25270 leader_election.cc:304] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
W20260709 13:11:43.443480 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 146611us
I20260709 13:11:43.356511 27976 consensus_queue.cc:1048] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:11:43.448292 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:43.453253 27976 consensus_queue.cc:1243] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer da445ce82dc4467f95f4fa52297eaa19 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:11:43.453414 25224 raft_consensus.cc:3060] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:11:43.456746 28044 consensus_meta.cc:287] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.801s	user 0.009s	sys 0.001s
I20260709 13:11:43.457147 28044 raft_consensus.cc:515] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:43.394392 28152 consensus_queue.cc:260] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:43.394634 28018 raft_consensus.cc:2749] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:43.452100 25221 raft_consensus.cc:1240] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:11:43.458882 28049 leader_election.cc:290] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:43.462656 28121 leader_election.cc:290] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:43.482900 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 67728.2us
I20260709 13:11:43.490908 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:43.491601 25297 raft_consensus.cc:3060] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:43.493119 25224 raft_consensus.cc:2468] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 8.
W20260709 13:11:43.445595 28067 consensus_meta.cc:287] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.683s	user 0.011s	sys 0.003s
W20260709 13:11:43.484572 25271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:43.485484 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 276381us
I20260709 13:11:43.488018 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:43.488052 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:43.495199 25298 raft_consensus.cc:3060] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:43.496649 25195 leader_election.cc:304] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:43.497440 25271 leader_election.cc:304] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:43.474710 28133 raft_consensus.cc:2749] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:11:43.503427 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 227284us
W20260709 13:11:43.509727 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:43.514462 25871 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:43.517846 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 495472us
I20260709 13:11:43.518798 25343 leader_election.cc:304] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:43.523098 25195 leader_election.cc:304] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:11:43.537990 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:43.518429 28121 raft_consensus.cc:493] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:43.503023 28022 consensus_queue.cc:1048] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.095s
I20260709 13:11:43.484771 28131 consensus_queue.cc:1048] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:11:43.523483 28152 raft_consensus.cc:3060] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:43.633502 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:43.617717 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 77861.5us
I20260709 13:11:43.514855 28018 raft_consensus.cc:2804] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:43.600941 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:43.499855 28067 raft_consensus.cc:515] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:43.626582 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:43.662319 25376 raft_consensus.cc:2468] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 3.
I20260709 13:11:43.660105 25270 leader_election.cc:304] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:43.517782 27783 consensus_queue.cc:1059] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.108s
W20260709 13:11:43.663317 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 144583us
I20260709 13:11:43.623663 28142 raft_consensus.cc:493] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
W20260709 13:11:43.667577 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 123002us
W20260709 13:11:43.669935 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 146893us
I20260709 13:11:43.524586 28173 raft_consensus.cc:2749] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:11:43.670528 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:43.520448 28127 consensus_queue.cc:1059] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.154s
I20260709 13:11:43.680460 25195 leader_election.cc:304] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:43.684674 28140 raft_consensus.cc:2749] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:43.684993 28142 raft_consensus.cc:515] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:43.656162 28018 raft_consensus.cc:493] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:43.659304 27996 raft_consensus.cc:493] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.658087 28175 raft_consensus.cc:493] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:43.619274 28121 raft_consensus.cc:515] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:43.674499 28043 raft_consensus.cc:493] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.660481 28125 consensus_queue.cc:1048] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:11:43.698582 25194 leader_election.cc:304] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:11:43.681427 27851 raft_consensus.cc:493] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:43.745349 25872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:43.724231 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:43.750432 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 70053.6us
W20260709 13:11:43.751849 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 205878us
I20260709 13:11:43.699440 27996 raft_consensus.cc:515] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:43.754803 27996 leader_election.cc:290] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:43.755626 28170 log.cc:927] Time spent T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.319s	user 0.009s	sys 0.003s
I20260709 13:11:43.700611 28126 raft_consensus.cc:3060] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:43.757795 28129 raft_consensus.cc:3055] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:43.758332 28129 raft_consensus.cc:740] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:43.759245 28129 consensus_queue.cc:260] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:43.760630 28129 raft_consensus.cc:3060] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:43.768507 25297 raft_consensus.cc:2468] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 7.
W20260709 13:11:43.770895 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 113599us
I20260709 13:11:43.769963 25298 raft_consensus.cc:2468] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 7.
W20260709 13:11:43.774876 25873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:43.694394 28018 raft_consensus.cc:3060] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:43.784195 25873 leader_election.cc:304] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:43.800449 28044 leader_election.cc:290] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:43.805341 28174 consensus_queue.cc:1048] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.141s
I20260709 13:11:43.709190 28175 raft_consensus.cc:515] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:43.808495 28121 leader_election.cc:290] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:43.750044 27851 raft_consensus.cc:515] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:43.809094 28121 raft_consensus.cc:2804] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:11:43.812978 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 61095.2us
W20260709 13:11:43.813184 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 114719us
I20260709 13:11:43.814198 28185 raft_consensus.cc:2804] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:43.814638 28185 raft_consensus.cc:493] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:43.814955 28185 raft_consensus.cc:3060] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:43.816998 28189 raft_consensus.cc:493] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:43.700307 28147 raft_consensus.cc:2804] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:43.817557 28189 raft_consensus.cc:515] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:43.818195 28147 raft_consensus.cc:697] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 6 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:43.819376 27851 leader_election.cc:290] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:43.819660 28189 leader_election.cc:290] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:43.819296 28147 consensus_queue.cc:237] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:43.820153 28189 raft_consensus.cc:2804] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:43.820572 28189 raft_consensus.cc:493] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:43.820926 28189 raft_consensus.cc:3060] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:43.711337 28043 raft_consensus.cc:515] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:43.822093 25194 leader_election.cc:304] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:11:43.823212 25194 leader_election.cc:304] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:11:43.823946 28043 leader_election.cc:290] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:43.824196 25194 leader_election.cc:304] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:43.824898 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:43.825335 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:43.825511 25194 leader_election.cc:304] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:11:43.826054 25372 raft_consensus.cc:2468] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 4.
I20260709 13:11:43.827980 28184 consensus_queue.cc:1048] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:43.828836 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:43.829425 28184 raft_consensus.cc:2804] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:11:43.829876 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 53958.2us
I20260709 13:11:43.830168 28131 raft_consensus.cc:2804] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:43.830173 28180 raft_consensus.cc:2764] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:11:43.831665 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:43.831491 28049 consensus_queue.cc:1048] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:43.832859 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:43.832968 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:43.833194 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:43.856441 25375 raft_consensus.cc:2368] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 6. Current term is 7.
I20260709 13:11:43.834661 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:43.835578 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:43.857237 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:43.836700 25874 leader_election.cc:304] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
W20260709 13:11:43.842468 28179 log.cc:927] Time spent T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 13:11:43.847394 28142 leader_election.cc:290] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:43.850554 25370 raft_consensus.cc:2410] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:11:43.852242 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:43.856565 25379 raft_consensus.cc:2468] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 5.
I20260709 13:11:43.857036 25378 raft_consensus.cc:2468] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 7.
I20260709 13:11:43.809526 28121 raft_consensus.cc:493] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
W20260709 13:11:43.774657 27945 consensus_meta.cc:287] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.884s	user 0.012s	sys 0.000s
I20260709 13:11:43.867703 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:43.870180 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:43.870723 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:43.871202 25226 raft_consensus.cc:1275] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:43.871704 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:43.877135 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:43.877532 25372 raft_consensus.cc:2393] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 7: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:43.849649 28184 raft_consensus.cc:493] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:43.854976 28131 raft_consensus.cc:493] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:43.878062 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:11:43.869509 28132 consensus_meta.cc:287] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.541s	user 0.011s	sys 0.001s
I20260709 13:11:43.862975 28125 raft_consensus.cc:2804] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:43.882368 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:43.882836 25370 raft_consensus.cc:1240] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 5 LEADER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:43.883206 25226 raft_consensus.cc:1240] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:43.861542 28126 raft_consensus.cc:2749] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:43.885710 28131 raft_consensus.cc:3060] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:43.892675 25221 raft_consensus.cc:1275] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:11:43.867895 28121 raft_consensus.cc:3060] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:43.896157 28175 leader_election.cc:290] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:43.891139 25296 raft_consensus.cc:2410] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:11:43.893110 28097 leader_election.cc:290] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:43.912942 28067 leader_election.cc:290] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:43.916796 28018 raft_consensus.cc:515] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:43.920456 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:11:43.922072 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 65976.6us
I20260709 13:11:43.922631 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:43.922840 25194 leader_election.cc:304] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:43.924031 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:43.924307 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:43.924758 25371 raft_consensus.cc:3060] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:43.924993 25373 raft_consensus.cc:2468] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 5.
I20260709 13:11:43.925347 28173 raft_consensus.cc:3055] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:43.925716 28173 raft_consensus.cc:740] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:43.926631 25299 raft_consensus.cc:2410] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:11:43.926601 28173 consensus_queue.cc:260] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:43.927924 28173 raft_consensus.cc:3060] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:43.912246 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:43.930692 25374 raft_consensus.cc:1275] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:11:43.931092 25374 pending_rounds.cc:85] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468: Aborting all ops after (but not including) 2
I20260709 13:11:43.931313 25374 pending_rounds.cc:107] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:11:43.931541 25374 raft_consensus.cc:2889] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:43.924785 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:43.932564 28152 raft_consensus.cc:493] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.933195 28152 raft_consensus.cc:515] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:43.934736 25229 raft_consensus.cc:2393] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 3: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:43.935370 28152 leader_election.cc:290] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:43.873970 27945 raft_consensus.cc:515] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:43.936951 25377 raft_consensus.cc:1240] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:43.938190 27945 leader_election.cc:290] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:43.939093 25377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56308 (request call id 431) took 1092 ms. Trace:
I20260709 13:11:43.939505 25377 rpcz_store.cc:276] 0709 13:11:42.846892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:42.847043 (+   151us) service_pool.cc:224] Handling call
0709 13:11:42.855757 (+  8714us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:43.937382 (+1081625us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:43.938873 (+  1491us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400306454. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:43.939033 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2486017792}
I20260709 13:11:43.939980 28043 consensus_queue.cc:1048] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:43.936591 25371 raft_consensus.cc:2468] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 8.
I20260709 13:11:43.942167 28186 raft_consensus.cc:493] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.942698 28186 raft_consensus.cc:515] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:43.942082 28174 raft_consensus.cc:3055] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:43.944705 28186 leader_election.cc:290] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:43.944857 28174 raft_consensus.cc:740] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:43.923969 25372 raft_consensus.cc:1240] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 6. Current term is 7. Ops: []
W20260709 13:11:43.947340 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 68708.1us
I20260709 13:11:43.948477 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:43.950611 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:11:43.950974 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 62463.9us
I20260709 13:11:43.952039 25195 leader_election.cc:304] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:43.898175 28125 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:43.876971 28127 raft_consensus.cc:2804] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:43.960640 25270 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:43.888276 28184 raft_consensus.cc:3060] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:43.964766 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:11:43.967540 25271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:43.963995 25194 leader_election.cc:304] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:43.972198 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:43.972396 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:43.974071 25297 raft_consensus.cc:2468] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 5.
I20260709 13:11:43.980836 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:43.989284 25298 raft_consensus.cc:3060] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:43.991451 25873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:43.981105 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:43.986455 25372 raft_consensus.cc:1240] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:11:43.974792 25303 raft_consensus.cc:3060] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:43.974527 25301 raft_consensus.cc:2468] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 8.
I20260709 13:11:43.995249 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:43.972134 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:43.965163 28159 consensus_queue.cc:1048] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:11:43.997013 27996 raft_consensus.cc:493] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.997483 27996 raft_consensus.cc:515] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:43.998205 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:43.998742 25297 raft_consensus.cc:3060] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:43.999280 28152 raft_consensus.cc:2749] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:44.000016 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:44.000591 25305 raft_consensus.cc:2468] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 7.
I20260709 13:11:44.001413 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:44.004230 25305 raft_consensus.cc:3060] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:44.004343 25302 raft_consensus.cc:2393] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 8: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:44.002794 25873 leader_election.cc:304] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:44.008049 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:44.007313 25297 raft_consensus.cc:2468] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 7.
I20260709 13:11:43.950433 28022 consensus_queue.cc:1048] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 13:11:43.971843 28125 raft_consensus.cc:3060] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:44.013592 25271 leader_election.cc:304] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:43.975272 28127 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:44.015697 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:44.008718 25904 raft_consensus.cc:2468] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 7.
I20260709 13:11:44.018242 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:43.963948 28121 raft_consensus.cc:515] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:44.034277 25230 raft_consensus.cc:2468] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 6.
I20260709 13:11:43.973938 28193 raft_consensus.cc:2749] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:44.036108 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:44.039189 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:44.058393 25343 leader_election.cc:304] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:43.988655 28129 raft_consensus.cc:2804] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:43.993637 27937 raft_consensus.cc:493] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.050827 25301 raft_consensus.cc:1275] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:11:44.066147 25296 raft_consensus.cc:3060] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:44.059669 25343 leader_election.cc:304] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:44.067909 25343 leader_election.cc:304] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:43.991042 28163 consensus_queue.cc:1048] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
W20260709 13:11:44.060832 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 96904.2us
I20260709 13:11:44.062256 25379 raft_consensus.cc:1240] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 6 LEADER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:44.061591 28132 raft_consensus.cc:2804] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:44.058303 25195 leader_election.cc:304] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:11:44.064186 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:43.975116 28043 consensus_queue.cc:1048] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
W20260709 13:11:44.019470 28039 consensus_meta.cc:287] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.972s	user 0.011s	sys 0.000s
I20260709 13:11:44.085161 25343 leader_election.cc:304] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:44.073361 25874 leader_election.cc:304] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:11:44.066226 25301 pending_rounds.cc:85] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19: Aborting all ops after (but not including) 3
I20260709 13:11:44.086445 25301 pending_rounds.cc:107] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:11:44.086750 25301 raft_consensus.cc:2889] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:44.069123 25194 leader_election.cc:304] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:44.040939 25297 raft_consensus.cc:2393] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 6: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:44.015673 28152 raft_consensus.cc:493] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.111462 28152 raft_consensus.cc:515] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:44.112129 25297 raft_consensus.cc:1275] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:44.113474 25297 raft_consensus.cc:1275] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:11:44.071496 25302 raft_consensus.cc:2468] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 5.
I20260709 13:11:44.118556 25372 raft_consensus.cc:1240] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:11:44.071616 25298 raft_consensus.cc:2468] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 7.
W20260709 13:11:44.069204 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:44.119725 25270 leader_election.cc:304] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:44.074553 27976 raft_consensus.cc:3060] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:44.077090 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:44.065864 28129 raft_consensus.cc:493] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:44.011422 28094 consensus_queue.cc:1048] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 13:11:44.079445 28018 leader_election.cc:290] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:44.034243 28049 raft_consensus.cc:2804] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:44.091140 28159 raft_consensus.cc:2804] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:44.091965 28067 raft_consensus.cc:1064] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468: attempting to promote NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 to VOTER
I20260709 13:11:44.092350 27945 raft_consensus.cc:2804] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:44.072592 28097 consensus_queue.cc:1048] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 13:11:44.094621 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:44.010583 28174 consensus_queue.cc:260] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:44.095563 28185 raft_consensus.cc:515] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:44.068461 28178 raft_consensus.cc:493] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.152065 28178 raft_consensus.cc:515] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:44.096405 28136 raft_consensus.cc:2804] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:44.130540 28140 raft_consensus.cc:493] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.154104 28136 raft_consensus.cc:493] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:44.154678 28136 raft_consensus.cc:3060] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:44.154531 28140 raft_consensus.cc:515] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:44.156924 28140 leader_election.cc:290] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:44.137658 27945 raft_consensus.cc:493] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:44.010665 28131 raft_consensus.cc:515] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:44.157773 27945 raft_consensus.cc:3060] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:44.159420 28131 leader_election.cc:290] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:44.097551 25195 leader_election.cc:400] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Vote denied by peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091) with higher term. Message: Invalid argument: T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 6. Current term is 7.
I20260709 13:11:44.160159 25195 leader_election.cc:403] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:44.127271 28196 raft_consensus.cc:2804] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:11:44.161016 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 63605.2us
I20260709 13:11:44.161273 28196 raft_consensus.cc:493] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:44.161691 28196 raft_consensus.cc:3060] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:44.161980 25195 leader_election.cc:304] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:44.164251 25195 leader_election.cc:304] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:44.098119 25300 raft_consensus.cc:2410] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:11:44.098879 25901 raft_consensus.cc:1240] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:44.165310 28174 raft_consensus.cc:3060] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:44.098800 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:44.104092 27994 consensus_queue.cc:1059] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:44.169735 25379 raft_consensus.cc:2393] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 7: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:44.169795 27994 raft_consensus.cc:3055] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:44.170310 27994 raft_consensus.cc:740] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:44.171226 27994 consensus_queue.cc:260] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:44.172539 27994 raft_consensus.cc:3060] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:44.132992 28039 raft_consensus.cc:2749] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:44.140614 28097 consensus_queue.cc:1243] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer 1f539ba21487460085b837e7529a78ce log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:11:44.104627 25303 raft_consensus.cc:2468] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 7.
I20260709 13:11:44.104885 25296 raft_consensus.cc:2468] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 8.
I20260709 13:11:44.107689 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:44.108086 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:44.039952 28127 raft_consensus.cc:3060] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:44.114449 28152 leader_election.cc:290] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:44.117261 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 48239us
I20260709 13:11:44.184715 25194 leader_election.cc:304] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:44.117703 25343 leader_election.cc:304] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:44.068552 27851 raft_consensus.cc:2804] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:44.077303 28189 raft_consensus.cc:515] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:44.128010 25270 leader_election.cc:304] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:44.101799 28132 raft_consensus.cc:697] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 8 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:44.067744 28175 consensus_queue.cc:1059] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 13:11:44.093146 27894 raft_consensus.cc:2804] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:44.192263 25296 raft_consensus.cc:1240] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:44.138024 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:44.120178 27996 leader_election.cc:290] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:44.126217 28129 raft_consensus.cc:3060] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:44.124516 28043 raft_consensus.cc:3060] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:44.140909 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:44.141825 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:44.129489 28049 raft_consensus.cc:493] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:44.129237 28159 raft_consensus.cc:493] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:44.179124 25378 raft_consensus.cc:2468] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 7.
I20260709 13:11:44.179834 25304 raft_consensus.cc:1275] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:44.174700 25305 raft_consensus.cc:2468] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 7.
I20260709 13:11:44.186827 27851 raft_consensus.cc:493] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:44.193691 25228 raft_consensus.cc:3060] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:44.192075 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:11:44.195570 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 70591.8us
I20260709 13:11:44.194146 27894 raft_consensus.cc:493] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:44.231074 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 113436us
I20260709 13:11:44.186502 28186 raft_consensus.cc:2749] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:44.185863 28126 raft_consensus.cc:2749] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:44.101233 27937 raft_consensus.cc:515] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:44.260035 25299 raft_consensus.cc:1275] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:11:44.260409 27937 leader_election.cc:290] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:44.238705 28175 consensus_queue.cc:1243] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer 1f539ba21487460085b837e7529a78ce log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:11:44.241675 25195 leader_election.cc:304] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:44.186067 28193 raft_consensus.cc:2749] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091) with higher term. Message: Invalid argument: T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 6. Current term is 7.
I20260709 13:11:44.245299 27851 raft_consensus.cc:3060] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:44.247617 25270 leader_election.cc:304] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:44.248147 25343 leader_election.cc:304] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:44.189716 28131 consensus_queue.cc:1048] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:11:44.239301 28159 raft_consensus.cc:3060] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:44.237355 28022 raft_consensus.cc:2749] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:44.238404 28133 raft_consensus.cc:2749] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:44.238251 28049 raft_consensus.cc:3060] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:44.250504 25229 raft_consensus.cc:2468] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 5.
I20260709 13:11:44.253011 28178 leader_election.cc:290] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:44.255016 28121 leader_election.cc:290] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 3 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:44.260437 25299 pending_rounds.cc:85] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19: Aborting all ops after (but not including) 2
I20260709 13:11:44.342159 25299 pending_rounds.cc:107] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:11:44.342470 25299 raft_consensus.cc:2889] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:44.173533 28067 consensus_queue.cc:237] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:44.299330 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 114737us
W20260709 13:11:44.300330 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 168464us
I20260709 13:11:44.246034 28204 raft_consensus.cc:493] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:44.302650 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 54582us
W20260709 13:11:44.304693 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 63086.3us
I20260709 13:11:44.308558 25228 raft_consensus.cc:2468] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 5.
I20260709 13:11:44.302160 28154 raft_consensus.cc:493] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.301573 28186 raft_consensus.cc:2804] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:44.296510 28173 raft_consensus.cc:2804] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:44.345909 25194 leader_election.cc:304] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:44.301581 28185 leader_election.cc:290] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:44.249430 27894 raft_consensus.cc:3060] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:44.348559 25271 leader_election.cc:304] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:11:44.348845 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 101319us
W20260709 13:11:44.388909 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:44.302161 28039 raft_consensus.cc:493] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.346408 25873 leader_election.cc:304] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
W20260709 13:11:44.372905 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:44.338263 28152 raft_consensus.cc:2804] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:44.329510 28047 raft_consensus.cc:2804] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:44.388018 25194 leader_election.cc:304] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:44.388518 25195 leader_election.cc:304] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:44.298938 28196 raft_consensus.cc:515] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:44.392383 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 43889.5us
W20260709 13:11:44.393332 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 46997.8us
I20260709 13:11:44.350404 28164 raft_consensus.cc:493] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:44.407709 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:44.352917 28186 raft_consensus.cc:493] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:44.432912 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 84892.4us
W20260709 13:11:44.432333 25873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:44.433668 25343 leader_election.cc:304] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:44.356750 28024 consensus_queue.cc:1048] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 13:11:44.329170 28132 consensus_queue.cc:237] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:44.436707 25343 leader_election.cc:304] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:44.397485 28180 raft_consensus.cc:2804] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:11:44.412474 28203 log.cc:927] Time spent T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:11:44.440644 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 52761.4us
W20260709 13:11:44.441243 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 203516us
I20260709 13:11:44.413771 27976 raft_consensus.cc:2749] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:44.405200 28154 raft_consensus.cc:515] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:44.419589 28186 raft_consensus.cc:3060] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:44.387432 28022 consensus_queue.cc:1048] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
W20260709 13:11:44.442718 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 54240.9us
I20260709 13:11:44.437011 27649 raft_consensus.cc:2804] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:44.419679 28047 raft_consensus.cc:697] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 7 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:44.451963 27649 raft_consensus.cc:493] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:44.454438 27649 raft_consensus.cc:3060] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:44.431983 28152 raft_consensus.cc:697] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 8 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:44.449098 25343 leader_election.cc:304] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:44.410754 28142 raft_consensus.cc:2804] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:44.411329 28173 raft_consensus.cc:697] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 7 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
W20260709 13:11:44.469957 28209 log.cc:927] Time spent T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:11:44.470481 28173 consensus_queue.cc:237] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:44.472456 28154 leader_election.cc:290] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:44.473065 28154 raft_consensus.cc:2804] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:44.473894 28218 consensus_queue.cc:1048] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:44.475863 28047 consensus_queue.cc:237] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:44.398959 28206 raft_consensus.cc:2749] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:44.447635 25194 leader_election.cc:304] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:44.430935 28125 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:44.447536 28217 raft_consensus.cc:2749] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:44.411108 28193 consensus_queue.cc:1048] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:11:44.449994 28126 raft_consensus.cc:2804] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:44.359663 28204 raft_consensus.cc:515] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:44.470724 27976 consensus_queue.cc:1059] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:44.397989 28039 raft_consensus.cc:515] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:44.473501 28154 raft_consensus.cc:697] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 8 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:44.452883 28180 raft_consensus.cc:697] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 7 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:44.507436 28196 leader_election.cc:290] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:44.538692 28133 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.539235 28133 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:44.540340 28201 log.cc:927] Time spent T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.236s	user 0.001s	sys 0.000s
I20260709 13:11:44.541369 28133 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:44.543200 28205 log.cc:927] Time spent T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.299s	user 0.000s	sys 0.002s
I20260709 13:11:44.543315 28204 leader_election.cc:290] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:44.514191 28018 raft_consensus.cc:493] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.508260 28152 consensus_queue.cc:237] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:44.544144 28018 raft_consensus.cc:515] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:44.544684 27945 raft_consensus.cc:515] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:44.545917 25221 raft_consensus.cc:2468] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 6.
I20260709 13:11:44.546120 28018 leader_election.cc:290] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:44.509243 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 61723.2us
I20260709 13:11:44.548650 25194 leader_election.cc:304] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:44.509809 28131 raft_consensus.cc:2749] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:44.550263 28131 raft_consensus.cc:2749] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:11:44.510239 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 44400.8us
I20260709 13:11:44.511564 28049 raft_consensus.cc:515] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:44.513867 28142 raft_consensus.cc:697] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 5 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:44.452266 28178 raft_consensus.cc:2804] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:11:44.516199 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:44.518014 25873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:44.524188 28043 raft_consensus.cc:2749] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:44.462900 28189 leader_election.cc:290] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:44.438436 28164 raft_consensus.cc:515] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:44.527590 28126 raft_consensus.cc:697] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 8 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:44.534674 27976 raft_consensus.cc:3055] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:44.535534 28154 consensus_queue.cc:237] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:44.537314 27996 raft_consensus.cc:3055] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:44.537437 28125 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:44.537032 28180 consensus_queue.cc:237] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:11:44.555655 25271 leader_election.cc:304] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:44.509335 28129 raft_consensus.cc:515] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:44.560855 28049 leader_election.cc:290] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 5 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:44.560791 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:44.557819 28185 consensus_queue.cc:1059] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:11:44.564968 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:44.565667 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:11:44.616896 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 62603.5us
W20260709 13:11:44.560756 25270 connection.cc:256] RPC call timeout handler was delayed by -2.2050153769999952s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1513s for a response
I20260709 13:11:44.592074 27976 raft_consensus.cc:740] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:44.566368 28142 consensus_queue.cc:237] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:44.574653 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:44.574862 25902 raft_consensus.cc:1240] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:44.575587 28039 leader_election.cc:290] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:44.576128 28136 raft_consensus.cc:515] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:44.577558 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:44.577993 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:44.585005 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
W20260709 13:11:44.559234 28184 consensus_meta.cc:287] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 0.550s	user 0.005s	sys 0.004s
I20260709 13:11:44.588634 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:44.588881 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:44.589669 25224 raft_consensus.cc:1217] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Deduplicated request from leader. Original: 3.6->[5.7-11.10]   Dedup: 5.7->[8.8-11.10]
W20260709 13:11:44.590291 28215 log.cc:927] Time spent T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:11:44.590991 27851 raft_consensus.cc:515] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:44.628403 25227 raft_consensus.cc:2468] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 6.
I20260709 13:11:44.619063 28133 raft_consensus.cc:2804] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:44.634554 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:44.594924 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:44.560961 28178 raft_consensus.cc:697] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 7 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:44.608366 28126 consensus_queue.cc:237] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:44.609858 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
W20260709 13:11:44.614985 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 59416.1us
I20260709 13:11:44.615947 25223 raft_consensus.cc:1275] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:11:44.591645 28164 leader_election.cc:290] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:44.618038 25221 raft_consensus.cc:2468] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 8.
I20260709 13:11:44.557662 27649 raft_consensus.cc:515] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:44.635972 28125 raft_consensus.cc:493] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.648254 27649 leader_election.cc:290] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:44.648017 28125 raft_consensus.cc:515] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:44.559439 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:44.570546 28175 consensus_queue.cc:1059] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:11:44.650090 28125 leader_election.cc:290] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:44.650379 28175 raft_consensus.cc:3055] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:44.650761 28175 raft_consensus.cc:740] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:44.651610 28175 consensus_queue.cc:260] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:44.608279 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:11:44.618513 25270 connection.cc:256] RPC call timeout handler was delayed by -1.9764153770000803s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1767s for a response
W20260709 13:11:44.653069 25270 connection.cc:256] RPC call timeout handler was delayed by -1.9314153770000075s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1817s for a response
I20260709 13:11:44.654801 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:11:44.617240 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 168213us
I20260709 13:11:44.603382 27996 raft_consensus.cc:740] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:44.622913 25904 raft_consensus.cc:2368] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for earlier term 4. Current term is 5.
I20260709 13:11:44.586498 28127 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:44.660111 25270 connection.cc:256] RPC call timeout handler was delayed by -1.7577153770000677s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20099999999999998s for a response
I20260709 13:11:44.626747 25226 raft_consensus.cc:2410] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:11:44.660518 25270 connection.cc:256] RPC call timeout handler was delayed by -1.2570058850000123s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1966s for a response
I20260709 13:11:44.660630 25223 raft_consensus.cc:1240] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 7. Current term is 8. Ops: []
W20260709 13:11:44.660923 25270 connection.cc:256] RPC call timeout handler was delayed by -1.2114153769999803s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2617s for a response
W20260709 13:11:44.661161 25270 connection.cc:256] RPC call timeout handler was delayed by -1.1454058850000592s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.209s for a response
I20260709 13:11:44.592253 25195 leader_election.cc:304] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:44.635651 25228 raft_consensus.cc:2393] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 3: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:44.589684 28159 raft_consensus.cc:515] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:44.664021 25907 raft_consensus.cc:1275] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 LEARNER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:11:44.628165 28184 raft_consensus.cc:515] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:44.665091 27851 leader_election.cc:290] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:44.603706 27894 raft_consensus.cc:515] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:44.665723 28159 leader_election.cc:290] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:44.674847 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:44.676940 28127 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:44.623693 28095 raft_consensus.cc:493] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.666188 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:44.646236 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:44.656399 25343 leader_election.cc:304] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:44.657088 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:44.626049 25224 pending_rounds.cc:85] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce: Aborting all ops after (but not including) 7
I20260709 13:11:44.683249 25221 raft_consensus.cc:1240] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
W20260709 13:11:44.661899 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 69727.7us
I20260709 13:11:44.629992 28049 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.663410 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:44.663043 27976 consensus_queue.cc:260] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:11:44.665994 25371 raft_consensus.cc:1240] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:11:44.666420 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:44.689074 25228 raft_consensus.cc:2468] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 7.
I20260709 13:11:44.636477 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:11:44.643327 25271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:44.677978 25301 raft_consensus.cc:1275] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 13:11:44.691134 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:44.691721 25297 raft_consensus.cc:3060] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:44.693137 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:44.694402 25299 raft_consensus.cc:1240] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:11:44.695364 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:44.696069 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:44.696465 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:44.696971 25299 raft_consensus.cc:3060] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:44.698348 25296 pending_rounds.cc:85] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19: Aborting all ops after (but not including) 5
I20260709 13:11:44.698451 25305 raft_consensus.cc:1275] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:11:44.698812 25296 pending_rounds.cc:107] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:11:44.699070 25296 raft_consensus.cc:2889] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:11:44.703672 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 47304.8us
I20260709 13:11:44.667914 25905 raft_consensus.cc:2410] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:11:44.634150 28133 raft_consensus.cc:493] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:44.690454 25301 pending_rounds.cc:85] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19: Aborting all ops after (but not including) 8
I20260709 13:11:44.683293 25227 raft_consensus.cc:2468] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 5.
I20260709 13:11:44.683558 25224 pending_rounds.cc:107] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:11:44.708192 25301 pending_rounds.cc:107] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 13:11:44.708657 25224 raft_consensus.cc:2889] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:44.687143 25226 raft_consensus.cc:2393] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 6: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:44.690485 25908 raft_consensus.cc:2468] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 8.
I20260709 13:11:44.708861 25301 raft_consensus.cc:2889] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:44.710247 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:44.711097 25304 raft_consensus.cc:2368] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 6. Current term is 7.
I20260709 13:11:44.710592 27996 consensus_queue.cc:260] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:44.711875 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:44.712134 25297 raft_consensus.cc:2468] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 8.
I20260709 13:11:44.629585 28186 raft_consensus.cc:515] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:44.675266 28129 leader_election.cc:290] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:44.666640 28184 leader_election.cc:290] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:44.742478 25301 raft_consensus.cc:1240] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:44.751437 25271 leader_election.cc:304] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:11:44.811966 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 67292.9us
I20260709 13:11:44.663419 28039 raft_consensus.cc:493] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.814162 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:44.784058 25300 raft_consensus.cc:2468] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 9.
I20260709 13:11:44.726620 25298 raft_consensus.cc:2468] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 7.
I20260709 13:11:44.714622 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:44.819757 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:44.820075 25304 raft_consensus.cc:3060] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:44.742955 25297 raft_consensus.cc:1240] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:44.821130 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:44.812947 25271 leader_election.cc:304] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:44.683405 27945 leader_election.cc:290] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:44.672851 28152 raft_consensus.cc:493] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.819773 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:44.714071 28133 raft_consensus.cc:3060] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:44.831743 25230 raft_consensus.cc:1240] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:11:44.827186 25301 raft_consensus.cc:3060] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:44.832101 25270 leader_election.cc:304] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:44.832933 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:44.755844 27996 raft_consensus.cc:3060] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:44.821970 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:44.831815 25300 raft_consensus.cc:2468] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 4.
I20260709 13:11:44.707810 28159 raft_consensus.cc:2804] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:44.810272 28163 raft_consensus.cc:493] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.837832 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:44.746603 27976 raft_consensus.cc:3060] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:44.682421 28095 raft_consensus.cc:515] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:44.841049 25297 raft_consensus.cc:3060] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:11:44.825479 28140 raft_consensus.cc:2804] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:44.832347 28018 raft_consensus.cc:2804] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:44.873065 25378 raft_consensus.cc:1275] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:44.873479 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:44.872509 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:44.874496 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:44.875080 25300 raft_consensus.cc:3060] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:44.884399 25299 raft_consensus.cc:2468] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 8.
I20260709 13:11:44.702365 28127 consensus_queue.cc:1059] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.129s
I20260709 13:11:44.832504 27851 raft_consensus.cc:493] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.754889 27649 consensus_queue.cc:1048] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.084s
I20260709 13:11:44.708225 28049 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:44.746820 28164 consensus_queue.cc:1048] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.119s
I20260709 13:11:44.891350 25194 leader_election.cc:304] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:44.900818 25194 leader_election.cc:304] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:44.901005 25297 raft_consensus.cc:2468] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 5.
I20260709 13:11:44.867110 28140 raft_consensus.cc:493] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:44.876649 28018 raft_consensus.cc:493] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:44.902491 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:44.902925 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:44.948935 28018 raft_consensus.cc:3060] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:44.941522 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:44.834342 28039 raft_consensus.cc:515] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:44.951278 25221 raft_consensus.cc:1240] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 7 LEADER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:44.951555 28184 consensus_queue.cc:1059] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:44.952615 25221 raft_consensus.cc:1240] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:11:44.902050 25378 raft_consensus.cc:1240] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 6 LEADER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:11:44.952715 28039 leader_election.cc:290] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:44.953352 28039 raft_consensus.cc:2749] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:11:44.954146 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:44.954260 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:44.954949 25297 raft_consensus.cc:3060] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:44.950445 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:44.948529 27894 leader_election.cc:290] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:44.950452 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:44.955101 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:44.956348 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:44.956630 25222 raft_consensus.cc:2468] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 6.
I20260709 13:11:44.957394 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:44.958105 28039 raft_consensus.cc:493] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.956363 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:44.958633 28039 raft_consensus.cc:515] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:44.958967 25298 raft_consensus.cc:2376] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 5. Re-sending same reply.
I20260709 13:11:44.959807 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:44.960682 28039 leader_election.cc:290] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:44.960841 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:44.961831 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:44.962442 28227 raft_consensus.cc:493] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.963550 28147 consensus_queue.cc:1048] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:44.963760 28227 raft_consensus.cc:515] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:44.964203 25300 raft_consensus.cc:2468] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 6.
I20260709 13:11:44.965481 25300 raft_consensus.cc:1275] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:44.947988 28196 raft_consensus.cc:2804] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:44.966009 28227 leader_election.cc:290] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:44.966289 28196 raft_consensus.cc:697] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 7 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:44.967078 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:44.967584 25227 raft_consensus.cc:1275] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:11:44.985853 25227 raft_consensus.cc:1275] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:44.967207 28196 consensus_queue.cc:237] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:44.966017 25344 leader_election.cc:304] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:44.968633 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:44.968822 25908 raft_consensus.cc:1275] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:11:44.970875 28212 log.cc:927] Time spent T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.506s	user 0.000s	sys 0.002s
I20260709 13:11:44.971319 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:44.972039 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:44.970781 25271 leader_election.cc:304] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:44.973012 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:44.974618 28131 raft_consensus.cc:3055] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:44.961855 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:44.976269 25298 raft_consensus.cc:2468] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 6.
I20260709 13:11:44.976977 25228 raft_consensus.cc:1240] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:44.977778 25221 raft_consensus.cc:1240] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:11:44.986784 25874 leader_election.cc:304] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:11:44.987120 25227 raft_consensus.cc:1275] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:11:44.987810 28227 raft_consensus.cc:2804] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:45.012389 28227 raft_consensus.cc:493] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:45.012521 28154 consensus_queue.cc:1048] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:45.012916 28227 raft_consensus.cc:3060] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:45.015995 25221 raft_consensus.cc:1275] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:11:45.016453 25221 pending_rounds.cc:85] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce: Aborting all ops after (but not including) 3
I20260709 13:11:45.016721 25221 pending_rounds.cc:107] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:11:45.017140 25221 raft_consensus.cc:2889] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:45.001415 25373 raft_consensus.cc:2468] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 4.
I20260709 13:11:45.002482 25377 raft_consensus.cc:3060] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:45.018452 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:45.019167 25902 raft_consensus.cc:2468] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 4.
I20260709 13:11:45.020571 27894 raft_consensus.cc:2804] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:45.021322 27894 raft_consensus.cc:493] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:45.019840 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:45.002946 28131 raft_consensus.cc:740] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:45.023319 28131 consensus_queue.cc:260] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:45.024845 28131 raft_consensus.cc:3060] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:45.021658 27894 raft_consensus.cc:3060] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:45.005120 25298 raft_consensus.cc:1240] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:11:45.027213 25298 raft_consensus.cc:1240] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:45.023520 25227 raft_consensus.cc:2468] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 6.
W20260709 13:11:45.029031 25873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:45.033118 28154 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:45.010449 25871 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:45.033708 28154 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:44.996236 28217 raft_consensus.cc:3055] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:45.035137 28217 raft_consensus.cc:740] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:45.033946 25298 raft_consensus.cc:1240] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 5 LEADER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:11:45.002172 25303 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5"
dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
mode: GRACEFUL
new_leader_uuid: "79d99c0e498349bda74127365219e468"
 from {username='slave'} at 127.0.0.1:35660
I20260709 13:11:45.037360 28154 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:45.037710 25298 raft_consensus.cc:1240] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:44.838682 28152 raft_consensus.cc:515] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:45.043679 28039 consensus_queue.cc:1059] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:44.889741 28159 raft_consensus.cc:697] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 7 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:45.044461 25298 raft_consensus.cc:1240] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:11:45.045254 28159 consensus_queue.cc:237] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:11:45.036106 25377 raft_consensus.cc:2468] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 5.
I20260709 13:11:45.045279 28039 consensus_queue.cc:1048] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:44.871750 28189 consensus_queue.cc:1059] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:11:45.047318 28039 raft_consensus.cc:3055] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:45.047696 28039 raft_consensus.cc:740] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
W20260709 13:11:45.049216 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:45.050004 25299 raft_consensus.cc:1240] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:45.048542 28039 consensus_queue.cc:260] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:45.051136 25297 raft_consensus.cc:2468] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 6.
I20260709 13:11:45.053279 28147 raft_consensus.cc:493] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.051741 25378 raft_consensus.cc:2468] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 3.
I20260709 13:11:45.053871 28147 raft_consensus.cc:515] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:45.054315 28152 leader_election.cc:290] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:45.049141 28217 consensus_queue.cc:260] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:45.056146 28147 leader_election.cc:290] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:44.978026 25230 raft_consensus.cc:1240] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:45.058060 28217 raft_consensus.cc:3060] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:45.063396 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:45.064096 25373 raft_consensus.cc:3060] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:45.064324 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:45.063800 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:45.066375 25375 raft_consensus.cc:1240] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:11:45.066624 25379 raft_consensus.cc:2393] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 9: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:45.069417 25344 leader_election.cc:304] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:45.070571 28220 raft_consensus.cc:2804] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:45.071105 28220 raft_consensus.cc:493] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:45.073215 28220 raft_consensus.cc:3060] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:45.053745 28039 raft_consensus.cc:3060] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:45.083184 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:45.083797 25374 raft_consensus.cc:3060] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:44.873904 28185 consensus_queue.cc:1048] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.070s
I20260709 13:11:45.092100 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:44.823885 28178 consensus_queue.cc:237] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:45.074747 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:44.900113 28136 leader_election.cc:290] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:45.113533 25873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:45.114287 25871 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:45.117398 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:44.939021 28140 raft_consensus.cc:3060] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:45.119325 25373 raft_consensus.cc:2468] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 6.
I20260709 13:11:45.120576 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:45.121400 25375 raft_consensus.cc:2393] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 8: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:44.868414 28163 raft_consensus.cc:515] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:45.133252 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:45.007992 28142 raft_consensus.cc:2804] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:45.118194 25905 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 4.
I20260709 13:11:44.942476 28193 raft_consensus.cc:493] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.942634 28127 raft_consensus.cc:2804] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:11:45.153523 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 327797us
I20260709 13:11:45.164479 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:45.106397 28174 raft_consensus.cc:3055] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:45.173331 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:45.172592 25372 raft_consensus.cc:2468] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 7.
I20260709 13:11:45.175566 25903 raft_consensus.cc:1275] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:45.185547 25270 leader_election.cc:304] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:45.196491 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:45.158916 28142 raft_consensus.cc:493] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:45.173686 28174 raft_consensus.cc:740] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:45.173202 28193 raft_consensus.cc:515] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:45.197072 25900 raft_consensus.cc:2468] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 7.
I20260709 13:11:45.218997 25271 leader_election.cc:304] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:11:45.246197 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 48587.7us
W20260709 13:11:45.247025 25271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:45.083966 27851 raft_consensus.cc:515] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:45.231746 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:45.232470 28095 leader_election.cc:290] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:45.232746 25375 raft_consensus.cc:1240] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:45.236999 28142 raft_consensus.cc:3060] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:45.279874 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:45.289915 28240 raft_consensus.cc:493] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.290541 28240 raft_consensus.cc:515] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:45.295403 25378 raft_consensus.cc:2393] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 7: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:45.225392 28127 raft_consensus.cc:697] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 9 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
W20260709 13:11:45.348865 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:45.391851 28174 consensus_queue.cc:260] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:45.425181 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:45.451880 25194 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.030s	sys 0.052s
W20260709 13:11:45.417224 28225 log.cc:927] Time spent T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.607s	user 0.003s	sys 0.000s
W20260709 13:11:45.453507 25194 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.030s	sys 0.052s
W20260709 13:11:45.454283 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 514339us
I20260709 13:11:45.455133 25194 leader_election.cc:304] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:11:45.469403 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:45.475507 28229 log.cc:927] Time spent T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.529s	user 0.002s	sys 0.002s
I20260709 13:11:45.403908 28238 raft_consensus.cc:2804] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:45.474696 28250 raft_consensus.cc:2804] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:45.475157 28136 consensus_queue.cc:1048] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:11:45.452512 28180 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.775s	user 0.008s	sys 0.002s
W20260709 13:11:45.551421 25371 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.016s	sys 0.004s
W20260709 13:11:45.568476 25871 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:45.654001 25371 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.016s	sys 0.004s
I20260709 13:11:45.544821 28163 leader_election.cc:290] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:45.548853 28235 log.cc:927] Time spent T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.298s	user 0.001s	sys 0.000s
I20260709 13:11:45.409128 28127 consensus_queue.cc:237] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:45.568629 25268 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.000s	sys 0.011s
W20260709 13:11:45.705130 25268 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.000s	sys 0.011s
W20260709 13:11:45.674373 28180 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.997s	user 0.009s	sys 0.002s
I20260709 13:11:45.652436 28238 raft_consensus.cc:493] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:45.775076 25225 raft_consensus.cc:1240] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 7 LEADER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 6. Current term is 7. Ops: []
W20260709 13:11:45.777904 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 592424us
W20260709 13:11:45.784615 25195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:45.693256 28250 raft_consensus.cc:697] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 8 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:45.802448 28248 raft_consensus.cc:493] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:45.774420 28131 consensus_meta.cc:287] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 0.749s	user 0.003s	sys 0.017s
I20260709 13:11:45.800628 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:45.814013 25375 raft_consensus.cc:3060] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:45.809653 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:45.801235 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:45.815382 25230 raft_consensus.cc:3060] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:11:45.801440 25373 raft_consensus.cc:1275] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:11:45.801339 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:45.810443 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:45.799069 28240 leader_election.cc:290] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:45.820997 25226 raft_consensus.cc:2468] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 7.
I20260709 13:11:45.823473 25379 raft_consensus.cc:2368] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for earlier term 4. Current term is 5.
I20260709 13:11:45.766391 28238 raft_consensus.cc:3060] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:45.842089 28253 log.cc:927] Time spent T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:11:45.792081 27851 leader_election.cc:290] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:11:45.823561 28232 log.cc:927] Time spent T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.256s	user 0.001s	sys 0.000s
I20260709 13:11:45.866150 25270 leader_election.cc:304] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
W20260709 13:11:45.866691 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:45.823369 28252 log.cc:927] Time spent T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.279s	user 0.000s	sys 0.001s
W20260709 13:11:45.879212 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:45.879784 25304 consensus_meta.cc:287] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 1.049s	user 0.015s	sys 0.006s
I20260709 13:11:45.880247 25304 raft_consensus.cc:2468] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 8.
I20260709 13:11:45.884197 25305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57272 (request call id 1630) took 1177 ms. Trace:
I20260709 13:11:45.884768 25305 rpcz_store.cc:276] 0709 13:11:44.693437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:44.700107 (+  6670us) service_pool.cc:224] Handling call
0709 13:11:44.700397 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:44.700770 (+   373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:44.700802 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:44.701270 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 13:11:44.900167 (+198897us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:44.900206 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:44.900276 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:45.870545 (+970269us) raft_consensus.cc:1685] finished
0709 13:11:45.870567 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:45.870754 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":442,"raft.run_cpu_time_us":67,"raft.run_wall_time_us":67,"thread_start_us":198500,"threads_started":1,"wal-append.queue_time_us":417643}
I20260709 13:11:45.811111 28213 consensus_queue.cc:1059] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:11:45.891839 25304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57272 (request call id 1636) took 1176 ms. Trace:
I20260709 13:11:45.892663 25304 rpcz_store.cc:276] 0709 13:11:44.704755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:44.711687 (+  6932us) service_pool.cc:224] Handling call
0709 13:11:45.881223 (+1169536us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:45.911464 25375 raft_consensus.cc:2468] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 6.
I20260709 13:11:45.817179 28248 raft_consensus.cc:515] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:45.870371 28049 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:45.913637 25299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57256 (request call id 1736) took 1077 ms. Trace:
I20260709 13:11:45.924773 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:45.879837 28236 raft_consensus.cc:493] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:45.928012 28234 log.cc:927] Time spent T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 13:11:45.918087 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 74761.1us
W20260709 13:11:45.938400 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:45.934758 28242 log.cc:927] Time spent T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.459s	user 0.001s	sys 0.000s
I20260709 13:11:45.939129 25296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57272 (request call id 1625) took 1247 ms. Trace:
I20260709 13:11:45.923512 25299 rpcz_store.cc:276] 0709 13:11:44.836194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:45.051405 (+215211us) service_pool.cc:224] Handling call
0709 13:11:45.051738 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:45.052038 (+   300us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:45.052066 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:45.052581 (+   515us) log.cc:844] Serialized 26 byte log entry
0709 13:11:45.116361 (+ 63780us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:45.116752 (+   391us) log.cc:844] Serialized 14 byte log entry
0709 13:11:45.120136 (+  3384us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:45.120201 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:45.913395 (+793194us) raft_consensus.cc:1685] finished
0709 13:11:45.913416 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:45.913568 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":6173,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":6210,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":159,"thread_start_us":63326,"threads_started":1,"wal-append.queue_time_us":513071}
I20260709 13:11:45.893729 28175 raft_consensus.cc:3060] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:45.964088 25301 consensus_meta.cc:287] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 1.126s	user 0.009s	sys 0.014s
I20260709 13:11:45.965523 25301 raft_consensus.cc:2468] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 8.
I20260709 13:11:45.966634 25303 raft_consensus.cc:606] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Received request to transfer leadership to TS 79d99c0e498349bda74127365219e468
I20260709 13:11:45.967034 25303 raft_consensus.cc:614] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:11:45.966751 25301 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46556 (request call id 380) took 1187 ms (client timeout 1573 ms). Trace:
I20260709 13:11:45.959319 25296 rpcz_store.cc:276] 0709 13:11:44.692176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:44.697864 (+  5688us) service_pool.cc:224] Handling call
0709 13:11:44.698165 (+   301us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:44.699738 (+  1573us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:44.699765 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:44.700300 (+   535us) log.cc:844] Serialized 52 byte log entry
0709 13:11:44.841618 (+141318us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:44.873387 (+ 31769us) log.cc:844] Serialized 14 byte log entry
0709 13:11:45.108172 (+234785us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:45.108335 (+   163us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:45.938815 (+830480us) raft_consensus.cc:1685] finished
0709 13:11:45.938844 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:45.939052 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":35361,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":81603,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":240,"thread_start_us":375349,"threads_started":2,"wal-append.queue_time_us":752852}
W20260709 13:11:45.967651 25301 rpcz_store.cc:269] 0709 13:11:44.778844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:44.813926 (+ 35082us) service_pool.cc:224] Handling call
0709 13:11:45.966674 (+1152748us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:45.922798 27945 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.831s	user 0.003s	sys 0.021s
I20260709 13:11:45.994609 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:11:45.997224 25271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:45.924300 28180 raft_consensus.cc:3055] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:46.002485 25301 raft_consensus.cc:1275] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:11:46.007828 28248 leader_election.cc:290] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:45.960950 28236 raft_consensus.cc:515] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:11:46.008932 25304 raft_consensus.cc:1240] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:46.010284 28236 leader_election.cc:290] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:46.010332 28245 log.cc:927] Time spent T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:11:46.012379 25222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58418 (request call id 1811) took 1404 ms. Trace:
I20260709 13:11:46.012775 25222 rpcz_store.cc:276] 0709 13:11:44.607994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:44.957408 (+349414us) service_pool.cc:224] Handling call
0709 13:11:44.957675 (+   267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:44.999080 (+ 41405us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:44.999118 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:44.999730 (+   612us) log.cc:844] Serialized 26 byte log entry
0709 13:11:45.001186 (+  1456us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:45.001226 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:45.001296 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:46.012129 (+1010833us) raft_consensus.cc:1685] finished
0709 13:11:46.012149 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:46.012304 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22441,"raft.queue_time_us":205354,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":11390,"thread_start_us":42064,"threads_started":2,"wal-append.queue_time_us":851109}
I20260709 13:11:46.030432 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:11:45.997148 28220 consensus_meta.cc:287] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.923s	user 0.017s	sys 0.011s
I20260709 13:11:45.972719 28152 raft_consensus.cc:2749] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:11:45.989527 27945 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.906s	user 0.003s	sys 0.022s
I20260709 13:11:46.040448 25226 raft_consensus.cc:1275] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:46.040191 25300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46556 (request call id 379) took 1261 ms. Trace:
W20260709 13:11:45.997396 28227 consensus_meta.cc:287] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.984s	user 0.020s	sys 0.015s
I20260709 13:11:46.050602 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:46.043691 25300 rpcz_store.cc:276] 0709 13:11:44.778581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:45.010749 (+232168us) service_pool.cc:224] Handling call
0709 13:11:45.011032 (+   283us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:45.042252 (+ 31220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:45.042364 (+   112us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:45.044370 (+  2006us) log.cc:844] Serialized 52 byte log entry
0709 13:11:45.296612 (+252242us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:45.418229 (+121617us) log.cc:844] Serialized 14 byte log entry
0709 13:11:45.422955 (+  4726us) log.cc:844] Serialized 14 byte log entry
0709 13:11:45.595245 (+172290us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:45.595356 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:46.039907 (+444551us) raft_consensus.cc:1685] finished
0709 13:11:46.039936 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:46.040117 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3713,"prepare.queue_time_us":100345,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":101,"raft.queue_time_us":859798,"raft.run_cpu_time_us":478,"raft.run_wall_time_us":18055,"thread_start_us":422619,"threads_started":2,"wal-append.queue_time_us":358596}
I20260709 13:11:46.004128 28180 raft_consensus.cc:740] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:46.059999 25223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58418 (request call id 1805) took 1469 ms. Trace:
I20260709 13:11:46.060429 25223 rpcz_store.cc:276] 0709 13:11:44.590389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:44.746763 (+156374us) service_pool.cc:224] Handling call
0709 13:11:44.778076 (+ 31313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:44.778418 (+   342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:44.778448 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:44.778921 (+   473us) log.cc:844] Serialized 26 byte log entry
0709 13:11:44.876326 (+ 97405us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:44.876395 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:44.876491 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:46.059775 (+1183284us) raft_consensus.cc:1685] finished
0709 13:11:46.059796 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:46.059942 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1078,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":77,"thread_start_us":97001,"threads_started":1,"wal-append.queue_time_us":991329}
W20260709 13:11:46.062768 25374 consensus_meta.cc:287] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.928s	user 0.011s	sys 0.006s
I20260709 13:11:46.063308 25374 raft_consensus.cc:2468] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 6.
I20260709 13:11:46.064276 25374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36254 (request call id 1850) took 1161 ms. Trace:
I20260709 13:11:46.064662 25374 rpcz_store.cc:276] 0709 13:11:44.902403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:44.944538 (+ 42135us) service_pool.cc:224] Handling call
0709 13:11:46.064219 (+1119681us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:46.039623 28257 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:46.072476 25371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56308 (request call id 451) took 1101 ms. Trace:
W20260709 13:11:46.073012 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 84320.4us
W20260709 13:11:46.054299 28018 consensus_meta.cc:287] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 1.092s	user 0.008s	sys 0.028s
I20260709 13:11:46.084643 28163 raft_consensus.cc:493] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.001834 28250 consensus_queue.cc:237] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:46.082759 28193 leader_election.cc:290] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:46.085300 28258 raft_consensus.cc:493] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.056564 28227 raft_consensus.cc:515] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:46.047086 28220 raft_consensus.cc:515] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:46.090817 25343 leader_election.cc:304] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:11:46.107445 28259 log.cc:927] Time spent T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
W20260709 13:11:46.102614 27894 consensus_meta.cc:287] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent flushing consensus metadata: real 1.076s	user 0.013s	sys 0.012s
I20260709 13:11:46.101766 28248 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:46.111131 28236 raft_consensus.cc:2749] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:46.119017 25270 leader_election.cc:304] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:46.086082 28257 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:46.108115 28256 raft_consensus.cc:493] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:46.112679 28260 raft_consensus.cc:493] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.086606 28018 raft_consensus.cc:515] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:46.164162 28260 raft_consensus.cc:515] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:46.164203 28126 raft_consensus.cc:493] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:46.170490 28260 leader_election.cc:290] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:46.170691 28126 raft_consensus.cc:515] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:46.171413 28039 consensus_meta.cc:287] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 1.092s	user 0.008s	sys 0.008s
I20260709 13:11:46.164050 28256 raft_consensus.cc:515] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:46.172580 25230 raft_consensus.cc:2468] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 8.
I20260709 13:11:46.115535 28248 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:46.173903 28256 leader_election.cc:290] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:46.175071 28018 leader_election.cc:290] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:46.175345 28227 leader_election.cc:290] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:46.106742 28163 raft_consensus.cc:515] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:46.120887 27851 raft_consensus.cc:2804] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:46.126502 28049 raft_consensus.cc:493] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:46.175637 28248 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:46.173549 28126 leader_election.cc:290] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:46.132566 28255 raft_consensus.cc:493] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.117843 27894 raft_consensus.cc:515] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:46.203097 28163 leader_election.cc:290] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:46.203271 27894 leader_election.cc:290] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:11:46.204770 28217 consensus_meta.cc:287] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 1.143s	user 0.010s	sys 0.006s
W20260709 13:11:46.205103 25194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:46.205368 28217 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.205883 28255 raft_consensus.cc:515] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:46.208070 28257 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:46.123098 28180 consensus_queue.cc:260] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:46.209331 28180 raft_consensus.cc:3060] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:46.193815 25372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56308 (request call id 455) took 1221 ms. Trace:
W20260709 13:11:46.197207 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 78268.2us
W20260709 13:11:46.200181 28142 consensus_meta.cc:287] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.913s	user 0.021s	sys 0.018s
I20260709 13:11:46.200009 25345 leader_election.cc:304] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:46.200821 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:46.213438 25372 rpcz_store.cc:276] 0709 13:11:44.971878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:44.972769 (+   891us) service_pool.cc:224] Handling call
0709 13:11:46.193603 (+1220834us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b5400307854. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:46.193719 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":390357248}
I20260709 13:11:46.216202 25345 leader_election.cc:304] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:46.217067 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:46.200436 28238 raft_consensus.cc:515] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:46.218971 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:46.220849 25227 raft_consensus.cc:2393] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 8: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:46.219285 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:46.178431 28263 raft_consensus.cc:493] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.220556 25370 raft_consensus.cc:2393] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 7: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:46.221815 25370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36264 (request call id 1581) took 1038 ms. Trace:
I20260709 13:11:46.190448 28262 raft_consensus.cc:2749] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:46.225103 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
W20260709 13:11:46.225435 28133 consensus_meta.cc:287] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 1.358s	user 0.015s	sys 0.006s
I20260709 13:11:46.225786 25223 raft_consensus.cc:3060] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:46.225999 28133 raft_consensus.cc:515] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:46.227372 25297 raft_consensus.cc:1240] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:11:46.222213 25370 rpcz_store.cc:276] 0709 13:11:45.337439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:46.200568 (+863129us) service_pool.cc:224] Handling call
0709 13:11:46.221739 (+ 21171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:46.208123 28255 leader_election.cc:290] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:46.229313 28217 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:46.230150 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:46.230926 25228 raft_consensus.cc:2376] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 79d99c0e498349bda74127365219e468 in term 7. Re-sending same reply.
I20260709 13:11:46.234256 28255 consensus_queue.cc:1059] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:46.235232 28255 raft_consensus.cc:2749] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:46.236734 25305 raft_consensus.cc:1240] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 13:11:46.246387 27976 consensus_meta.cc:287] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 1.376s	user 0.017s	sys 0.000s
I20260709 13:11:46.246675 28255 raft_consensus.cc:3055] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:11:46.254541 28244 log.cc:927] Time spent T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 13:11:46.248618 28133 leader_election.cc:290] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:46.256001 28262 consensus_queue.cc:1059] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:11:46.261399 28262 raft_consensus.cc:3055] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:46.261739 28262 raft_consensus.cc:740] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:46.262616 28262 consensus_queue.cc:260] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:46.263808 28262 raft_consensus.cc:3060] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:46.255705 28255 raft_consensus.cc:740] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
W20260709 13:11:46.266860 28266 log.cc:927] Time spent T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:11:46.237699 28238 leader_election.cc:290] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:46.268752 25270 leader_election.cc:304] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:46.270110 25270 leader_election.cc:400] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085) with higher term. Message: Invalid argument: T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for earlier term 4. Current term is 5.
I20260709 13:11:46.270450 25270 leader_election.cc:403] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:46.271258 25270 leader_election.cc:304] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:46.240422 28217 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:46.244349 28220 leader_election.cc:290] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:46.141888 28258 raft_consensus.cc:515] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:46.195490 28049 raft_consensus.cc:515] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:46.272859 25871 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:46.239045 25223 raft_consensus.cc:2468] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 6.
I20260709 13:11:46.274188 25229 raft_consensus.cc:2468] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 7.
I20260709 13:11:46.274979 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:46.277845 25227 raft_consensus.cc:2393] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 8: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:46.184619 28256 raft_consensus.cc:493] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:46.267660 28140 consensus_meta.cc:287] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 1.098s	user 0.011s	sys 0.013s
I20260709 13:11:46.221706 28227 raft_consensus.cc:2749] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:46.274124 28236 raft_consensus.cc:2749] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085) with higher term. Message: Invalid argument: T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for earlier term 4. Current term is 5.
I20260709 13:11:46.279393 28133 raft_consensus.cc:2749] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:11:46.292497 27996 consensus_meta.cc:287] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent flushing consensus metadata: real 1.454s	user 0.003s	sys 0.012s
I20260709 13:11:46.275532 28257 raft_consensus.cc:2749] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:11:46.305452 25873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:46.288309 28248 raft_consensus.cc:493] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:46.306177 27976 raft_consensus.cc:493] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.268291 28163 consensus_queue.cc:1048] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
W20260709 13:11:46.310532 28231 log.cc:927] Time spent T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 1.270s	user 0.009s	sys 0.011s
I20260709 13:11:46.311703 25221 raft_consensus.cc:2410] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 13:11:46.313036 28237 log.cc:927] Time spent T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
W20260709 13:11:46.314754 25873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:46.321542 25194 leader_election.cc:304] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:11:46.369215 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 47757.3us
I20260709 13:11:46.375115 25377 raft_consensus.cc:1240] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 7 LEADER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:46.221508 28142 raft_consensus.cc:515] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:46.267071 28255 consensus_queue.cc:260] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:46.305151 28247 raft_consensus.cc:493] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.274238 28263 raft_consensus.cc:515] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:46.392925 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 302162us
I20260709 13:11:46.282992 28256 raft_consensus.cc:515] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:46.397516 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 181373us
I20260709 13:11:46.316972 28217 raft_consensus.cc:493] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.294315 28140 raft_consensus.cc:515] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:46.405978 25268 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.013s	sys 0.005s
W20260709 13:11:46.406437 25268 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.013s	sys 0.005s
W20260709 13:11:46.407105 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 225965us
I20260709 13:11:46.389173 28180 raft_consensus.cc:2804] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:11:46.408478 25195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:46.397712 27996 raft_consensus.cc:493] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.406989 25270 leader_election.cc:304] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:46.396564 28248 raft_consensus.cc:515] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:46.402278 28257 raft_consensus.cc:493] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.368407 27976 raft_consensus.cc:515] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:46.420775 25298 raft_consensus.cc:1240] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 6. Current term is 7. Ops: []
W20260709 13:11:46.422164 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:46.398766 28193 consensus_queue.cc:1048] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:11:46.411201 28133 raft_consensus.cc:493] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.410066 28255 raft_consensus.cc:3060] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:11:46.428234 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:46.449342 25270 leader_election.cc:304] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:46.412902 28127 raft_consensus.cc:493] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.406162 25345 leader_election.cc:304] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:11:46.421270 28196 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.421s	user 0.020s	sys 0.037s
I20260709 13:11:46.403035 28247 raft_consensus.cc:515] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:46.413367 27851 raft_consensus.cc:697] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 6 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
W20260709 13:11:46.562400 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 113146us
W20260709 13:11:46.564584 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 133877us
I20260709 13:11:46.409382 28217 raft_consensus.cc:515] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:46.425727 28180 raft_consensus.cc:697] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 8 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
W20260709 13:11:46.576493 25378 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36264 (request call id 1570) took 1514 ms (client timeout 1622 ms). Trace:
I20260709 13:11:46.413589 28227 consensus_queue.cc:1059] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
W20260709 13:11:46.570868 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 164783us
I20260709 13:11:46.567706 25270 leader_election.cc:304] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
W20260709 13:11:46.578698 25378 rpcz_store.cc:269] 0709 13:11:45.062671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:45.073880 (+ 11209us) service_pool.cc:224] Handling call
0709 13:11:46.576283 (+1502403us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b54000e5bd4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:46.576421 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":423691008}
W20260709 13:11:46.561537 28196 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.568s	user 0.021s	sys 0.039s
I20260709 13:11:46.583873 27851 consensus_queue.cc:237] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:46.558601 28175 raft_consensus.cc:493] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.420810 27996 raft_consensus.cc:515] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:46.588671 25343 leader_election.cc:304] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:46.562505 28018 raft_consensus.cc:493] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:46.561964 28126 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:46.426946 28257 raft_consensus.cc:515] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:46.564649 28039 raft_consensus.cc:493] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:46.564836 28265 raft_consensus.cc:2749] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:46.579947 28260 raft_consensus.cc:2749] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:46.565465 28236 raft_consensus.cc:493] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:46.586301 28271 raft_consensus.cc:2749] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:46.577915 28178 consensus_queue.cc:1059] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:11:46.594123 28018 raft_consensus.cc:515] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:46.579727 27783 raft_consensus.cc:2749] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:46.559424 28133 raft_consensus.cc:515] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:46.596218 28126 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:46.588795 28049 leader_election.cc:290] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:46.565900 28127 raft_consensus.cc:515] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:46.592533 28220 consensus_queue.cc:1059] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:11:46.618283 27894 raft_consensus.cc:493] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.624210 28236 raft_consensus.cc:515] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:46.635823 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 46112.2us
W20260709 13:11:46.633399 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 53280.3us
I20260709 13:11:46.594417 28275 raft_consensus.cc:2804] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:46.607311 28263 leader_election.cc:290] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:46.637903 25345 leader_election.cc:304] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:46.620246 28258 leader_election.cc:290] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:46.593037 28175 raft_consensus.cc:515] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:46.640175 28248 leader_election.cc:290] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:46.077979 25371 rpcz_store.cc:276] 0709 13:11:44.970626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:44.973238 (+  2612us) service_pool.cc:224] Handling call
0709 13:11:44.973523 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:44.973710 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:11:45.654536 (+680826us) log.cc:844] Serialized 14 byte log entry
0709 13:11:46.072143 (+417607us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:46.072197 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:46.072239 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:46.072298 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:46.072419 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10129,"prepare.queue_time_us":1102384,"thread_start_us":1087101,"threads_started":2}
I20260709 13:11:46.660877 28189 raft_consensus.cc:493] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.661427 28189 raft_consensus.cc:515] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:46.662112 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:46.644680 27894 raft_consensus.cc:515] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:46.663584 28189 leader_election.cc:290] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:46.664326 27894 leader_election.cc:290] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:46.665477 28189 raft_consensus.cc:493] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.668910 28152 raft_consensus.cc:493] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:46.669425 28152 raft_consensus.cc:515] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:46.670509 28256 leader_election.cc:290] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:46.671427 28152 leader_election.cc:290] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:46.672426 28127 leader_election.cc:290] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:46.668215 28189 raft_consensus.cc:515] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:46.673529 28268 log.cc:927] Time spent T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
W20260709 13:11:46.641189 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 173623us
W20260709 13:11:46.676196 28237 log.cc:927] Time spent T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.282s	user 0.002s	sys 0.000s
I20260709 13:11:46.676890 28189 leader_election.cc:290] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:46.677309 28180 consensus_queue.cc:237] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:46.681473 28274 log.cc:927] Time spent T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:11:46.682632 28270 raft_consensus.cc:2749] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:46.685041 28186 leader_election.cc:290] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:46.676162 28175 leader_election.cc:290] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:46.664366 25872 connection.cc:256] RPC call timeout handler was delayed by -1.0763202109999384s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23490000000000003s for a response
W20260709 13:11:46.687191 25872 leader_election.cc:336] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Timed out: RequestConsensusVote RPC to 127.23.140.66:33127 timed out after 3.129s (SENT)
I20260709 13:11:46.687582 25872 leader_election.cc:304] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:46.689347 28133 leader_election.cc:290] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:46.689615 25872 leader_election.cc:304] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:46.690763 28175 raft_consensus.cc:2749] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:46.691249 28126 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:46.618275 28238 consensus_queue.cc:1048] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:11:46.691493 28175 raft_consensus.cc:493] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:46.691813 25304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57256 (request call id 1740) took 1852 ms. Trace:
I20260709 13:11:46.692075 28175 raft_consensus.cc:515] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:46.693251 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:46.692233 25304 rpcz_store.cc:276] 0709 13:11:44.838938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:45.918974 (+1080036us) service_pool.cc:224] Handling call
0709 13:11:45.919299 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:46.009306 (+ 90007us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:46.691586 (+682280us) spinlock_profiling.cc:243] Waited 89.4 ms on lock 0x7b54000a5354. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:46.691744 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":205722880}
I20260709 13:11:46.693879 25300 raft_consensus.cc:2468] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 4.
I20260709 13:11:46.694473 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:46.695204 25304 raft_consensus.cc:2393] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 9: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
W20260709 13:11:46.693885 25229 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58418 (request call id 1809) took 2082 ms (client timeout 1584 ms). Trace:
W20260709 13:11:46.696799 25229 rpcz_store.cc:269] 0709 13:11:44.591391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:44.603394 (+ 12003us) service_pool.cc:224] Handling call
0709 13:11:46.673541 (+2070147us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b540024c054. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:46.673655 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3690076416}
I20260709 13:11:46.699213 28250 raft_consensus.cc:493] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.752674 28250 raft_consensus.cc:515] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:46.677078 28217 leader_election.cc:290] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:46.698664 28142 leader_election.cc:290] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:46.636869 28049 raft_consensus.cc:493] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
W20260709 13:11:46.753703 25873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:46.622179 28039 raft_consensus.cc:515] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:46.754985 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 117224us
I20260709 13:11:46.786772 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:46.787194 25345 leader_election.cc:304] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
W20260709 13:11:46.755015 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 167709us
W20260709 13:11:46.766672 25871 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:46.769194 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:46.773075 28275 raft_consensus.cc:697] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 6 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:46.773643 28258 raft_consensus.cc:2749] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:46.774385 25303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:35660 (request call id 15) took 1797 ms. Trace:
W20260709 13:11:46.774729 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:46.776185 28132 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.936s	user 0.012s	sys 0.031s
I20260709 13:11:46.777088 25305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57256 (request call id 1739) took 1938 ms. Trace:
W20260709 13:11:46.778050 25194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:46.780705 25377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36264 (request call id 1576) took 1715 ms. Trace:
I20260709 13:11:46.789211 25270 leader_election.cc:304] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:46.647926 28227 consensus_queue.cc:1243] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer da445ce82dc4467f95f4fa52297eaa19 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:11:46.763573 28271 raft_consensus.cc:3055] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:11:46.821614 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 132071us
I20260709 13:11:46.792870 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:46.838636 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:46.839291 25375 raft_consensus.cc:3060] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:46.839633 25372 raft_consensus.cc:3055] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:46.840009 25372 raft_consensus.cc:740] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:46.801743 25230 raft_consensus.cc:1240] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 7 LEADER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:46.767872 28140 leader_election.cc:290] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:46.805518 25305 rpcz_store.cc:276] 0709 13:11:44.838273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:45.912708 (+1074435us) service_pool.cc:224] Handling call
0709 13:11:45.928161 (+ 15453us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:46.246481 (+318320us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:46.776764 (+530283us) spinlock_profiling.cc:243] Waited 308 ms on lock 0x7b540018d3d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:46.777012 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":708836608}
I20260709 13:11:46.807102 25377 rpcz_store.cc:276] 0709 13:11:45.116135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:45.116314 (+   179us) service_pool.cc:224] Handling call
0709 13:11:45.116672 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:46.375698 (+1259026us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:46.780379 (+404681us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54002878d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:46.780625 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2893612800}
I20260709 13:11:46.806421 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:46.810900 25225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58418 (request call id 1802) took 2210 ms. Trace:
I20260709 13:11:46.848193 25227 raft_consensus.cc:3060] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:46.798838 25303 rpcz_store.cc:276] 0709 13:11:44.976942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:45.001961 (+ 25019us) service_pool.cc:224] Handling call
0709 13:11:46.774156 (+1772195us) spinlock_profiling.cc:243] Waited 929 ms on lock 0x7b540029ac54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc69853 00007fd734c3760a 00007fd72e1bd7d4 00007fd72e1bd762 00007fd72e1bd691 00007fd72e1bd60c 00007fd72e1bc8c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:46.774293 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2137282944}
W20260709 13:11:46.754717 28237 log.cc:927] Time spent T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:11:46.818670 25270 leader_election.cc:400] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091) with higher term. Message: Invalid argument: T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for earlier term 4. Current term is 5.
I20260709 13:11:46.850168 25270 leader_election.cc:304] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:46.698125 28147 consensus_queue.cc:1059] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.145s
I20260709 13:11:46.821168 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:46.793898 25299 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 4.
I20260709 13:11:46.852766 25226 raft_consensus.cc:3060] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:46.810636 28132 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.966s	user 0.013s	sys 0.031s
I20260709 13:11:46.791522 28133 raft_consensus.cc:493] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.824352 28276 consensus_queue.cc:1059] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:46.824844 28174 raft_consensus.cc:3060] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:46.825045 28227 consensus_queue.cc:1048] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:46.806155 28285 raft_consensus.cc:2804] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:46.828258 28236 leader_election.cc:290] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:46.828857 25297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57256 (request call id 1737) took 1992 ms. Trace:
I20260709 13:11:46.829223 28257 leader_election.cc:290] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:46.791778 28272 log.cc:927] Time spent T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:11:46.829713 25298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57256 (request call id 1738) took 1991 ms. Trace:
I20260709 13:11:46.830145 28283 raft_consensus.cc:2749] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:11:46.831360 28277 log.cc:927] Time spent T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:11:46.832280 28263 raft_consensus.cc:493] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.811038 28270 raft_consensus.cc:493] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:46.832719 28178 consensus_queue.cc:1048] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:46.823019 28271 raft_consensus.cc:740] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:46.812021 28220 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:46.833626 28142 raft_consensus.cc:2749] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:46.836484 25223 raft_consensus.cc:1275] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:11:46.837303 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:46.837922 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:46.807519 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:46.841032 25872 leader_election.cc:304] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:11:46.841997 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:46.919759 25229 raft_consensus.cc:3060] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:46.845085 25873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:46.845995 28289 raft_consensus.cc:493] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.846568 25221 raft_consensus.cc:2393] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 9: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:46.754347 27894 consensus_queue.cc:1048] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:11:46.846727 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:46.806862 28152 raft_consensus.cc:493] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.848269 25225 rpcz_store.cc:276] 0709 13:11:44.589549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:44.636380 (+ 46831us) service_pool.cc:224] Handling call
0709 13:11:44.636637 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:45.775655 (+1139018us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:46.799454 (+1023799us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b5400421154. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:46.799645 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2617576832}
I20260709 13:11:46.856122 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:46.857411 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:46.794612 28018 leader_election.cc:290] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:46.926347 25222 raft_consensus.cc:3060] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:46.861970 28290 consensus_queue.cc:1059] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:46.861616 25372 consensus_queue.cc:260] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:46.927974 28220 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:46.929181 25372 raft_consensus.cc:3060] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:46.930495 28220 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:46.930282 28152 raft_consensus.cc:515] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:46.931470 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:46.932590 28152 leader_election.cc:290] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:46.932688 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:46.933427 25223 raft_consensus.cc:3060] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:46.933910 28284 raft_consensus.cc:2804] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:46.934482 28284 raft_consensus.cc:697] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 6 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:46.935360 28284 consensus_queue.cc:237] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:46.864210 28293 raft_consensus.cc:493] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:46.937114 25372 raft_consensus.cc:1275] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:11:46.937512 25372 pending_rounds.cc:85] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468: Aborting all ops after (but not including) 3
I20260709 13:11:46.937876 27894 consensus_queue.cc:1059] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:46.941856 25223 raft_consensus.cc:2468] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 7.
I20260709 13:11:46.942173 28275 consensus_queue.cc:237] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:46.875151 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:46.875564 28247 leader_election.cc:290] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:46.875844 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:46.876075 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:46.875195 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:46.951304 25228 raft_consensus.cc:2410] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:11:46.876226 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:46.951771 25299 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 4.
I20260709 13:11:46.879144 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:46.891947 25270 leader_election.cc:304] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:46.952651 25303 raft_consensus.cc:2468] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 6.
I20260709 13:11:46.881985 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:46.882368 25302 raft_consensus.cc:1240] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 8 LEADER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:46.898975 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:46.881592 25224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54000 (request call id 455) took 2299 ms. Trace:
I20260709 13:11:46.953719 25301 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 6.
I20260709 13:11:46.897121 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:46.954783 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:46.821565 27976 leader_election.cc:290] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:46.902777 28133 raft_consensus.cc:515] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:46.902150 25297 rpcz_store.cc:276] 0709 13:11:44.837521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:45.056524 (+219003us) service_pool.cc:224] Handling call
0709 13:11:45.060457 (+  3933us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:46.227773 (+1167316us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:46.828606 (+600833us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54000a5854. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:46.828797 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2681671424}
I20260709 13:11:46.973635 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:46.974228 25297 raft_consensus.cc:2468] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 8.
I20260709 13:11:46.908826 25298 rpcz_store.cc:276] 0709 13:11:44.837998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:45.813644 (+975646us) service_pool.cc:224] Handling call
0709 13:11:45.814176 (+   532us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:46.426724 (+612548us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:46.829510 (+402786us) spinlock_profiling.cc:243] Waited 606 ms on lock 0x7b54002c9554. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:46.829661 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1394429184}
I20260709 13:11:46.975576 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:46.976145 25298 raft_consensus.cc:2468] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 8.
I20260709 13:11:46.976991 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:46.977470 25298 raft_consensus.cc:3060] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:46.791859 28049 raft_consensus.cc:515] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:46.842626 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:46.896937 28285 raft_consensus.cc:493] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:46.834822 28282 consensus_queue.cc:1059] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.091s
I20260709 13:11:46.936683 28293 raft_consensus.cc:515] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:46.993966 28285 raft_consensus.cc:3060] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:46.999008 28293 leader_election.cc:290] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:46.868432 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 46047us
I20260709 13:11:46.999622 28049 leader_election.cc:290] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:47.000234 28282 consensus_queue.cc:1243] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [LEADER]: Peer 1f539ba21487460085b837e7529a78ce log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:11:47.001881 28295 raft_consensus.cc:3055] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:47.002324 28295 raft_consensus.cc:740] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:46.946125 25305 raft_consensus.cc:2468] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 6.
I20260709 13:11:46.925297 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:46.947176 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:47.004933 25300 raft_consensus.cc:2393] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 6: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
W20260709 13:11:46.953078 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 61237.4us
I20260709 13:11:46.955941 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:46.953910 25224 rpcz_store.cc:276] 0709 13:11:44.582111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:44.582238 (+   127us) service_pool.cc:224] Handling call
0709 13:11:44.589438 (+  7200us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:11:44.710340 (+120902us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:11:44.813801 (+103461us) log.cc:844] Serialized 14 byte log entry
0709 13:11:44.942897 (+129096us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:11:44.943771 (+   874us) log.cc:844] Serialized 78 byte log entry
0709 13:11:44.943948 (+   177us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:44.944174 (+   226us) log.cc:844] Serialized 14 byte log entry
0709 13:11:44.945211 (+  1037us) log.cc:844] Serialized 14 byte log entry
0709 13:11:45.199179 (+253968us) spinlock_profiling.cc:243] Waited 30.3 ms on lock 0x7b180033d0c0. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72cb502a6 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd734b98aa1 00007fd734b8fb37 00007fd734b8f9ca 00007fd734c8726f
0709 13:11:45.272632 (+ 73453us) spinlock_profiling.cc:243] Waited 75.6 ms on lock 0x7b48002d03d8. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd734b98aa1 00007fd734b8fb37 00007fd734b8f9ca 00007fd734c8726f 00007fd734c86f37 00007fd734c9b55c 00007fd734c9b508 00007fd734c9b488 00007fd734c9b443 00007fd734c9a6ec 00007fd733bc4a96
0709 13:11:45.293034 (+ 20402us) spinlock_profiling.cc:243] Waited 8.1 ms on lock 0x7b180033d0c0. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72cb82522 00007fd72cb847c1 00007fd72cb84779 00007fd72cb84709 00007fd72cb846d1 00007fd72cb839cd 000000000038f354 000000000038f199 00007fd72cb6583a
0709 13:11:46.171847 (+878813us) spinlock_profiling.cc:243] Waited 3.31 ms on lock 0x7b180033d0c0. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72cb823f3 00007fd72cb847c1 00007fd72cb84779 00007fd72cb84709 00007fd72cb846d1 00007fd72cb839cd 000000000038f354 000000000038f199 00007fd72cb6583a
0709 13:11:46.302177 (+130330us) spinlock_profiling.cc:243] Waited 32.2 ms on lock 0x7b180033d0c0. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72f8174bc 00007fd72cb6548b 00007fd7359bfab9 00007fd72cb8169b 00007fd72cb7f93f 00007fd72cb7f455 00007fd72fc67060 00007fd72fc79716 00007fd72fc8a287
0709 13:11:46.312283 (+ 10106us) spinlock_profiling.cc:243] Waited 4.63 ms on lock 0x7b4400022b4c. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72caa8c85 00007fd72caa96a2 00007fd72f81b1db 00007fd72f816aaf 00007fd72f80a86e 00007fd72f809bb6 00007fd72f8097d8 00007fd72f813221 00007fd72f8131d9 00007fd72f813169
0709 13:11:46.578233 (+265950us) log.cc:844] Serialized 14 byte log entry
0709 13:11:46.578455 (+   222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:46.578529 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:46.648673 (+ 70144us) spinlock_profiling.cc:243] Waited 62.9 ms on lock 0x7b180033d0c0. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72cb823f3 00007fd72cb847c1 00007fd72cb84779 00007fd72cb84709 00007fd72cb846d1 00007fd72cb839cd 000000000038f354 000000000038f199 00007fd72cb6583a
0709 13:11:46.675926 (+ 27253us) spinlock_profiling.cc:243] Waited 6.09 ms on lock 0x7b2400169058. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72ca089c4 00007fd72ca06acb 00007fd72cbc1dc9 00007fd72cbc1a55 00007fd72cbc109d 00007fd72f7f310e 00007fd72f80a88c 00007fd72f809bb6 00007fd72f8097d8 00007fd72f813221
0709 13:11:46.881263 (+205337us) raft_consensus.cc:1685] finished
0709 13:11:46.881293 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:46.881507 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37865,"prepare.queue_time_us":987556,"prepare.run_cpu_time_us":167,"prepare.run_wall_time_us":2643,"raft.queue_time_us":156902,"raft.run_cpu_time_us":5231,"raft.run_wall_time_us":460753,"spinlock_wait_cycles":513137408,"thread_start_us":666977,"threads_started":4,"wal-append.queue_time_us":434904}
I20260709 13:11:46.906611 25375 raft_consensus.cc:2468] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 9.
I20260709 13:11:46.962213 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:11:46.953680 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 88702.4us
I20260709 13:11:46.937740 25372 pending_rounds.cc:107] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:11:46.963724 28175 leader_election.cc:290] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:46.920691 28263 raft_consensus.cc:515] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:46.920849 28270 raft_consensus.cc:515] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:46.925644 28276 raft_consensus.cc:493] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:46.972272 28220 raft_consensus.cc:493] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:46.980844 25227 raft_consensus.cc:2468] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 6.
I20260709 13:11:46.981693 25222 raft_consensus.cc:2468] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 7.
I20260709 13:11:46.994805 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:47.027849 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:46.995405 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:47.028716 25303 raft_consensus.cc:3060] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:46.993453 25229 raft_consensus.cc:2468] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 9.
I20260709 13:11:47.007215 25372 raft_consensus.cc:2889] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:47.030336 25874 leader_election.cc:304] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:11:47.030604 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:46.974027 28283 raft_consensus.cc:2804] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:47.035260 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:47.035907 25305 raft_consensus.cc:2468] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 7.
I20260709 13:11:47.036911 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:47.015954 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:47.017220 25194 leader_election.cc:304] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:47.038518 28049 raft_consensus.cc:2804] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:47.039052 28049 raft_consensus.cc:493] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:47.039265 25302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57256 (request call id 1725) took 3053 ms. Trace:
I20260709 13:11:47.039551 28049 raft_consensus.cc:3060] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:47.039721 25302 rpcz_store.cc:276] 0709 13:11:43.986282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:44.118902 (+132620us) service_pool.cc:224] Handling call
0709 13:11:44.119212 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:46.953327 (+2834115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:47.038977 (+ 85650us) spinlock_profiling.cc:243] Waited 2.76 s on lock 0x7b5400099a54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:47.039172 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6354034560}
I20260709 13:11:47.041149 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:47.042098 28140 raft_consensus.cc:493] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:47.042219 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:47.042686 28140 raft_consensus.cc:515] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:47.043540 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:11:46.947755 28258 consensus_queue.cc:1175] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "1f539ba21487460085b837e7529a78ce" responder_term: 5 status { last_received { term: 3 index: 3 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 4. Current term is 5. Ops: [4.4-4.4]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:11:47.033700 28220 raft_consensus.cc:515] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:47.046514 28297 raft_consensus.cc:3055] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:47.046932 28297 raft_consensus.cc:740] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:47.047619 28220 leader_election.cc:290] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:47.003938 25225 raft_consensus.cc:2468] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 6.
I20260709 13:11:47.047799 28297 consensus_queue.cc:260] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:47.048444 28049 raft_consensus.cc:515] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:47.033664 28236 raft_consensus.cc:493] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.050220 28247 raft_consensus.cc:2804] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:47.050644 28247 raft_consensus.cc:493] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:47.050552 28236 raft_consensus.cc:515] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:47.051178 28247 raft_consensus.cc:3060] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:47.050778 28271 consensus_queue.cc:260] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:47.051419 28049 leader_election.cc:290] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:47.052217 28271 raft_consensus.cc:3060] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:47.056739 28262 consensus_meta.cc:287] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.793s	user 0.011s	sys 0.000s
I20260709 13:11:47.061903 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:47.024462 25301 raft_consensus.cc:2410] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:11:46.970206 28159 raft_consensus.cc:3055] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:47.019429 28174 raft_consensus.cc:493] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:47.031458 25874 leader_election.cc:304] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:11:47.043685 28250 leader_election.cc:290] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:47.071769 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:47.072672 25901 raft_consensus.cc:1275] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:11:47.073091 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:47.073401 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:46.995952 28147 raft_consensus.cc:493] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.078253 28147 raft_consensus.cc:515] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:47.080631 28147 leader_election.cc:290] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:47.021219 28018 raft_consensus.cc:2804] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:47.076431 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:47.085937 25904 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 4.
I20260709 13:11:47.089439 25303 raft_consensus.cc:2468] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 9.
I20260709 13:11:47.064661 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:47.091640 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:47.091943 25225 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 7.
I20260709 13:11:47.065878 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:47.066244 25375 raft_consensus.cc:2468] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 9.
I20260709 13:11:47.008044 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:47.094276 25297 raft_consensus.cc:2393] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 9: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:47.095144 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:47.066926 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:47.049887 25194 leader_election.cc:304] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:47.096907 25222 raft_consensus.cc:2468] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 5.
W20260709 13:11:47.097294 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 47459.2us
I20260709 13:11:47.097663 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:47.098707 25906 raft_consensus.cc:2410] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:11:46.994485 27996 leader_election.cc:290] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:47.070614 28049 raft_consensus.cc:2804] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:47.070937 28174 raft_consensus.cc:515] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:47.111953 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:47.048923 28297 raft_consensus.cc:3060] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:47.074079 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:47.114753 25908 raft_consensus.cc:2468] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 3.
I20260709 13:11:47.074322 25901 raft_consensus.cc:3060] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:47.074766 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:47.075105 28247 raft_consensus.cc:515] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:47.075481 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:47.076213 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:47.076292 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:47.077073 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:47.121908 25902 raft_consensus.cc:2468] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 7.
I20260709 13:11:47.063591 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:46.948064 28289 raft_consensus.cc:515] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:47.089540 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:47.123541 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:47.124181 25300 raft_consensus.cc:2393] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 7: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:47.098387 25194 leader_election.cc:304] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:47.124428 25296 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 4.
I20260709 13:11:47.125237 25296 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c"
dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
mode: GRACEFUL
new_leader_uuid: "1f539ba21487460085b837e7529a78ce"
 from {username='slave'} at 127.0.0.1:35660
I20260709 13:11:47.067648 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:47.126004 25296 raft_consensus.cc:606] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Received request to transfer leadership to TS 1f539ba21487460085b837e7529a78ce
I20260709 13:11:47.126397 25296 raft_consensus.cc:614] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:47.018415 25270 leader_election.cc:304] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:47.034606 28283 raft_consensus.cc:493] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:47.099850 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:47.101580 28250 raft_consensus.cc:2804] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:47.130676 25299 raft_consensus.cc:2393] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 7: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:47.130970 25297 raft_consensus.cc:2410] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:11:47.064710 28227 consensus_queue.cc:1059] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 13:11:47.081826 28018 raft_consensus.cc:697] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 6 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
W20260709 13:11:47.084326 27945 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:11:47.152220 24113 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:11:47.101985 25271 leader_election.cc:304] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:47.061251 28276 raft_consensus.cc:515] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:47.023125 28282 consensus_queue.cc:1048] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 13:11:47.068347 28159 raft_consensus.cc:740] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:47.115237 25343 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:47.115458 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:47.098956 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:47.285367 25303 raft_consensus.cc:2410] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:11:47.123553 25221 raft_consensus.cc:2393] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 5: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:47.121565 25899 raft_consensus.cc:2376] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 7. Re-sending same reply.
I20260709 13:11:47.004050 28238 consensus_queue.cc:1048] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.078s
I20260709 13:11:47.131845 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:11:47.132797 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 131639us
I20260709 13:11:47.287017 25904 raft_consensus.cc:2410] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:11:47.111421 28265 raft_consensus.cc:493] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:47.133801 25300 raft_consensus.cc:1275] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:47.096828 28262 consensus_queue.cc:1048] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:11:47.121147 28049 raft_consensus.cc:697] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:47.132388 28283 raft_consensus.cc:3060] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:47.145650 28289 leader_election.cc:290] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:47.146257 28174 leader_election.cc:290] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:47.147089 28247 leader_election.cc:290] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:47.132786 28250 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:47.148130 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:47.148972 25299 raft_consensus.cc:1275] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
W20260709 13:11:47.150818 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 310281us
I20260709 13:11:47.137974 28180 raft_consensus.cc:2804] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:47.264659 25226 raft_consensus.cc:2468] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 7.
I20260709 13:11:47.114538 28163 consensus_queue.cc:1059] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:11:47.266667 25298 raft_consensus.cc:2468] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 5.
W20260709 13:11:47.287734 25873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:47.286460 25301 raft_consensus.cc:1240] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:11:47.305141 28039 leader_election.cc:290] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:47.316635 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 201471us
I20260709 13:11:47.290223 28018 consensus_queue.cc:237] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:47.290580 28248 raft_consensus.cc:493] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.293964 25300 raft_consensus.cc:1275] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:11:47.287339 25345 leader_election.cc:304] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:47.307317 25872 leader_election.cc:304] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:47.291126 28280 raft_consensus.cc:493] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.310555 28250 raft_consensus.cc:3060] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:47.295480 28147 raft_consensus.cc:3055] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:47.324787 25305 raft_consensus.cc:1275] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:11:47.338819 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:47.326354 25872 leader_election.cc:304] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:47.323065 25299 raft_consensus.cc:1275] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:11:47.315318 28180 raft_consensus.cc:493] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:47.341188 25873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:47.341578 25872 leader_election.cc:304] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:47.338402 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:47.343367 28163 raft_consensus.cc:3055] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:47.323875 28270 leader_election.cc:290] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:47.348141 25872 leader_election.cc:304] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:47.327066 28039 raft_consensus.cc:493] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:47.387780 25871 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:47.351240 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:47.351572 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:47.351763 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:47.352897 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:47.326524 28257 raft_consensus.cc:2749] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:47.332165 28289 raft_consensus.cc:2749] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:47.393404 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:47.394476 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:47.388650 25901 raft_consensus.cc:3060] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:47.388720 25904 raft_consensus.cc:2393] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 8: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
W20260709 13:11:47.388207 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 369864us
I20260709 13:11:47.387063 28049 consensus_queue.cc:237] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:47.296491 28265 raft_consensus.cc:515] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:47.391925 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 43903.2us
I20260709 13:11:47.336045 28147 raft_consensus.cc:740] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:47.346642 28133 leader_election.cc:290] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:47.396911 25194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:47.348268 28180 raft_consensus.cc:3060] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:47.405161 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 304479us
I20260709 13:11:47.331175 28248 raft_consensus.cc:515] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:47.373236 27996 raft_consensus.cc:2804] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:47.397421 25872 leader_election.cc:304] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:47.372928 28163 raft_consensus.cc:740] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:47.474869 25271 leader_election.cc:304] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:11:47.476094 25271 leader_election.cc:304] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:47.476866 25271 leader_election.cc:304] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:47.478206 28236 leader_election.cc:290] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:47.479954 28236 raft_consensus.cc:2804] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:47.480523 28236 raft_consensus.cc:697] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 6 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:47.453299 28220 raft_consensus.cc:2749] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:47.391224 28285 raft_consensus.cc:515] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:47.483968 28285 leader_election.cc:290] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:47.486065 28174 consensus_queue.cc:1048] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:47.487665 25374 raft_consensus.cc:1240] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:11:47.337822 28299 raft_consensus.cc:2804] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:47.477595 25271 leader_election.cc:304] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:47.374972 28175 raft_consensus.cc:2749] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:47.517668 25271 leader_election.cc:304] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:11:47.518162 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 120787us
I20260709 13:11:47.526237 25901 raft_consensus.cc:2468] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 9.
I20260709 13:11:47.396776 28298 raft_consensus.cc:2749] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:47.398638 28262 raft_consensus.cc:2804] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:47.396669 28178 consensus_queue.cc:1059] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.122s
W20260709 13:11:47.564646 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 47028.3us
I20260709 13:11:47.438982 28276 leader_election.cc:290] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:47.436650 28289 raft_consensus.cc:493] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
W20260709 13:11:47.518390 28275 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.022s	sys 0.027s
I20260709 13:11:47.491333 28299 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:47.481561 28236 consensus_queue.cc:237] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:47.337181 28280 raft_consensus.cc:515] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:47.570142 25194 leader_election.cc:304] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:47.339154 28159 consensus_queue.cc:260] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:47.518570 28270 raft_consensus.cc:2804] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:47.396497 28255 consensus_queue.cc:1059] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.148s
W20260709 13:11:47.574785 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:47.393198 28039 raft_consensus.cc:515] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:11:47.345036 28295 consensus_queue.cc:260] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:47.531818 28247 raft_consensus.cc:493] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:47.604398 25300 raft_consensus.cc:1275] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:11:47.527148 28293 raft_consensus.cc:2749] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:47.572160 28262 raft_consensus.cc:697] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 7 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
W20260709 13:11:47.579082 28275 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.022s	sys 0.032s
W20260709 13:11:47.593050 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 219221us
W20260709 13:11:47.601032 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:47.572993 28303 raft_consensus.cc:2804] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:47.581283 28299 raft_consensus.cc:3060] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:47.583070 28308 raft_consensus.cc:2804] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:47.610394 25195 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:47.592388 28133 raft_consensus.cc:2804] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:47.616012 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:47.618675 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:47.582275 28298 consensus_queue.cc:1059] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
W20260709 13:11:47.625154 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 280307us
I20260709 13:11:47.603564 28270 raft_consensus.cc:697] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 7 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:47.631745 25343 leader_election.cc:304] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:11:47.832527 28283 consensus_meta.cc:287] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent flushing consensus metadata: real 0.522s	user 0.009s	sys 0.000s
I20260709 13:11:47.649703 28303 raft_consensus.cc:697] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 9 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:47.577466 28147 consensus_queue.cc:260] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:47.582628 28289 raft_consensus.cc:515] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:47.840353 28303 consensus_queue.cc:237] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:47.841252 28147 raft_consensus.cc:3060] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:47.727368 27976 consensus_queue.cc:1059] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:47.719856 28220 raft_consensus.cc:3055] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:47.843966 28328 raft_consensus.cc:3055] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:47.844167 28220 raft_consensus.cc:740] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:47.844398 28328 raft_consensus.cc:740] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:47.845044 28220 consensus_queue.cc:260] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:47.845157 28328 consensus_queue.cc:260] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:47.752621 28140 leader_election.cc:290] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:47.618507 28248 leader_election.cc:290] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:47.766302 28263 leader_election.cc:290] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:47.708295 28174 raft_consensus.cc:2804] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:11:47.750536 28304 log.cc:927] Time spent T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:11:47.846796 28174 raft_consensus.cc:493] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:47.847208 28174 raft_consensus.cc:3060] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:47.846278 28328 raft_consensus.cc:3060] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:47.699241 28281 raft_consensus.cc:3055] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:47.850013 28281 raft_consensus.cc:740] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:47.850843 28281 consensus_queue.cc:260] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:47.789055 28250 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:47.765013 28280 leader_election.cc:290] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:47.709436 28271 raft_consensus.cc:3055] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:11:47.769129 28297 consensus_meta.cc:287] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent flushing consensus metadata: real 0.648s	user 0.011s	sys 0.000s
I20260709 13:11:47.787400 24113 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:47.581135 28163 consensus_queue.cc:260] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:47.632710 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 345434us
W20260709 13:11:47.611481 28301 consensus_queue.cc:1175] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "da445ce82dc4467f95f4fa52297eaa19" responder_term: 8 status { last_received { term: 8 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 8 index: 5 } }
W20260709 13:11:47.688402 28305 log.cc:927] Time spent T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 13:11:47.617010 28308 raft_consensus.cc:493] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:47.711824 28039 leader_election.cc:290] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361)
I20260709 13:11:47.649991 28306 raft_consensus.cc:493] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:47.650260 28159 raft_consensus.cc:3060] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:47.618465 28285 raft_consensus.cc:493] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.702131 28262 consensus_queue.cc:237] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:47.709959 28302 log.cc:927] Time spent T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.294s	user 0.000s	sys 0.001s
I20260709 13:11:47.610150 28247 raft_consensus.cc:515] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:47.816578 28313 raft_consensus.cc:2804] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:47.820214 27996 raft_consensus.cc:697] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
W20260709 13:11:47.820749 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 231158us
I20260709 13:11:47.744688 28265 leader_election.cc:290] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:47.823397 25304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57272 (request call id 1643) took 1019 ms. Trace:
W20260709 13:11:47.824024 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:47.824988 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 298900us
I20260709 13:11:47.751639 28293 raft_consensus.cc:3055] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:47.619153 28133 raft_consensus.cc:493] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
W20260709 13:11:47.827769 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 217467us
I20260709 13:11:47.792057 28270 consensus_queue.cc:237] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:47.832765 28314 raft_consensus.cc:2804] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:11:47.833302 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 202229us
I20260709 13:11:47.830052 28180 raft_consensus.cc:515] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:47.935173 27996 consensus_queue.cc:237] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:47.937783 25903 raft_consensus.cc:2410] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 13:11:47.938607 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:47.939630 28227 consensus_queue.cc:1048] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:11:47.899595 25873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:47.894992 25871 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:47.942395 28248 consensus_queue.cc:1048] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:47.944152 28280 consensus_queue.cc:1048] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:47.946316 27976 consensus_queue.cc:1048] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:47.904511 28263 raft_consensus.cc:493] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.947400 28271 raft_consensus.cc:740] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:47.947582 28263 raft_consensus.cc:515] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:47.948505 28163 raft_consensus.cc:3060] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:47.948246 28271 consensus_queue.cc:260] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:47.949127 27976 consensus_queue.cc:1048] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:47.949826 28293 raft_consensus.cc:740] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:47.950309 25304 rpcz_store.cc:276] 0709 13:11:46.803917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:47.283904 (+479987us) service_pool.cc:224] Handling call
0709 13:11:47.290689 (+  6785us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:47.517011 (+226322us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:47.517060 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:47.547480 (+ 30420us) log.cc:844] Serialized 26 byte log entry
0709 13:11:47.823044 (+275564us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:47.823089 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:47.823154 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:47.823193 (+    39us) raft_consensus.cc:1685] finished
0709 13:11:47.823203 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:47.823330 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":161065,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":111,"thread_start_us":452766,"threads_started":2,"wal-append.queue_time_us":238031}
I20260709 13:11:47.951032 28293 consensus_queue.cc:260] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:47.952075 28295 raft_consensus.cc:3060] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:47.952592 28293 raft_consensus.cc:3060] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:47.846283 28220 raft_consensus.cc:3060] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:47.936616 28133 raft_consensus.cc:3060] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:47.953850 28314 raft_consensus.cc:493] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:47.954321 28314 raft_consensus.cc:3060] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:47.923180 25270 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 1.573s (SENT) [suppressed 21 similar messages]
I20260709 13:11:47.955998 25195 leader_election.cc:304] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:11:47.955866 28285 raft_consensus.cc:515] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:47.956986 27976 raft_consensus.cc:2804] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:47.957185 25195 leader_election.cc:304] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:47.962337 28313 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:47.963063 28280 raft_consensus.cc:2804] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:47.852182 28281 raft_consensus.cc:3060] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:47.963526 28280 raft_consensus.cc:493] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:47.963972 28280 raft_consensus.cc:3060] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:47.936084 28180 leader_election.cc:290] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:47.894752 28327 raft_consensus.cc:493] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.963063 28313 raft_consensus.cc:3060] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:47.965449 28327 raft_consensus.cc:515] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:47.967994 28327 leader_election.cc:290] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:47.968245 28289 leader_election.cc:290] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:47.932937 28299 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:47.963160 28308 raft_consensus.cc:3060] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:47.972826 28299 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:47.883188 25271 leader_election.cc:304] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:11:47.961468 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:47.973552 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 90439.7us
I20260709 13:11:47.961716 28247 leader_election.cc:290] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:47.974210 28247 raft_consensus.cc:493] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.974656 28247 raft_consensus.cc:515] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:47.976694 28247 leader_election.cc:290] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:47.964658 25195 leader_election.cc:304] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:11:47.957453 27976 raft_consensus.cc:493] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:47.936719 28306 raft_consensus.cc:515] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:47.981899 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:47.982590 25305 raft_consensus.cc:2468] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 7.
I20260709 13:11:47.982986 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:47.936061 28250 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:47.983573 25300 raft_consensus.cc:3060] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:47.985168 28327 raft_consensus.cc:2804] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:47.985244 25195 leader_election.cc:304] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:47.978700 28265 raft_consensus.cc:2804] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:47.986230 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:47.987021 25229 raft_consensus.cc:2468] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 6.
I20260709 13:11:47.988435 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:47.990792 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:47.962253 28263 leader_election.cc:290] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:47.980190 25296 raft_consensus.cc:1275] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:11:47.984854 25126 catalog_manager.cc:5697] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 4 to 5, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 5 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:47.997038 28326 raft_consensus.cc:2749] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:47.997871 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:47.998620 25229 raft_consensus.cc:2468] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 6.
I20260709 13:11:47.996390 28327 raft_consensus.cc:697] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 7 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:48.000834 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:48.001011 28327 consensus_queue.cc:237] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:48.001906 25225 raft_consensus.cc:1240] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:48.002936 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:48.003181 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:48.003598 25225 raft_consensus.cc:2393] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 7: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:48.004926 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:48.005390 25229 raft_consensus.cc:1275] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:11:47.980976 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:47.983534 28306 leader_election.cc:290] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:47.958491 28285 leader_election.cc:290] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:47.996796 25126 catalog_manager.cc:5697] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 4 to 6, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 6 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:11:48.006237 25221 raft_consensus.cc:2468] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 7.
I20260709 13:11:48.007226 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:48.007508 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:47.981936 27976 raft_consensus.cc:3060] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:47.987054 28265 raft_consensus.cc:697] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 7 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:47.961680 25872 leader_election.cc:304] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:48.005460 25224 raft_consensus.cc:2468] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 8.
W20260709 13:11:48.009038 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 49788us
I20260709 13:11:48.009244 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
W20260709 13:11:48.009819 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 65910.5us
I20260709 13:11:48.009974 25227 raft_consensus.cc:3060] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:47.949394 28271 raft_consensus.cc:3060] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:47.979545 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:48.012938 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:48.014637 25194 leader_election.cc:304] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:48.015190 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:48.036239 25908 raft_consensus.cc:2468] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 6.
I20260709 13:11:48.015810 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:48.018365 25227 raft_consensus.cc:2468] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 8.
I20260709 13:11:47.963373 25344 leader_election.cc:304] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:48.037528 25904 raft_consensus.cc:2393] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 7: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:11:48.007050 25126 catalog_manager.cc:5697] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 3 to 6, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 6 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
I20260709 13:11:48.026420 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:48.038374 25901 raft_consensus.cc:2393] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 7: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:11:48.033452 25345 leader_election.cc:304] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:48.047940 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:48.053144 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:11:48.058238 25194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:48.063869 25303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57272 (request call id 1651) took 1166 ms. Trace:
I20260709 13:11:48.076013 25303 rpcz_store.cc:276] 0709 13:11:46.897273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:47.293882 (+396609us) service_pool.cc:224] Handling call
0709 13:11:47.309737 (+ 15855us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:47.594455 (+284718us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:47.594488 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:47.610926 (+ 16438us) log.cc:844] Serialized 26 byte log entry
0709 13:11:48.063515 (+452589us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:48.063557 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:48.063633 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:48.063671 (+    38us) raft_consensus.cc:1685] finished
0709 13:11:48.063681 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:48.063808 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":168854,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":126,"thread_start_us":664099,"threads_started":2,"wal-append.queue_time_us":390894}
I20260709 13:11:48.049883 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:48.067605 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:11:48.058442 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 95122.7us
I20260709 13:11:48.088130 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:48.089485 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:48.094137 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:48.094998 25304 raft_consensus.cc:2468] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 8.
I20260709 13:11:48.068768 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:48.100147 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:48.101073 25908 raft_consensus.cc:3060] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:48.101624 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:48.101812 25300 raft_consensus.cc:2468] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 9.
I20260709 13:11:48.103761 25221 raft_consensus.cc:1240] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:48.104585 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:11:48.108404 25128 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40034 (request call id 261) took 15514 ms (client timeout 15000 ms). Trace:
I20260709 13:11:48.109663 25297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57256 (request call id 1762) took 1351 ms. Trace:
W20260709 13:11:48.064945 25345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:48.138329 25126 catalog_manager.cc:5697] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 2 to 3, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 3 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:48.140882 25905 raft_consensus.cc:1240] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:48.033119 28289 raft_consensus.cc:2749] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:48.149629 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:48.067201 28250 raft_consensus.cc:2804] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:48.153807 25126 catalog_manager.cc:5697] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 2 to 3, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 3 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
I20260709 13:11:48.047091 28315 raft_consensus.cc:493] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:48.067341 28299 raft_consensus.cc:2749] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:11:48.163417 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:48.156294 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:48.166199 25229 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 7.
I20260709 13:11:48.100311 28285 raft_consensus.cc:2804] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:48.143946 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:11:48.167982 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:48.169087 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 245943us
I20260709 13:11:48.102922 28247 consensus_queue.cc:1048] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:11:48.177830 25270 leader_election.cc:304] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:48.180105 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:48.182410 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:48.050494 28283 raft_consensus.cc:515] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:48.183446 25229 raft_consensus.cc:2410] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:11:48.184896 25270 leader_election.cc:304] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:48.186995 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:48.189558 25223 raft_consensus.cc:2393] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 8: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:11:48.191154 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:48.191900 25228 raft_consensus.cc:2393] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 9: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:48.192261 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:48.190150 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:48.153489 28250 raft_consensus.cc:493] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:48.201519 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:48.207331 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:48.207790 25903 raft_consensus.cc:2468] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 6.
I20260709 13:11:48.204275 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:48.204996 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:48.205986 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:48.206574 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:48.209499 25227 raft_consensus.cc:2393] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 8: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:11:48.211709 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:48.212050 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:48.212388 25227 raft_consensus.cc:1240] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:11:48.212617 25899 raft_consensus.cc:2393] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 5: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
W20260709 13:11:48.142047 25128 rpcz_store.cc:269] 0709 13:11:32.594213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:32.594865 (+   652us) service_pool.cc:224] Handling call
0709 13:11:48.108313 (+15513448us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:43.896819 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:44.033095 (+136276us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:44.065308 (+ 32213us) write_op.cc:435] Acquired schema lock
0709 13:11:44.067267 (+  1959us) tablet.cc:662] Decoding operations
0709 13:11:44.076876 (+  9609us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:44.076968 (+    92us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:44.077003 (+    35us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:11:44.099993 (+ 22990us) tablet.cc:701] Row locks acquired
0709 13:11:44.100043 (+    50us) write_op.cc:260] PREPARE: finished
0709 13:11:44.100226 (+   183us) write_op.cc:270] Start()
0709 13:11:44.100380 (+   154us) write_op.cc:276] Timestamp: P: 1783602704100143 usec, L: 0
0709 13:11:44.100401 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:11:44.101090 (+   689us) log.cc:844] Serialized 6453 byte log entry
0709 13:11:44.608974 (+507884us) op_driver.cc:464] REPLICATION: finished
0709 13:11:45.089653 (+480679us) write_op.cc:301] APPLY: starting
0709 13:11:45.118808 (+ 29155us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:45.195479 (+ 76671us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:45.280648 (+ 85169us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:45.321225 (+ 40577us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:45.321801 (+   576us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 13:11:45.321872 (+    71us) write_op.cc:312] APPLY: finished
0709 13:11:45.322456 (+   584us) log.cc:844] Serialized 113 byte log entry
0709 13:11:45.328679 (+  6223us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:45.328841 (+   162us) write_op.cc:454] Released schema lock
0709 13:11:45.328912 (+    71us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:45.418596 (+ 89684us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:45.421425 (+  2829us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":303985,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":268217,"apply.run_cpu_time_us":7547,"apply.run_wall_time_us":449778,"num_ops":16,"prepare.queue_time_us":226926,"prepare.run_cpu_time_us":11258,"prepare.run_wall_time_us":404520,"raft.queue_time_us":83140,"raft.run_cpu_time_us":10086,"raft.run_wall_time_us":218376,"replication_time_us":508368,"thread_start_us":636053,"threads_started":4,"wal-append.queue_time_us":348548,"wal-append.run_cpu_time_us":19678,"wal-append.run_wall_time_us":1877378}]]}
W20260709 13:11:48.212677 25345 connection.cc:256] RPC call timeout handler was delayed by -2.0060976100000971s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:11:48.214277 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:48.214433 25230 raft_consensus.cc:1275] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:11:48.214864 25303 raft_consensus.cc:2468] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 7.
I20260709 13:11:48.215112 25230 pending_rounds.cc:85] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce: Aborting all ops after (but not including) 3
I20260709 13:11:48.215607 25230 pending_rounds.cc:107] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:11:48.216017 25230 raft_consensus.cc:2889] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:48.217303 25300 raft_consensus.cc:2468] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 6.
W20260709 13:11:48.218827 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:48.219802 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:48.220608 25300 raft_consensus.cc:2468] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 6.
I20260709 13:11:48.222335 25375 raft_consensus.cc:1240] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:48.223985 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:48.224659 25375 raft_consensus.cc:2393] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 5: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:48.226370 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:48.227465 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:48.228021 25901 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 7.
I20260709 13:11:48.227138 25376 raft_consensus.cc:2468] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 5.
I20260709 13:11:48.235420 25874 leader_election.cc:304] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:48.236019 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:48.236534 25874 leader_election.cc:304] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:48.237005 25375 raft_consensus.cc:2393] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 5: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:48.142949 25297 rpcz_store.cc:276] 0709 13:11:46.758146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:47.134648 (+376502us) service_pool.cc:224] Handling call
0709 13:11:47.134945 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:47.135206 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:11:47.185128 (+ 49922us) log.cc:844] Serialized 14 byte log entry
0709 13:11:47.732514 (+547386us) spinlock_profiling.cc:243] Waited 5.15 ms on lock 0x7b18000cd000. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72cb64e07 00007fd7359bfab9 00007fd72cb8169b 00007fd72cb7f93f 00007fd72cb81c02 00007fd72f80920b 00007fd72f80ed23 00007fd72f80f23a 00007fd72fc79a2a
0709 13:11:48.109237 (+376723us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:48.109309 (+    72us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:48.109365 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:48.109450 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:48.109590 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":49731,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":73,"raft.queue_time_us":112,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":8387,"spinlock_wait_cycles":11851008,"thread_start_us":376349,"threads_started":1}
I20260709 13:11:48.231326 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:48.243136 25227 raft_consensus.cc:1275] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:11:48.243615 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:48.244256 25303 raft_consensus.cc:2468] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 5.
W20260709 13:11:48.244757 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 279633us
I20260709 13:11:48.245154 25304 raft_consensus.cc:2393] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 7: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:48.246006 25872 leader_election.cc:304] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:48.202200 28303 raft_consensus.cc:2749] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:48.242895 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:48.249142 25371 raft_consensus.cc:3060] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:48.255594 25343 leader_election.cc:304] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:11:48.242151 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 43562.2us
I20260709 13:11:48.172072 28315 raft_consensus.cc:515] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:11:48.203245 28270 consensus_queue.cc:1059] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.102s
I20260709 13:11:48.176235 28265 consensus_queue.cc:237] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:48.228688 28285 raft_consensus.cc:697] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 9 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:48.232589 25900 raft_consensus.cc:2410] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:11:48.334712 28282 raft_consensus.cc:2804] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:48.213055 28250 raft_consensus.cc:3060] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:48.424002 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:48.304993 28323 consensus_queue.cc:1059] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.248s
I20260709 13:11:48.428515 28263 raft_consensus.cc:493] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
W20260709 13:11:48.434176 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:48.504539 25223 raft_consensus.cc:2468] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 7.
I20260709 13:11:48.259027 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:48.417143 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:48.504784 28263 raft_consensus.cc:515] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:48.425346 25300 raft_consensus.cc:1275] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:11:48.506263 25379 raft_consensus.cc:2468] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 7.
I20260709 13:11:48.506333 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:48.303478 27996 raft_consensus.cc:2749] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:48.506917 28299 raft_consensus.cc:493] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:48.507254 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:48.507449 28299 raft_consensus.cc:515] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:48.507543 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:11:48.376690 28324 log.cc:927] Time spent T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:11:48.503324 28285 consensus_queue.cc:237] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:48.508476 25372 raft_consensus.cc:2468] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 6.
I20260709 13:11:48.509575 28299 leader_election.cc:290] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:48.508503 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:48.462343 28317 raft_consensus.cc:493] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:48.511423 25379 raft_consensus.cc:2468] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 7.
I20260709 13:11:48.511487 28317 raft_consensus.cc:515] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:48.258700 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:48.512585 25370 raft_consensus.cc:2468] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 6.
W20260709 13:11:48.255414 28334 log.cc:927] Time spent T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
I20260709 13:11:48.377952 28174 raft_consensus.cc:515] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:48.513913 28317 leader_election.cc:290] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:48.306030 27945 consensus_queue.cc:1048] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.221s
I20260709 13:11:48.514679 25229 raft_consensus.cc:1240] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:48.218379 28262 raft_consensus.cc:2804] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:48.244422 28147 raft_consensus.cc:493] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:48.258100 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:48.293296 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:48.516633 28147 raft_consensus.cc:515] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:48.345845 28318 consensus_queue.cc:1048] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.212s
I20260709 13:11:48.232676 28039 raft_consensus.cc:493] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:48.518283 28039 raft_consensus.cc:515] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:48.259532 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:48.295078 28322 raft_consensus.cc:2749] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:48.520406 25371 raft_consensus.cc:2468] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 8.
I20260709 13:11:48.335759 25126 catalog_manager.cc:5697] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 5 to 6, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 6 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:11:48.534449 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:48.555224 28315 leader_election.cc:290] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:48.556824 25908 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 5.
I20260709 13:11:48.557066 28263 leader_election.cc:290] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:48.558203 28333 log.cc:927] Time spent T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.354s	user 0.000s	sys 0.001s
I20260709 13:11:48.559815 28039 leader_election.cc:290] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:48.559965 28227 raft_consensus.cc:493] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
W20260709 13:11:48.561053 28341 log.cc:927] Time spent T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260709 13:11:48.560781 28227 raft_consensus.cc:515] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:48.561875 28174 leader_election.cc:290] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:48.561918 28299 raft_consensus.cc:493] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:48.562688 28299 raft_consensus.cc:515] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:48.565155 28299 leader_election.cc:290] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:48.567152 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:48.568090 25904 raft_consensus.cc:2393] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 7: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:11:48.572238 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:48.572947 25374 raft_consensus.cc:2376] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 3. Re-sending same reply.
I20260709 13:11:48.575166 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:48.576646 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:48.577337 25375 raft_consensus.cc:2376] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 5. Re-sending same reply.
I20260709 13:11:48.580938 27945 raft_consensus.cc:493] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:48.560278 28331 log.cc:927] Time spent T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.360s	user 0.001s	sys 0.000s
I20260709 13:11:48.582728 25228 raft_consensus.cc:1275] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:11:48.597540 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 361037us
I20260709 13:11:48.602764 25874 leader_election.cc:304] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:11:48.525173 28326 raft_consensus.cc:493] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:48.606264 25226 raft_consensus.cc:1240] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:11:48.609827 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:11:48.612934 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 366999us
I20260709 13:11:48.625051 25375 raft_consensus.cc:2468] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 3.
I20260709 13:11:48.625208 25872 leader_election.cc:304] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:48.626331 25872 leader_election.cc:304] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:48.616622 25874 leader_election.cc:304] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:11:48.633823 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:48.634796 25375 raft_consensus.cc:2468] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 8.
I20260709 13:11:48.581605 27945 raft_consensus.cc:515] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:48.648816 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:48.659402 25126 catalog_manager.cc:5697] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 5 to 7, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 7 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:48.536914 28328 raft_consensus.cc:493] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:48.617806 25194 leader_election.cc:304] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:48.565739 28299 raft_consensus.cc:493] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:48.668105 25374 raft_consensus.cc:1275] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:11:48.672308 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:48.676781 25373 raft_consensus.cc:3060] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:11:48.677129 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:48.674073 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:48.678184 25370 raft_consensus.cc:2468] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 6.
I20260709 13:11:48.685316 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:48.685968 25297 raft_consensus.cc:3060] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:48.687881 25271 leader_election.cc:304] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:11:48.695902 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:48.697113 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:48.698725 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:48.682987 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:48.696259 25905 pending_rounds.cc:85] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6: Aborting all ops after (but not including) 5
I20260709 13:11:48.726967 25229 raft_consensus.cc:1275] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:11:48.712657 25271 leader_election.cc:304] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:48.718559 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:48.718133 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:48.737723 25372 raft_consensus.cc:2393] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 7: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:48.718576 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:48.738103 25370 raft_consensus.cc:2468] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 7.
I20260709 13:11:48.737689 25271 leader_election.cc:304] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:48.718034 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:48.719691 25301 raft_consensus.cc:1240] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:11:48.761112 25379 raft_consensus.cc:2393] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 5: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
W20260709 13:11:48.771406 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:48.771572 25297 raft_consensus.cc:2468] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 8.
I20260709 13:11:48.772632 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:48.773340 25297 raft_consensus.cc:3060] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:48.774521 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:48.774717 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:48.775484 25370 raft_consensus.cc:2393] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 7: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:48.775492 25296 raft_consensus.cc:2468] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 7.
I20260709 13:11:48.649547 28323 raft_consensus.cc:2804] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:48.668917 28298 raft_consensus.cc:2804] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:48.604239 28250 raft_consensus.cc:515] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:48.764845 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 65562.3us
I20260709 13:11:48.659085 28322 raft_consensus.cc:2804] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:48.659565 28317 raft_consensus.cc:493] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:48.659461 28297 raft_consensus.cc:2804] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:48.733506 28325 raft_consensus.cc:493] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:48.774271 28306 raft_consensus.cc:2804] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:48.796157 25373 raft_consensus.cc:2468] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 8.
I20260709 13:11:48.736771 25905 pending_rounds.cc:107] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 6.6
I20260709 13:11:48.733029 25126 catalog_manager.cc:5697] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:11:48.842597 25905 raft_consensus.cc:2917] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Aborting config change with OpId 6.6: Aborted: Op aborted by new leader
I20260709 13:11:48.802237 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:48.809634 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:48.660724 28326 raft_consensus.cc:515] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:48.818005 28313 consensus_meta.cc:287] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 0.852s	user 0.008s	sys 0.002s
I20260709 13:11:48.815025 28298 raft_consensus.cc:697] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:48.816721 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:48.840809 28306 raft_consensus.cc:493] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:48.791435 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:48.892715 25126 catalog_manager.cc:5697] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 1 to 3, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 3 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
I20260709 13:11:48.893601 25374 raft_consensus.cc:2410] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:11:48.817408 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:48.780598 25226 raft_consensus.cc:1240] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:48.784212 28323 raft_consensus.cc:493] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:48.840108 25228 raft_consensus.cc:1240] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:11:48.813361 25899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50060 (request call id 509) took 1449 ms. Trace:
I20260709 13:11:48.907264 25899 rpcz_store.cc:276] 0709 13:11:47.351456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:47.351559 (+   103us) service_pool.cc:224] Handling call
0709 13:11:48.800584 (+1449025us) spinlock_profiling.cc:243] Waited 824 ms on lock 0x7b5400276ad4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:48.800772 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1894454016}
I20260709 13:11:48.843127 25905 raft_consensus.cc:2889] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:48.814868 28289 consensus_queue.cc:1059] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 13:11:48.844146 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:48.910115 25304 raft_consensus.cc:2468] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 5.
I20260709 13:11:48.713263 28039 raft_consensus.cc:2804] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:48.815492 28322 raft_consensus.cc:493] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:48.735803 28299 raft_consensus.cc:515] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:48.696795 28328 raft_consensus.cc:515] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:48.879829 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:48.816509 28297 raft_consensus.cc:493] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:48.763113 28315 raft_consensus.cc:2804] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:48.971140 25228 raft_consensus.cc:1275] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:11:48.883294 28270 raft_consensus.cc:2804] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:11:48.887435 28345 log.cc:927] Time spent T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 13:11:48.888954 28346 log.cc:927] Time spent T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
W20260709 13:11:48.887475 28350 log.cc:927] Time spent T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
W20260709 13:11:48.699680 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 82426.2us
I20260709 13:11:48.978053 28289 raft_consensus.cc:3055] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:48.992597 25194 leader_election.cc:304] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:48.918301 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:48.501784 28282 raft_consensus.cc:697] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 5 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:48.922128 25303 raft_consensus.cc:1275] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:11:48.975193 28315 raft_consensus.cc:493] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:48.931203 28039 raft_consensus.cc:493] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:48.828655 28317 raft_consensus.cc:515] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:48.964172 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:48.978932 28270 raft_consensus.cc:493] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:48.845367 28325 raft_consensus.cc:515] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:48.908049 28306 raft_consensus.cc:3060] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:48.917708 28323 raft_consensus.cc:3060] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:48.962155 27976 consensus_meta.cc:287] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 0.863s	user 0.011s	sys 0.000s
I20260709 13:11:48.918848 28283 leader_election.cc:290] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 5 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:49.034089 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 405840us
I20260709 13:11:48.986459 25372 raft_consensus.cc:2468] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 5.
I20260709 13:11:48.961171 28352 raft_consensus.cc:493] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:48.962076 28356 consensus_queue.cc:1048] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:11:48.989475 25223 raft_consensus.cc:2468] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 9.
W20260709 13:11:48.891150 25907 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.001s	sys 0.008s
I20260709 13:11:49.013020 28039 raft_consensus.cc:3060] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:48.998329 25374 raft_consensus.cc:2393] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 8: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:48.971021 28297 raft_consensus.cc:3060] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:48.961499 28322 raft_consensus.cc:3060] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:48.893118 28313 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:49.060660 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:49.061467 25374 raft_consensus.cc:2393] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 9: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:48.985132 25343 leader_election.cc:304] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:48.966477 25371 raft_consensus.cc:1275] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:11:49.063591 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:48.994081 28289 raft_consensus.cc:740] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:49.001257 28247 raft_consensus.cc:2804] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:49.009630 28315 raft_consensus.cc:3060] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:49.035576 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:49.036706 25379 raft_consensus.cc:2376] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 6. Re-sending same reply.
I20260709 13:11:49.038000 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:49.069363 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:49.083474 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:48.930279 28147 leader_election.cc:290] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:49.010004 28227 leader_election.cc:290] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:49.041601 27945 leader_election.cc:290] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:49.029970 28270 raft_consensus.cc:3060] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:49.058038 28325 leader_election.cc:290] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:49.013769 25373 raft_consensus.cc:2468] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 7.
I20260709 13:11:49.059098 25225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1790) took 1045 ms. Trace:
I20260709 13:11:49.065596 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:49.067057 28285 raft_consensus.cc:2749] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:49.079443 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:11:49.038859 25907 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.835s	user 0.001s	sys 0.008s
W20260709 13:11:49.089511 25195 leader_election.cc:336] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 1.622s (SENT)
W20260709 13:11:49.134951 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 45467.2us
W20260709 13:11:49.136180 25195 leader_election.cc:336] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 1.623s (SENT)
W20260709 13:11:49.137223 25195 leader_election.cc:336] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 1.691s (SENT)
W20260709 13:11:49.089990 25873 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.795s	user 0.005s	sys 0.012s
W20260709 13:11:49.099435 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:49.102769 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:11:49.137952 25873 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.843s	user 0.005s	sys 0.012s
W20260709 13:11:49.138387 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 844118us
I20260709 13:11:49.107509 25297 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 5.
W20260709 13:11:49.107641 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 125922us
I20260709 13:11:49.041193 25227 raft_consensus.cc:2468] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 11.
I20260709 13:11:49.112032 25222 raft_consensus.cc:2393] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 5: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:49.122437 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:11:48.997491 28327 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.852s	user 0.000s	sys 0.024s
W20260709 13:11:49.106091 25305 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.945s	user 0.006s	sys 0.010s
W20260709 13:11:49.152240 25305 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.996s	user 0.007s	sys 0.010s
I20260709 13:11:49.137707 25195 leader_election.cc:304] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:49.036937 27976 raft_consensus.cc:515] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:49.009105 28298 consensus_queue.cc:237] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:49.149529 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:49.064914 28283 raft_consensus.cc:493] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:49.155660 25195 leader_election.cc:336] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 1.692s (SENT)
I20260709 13:11:49.163051 25195 leader_election.cc:304] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:49.157891 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:49.163646 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:49.164577 25373 raft_consensus.cc:2393] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 9: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:49.165512 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:49.167029 25373 raft_consensus.cc:2468] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 6.
W20260709 13:11:49.106380 28265 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.004s	sys 0.014s
I20260709 13:11:49.080996 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:49.174084 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:11:49.176594 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:49.129119 25225 rpcz_store.cc:276] 0709 13:11:48.013816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:48.018449 (+  4633us) service_pool.cc:224] Handling call
0709 13:11:48.018843 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:48.033477 (+ 14634us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:48.033510 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:48.098526 (+ 65016us) log.cc:844] Serialized 26 byte log entry
0709 13:11:48.202602 (+104076us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:48.202643 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:48.202704 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:49.058887 (+856183us) raft_consensus.cc:1685] finished
0709 13:11:49.058909 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:49.059039 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14185,"raft.queue_time_us":14310,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":51796,"thread_start_us":41622,"threads_started":1,"wal-append.queue_time_us":440087}
I20260709 13:11:49.180995 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:49.181919 25374 raft_consensus.cc:2468] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 6.
I20260709 13:11:49.183341 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:11:49.151774 28327 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.043s	user 0.000s	sys 0.025s
I20260709 13:11:49.184563 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:49.190117 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:49.190821 25373 raft_consensus.cc:2468] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 6.
I20260709 13:11:49.192878 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
W20260709 13:11:49.192402 25378 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.791s	user 0.005s	sys 0.013s
W20260709 13:11:49.193923 25378 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.792s	user 0.006s	sys 0.013s
I20260709 13:11:49.053359 28352 raft_consensus.cc:515] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:49.198297 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:49.198925 25373 raft_consensus.cc:3060] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:49.171788 28265 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.005s	sys 0.015s
I20260709 13:11:49.156247 28319 raft_consensus.cc:2804] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:11:49.212858 25270 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.793s	user 0.005s	sys 0.015s
W20260709 13:11:49.213331 25270 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.794s	user 0.005s	sys 0.015s
I20260709 13:11:49.214350 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:49.215123 25371 raft_consensus.cc:2393] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 9: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:49.171557 28250 leader_election.cc:290] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:49.248880 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:49.249568 25371 raft_consensus.cc:2468] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 8.
I20260709 13:11:49.192366 25900 raft_consensus.cc:2468] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 3.
I20260709 13:11:49.250988 25373 raft_consensus.cc:2468] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 7.
W20260709 13:11:49.258704 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 475318us
I20260709 13:11:49.261287 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:49.264405 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:49.268245 25373 raft_consensus.cc:2468] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 5.
W20260709 13:11:49.240124 28351 log.cc:927] Time spent T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.334s	user 0.001s	sys 0.000s
I20260709 13:11:49.263684 25271 leader_election.cc:304] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:49.196612 28285 consensus_queue.cc:1048] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:11:49.284878 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:49.325101 25373 raft_consensus.cc:2468] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 8.
W20260709 13:11:49.325562 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 63906.2us
I20260709 13:11:49.187785 28283 raft_consensus.cc:515] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:49.286727 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:49.293056 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:49.294369 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:49.283934 28299 leader_election.cc:290] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:49.352195 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:49.366524 25296 raft_consensus.cc:1240] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:11:49.356428 25222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54000 (request call id 461) took 1356 ms. Trace:
I20260709 13:11:49.161074 28282 consensus_queue.cc:237] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:49.293651 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:49.380404 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:49.345922 25302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57272 (request call id 1673) took 1357 ms. Trace:
I20260709 13:11:49.381310 25226 raft_consensus.cc:2393] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 4: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:49.355502 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:49.363315 25227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58418 (request call id 1850) took 1070 ms. Trace:
I20260709 13:11:49.367678 25222 rpcz_store.cc:276] 0709 13:11:48.000479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:48.000611 (+   132us) service_pool.cc:224] Handling call
0709 13:11:49.356197 (+1355586us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54000884d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:49.356358 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2553762048}
I20260709 13:11:49.381428 25304 raft_consensus.cc:2393] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 5: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:49.262645 25872 leader_election.cc:304] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:11:49.384493 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 121939us
I20260709 13:11:49.385445 25872 leader_election.cc:304] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:49.371038 25270 leader_election.cc:304] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:49.378755 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:49.286422 28227 raft_consensus.cc:493] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.193863 28289 consensus_queue.cc:260] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:49.389655 25270 leader_election.cc:304] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:49.390792 25225 raft_consensus.cc:2368] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 7. Current term is 8.
I20260709 13:11:49.383559 25227 rpcz_store.cc:276] 0709 13:11:48.293284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:48.372048 (+ 78764us) service_pool.cc:224] Handling call
0709 13:11:48.682811 (+310763us) spinlock_profiling.cc:243] Waited 1.72 ms on lock 0x7b5800002a98. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72cb4ab71 00007fd72cb4aa22 00007fd735a63c09 00007fd734bbdee0 00007fd734c870ab 00007fd734c87131 00007fd734c350a0 00007fd734c34984 00007fd72e1af6d4 00007fd72e1af662
0709 13:11:49.363078 (+680267us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x7b540004bd54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:49.363239 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":698196096}
I20260709 13:11:49.381502 25302 rpcz_store.cc:276] 0709 13:11:47.988124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:47.988255 (+   131us) service_pool.cc:224] Handling call
0709 13:11:47.988543 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:47.988936 (+   393us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:11:48.188027 (+199091us) log.cc:844] Serialized 14 byte log entry
0709 13:11:48.988249 (+800222us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:48.994171 (+  5922us) log.cc:844] Serialized 26 byte log entry
0709 13:11:49.000336 (+  6165us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:49.000374 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:49.000485 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:49.345704 (+345219us) raft_consensus.cc:1685] finished
0709 13:11:49.345724 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:49.345866 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":535906,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":59,"raft.queue_time_us":36367,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":177,"thread_start_us":939364,"threads_started":3,"wal-append.queue_time_us":564297}
I20260709 13:11:49.392228 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:49.300288 28328 leader_election.cc:290] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:49.299858 28370 raft_consensus.cc:2749] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:49.396745 25270 leader_election.cc:304] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:11:49.342428 28293 consensus_meta.cc:287] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent flushing consensus metadata: real 1.389s	user 0.009s	sys 0.003s
W20260709 13:11:49.340942 28159 consensus_meta.cc:287] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 1.395s	user 0.009s	sys 0.000s
I20260709 13:11:49.404208 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:49.347504 28319 raft_consensus.cc:493] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:49.358031 28358 raft_consensus.cc:493] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:49.350577 28250 raft_consensus.cc:2749] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:49.343778 28262 raft_consensus.cc:493] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:49.411378 25371 raft_consensus.cc:2376] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 9. Re-sending same reply.
I20260709 13:11:49.409065 25270 leader_election.cc:304] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:49.414820 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:49.358294 28140 raft_consensus.cc:2804] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:49.501001 28262 raft_consensus.cc:3060] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:49.418584 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:11:49.437647 28357 log.cc:927] Time spent T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
W20260709 13:11:49.432511 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 361263us
I20260709 13:11:49.441144 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:11:49.438629 28367 log.cc:927] Time spent T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.190s	user 0.000s	sys 0.000s
I20260709 13:11:49.360989 28303 consensus_queue.cc:1048] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
W20260709 13:11:49.551900 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 163905us
I20260709 13:11:49.360738 28265 consensus_queue.cc:1059] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 13:11:49.502815 25229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58418 (request call id 1848) took 1284 ms. Trace:
I20260709 13:11:49.398963 28247 raft_consensus.cc:697] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 9 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:49.558079 25229 rpcz_store.cc:276] 0709 13:11:48.217977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:48.774208 (+556231us) service_pool.cc:224] Handling call
0709 13:11:48.782536 (+  8328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:48.782744 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:11:49.065384 (+282640us) log.cc:844] Serialized 14 byte log entry
0709 13:11:49.502358 (+436974us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:49.502428 (+    70us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:49.502499 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:49.502588 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:49.502744 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":82467,"prepare.queue_time_us":503912,"prepare.run_cpu_time_us":6815,"prepare.run_wall_time_us":23541,"raft.queue_time_us":70063,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":2974,"thread_start_us":617764,"threads_started":2}
I20260709 13:11:49.406545 28326 leader_election.cc:290] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:49.402782 28317 leader_election.cc:290] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:49.382468 28353 consensus_queue.cc:1048] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:11:49.460394 25902 raft_consensus.cc:1275] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:11:49.441504 28319 raft_consensus.cc:3060] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:49.520061 25228 raft_consensus.cc:2468] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 8.
W20260709 13:11:49.522469 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 113479us
I20260709 13:11:49.574342 25270 leader_election.cc:304] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:49.524001 25345 leader_election.cc:304] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
W20260709 13:11:49.397944 28362 log.cc:927] Time spent T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.241s	user 0.000s	sys 0.001s
I20260709 13:11:49.397655 28227 raft_consensus.cc:515] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:49.534832 25378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56308 (request call id 458) took 1319 ms. Trace:
W20260709 13:11:49.598861 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 74977.1us
I20260709 13:11:49.598305 25378 rpcz_store.cc:276] 0709 13:11:48.215339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:48.215439 (+   100us) service_pool.cc:224] Handling call
0709 13:11:48.256070 (+ 40631us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:48.256258 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:11:49.194364 (+938106us) log.cc:844] Serialized 14 byte log entry
0709 13:11:49.533671 (+339307us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:49.533735 (+    64us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:49.534547 (+   812us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:49.534640 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:49.534775 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":153862,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":90,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":4784,"thread_start_us":1131617,"threads_started":2}
W20260709 13:11:49.537400 25873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:49.600132 25873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:49.600080 25345 leader_election.cc:304] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
W20260709 13:11:49.600678 25873 leader_election.cc:336] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 1.624s (SENT)
I20260709 13:11:49.501894 28358 raft_consensus.cc:515] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:49.543720 25344 leader_election.cc:304] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:49.544242 25222 raft_consensus.cc:2468] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 6.
I20260709 13:11:49.606758 25345 leader_election.cc:304] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:11:49.547457 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 391798us
W20260709 13:11:49.548127 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:49.557082 25908 raft_consensus.cc:1275] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:11:49.557403 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:11:49.609273 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:49.518988 28299 raft_consensus.cc:493] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:49.610983 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 67344.7us
I20260709 13:11:49.531582 28140 raft_consensus.cc:493] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:49.577033 28378 log.cc:927] Time spent T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:11:49.577651 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:11:49.578562 28280 consensus_meta.cc:287] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 1.614s	user 0.008s	sys 0.007s
I20260709 13:11:49.560575 27976 leader_election.cc:290] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:49.580330 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:49.581100 28352 leader_election.cc:290] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:49.582157 28220 consensus_meta.cc:287] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 1.628s	user 0.016s	sys 0.000s
I20260709 13:11:49.582418 28383 consensus_queue.cc:1059] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:11:49.544130 28364 raft_consensus.cc:2749] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 LEARNER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:49.516284 28039 raft_consensus.cc:515] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:49.584944 28163 consensus_meta.cc:287] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 1.636s	user 0.010s	sys 0.001s
I20260709 13:11:49.585916 28265 consensus_queue.cc:1243] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer 1f539ba21487460085b837e7529a78ce log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 13:11:49.587152 28322 consensus_meta.cc:287] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent flushing consensus metadata: real 0.506s	user 0.007s	sys 0.001s
I20260709 13:11:49.587594 28375 raft_consensus.cc:2804] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:49.587713 28247 consensus_queue.cc:237] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:49.564360 28356 raft_consensus.cc:2749] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:49.590940 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:11:49.592226 25223 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58422 (request call id 1796) took 1336 ms (client timeout 1700 ms). Trace:
I20260709 13:11:49.540968 25230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58418 (request call id 1851) took 1166 ms. Trace:
W20260709 13:11:49.603871 25873 leader_election.cc:336] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 1.775s (SENT)
I20260709 13:11:49.549073 28293 raft_consensus.cc:2804] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:49.614034 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:11:49.617621 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 260113us
W20260709 13:11:49.619282 25195 leader_election.cc:336] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 1.711s (SENT)
W20260709 13:11:49.647042 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 45346.7us
I20260709 13:11:49.683735 25370 raft_consensus.cc:2410] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:11:49.683996 25905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50056 (request call id 618) took 1032 ms. Trace:
I20260709 13:11:49.610496 28301 raft_consensus.cc:2749] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:49.612499 28317 raft_consensus.cc:2749] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:49.723311 25230 rpcz_store.cc:276] 0709 13:11:48.374994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:48.890691 (+515697us) service_pool.cc:224] Handling call
0709 13:11:48.892644 (+  1953us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:48.892870 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:11:49.264743 (+371873us) log.cc:844] Serialized 14 byte log entry
0709 13:11:49.540485 (+275742us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:49.540555 (+    70us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:49.540621 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:49.540722 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:49.540875 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":521896,"prepare.run_cpu_time_us":6427,"prepare.run_wall_time_us":37191,"raft.queue_time_us":128,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":12356,"thread_start_us":577493,"threads_started":2}
I20260709 13:11:49.720781 28375 raft_consensus.cc:493] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:49.605319 28365 raft_consensus.cc:493] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.681311 25900 raft_consensus.cc:2468] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 7.
I20260709 13:11:49.684389 27976 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:49.746455 27976 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:49.697690 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:49.721002 28263 raft_consensus.cc:3055] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:49.760906 28263 raft_consensus.cc:740] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:49.760968 28358 leader_election.cc:290] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:49.761588 28358 raft_consensus.cc:493] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:49.616420 27945 raft_consensus.cc:2804] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:49.762135 27945 raft_consensus.cc:493] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:49.761823 28263 consensus_queue.cc:260] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:49.762082 28358 raft_consensus.cc:515] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:49.711695 25298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57272 (request call id 1682) took 1028 ms. Trace:
I20260709 13:11:49.762979 28263 raft_consensus.cc:3060] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:11:49.763423 28360 log.cc:927] Time spent T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.248s	user 0.001s	sys 0.000s
W20260709 13:11:49.764079 28271 consensus_meta.cc:287] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 1.713s	user 0.010s	sys 0.002s
I20260709 13:11:49.687243 28313 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:49.718668 25906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50060 (request call id 516) took 1611 ms. Trace:
I20260709 13:11:49.676630 28330 raft_consensus.cc:2749] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:49.646339 28280 raft_consensus.cc:515] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:49.765237 25374 raft_consensus.cc:2410] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 13:11:49.765713 28281 consensus_meta.cc:287] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 1.802s	user 0.011s	sys 0.002s
I20260709 13:11:49.766306 25376 raft_consensus.cc:2468] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 7.
I20260709 13:11:49.766666 28280 leader_election.cc:290] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:49.767273 28289 raft_consensus.cc:3060] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:49.768486 25376 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56308 (request call id 467) took 1510 ms (client timeout 1934 ms). Trace:
W20260709 13:11:49.768989 25376 rpcz_store.cc:269] 0709 13:11:48.257724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:48.257881 (+   157us) service_pool.cc:224] Handling call
0709 13:11:49.768320 (+1510439us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b5400311ad4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:49.768437 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2873432960}
I20260709 13:11:49.764809 25906 rpcz_store.cc:276] 0709 13:11:48.088468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:48.135219 (+ 46751us) service_pool.cc:224] Handling call
0709 13:11:48.229515 (+ 94296us) spinlock_profiling.cc:243] Waited 2.69 ms on lock 0x7b58001a3198. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72cb4ab71 00007fd72cb4aa22 00007fd735a63c09 00007fd734bbdee0 00007fd734c870ab 00007fd734c87131 00007fd734c48fc0 00007fd734c33929 00007fd734c333d2 00007fd72e1aabd4
0709 13:11:48.229679 (+   164us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:48.229898 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:11:48.761634 (+531736us) log.cc:844] Serialized 14 byte log entry
0709 13:11:49.438611 (+676977us) log.cc:844] Serialized 14 byte log entry
0709 13:11:49.699285 (+260674us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:49.699343 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:49.699395 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:49.699464 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:49.699584 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5015,"prepare.queue_time_us":662177,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":9712,"raft.queue_time_us":400031,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":5165,"spinlock_wait_cycles":6176640,"thread_start_us":1377060,"threads_started":4,"wal-append.queue_time_us":649129}
I20260709 13:11:49.770045 25224 raft_consensus.cc:2368] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for earlier term 7. Current term is 8.
W20260709 13:11:49.723757 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 119904us
I20260709 13:11:49.770130 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:11:49.770728 25873 leader_election.cc:336] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 1.870s (SENT)
I20260709 13:11:49.770819 25376 raft_consensus.cc:2468] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 11.
W20260709 13:11:49.771099 25224 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58422 (request call id 1791) took 1671 ms (client timeout 2219 ms). Trace:
W20260709 13:11:49.771514 25224 rpcz_store.cc:269] 0709 13:11:48.099340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:48.101390 (+  2050us) service_pool.cc:224] Handling call
0709 13:11:49.770923 (+1669533us) spinlock_profiling.cc:243] Waited 1.67 s on lock 0x7b5400435b54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:49.771043 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3835236608}
I20260709 13:11:49.771970 25376 raft_consensus.cc:1275] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:11:49.772317 25873 leader_election.cc:336] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 2.093s (SENT)
W20260709 13:11:49.773392 25873 leader_election.cc:336] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 2.119s (SENT)
I20260709 13:11:49.725857 25195 leader_election.cc:304] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:11:49.774513 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 155305us
I20260709 13:11:49.726274 25345 leader_election.cc:304] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:11:49.775411 25195 leader_election.cc:336] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 1.994s (SENT)
W20260709 13:11:49.775658 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 49495.6us
I20260709 13:11:49.776337 25345 leader_election.cc:304] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
W20260709 13:11:49.776640 25195 leader_election.cc:336] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 2.124s (SENT)
W20260709 13:11:49.723191 25223 rpcz_store.cc:269] 0709 13:11:48.255763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:48.574866 (+319103us) service_pool.cc:224] Handling call
0709 13:11:49.592068 (+1017202us) spinlock_profiling.cc:243] Waited 413 ms on lock 0x7b54002300d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:49.592167 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":950821760}
I20260709 13:11:49.727824 25907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50060 (request call id 514) took 1639 ms. Trace:
I20260709 13:11:49.777423 25345 leader_election.cc:304] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:49.778692 25873 leader_election.cc:304] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:49.771099 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:49.782927 25371 raft_consensus.cc:2468] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 5.
I20260709 13:11:49.789251 25296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57256 (request call id 1767) took 1104 ms. Trace:
I20260709 13:11:49.789827 25296 rpcz_store.cc:276] 0709 13:11:48.685370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:48.878154 (+192784us) service_pool.cc:224] Handling call
0709 13:11:49.366046 (+487892us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:49.390660 (+ 24614us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:49.788992 (+398332us) spinlock_profiling.cc:243] Waited 475 ms on lock 0x7b54000a5350. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6e8ad 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:49.789174 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1093529984}
I20260709 13:11:49.769657 25377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36264 (request call id 1584) took 1219 ms. Trace:
I20260709 13:11:49.791796 25377 rpcz_store.cc:276] 0709 13:11:48.550537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:48.667029 (+116492us) service_pool.cc:224] Handling call
0709 13:11:49.768443 (+1101414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:49.768727 (+   284us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:11:49.768753 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:49.768789 (+    36us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:49.768820 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:49.768871 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:49.769513 (+   642us) spinlock_profiling.cc:243] Waited 950 ms on lock 0x7b5400311ad0. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6e8ad 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:49.769603 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2184098688}
I20260709 13:11:49.794842 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:49.795678 25899 raft_consensus.cc:3060] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:49.796630 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:49.733413 25902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50058 (request call id 652) took 1632 ms. Trace:
I20260709 13:11:49.616739 28299 raft_consensus.cc:515] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:49.618863 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:49.800312 25378 raft_consensus.cc:2393] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 8: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:49.743532 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:49.743884 28220 raft_consensus.cc:493] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.724653 28293 raft_consensus.cc:493] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:49.812268 25378 raft_consensus.cc:1275] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:11:49.724797 28382 raft_consensus.cc:3055] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:11:49.810835 28314 consensus_meta.cc:287] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 1.856s	user 0.009s	sys 0.003s
I20260709 13:11:49.814013 28382 raft_consensus.cc:740] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:49.814505 28314 raft_consensus.cc:515] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:49.814972 28382 consensus_queue.cc:260] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:49.816061 28382 raft_consensus.cc:3060] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:49.744360 27996 raft_consensus.cc:3055] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:49.817219 28314 leader_election.cc:290] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:11:49.863895 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 138479us
W20260709 13:11:49.750739 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:49.748636 27976 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:49.888348 28399 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.888985 28301 consensus_queue.cc:1048] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:49.748718 28375 raft_consensus.cc:3060] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:49.753997 28283 leader_election.cc:290] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:49.754685 28381 log.cc:927] Time spent T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
W20260709 13:11:49.758576 28306 consensus_meta.cc:287] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.720s	user 0.007s	sys 0.002s
I20260709 13:11:49.891567 28306 raft_consensus.cc:515] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:49.753934 28366 log.cc:927] Time spent T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.387s	user 0.000s	sys 0.001s
I20260709 13:11:49.762676 27945 raft_consensus.cc:3060] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:49.893795 28306 leader_election.cc:290] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:49.760495 28323 consensus_meta.cc:287] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent flushing consensus metadata: real 0.724s	user 0.000s	sys 0.007s
I20260709 13:11:49.894549 28323 raft_consensus.cc:515] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:49.895370 28358 leader_election.cc:290] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:49.763155 25298 rpcz_store.cc:276] 0709 13:11:48.683417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:48.683623 (+   206us) service_pool.cc:224] Handling call
0709 13:11:48.683998 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:48.696856 (+ 12858us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:48.696900 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:48.697492 (+   592us) log.cc:844] Serialized 26 byte log entry
0709 13:11:48.973974 (+276482us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:48.974013 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:48.974073 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:49.711418 (+737345us) raft_consensus.cc:1685] finished
0709 13:11:49.711440 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:49.711628 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12355,"raft.queue_time_us":28659,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"thread_start_us":260264,"threads_started":1,"wal-append.queue_time_us":440838}
I20260709 13:11:49.764798 25305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57272 (request call id 1676) took 1757 ms. Trace:
I20260709 13:11:49.896718 25343 leader_election.cc:304] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:49.818104 28220 raft_consensus.cc:515] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:49.897205 25305 rpcz_store.cc:276] 0709 13:11:48.007867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:48.008134 (+   267us) service_pool.cc:224] Handling call
0709 13:11:48.103605 (+ 95471us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:48.103813 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:48.103851 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:48.104273 (+   422us) log.cc:844] Serialized 26 byte log entry
0709 13:11:49.152794 (+1048521us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:49.152884 (+    90us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:49.152986 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:49.762793 (+609807us) spinlock_profiling.cc:243] Waited 17.3 ms on lock 0x7b4400022b4c. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72caa8c85 00007fd72caa96a2 00007fd72f81b1db 00007fd72f816aaf 00007fd72f80a86e 00007fd72f809bb6 00007fd72f8097d8 00007fd72f813221 00007fd72f8131d9 00007fd72f813169
0709 13:11:49.764514 (+  1721us) raft_consensus.cc:1685] finished
0709 13:11:49.764533 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:49.764737 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39776000,"thread_start_us":996658,"threads_started":1,"wal-append.queue_time_us":1260655}
I20260709 13:11:49.898253 28227 leader_election.cc:290] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:49.774092 25376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36264 (request call id 1598) took 1058 ms. Trace:
I20260709 13:11:49.898737 25376 rpcz_store.cc:276] 0709 13:11:48.715990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:49.771431 (+1055441us) service_pool.cc:224] Handling call
0709 13:11:49.771683 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:49.773853 (+  2170us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:49.774045 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:49.899152 28220 leader_election.cc:290] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:11:49.724550 28369 log.cc:927] Time spent T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.439s	user 0.000s	sys 0.001s
W20260709 13:11:49.899811 28315 consensus_meta.cc:287] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 0.777s	user 0.006s	sys 0.004s
I20260709 13:11:49.900316 28315 raft_consensus.cc:515] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:49.900822 28299 leader_election.cc:290] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:49.726536 25905 rpcz_store.cc:276] 0709 13:11:48.651721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:48.651895 (+   174us) service_pool.cc:224] Handling call
0709 13:11:48.696058 (+ 44163us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:48.908775 (+212717us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:48.908813 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:48.909348 (+   535us) log.cc:844] Serialized 26 byte log entry
0709 13:11:49.272265 (+362917us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:49.272301 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:49.272383 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:49.683770 (+411387us) raft_consensus.cc:1685] finished
0709 13:11:49.683788 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:49.683934 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":362617,"threads_started":1,"wal-append.queue_time_us":508826}
I20260709 13:11:49.901039 28317 raft_consensus.cc:2804] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:49.896714 28323 leader_election.cc:290] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 9 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:49.901594 28317 raft_consensus.cc:493] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:49.902060 28317 raft_consensus.cc:3060] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:49.902696 28315 leader_election.cc:290] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:49.902855 28039 leader_election.cc:290] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:49.803495 25345 leader_election.cc:304] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
W20260709 13:11:49.904407 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 101015us
I20260709 13:11:49.804734 25370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36264 (request call id 1605) took 1087 ms. Trace:
W20260709 13:11:49.907603 25271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:49.905542 25345 leader_election.cc:304] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:49.798225 25902 rpcz_store.cc:276] 0709 13:11:48.101030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:48.137271 (+ 36241us) service_pool.cc:224] Handling call
0709 13:11:48.138426 (+  1155us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:49.569007 (+1430581us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:49.733105 (+164098us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b5400490cd4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:49.733321 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2943908352}
W20260709 13:11:49.809819 25195 leader_election.cc:336] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 2.115s (SENT)
I20260709 13:11:49.913728 25223 raft_consensus.cc:1275] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:11:49.914062 25195 leader_election.cc:304] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:49.818774 28271 raft_consensus.cc:2749] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:49.724647 28265 raft_consensus.cc:2749] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:49.700119 25373 raft_consensus.cc:2410] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:11:49.762079 28370 raft_consensus.cc:493] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:49.810443 28281 raft_consensus.cc:2749] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:49.712467 28379 raft_consensus.cc:2804] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:49.937196 25345 leader_election.cc:304] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:49.800987 28280 raft_consensus.cc:2749] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:49.778251 25907 rpcz_store.cc:276] 0709 13:11:48.087933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:48.088033 (+   100us) service_pool.cc:224] Handling call
0709 13:11:48.138411 (+ 50378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:48.151241 (+ 12830us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:48.151271 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:48.151644 (+   373us) log.cc:844] Serialized 26 byte log entry
0709 13:11:49.134160 (+982516us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:49.134218 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:49.134311 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:49.727622 (+593311us) raft_consensus.cc:1685] finished
0709 13:11:49.727641 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:49.727770 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6085,"raft.queue_time_us":132,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":10597,"spinlock_wait_cycles":1890432,"thread_start_us":930578,"threads_started":1,"wal-append.queue_time_us":884006}
I20260709 13:11:49.853983 25371 raft_consensus.cc:1275] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:11:49.948104 25373 raft_consensus.cc:1275] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:11:49.948622 25373 pending_rounds.cc:85] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468: Aborting all ops after (but not including) 3
I20260709 13:11:49.948472 25371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36254 (request call id 1882) took 1067 ms. Trace:
I20260709 13:11:49.949050 25373 pending_rounds.cc:107] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:11:49.850876 25374 raft_consensus.cc:1275] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:11:49.949510 25373 raft_consensus.cc:2889] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:11:49.858582 28308 consensus_meta.cc:287] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 1.886s	user 0.013s	sys 0.002s
I20260709 13:11:49.895402 28330 raft_consensus.cc:493] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:49.917630 28039 raft_consensus.cc:493] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:49.812485 28344 log.cc:927] Time spent T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 1.037s	user 0.004s	sys 0.001s
I20260709 13:11:49.721144 28322 raft_consensus.cc:515] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:49.723241 28391 raft_consensus.cc:2749] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:49.753777 28365 raft_consensus.cc:515] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:49.853446 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 71174.5us
I20260709 13:11:49.976162 25873 leader_election.cc:304] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:49.977504 25873 leader_election.cc:304] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:49.854225 25379 raft_consensus.cc:2410] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
W20260709 13:11:49.853727 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 59312us
I20260709 13:11:49.981680 25874 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:49.845450 25378 raft_consensus.cc:1240] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:49.985041 25378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36254 (request call id 1892) took 1022 ms. Trace:
I20260709 13:11:49.985461 25378 rpcz_store.cc:276] 0709 13:11:48.962736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:49.843896 (+881160us) service_pool.cc:224] Handling call
0709 13:11:49.844303 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:49.984714 (+140411us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:49.984975 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:49.886322 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 312059us
I20260709 13:11:49.987412 25270 leader_election.cc:304] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:49.817454 27996 raft_consensus.cc:740] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:49.889091 25194 leader_election.cc:304] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:50.021000 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:49.888926 28399 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:49.894043 25904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50056 (request call id 613) took 1243 ms. Trace:
I20260709 13:11:49.616159 28140 raft_consensus.cc:3060] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:11:49.896894 28347 log.cc:927] Time spent T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 1.154s	user 0.004s	sys 0.000s
W20260709 13:11:49.741343 28133 consensus_meta.cc:287] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 1.787s	user 0.008s	sys 0.004s
I20260709 13:11:49.818918 28293 raft_consensus.cc:3060] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:49.917548 25226 raft_consensus.cc:1275] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:11:50.023262 25904 rpcz_store.cc:276] 0709 13:11:48.650295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:48.650428 (+   133us) service_pool.cc:224] Handling call
0709 13:11:48.650738 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:48.651052 (+   314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:48.651076 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:48.674958 (+ 23882us) log.cc:844] Serialized 26 byte log entry
0709 13:11:49.035804 (+360846us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:49.035842 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:49.035911 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:49.893814 (+857903us) raft_consensus.cc:1685] finished
0709 13:11:49.893836 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:49.893986 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7307,"raft.queue_time_us":190264,"raft.run_cpu_time_us":4567,"raft.run_wall_time_us":42036,"thread_start_us":322462,"threads_started":1,"wal-append.queue_time_us":530312}
I20260709 13:11:50.007239 28394 raft_consensus.cc:2749] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:49.918476 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:49.911630 25370 rpcz_store.cc:276] 0709 13:11:48.717691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:48.801945 (+ 84254us) service_pool.cc:224] Handling call
0709 13:11:49.779815 (+977870us) spinlock_profiling.cc:243] Waited 840 ms on lock 0x7b5400307354. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:49.804671 (+ 24856us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1931898112}
I20260709 13:11:49.919034 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:11:49.871114 28295 consensus_meta.cc:287] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 1.916s	user 0.015s	sys 0.003s
W20260709 13:11:49.919976 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 110215us
I20260709 13:11:49.922377 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:50.044209 25297 raft_consensus.cc:2393] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 5: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:49.843811 28285 raft_consensus.cc:2749] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:49.923271 25343 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:50.046917 25902 raft_consensus.cc:2393] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 8: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:11:50.047032 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
W20260709 13:11:50.047232 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 124052us
I20260709 13:11:49.925575 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:49.905490 28301 raft_consensus.cc:2749] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:49.934682 25225 raft_consensus.cc:1275] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:49.934983 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:50.060025 25296 raft_consensus.cc:2468] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 8.
I20260709 13:11:49.949147 25371 rpcz_store.cc:276] 0709 13:11:48.881288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:49.805292 (+924004us) service_pool.cc:224] Handling call
0709 13:11:49.853615 (+ 48323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:49.948092 (+ 94477us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:49.948379 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:49.946267 25376 raft_consensus.cc:1275] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
W20260709 13:11:49.932463 28297 consensus_meta.cc:287] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent flushing consensus metadata: real 0.875s	user 0.010s	sys 0.000s
I20260709 13:11:49.851819 25375 raft_consensus.cc:1240] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:49.774348 28163 raft_consensus.cc:493] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.954545 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:49.925468 28147 raft_consensus.cc:493] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.929443 28227 raft_consensus.cc:2749] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:49.929701 28299 consensus_queue.cc:1048] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:11:49.942135 28379 raft_consensus.cc:493] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:49.874269 28319 raft_consensus.cc:515] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:49.969997 28265 raft_consensus.cc:493] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.956452 28281 raft_consensus.cc:2749] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:50.002085 28323 raft_consensus.cc:2749] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:50.011332 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:50.105234 25305 raft_consensus.cc:3060] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:11:49.989737 25270 leader_election.cc:304] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
W20260709 13:11:50.107115 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 117460us
I20260709 13:11:50.108667 25270 leader_election.cc:304] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:50.024840 28401 raft_consensus.cc:493] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:50.024936 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 135927us
I20260709 13:11:50.004482 28396 raft_consensus.cc:2749] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:50.004696 28298 raft_consensus.cc:2804] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:50.004400 28405 raft_consensus.cc:3060] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:50.011690 28404 consensus_queue.cc:1059] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.088s
I20260709 13:11:50.025656 28388 raft_consensus.cc:2804] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:49.918339 25230 raft_consensus.cc:1240] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:11:50.033614 25271 leader_election.cc:400] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361) with higher term. Message: Invalid argument: T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for earlier term 7. Current term is 8.
I20260709 13:11:50.144336 25271 leader_election.cc:403] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:11:50.145221 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 118495us
I20260709 13:11:50.034480 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:49.970178 28308 raft_consensus.cc:515] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:50.036043 27996 consensus_queue.cc:260] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:50.037951 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 94442.9us
I20260709 13:11:49.974056 28039 raft_consensus.cc:515] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:50.050114 25372 raft_consensus.cc:2410] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:11:50.047719 25904 raft_consensus.cc:3060] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:50.050863 25226 raft_consensus.cc:1240] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:50.008025 28358 consensus_queue.cc:1048] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:11:50.163493 28323 raft_consensus.cc:493] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.056434 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:50.163980 28323 raft_consensus.cc:515] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:50.165475 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:50.166273 25297 raft_consensus.cc:2393] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 6: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
W20260709 13:11:50.032593 28270 consensus_meta.cc:287] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.866s	user 0.007s	sys 0.004s
I20260709 13:11:50.169781 28270 raft_consensus.cc:515] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:50.172168 28270 leader_election.cc:290] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:50.172911 28373 raft_consensus.cc:493] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.145268 28301 raft_consensus.cc:2804] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:50.058341 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:50.059278 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:11:50.076685 25114 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d56909a48cf841eb99365741e9e29e93 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 79d99c0e498349bda74127365219e468 (127.23.140.67:34091) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 79d99c0e498349bda74127365219e468 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:11:50.042830 28263 raft_consensus.cc:493] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.081679 25899 raft_consensus.cc:2468] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 4.
I20260709 13:11:49.950824 28271 consensus_queue.cc:1048] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.100s
I20260709 13:11:50.087402 25377 raft_consensus.cc:1275] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 13:11:50.196357 25377 pending_rounds.cc:85] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468: Aborting all ops after (but not including) 5
I20260709 13:11:50.196647 25377 pending_rounds.cc:107] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 13:11:50.196910 25377 raft_consensus.cc:2889] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:49.973824 28330 raft_consensus.cc:515] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:50.099720 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:50.202167 25299 raft_consensus.cc:2393] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 7: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:50.202517 25221 raft_consensus.cc:3060] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:50.103587 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:50.111931 25194 leader_election.cc:304] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:11:50.203428 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:11:50.204031 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 92236.4us
I20260709 13:11:50.205017 28248 raft_consensus.cc:2804] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:50.099062 28147 raft_consensus.cc:515] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:50.205351 25305 raft_consensus.cc:2468] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 8.
I20260709 13:11:49.941963 28370 raft_consensus.cc:515] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:50.205554 28248 raft_consensus.cc:493] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:50.206122 28248 raft_consensus.cc:3060] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:50.146546 25271 leader_election.cc:304] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:11:50.207631 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 61181.5us
I20260709 13:11:50.208690 28358 raft_consensus.cc:2804] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:50.209189 28358 raft_consensus.cc:493] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:50.146597 25270 leader_election.cc:304] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
W20260709 13:11:50.147380 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.155972 28293 raft_consensus.cc:515] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:50.105123 28347 log.cc:927] Time spent T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:11:50.038349 28133 raft_consensus.cc:515] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:50.210798 28270 consensus_queue.cc:1048] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:50.212375 28133 leader_election.cc:290] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:50.212415 28270 consensus_queue.cc:1048] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:50.213065 28133 raft_consensus.cc:2804] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:11:50.168085 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.213922 25301 raft_consensus.cc:1240] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:50.214329 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:50.169256 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:50.215061 25297 raft_consensus.cc:3060] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:50.215118 25305 raft_consensus.cc:2393] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 7: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:50.174372 28409 raft_consensus.cc:2749] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:50.088624 28315 consensus_queue.cc:1048] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.072s
I20260709 13:11:50.221616 25904 raft_consensus.cc:2468] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 8.
I20260709 13:11:50.102461 28163 raft_consensus.cc:515] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:50.101727 28379 raft_consensus.cc:3060] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:50.058185 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:50.103044 28180 consensus_queue.cc:1048] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
W20260709 13:11:50.180464 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 93149.5us
I20260709 13:11:50.143711 28401 raft_consensus.cc:515] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:50.182752 25114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 157035us
W20260709 13:11:50.185411 25873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.118818 28298 raft_consensus.cc:493] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:50.095592 28297 raft_consensus.cc:515] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:50.110848 28391 raft_consensus.cc:2749] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:50.119752 25375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36264 (request call id 1588) took 1465 ms. Trace:
I20260709 13:11:50.209651 28358 raft_consensus.cc:3060] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:50.213488 28133 raft_consensus.cc:493] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
W20260709 13:11:50.176363 28262 consensus_meta.cc:287] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.622s	user 0.007s	sys 0.002s
I20260709 13:11:50.162134 28388 raft_consensus.cc:697] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 8 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
W20260709 13:11:50.196341 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 148264us
I20260709 13:11:50.361357 25298 raft_consensus.cc:3060] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:50.174857 28323 leader_election.cc:290] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:50.239840 25345 leader_election.cc:304] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:50.225433 25372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36264 (request call id 1607) took 1374 ms. Trace:
I20260709 13:11:50.201979 28263 raft_consensus.cc:515] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:50.168491 28159 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.124949 28265 raft_consensus.cc:515] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:50.258733 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:50.198297 27996 raft_consensus.cc:3060] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:50.263741 25195 leader_election.cc:304] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
W20260709 13:11:50.379981 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 116349us
I20260709 13:11:50.380885 25195 leader_election.cc:304] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:50.118963 28280 raft_consensus.cc:493] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.257818 25229 raft_consensus.cc:2468] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 6.
I20260709 13:11:50.387884 25377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36264 (request call id 1614) took 1285 ms. Trace:
I20260709 13:11:50.388275 25377 rpcz_store.cc:276] 0709 13:11:49.102785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:49.876896 (+774111us) service_pool.cc:224] Handling call
0709 13:11:50.062094 (+185198us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:50.218175 (+156081us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:50.387685 (+169510us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b540037bed0. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6e8ad 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:50.387827 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":318812416}
I20260709 13:11:50.358567 28327 raft_consensus.cc:493] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.282545 25375 rpcz_store.cc:276] 0709 13:11:48.654730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:48.655705 (+   975us) service_pool.cc:224] Handling call
0709 13:11:48.656078 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:50.086230 (+1430152us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:50.119532 (+ 33302us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54004411d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:50.119697 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2674012544}
I20260709 13:11:50.218036 28282 raft_consensus.cc:3055] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:11:50.304003 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.344449 25221 raft_consensus.cc:2468] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 9.
I20260709 13:11:50.237831 28356 raft_consensus.cc:493] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:50.173537 28373 raft_consensus.cc:515] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:50.362480 25901 raft_consensus.cc:2368] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 6. Current term is 7.
I20260709 13:11:50.366427 25372 rpcz_store.cc:276] 0709 13:11:48.853014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:49.154512 (+301498us) service_pool.cc:224] Handling call
0709 13:11:50.225198 (+1070686us) spinlock_profiling.cc:243] Waited 856 ms on lock 0x7b54000e4cd4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:50.225360 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1968994048}
I20260709 13:11:50.255314 25297 raft_consensus.cc:2410] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:11:50.366791 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 127035us
I20260709 13:11:50.282135 28298 raft_consensus.cc:3060] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:50.257007 28404 consensus_queue.cc:1048] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.112s
I20260709 13:11:50.448488 28180 raft_consensus.cc:493] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:50.450613 28180 raft_consensus.cc:515] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:50.450909 28356 raft_consensus.cc:515] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:11:50.453284 28356 leader_election.cc:290] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:50.449201 28413 log.cc:927] Time spent T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:11:50.454087 28386 raft_consensus.cc:2749] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:50.454905 28180 leader_election.cc:290] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:50.457020 28039 leader_election.cc:290] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:50.360298 28133 raft_consensus.cc:3060] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:50.248458 28285 consensus_queue.cc:1048] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:11:50.376199 25296 raft_consensus.cc:2468] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 8.
I20260709 13:11:50.219362 28306 raft_consensus.cc:2749] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361) with higher term. Message: Invalid argument: T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for earlier term 7. Current term is 8.
W20260709 13:11:50.397444 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.401818 28282 raft_consensus.cc:740] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
W20260709 13:11:50.448498 28406 log.cc:927] Time spent T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.365s	user 0.001s	sys 0.000s
I20260709 13:11:50.303833 27945 raft_consensus.cc:515] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:50.494527 28282 consensus_queue.cc:260] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:50.496181 28379 raft_consensus.cc:515] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:50.496604 27945 leader_election.cc:290] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:50.427196 25195 leader_election.cc:304] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:50.498349 28180 raft_consensus.cc:2804] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:50.498883 28180 raft_consensus.cc:493] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:50.499068 28248 raft_consensus.cc:515] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:11:50.499435 28180 raft_consensus.cc:3060] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:50.500061 28375 consensus_meta.cc:287] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.609s	user 0.007s	sys 0.000s
I20260709 13:11:50.500481 28375 raft_consensus.cc:515] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:50.361018 28262 raft_consensus.cc:515] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:50.502468 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 75395.8us
I20260709 13:11:50.395212 27976 raft_consensus.cc:2804] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:50.377164 28323 raft_consensus.cc:493] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:50.485781 28319 leader_election.cc:290] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:50.488407 28289 consensus_meta.cc:287] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent flushing consensus metadata: real 0.721s	user 0.009s	sys 0.000s
I20260709 13:11:50.519272 28293 leader_election.cc:290] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:50.512804 27976 raft_consensus.cc:493] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:50.520045 27976 raft_consensus.cc:3060] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:50.504436 28408 log.cc:927] Time spent T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.450s	user 0.000s	sys 0.001s
I20260709 13:11:50.463356 28365 leader_election.cc:290] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:50.506593 25298 raft_consensus.cc:2468] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 8.
I20260709 13:11:50.506974 25297 raft_consensus.cc:1240] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:50.396554 28394 raft_consensus.cc:2804] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:50.563185 28394 raft_consensus.cc:697] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 7 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:50.564090 28394 consensus_queue.cc:237] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:50.389999 28419 raft_consensus.cc:2749] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:50.384707 28159 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:50.489683 28263 leader_election.cc:290] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:50.566926 28379 leader_election.cc:290] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:50.568488 28373 leader_election.cc:290] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:50.570447 28375 leader_election.cc:290] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:50.571087 28370 leader_election.cc:290] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:50.407353 28327 raft_consensus.cc:515] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:50.575474 28385 raft_consensus.cc:493] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:50.576042 28385 raft_consensus.cc:515] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:50.578711 28265 leader_election.cc:290] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:50.579800 28401 leader_election.cc:290] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:50.582235 28322 leader_election.cc:290] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:50.586125 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 73802.5us
I20260709 13:11:50.535358 25305 raft_consensus.cc:1240] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:50.589046 25297 raft_consensus.cc:1240] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:50.479277 25345 leader_election.cc:304] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:50.524255 28323 raft_consensus.cc:515] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:50.550016 28388 consensus_queue.cc:237] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:50.550669 28308 leader_election.cc:290] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:50.551982 28262 leader_election.cc:290] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:50.558584 28330 leader_election.cc:290] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:50.501610 28248 leader_election.cc:290] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:50.402680 28280 raft_consensus.cc:515] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:50.591821 25297 raft_consensus.cc:1240] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 13:11:50.599550 25297 raft_consensus.cc:1240] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:50.601011 25195 leader_election.cc:304] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:11:50.596247 25302 raft_consensus.cc:1275] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:11:50.606315 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 459936us
W20260709 13:11:50.608147 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 398903us
W20260709 13:11:50.593072 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 113866us
I20260709 13:11:50.612535 25195 leader_election.cc:304] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:11:50.613945 25345 leader_election.cc:400] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361) with higher term. Message: Invalid argument: T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 7. Current term is 8.
I20260709 13:11:50.616732 25345 leader_election.cc:403] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:50.616930 25270 leader_election.cc:304] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:50.622455 28313 raft_consensus.cc:2804] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:50.623641 28248 raft_consensus.cc:2804] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:50.624241 28248 raft_consensus.cc:697] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 8 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:50.593824 28247 raft_consensus.cc:493] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.595531 28415 raft_consensus.cc:2804] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:50.598107 28327 leader_election.cc:290] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:50.679725 25873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.611212 28319 raft_consensus.cc:493] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:50.635416 28385 leader_election.cc:290] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:50.636201 28415 raft_consensus.cc:493] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
W20260709 13:11:50.688297 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 71485us
I20260709 13:11:50.687341 25343 leader_election.cc:304] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:50.692400 25345 leader_election.cc:304] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:50.638664 28401 consensus_queue.cc:1048] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
W20260709 13:11:50.694706 28140 consensus_meta.cc:287] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.656s	user 0.011s	sys 0.000s
W20260709 13:11:50.780462 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.728654 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:50.720983 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:50.737133 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:50.824862 25223 raft_consensus.cc:3060] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:50.824494 25221 raft_consensus.cc:3060] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:11:50.826960 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.825532 25224 raft_consensus.cc:3060] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:50.828052 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 135596us
I20260709 13:11:50.831014 25345 leader_election.cc:304] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
W20260709 13:11:50.825043 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 137801us
I20260709 13:11:50.835978 25221 raft_consensus.cc:2468] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 8.
I20260709 13:11:50.645421 28301 raft_consensus.cc:697] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 5 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:50.840905 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:50.841682 25228 raft_consensus.cc:3060] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:50.635193 28262 consensus_queue.cc:1059] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:11:50.625478 28248 consensus_queue.cc:237] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:50.928830 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 84275.5us
I20260709 13:11:50.928920 25223 raft_consensus.cc:2468] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 7.
I20260709 13:11:50.931180 25270 leader_election.cc:304] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
W20260709 13:11:50.941318 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 328864us
I20260709 13:11:50.964521 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:50.965370 25223 raft_consensus.cc:1275] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:11:50.965721 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:50.653627 28399 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:50.679394 28314 raft_consensus.cc:3060] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:11:50.683069 28308 raft_consensus.cc:2804] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:50.642311 28247 raft_consensus.cc:515] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:50.966352 25221 raft_consensus.cc:2468] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 7.
I20260709 13:11:50.823258 28140 raft_consensus.cc:515] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:11:50.720037 28385 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.846517 28330 raft_consensus.cc:2804] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:50.842516 28427 raft_consensus.cc:2749] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:50.846567 28299 raft_consensus.cc:2804] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:50.927683 28415 raft_consensus.cc:3060] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:51.000977 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:51.002921 25228 raft_consensus.cc:2468] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 7.
W20260709 13:11:51.006235 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 322421us
I20260709 13:11:51.011397 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:51.028028 25221 raft_consensus.cc:2393] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 7: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:50.694687 28319 raft_consensus.cc:515] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:51.012084 28330 raft_consensus.cc:493] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:51.031047 28330 raft_consensus.cc:3060] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:50.995934 28317 consensus_meta.cc:287] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 1.093s	user 0.011s	sys 0.001s
I20260709 13:11:51.041355 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:50.978750 28313 raft_consensus.cc:697] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 4 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:51.046334 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:51.061962 25227 raft_consensus.cc:2393] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 8: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:50.970834 28419 raft_consensus.cc:493] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:50.968721 28285 consensus_queue.cc:1059] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 13:11:51.048146 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
W20260709 13:11:51.056125 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 427915us
I20260709 13:11:50.980443 28308 raft_consensus.cc:493] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:51.066604 25230 raft_consensus.cc:3060] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:51.067940 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:51.068202 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:51.072314 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:51.060602 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:51.076783 25302 raft_consensus.cc:2393] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 8: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
W20260709 13:11:51.046814 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 115709us
I20260709 13:11:51.076463 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:51.078538 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:51.078917 25373 raft_consensus.cc:2468] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 5.
I20260709 13:11:51.079658 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:51.080232 25378 raft_consensus.cc:3060] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:11:51.078830 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:51.044011 25224 raft_consensus.cc:2468] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 6.
I20260709 13:11:51.080155 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:51.082798 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
W20260709 13:11:51.052898 27976 consensus_meta.cc:287] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 0.532s	user 0.009s	sys 0.001s
I20260709 13:11:51.083757 25195 leader_election.cc:304] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:50.981055 27945 consensus_queue.cc:1059] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.078s
I20260709 13:11:51.092154 25378 raft_consensus.cc:2468] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 9.
I20260709 13:11:51.020088 28299 raft_consensus.cc:493] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:51.085162 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:51.086045 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:51.086535 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:51.081197 25374 raft_consensus.cc:2468] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 6.
W20260709 13:11:51.090992 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 124959us
I20260709 13:11:51.085002 25194 leader_election.cc:304] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:51.089174 25270 leader_election.cc:304] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:51.094548 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:51.099102 25302 raft_consensus.cc:2393] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 8: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:51.099587 25376 raft_consensus.cc:3060] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:51.096149 25370 raft_consensus.cc:2376] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 8. Re-sending same reply.
I20260709 13:11:51.100369 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:51.110837 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:51.113366 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:51.109923 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:51.114202 25378 raft_consensus.cc:2376] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 9. Re-sending same reply.
I20260709 13:11:51.063746 28262 raft_consensus.cc:3060] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:51.114375 25377 raft_consensus.cc:2468] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 5.
W20260709 13:11:51.117322 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 361676us
I20260709 13:11:51.010476 28385 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:51.140594 25271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.045670 28281 consensus_queue.cc:1048] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:11:51.115901 25372 raft_consensus.cc:1275] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:11:51.092868 28265 raft_consensus.cc:3055] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:51.085929 28308 raft_consensus.cc:3060] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:51.101027 27976 raft_consensus.cc:515] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:51.116333 28358 consensus_meta.cc:287] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.752s	user 0.007s	sys 0.003s
W20260709 13:11:51.101220 28405 consensus_meta.cc:287] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.933s	user 0.011s	sys 0.000s
I20260709 13:11:51.167848 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:51.168788 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:51.170084 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:51.170497 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:51.141240 28323 leader_election.cc:290] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:51.170909 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:51.177194 25375 raft_consensus.cc:1275] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:11:51.058720 28317 raft_consensus.cc:515] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:51.102160 28271 raft_consensus.cc:3055] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:11:51.111573 28412 log.cc:927] Time spent T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.572s	user 0.001s	sys 0.000s
I20260709 13:11:51.155562 28265 raft_consensus.cc:740] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:51.102963 28299 raft_consensus.cc:3060] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:51.184455 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:51.219550 25302 raft_consensus.cc:2410] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:11:51.193890 25374 raft_consensus.cc:2393] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 4: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:51.170514 27945 raft_consensus.cc:493] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:51.193360 28423 log.cc:927] Time spent T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.500s	user 0.000s	sys 0.000s
I20260709 13:11:51.192953 28313 consensus_queue.cc:237] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:51.196925 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:51.176430 28434 raft_consensus.cc:493] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
W20260709 13:11:51.197247 28433 log.cc:927] Time spent T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 13:11:51.148164 28379 raft_consensus.cc:2804] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:51.093607 28419 raft_consensus.cc:515] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:51.308434 28419 leader_election.cc:290] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:51.152401 28430 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:51.156255 25873 leader_election.cc:304] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:51.148136 28401 consensus_queue.cc:1048] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 13:11:51.222275 25371 raft_consensus.cc:1240] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:51.222754 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:51.224852 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:11:51.231767 25343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:51.317706 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 161544us
W20260709 13:11:51.318528 25873 leader_election.cc:336] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 1.608s (SENT)
W20260709 13:11:51.251695 28180 consensus_meta.cc:287] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 0.752s	user 0.010s	sys 0.003s
I20260709 13:11:51.239059 25377 raft_consensus.cc:2468] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 8.
I20260709 13:11:51.243327 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:51.195560 28358 raft_consensus.cc:515] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:51.249912 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:51.205238 28271 raft_consensus.cc:740] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
W20260709 13:11:51.258324 28420 log.cc:927] Time spent T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.369s	user 0.001s	sys 0.001s
I20260709 13:11:51.258790 28426 raft_consensus.cc:493] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:51.287580 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 202627us
I20260709 13:11:51.343902 25194 leader_election.cc:304] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:11:51.288620 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 204983us
W20260709 13:11:51.293385 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:51.197407 28425 log.cc:927] Time spent T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.508s	user 0.000s	sys 0.001s
W20260709 13:11:51.303786 28436 log.cc:927] Time spent T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:11:51.298622 28379 raft_consensus.cc:493] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:51.201146 25230 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 8.
I20260709 13:11:51.202199 28405 raft_consensus.cc:2749] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:51.319727 25297 raft_consensus.cc:2468] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 6.
I20260709 13:11:51.324188 25379 raft_consensus.cc:2393] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 9: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:11:51.334499 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:51.360105 25222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54000 (request call id 480) took 1293 ms. Trace:
I20260709 13:11:51.337311 28323 raft_consensus.cc:2804] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:51.337515 28271 consensus_queue.cc:260] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:51.339355 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:51.340166 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:11:51.346276 25873 leader_election.cc:336] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 1.623s (SENT)
I20260709 13:11:51.236706 27945 raft_consensus.cc:515] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:51.183665 28301 consensus_queue.cc:237] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:51.361073 25302 raft_consensus.cc:1240] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:11:51.362191 25297 raft_consensus.cc:1240] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:51.360517 25222 rpcz_store.cc:276] 0709 13:11:50.067310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:50.068477 (+  1167us) service_pool.cc:224] Handling call
0709 13:11:50.068864 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:50.084099 (+ 15235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:50.084143 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:50.097980 (+ 13837us) log.cc:844] Serialized 26 byte log entry
0709 13:11:50.396805 (+298825us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:50.396847 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:50.396924 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:51.359902 (+962978us) raft_consensus.cc:1685] finished
0709 13:11:51.359923 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:51.360048 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18906,"raft.queue_time_us":16229,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":14607,"thread_start_us":298496,"threads_started":1,"wal-append.queue_time_us":545695}
W20260709 13:11:51.362702 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 222156us
W20260709 13:11:51.352084 28431 log.cc:927] Time spent T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.332s	user 0.001s	sys 0.000s
I20260709 13:11:51.361435 28379 raft_consensus.cc:3060] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:51.345134 28319 leader_election.cc:290] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:11:51.369731 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.344800 28140 leader_election.cc:290] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361)
I20260709 13:11:51.370955 25873 leader_election.cc:304] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:51.298979 28434 raft_consensus.cc:515] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:51.332441 28430 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:51.355492 28247 leader_election.cc:290] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:51.366259 25377 raft_consensus.cc:2468] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 6.
I20260709 13:11:51.336215 28180 raft_consensus.cc:515] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:51.362886 28323 raft_consensus.cc:493] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:51.363279 28437 raft_consensus.cc:2804] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:51.407445 25378 raft_consensus.cc:2468] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 9.
I20260709 13:11:51.380198 25302 raft_consensus.cc:1275] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:11:51.411324 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:51.436733 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:51.376860 28271 raft_consensus.cc:3060] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:51.400779 28439 raft_consensus.cc:2749] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:51.342590 28265 consensus_queue.cc:260] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:51.364063 28426 raft_consensus.cc:515] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:51.441664 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:51.417340 28319 raft_consensus.cc:2804] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:51.417797 28441 raft_consensus.cc:493] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:51.418406 28442 raft_consensus.cc:2804] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:51.421056 28447 raft_consensus.cc:493] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:51.437534 28323 raft_consensus.cc:3060] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:51.403106 28375 consensus_queue.cc:1048] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:11:51.437244 28437 raft_consensus.cc:493] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:51.420248 28140 consensus_queue.cc:1048] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:11:51.464098 25376 raft_consensus.cc:2468] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 7.
I20260709 13:11:51.423698 28401 consensus_queue.cc:1048] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.055s
W20260709 13:11:51.484680 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 137895us
I20260709 13:11:51.449076 28453 raft_consensus.cc:493] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:51.488931 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:51.465878 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:51.456508 27976 leader_election.cc:290] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:51.489038 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:51.449863 28399 consensus_queue.cc:1048] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:11:51.462564 28385 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:51.480806 28265 raft_consensus.cc:3060] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:51.473150 28319 raft_consensus.cc:697] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:51.473690 28442 raft_consensus.cc:493] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:51.502605 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:11:51.504107 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 141308us
I20260709 13:11:51.485992 28437 raft_consensus.cc:3060] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:51.508286 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 101721us
I20260709 13:11:51.486200 28454 raft_consensus.cc:493] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
W20260709 13:11:51.514447 25872 connection.cc:256] RPC call timeout handler was delayed by -1.1109885479999093s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1515s for a response
W20260709 13:11:51.525915 25872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.473376 28441 raft_consensus.cc:515] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:51.520289 25194 leader_election.cc:304] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:51.520591 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:51.519208 25900 raft_consensus.cc:2393] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 5: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:51.524926 28385 raft_consensus.cc:493] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:51.522837 28442 raft_consensus.cc:3060] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:51.534478 28434 leader_election.cc:290] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:51.536967 28426 leader_election.cc:290] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:51.509421 28317 leader_election.cc:290] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:51.537545 28298 consensus_meta.cc:287] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent flushing consensus metadata: real 1.026s	user 0.003s	sys 0.009s
I20260709 13:11:51.538084 28375 raft_consensus.cc:493] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:51.507730 27976 consensus_queue.cc:1048] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:11:51.535562 28262 raft_consensus.cc:2749] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:51.542008 28358 leader_election.cc:290] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:51.543957 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
W20260709 13:11:51.545136 27996 consensus_meta.cc:287] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent flushing consensus metadata: real 1.156s	user 0.008s	sys 0.004s
I20260709 13:11:51.558758 25907 raft_consensus.cc:1240] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:51.566461 28430 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:51.482897 28447 raft_consensus.cc:515] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:51.568964 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:51.494423 28415 raft_consensus.cc:515] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:51.569514 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:51.569034 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:51.580688 25906 raft_consensus.cc:2393] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 8: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:11:51.580734 28460 raft_consensus.cc:1064] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce: attempting to promote NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 to VOTER
I20260709 13:11:51.582144 28439 raft_consensus.cc:2804] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:11:51.582480 28449 log.cc:927] Time spent T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:11:51.582787 28439 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:51.555961 28419 raft_consensus.cc:493] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:51.583395 28439 raft_consensus.cc:3060] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:51.583688 28419 raft_consensus.cc:515] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:51.523865 28450 consensus_queue.cc:1048] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:11:51.500404 28453 raft_consensus.cc:515] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:51.544763 28330 consensus_meta.cc:287] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.513s	user 0.005s	sys 0.007s
I20260709 13:11:51.573076 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:11:51.574088 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 79713.3us
W20260709 13:11:51.563763 28438 log.cc:927] Time spent T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
W20260709 13:11:51.577035 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 56852.4us
I20260709 13:11:51.568143 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:51.575212 25270 leader_election.cc:304] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:11:51.578015 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:51.578480 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:51.597795 25899 raft_consensus.cc:2468] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 6.
I20260709 13:11:51.570853 25904 raft_consensus.cc:1275] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:51.596989 25905 raft_consensus.cc:2410] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:11:51.579896 25908 raft_consensus.cc:3060] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:51.599311 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:51.600057 25902 raft_consensus.cc:2393] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 7: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:11:51.602892 28358 raft_consensus.cc:2804] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:51.603506 28358 raft_consensus.cc:493] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:51.603837 28401 consensus_queue.cc:1048] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:51.605294 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:51.606535 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:51.606906 25377 raft_consensus.cc:2468] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 7.
I20260709 13:11:51.604056 28358 raft_consensus.cc:3060] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:51.607376 25376 raft_consensus.cc:2410] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:11:51.601401 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:51.608769 25907 raft_consensus.cc:3060] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:11:51.595499 28133 consensus_meta.cc:287] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 1.089s	user 0.012s	sys 0.000s
I20260709 13:11:51.612049 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:51.622155 25376 raft_consensus.cc:2393] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 7: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:11:51.612504 25908 raft_consensus.cc:2468] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 7.
I20260709 13:11:51.548172 28308 raft_consensus.cc:515] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:51.614705 28460 consensus_queue.cc:237] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:51.568941 28298 raft_consensus.cc:515] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:51.558382 28385 raft_consensus.cc:515] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:51.629036 25227 raft_consensus.cc:1240] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:11:51.630420 28437 raft_consensus.cc:515] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:51.632951 28437 leader_election.cc:290] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:51.633105 28298 leader_election.cc:290] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:51.546602 28454 raft_consensus.cc:515] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:51.598107 28319 consensus_queue.cc:237] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:51.635478 28454 leader_election.cc:290] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:51.637074 28415 leader_election.cc:290] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:51.637306 25224 raft_consensus.cc:1240] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:51.622522 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:51.624341 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:51.624787 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:51.642457 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:51.643267 25902 raft_consensus.cc:2410] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:11:51.643965 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:51.625198 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:51.644586 25908 raft_consensus.cc:2468] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 5.
W20260709 13:11:51.645358 25343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.645632 25270 leader_election.cc:304] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:51.573644 28375 raft_consensus.cc:515] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:51.657281 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:51.674192 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:51.675665 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:51.676143 25376 raft_consensus.cc:2376] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 9. Re-sending same reply.
I20260709 13:11:51.676923 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:51.677413 25376 raft_consensus.cc:2468] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 7.
I20260709 13:11:51.677992 25903 raft_consensus.cc:2468] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 7.
I20260709 13:11:51.679077 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:51.679790 25226 raft_consensus.cc:2393] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 6: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:51.620791 28419 leader_election.cc:290] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:51.681481 25270 leader_election.cc:304] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:51.682780 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:51.647630 25907 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 8.
I20260709 13:11:51.609962 28441 leader_election.cc:290] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:51.685393 25229 raft_consensus.cc:1240] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 13:11:51.685659 25226 raft_consensus.cc:1240] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 8 LEADER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:11:51.685837 25230 raft_consensus.cc:1240] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:11:51.683142 25270 leader_election.cc:304] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:11:51.687103 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 84838.7us
I20260709 13:11:51.687340 25270 leader_election.cc:304] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:51.639338 28308 leader_election.cc:290] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:51.688706 25270 leader_election.cc:304] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:51.621053 28180 leader_election.cc:290] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:51.626076 28140 raft_consensus.cc:493] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:51.627310 28133 raft_consensus.cc:515] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:51.617609 28323 raft_consensus.cc:515] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:51.602053 28330 raft_consensus.cc:515] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:51.693377 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:51.697042 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:51.698551 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:51.699699 25230 pending_rounds.cc:85] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce: Aborting all ops after (but not including) 2
I20260709 13:11:51.686765 28454 raft_consensus.cc:2804] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:51.702286 28379 raft_consensus.cc:515] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:51.693011 28441 consensus_queue.cc:1048] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:11:51.706048 25304 raft_consensus.cc:1240] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:51.690128 28262 raft_consensus.cc:2804] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:51.691334 28467 consensus_queue.cc:1048] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:11:51.726991 28262 raft_consensus.cc:493] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:51.727460 28262 raft_consensus.cc:3060] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:51.689968 28430 raft_consensus.cc:2804] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:51.728363 28430 raft_consensus.cc:697] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 7 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:51.729242 28430 consensus_queue.cc:237] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:51.716446 28314 consensus_meta.cc:287] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.736s	user 0.011s	sys 0.000s
I20260709 13:11:51.719108 25195 leader_election.cc:304] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:51.721448 25226 raft_consensus.cc:1240] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:51.722365 25230 pending_rounds.cc:107] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce: Aborting uncommitted NO_OP operation due to leader change: 5.3
W20260709 13:11:51.733724 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.733911 25230 raft_consensus.cc:2889] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:51.692282 28299 raft_consensus.cc:515] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:51.684805 28402 raft_consensus.cc:2749] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:51.739008 25379 raft_consensus.cc:2393] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 7: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:51.724889 25270 leader_election.cc:304] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:51.724967 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:51.717129 28401 raft_consensus.cc:2804] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:51.739831 25903 raft_consensus.cc:2468] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 6.
I20260709 13:11:51.743170 25302 raft_consensus.cc:1240] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:51.743250 25195 leader_election.cc:304] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:51.745694 25270 leader_election.cc:304] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:51.746553 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:51.724460 28453 leader_election.cc:290] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:51.747478 25376 raft_consensus.cc:2393] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 9: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:51.747870 28467 raft_consensus.cc:2749] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:51.747963 28429 consensus_queue.cc:1059] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:51.748381 28299 leader_election.cc:290] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:51.740281 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:51.775074 25226 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 6.
I20260709 13:11:51.749241 25345 leader_election.cc:304] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:51.749815 28317 consensus_queue.cc:1059] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:51.748420 28301 consensus_queue.cc:1059] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:11:51.740224 28314 raft_consensus.cc:2749] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361) with higher term. Message: Invalid argument: T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 7. Current term is 8.
I20260709 13:11:51.751547 28471 raft_consensus.cc:2804] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:51.751945 28460 raft_consensus.cc:2749] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:51.751571 28472 raft_consensus.cc:2804] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:51.797704 28472 raft_consensus.cc:493] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:51.797696 28282 raft_consensus.cc:3060] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:51.798301 28472 raft_consensus.cc:3060] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:51.752856 25195 leader_election.cc:304] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:51.723714 28454 raft_consensus.cc:493] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:51.709339 28447 leader_election.cc:290] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:51.774168 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:51.801237 25376 raft_consensus.cc:3060] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:51.718137 28140 raft_consensus.cc:515] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:51.807898 28140 leader_election.cc:290] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:51.723421 28373 consensus_queue.cc:1059] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:11:51.767203 28375 leader_election.cc:290] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:51.781217 28418 raft_consensus.cc:2749] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:51.793957 28415 consensus_queue.cc:1059] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:11:51.809592 28415 raft_consensus.cc:3055] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:51.797036 28301 consensus_queue.cc:1059] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:51.810156 28415 raft_consensus.cc:740] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:51.811092 28415 consensus_queue.cc:260] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
W20260709 13:11:51.811749 25299 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57272 (request call id 1663) took 4216 ms (client timeout 1769 ms). Trace:
I20260709 13:11:51.767800 28401 raft_consensus.cc:697] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 7 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:51.813894 28460 raft_consensus.cc:2749] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:51.814335 28373 raft_consensus.cc:3055] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:51.799129 28314 raft_consensus.cc:3055] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:51.814790 28373 raft_consensus.cc:740] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:51.815068 28314 raft_consensus.cc:740] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:51.803404 28454 raft_consensus.cc:3060] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:51.809522 25372 raft_consensus.cc:2468] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 8.
W20260709 13:11:51.816589 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.805593 25301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57256 (request call id 1773) took 3118 ms. Trace:
I20260709 13:11:51.813687 28401 consensus_queue.cc:237] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:51.822993 25301 rpcz_store.cc:276] 0709 13:11:48.687049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:48.925794 (+238745us) service_pool.cc:224] Handling call
0709 13:11:48.926150 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:50.214330 (+1288180us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:51.805352 (+1591022us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b54001f18d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:51.805536 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2961183104}
I20260709 13:11:51.824740 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:51.815868 28373 consensus_queue.cc:260] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:51.825910 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:51.826627 25301 raft_consensus.cc:2468] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 8.
I20260709 13:11:51.812485 28415 raft_consensus.cc:3060] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:11:51.813684 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 60931.9us
I20260709 13:11:51.816068 25305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57272 (request call id 1697) took 1888 ms. Trace:
I20260709 13:11:51.827773 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:51.828074 25305 rpcz_store.cc:276] 0709 13:11:49.928044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:50.249222 (+321178us) service_pool.cc:224] Handling call
0709 13:11:50.292043 (+ 42821us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:50.586865 (+294822us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:51.815815 (+1228950us) spinlock_profiling.cc:243] Waited 243 ms on lock 0x7b54004001d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:51.816005 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":559151488}
I20260709 13:11:51.829362 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:51.829982 25305 raft_consensus.cc:2468] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 9.
W20260709 13:11:51.812188 25299 rpcz_store.cc:269] 0709 13:11:47.595255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:47.606875 (+ 11620us) service_pool.cc:224] Handling call
0709 13:11:51.811502 (+4204627us) spinlock_profiling.cc:243] Waited 2.58 s on lock 0x7b54002de1d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:51.811649 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5929570048}
I20260709 13:11:51.780126 28299 raft_consensus.cc:3055] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:51.794191 28471 raft_consensus.cc:493] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
W20260709 13:11:51.832988 25195 leader_election.cc:336] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 1.622s (SENT)
I20260709 13:11:51.834972 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:51.816039 28314 consensus_queue.cc:260] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:51.834599 28299 raft_consensus.cc:740] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:51.836225 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:51.839025 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:51.842800 25299 raft_consensus.cc:3060] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:51.848927 28323 leader_election.cc:290] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:51.841440 28471 raft_consensus.cc:3060] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:51.826751 28373 raft_consensus.cc:3060] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:51.843739 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:51.837452 28314 raft_consensus.cc:3060] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:51.850289 28379 leader_election.cc:290] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:51.851544 28385 leader_election.cc:290] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:51.852124 28330 leader_election.cc:290] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:51.871852 28227 raft_consensus.cc:3055] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:51.862963 25305 raft_consensus.cc:2468] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 5.
I20260709 13:11:51.872339 28227 raft_consensus.cc:740] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:51.873616 28227 consensus_queue.cc:260] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:51.875093 28227 raft_consensus.cc:3060] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:51.875108 28297 leader_election.cc:290] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:51.879237 28163 leader_election.cc:290] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:51.882465 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:51.882596 28159 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:51.849691 25376 raft_consensus.cc:2468] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 7.
I20260709 13:11:51.884018 25305 raft_consensus.cc:2468] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 6.
I20260709 13:11:51.886546 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:51.889089 25376 raft_consensus.cc:2410] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:11:51.894073 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:51.895874 28379 raft_consensus.cc:493] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:51.896051 25271 leader_election.cc:304] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:11:51.896449 28379 raft_consensus.cc:515] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:51.895538 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:51.899544 25271 leader_election.cc:304] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:51.898846 28379 leader_election.cc:290] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:51.903952 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:51.904786 25376 raft_consensus.cc:2468] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 5.
I20260709 13:11:51.905128 25303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57256 (request call id 1778) took 1966 ms. Trace:
I20260709 13:11:51.900743 25305 raft_consensus.cc:2393] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 7: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:51.905522 25303 rpcz_store.cc:276] 0709 13:11:49.938757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:50.389028 (+450271us) service_pool.cc:224] Handling call
0709 13:11:50.389461 (+   433us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:50.403019 (+ 13558us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:50.403066 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:50.403810 (+   744us) log.cc:844] Serialized 52 byte log entry
0709 13:11:50.712032 (+308222us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:50.823073 (+111041us) log.cc:844] Serialized 14 byte log entry
0709 13:11:50.933141 (+110068us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:51.804721 (+871580us) spinlock_profiling.cc:243] Waited 20.4 ms on lock 0x7b1800442360. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72cb823f3 00007fd72cb847c1 00007fd72cb84779 00007fd72cb84709 00007fd72cb846d1 00007fd72cb839cd 000000000038f354 000000000038f199 00007fd72cb6583a
0709 13:11:51.904788 (+100067us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b54000f8554. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:51.904844 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:51.904903 (+    59us) raft_consensus.cc:1685] finished
0709 13:11:51.904917 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:51.905064 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32950,"prepare.queue_time_us":128207,"prepare.run_cpu_time_us":6116,"prepare.run_wall_time_us":19932,"raft.queue_time_us":147185,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":48111,"spinlock_wait_cycles":78357504,"thread_start_us":240085,"threads_started":1,"wal-append.queue_time_us":801356}
I20260709 13:11:51.908949 25271 leader_election.cc:304] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:51.909615 28265 raft_consensus.cc:2804] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:51.914188 28402 raft_consensus.cc:2804] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:51.914963 28402 raft_consensus.cc:697] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 7 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:51.917896 25271 leader_election.cc:304] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
W20260709 13:11:51.918120 25343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.862393 28472 raft_consensus.cc:515] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:51.906255 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:51.949473 28133 leader_election.cc:290] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:51.913053 28265 raft_consensus.cc:697] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 8 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:51.912168 28375 raft_consensus.cc:2804] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:51.958098 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:51.958801 28265 consensus_queue.cc:237] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:51.961503 25376 raft_consensus.cc:3060] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:51.838737 28299 consensus_queue.cc:260] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:51.965102 28375 raft_consensus.cc:697] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 7 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:51.971881 28375 consensus_queue.cc:237] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:51.972663 28472 leader_election.cc:290] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:51.991765 28262 raft_consensus.cc:515] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:51.992360 25874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.994750 25907 raft_consensus.cc:1275] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:11:51.997089 28452 log.cc:927] Time spent T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.473s	user 0.003s	sys 0.000s
W20260709 13:11:52.000815 25900 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50056 (request call id 624) took 2010 ms (client timeout 1878 ms). Trace:
W20260709 13:11:52.001423 25900 rpcz_store.cc:269] 0709 13:11:49.990489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:50.027641 (+ 37152us) service_pool.cc:224] Handling call
0709 13:11:52.000506 (+1972865us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b54006c0554. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:52.000690 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3131944192}
I20260709 13:11:52.002696 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
W20260709 13:11:52.002996 25872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.003432 25907 raft_consensus.cc:2393] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 4: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:52.006723 25903 raft_consensus.cc:1240] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:52.007244 28280 leader_election.cc:290] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:52.008231 25901 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50060 (request call id 522) took 2983 ms (client timeout 1705 ms). Trace:
I20260709 13:11:52.008122 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:11:52.008662 25901 rpcz_store.cc:269] 0709 13:11:49.024405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:49.024522 (+   117us) service_pool.cc:224] Handling call
0709 13:11:52.008022 (+2983500us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54003589d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:52.008136 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2947248512}
I20260709 13:11:52.009907 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:52.010666 25902 raft_consensus.cc:2368] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 6. Current term is 7.
I20260709 13:11:51.915805 28402 consensus_queue.cc:237] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:52.012859 28444 log.cc:927] Time spent T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.707s	user 0.001s	sys 0.001s
I20260709 13:11:52.002192 28439 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:51.960152 28471 raft_consensus.cc:515] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:51.960916 28379 raft_consensus.cc:2804] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:52.023619 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:52.024713 25907 raft_consensus.cc:2368] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 6. Current term is 7.
I20260709 13:11:52.028878 28426 raft_consensus.cc:3055] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:52.029479 28426 raft_consensus.cc:740] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:52.032831 28439 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:52.034021 28432 log.cc:927] Time spent T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.812s	user 0.003s	sys 0.001s
I20260709 13:11:52.034926 28454 raft_consensus.cc:515] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:51.972487 28442 raft_consensus.cc:515] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:52.027235 28379 raft_consensus.cc:697] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 6 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:51.963809 28358 raft_consensus.cc:515] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:52.042753 28457 log.cc:927] Time spent T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.517s	user 0.003s	sys 0.000s
I20260709 13:11:52.045315 28471 leader_election.cc:290] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:52.045674 28454 leader_election.cc:290] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:52.087584 28480 log.cc:927] Time spent T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.124s	user 0.007s	sys 0.000s
W20260709 13:11:52.088675 28464 log.cc:927] Time spent T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.578s	user 0.001s	sys 0.003s
W20260709 13:11:52.090261 28479 log.cc:927] Time spent T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.119s	user 0.005s	sys 0.002s
I20260709 13:11:52.126924 25297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57256 (request call id 1796) took 1082 ms. Trace:
I20260709 13:11:52.127882 25297 rpcz_store.cc:276] 0709 13:11:51.043875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:51.373769 (+329894us) service_pool.cc:224] Handling call
0709 13:11:51.374216 (+   447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:51.374524 (+   308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:51.374564 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:51.375138 (+   574us) log.cc:844] Serialized 26 byte log entry
0709 13:11:51.513191 (+138053us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:51.513236 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:51.513316 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:52.039850 (+526534us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b4400022b4c. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72caa8c85 00007fd72caa96a2 00007fd72f81b1db 00007fd72f816aaf 00007fd72f80a86e 00007fd72f809bb6 00007fd72f8097d8 00007fd72f813221 00007fd72f8131d9 00007fd72f813169
0709 13:11:52.125645 (+ 85795us) raft_consensus.cc:1685] finished
0709 13:11:52.125742 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:52.126533 (+   791us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":293418880,"thread_start_us":78643,"threads_started":1,"wal-append.queue_time_us":97605}
W20260709 13:11:52.131719 25194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:52.132575 25194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.137709 25900 raft_consensus.cc:1240] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:52.138756 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:52.140627 25370 raft_consensus.cc:2410] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:11:52.037688 28262 leader_election.cc:290] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:52.145015 28262 raft_consensus.cc:493] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:52.131742 25221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1819) took 1086 ms. Trace:
I20260709 13:11:52.154116 25301 raft_consensus.cc:2393] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 7: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:52.156818 28358 leader_election.cc:290] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:52.160876 25300 raft_consensus.cc:1240] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 7 LEADER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:52.162320 28326 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.162572 25376 raft_consensus.cc:2468] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 9.
I20260709 13:11:52.163491 28326 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:52.164737 28466 log.cc:927] Time spent T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.583s	user 0.001s	sys 0.008s
I20260709 13:11:52.039678 28299 raft_consensus.cc:3060] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:52.169575 27945 leader_election.cc:290] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:52.173902 28442 leader_election.cc:290] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:52.059330 28379 consensus_queue.cc:237] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:52.184242 25298 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57272 (request call id 1688) took 2266 ms (client timeout 1960 ms). Trace:
I20260709 13:11:52.148824 25221 rpcz_store.cc:276] 0709 13:11:51.045432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:51.046850 (+  1418us) service_pool.cc:224] Handling call
0709 13:11:51.047160 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:51.047488 (+   328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:51.047530 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:51.062951 (+ 15421us) log.cc:844] Serialized 26 byte log entry
0709 13:11:51.372176 (+309225us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:51.372268 (+    92us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:51.372624 (+   356us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:51.996576 (+623952us) spinlock_profiling.cc:243] Waited 85.2 ms on lock 0x7b4400022b4c. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72caa8c85 00007fd72caa96a2 00007fd72f81b1db 00007fd72f816aaf 00007fd72f80a86e 00007fd72f809bb6 00007fd72f8097d8 00007fd72f813221 00007fd72f8131d9 00007fd72f813169
0709 13:11:52.130667 (+134091us) raft_consensus.cc:1685] finished
0709 13:11:52.130733 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:52.131359 (+   626us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18464,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":30294,"spinlock_wait_cycles":196019456,"thread_start_us":231283,"threads_started":1,"wal-append.queue_time_us":384374}
I20260709 13:11:52.191390 25375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56308 (request call id 493) took 1111 ms. Trace:
I20260709 13:11:52.191987 25375 rpcz_store.cc:276] 0709 13:11:51.080244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:51.097054 (+ 16810us) service_pool.cc:224] Handling call
0709 13:11:51.105580 (+  8526us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:51.199582 (+ 94002us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:52.190798 (+991216us) spinlock_profiling.cc:243] Waited 7.97 ms on lock 0x7b5400307850. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6e8ad 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:52.191133 (+   335us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18338176}
I20260709 13:11:52.134100 25271 leader_election.cc:304] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:11:52.195971 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 62603.8us
I20260709 13:11:52.198195 28265 raft_consensus.cc:2804] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:52.198769 28265 raft_consensus.cc:697] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 8 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
W20260709 13:11:52.185014 25298 rpcz_store.cc:269] 0709 13:11:49.917316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:49.918222 (+   906us) service_pool.cc:224] Handling call
0709 13:11:52.183658 (+2265436us) spinlock_profiling.cc:243] Waited 322 ms on lock 0x7b54002debd4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:52.183929 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":740494592}
I20260709 13:11:52.189356 25373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56308 (request call id 491) took 1109 ms. Trace:
W20260709 13:11:52.067464 28394 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.844s	user 0.003s	sys 0.010s
I20260709 13:11:52.205587 25373 rpcz_store.cc:276] 0709 13:11:51.079675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:51.112629 (+ 32954us) service_pool.cc:224] Handling call
0709 13:11:51.112921 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:51.309184 (+196263us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:51.309217 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:51.309266 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:51.309299 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:52.188533 (+879234us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b540024cf54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:52.188639 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:52.188990 (+   351us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":450842496}
I20260709 13:11:52.146081 28262 raft_consensus.cc:515] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:52.200110 28265 consensus_queue.cc:237] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:52.209425 28455 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.007s	sys 0.007s
I20260709 13:11:52.222741 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:52.219012 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:52.224478 25371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56308 (request call id 482) took 1153 ms. Trace:
I20260709 13:11:52.235158 28285 raft_consensus.cc:493] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.235810 25372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36264 (request call id 1626) took 1068 ms. Trace:
I20260709 13:11:52.235836 28285 raft_consensus.cc:515] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:52.236260 25372 rpcz_store.cc:276] 0709 13:11:51.167394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:51.167537 (+   143us) service_pool.cc:224] Handling call
0709 13:11:52.235439 (+1067902us) spinlock_profiling.cc:243] Waited 607 ms on lock 0x7b5400288cd4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:52.235608 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1395572992}
I20260709 13:11:52.238848 28285 leader_election.cc:290] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:52.244721 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:52.236334 28326 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:52.233616 25371 rpcz_store.cc:276] 0709 13:11:51.070679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:51.070845 (+   166us) service_pool.cc:224] Handling call
0709 13:11:51.110500 (+ 39655us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:51.323366 (+212866us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:52.223942 (+900576us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b540009ced4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:52.224291 (+   349us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":256631168}
I20260709 13:11:52.247596 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:52.234247 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:11:52.239027 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:52.249565 28394 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.997s	user 0.004s	sys 0.011s
I20260709 13:11:52.249528 25377 raft_consensus.cc:2468] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 8.
I20260709 13:11:52.251281 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:52.252101 25377 raft_consensus.cc:3060] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:52.253088 28386 raft_consensus.cc:670] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
W20260709 13:11:52.232988 28455 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.007s	sys 0.008s
I20260709 13:11:52.238713 28262 leader_election.cc:290] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:52.259174 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:52.260268 25376 raft_consensus.cc:3060] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Advancing to term 7
W20260709 13:11:52.234059 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 100453us
I20260709 13:11:52.262646 25379 raft_consensus.cc:2393] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 12: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:52.240971 28426 consensus_queue.cc:260] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:52.265801 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
W20260709 13:11:52.279170 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 46502us
I20260709 13:11:52.280618 25874 leader_election.cc:304] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:52.286204 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:52.287602 25371 raft_consensus.cc:2410] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:11:52.289315 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:52.290343 25371 raft_consensus.cc:2393] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 9: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:52.291275 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:52.292213 25371 raft_consensus.cc:2393] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 8: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:52.293172 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:52.294921 28319 raft_consensus.cc:2749] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:52.299496 28386 consensus_queue.cc:1048] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:52.300558 25299 raft_consensus.cc:2468] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 7.
W20260709 13:11:52.302122 25343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.302866 25874 leader_election.cc:304] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:11:52.303947 28415 raft_consensus.cc:493] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.304782 28415 raft_consensus.cc:515] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:52.311437 28415 leader_election.cc:290] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:11:52.308732 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.312031 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:52.313117 25907 raft_consensus.cc:2468] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 5.
I20260709 13:11:52.313740 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:11:52.313062 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.314332 25872 leader_election.cc:304] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:52.314803 25221 raft_consensus.cc:2468] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 8.
I20260709 13:11:52.316202 25226 raft_consensus.cc:1240] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:52.316213 28285 raft_consensus.cc:493] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.316716 25872 leader_election.cc:304] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:52.317483 28285 raft_consensus.cc:515] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:52.317966 28319 raft_consensus.cc:2749] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:52.318922 28319 raft_consensus.cc:2804] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:52.319366 28319 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:52.319747 28319 raft_consensus.cc:3060] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:52.320309 28285 leader_election.cc:290] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:52.294147 25371 raft_consensus.cc:2393] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 4: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:52.322021 25372 raft_consensus.cc:3060] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Advancing to term 7
W20260709 13:11:52.275372 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 73819.4us
I20260709 13:11:52.322559 25371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36264 (request call id 1640) took 1136 ms. Trace:
I20260709 13:11:52.337543 25371 rpcz_store.cc:276] 0709 13:11:51.192320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.292849 (+1100529us) service_pool.cc:224] Handling call
0709 13:11:52.322476 (+ 29627us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:52.343904 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.346401 25378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36264 (request call id 1629) took 1177 ms. Trace:
I20260709 13:11:52.347332 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:52.348348 25304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57272 (request call id 1694) took 2423 ms. Trace:
I20260709 13:11:52.354355 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:52.356303 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:52.354436 25872 leader_election.cc:304] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:52.347050 25378 rpcz_store.cc:276] 0709 13:11:51.168338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:51.168483 (+   145us) service_pool.cc:224] Handling call
0709 13:11:52.345905 (+1177422us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b54004588d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:52.346158 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":493622016}
I20260709 13:11:52.348989 25304 rpcz_store.cc:276] 0709 13:11:49.924286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:50.248095 (+323809us) service_pool.cc:224] Handling call
0709 13:11:50.260847 (+ 12752us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:51.726660 (+1465813us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:52.347567 (+620907us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b54002c9f54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:52.347983 (+   416us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3322989952}
I20260709 13:11:52.358772 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:52.360147 28297 raft_consensus.cc:2804] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:52.360616 28297 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:52.360978 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:52.360984 28297 raft_consensus.cc:3060] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:52.367589 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:52.368779 25371 raft_consensus.cc:2468] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 8.
I20260709 13:11:52.372489 25902 raft_consensus.cc:1240] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:52.369638 25371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36264 (request call id 1649) took 1031 ms. Trace:
I20260709 13:11:52.383383 25371 rpcz_store.cc:276] 0709 13:11:51.337951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.366971 (+1029020us) service_pool.cc:224] Handling call
0709 13:11:52.369558 (+  2587us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:52.377305 25300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46556 (request call id 405) took 3006 ms. Trace:
W20260709 13:11:52.384500 28373 consensus_meta.cc:287] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 0.527s	user 0.016s	sys 0.003s
I20260709 13:11:52.375247 25370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36264 (request call id 1630) took 1205 ms. Trace:
I20260709 13:11:52.360636 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:52.409125 25377 raft_consensus.cc:2468] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 6.
I20260709 13:11:52.444152 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:52.439652 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:52.394585 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:52.430676 25376 raft_consensus.cc:2468] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 7.
I20260709 13:11:52.435084 25296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57256 (request call id 1779) took 2425 ms. Trace:
I20260709 13:11:52.388852 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:52.459069 25872 leader_election.cc:304] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:52.465018 25370 rpcz_store.cc:276] 0709 13:11:51.169696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:51.169864 (+   168us) service_pool.cc:224] Handling call
0709 13:11:52.374955 (+1205091us) spinlock_profiling.cc:243] Waited 947 ms on lock 0x7b5400306e54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:52.375173 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2177150336}
I20260709 13:11:52.464696 25300 rpcz_store.cc:276] 0709 13:11:49.370453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:49.370593 (+   140us) service_pool.cc:224] Handling call
0709 13:11:51.812799 (+2442206us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:52.161601 (+348802us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:52.376033 (+214432us) spinlock_profiling.cc:243] Waited 328 ms on lock 0x7b54002de1d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:52.376953 (+   920us) spinlock_profiling.cc:243] Waited 2.44 s on lock 0x7b54002de1d0. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6e8ad 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:52.377220 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6370863360}
I20260709 13:11:52.453044 25873 leader_election.cc:304] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:52.478461 25373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36254 (request call id 1911) took 1023 ms. Trace:
I20260709 13:11:52.480069 25373 rpcz_store.cc:276] 0709 13:11:51.455060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.443658 (+988598us) service_pool.cc:224] Handling call
0709 13:11:52.478380 (+ 34722us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:52.480064 25343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.422029 28314 raft_consensus.cc:493] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.446507 28147 leader_election.cc:290] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:52.485229 25379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36254 (request call id 1912) took 1012 ms. Trace:
I20260709 13:11:52.491469 25372 raft_consensus.cc:2468] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 7.
I20260709 13:11:52.470736 25296 rpcz_store.cc:276] 0709 13:11:49.939137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:50.502804 (+563667us) service_pool.cc:224] Handling call
0709 13:11:50.534765 (+ 31961us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:50.535117 (+   352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:50.535151 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:50.535592 (+   441us) log.cc:844] Serialized 26 byte log entry
0709 13:11:52.134469 (+1598877us) spinlock_profiling.cc:243] Waited 20.9 ms on lock 0x7b18003ba6a0. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72cb64e07 00007fd7359bfab9 00007fd72cb8169b 00007fd72cb7f93f 00007fd72cb81c02 00007fd72f80920b 00007fd72f80ed23 00007fd72f80f0d1 00007fd72fc2aa0f
0709 13:11:52.232014 (+ 97545us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:52.232150 (+   136us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:52.234875 (+  2725us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:52.321699 (+ 86824us) raft_consensus.cc:1685] finished
0709 13:11:52.321728 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:52.364718 (+ 42990us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2614,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":128,"spinlock_wait_cycles":48022912,"thread_start_us":68645,"threads_started":1,"wal-append.queue_time_us":1778410}
I20260709 13:11:52.489353 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:52.492982 25379 rpcz_store.cc:276] 0709 13:11:51.472937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.276341 (+803404us) service_pool.cc:224] Handling call
0709 13:11:52.485154 (+208813us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:52.496912 25378 raft_consensus.cc:2410] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:11:52.501268 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:52.502326 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:52.504366 25377 raft_consensus.cc:2393] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 8: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:52.505174 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:52.505877 25377 raft_consensus.cc:1240] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:52.508850 25908 raft_consensus.cc:2393] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 8: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:52.509415 25222 raft_consensus.cc:3060] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:52.508737 25377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36264 (request call id 1633) took 1335 ms. Trace:
I20260709 13:11:52.503010 25378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36264 (request call id 1651) took 1160 ms. Trace:
I20260709 13:11:52.511579 25378 rpcz_store.cc:276] 0709 13:11:51.338551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.388447 (+1049896us) service_pool.cc:224] Handling call
0709 13:11:52.499232 (+110785us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:52.507913 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:52.510151 25377 rpcz_store.cc:276] 0709 13:11:51.170717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.505168 (+1334451us) service_pool.cc:224] Handling call
0709 13:11:52.505571 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:52.506364 (+   793us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:52.506536 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:52.506264 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:52.525811 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:52.530546 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:52.530588 28385 raft_consensus.cc:2749] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:52.533282 28385 raft_consensus.cc:2804] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:52.533862 25270 leader_election.cc:304] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:52.538450 25373 raft_consensus.cc:2410] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:11:52.530630 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:52.541824 25379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36254 (request call id 1904) took 1108 ms. Trace:
I20260709 13:11:52.543157 25379 rpcz_store.cc:276] 0709 13:11:51.433326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.498039 (+1064713us) service_pool.cc:224] Handling call
0709 13:11:52.541729 (+ 43690us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:52.540843 25371 raft_consensus.cc:2468] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 9.
I20260709 13:11:52.533856 28385 raft_consensus.cc:697] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:52.550531 25374 raft_consensus.cc:3060] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:52.551944 25372 raft_consensus.cc:2393] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 6: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
W20260709 13:11:52.562079 28489 log.cc:927] Time spent T 00000000000000000000000000000000 P 5140a3161b944724a989995efdc4a818: Append to log took a long time: real 0.350s	user 0.001s	sys 0.005s
I20260709 13:11:52.564854 25226 raft_consensus.cc:1240] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:52.568279 25374 raft_consensus.cc:2468] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 10.
I20260709 13:11:52.570427 28402 raft_consensus.cc:2804] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:52.570858 25270 leader_election.cc:304] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:11:52.572649 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 151798us
I20260709 13:11:52.575322 28426 raft_consensus.cc:3060] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:52.570931 28402 raft_consensus.cc:493] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:52.585624 28147 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
W20260709 13:11:52.596588 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.577538 28386 raft_consensus.cc:2804] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:52.574332 28314 raft_consensus.cc:515] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:52.601207 28402 raft_consensus.cc:3060] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:52.621308 25370 raft_consensus.cc:1240] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:11:52.622445 25373 raft_consensus.cc:1275] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:11:52.622884 25373 pending_rounds.cc:85] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468: Aborting all ops after (but not including) 3
W20260709 13:11:52.625156 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 168170us
I20260709 13:11:52.625417 25370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36254 (request call id 1918) took 1075 ms. Trace:
I20260709 13:11:52.626017 25370 rpcz_store.cc:276] 0709 13:11:51.546799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.590011 (+1043212us) service_pool.cc:224] Handling call
0709 13:11:52.610679 (+ 20668us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:52.621928 (+ 11249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:52.622158 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:52.627781 25375 raft_consensus.cc:3060] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:52.591593 28319 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:52.625108 25373 pending_rounds.cc:107] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:11:52.633129 25373 raft_consensus.cc:2889] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:52.636565 25908 raft_consensus.cc:1240] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:52.639122 25379 raft_consensus.cc:1240] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:11:52.602358 28147 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:52.643066 25379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36254 (request call id 1907) took 1198 ms. Trace:
I20260709 13:11:52.659772 25379 rpcz_store.cc:276] 0709 13:11:51.442018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.594775 (+1152757us) service_pool.cc:224] Handling call
0709 13:11:52.631538 (+ 36763us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:52.639610 (+  8072us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:52.639857 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:52.644347 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:52.644850 25376 raft_consensus.cc:1275] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:11:52.644747 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:52.645781 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:52.646623 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:52.652352 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:52.660820 25376 pending_rounds.cc:85] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468: Aborting all ops after (but not including) 4
I20260709 13:11:52.669411 25376 pending_rounds.cc:107] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:11:52.669801 25376 raft_consensus.cc:2889] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:52.645443 28454 raft_consensus.cc:2804] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:52.654256 25872 leader_election.cc:304] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:11:52.675033 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.676546 25370 raft_consensus.cc:1240] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:11:52.678886 25222 raft_consensus.cc:2468] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 7.
I20260709 13:11:52.675397 25904 raft_consensus.cc:3060] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:52.682060 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:52.682725 25370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36254 (request call id 1922) took 1071 ms. Trace:
I20260709 13:11:52.683264 25370 rpcz_store.cc:276] 0709 13:11:51.611080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.630603 (+1019523us) service_pool.cc:224] Handling call
0709 13:11:52.673933 (+ 43330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:52.677099 (+  3166us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:52.682656 (+  5557us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:52.684787 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:52.685304 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:52.685727 25905 raft_consensus.cc:2393] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 6: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:11:52.673637 28454 raft_consensus.cc:493] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:52.689261 25373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36254 (request call id 1901) took 1274 ms. Trace:
I20260709 13:11:52.691262 25373 rpcz_store.cc:276] 0709 13:11:51.407931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.545431 (+1137500us) service_pool.cc:224] Handling call
0709 13:11:52.589985 (+ 44554us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:52.680328 (+ 90343us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:52.682477 (+  2149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:52.692660 25226 raft_consensus.cc:2468] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 5.
W20260709 13:11:52.701825 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 249114us
I20260709 13:11:52.690735 28454 raft_consensus.cc:3060] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:52.705382 25376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36254 (request call id 1903) took 1273 ms. Trace:
I20260709 13:11:52.706542 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:52.705924 25376 rpcz_store.cc:276] 0709 13:11:51.429272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.583982 (+1154710us) service_pool.cc:224] Handling call
0709 13:11:52.602023 (+ 18041us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:52.702704 (+100681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:52.702890 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:52.708981 25908 raft_consensus.cc:2368] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 8. Current term is 9.
W20260709 13:11:52.711920 25194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.707757 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:52.718327 25224 raft_consensus.cc:1240] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:52.732405 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:52.727936 25379 raft_consensus.cc:2468] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 7.
I20260709 13:11:52.726639 25873 leader_election.cc:304] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:52.738903 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
W20260709 13:11:52.735193 25195 leader_election.cc:336] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 1.755s (SENT)
I20260709 13:11:52.743782 25195 leader_election.cc:304] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:52.681922 28385 consensus_queue.cc:237] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:52.746454 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.754448 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:52.758111 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:52.747404 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:52.809980 28297 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:52.810895 28147 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:52.812505 28297 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:52.813421 28297 raft_consensus.cc:493] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.815587 25902 raft_consensus.cc:1240] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:52.815986 28180 raft_consensus.cc:2749] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:11:52.817000 28493 log.cc:927] Time spent T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:11:52.819275 25379 raft_consensus.cc:1275] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:11:52.820282 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.832998 28386 raft_consensus.cc:493] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:52.838398 25370 raft_consensus.cc:1240] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 11. Current term is 12. Ops: []
W20260709 13:11:52.839975 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 209384us
W20260709 13:11:52.841080 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.876000 25379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36264 (request call id 1656) took 1046 ms. Trace:
I20260709 13:11:52.854781 28265 raft_consensus.cc:493] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:52.855407 28262 raft_consensus.cc:493] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:52.880223 25379 rpcz_store.cc:276] 0709 13:11:51.829939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.818372 (+988433us) service_pool.cc:224] Handling call
0709 13:11:52.818827 (+   455us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:52.875680 (+ 56853us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:52.875923 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:52.902218 28262 raft_consensus.cc:515] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:52.903024 25379 pending_rounds.cc:85] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468: Aborting all ops after (but not including) 5
I20260709 13:11:52.903471 25379 pending_rounds.cc:107] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 6.6
I20260709 13:11:52.903868 25379 raft_consensus.cc:2917] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Aborting config change with OpId 6.6: Aborted: Op aborted by new leader
I20260709 13:11:52.904419 25379 raft_consensus.cc:2889] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:52.905165 28262 leader_election.cc:290] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:52.883431 28319 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 9 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:52.906214 28319 raft_consensus.cc:2749] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:52.906597 28314 leader_election.cc:290] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:52.906971 28319 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.907629 28319 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:52.883636 28379 raft_consensus.cc:493] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.885888 28297 raft_consensus.cc:515] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:52.888847 25195 leader_election.cc:336] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 1.994s (SENT)
I20260709 13:11:52.882181 28386 raft_consensus.cc:3060] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:52.893424 25344 leader_election.cc:400] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085) with higher term. Message: Invalid argument: T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 6. Current term is 7.
I20260709 13:11:52.914021 25344 leader_election.cc:403] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:52.893965 28147 consensus_queue.cc:1048] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:52.920958 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:52.921285 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:52.919780 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:52.922086 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:52.922611 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:52.923043 25230 raft_consensus.cc:1275] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:11:52.923197 28265 raft_consensus.cc:515] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:52.923739 28297 leader_election.cc:290] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:52.924075 25900 raft_consensus.cc:1275] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:11:52.924541 28299 consensus_queue.cc:1048] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:52.925438 28265 leader_election.cc:290] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:52.896629 28308 raft_consensus.cc:493] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.897600 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:52.901402 25904 raft_consensus.cc:2468] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 6.
I20260709 13:11:52.909780 25370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56308 (request call id 499) took 1163 ms. Trace:
I20260709 13:11:52.914291 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:52.930836 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:52.916451 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:52.919727 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:52.920409 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:52.895516 27945 consensus_queue.cc:1059] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:52.930516 25370 rpcz_store.cc:276] 0709 13:11:51.746124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.777439 (+1031315us) service_pool.cc:224] Handling call
0709 13:11:52.838165 (+ 60726us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:52.909438 (+ 71273us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:52.909686 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:52.932789 27945 raft_consensus.cc:3055] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:52.916237 25905 raft_consensus.cc:1240] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:52.933128 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:52.930964 28500 raft_consensus.cc:2749] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:52.933195 27945 raft_consensus.cc:740] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:52.927189 25222 raft_consensus.cc:2368] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for earlier term 9. Current term is 10.
I20260709 13:11:52.934130 25221 raft_consensus.cc:2393] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 8: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:52.934700 27945 consensus_queue.cc:260] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:52.926851 25195 leader_election.cc:304] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:52.936933 28180 raft_consensus.cc:2749] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:52.933269 25370 raft_consensus.cc:1240] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 9. Current term is 10. Ops: [8.4-9.5]
I20260709 13:11:52.936256 27945 raft_consensus.cc:3060] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:52.939335 25370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36264 (request call id 1661) took 1108 ms. Trace:
I20260709 13:11:52.939736 25370 rpcz_store.cc:276] 0709 13:11:51.831390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.932593 (+1101203us) service_pool.cc:224] Handling call
0709 13:11:52.933023 (+   430us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:52.939016 (+  5993us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:52.939247 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:52.939642 25127 catalog_manager.cc:5697] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
I20260709 13:11:52.943292 28265 raft_consensus.cc:493] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:52.943670 28502 consensus_queue.cc:1059] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:52.943964 28265 raft_consensus.cc:515] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:52.945312 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:52.945782 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:52.946197 25223 raft_consensus.cc:2393] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 7: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:52.946046 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:52.946830 25226 raft_consensus.cc:2468] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 9.
I20260709 13:11:52.947036 28500 raft_consensus.cc:3055] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:52.947522 28500 raft_consensus.cc:740] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:52.947907 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
W20260709 13:11:52.948181 25126 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40026 (request call id 241) took 19725 ms (client timeout 15000 ms). Trace:
I20260709 13:11:52.949083 25372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36254 (request call id 1920) took 1345 ms. Trace:
I20260709 13:11:52.948598 28500 consensus_queue.cc:260] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:52.949477 25372 rpcz_store.cc:276] 0709 13:11:51.604072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.610613 (+1006541us) service_pool.cc:224] Handling call
0709 13:11:52.615569 (+  4956us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:52.650888 (+ 35319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:52.650934 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:52.651551 (+   617us) log.cc:844] Serialized 26 byte log entry
0709 13:11:52.711064 (+ 59513us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:52.711191 (+   127us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:52.711436 (+   245us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:52.948867 (+237431us) raft_consensus.cc:1685] finished
0709 13:11:52.948887 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:52.949006 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3921,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":13068,"thread_start_us":58819,"threads_started":1,"wal-append.queue_time_us":294274}
W20260709 13:11:52.948586 25126 rpcz_store.cc:269] 0709 13:11:33.222265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:33.222532 (+   267us) service_pool.cc:224] Handling call
0709 13:11:52.947961 (+19725429us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:49.758896 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:49.759501 (+   605us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:49.759549 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:11:49.759576 (+    27us) tablet.cc:662] Decoding operations
0709 13:11:49.760592 (+  1016us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:49.760646 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:49.760672 (+    26us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:11:49.761404 (+   732us) tablet.cc:701] Row locks acquired
0709 13:11:49.761423 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:11:49.761562 (+   139us) write_op.cc:270] Start()
0709 13:11:49.761684 (+   122us) write_op.cc:276] Timestamp: P: 1783602709761514 usec, L: 0
0709 13:11:49.761710 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:11:49.773397 (+ 11687us) log.cc:844] Serialized 3631 byte log entry
0709 13:11:51.057301 (+1283904us) op_driver.cc:464] REPLICATION: finished
0709 13:11:51.515841 (+458540us) write_op.cc:301] APPLY: starting
0709 13:11:51.519189 (+  3348us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:51.554203 (+ 35014us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:51.554338 (+   135us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:51.629565 (+ 75227us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:51.629810 (+   245us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 13:11:51.629858 (+    48us) write_op.cc:312] APPLY: finished
0709 13:11:51.630121 (+   263us) log.cc:844] Serialized 71 byte log entry
0709 13:11:52.077362 (+447241us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b4400022b4c. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72caa8c85 00007fd72caa96a2 00007fd72f81b1db 00007fd72f816aaf 00007fd72cb650ac 00007fd7359bfab9 00007fd72cb8169b 00007fd72cb7f93f 00007fd72cb81c02 00007fd72f80920b
0709 13:11:52.255597 (+178235us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:52.255950 (+   353us) write_op.cc:454] Released schema lock
0709 13:11:52.256069 (+   119us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:52.256840 (+   771us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:52.256896 (+    56us) write_op.cc:454] Released schema lock
0709 13:11:52.561056 (+304160us) spinlock_profiling.cc:243] Waited 9.11 ms on lock 0x7b4400022b4c. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72caa8c85 00007fd72caa96a2 00007fd72f81b1db 00007fd72f816aaf 00007fd72f80a86e 00007fd72f809bb6 00007fd72f8097d8 00007fd72f813221 00007fd72f8131d9 00007fd72f813169
Metrics: {"mutex_wait_us":601839,"reported_tablets":42,"child_traces":[["op",{"apply.queue_time_us":437026,"apply.run_cpu_time_us":23295,"apply.run_wall_time_us":754176,"num_ops":9,"prepare.queue_time_us":627485,"prepare.run_cpu_time_us":44224,"prepare.run_wall_time_us":265498,"raft.queue_time_us":725278,"raft.run_cpu_time_us":75216,"raft.run_wall_time_us":573102,"replication_time_us":1213287,"spinlock_wait_cycles":57573120,"thread_start_us":2047372,"threads_started":5,"wal-append.queue_time_us":809949,"wal-append.run_cpu_time_us":33542,"wal-append.run_wall_time_us":1484701}]]}
I20260709 13:11:52.952951 28500 raft_consensus.cc:3060] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:52.953910 28308 raft_consensus.cc:515] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:52.938364 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 49536.8us
W20260709 13:11:52.955206 25195 leader_election.cc:336] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 2.024s (SENT)
I20260709 13:11:52.936117 28319 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:52.948710 25222 raft_consensus.cc:2393] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 12: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:52.952589 28265 leader_election.cc:290] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:52.990950 25195 leader_election.cc:304] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:52.992362 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:52.999336 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:52.941612 25127 catalog_manager.cc:5697] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 5 to 7, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 7 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
I20260709 13:11:52.937456 28454 raft_consensus.cc:515] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:53.018191 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 62258.6us
I20260709 13:11:53.015578 25375 raft_consensus.cc:2468] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 8.
I20260709 13:11:53.020362 25228 raft_consensus.cc:3060] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:53.022281 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 67118.3us
I20260709 13:11:53.025151 28308 leader_election.cc:290] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:53.025839 28180 raft_consensus.cc:2749] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:53.026223 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:53.026892 25223 raft_consensus.cc:3060] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:53.027175 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:53.028537 25222 raft_consensus.cc:1275] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:11:53.029119 25230 raft_consensus.cc:1240] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:53.030218 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:53.030661 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:53.031565 25228 raft_consensus.cc:2410] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:11:53.032377 28180 consensus_queue.cc:1059] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:53.032981 28454 leader_election.cc:290] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:52.997438 28147 raft_consensus.cc:2749] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085) with higher term. Message: Invalid argument: T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 6. Current term is 7.
I20260709 13:11:53.032792 25127 catalog_manager.cc:5697] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 2 to 6, leader changed from 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 6 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:53.035017 25127 catalog_manager.cc:5697] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 2 to 6, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68). New cstate: current_term: 6 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:11:53.036576 25127 catalog_manager.cc:5697] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 3 to 4, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 4 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
I20260709 13:11:53.038107 25127 catalog_manager.cc:5697] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 2 to 6, leader changed from 79d99c0e498349bda74127365219e468 (127.23.140.67) to 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68). New cstate: current_term: 6 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:11:53.039649 25874 leader_election.cc:304] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
W20260709 13:11:53.126569 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 86985.6us
I20260709 13:11:53.043463 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:53.015000 28373 raft_consensus.cc:493] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.046504 25375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36254 (request call id 1925) took 1126 ms. Trace:
I20260709 13:11:53.128190 25375 rpcz_store.cc:276] 0709 13:11:51.919529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.439171 (+519642us) service_pool.cc:224] Handling call
0709 13:11:53.046191 (+607020us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b54000e5bd4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:53.046329 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":362055552}
I20260709 13:11:53.046717 25377 raft_consensus.cc:1240] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 7. Current term is 8. Ops: [6.4-7.5]
I20260709 13:11:53.047348 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:53.048683 25222 raft_consensus.cc:1240] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:53.049378 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:52.938525 28386 raft_consensus.cc:515] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:53.057405 25223 raft_consensus.cc:2468] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 9.
I20260709 13:11:53.057379 28454 raft_consensus.cc:493] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
W20260709 13:11:53.112592 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 212515us
I20260709 13:11:53.019311 28379 raft_consensus.cc:515] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:53.110757 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 217559us
I20260709 13:11:53.157289 25904 raft_consensus.cc:1275] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:53.155969 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:53.159672 25905 raft_consensus.cc:2393] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 5: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:53.133215 28373 raft_consensus.cc:515] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:53.163414 25343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:53.164044 25343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:53.113014 28308 raft_consensus.cc:493] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:53.176142 25874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:53.202258 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:53.137728 28454 raft_consensus.cc:515] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:53.205291 25225 raft_consensus.cc:2468] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 9.
I20260709 13:11:53.170645 28319 raft_consensus.cc:2804] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:53.214792 25377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36264 (request call id 1647) took 1997 ms. Trace:
I20260709 13:11:53.215351 25377 rpcz_store.cc:276] 0709 13:11:51.213359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.526356 (+1312997us) service_pool.cc:224] Handling call
0709 13:11:53.046339 (+519983us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:53.129449 (+ 83110us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:53.206932 (+ 77483us) spinlock_profiling.cc:243] Waited 487 ms on lock 0x7b54000e5bd0. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6e8ad 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:53.211029 (+  4097us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1120633600}
I20260709 13:11:53.217109 25127 catalog_manager.cc:5697] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:11:53.232007 25300 raft_consensus.cc:1240] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 7. Current term is 8. Ops: []
W20260709 13:11:53.232967 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 578868us
I20260709 13:11:53.234894 25299 raft_consensus.cc:1240] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 8 LEADER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:53.241861 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:53.241384 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:53.230594 28319 raft_consensus.cc:697] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:53.258489 25127 catalog_manager.cc:5697] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 3 to 6, leader changed from 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 6 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:11:53.269116 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 553636us
I20260709 13:11:53.269613 25296 raft_consensus.cc:1240] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 7 LEADER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 13:11:53.262898 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:53.275202 25377 raft_consensus.cc:1275] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:11:53.276000 25377 pending_rounds.cc:85] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468: Aborting all ops after (but not including) 4
I20260709 13:11:53.282696 25377 pending_rounds.cc:107] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:11:53.283066 25377 raft_consensus.cc:2889] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:53.275194 25872 leader_election.cc:304] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:53.231736 28308 raft_consensus.cc:515] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:53.290220 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
W20260709 13:11:53.264199 28402 consensus_meta.cc:287] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.634s	user 0.013s	sys 0.000s
W20260709 13:11:53.289394 25871 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:53.289644 25873 leader_election.cc:304] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:53.286358 25301 raft_consensus.cc:2393] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 8: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:53.293812 25298 raft_consensus.cc:2393] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 6: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:53.300513 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:53.312024 25297 raft_consensus.cc:2410] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
W20260709 13:11:53.313211 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 288290us
I20260709 13:11:53.258302 28299 consensus_queue.cc:1059] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:11:53.301952 28385 raft_consensus.cc:2804] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:53.315106 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:53.326901 25377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36264 (request call id 1666) took 1420 ms. Trace:
I20260709 13:11:53.328673 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:53.328866 28379 leader_election.cc:290] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:53.329427 25305 raft_consensus.cc:2468] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 5.
I20260709 13:11:53.330029 25127 catalog_manager.cc:5697] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 3 to 7, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 7 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:53.332412 25127 catalog_manager.cc:5697] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 5 to 7, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 7 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:53.333864 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 58800us
I20260709 13:11:53.334288 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:53.334653 25872 leader_election.cc:304] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:53.335176 25303 raft_consensus.cc:2410] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:11:53.326304 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:53.328313 25377 rpcz_store.cc:276] 0709 13:11:51.906651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:53.216513 (+1309862us) service_pool.cc:224] Handling call
0709 13:11:53.255758 (+ 39245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:53.326653 (+ 70895us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:53.326842 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:53.336181 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:53.324426 25906 raft_consensus.cc:1275] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 LEARNER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:11:53.310359 27945 consensus_queue.cc:1048] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:11:53.342247 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:53.342764 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:53.343050 25305 raft_consensus.cc:2468] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 8.
I20260709 13:11:53.343391 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:53.295697 28402 raft_consensus.cc:515] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:53.343942 25301 raft_consensus.cc:2468] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 9.
I20260709 13:11:53.344038 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:53.344542 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:53.344846 25305 raft_consensus.cc:2393] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 8: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:53.344756 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:53.345480 28402 leader_election.cc:290] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:53.327881 28385 raft_consensus.cc:493] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:53.346105 25374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36254 (request call id 1923) took 1715 ms. Trace:
I20260709 13:11:53.312937 28502 raft_consensus.cc:2804] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:53.346529 28385 raft_consensus.cc:3060] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:53.346129 28299 raft_consensus.cc:3055] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:53.353427 28508 raft_consensus.cc:493] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.359311 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
W20260709 13:11:53.351244 28501 log.cc:927] Time spent T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
I20260709 13:11:53.371076 25903 raft_consensus.cc:2393] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 4: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:53.370685 28508 raft_consensus.cc:515] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:53.370151 28502 raft_consensus.cc:697] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:53.348423 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:53.372469 28502 consensus_queue.cc:237] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:53.373085 28508 leader_election.cc:290] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:53.373246 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:53.373807 28299 raft_consensus.cc:740] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:53.373908 25302 raft_consensus.cc:2468] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 5.
I20260709 13:11:53.374418 25296 raft_consensus.cc:1275] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:11:53.347537 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 92017.4us
I20260709 13:11:53.374884 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:53.375366 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:53.343647 25298 raft_consensus.cc:2410] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
W20260709 13:11:53.347112 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:53.311173 28180 raft_consensus.cc:3055] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:11:53.390971 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:53.349303 25377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56308 (request call id 503) took 1442 ms. Trace:
I20260709 13:11:53.361313 25905 raft_consensus.cc:1240] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:11:53.358834 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:53.352514 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:11:53.356755 25343 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.140.66:33127 timed out after 1.703s (SENT) [suppressed 50 similar messages]
W20260709 13:11:53.458616 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 371906us
I20260709 13:11:53.346369 25301 raft_consensus.cc:1275] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:11:53.346565 25374 rpcz_store.cc:276] 0709 13:11:51.631028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.633689 (+1002661us) service_pool.cc:224] Handling call
0709 13:11:52.672092 (+ 38403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:52.707569 (+ 35477us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:52.707612 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:52.733742 (+ 26130us) log.cc:844] Serialized 26 byte log entry
0709 13:11:53.174163 (+440421us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:53.174207 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:53.174281 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:53.345877 (+171596us) raft_consensus.cc:1685] finished
0709 13:11:53.345902 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:53.346036 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":415058,"threads_started":1,"wal-append.queue_time_us":535412}
I20260709 13:11:53.358565 25305 raft_consensus.cc:1240] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:11:53.364617 25373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56308 (request call id 498) took 1651 ms. Trace:
I20260709 13:11:53.376085 25907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50056 (request call id 627) took 1008 ms. Trace:
I20260709 13:11:53.467927 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:53.356479 25300 raft_consensus.cc:1240] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:53.461822 25299 raft_consensus.cc:2410] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:11:53.357470 25872 leader_election.cc:304] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:53.459957 25377 rpcz_store.cc:276] 0709 13:11:51.907156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:53.341680 (+1434524us) service_pool.cc:224] Handling call
0709 13:11:53.348598 (+  6918us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:53.348853 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:53.348893 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:53.348955 (+    62us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:53.349001 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:53.349069 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:53.349198 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:53.355756 28373 leader_election.cc:290] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:53.355149 28509 log.cc:927] Time spent T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:11:53.498833 25907 rpcz_store.cc:276] 0709 13:11:52.367845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.372765 (+  4920us) service_pool.cc:224] Handling call
0709 13:11:52.373358 (+   593us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:52.374004 (+   646us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:52.374034 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:52.490441 (+116407us) log.cc:844] Serialized 26 byte log entry
0709 13:11:52.879212 (+388771us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:52.879272 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:52.879363 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:53.375889 (+496526us) raft_consensus.cc:1685] finished
0709 13:11:53.375908 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:53.376036 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":351297,"threads_started":1,"wal-append.queue_time_us":604130}
I20260709 13:11:53.350391 25378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36264 (request call id 1643) took 2150 ms. Trace:
I20260709 13:11:53.498016 25373 rpcz_store.cc:276] 0709 13:11:51.712813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.760630 (+1047817us) service_pool.cc:224] Handling call
0709 13:11:52.761107 (+   477us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:52.764666 (+  3559us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:11:52.825984 (+ 61318us) log.cc:844] Serialized 14 byte log entry
0709 13:11:53.259084 (+433100us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:53.291966 (+ 32882us) log.cc:844] Serialized 26 byte log entry
0709 13:11:53.292148 (+   182us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:53.292594 (+   446us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:53.292867 (+   273us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:53.355864 (+ 62997us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b4800280158. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd734b98aa1 00007fd734b8fb37 00007fd734b8f9ca 00007fd734c8726f 00007fd734c86f37 00007fd734c9b55c 00007fd734c9b508 00007fd734c9b488 00007fd734c9b443 00007fd734c9a6ec 00007fd733bc4a96
0709 13:11:53.364283 (+  8419us) raft_consensus.cc:1685] finished
0709 13:11:53.364416 (+   133us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:53.364548 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15165,"prepare.queue_time_us":775,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":18742,"raft.run_cpu_time_us":2722,"raft.run_wall_time_us":96515,"spinlock_wait_cycles":25007872,"thread_start_us":417412,"threads_started":1,"wal-append.queue_time_us":535760}
I20260709 13:11:53.515503 25303 raft_consensus.cc:1240] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:53.512384 25297 raft_consensus.cc:2410] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:11:53.348021 28308 leader_election.cc:290] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:53.354286 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 64748.7us
I20260709 13:11:53.457950 27945 raft_consensus.cc:493] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.358003 28512 raft_consensus.cc:2804] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:53.547725 25270 leader_election.cc:304] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:53.347219 28319 consensus_queue.cc:237] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:53.468344 28285 raft_consensus.cc:493] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.462687 28180 raft_consensus.cc:740] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:53.543608 25296 raft_consensus.cc:2376] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 8. Re-sending same reply.
I20260709 13:11:53.571146 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:53.553149 25300 raft_consensus.cc:1240] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:53.503846 28147 raft_consensus.cc:493] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.573277 28147 raft_consensus.cc:515] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:53.575577 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:53.575915 28285 raft_consensus.cc:515] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:53.576905 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:53.577915 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:53.578063 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:53.578200 28285 leader_election.cc:290] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:53.578613 25373 raft_consensus.cc:2376] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 8. Re-sending same reply.
I20260709 13:11:53.560294 25374 raft_consensus.cc:1275] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:53.579507 25374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36264 (request call id 1667) took 1671 ms. Trace:
I20260709 13:11:53.579632 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:53.579885 25374 rpcz_store.cc:276] 0709 13:11:51.907653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:53.503359 (+1595706us) service_pool.cc:224] Handling call
0709 13:11:53.503657 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:53.579216 (+ 75559us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:53.579446 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:53.580346 25373 raft_consensus.cc:2468] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 9.
I20260709 13:11:53.580960 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:53.578620 25907 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 8.
I20260709 13:11:53.582365 28180 consensus_queue.cc:260] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:53.583731 28180 raft_consensus.cc:3060] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:53.586602 25301 raft_consensus.cc:1275] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:11:53.587080 25301 pending_rounds.cc:85] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19: Aborting all ops after (but not including) 2
I20260709 13:11:53.587322 25301 pending_rounds.cc:107] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260709 13:11:53.587585 25301 raft_consensus.cc:2889] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:53.558673 25299 raft_consensus.cc:1240] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:53.503561 28454 leader_election.cc:290] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:53.560034 25127 catalog_manager.cc:5697] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:53.374883 28299 consensus_queue.cc:260] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:53.589922 25374 raft_consensus.cc:2410] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:11:53.540899 25378 rpcz_store.cc:276] 0709 13:11:51.211847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.524361 (+1312514us) service_pool.cc:224] Handling call
0709 13:11:52.579719 (+ 55358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:52.627622 (+ 47903us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:52.627651 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:52.668643 (+ 40992us) log.cc:844] Serialized 26 byte log entry
0709 13:11:53.057615 (+388972us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:53.087006 (+ 29391us) log.cc:844] Serialized 14 byte log entry
0709 13:11:53.102781 (+ 15775us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:53.102886 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:53.350189 (+247303us) raft_consensus.cc:1685] finished
0709 13:11:53.350217 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:53.350340 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":246,"prepare.queue_time_us":29243,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":40,"raft.queue_time_us":19209,"raft.run_cpu_time_us":406,"raft.run_wall_time_us":17512,"thread_start_us":361929,"threads_started":1,"wal-append.queue_time_us":575054}
I20260709 13:11:53.595118 25303 raft_consensus.cc:1275] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:11:53.551963 28512 raft_consensus.cc:493] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:53.556532 28511 raft_consensus.cc:2749] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:11:53.587632 28500 consensus_meta.cc:287] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent flushing consensus metadata: real 0.634s	user 0.012s	sys 0.002s
I20260709 13:11:53.598060 25305 raft_consensus.cc:1275] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:11:53.599768 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:53.604130 25377 raft_consensus.cc:3060] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:53.599833 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:53.578859 28285 raft_consensus.cc:493] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.364957 28526 consensus_queue.cc:1059] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.228s
I20260709 13:11:53.602406 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:53.607625 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:53.602064 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:53.609041 25302 raft_consensus.cc:3060] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:53.598693 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 269508us
I20260709 13:11:53.553671 27945 raft_consensus.cc:515] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:53.543226 28373 consensus_queue.cc:1059] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:11:53.616665 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:53.617102 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:53.616897 28513 consensus_queue.cc:1048] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:11:53.621996 25301 raft_consensus.cc:2410] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:11:53.623729 25299 raft_consensus.cc:1240] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:53.629464 25370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36264 (request call id 1663) took 1797 ms. Trace:
I20260709 13:11:53.629908 25370 rpcz_store.cc:276] 0709 13:11:51.831978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.940653 (+1108675us) service_pool.cc:224] Handling call
0709 13:11:52.941053 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:52.942066 (+  1013us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:52.942092 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:52.942680 (+   588us) log.cc:844] Serialized 26 byte log entry
0709 13:11:53.259162 (+316482us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:53.598518 (+339356us) log.cc:844] Serialized 14 byte log entry
0709 13:11:53.599659 (+  1141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:53.599831 (+   172us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:53.629254 (+ 29423us) raft_consensus.cc:1685] finished
0709 13:11:53.629272 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:53.629405 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31060,"prepare.queue_time_us":87013,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"raft.queue_time_us":1242,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":4584,"thread_start_us":604570,"threads_started":2,"wal-append.queue_time_us":676721}
W20260709 13:11:53.643361 28514 log.cc:927] Time spent T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:11:53.644544 28386 leader_election.cc:290] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:53.645473 28517 raft_consensus.cc:2804] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:11:53.646541 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 147532us
I20260709 13:11:53.648343 25270 leader_election.cc:304] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:53.649317 28308 raft_consensus.cc:2804] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:53.649698 28308 raft_consensus.cc:493] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:53.650115 28308 raft_consensus.cc:3060] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:53.645520 25371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36254 (request call id 1921) took 2040 ms. Trace:
I20260709 13:11:53.613552 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:53.653456 25303 raft_consensus.cc:3060] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:11:53.658713 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 301296us
I20260709 13:11:53.660030 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:53.670651 25305 raft_consensus.cc:2410] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:11:53.651407 25371 rpcz_store.cc:276] 0709 13:11:51.604639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.629160 (+1024521us) service_pool.cc:224] Handling call
0709 13:11:52.674271 (+ 45111us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:52.700454 (+ 26183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:52.700500 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:52.751829 (+ 51329us) log.cc:844] Serialized 52 byte log entry
0709 13:11:53.236588 (+484759us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:53.272985 (+ 36397us) log.cc:844] Serialized 14 byte log entry
0709 13:11:53.273563 (+   578us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:53.273790 (+   227us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:53.645203 (+371413us) raft_consensus.cc:1685] finished
0709 13:11:53.645230 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:53.645443 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38084,"prepare.queue_time_us":36088,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":33,"raft.queue_time_us":7936,"raft.run_cpu_time_us":349,"raft.run_wall_time_us":10303,"thread_start_us":414510,"threads_started":1,"wal-append.queue_time_us":724456}
W20260709 13:11:53.648736 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:53.593705 28147 leader_election.cc:290] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:53.603075 28512 raft_consensus.cc:3060] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:53.690367 25344 leader_election.cc:304] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:53.701005 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:53.707031 25127 catalog_manager.cc:5697] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 4 to 7, leader changed from 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 7 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
W20260709 13:11:53.699574 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 68447us
W20260709 13:11:53.709297 25874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:53.713863 25297 raft_consensus.cc:2393] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 8: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:53.717619 28519 raft_consensus.cc:2749] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:53.718391 28519 raft_consensus.cc:493] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.718663 28147 consensus_queue.cc:1059] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:53.718801 28519 raft_consensus.cc:515] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:11:53.719585 28147 raft_consensus.cc:3055] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:53.719967 28147 raft_consensus.cc:740] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:53.720980 28519 leader_election.cc:290] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:53.717612 25344 leader_election.cc:304] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:53.723011 28528 raft_consensus.cc:3055] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:53.723376 28528 raft_consensus.cc:740] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:53.724031 28314 raft_consensus.cc:2749] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:53.723892 28512 raft_consensus.cc:515] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:53.720952 28147 consensus_queue.cc:260] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:53.725617 28147 raft_consensus.cc:3060] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:53.727052 28526 raft_consensus.cc:493] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.727551 28526 raft_consensus.cc:515] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:53.730921 25873 leader_election.cc:304] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:53.733184 28386 raft_consensus.cc:2804] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:53.733767 28386 raft_consensus.cc:697] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:53.734673 28386 consensus_queue.cc:237] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:53.724237 28528 consensus_queue.cc:260] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:53.736860 28528 raft_consensus.cc:3060] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:11:53.743839 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 387081us
I20260709 13:11:53.726295 28512 leader_election.cc:290] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:11:53.726789 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:53.738984 25299 raft_consensus.cc:2468] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 9.
I20260709 13:11:53.745808 25127 catalog_manager.cc:5697] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:11:53.700421 28426 raft_consensus.cc:493] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:53.762440 25343 leader_election.cc:336] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Timed out: RequestConsensusVote RPC to 127.23.140.66:33127 timed out after 1.710s (SENT)
I20260709 13:11:53.762897 25343 leader_election.cc:304] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:53.685873 28285 raft_consensus.cc:515] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:53.764252 25195 leader_election.cc:304] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:53.748034 28299 raft_consensus.cc:3060] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:53.755857 28526 leader_election.cc:290] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:53.768555 28314 raft_consensus.cc:2749] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:11:53.771008 28520 log.cc:927] Time spent T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:11:53.774199 25270 leader_election.cc:304] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:53.774938 27945 leader_election.cc:290] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:53.757421 28454 consensus_queue.cc:1059] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
W20260709 13:11:53.784611 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 69952.3us
I20260709 13:11:53.784611 25271 leader_election.cc:304] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:53.711781 28511 consensus_queue.cc:1059] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:11:53.785360 25127 catalog_manager.cc:5697] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
I20260709 13:11:53.796694 25377 raft_consensus.cc:2468] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 10.
I20260709 13:11:53.759727 28379 consensus_queue.cc:1059] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:11:53.765511 28426 raft_consensus.cc:515] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:53.825580 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 66142.7us
W20260709 13:11:53.828562 25343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:53.828576 28314 raft_consensus.cc:493] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.829331 28538 raft_consensus.cc:493] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:53.829257 28314 raft_consensus.cc:515] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:53.829996 28538 raft_consensus.cc:515] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:53.832020 28538 leader_election.cc:290] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:53.833535 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:53.837132 28314 leader_election.cc:290] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:53.838953 28285 leader_election.cc:290] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:53.842130 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 75718.7us
I20260709 13:11:53.844098 28180 raft_consensus.cc:2749] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:53.846033 25376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36264 (request call id 1657) took 2015 ms. Trace:
I20260709 13:11:53.846124 28517 raft_consensus.cc:493] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:53.846475 25376 rpcz_store.cc:276] 0709 13:11:51.830237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.797100 (+966863us) service_pool.cc:224] Handling call
0709 13:11:52.907717 (+110617us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:52.908134 (+   417us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:52.908172 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:52.908840 (+   668us) log.cc:844] Serialized 26 byte log entry
0709 13:11:53.303425 (+394585us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:53.303474 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:53.303561 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:53.845835 (+542274us) raft_consensus.cc:1685] finished
0709 13:11:53.845856 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:53.845980 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":394153,"threads_started":1,"wal-append.queue_time_us":698580}
I20260709 13:11:53.848115 25303 raft_consensus.cc:2468] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 10.
I20260709 13:11:53.815951 28265 raft_consensus.cc:2749] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:53.815233 25127 catalog_manager.cc:5697] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 4 to 6, leader changed from 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 6 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:53.854800 25872 leader_election.cc:304] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:53.858300 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:53.846649 28517 raft_consensus.cc:3060] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:53.859766 28385 raft_consensus.cc:515] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:53.864203 28513 raft_consensus.cc:3060] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:53.866719 28511 consensus_queue.cc:1059] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:11:53.817735 28405 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.006s	sys 0.016s
I20260709 13:11:53.870796 28405 raft_consensus.cc:2749] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:53.871258 28512 raft_consensus.cc:3055] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:53.876300 28512 raft_consensus.cc:740] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
W20260709 13:11:53.877856 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:53.877468 28512 consensus_queue.cc:260] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:53.879031 28512 raft_consensus.cc:3060] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:53.882476 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:53.852921 25127 catalog_manager.cc:5697] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 4 to 6, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 6 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:53.873028 28426 leader_election.cc:290] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:53.874326 28308 raft_consensus.cc:515] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:53.889019 25302 raft_consensus.cc:2410] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:11:53.896382 25300 raft_consensus.cc:2468] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 8.
I20260709 13:11:53.896695 25379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36264 (request call id 1658) took 2066 ms. Trace:
I20260709 13:11:53.884109 25127 catalog_manager.cc:5697] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 2 to 3, leader changed from 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 3 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:53.900576 25372 raft_consensus.cc:1275] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:11:53.897059 25379 rpcz_store.cc:276] 0709 13:11:51.830517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.902278 (+1071761us) service_pool.cc:224] Handling call
0709 13:11:52.902790 (+   512us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:52.905555 (+  2765us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:52.905587 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:52.915335 (+  9748us) log.cc:844] Serialized 26 byte log entry
0709 13:11:53.294711 (+379376us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:53.686545 (+391834us) log.cc:844] Serialized 14 byte log entry
0709 13:11:53.896384 (+209839us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:53.896471 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:53.896511 (+    40us) raft_consensus.cc:1685] finished
0709 13:11:53.896522 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:53.896647 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16100,"prepare.queue_time_us":51548,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":30495,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"thread_start_us":892364,"threads_started":3,"wal-append.queue_time_us":591931}
I20260709 13:11:53.903292 25377 raft_consensus.cc:1275] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:11:53.903895 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 351449us
W20260709 13:11:53.922426 25194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:53.923573 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:53.924444 25227 raft_consensus.cc:2393] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 10: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:53.925822 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:53.926353 25227 raft_consensus.cc:2468] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 7.
I20260709 13:11:53.926999 28308 leader_election.cc:290] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:53.927454 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:53.927616 28308 consensus_queue.cc:1048] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:53.928303 25227 raft_consensus.cc:2410] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:11:53.885978 28385 leader_election.cc:290] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:53.928900 25377 raft_consensus.cc:1275] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:53.932787 25372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36264 (request call id 1664) took 2100 ms. Trace:
I20260709 13:11:53.934228 25372 rpcz_store.cc:276] 0709 13:11:51.832270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.951479 (+1119209us) service_pool.cc:224] Handling call
0709 13:11:53.896669 (+945190us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:53.901060 (+  4391us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:53.932504 (+ 31444us) spinlock_profiling.cc:243] Waited 945 ms on lock 0x7b5400311ad0. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6e8ad 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:53.932676 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2172759936}
I20260709 13:11:53.942394 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:53.942518 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:53.944525 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:53.943588 25376 raft_consensus.cc:2468] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 4.
W20260709 13:11:53.949635 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:53.953696 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:53.929968 28319 raft_consensus.cc:493] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:53.944872 28299 raft_consensus.cc:493] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:53.987596 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:53.987725 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 223545us
I20260709 13:11:53.989323 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:54.000888 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:54.002890 25226 raft_consensus.cc:2468] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 7.
W20260709 13:11:54.007130 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 164236us
I20260709 13:11:54.018002 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:53.988870 28319 raft_consensus.cc:515] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:53.995244 28299 raft_consensus.cc:515] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:54.009405 28513 raft_consensus.cc:2749] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:54.044255 25226 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 8.
W20260709 13:11:54.061582 28543 log.cc:927] Time spent T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:11:54.061861 28517 raft_consensus.cc:515] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:11:54.062927 28299 leader_election.cc:290] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:54.064311 28517 leader_election.cc:290] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:54.058522 25345 leader_election.cc:304] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
W20260709 13:11:54.065268 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 123706us
I20260709 13:11:54.066022 28299 raft_consensus.cc:2804] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:54.066565 28299 raft_consensus.cc:493] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:54.066902 28299 raft_consensus.cc:3060] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:54.065996 25345 leader_election.cc:304] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:54.068647 28549 raft_consensus.cc:2749] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:54.069537 25345 leader_election.cc:304] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:54.069950 25271 leader_election.cc:400] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 election: Vote denied by peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361) with higher term. Message: Invalid argument: T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for earlier term 9. Current term is 10.
I20260709 13:11:54.070273 25271 leader_election.cc:403] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:11:54.070573 25345 leader_election.cc:304] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:54.071918 25345 leader_election.cc:304] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:54.072388 28550 raft_consensus.cc:2749] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:11:54.072748 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 307430us
I20260709 13:11:54.070771 28549 raft_consensus.cc:2804] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:54.073585 25270 leader_election.cc:304] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:54.073980 28549 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:54.075412 28549 raft_consensus.cc:3060] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:54.075546 25271 leader_election.cc:304] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:54.074304 28553 raft_consensus.cc:2749] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:54.081940 28517 raft_consensus.cc:2749] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361) with higher term. Message: Invalid argument: T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for earlier term 9. Current term is 10.
I20260709 13:11:54.082260 28560 raft_consensus.cc:2749] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:54.083014 28560 raft_consensus.cc:2749] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:54.082839 28517 consensus_queue.cc:1059] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:54.083715 28560 raft_consensus.cc:3055] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:54.075254 28299 raft_consensus.cc:515] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:54.084080 28560 raft_consensus.cc:740] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:54.085045 28560 consensus_queue.cc:260] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:54.084435 25271 leader_election.cc:304] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:54.086932 25270 leader_election.cc:304] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:54.087034 28402 raft_consensus.cc:2804] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:54.096086 25375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36264 (request call id 1665) took 2263 ms. Trace:
I20260709 13:11:54.088439 28426 raft_consensus.cc:493] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.097299 28402 raft_consensus.cc:493] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:54.097618 28426 raft_consensus.cc:515] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:54.097921 28402 raft_consensus.cc:3060] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:54.097354 25375 rpcz_store.cc:276] 0709 13:11:51.833017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:53.138901 (+1305884us) service_pool.cc:224] Handling call
0709 13:11:53.160590 (+ 21689us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:53.256741 (+ 96151us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:11:53.606276 (+349535us) log.cc:844] Serialized 14 byte log entry
0709 13:11:54.004153 (+397877us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:54.012140 (+  7987us) log.cc:844] Serialized 26 byte log entry
0709 13:11:54.012314 (+   174us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:54.012563 (+   249us) log.cc:844] Serialized 14 byte log entry
0709 13:11:54.016495 (+  3932us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:54.016579 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:54.095828 (+ 79249us) raft_consensus.cc:1685] finished
0709 13:11:54.095848 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:54.096010 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36828,"prepare.queue_time_us":82244,"prepare.run_cpu_time_us":212,"prepare.run_wall_time_us":18278,"raft.queue_time_us":32422,"raft.run_cpu_time_us":492,"raft.run_wall_time_us":49525,"thread_start_us":662629,"threads_started":2,"wal-append.queue_time_us":433181}
I20260709 13:11:54.099809 28426 leader_election.cc:290] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:54.087827 28299 leader_election.cc:290] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:54.093132 25345 leader_election.cc:304] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:54.100994 28299 raft_consensus.cc:2804] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:54.101403 28299 raft_consensus.cc:493] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:54.102002 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:54.102234 28517 raft_consensus.cc:3060] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:54.102094 28299 raft_consensus.cc:3060] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:54.087193 28319 leader_election.cc:290] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:54.103839 25270 leader_election.cc:304] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:54.104637 28454 raft_consensus.cc:2804] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:54.105156 28454 raft_consensus.cc:697] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 10 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:54.106068 28454 consensus_queue.cc:237] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:54.106945 25226 raft_consensus.cc:1275] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:11:54.108769 28379 consensus_queue.cc:1059] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:54.101410 25345 leader_election.cc:304] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:54.088387 25195 leader_election.cc:400] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 election: Vote denied by peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085) with higher term. Message: Invalid argument: T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 8. Current term is 9.
I20260709 13:11:54.111048 25195 leader_election.cc:403] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
W20260709 13:11:54.112371 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 71548.9us
I20260709 13:11:54.113232 25345 leader_election.cc:304] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:54.122291 25230 raft_consensus.cc:1275] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:11:54.122781 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 62620us
I20260709 13:11:54.124207 25345 leader_election.cc:304] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:54.125043 25223 raft_consensus.cc:1275] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:11:54.130254 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:54.128084 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:54.128687 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:54.146231 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:54.150058 25226 raft_consensus.cc:1275] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:11:54.155218 25223 raft_consensus.cc:1275] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:11:54.127935 28147 raft_consensus.cc:2804] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:54.156250 28147 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:54.156610 28147 raft_consensus.cc:3060] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:54.122460 28553 raft_consensus.cc:2749] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:54.155575 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:54.159643 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:54.159682 25230 raft_consensus.cc:2468] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 8.
I20260709 13:11:54.162804 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:54.129108 28285 raft_consensus.cc:2804] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:54.164819 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:11:54.165146 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 59267.1us
I20260709 13:11:54.166847 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:54.165632 25223 raft_consensus.cc:2468] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 7.
I20260709 13:11:54.128253 28554 raft_consensus.cc:2749] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085) with higher term. Message: Invalid argument: T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 8. Current term is 9.
I20260709 13:11:54.168390 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:54.169306 25227 raft_consensus.cc:2393] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 9: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:54.175854 28552 consensus_queue.cc:1059] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:11:54.176838 28558 log.cc:927] Time spent T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 13:11:54.180502 28560 raft_consensus.cc:3060] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:54.182317 28405 raft_consensus.cc:3055] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:54.182713 28405 raft_consensus.cc:740] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:54.187625 25195 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:54.190208 25873 leader_election.cc:304] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:54.166045 28285 raft_consensus.cc:493] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:54.204715 28553 raft_consensus.cc:493] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.204864 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:54.205258 28553 raft_consensus.cc:515] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:54.206756 25194 leader_election.cc:304] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:54.196650 28530 raft_consensus.cc:3055] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:54.208065 28530 raft_consensus.cc:740] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:54.208216 28526 raft_consensus.cc:2749] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:54.209081 28530 consensus_queue.cc:260] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:54.210469 28530 raft_consensus.cc:3060] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:54.210922 28426 raft_consensus.cc:493] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:54.211462 28426 raft_consensus.cc:515] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:54.204172 28285 raft_consensus.cc:3060] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:54.213922 28180 consensus_queue.cc:1059] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:54.207667 28553 leader_election.cc:290] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:54.215711 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:54.214429 28314 raft_consensus.cc:493] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:54.164438 28556 consensus_queue.cc:1048] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:11:54.226014 25371 raft_consensus.cc:1275] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:54.183602 28405 consensus_queue.cc:260] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:54.232280 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:54.233557 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:54.233794 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:54.247381 25302 raft_consensus.cc:2468] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 8.
I20260709 13:11:54.188849 28549 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:54.247809 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:54.235044 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:54.236055 25375 raft_consensus.cc:1275] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:11:54.236212 28565 log.cc:927] Time spent T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:11:54.213569 28426 leader_election.cc:290] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:54.198350 28528 raft_consensus.cc:3055] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:54.246703 25296 raft_consensus.cc:2468] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 9.
I20260709 13:11:54.201918 28385 raft_consensus.cc:2804] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:54.176885 28552 consensus_queue.cc:1048] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:11:54.252640 25304 raft_consensus.cc:2468] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 7.
I20260709 13:11:54.193423 28386 consensus_queue.cc:1048] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:11:54.198067 28513 consensus_queue.cc:1048] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:11:54.264504 28566 consensus_queue.cc:1059] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:11:54.270323 28147 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:54.270836 28549 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:54.260763 28373 consensus_queue.cc:1059] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:11:54.260524 28553 consensus_queue.cc:1059] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:11:54.257663 28385 raft_consensus.cc:493] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:54.272891 28385 raft_consensus.cc:3060] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:54.273049 28553 raft_consensus.cc:3055] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:54.273502 28553 raft_consensus.cc:740] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
W20260709 13:11:54.273878 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 67203.1us
I20260709 13:11:54.258670 28538 raft_consensus.cc:2804] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:54.257459 28265 raft_consensus.cc:3055] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:54.251854 28528 raft_consensus.cc:740] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:54.278813 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:54.238091 28314 raft_consensus.cc:515] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:54.249058 28511 consensus_queue.cc:1048] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:11:54.293023 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:54.293907 25304 raft_consensus.cc:2468] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 5.
I20260709 13:11:54.283242 28517 raft_consensus.cc:2749] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:54.286134 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:54.286396 28373 consensus_queue.cc:1048] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:54.290086 28553 consensus_queue.cc:260] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:54.258867 28508 consensus_queue.cc:1048] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:11:54.314872 28553 raft_consensus.cc:3060] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:54.315130 28314 leader_election.cc:290] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:54.307049 25298 raft_consensus.cc:2393] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 6: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:54.310107 28569 raft_consensus.cc:3055] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:54.310220 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:54.312229 28180 consensus_queue.cc:1059] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:54.316336 25270 leader_election.cc:304] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:54.276958 28147 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:54.278647 28265 raft_consensus.cc:740] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
W20260709 13:11:54.326517 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 79835us
I20260709 13:11:54.328212 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:54.330931 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:54.331348 25343 leader_election.cc:304] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:54.295284 28538 raft_consensus.cc:697] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 8 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:54.332931 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:54.333997 25304 raft_consensus.cc:2410] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:11:54.293433 28454 consensus_queue.cc:1048] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:11:54.337494 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:54.337551 28265 consensus_queue.cc:260] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:54.338415 28402 raft_consensus.cc:515] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:54.318837 28566 consensus_queue.cc:1048] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:11:54.342324 28526 raft_consensus.cc:3055] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:54.343142 28299 raft_consensus.cc:515] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:54.322237 28569 raft_consensus.cc:740] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:54.353210 25195 leader_election.cc:304] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:54.344383 28405 raft_consensus.cc:3060] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:54.359267 25343 leader_election.cc:304] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:54.350888 25904 raft_consensus.cc:2468] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 6.
W20260709 13:11:54.352074 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 52685.9us
I20260709 13:11:54.334412 25227 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9"
dest_uuid: "1f539ba21487460085b837e7529a78ce"
mode: GRACEFUL
new_leader_uuid: "da445ce82dc4467f95f4fa52297eaa19"
 from {username='slave'} at 127.0.0.1:45014
W20260709 13:11:54.355285 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 78025.7us
I20260709 13:11:54.360862 25227 raft_consensus.cc:606] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Received request to transfer leadership to TS da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:54.360797 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:54.361308 25227 raft_consensus.cc:614] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:54.361502 25304 raft_consensus.cc:2468] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 8.
I20260709 13:11:54.335939 28314 raft_consensus.cc:2749] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:54.366758 25270 leader_election.cc:304] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:54.373463 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:54.378054 25344 leader_election.cc:304] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:54.355438 28517 raft_consensus.cc:2804] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:54.351282 28526 raft_consensus.cc:740] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:54.379262 25343 leader_election.cc:304] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:54.381678 28550 raft_consensus.cc:2804] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:54.382146 28550 raft_consensus.cc:493] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:54.381917 28538 consensus_queue.cc:237] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:54.382511 28550 raft_consensus.cc:3060] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:54.385044 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:54.385883 25296 raft_consensus.cc:2393] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 8: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:54.386188 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:54.386605 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:54.387378 25302 raft_consensus.cc:2393] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 10: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:54.374946 28147 raft_consensus.cc:2749] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:54.388172 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:54.388799 25300 raft_consensus.cc:2468] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 9.
I20260709 13:11:54.389593 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:54.390147 25303 raft_consensus.cc:3060] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:54.390560 28373 consensus_queue.cc:1048] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:54.392396 28373 consensus_queue.cc:1048] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:54.380208 28517 raft_consensus.cc:493] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:54.393818 28517 raft_consensus.cc:3060] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:54.394135 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:54.394906 25299 raft_consensus.cc:2410] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:11:54.395753 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:54.353389 28569 consensus_queue.cc:260] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:54.397737 28569 raft_consensus.cc:3060] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:54.389916 28180 consensus_queue.cc:1059] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:54.394676 25270 leader_election.cc:304] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:54.404713 25303 raft_consensus.cc:2468] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 6.
I20260709 13:11:54.407366 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:11:54.407879 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:54.415889 28308 consensus_queue.cc:1048] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:54.418404 28308 consensus_queue.cc:1048] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:54.421125 28180 raft_consensus.cc:3055] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:54.421571 28180 raft_consensus.cc:740] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:54.422407 28180 consensus_queue.cc:260] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:54.423475 28180 raft_consensus.cc:3060] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:54.424942 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:54.425583 28147 raft_consensus.cc:2749] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:54.426738 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:54.427796 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
W20260709 13:11:54.428684 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 75554.4us
I20260709 13:11:54.428995 28526 consensus_queue.cc:260] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:54.424959 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:54.430315 25296 raft_consensus.cc:2393] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 6: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:54.431190 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:54.431982 25296 raft_consensus.cc:2393] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 8: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:54.346690 28528 consensus_queue.cc:260] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:54.432850 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:54.393572 28285 raft_consensus.cc:515] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:54.374663 28552 raft_consensus.cc:2749] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:54.434710 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:54.429416 25195 leader_election.cc:304] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:54.435578 25223 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f"
dest_uuid: "1f539ba21487460085b837e7529a78ce"
mode: GRACEFUL
new_leader_uuid: "da445ce82dc4467f95f4fa52297eaa19"
 from {username='slave'} at 127.0.0.1:45014
I20260709 13:11:54.436177 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:54.452555 25223 raft_consensus.cc:606] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 8 LEADER]: Received request to transfer leadership to TS da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:54.453238 25304 raft_consensus.cc:2393] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 8: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:54.436343 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:54.454048 25271 leader_election.cc:304] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:54.425117 28502 raft_consensus.cc:493] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:54.459784 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 71958.5us
I20260709 13:11:54.454255 25303 raft_consensus.cc:3060] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:54.456817 25300 raft_consensus.cc:2393] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 7: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:54.462116 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:54.467730 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:54.467672 25224 raft_consensus.cc:1275] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:54.467727 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:54.470072 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:54.471488 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:54.472180 25302 raft_consensus.cc:3060] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:54.473356 25904 raft_consensus.cc:1275] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:11:54.406071 28560 raft_consensus.cc:2749] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:54.478005 25299 raft_consensus.cc:2393] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 10: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:54.478499 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:54.481623 25296 raft_consensus.cc:2393] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 6: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:54.470818 25301 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 5.
I20260709 13:11:54.430337 28526 raft_consensus.cc:3060] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:54.483347 25300 raft_consensus.cc:1275] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:54.484750 25304 raft_consensus.cc:1275] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:11:54.483534 25227 raft_consensus.cc:1275] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
W20260709 13:11:54.483294 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 118378us
I20260709 13:11:54.489025 25343 leader_election.cc:304] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:11:54.494311 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 64965.3us
I20260709 13:11:54.494657 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:54.500761 25303 raft_consensus.cc:2468] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 10.
W20260709 13:11:54.487399 25270 connection.cc:256] RPC call timeout handler was delayed by -1.2809347550000894s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1555s for a response
W20260709 13:11:54.503285 25270 connection.cc:256] RPC call timeout handler was delayed by -1.0181347550001192s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1847s for a response
I20260709 13:11:54.503850 25270 leader_election.cc:304] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:54.503307 25195 leader_election.cc:304] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:54.529141 25906 raft_consensus.cc:2393] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 6: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:11:54.461885 28308 consensus_queue.cc:1048] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
W20260709 13:11:54.529148 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 44201.3us
I20260709 13:11:54.478312 28512 raft_consensus.cc:493] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.487030 28530 raft_consensus.cc:2749] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:54.451649 28567 consensus_queue.cc:1048] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:11:54.468428 28502 raft_consensus.cc:515] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:54.488787 28379 raft_consensus.cc:493] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:54.527381 28265 raft_consensus.cc:3060] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:54.541528 25194 leader_election.cc:304] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:54.540079 25302 raft_consensus.cc:2468] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 9.
I20260709 13:11:54.528476 28147 raft_consensus.cc:2749] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:54.542654 25227 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a"
dest_uuid: "1f539ba21487460085b837e7529a78ce"
mode: GRACEFUL
new_leader_uuid: "79d99c0e498349bda74127365219e468"
 from {username='slave'} at 127.0.0.1:45014
I20260709 13:11:54.544523 25227 raft_consensus.cc:606] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Received request to transfer leadership to TS 79d99c0e498349bda74127365219e468
I20260709 13:11:54.544930 25227 raft_consensus.cc:614] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:54.546139 28549 raft_consensus.cc:493] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.546545 25270 leader_election.cc:304] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:54.528298 28314 consensus_queue.cc:1048] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:11:54.581316 25270 leader_election.cc:304] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:54.582943 25270 leader_election.cc:304] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:54.588343 25372 raft_consensus.cc:1275] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:11:54.537169 28512 raft_consensus.cc:515] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:54.550923 28454 raft_consensus.cc:2749] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:11:54.592114 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 55120.3us
I20260709 13:11:54.543893 28552 consensus_queue.cc:1059] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:11:54.599596 25343 leader_election.cc:304] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:54.599061 25270 leader_election.cc:304] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
W20260709 13:11:54.597702 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:54.598006 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 66586.9us
I20260709 13:11:54.580003 28538 raft_consensus.cc:2749] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:54.587029 28530 raft_consensus.cc:2749] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:54.586572 28560 raft_consensus.cc:2749] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:54.551652 28549 raft_consensus.cc:515] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:54.611120 25379 raft_consensus.cc:1240] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:54.593107 28559 raft_consensus.cc:2804] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:54.544119 28379 raft_consensus.cc:515] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:54.536731 28574 consensus_queue.cc:1048] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 13:11:54.595399 28566 raft_consensus.cc:3060] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:54.595310 28557 raft_consensus.cc:2804] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:54.595793 28402 leader_election.cc:290] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:54.602555 28308 raft_consensus.cc:2749] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:11:54.641707 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 138468us
I20260709 13:11:54.601740 28299 leader_election.cc:290] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:11:54.644733 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 45800.6us
W20260709 13:11:54.646718 28580 log.cc:927] Time spent T 00000000000000000000000000000000 P 5140a3161b944724a989995efdc4a818: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:11:54.646934 28502 leader_election.cc:290] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:54.649392 25227 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483"
dest_uuid: "1f539ba21487460085b837e7529a78ce"
mode: GRACEFUL
new_leader_uuid: "da445ce82dc4467f95f4fa52297eaa19"
 from {username='slave'} at 127.0.0.1:45014
I20260709 13:11:54.662415 25227 raft_consensus.cc:606] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 8 LEADER]: Received request to transfer leadership to TS da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:54.644037 28405 raft_consensus.cc:2804] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:54.644337 28557 raft_consensus.cc:493] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:54.679414 25195 leader_election.cc:304] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:54.661962 28552 raft_consensus.cc:3055] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:54.683013 24113 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:11:54.686273 28584 raft_consensus.cc:493] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:54.697887 28574 raft_consensus.cc:2749] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:54.662465 28560 consensus_queue.cc:1048] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:11:54.694039 28517 raft_consensus.cc:515] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:54.695039 28583 log.cc:927] Time spent T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:11:54.695788 28581 log.cc:927] Time spent T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
W20260709 13:11:54.696621 28582 log.cc:927] Time spent T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:11:54.671087 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:54.697803 28591 raft_consensus.cc:2804] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:11:54.703436 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:54.715981 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 44270.9us
W20260709 13:11:54.703473 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:54.699980 24113 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:54.687013 28385 raft_consensus.cc:515] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:54.678794 28557 raft_consensus.cc:3060] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:54.714440 25379 raft_consensus.cc:2468] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 8.
I20260709 13:11:54.719550 28379 leader_election.cc:290] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:54.723260 28573 consensus_queue.cc:1048] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:54.723539 28500 consensus_queue.cc:1059] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:11:54.724047 28577 log.cc:927] Time spent T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 13:11:54.724792 28512 leader_election.cc:290] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:54.704918 28147 raft_consensus.cc:493] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:54.725700 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:54.725857 28584 raft_consensus.cc:515] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:54.727392 25872 leader_election.cc:304] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:54.728533 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:54.715781 28591 raft_consensus.cc:493] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:54.700455 28552 raft_consensus.cc:740] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:54.700742 28405 raft_consensus.cc:697] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 6 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:54.750506 25195 leader_election.cc:304] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:54.756922 25375 raft_consensus.cc:2468] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 12.
I20260709 13:11:54.757726 25872 leader_election.cc:304] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:11:54.743961 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 175133us
I20260709 13:11:54.768648 25873 leader_election.cc:304] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:54.772655 25873 leader_election.cc:304] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
W20260709 13:11:54.750272 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 211202us
I20260709 13:11:54.777679 25872 leader_election.cc:304] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:11:54.775799 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 176272us
I20260709 13:11:54.751163 28500 raft_consensus.cc:3055] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:54.798409 28373 raft_consensus.cc:493] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.798702 28500 raft_consensus.cc:740] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:54.799258 28373 raft_consensus.cc:515] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:54.751981 28571 raft_consensus.cc:3055] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:54.756650 28502 raft_consensus.cc:3060] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:54.756443 28584 leader_election.cc:290] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:54.757092 28591 raft_consensus.cc:3060] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:54.780500 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:54.764545 28517 leader_election.cc:290] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:54.807184 25343 leader_election.cc:304] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:54.809230 25195 leader_election.cc:304] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:54.812266 25906 raft_consensus.cc:3060] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:54.805816 25194 leader_election.cc:304] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:54.805816 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:54.819106 25904 raft_consensus.cc:2393] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 7: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:11:54.762127 28285 leader_election.cc:290] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:54.780592 28573 raft_consensus.cc:2804] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:54.783144 28386 raft_consensus.cc:2804] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:54.782990 28512 raft_consensus.cc:2804] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:54.771261 28508 consensus_queue.cc:1048] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:11:54.757907 28513 consensus_queue.cc:1048] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
W20260709 13:11:54.838976 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 54185.1us
I20260709 13:11:54.804102 28566 raft_consensus.cc:2749] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:54.763314 28147 raft_consensus.cc:515] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:54.848872 25194 leader_election.cc:304] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:54.849004 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:54.798477 28595 raft_consensus.cc:2804] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:11:54.849675 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 66021us
I20260709 13:11:54.867856 25343 leader_election.cc:304] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:54.861614 25195 leader_election.cc:304] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:54.842458 28584 raft_consensus.cc:2804] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:54.802167 28571 raft_consensus.cc:740] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:54.867098 25904 raft_consensus.cc:2468] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 8.
W20260709 13:11:54.868798 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:54.838312 28573 raft_consensus.cc:493] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:54.758595 28405 consensus_queue.cc:237] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:54.876195 25343 leader_election.cc:304] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:54.841295 28512 raft_consensus.cc:493] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:54.870555 28559 raft_consensus.cc:697] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 8 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:54.848825 28180 raft_consensus.cc:2804] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:54.799893 28500 consensus_queue.cc:260] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:54.848701 28549 leader_election.cc:290] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:54.885295 25904 raft_consensus.cc:1275] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:54.757740 28552 consensus_queue.cc:260] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:54.866789 28386 raft_consensus.cc:697] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:54.870217 28595 raft_consensus.cc:493] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:54.891445 25194 leader_election.cc:304] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:54.881069 28556 raft_consensus.cc:2804] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:54.879727 28573 raft_consensus.cc:3060] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:54.881592 28512 raft_consensus.cc:3060] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:54.895813 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 290598us
I20260709 13:11:54.885615 28180 raft_consensus.cc:493] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:54.887208 28584 raft_consensus.cc:697] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 9 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:54.891415 28538 raft_consensus.cc:2749] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:54.920477 28147 leader_election.cc:290] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:54.922191 28386 consensus_queue.cc:237] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:54.922839 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:54.923493 25900 raft_consensus.cc:2468] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 6.
I20260709 13:11:54.924242 25905 raft_consensus.cc:1240] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:54.924587 28571 consensus_queue.cc:260] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:54.905951 28550 consensus_meta.cc:287] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.523s	user 0.010s	sys 0.001s
I20260709 13:11:54.926117 28550 raft_consensus.cc:515] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:54.927045 28600 consensus_queue.cc:1048] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:54.928089 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:54.928661 28588 consensus_queue.cc:1048] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:11:54.929056 28597 raft_consensus.cc:2804] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:54.929551 28597 raft_consensus.cc:493] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:54.929993 28597 raft_consensus.cc:3060] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:54.930348 28572 raft_consensus.cc:2804] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:54.930572 25344 leader_election.cc:304] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:54.931017 28572 raft_consensus.cc:697] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:54.910816 28500 raft_consensus.cc:3060] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:54.932044 28572 consensus_queue.cc:237] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:54.926357 25270 leader_election.cc:304] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:54.935014 25270 leader_election.cc:304] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:54.936094 25908 raft_consensus.cc:1275] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:11:54.935345 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:54.926465 28590 log.cc:927] Time spent T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.239s	user 0.001s	sys 0.001s
I20260709 13:11:54.928663 25302 raft_consensus.cc:2468] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 8.
I20260709 13:11:54.892982 28595 raft_consensus.cc:3060] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:54.938977 25195 leader_election.cc:304] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:54.944525 25223 raft_consensus.cc:1275] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:11:54.902702 28549 raft_consensus.cc:2749] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:11:54.949077 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 72912.5us
I20260709 13:11:54.949616 25270 leader_election.cc:304] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:54.905369 28180 raft_consensus.cc:3060] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:54.952888 25906 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 9.
I20260709 13:11:54.904001 28556 raft_consensus.cc:697] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 10 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:54.956387 25343 leader_election.cc:304] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:54.957851 25343 leader_election.cc:304] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:54.962402 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:54.911994 28530 raft_consensus.cc:2749] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:54.966162 25908 raft_consensus.cc:1240] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:11:54.969091 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:54.941269 28571 raft_consensus.cc:3060] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:54.970562 28598 raft_consensus.cc:2804] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:54.979956 28556 consensus_queue.cc:237] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:54.981160 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:54.982318 28559 consensus_queue.cc:237] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:54.982856 28512 raft_consensus.cc:515] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:54.985175 28605 raft_consensus.cc:2804] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:54.985037 28379 consensus_queue.cc:1048] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:54.986317 28373 leader_election.cc:290] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:54.987046 28530 raft_consensus.cc:2749] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:54.987704 28561 consensus_queue.cc:1059] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:54.947378 28285 raft_consensus.cc:2804] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:54.992177 25221 raft_consensus.cc:1275] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:11:54.939702 28600 raft_consensus.cc:2749] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:54.947669 28588 raft_consensus.cc:2749] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:54.990104 25226 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 6.
W20260709 13:11:55.023612 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 64501.2us
I20260709 13:11:55.006668 28598 raft_consensus.cc:493] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:55.007462 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:54.940974 28385 leader_election.cc:290] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 5 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:54.963382 28147 raft_consensus.cc:2749] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:11:55.019062 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 127692us
W20260709 13:11:55.022714 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 49485.9us
I20260709 13:11:55.018857 28599 raft_consensus.cc:2804] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:55.011039 28605 raft_consensus.cc:493] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:55.060107 25343 leader_election.cc:304] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:55.017268 28550 leader_election.cc:290] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:55.065542 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:55.026402 28285 raft_consensus.cc:493] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:55.075258 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:55.072000 25194 leader_election.cc:304] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:55.076112 25372 raft_consensus.cc:3060] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:55.038762 28598 raft_consensus.cc:3060] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:55.014616 28454 consensus_queue.cc:1048] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:11:55.055727 28599 raft_consensus.cc:493] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:55.026012 28402 consensus_queue.cc:1048] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:11:55.063342 28605 raft_consensus.cc:3060] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:55.082553 28599 raft_consensus.cc:3060] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:54.989043 28584 consensus_queue.cc:237] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:55.074087 28285 raft_consensus.cc:3060] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:55.088863 25343 leader_election.cc:304] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:55.075884 28314 raft_consensus.cc:2749] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:11:55.105155 25194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:55.106864 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:55.108420 25343 leader_election.cc:304] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:11:55.111351 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 201631us
I20260709 13:11:55.093227 28373 raft_consensus.cc:2749] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:55.123574 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:55.125639 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:55.126818 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:55.129338 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:11:55.131510 28608 log.cc:927] Time spent T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 13:11:55.132817 28613 raft_consensus.cc:493] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.133387 28613 raft_consensus.cc:515] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:55.134509 28596 raft_consensus.cc:2749] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:55.135847 28613 leader_election.cc:290] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:55.129964 25229 raft_consensus.cc:2468] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 9.
I20260709 13:11:55.136135 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:55.138083 25222 raft_consensus.cc:2410] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:11:55.106734 28530 raft_consensus.cc:493] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.138897 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:55.142813 25222 raft_consensus.cc:3060] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:55.140353 25343 leader_election.cc:304] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:55.121131 28528 raft_consensus.cc:3060] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:55.144699 25343 leader_election.cc:304] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:55.145505 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
W20260709 13:11:55.167586 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 221810us
I20260709 13:11:55.200523 25229 raft_consensus.cc:3060] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:11:55.200986 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:55.136798 28314 raft_consensus.cc:493] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.205467 25372 raft_consensus.cc:2468] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 5.
I20260709 13:11:55.208091 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:11:55.208261 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 63590.7us
I20260709 13:11:55.119182 28549 consensus_queue.cc:1048] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
W20260709 13:11:55.214972 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:55.141978 28147 raft_consensus.cc:2749] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:11:55.215844 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 85261.6us
I20260709 13:11:55.206010 28596 raft_consensus.cc:2804] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:55.239817 25222 raft_consensus.cc:2468] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 8.
I20260709 13:11:55.241308 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:55.207988 28500 raft_consensus.cc:493] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.144001 28530 raft_consensus.cc:515] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:55.272812 25195 leader_election.cc:304] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:55.274246 25375 raft_consensus.cc:1275] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:11:55.314947 28265 raft_consensus.cc:3055] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:55.315387 28265 raft_consensus.cc:740] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:55.316257 28265 consensus_queue.cc:260] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:55.317212 28265 raft_consensus.cc:3060] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:55.318504 25372 raft_consensus.cc:1275] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 3. (term mismatch)
I20260709 13:11:55.318867 25372 pending_rounds.cc:85] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468: Aborting all ops after (but not including) 2
I20260709 13:11:55.319096 25372 pending_rounds.cc:107] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:11:55.319316 25372 raft_consensus.cc:2889] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:55.319589 25372 pending_rounds.cc:107] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:11:55.319829 25372 raft_consensus.cc:2889] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:55.221837 28314 raft_consensus.cc:515] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:55.221912 28426 raft_consensus.cc:2749] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:11:55.249035 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:55.285455 28615 log.cc:927] Time spent T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260709 13:11:55.385844 25229 raft_consensus.cc:2468] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 10.
I20260709 13:11:55.291851 28597 raft_consensus.cc:515] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:55.287966 25908 raft_consensus.cc:1240] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:55.294109 28512 leader_election.cc:290] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:55.213701 28454 consensus_queue.cc:1059] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:11:55.309054 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:55.406358 25224 raft_consensus.cc:3060] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:55.236543 28299 raft_consensus.cc:493] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.337589 25375 raft_consensus.cc:1240] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 8. Current term is 9. Ops: []
W20260709 13:11:55.337901 25874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:55.329166 25305 raft_consensus.cc:2468] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 9.
I20260709 13:11:55.341012 28599 raft_consensus.cc:515] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:55.344049 28314 leader_election.cc:290] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:55.347735 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:11:55.348465 28591 consensus_meta.cc:287] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.510s	user 0.005s	sys 0.004s
I20260709 13:11:55.305401 28500 raft_consensus.cc:515] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:55.353945 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:55.355962 28526 raft_consensus.cc:993] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce: : Instructing follower da445ce82dc4467f95f4fa52297eaa19 to start an election
W20260709 13:11:55.356235 28502 consensus_meta.cc:287] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent flushing consensus metadata: real 0.551s	user 0.010s	sys 0.000s
W20260709 13:11:55.356777 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 112163us
I20260709 13:11:55.357939 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:11:55.358517 28616 log.cc:927] Time spent T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 13:11:55.360810 28180 raft_consensus.cc:515] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:55.451900 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:55.466440 25300 raft_consensus.cc:3060] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:55.365603 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:55.366914 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:55.367064 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:55.467442 25373 raft_consensus.cc:3060] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:55.367637 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:55.368362 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:55.368865 28573 raft_consensus.cc:515] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:55.370254 28574 raft_consensus.cc:493] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.370729 28530 leader_election.cc:290] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:55.370846 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:55.474066 25374 raft_consensus.cc:3060] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:55.408197 28567 consensus_queue.cc:1048] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
W20260709 13:11:55.375480 28557 consensus_meta.cc:287] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.627s	user 0.009s	sys 0.000s
I20260709 13:11:55.313122 28584 raft_consensus.cc:2804] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:11:55.378809 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:55.482299 25195 leader_election.cc:304] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
W20260709 13:11:55.483640 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:55.484069 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:55.382699 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:11:55.385047 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:55.406409 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:55.407614 25372 raft_consensus.cc:1275] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:11:55.353320 28595 raft_consensus.cc:515] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:55.438726 25375 raft_consensus.cc:1275] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:11:55.438365 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:55.439466 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:55.406888 28508 raft_consensus.cc:493] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.364483 25345 leader_election.cc:304] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:55.470461 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:55.470764 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:55.468082 25371 raft_consensus.cc:2468] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 8.
I20260709 13:11:55.371265 28285 raft_consensus.cc:515] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:55.469235 25377 raft_consensus.cc:2468] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 8.
I20260709 13:11:55.477187 25378 raft_consensus.cc:2368] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for earlier term 9. Current term is 10.
I20260709 13:11:55.421873 28596 raft_consensus.cc:697] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 6 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:55.502700 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:55.503367 25370 raft_consensus.cc:3060] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:55.479605 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
W20260709 13:11:55.490916 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 434778us
I20260709 13:11:55.491982 25225 raft_consensus.cc:2393] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 10: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:55.508069 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:55.508325 25377 raft_consensus.cc:1240] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:55.493938 25303 raft_consensus.cc:2410] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:11:55.474124 28502 raft_consensus.cc:2749] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:11:55.502019 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 137624us
I20260709 13:11:55.510201 25345 leader_election.cc:304] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:55.448326 28299 raft_consensus.cc:515] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:55.516064 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:55.517385 25300 raft_consensus.cc:2468] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 10.
I20260709 13:11:55.517664 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:55.519001 25302 raft_consensus.cc:2468] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 6.
I20260709 13:11:55.521816 25303 raft_consensus.cc:1240] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 7. Current term is 8. Ops: [4.3-7.4]
I20260709 13:11:55.522030 25345 leader_election.cc:304] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:55.523597 25228 raft_consensus.cc:2393] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 6: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:55.525688 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:55.526391 25345 leader_election.cc:304] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:55.527683 25377 raft_consensus.cc:3060] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:55.482556 28584 raft_consensus.cc:493] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
W20260709 13:11:55.528575 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 46380.1us
I20260709 13:11:55.528991 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:55.530308 25300 raft_consensus.cc:1240] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 9. Current term is 10. Ops: [8.9-9.10]
I20260709 13:11:55.531498 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:55.531976 25374 raft_consensus.cc:2468] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 9.
I20260709 13:11:55.534384 25302 raft_consensus.cc:1240] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:11:55.535583 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:55.536134 25270 leader_election.cc:304] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:55.508795 28530 raft_consensus.cc:2804] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:55.536959 25304 raft_consensus.cc:1240] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 8. Current term is 9. Ops: []
W20260709 13:11:55.538627 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:55.538925 25345 leader_election.cc:304] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:55.479199 28574 raft_consensus.cc:515] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:55.544142 25195 leader_election.cc:304] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:55.561442 25377 raft_consensus.cc:2468] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 8.
I20260709 13:11:55.563349 25377 raft_consensus.cc:1240] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:11:55.448715 28591 raft_consensus.cc:515] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:11:55.537422 28584 raft_consensus.cc:3060] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:55.531620 28426 raft_consensus.cc:2749] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:55.492419 28557 raft_consensus.cc:515] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:55.620082 25343 leader_election.cc:304] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:55.509277 28508 raft_consensus.cc:515] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:55.539809 28147 raft_consensus.cc:2804] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:55.578572 25296 raft_consensus.cc:1240] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:55.623121 25224 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 9.
I20260709 13:11:55.546232 28556 raft_consensus.cc:493] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.552474 28549 raft_consensus.cc:493] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.627869 25223 raft_consensus.cc:2410] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:11:55.628270 28567 raft_consensus.cc:2749] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:55.628360 25377 raft_consensus.cc:1275] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:11:55.642470 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 98398.7us
I20260709 13:11:55.628777 28528 raft_consensus.cc:3060] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:11:55.635623 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 99580.4us
I20260709 13:11:55.570115 28553 raft_consensus.cc:2804] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:55.640108 25230 raft_consensus.cc:1240] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:11:55.543337 28405 consensus_queue.cc:1048] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.085s
I20260709 13:11:55.645771 25270 leader_election.cc:304] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:55.542878 28379 consensus_queue.cc:1059] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.091s
I20260709 13:11:55.648074 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:55.543128 28600 consensus_queue.cc:1048] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.091s
I20260709 13:11:55.682621 25270 leader_election.cc:304] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:55.624429 28530 raft_consensus.cc:697] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 6 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
W20260709 13:11:55.686846 28626 log.cc:927] Time spent T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 13:11:55.686975 28610 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.687165 28299 leader_election.cc:290] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:55.687873 28630 raft_consensus.cc:2749] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:55.688459 28597 leader_election.cc:290] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:55.688606 28500 leader_election.cc:290] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:55.689565 28595 leader_election.cc:290] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:55.691545 28598 consensus_meta.cc:287] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.604s	user 0.010s	sys 0.000s
I20260709 13:11:55.693001 25195 leader_election.cc:304] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:11:55.694005 28622 log.cc:927] Time spent T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260709 13:11:55.638608 28147 raft_consensus.cc:493] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
W20260709 13:11:55.712168 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 92142.6us
I20260709 13:11:55.680510 28593 raft_consensus.cc:1081] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 8 LEADER]: Signalling peer da445ce82dc4467f95f4fa52297eaa19 to start an election
I20260709 13:11:55.744105 28599 leader_election.cc:290] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:11:55.718189 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 153152us
I20260709 13:11:55.745221 25345 leader_election.cc:304] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
W20260709 13:11:55.724784 25194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:55.694887 28426 raft_consensus.cc:2749] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:55.690937 28578 consensus_queue.cc:1059] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:11:55.708518 28553 raft_consensus.cc:697] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 8 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:55.647688 28549 raft_consensus.cc:515] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:55.797286 28549 leader_election.cc:290] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:55.681831 28526 consensus_queue.cc:1059] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 13:11:55.754402 28595 raft_consensus.cc:2749] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:55.686406 28614 consensus_queue.cc:1059] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.072s
I20260709 13:11:55.799635 28614 raft_consensus.cc:3055] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:55.800033 28614 raft_consensus.cc:740] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:55.800146 28530 consensus_queue.cc:237] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:55.800964 28614 consensus_queue.cc:260] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:55.758514 25194 leader_election.cc:336] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Timed out: RequestConsensusVote RPC to 127.23.140.66:33127 timed out after 1.690s (SENT)
I20260709 13:11:55.768164 25345 leader_election.cc:304] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:55.811511 25345 leader_election.cc:304] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
W20260709 13:11:55.812829 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:55.746917 28147 raft_consensus.cc:3060] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:11:55.770849 28636 log.cc:927] Time spent T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
W20260709 13:11:55.771611 28631 log.cc:927] Time spent T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 13:11:55.741089 28588 raft_consensus.cc:2804] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:55.641885 28596 consensus_queue.cc:237] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:55.778209 28630 raft_consensus.cc:2804] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:11:55.778936 28571 consensus_meta.cc:287] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 0.772s	user 0.008s	sys 0.002s
I20260709 13:11:55.779659 28578 raft_consensus.cc:3055] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:55.779904 28454 consensus_queue.cc:1048] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:55.780784 28591 leader_election.cc:290] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:55.849490 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:55.850219 25374 raft_consensus.cc:3060] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:55.785297 28605 consensus_meta.cc:287] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.689s	user 0.007s	sys 0.000s
I20260709 13:11:55.754575 28552 raft_consensus.cc:3060] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:55.786839 28573 leader_election.cc:290] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 9 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:55.787840 28553 consensus_queue.cc:237] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:55.754663 28180 leader_election.cc:290] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:55.741469 28379 raft_consensus.cc:2749] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:55.719777 28610 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:55.794713 28557 leader_election.cc:290] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:55.742939 28598 raft_consensus.cc:515] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:55.798231 28526 raft_consensus.cc:3055] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:11:55.747406 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:55.803040 28600 consensus_queue.cc:1059] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:11:55.803905 28528 raft_consensus.cc:2749] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:55.644416 28556 raft_consensus.cc:515] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:55.744815 28285 leader_election.cc:290] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:55.785327 25373 raft_consensus.cc:2468] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 8.
I20260709 13:11:55.775018 28508 leader_election.cc:290] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:55.823258 25370 raft_consensus.cc:2468] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 10.
W20260709 13:11:55.825359 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 132440us
W20260709 13:11:55.823383 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 189600us
I20260709 13:11:55.906085 28550 raft_consensus.cc:2749] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:55.826435 25376 raft_consensus.cc:1240] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 7. Current term is 8. Ops: []
W20260709 13:11:55.844409 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 85944.2us
I20260709 13:11:55.825117 28549 raft_consensus.cc:2804] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:55.910085 28549 raft_consensus.cc:697] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 9 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:55.911461 28610 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:55.911098 28549 consensus_queue.cc:237] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:55.914835 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:55.915489 25223 raft_consensus.cc:3060] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:55.828008 28599 raft_consensus.cc:493] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.918021 28599 raft_consensus.cc:515] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:55.919548 28265 consensus_meta.cc:287] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.602s	user 0.010s	sys 0.001s
I20260709 13:11:55.826416 28588 raft_consensus.cc:493] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:55.920147 28599 leader_election.cc:290] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:55.920315 28588 raft_consensus.cc:3060] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:55.922197 28638 raft_consensus.cc:493] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.922722 28638 raft_consensus.cc:515] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:55.846741 28578 raft_consensus.cc:740] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:55.863286 28614 raft_consensus.cc:3060] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:55.878525 25873 leader_election.cc:304] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
W20260709 13:11:55.926388 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 56745.5us
I20260709 13:11:55.850054 28630 raft_consensus.cc:697] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 10 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:55.815145 28642 raft_consensus.cc:2749] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:11:55.895433 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:55.933423 25379 raft_consensus.cc:2393] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 9: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:55.862378 28643 raft_consensus.cc:493] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.938721 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:55.939765 25376 raft_consensus.cc:2410] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:11:55.888921 28526 raft_consensus.cc:740] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:55.857033 28605 raft_consensus.cc:515] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:55.910073 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:55.925091 28638 leader_election.cc:290] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:55.933948 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:55.954223 25229 raft_consensus.cc:3060] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:55.935959 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:55.955343 25373 raft_consensus.cc:3060] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:55.947726 25223 raft_consensus.cc:2468] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 10.
W20260709 13:11:55.900484 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 160153us
I20260709 13:11:55.944254 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:55.931836 25195 leader_election.cc:304] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:55.957643 25270 leader_election.cc:304] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:55.957652 25375 raft_consensus.cc:2468] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 6.
I20260709 13:11:55.928190 28557 raft_consensus.cc:493] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.959834 28557 raft_consensus.cc:515] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:55.960915 28526 consensus_queue.cc:260] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:55.925190 28578 consensus_queue.cc:260] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:55.962296 25304 raft_consensus.cc:1240] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260709 13:11:56.092921 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:56.118171 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 160621us
W20260709 13:11:55.989763 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 58015.4us
I20260709 13:11:55.963754 25374 raft_consensus.cc:2468] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 13.
W20260709 13:11:56.024802 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:56.005470 25373 raft_consensus.cc:2468] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 9.
W20260709 13:11:55.991086 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 50195.1us
I20260709 13:11:55.944923 28508 raft_consensus.cc:2804] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:56.050554 25229 raft_consensus.cc:2468] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 9.
W20260709 13:11:56.088618 28609 log.cc:927] Time spent T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 13:11:56.131454 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 113928us
I20260709 13:11:55.962230 28605 leader_election.cc:290] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:56.116014 28644 log.cc:927] Time spent T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
I20260709 13:11:56.053000 28180 raft_consensus.cc:493] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.077876 28638 raft_consensus.cc:2749] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:56.136029 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:55.990363 28610 raft_consensus.cc:2749] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:56.007323 28572 raft_consensus.cc:493] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:56.085942 28611 raft_consensus.cc:493] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.119072 28526 raft_consensus.cc:3060] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:55.990487 28598 leader_election.cc:290] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:55.962410 28557 leader_election.cc:290] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:55.962891 28654 consensus_queue.cc:1048] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.199s
W20260709 13:11:56.176484 25305 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57272 (request call id 1735) took 1774 ms (client timeout 1690 ms). Trace:
W20260709 13:11:56.176971 25305 rpcz_store.cc:269] 0709 13:11:54.401933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:54.402107 (+   174us) service_pool.cc:224] Handling call
0709 13:11:56.176280 (+1774173us) spinlock_profiling.cc:243] Waited 581 ms on lock 0x7b54000f8f54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:56.176395 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1336643328}
I20260709 13:11:56.152299 28379 raft_consensus.cc:3055] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:56.178745 28379 raft_consensus.cc:740] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:56.179246 28588 raft_consensus.cc:515] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:56.179600 28379 consensus_queue.cc:260] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:56.146963 28454 raft_consensus.cc:493] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.181448 28588 leader_election.cc:290] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:56.181514 28454 raft_consensus.cc:515] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:56.183740 28454 leader_election.cc:290] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:56.169008 28578 raft_consensus.cc:3060] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:56.128175 28630 consensus_queue.cc:237] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:56.173314 28572 raft_consensus.cc:515] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:56.171182 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 48937.2us
I20260709 13:11:56.176127 28147 raft_consensus.cc:515] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:56.134574 28508 raft_consensus.cc:697] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:56.186920 25298 raft_consensus.cc:2468] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 8.
I20260709 13:11:55.948467 28643 raft_consensus.cc:515] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:56.194435 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:56.195101 25224 raft_consensus.cc:3060] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:56.199422 28147 leader_election.cc:290] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:56.200644 25377 raft_consensus.cc:1240] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:56.134065 28584 raft_consensus.cc:515] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:56.214643 25224 raft_consensus.cc:2468] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 9.
I20260709 13:11:56.217098 25227 raft_consensus.cc:1275] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:11:56.220003 28572 leader_election.cc:290] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:56.221611 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:56.222681 25373 raft_consensus.cc:2393] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 7: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:56.172165 28611 raft_consensus.cc:515] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:56.148017 28180 raft_consensus.cc:515] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:56.226990 25195 leader_election.cc:304] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:56.231231 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:56.225423 28654 raft_consensus.cc:493] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.228823 28552 raft_consensus.cc:493] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.226696 28610 consensus_queue.cc:1048] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:11:56.228896 28569 raft_consensus.cc:2749] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:56.252378 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:56.252185 28508 consensus_queue.cc:237] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:56.253116 25373 raft_consensus.cc:2368] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 8. Current term is 9.
W20260709 13:11:56.239324 28657 log.cc:927] Time spent T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.123s	user 0.000s	sys 0.002s
I20260709 13:11:56.261550 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:56.255041 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:56.271883 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:56.273116 25373 raft_consensus.cc:2393] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 10: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:56.274080 25908 raft_consensus.cc:1275] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:11:56.274187 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:56.274788 25303 raft_consensus.cc:3060] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:56.275215 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:56.278203 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:56.284437 25908 raft_consensus.cc:3060] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:56.284970 25305 raft_consensus.cc:2468] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 6.
I20260709 13:11:56.287676 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:56.290553 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:56.292383 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:56.241714 28654 raft_consensus.cc:515] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:56.297633 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:56.312704 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:56.314898 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:56.244431 28552 raft_consensus.cc:515] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:56.317111 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:56.317579 25303 raft_consensus.cc:2468] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 9.
W20260709 13:11:56.318198 25195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:56.322394 25872 leader_election.cc:304] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:56.289609 28614 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.324059 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:56.328814 25371 raft_consensus.cc:1275] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:11:56.329332 25372 raft_consensus.cc:1275] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:11:56.329710 28654 leader_election.cc:290] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:56.329625 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:56.355487 25376 raft_consensus.cc:2393] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 10: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:56.294435 28643 leader_election.cc:290] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:56.357164 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:56.300000 28526 raft_consensus.cc:493] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.336675 25370 raft_consensus.cc:1275] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:11:56.329345 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:56.359308 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:56.359859 25222 raft_consensus.cc:1240] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:56.360643 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:56.360848 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:56.361931 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:56.362663 25222 raft_consensus.cc:2410] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:11:56.364362 25370 raft_consensus.cc:1240] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:11:56.347201 25908 raft_consensus.cc:2468] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 9.
I20260709 13:11:56.356097 25229 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f"
dest_uuid: "1f539ba21487460085b837e7529a78ce"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:58402
I20260709 13:11:56.366493 25229 raft_consensus.cc:606] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Received request to transfer leadership
I20260709 13:11:56.366726 25229 raft_consensus.cc:614] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:56.367803 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:56.363322 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:56.301594 28454 consensus_queue.cc:1048] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:11:56.371888 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
W20260709 13:11:56.397166 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 72023.6us
I20260709 13:11:56.356907 28614 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:56.407740 25230 raft_consensus.cc:2468] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 6.
I20260709 13:11:56.410506 25270 leader_election.cc:304] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:56.412889 25872 leader_election.cc:304] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:56.371623 28526 raft_consensus.cc:515] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:56.418198 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:56.419011 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:56.411880 28611 leader_election.cc:290] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:56.423748 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:56.424427 25305 raft_consensus.cc:2468] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 7.
I20260709 13:11:56.407562 28620 raft_consensus.cc:2804] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:56.428654 25225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58422 (request call id 1862) took 1483 ms. Trace:
I20260709 13:11:56.417645 28666 raft_consensus.cc:2804] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:56.426584 28620 raft_consensus.cc:493] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:56.431170 28620 raft_consensus.cc:3060] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:56.438884 28673 log.cc:927] Time spent T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 13:11:56.414801 28643 raft_consensus.cc:493] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.429157 25225 rpcz_store.cc:276] 0709 13:11:54.943330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:54.943513 (+   183us) service_pool.cc:224] Handling call
0709 13:11:56.426122 (+1482609us) spinlock_profiling.cc:243] Waited 520 ms on lock 0x7b5400041d54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:56.426272 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1195278080}
W20260709 13:11:56.440317 28665 log.cc:927] Time spent T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.232s	user 0.002s	sys 0.007s
I20260709 13:11:56.417937 28573 raft_consensus.cc:2804] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:56.441388 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:56.442231 25225 raft_consensus.cc:3060] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:56.430524 28666 raft_consensus.cc:697] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 9 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:56.445858 28517 raft_consensus.cc:3055] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:56.449330 28517 raft_consensus.cc:740] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:56.450405 28517 consensus_queue.cc:260] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:56.447432 25872 leader_election.cc:304] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:56.441349 28573 raft_consensus.cc:697] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
W20260709 13:11:56.430671 28669 log.cc:927] Time spent T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:11:56.464883 25228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58418 (request call id 1900) took 1354 ms. Trace:
I20260709 13:11:56.442245 28180 leader_election.cc:290] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:56.465291 25228 rpcz_store.cc:276] 0709 13:11:55.110166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.123276 (+ 13110us) service_pool.cc:224] Handling call
0709 13:11:56.464677 (+1341401us) spinlock_profiling.cc:243] Waited 399 ms on lock 0x7b5400087fd4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:56.464819 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":917760768}
I20260709 13:11:56.459978 28611 raft_consensus.cc:2804] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:56.470422 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:56.440346 28643 raft_consensus.cc:515] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:56.472762 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:56.474119 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:56.474424 28643 leader_election.cc:290] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:56.472069 28611 raft_consensus.cc:493] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:56.475503 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:56.476495 25904 raft_consensus.cc:2468] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 8.
I20260709 13:11:56.476214 28611 raft_consensus.cc:3060] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:56.448747 28666 consensus_queue.cc:237] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:56.490130 28573 consensus_queue.cc:237] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:56.499737 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:56.500471 25229 raft_consensus.cc:2376] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 9. Re-sending same reply.
I20260709 13:11:56.503479 25229 raft_consensus.cc:1275] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:56.503641 25343 leader_election.cc:304] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:56.504695 25229 raft_consensus.cc:1275] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:56.505292 25343 leader_election.cc:304] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:56.466800 28620 raft_consensus.cc:515] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:56.519366 25343 leader_election.cc:304] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:56.522625 25228 raft_consensus.cc:2468] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 7.
I20260709 13:11:56.524117 25343 leader_election.cc:304] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:56.531631 25343 leader_election.cc:304] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:56.532080 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:56.533030 25228 raft_consensus.cc:2468] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 7.
I20260709 13:11:56.529646 28147 raft_consensus.cc:2749] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:56.522779 28549 raft_consensus.cc:2749] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:56.518224 28596 raft_consensus.cc:2749] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:56.531240 28598 raft_consensus.cc:2749] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:56.542184 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:56.543098 25377 raft_consensus.cc:3060] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:56.539075 28553 raft_consensus.cc:2749] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:56.540622 28620 leader_election.cc:290] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:56.541211 25904 raft_consensus.cc:1240] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:11:56.552088 25225 raft_consensus.cc:2468] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 13.
I20260709 13:11:56.553124 25270 leader_election.cc:304] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:56.553728 25228 raft_consensus.cc:1275] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:11:56.554360 25228 pending_rounds.cc:85] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce: Aborting all ops after (but not including) 9
I20260709 13:11:56.554662 25228 pending_rounds.cc:107] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:11:56.554993 25228 raft_consensus.cc:2889] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:11:56.555133 25874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:56.561889 25305 raft_consensus.cc:1275] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:11:56.565595 25270 leader_election.cc:304] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:56.566918 25377 raft_consensus.cc:2468] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 7.
I20260709 13:11:56.568981 28512 consensus_queue.cc:1048] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:56.569378 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:56.569948 25297 raft_consensus.cc:3060] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:56.570478 28650 consensus_queue.cc:1048] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:56.572430 28588 raft_consensus.cc:493] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.572798 28572 consensus_queue.cc:1048] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:56.573020 28588 raft_consensus.cc:515] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:56.573421 28572 consensus_queue.cc:1243] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer 1f539ba21487460085b837e7529a78ce log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:11:56.575115 28588 leader_election.cc:290] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:56.565281 28600 consensus_queue.cc:1048] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:11:56.576007 28652 raft_consensus.cc:2804] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:56.576421 28652 raft_consensus.cc:493] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:56.576745 28652 raft_consensus.cc:3060] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:56.568321 28500 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.577773 28500 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:56.580098 28500 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:56.566641 28598 raft_consensus.cc:493] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:56.581331 28598 raft_consensus.cc:515] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:56.582861 25270 leader_election.cc:304] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:56.558043 28560 raft_consensus.cc:2804] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:56.584730 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:56.585321 25908 raft_consensus.cc:2468] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 6.
I20260709 13:11:56.585992 28147 raft_consensus.cc:493] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:56.586516 28147 raft_consensus.cc:515] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:56.588505 28147 leader_election.cc:290] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:56.591178 28650 raft_consensus.cc:2804] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:56.563589 28454 consensus_queue.cc:1059] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:11:56.591696 28650 raft_consensus.cc:697] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 10 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:56.591940 28573 consensus_queue.cc:1059] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:56.592661 28650 consensus_queue.cc:237] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:56.593331 28683 log.cc:927] Time spent T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:11:56.593945 28573 raft_consensus.cc:3055] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:56.594349 28573 raft_consensus.cc:740] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:56.596220 25372 raft_consensus.cc:1275] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:11:56.596611 25372 pending_rounds.cc:85] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468: Aborting all ops after (but not including) 5
I20260709 13:11:56.596930 25372 pending_rounds.cc:107] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:11:56.597141 25372 raft_consensus.cc:2889] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:56.597565 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:56.598188 25374 raft_consensus.cc:3060] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:56.600993 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:56.602026 25195 leader_election.cc:400] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 election: Vote denied by peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091) with higher term. Message: Invalid argument: T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 8. Current term is 9.
I20260709 13:11:56.602339 25195 leader_election.cc:403] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:11:56.591619 25376 raft_consensus.cc:1275] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:11:56.596499 28598 leader_election.cc:290] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:56.603591 25270 leader_election.cc:304] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:56.606549 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:56.607401 25222 raft_consensus.cc:2393] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 6: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:56.607280 25225 raft_consensus.cc:3060] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:56.608182 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:56.608673 25376 raft_consensus.cc:2468] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 8.
I20260709 13:11:56.610479 25873 leader_election.cc:304] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:56.611423 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:56.613795 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:56.614574 25376 raft_consensus.cc:3060] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:56.615749 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:56.616255 25370 raft_consensus.cc:2468] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 10.
I20260709 13:11:56.616662 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:56.612358 25874 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:56.616891 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:56.618203 25370 raft_consensus.cc:2468] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 9.
I20260709 13:11:56.613134 28319 consensus_queue.cc:1059] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:11:56.627799 25378 raft_consensus.cc:1240] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 9 LEADER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:11:56.613365 28557 raft_consensus.cc:493] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.630477 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:56.631177 25372 raft_consensus.cc:2468] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 6.
I20260709 13:11:56.636392 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:56.637359 25228 raft_consensus.cc:2468] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 8.
I20260709 13:11:56.641971 25225 raft_consensus.cc:2468] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 10.
I20260709 13:11:56.643343 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:56.644560 25222 raft_consensus.cc:2393] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 9: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:56.649784 25374 raft_consensus.cc:2468] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 9.
I20260709 13:11:56.629101 28557 raft_consensus.cc:515] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:56.568693 28611 raft_consensus.cc:515] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:56.670647 25376 raft_consensus.cc:2468] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 9.
I20260709 13:11:56.615540 28560 raft_consensus.cc:697] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 8 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:56.675311 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:56.634704 28386 raft_consensus.cc:2749] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:56.678805 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:56.691642 25377 raft_consensus.cc:2376] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 8. Re-sending same reply.
I20260709 13:11:56.678844 25376 raft_consensus.cc:2468] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 8.
I20260709 13:11:56.693223 25297 raft_consensus.cc:2468] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 7.
I20260709 13:11:56.655303 28588 raft_consensus.cc:2804] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:11:56.695768 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 81443us
W20260709 13:11:56.703039 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 80543.5us
I20260709 13:11:56.704177 25873 leader_election.cc:304] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:56.704284 25874 leader_election.cc:304] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:56.699667 28572 raft_consensus.cc:2749] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:56.709997 25270 leader_election.cc:304] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:56.702529 28588 raft_consensus.cc:493] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:56.714768 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:56.715144 25908 raft_consensus.cc:1240] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:56.724069 25907 raft_consensus.cc:2368] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 8. Current term is 9.
I20260709 13:11:56.649626 28573 consensus_queue.cc:260] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:56.742228 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:56.705360 28652 raft_consensus.cc:515] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:56.740913 28557 leader_election.cc:290] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:56.745527 25904 raft_consensus.cc:1240] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 6. Current term is 8. Ops: []
I20260709 13:11:56.734177 28588 raft_consensus.cc:3060] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:56.749028 25908 raft_consensus.cc:1240] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:56.755018 28689 raft_consensus.cc:2749] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:56.755242 28511 raft_consensus.cc:2804] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:56.755946 28511 raft_consensus.cc:697] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:56.756983 28556 leader_election.cc:290] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:56.762830 25303 raft_consensus.cc:1240] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:56.764065 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:56.764362 28611 leader_election.cc:290] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:56.764477 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:56.712622 28666 consensus_queue.cc:1048] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:11:56.767715 28666 raft_consensus.cc:493] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.768309 28666 raft_consensus.cc:515] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:56.770089 25301 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483"
dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
 from {username='slave'} at 127.0.0.1:57272
I20260709 13:11:56.770843 25301 raft_consensus.cc:493] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:56.770895 28584 leader_election.cc:290] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:56.771392 25301 raft_consensus.cc:3060] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:56.773780 25303 raft_consensus.cc:1275] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:11:56.774479 25296 raft_consensus.cc:1275] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:11:56.765139 28560 consensus_queue.cc:237] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:56.778662 25304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57272 (request call id 1743) took 1213 ms. Trace:
I20260709 13:11:56.757094 28511 consensus_queue.cc:237] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:56.779067 25304 rpcz_store.cc:276] 0709 13:11:55.565542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.572234 (+  6692us) service_pool.cc:224] Handling call
0709 13:11:55.572527 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:56.120827 (+548300us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:56.778435 (+657608us) spinlock_profiling.cc:243] Waited 390 ms on lock 0x7b5400169ed4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:56.778608 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":895855360}
I20260709 13:11:56.778719 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:56.786147 25300 raft_consensus.cc:2468] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 10.
I20260709 13:11:56.784853 25345 leader_election.cc:304] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:56.804981 25345 leader_election.cc:304] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:56.808204 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:56.808988 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:56.809376 25300 raft_consensus.cc:2410] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:11:56.809660 25303 raft_consensus.cc:3060] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:56.814781 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:56.815815 25305 raft_consensus.cc:2393] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 9: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:56.810890 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:56.807313 25345 leader_election.cc:304] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:56.820039 25872 leader_election.cc:304] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:56.820680 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:56.820822 25345 leader_election.cc:304] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:56.746899 28600 raft_consensus.cc:2804] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:56.823364 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:56.824447 25297 raft_consensus.cc:2393] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 6: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:56.827816 25906 raft_consensus.cc:1240] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:11:56.830204 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:56.830544 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:56.831734 25907 raft_consensus.cc:1240] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 LEADER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:11:56.832123 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:56.830219 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:56.834211 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:56.834723 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:56.831404 28605 consensus_queue.cc:1059] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:56.834985 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:56.838321 25906 raft_consensus.cc:2468] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 7.
I20260709 13:11:56.840304 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:56.840158 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:56.840821 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:56.841082 25296 raft_consensus.cc:3060] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:56.841399 25302 raft_consensus.cc:3060] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:56.827049 28526 leader_election.cc:290] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:56.830042 28655 log.cc:927] Time spent T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.723s	user 0.004s	sys 0.000s
W20260709 13:11:56.847761 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 137831us
W20260709 13:11:56.843719 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 132127us
W20260709 13:11:56.853988 25873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:56.818881 28650 raft_consensus.cc:493] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.848757 25270 leader_election.cc:304] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:56.836092 28600 raft_consensus.cc:493] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:56.836007 28598 raft_consensus.cc:2804] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:56.859864 25270 leader_election.cc:304] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:56.843330 28686 raft_consensus.cc:2804] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:56.843398 28553 raft_consensus.cc:2804] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:56.835736 28687 raft_consensus.cc:2804] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:56.864369 25303 raft_consensus.cc:2468] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 10.
I20260709 13:11:56.865453 25270 leader_election.cc:304] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:56.855329 28500 raft_consensus.cc:2804] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:56.871353 25270 leader_election.cc:304] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:56.855800 28560 consensus_queue.cc:1048] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:11:56.877087 28553 raft_consensus.cc:697] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 10 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:56.878223 28553 consensus_queue.cc:237] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:56.881371 28668 log.cc:927] Time spent T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.545s	user 0.001s	sys 0.001s
I20260709 13:11:56.874716 25270 leader_election.cc:304] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:56.891832 25343 leader_election.cc:304] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:56.858304 28386 consensus_queue.cc:1059] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:11:56.893134 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:56.894044 25907 raft_consensus.cc:3060] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:56.895956 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:11:56.896279 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:56.896996 28664 log.cc:927] Time spent T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.546s	user 0.003s	sys 0.000s
I20260709 13:11:56.897229 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:56.898070 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:56.863119 28600 raft_consensus.cc:3060] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:56.893421 28693 raft_consensus.cc:2804] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:11:56.869798 28700 log.cc:927] Time spent T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
W20260709 13:11:56.919806 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:56.865309 28567 raft_consensus.cc:2804] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:11:56.936630 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:56.871779 28598 raft_consensus.cc:697] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 9 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:56.871116 28605 raft_consensus.cc:2804] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:56.866611 28686 raft_consensus.cc:493] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:56.942540 25296 raft_consensus.cc:2468] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 7.
I20260709 13:11:56.941613 25301 raft_consensus.cc:515] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:57.007615 25902 raft_consensus.cc:1275] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:11:56.957010 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:56.996740 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
W20260709 13:11:56.996912 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 394978us
I20260709 13:11:57.010437 25195 leader_election.cc:304] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:57.011332 25195 leader_election.cc:304] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:57.012871 25195 leader_election.cc:304] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:56.998759 25221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58418 (request call id 1912) took 1090 ms. Trace:
I20260709 13:11:57.013949 28180 raft_consensus.cc:2749] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:57.014652 28180 raft_consensus.cc:2749] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:57.015180 28654 raft_consensus.cc:2749] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:57.015308 28180 raft_consensus.cc:493] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:57.015893 28654 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.015851 28180 raft_consensus.cc:515] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:57.016417 28654 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:57.005348 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:57.018882 25903 raft_consensus.cc:2468] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 8.
I20260709 13:11:57.013962 25221 rpcz_store.cc:276] 0709 13:11:55.908788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.913865 (+  5077us) service_pool.cc:224] Handling call
0709 13:11:55.914251 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:55.951425 (+ 37174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:55.951483 (+    58us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:55.963266 (+ 11783us) log.cc:844] Serialized 26 byte log entry
0709 13:11:56.233892 (+270626us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:56.233951 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:56.234054 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:56.896448 (+662394us) spinlock_profiling.cc:243] Waited 9.99 ms on lock 0x7b4400022b4c. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72caa8c85 00007fd72caa96a2 00007fd72f81b1db 00007fd72f816aaf 00007fd72f80a86e 00007fd72f809bb6 00007fd72f8097d8 00007fd72f813221 00007fd72f8131d9 00007fd72f813169
0709 13:11:56.898256 (+  1808us) raft_consensus.cc:1685] finished
0709 13:11:56.898275 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:56.998662 (+100387us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36742,"raft.queue_time_us":37349,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":103,"spinlock_wait_cycles":22980480,"thread_start_us":154761,"threads_started":1,"wal-append.queue_time_us":260684}
I20260709 13:11:57.021879 25907 raft_consensus.cc:2468] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 7.
I20260709 13:11:56.863273 28650 raft_consensus.cc:515] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:56.944802 28693 raft_consensus.cc:493] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:57.005080 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 221299us
I20260709 13:11:56.944628 28560 raft_consensus.cc:2804] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:56.961117 25302 raft_consensus.cc:2468] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 9.
I20260709 13:11:57.003895 28588 raft_consensus.cc:515] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:56.956820 28567 raft_consensus.cc:493] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:56.872192 28645 consensus_queue.cc:1059] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.134s
I20260709 13:11:56.895959 28559 raft_consensus.cc:3055] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:56.898097 28578 raft_consensus.cc:493] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:56.945458 28500 raft_consensus.cc:697] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:57.002067 28605 raft_consensus.cc:493] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:56.951251 28147 raft_consensus.cc:2804] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:56.902437 28687 raft_consensus.cc:697] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 10 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:57.024019 28611 raft_consensus.cc:3055] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:57.006103 28569 raft_consensus.cc:2749] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091) with higher term. Message: Invalid argument: T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 8. Current term is 9.
W20260709 13:11:57.063740 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 244201us
I20260709 13:11:57.044060 28559 raft_consensus.cc:740] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
W20260709 13:11:57.107849 25874 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.23.140.126:37145, user_credentials={real_user=slave}} blocked reactor thread for 43849.6us
I20260709 13:11:57.024814 28686 raft_consensus.cc:3060] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:57.033908 28454 raft_consensus.cc:2764] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 13:11:57.045923 28567 raft_consensus.cc:3060] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:57.038661 28693 raft_consensus.cc:3060] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:57.046336 28645 consensus_queue.cc:1243] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Peer 79d99c0e498349bda74127365219e468 log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:11:57.320818 25907 raft_consensus.cc:1275] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:11:57.110742 28578 raft_consensus.cc:515] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:57.113811 28611 raft_consensus.cc:740] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:57.112471 28147 raft_consensus.cc:493] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:57.163465 28180 leader_election.cc:290] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:57.164525 25175 auto_rebalancer.cc:893] Removing replace marker failed: Replica 1f539ba21487460085b837e7529a78ce is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
W20260709 13:11:57.343261 25175 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 13:11:57.065330 28560 raft_consensus.cc:697] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 9 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:57.057134 28553 raft_consensus.cc:493] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:57.031888 28610 consensus_queue.cc:1048] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.110s
I20260709 13:11:57.039292 28584 consensus_queue.cc:1048] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.111s
I20260709 13:11:57.062879 28620 raft_consensus.cc:493] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:57.032085 28538 consensus_queue.cc:1048] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.082s
I20260709 13:11:57.112730 28605 raft_consensus.cc:3060] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:57.104605 28666 leader_election.cc:290] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:57.423385 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:57.424499 25222 raft_consensus.cc:2468] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 6.
I20260709 13:11:57.039685 28556 consensus_queue.cc:1059] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.119s
I20260709 13:11:57.310066 25344 leader_election.cc:304] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:11:57.160722 28652 leader_election.cc:290] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:57.293159 28703 log.cc:927] Time spent T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.294s	user 0.003s	sys 0.004s
I20260709 13:11:57.321854 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:57.435365 25901 raft_consensus.cc:2468] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 6.
W20260709 13:11:57.105331 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 230726us
I20260709 13:11:57.436558 25270 leader_election.cc:304] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
W20260709 13:11:57.330399 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 296435us
I20260709 13:11:57.439061 25194 leader_election.cc:304] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:57.335105 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:57.342248 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:11:57.343679 25175 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:11:57.440205 25899 raft_consensus.cc:2393] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 8: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:11:57.441427 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:57.339084 28654 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:57.397739 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:57.376205 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:57.342806 28147 raft_consensus.cc:3060] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:57.371764 28707 log.cc:927] Time spent T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:11:57.371910 28704 log.cc:927] Time spent T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
W20260709 13:11:57.366858 25376 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.005s	sys 0.003s
W20260709 13:11:57.459959 25376 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.006s	sys 0.003s
I20260709 13:11:57.429494 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:11:57.434116 28701 log.cc:927] Time spent T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
W20260709 13:11:57.333853 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:57.426367 28700 log.cc:927] Time spent T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.064s	user 0.005s	sys 0.002s
I20260709 13:11:57.442204 25222 raft_consensus.cc:2468] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 6.
I20260709 13:11:57.369117 28569 raft_consensus.cc:493] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:57.461278 25223 raft_consensus.cc:2468] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 9.
I20260709 13:11:57.362603 28696 consensus_queue.cc:1048] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 13:11:57.336910 28500 consensus_queue.cc:237] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:57.340095 28598 consensus_queue.cc:237] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:11:57.372422 28553 raft_consensus.cc:515] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:57.481285 25373 raft_consensus.cc:1240] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:11:57.483194 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:11:57.488230 25873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:57.425406 28620 raft_consensus.cc:515] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:57.494779 25379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36254 (request call id 1941) took 2118 ms. Trace:
I20260709 13:11:57.497179 25379 rpcz_store.cc:276] 0709 13:11:55.362197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.367378 (+  5181us) service_pool.cc:224] Handling call
0709 13:11:57.480534 (+2113156us) spinlock_profiling.cc:243] Waited 460 ms on lock 0x7b5400306e54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:57.480701 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1057706368}
I20260709 13:11:57.459578 28574 leader_election.cc:290] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:57.499270 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:57.499961 25296 raft_consensus.cc:3060] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:57.501657 25297 raft_consensus.cc:1275] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:11:57.504501 25303 raft_consensus.cc:1275] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:57.506713 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:57.507526 25902 raft_consensus.cc:3060] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:57.508613 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:57.509385 25907 raft_consensus.cc:2468] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 7.
I20260709 13:11:57.516005 25902 raft_consensus.cc:2468] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 7.
I20260709 13:11:57.519513 25270 leader_election.cc:304] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:57.371781 28560 consensus_queue.cc:237] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:57.443485 28709 consensus_queue.cc:1048] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
W20260709 13:11:57.518204 25268 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.010s	sys 0.011s
I20260709 13:11:57.520398 25304 raft_consensus.cc:2393] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 8: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
W20260709 13:11:57.572255 25268 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.011s	sys 0.011s
I20260709 13:11:57.558169 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:57.572805 25899 raft_consensus.cc:3060] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:57.569772 28652 raft_consensus.cc:2804] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:11:57.571012 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:57.567693 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 48288.4us
I20260709 13:11:57.573510 25901 raft_consensus.cc:1275] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:11:57.577129 25195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:57.614149 25296 raft_consensus.cc:2468] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 8.
I20260709 13:11:57.610226 25270 leader_election.cc:304] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:57.615839 25371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36254 (request call id 1957) took 1032 ms. Trace:
I20260709 13:11:57.454411 28611 consensus_queue.cc:260] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:57.621217 25371 rpcz_store.cc:276] 0709 13:11:56.583884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:56.584008 (+   124us) service_pool.cc:224] Handling call
0709 13:11:56.584324 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:56.700891 (+116567us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:56.700924 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:56.703406 (+  2482us) log.cc:844] Serialized 26 byte log entry
0709 13:11:56.862099 (+158693us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:56.862146 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:56.862226 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:57.615623 (+753397us) raft_consensus.cc:1685] finished
0709 13:11:57.615643 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:57.615771 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4319,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":73,"thread_start_us":236373,"threads_started":2,"wal-append.queue_time_us":307329}
W20260709 13:11:57.571376 28695 log.cc:927] Time spent T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:11:57.496495 28588 leader_election.cc:290] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:57.633663 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 323807us
I20260709 13:11:57.636852 25344 leader_election.cc:304] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:57.491060 28710 raft_consensus.cc:2804] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:57.637699 25344 leader_election.cc:304] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
W20260709 13:11:57.640200 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 201245us
I20260709 13:11:57.576556 28574 raft_consensus.cc:493] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.576354 28645 raft_consensus.cc:493] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.609951 28652 raft_consensus.cc:493] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:57.480082 28569 raft_consensus.cc:515] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:57.641510 28600 consensus_meta.cc:287] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.642s	user 0.006s	sys 0.006s
I20260709 13:11:57.437955 28687 consensus_queue.cc:237] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:57.620333 28717 raft_consensus.cc:3055] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:11:57.640385 28705 log.cc:927] Time spent T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.340s	user 0.001s	sys 0.000s
I20260709 13:11:57.556488 28654 raft_consensus.cc:493] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.496371 28650 leader_election.cc:290] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:57.620944 28610 raft_consensus.cc:2749] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:57.495796 28180 consensus_queue.cc:1059] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.169s
I20260709 13:11:57.670987 28611 raft_consensus.cc:3060] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:57.620538 28596 consensus_queue.cc:1048] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:11:57.666059 28652 raft_consensus.cc:3060] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:57.672634 28717 raft_consensus.cc:740] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:57.667618 28574 raft_consensus.cc:515] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:57.679105 28578 leader_election.cc:290] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:57.690378 28709 raft_consensus.cc:2804] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:57.683035 28530 raft_consensus.cc:493] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:57.670248 28645 raft_consensus.cc:515] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:57.692662 28716 raft_consensus.cc:993] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce: : Instructing follower da445ce82dc4467f95f4fa52297eaa19 to start an election
I20260709 13:11:57.675655 28600 raft_consensus.cc:515] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:57.719718 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:57.723042 28706 log.cc:927] Time spent T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.276s	user 0.001s	sys 0.000s
I20260709 13:11:57.723902 28715 raft_consensus.cc:3060] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:57.718950 28559 consensus_queue.cc:260] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:57.730208 28725 raft_consensus.cc:493] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:57.696450 28718 consensus_queue.cc:1048] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:11:57.730445 28731 consensus_queue.cc:1048] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:11:57.730969 28725 raft_consensus.cc:515] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:57.735234 28711 raft_consensus.cc:2804] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:57.684482 28654 raft_consensus.cc:515] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:57.711270 28553 leader_election.cc:290] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:57.746168 28596 raft_consensus.cc:2804] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:57.719552 28530 raft_consensus.cc:515] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:57.753859 28552 leader_election.cc:290] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:57.755904 28720 log.cc:927] Time spent T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:11:57.756542 28614 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:57.736183 28716 raft_consensus.cc:1081] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 8 LEADER]: Signalling peer da445ce82dc4467f95f4fa52297eaa19 to start an election
I20260709 13:11:57.743008 28711 raft_consensus.cc:493] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:57.726797 28709 raft_consensus.cc:697] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 7 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:57.781689 28728 raft_consensus.cc:493] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.783681 28530 leader_election.cc:290] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:57.759394 28600 leader_election.cc:290] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:57.759552 28574 leader_election.cc:290] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:57.733605 28725 leader_election.cc:290] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:57.817433 28693 raft_consensus.cc:515] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:57.830086 28693 leader_election.cc:290] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:57.785331 28686 raft_consensus.cc:515] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:57.790079 28689 consensus_queue.cc:1048] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.041s
W20260709 13:11:57.854616 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:57.855885 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:57.833133 28709 consensus_queue.cc:237] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:57.793990 28717 consensus_queue.cc:260] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:57.795668 28596 raft_consensus.cc:697] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 7 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:11:57.830797 28711 raft_consensus.cc:3060] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:57.834760 28728 raft_consensus.cc:515] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:57.836153 28147 raft_consensus.cc:515] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:57.843034 28620 leader_election.cc:290] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:57.844960 28654 leader_election.cc:290] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:57.845917 28652 raft_consensus.cc:515] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:57.848073 25271 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.022s	sys 0.046s
I20260709 13:11:57.777438 25899 raft_consensus.cc:2468] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 9.
W20260709 13:11:57.885257 25271 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.022s	sys 0.046s
I20260709 13:11:57.846455 28645 leader_election.cc:290] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:57.879443 25227 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.000s	sys 0.050s
I20260709 13:11:57.855072 28715 raft_consensus.cc:2749] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:11:57.885687 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 596989us
W20260709 13:11:57.886152 25227 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.000s	sys 0.051s
W20260709 13:11:57.892136 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 254482us
I20260709 13:11:57.865242 28614 raft_consensus.cc:493] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:57.865224 28553 raft_consensus.cc:493] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:57.926435 25271 leader_election.cc:304] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:11:57.930184 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 402022us
W20260709 13:11:57.936455 25873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:57.937845 28550 raft_consensus.cc:493] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.930155 28614 raft_consensus.cc:515] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:57.938482 28550 raft_consensus.cc:515] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:57.940618 28550 leader_election.cc:290] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:57.941319 28728 leader_election.cc:290] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:57.942443 28611 consensus_queue.cc:1048] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:57.943014 28728 raft_consensus.cc:493] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:57.923409 28569 leader_election.cc:290] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:57.943596 28728 raft_consensus.cc:515] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:57.936100 28715 raft_consensus.cc:493] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.950946 28147 leader_election.cc:290] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:57.951081 28715 raft_consensus.cc:515] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:57.953287 28715 leader_election.cc:290] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:57.891830 28620 raft_consensus.cc:493] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.947532 25194 leader_election.cc:304] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:57.976115 28654 raft_consensus.cc:2804] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:57.979266 28654 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:57.979736 28654 raft_consensus.cc:3060] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:11:57.995918 25229 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.006s	sys 0.009s
W20260709 13:11:57.996456 25229 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.006s	sys 0.009s
I20260709 13:11:57.998495 28741 raft_consensus.cc:493] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.998787 28739 raft_consensus.cc:493] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:57.999199 28741 raft_consensus.cc:515] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:57.999573 28739 raft_consensus.cc:515] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:58.000180 28454 raft_consensus.cc:493] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:58.000758 28454 raft_consensus.cc:515] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:58.002179 25906 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.004s	sys 0.009s
I20260709 13:11:58.002441 28741 leader_election.cc:290] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:58.002624 28710 raft_consensus.cc:697] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 8 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:58.002480 28739 leader_election.cc:290] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:58.003713 28511 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.001s	sys 0.010s
W20260709 13:11:58.010170 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 400035us
I20260709 13:11:57.946353 28600 raft_consensus.cc:2804] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:11:58.011885 25906 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.004s	sys 0.009s
I20260709 13:11:57.961874 28569 raft_consensus.cc:493] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.016714 25872 leader_election.cc:304] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:57.935050 28553 raft_consensus.cc:515] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:58.021914 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:58.022707 25899 raft_consensus.cc:2468] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 9.
I20260709 13:11:58.024622 28686 leader_election.cc:290] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:11:58.025231 25114 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 275226661cc840559134f8c9e5b15719 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 79d99c0e498349bda74127365219e468 (127.23.140.67:34091) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:11:58.025977 25114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 49051us
I20260709 13:11:58.017948 28600 raft_consensus.cc:493] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:58.032536 28728 leader_election.cc:290] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:58.033036 28600 raft_consensus.cc:3060] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:57.937335 28596 consensus_queue.cc:237] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:58.017863 28511 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.001s	sys 0.010s
I20260709 13:11:58.035100 28654 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:57.978612 28620 raft_consensus.cc:515] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:58.036713 25373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36264 (request call id 1687) took 1708 ms. Trace:
I20260709 13:11:58.037101 25373 rpcz_store.cc:276] 0709 13:11:56.328675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:56.348867 (+ 20192us) service_pool.cc:224] Handling call
0709 13:11:57.480966 (+1132099us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:57.492000 (+ 11034us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:58.036495 (+544495us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b5400306e50. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6e8ad 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:58.036656 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2602657536}
I20260709 13:11:57.978338 28716 consensus_queue.cc:1059] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:11:58.039206 28716 raft_consensus.cc:3055] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:58.025409 28573 raft_consensus.cc:3060] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:58.042342 25194 leader_election.cc:304] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:11:58.052779 25874 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.735s	user 0.000s	sys 0.016s
W20260709 13:11:58.053313 25874 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.000s	sys 0.016s
I20260709 13:11:58.045536 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:58.045944 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:58.054173 25223 raft_consensus.cc:3055] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:58.054246 25222 raft_consensus.cc:2468] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 7.
I20260709 13:11:58.054620 25223 raft_consensus.cc:740] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:58.055104 25343 leader_election.cc:304] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:58.046267 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:58.056655 25226 raft_consensus.cc:2468] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 8.
I20260709 13:11:58.056969 25343 leader_election.cc:304] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:58.023643 25906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50060 (request call id 568) took 1076 ms. Trace:
I20260709 13:11:58.039570 28716 raft_consensus.cc:740] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
W20260709 13:11:58.058948 25376 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.009s	sys 0.007s
W20260709 13:11:58.064451 25376 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.009s	sys 0.007s
I20260709 13:11:58.059338 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:58.065307 25376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36254 (request call id 1970) took 1364 ms. Trace:
W20260709 13:11:58.065351 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 739577us
I20260709 13:11:58.065730 25224 raft_consensus.cc:3060] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:58.059484 25343 leader_election.cc:304] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:58.037434 28654 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:58.080284 25221 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.009s	sys 0.012s
W20260709 13:11:58.081444 25221 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.009s	sys 0.013s
I20260709 13:11:58.087594 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:58.064970 25223 consensus_queue.cc:260] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:58.088402 25899 raft_consensus.cc:2468] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 8.
I20260709 13:11:58.088855 25223 raft_consensus.cc:3060] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Advancing to term 10
W20260709 13:11:58.091367 25873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:58.065778 25376 rpcz_store.cc:276] 0709 13:11:56.700983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:56.701135 (+   152us) service_pool.cc:224] Handling call
0709 13:11:56.701654 (+   519us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:56.704369 (+  2715us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:56.704402 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:56.707256 (+  2854us) log.cc:844] Serialized 52 byte log entry
0709 13:11:56.846342 (+139086us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:57.460356 (+614014us) log.cc:844] Serialized 14 byte log entry
0709 13:11:57.460737 (+   381us) log.cc:844] Serialized 14 byte log entry
0709 13:11:58.064899 (+604162us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:58.065068 (+   169us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:58.065115 (+    47us) raft_consensus.cc:1685] finished
0709 13:11:58.065126 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:58.065257 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51981,"prepare.queue_time_us":23745,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":77,"raft.queue_time_us":485816,"raft.run_cpu_time_us":416,"raft.run_wall_time_us":16137,"thread_start_us":1311894,"threads_started":3,"wal-append.queue_time_us":155799}
I20260709 13:11:58.095160 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:58.095754 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:58.096403 25303 raft_consensus.cc:2393] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 8: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:58.096719 25224 raft_consensus.cc:2468] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 7.
I20260709 13:11:58.097502 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:58.098706 25303 raft_consensus.cc:1240] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:58.099524 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:58.100032 25303 raft_consensus.cc:2468] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 8.
I20260709 13:11:58.039690 28454 leader_election.cc:290] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:58.058524 28513 raft_consensus.cc:2804] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:11:58.064144 28605 consensus_meta.cc:287] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.628s	user 0.011s	sys 0.000s
W20260709 13:11:58.079131 28567 consensus_meta.cc:287] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.743s	user 0.006s	sys 0.006s
I20260709 13:11:58.060245 28598 raft_consensus.cc:493] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:58.063771 28584 raft_consensus.cc:2749] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:58.127962 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:58.078398 28736 raft_consensus.cc:2749] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:58.053819 28686 raft_consensus.cc:493] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:58.138794 28686 raft_consensus.cc:515] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:58.053409 28728 raft_consensus.cc:493] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:58.142051 28728 raft_consensus.cc:515] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:58.144014 28728 leader_election.cc:290] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:58.145051 28753 log.cc:927] Time spent T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 13:11:58.110453 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:58.063551 28687 raft_consensus.cc:2749] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:58.113710 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:58.152768 25225 raft_consensus.cc:2468] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 7.
I20260709 13:11:58.118996 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:58.153324 28734 raft_consensus.cc:493] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:58.154084 25298 raft_consensus.cc:2393] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 8: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:11:58.153946 28734 raft_consensus.cc:515] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:58.155011 25194 leader_election.cc:304] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:58.155344 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:58.119765 25296 raft_consensus.cc:1240] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 8. Current term is 9. Ops: []
W20260709 13:11:58.156018 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 96633.2us
I20260709 13:11:58.107247 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:58.092340 28738 raft_consensus.cc:493] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:58.065860 28739 raft_consensus.cc:493] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:58.021425 28569 raft_consensus.cc:515] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:58.133625 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:58.089257 28747 raft_consensus.cc:493] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.137938 28737 consensus_queue.cc:1048] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:11:58.156745 25343 leader_election.cc:304] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:58.157543 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:58.203557 28596 consensus_queue.cc:1048] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:58.205487 28559 raft_consensus.cc:3060] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:58.209820 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:58.210557 25305 raft_consensus.cc:2468] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 9.
I20260709 13:11:58.211397 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:58.212112 25305 raft_consensus.cc:2393] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 9: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:58.212801 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:58.213321 25305 raft_consensus.cc:2468] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 9.
W20260709 13:11:58.214429 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 57754.6us
I20260709 13:11:58.216665 28689 consensus_queue.cc:1048] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:58.221904 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:58.222755 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:58.229148 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:58.236462 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:58.232681 28147 raft_consensus.cc:493] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.238916 28147 raft_consensus.cc:515] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:58.239974 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:58.240532 25375 raft_consensus.cc:3060] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:58.241001 28147 leader_election.cc:290] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:58.233335 28715 raft_consensus.cc:493] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.141674 28686 leader_election.cc:290] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:58.177834 28530 consensus_queue.cc:1059] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:11:58.241863 28652 leader_election.cc:290] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:58.241828 28715 raft_consensus.cc:515] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:11:58.242718 28652 raft_consensus.cc:493] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.243227 25372 raft_consensus.cc:1240] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:11:58.243276 28652 raft_consensus.cc:515] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:58.244064 28715 leader_election.cc:290] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:58.244441 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:58.245983 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:58.206992 28728 raft_consensus.cc:2749] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:58.124007 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:58.248047 25297 raft_consensus.cc:2410] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:11:58.158375 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:58.158594 25373 raft_consensus.cc:1275] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:11:58.158463 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 56395.9us
I20260709 13:11:58.249603 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:58.159261 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:58.250298 25228 raft_consensus.cc:2468] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 6.
I20260709 13:11:58.159312 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:58.245693 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:58.250957 25376 raft_consensus.cc:2468] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 8.
I20260709 13:11:58.251169 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:58.160436 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:58.252535 25224 raft_consensus.cc:2468] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 5.
I20260709 13:11:58.109531 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:58.032575 28711 raft_consensus.cc:515] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:58.161273 25298 raft_consensus.cc:2393] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 8: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:58.253338 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:58.254323 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:58.160609 25223 raft_consensus.cc:2468] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 10.
I20260709 13:11:58.178135 28574 raft_consensus.cc:2804] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:11:58.160794 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:58.189234 28716 consensus_queue.cc:260] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:58.189841 28687 raft_consensus.cc:493] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.126813 28605 raft_consensus.cc:515] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:58.258131 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:58.284040 25225 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 6.
I20260709 13:11:58.284823 28728 raft_consensus.cc:493] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.284982 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:58.285362 28728 raft_consensus.cc:515] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:58.285912 25225 raft_consensus.cc:2410] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:11:58.263928 28716 raft_consensus.cc:3060] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:58.286698 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:58.258189 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:58.287531 28728 leader_election.cc:290] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:58.288345 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:58.288957 28728 raft_consensus.cc:493] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:58.289350 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:58.289458 28728 raft_consensus.cc:515] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:58.290232 25223 raft_consensus.cc:2410] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:11:58.258189 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:58.174338 28550 raft_consensus.cc:2749] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:58.266163 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:58.251169 25372 raft_consensus.cc:2376] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 9. Re-sending same reply.
I20260709 13:11:58.292505 25224 raft_consensus.cc:2468] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 9.
W20260709 13:11:58.262408 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:58.269647 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:58.289909 25303 raft_consensus.cc:2468] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 8.
I20260709 13:11:58.262126 28574 raft_consensus.cc:493] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:58.295212 25225 raft_consensus.cc:2393] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 9: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:58.250222 25371 raft_consensus.cc:2468] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 8.
I20260709 13:11:58.301492 25224 raft_consensus.cc:1275] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:11:58.259774 28517 raft_consensus.cc:3060] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:58.332559 25372 raft_consensus.cc:1275] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:58.339314 25225 raft_consensus.cc:1275] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:11:58.332850 25297 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f"
dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
 from {username='slave'} at 127.0.0.1:57272
I20260709 13:11:58.340755 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:58.341549 25225 raft_consensus.cc:2410] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:11:58.303498 25378 raft_consensus.cc:2393] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 9: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:58.330540 25228 raft_consensus.cc:2468] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 8.
I20260709 13:11:58.258636 28530 raft_consensus.cc:3055] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:58.219273 28710 consensus_queue.cc:237] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:11:58.136183 28598 raft_consensus.cc:515] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:58.297254 28687 raft_consensus.cc:515] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:58.328416 25296 raft_consensus.cc:1275] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:11:58.280459 25375 raft_consensus.cc:2468] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 10.
I20260709 13:11:58.341919 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:58.341275 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:58.267568 28739 raft_consensus.cc:515] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:58.131640 28567 raft_consensus.cc:515] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:58.340219 28715 raft_consensus.cc:493] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
W20260709 13:11:58.352632 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:58.368224 25229 raft_consensus.cc:1275] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:11:58.371166 25373 raft_consensus.cc:3060] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:58.375216 25194 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.140.66:33127 timed out after 1.519s (SENT) [suppressed 31 similar messages]
I20260709 13:11:58.301833 28574 raft_consensus.cc:3060] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:58.377807 28567 leader_election.cc:290] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:58.302016 28584 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:58.379904 25225 raft_consensus.cc:1275] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:11:58.380585 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:58.407061 25375 raft_consensus.cc:2468] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 9.
I20260709 13:11:58.384307 28550 raft_consensus.cc:493] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.380692 25298 raft_consensus.cc:1240] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:11:58.383759 25371 raft_consensus.cc:2393] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 9: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:58.232144 28747 raft_consensus.cc:515] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:58.391296 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:58.332224 28652 leader_election.cc:290] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:58.392417 25379 raft_consensus.cc:1275] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:11:58.342918 28530 raft_consensus.cc:740] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:58.346905 25223 raft_consensus.cc:1275] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:11:58.253024 28738 raft_consensus.cc:515] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:58.410483 28584 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:58.404801 28553 leader_election.cc:290] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:58.412717 28550 raft_consensus.cc:515] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:58.387282 28512 consensus_queue.cc:1048] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:11:58.432492 25373 raft_consensus.cc:2468] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 7.
I20260709 13:11:58.404273 28715 raft_consensus.cc:515] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:58.439483 28711 leader_election.cc:290] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:58.437892 25903 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.826s	user 0.027s	sys 0.084s
W20260709 13:11:58.466105 25903 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.854s	user 0.027s	sys 0.084s
W20260709 13:11:58.464468 28578 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.038s	sys 0.077s
W20260709 13:11:58.473415 28578 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.038s	sys 0.077s
W20260709 13:11:58.476523 25873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:58.479905 25270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:58.483943 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:58.485359 25908 raft_consensus.cc:1275] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:11:58.486654 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:58.491140 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:58.493677 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:58.495796 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:58.510473 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:58.511475 25902 raft_consensus.cc:2393] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 9: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:58.484123 28689 raft_consensus.cc:493] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.522158 25301 leader_election.cc:290] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:58.530048 25301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:57272 (request call id 1748) took 1759 ms. Trace:
I20260709 13:11:58.530586 25301 rpcz_store.cc:276] 0709 13:11:56.763192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:56.769911 (+  6719us) service_pool.cc:224] Handling call
0709 13:11:58.522002 (+1752091us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b4c00094dc0. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72df3ba20 00007fd72df4ca29 00007fd72df4d13f 00007fd72df112ab 00007fd72df3ef3c 00007fd72df3f3fe 00007fd72e1cc88b 00007fd72fbcb495 00007fd72fc1c30f 00007fd72fc66a55 00007fd734c36cd0
0709 13:11:58.522780 (+   778us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36407552}
I20260709 13:11:58.536765 25270 leader_election.cc:304] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:58.542479 25270 leader_election.cc:304] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:58.512881 28569 leader_election.cc:290] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:58.545306 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:58.543646 25270 leader_election.cc:304] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:11:58.551229 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 194754us
I20260709 13:11:58.528517 28605 leader_election.cc:290] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:58.527601 28689 raft_consensus.cc:515] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:58.528066 28513 raft_consensus.cc:697] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:58.532192 28728 leader_election.cc:290] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:11:58.592077 28600 consensus_meta.cc:287] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.558s	user 0.009s	sys 0.000s
I20260709 13:11:58.546373 28559 consensus_queue.cc:1048] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:11:58.592571 28600 raft_consensus.cc:515] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:58.593694 25296 raft_consensus.cc:1240] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:58.593958 28721 raft_consensus.cc:493] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.594496 28721 raft_consensus.cc:515] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:58.586556 28319 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:58.549274 28651 raft_consensus.cc:2804] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:58.590848 28513 consensus_queue.cc:237] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:58.591750 28771 raft_consensus.cc:2804] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:58.596032 25300 raft_consensus.cc:1275] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
W20260709 13:11:58.549190 28637 log.cc:927] Time spent T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 2.086s	user 0.002s	sys 0.003s
I20260709 13:11:58.533785 28711 consensus_queue.cc:1048] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:11:58.613168 25300 pending_rounds.cc:85] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19: Aborting all ops after (but not including) 6
I20260709 13:11:58.613503 25300 pending_rounds.cc:107] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 13:11:58.500489 28530 consensus_queue.cc:260] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:58.613797 25300 raft_consensus.cc:2889] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:58.574764 28741 raft_consensus.cc:2804] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:58.617566 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:11:58.618513 25903 raft_consensus.cc:3060] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:58.619211 25901 raft_consensus.cc:2468] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 9.
W20260709 13:11:58.617951 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 461519us
I20260709 13:11:58.620680 25297 raft_consensus.cc:493] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:58.621129 25297 raft_consensus.cc:3060] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:58.578761 28749 raft_consensus.cc:493] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:58.623029 25271 leader_election.cc:304] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:58.552054 28739 leader_election.cc:290] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:58.635017 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:58.614027 28771 raft_consensus.cc:493] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:58.636569 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:11:58.596490 28319 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:58.637336 25902 raft_consensus.cc:2468] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 7.
I20260709 13:11:58.616117 28741 raft_consensus.cc:493] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:58.616436 28651 raft_consensus.cc:697] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 9 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:58.620347 28598 leader_election.cc:290] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:58.644629 25344 leader_election.cc:304] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:58.671797 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:11:58.761464 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 116913us
I20260709 13:11:58.742118 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:11:58.778487 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:58.787250 25874 leader_election.cc:336] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Timed out: RequestConsensusVote RPC to 127.23.140.65:39361 timed out after 1.843s (SENT)
I20260709 13:11:58.839282 25874 leader_election.cc:304] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:11:58.840512 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 53349.7us
I20260709 13:11:58.841774 25344 leader_election.cc:304] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:11:58.631593 28693 raft_consensus.cc:493] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
W20260709 13:11:58.817124 28776 log.cc:927] Time spent T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.343s	user 0.001s	sys 0.000s
I20260709 13:11:58.643229 28530 raft_consensus.cc:3060] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:58.816298 25297 raft_consensus.cc:515] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:58.883576 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:58.828588 28738 leader_election.cc:290] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:58.642760 28771 raft_consensus.cc:3060] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:58.833109 28765 log.cc:927] Time spent T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.187s	user 0.000s	sys 0.000s
W20260709 13:11:58.827284 28716 consensus_meta.cc:287] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 0.541s	user 0.009s	sys 0.000s
I20260709 13:11:58.842911 25903 raft_consensus.cc:2468] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 8.
I20260709 13:11:58.821899 28550 leader_election.cc:290] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:58.780314 28741 raft_consensus.cc:3060] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:11:58.924000 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:58.914564 28693 raft_consensus.cc:515] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:58.982052 28574 consensus_meta.cc:287] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 0.573s	user 0.007s	sys 0.003s
I20260709 13:11:58.982227 28693 leader_election.cc:290] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:58.927096 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 294694us
I20260709 13:11:58.802501 28737 raft_consensus.cc:493] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.741813 28584 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:58.822211 28600 leader_election.cc:290] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:58.842888 28770 raft_consensus.cc:2749] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:11:58.929459 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 306482us
I20260709 13:11:58.803414 28746 raft_consensus.cc:2804] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:11:58.949517 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:58.746637 28739 raft_consensus.cc:2804] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:58.951987 28573 raft_consensus.cc:493] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.953575 28614 leader_election.cc:290] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:58.956804 25230 raft_consensus.cc:1275] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:11:58.918608 28598 raft_consensus.cc:2804] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:58.822731 28651 consensus_queue.cc:237] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:58.979178 28717 raft_consensus.cc:3060] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:58.923282 28512 raft_consensus.cc:493] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
W20260709 13:11:58.991258 25194 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.008s	sys 0.007s
W20260709 13:11:59.007718 25194 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.008s	sys 0.007s
I20260709 13:11:59.004974 25270 leader_election.cc:304] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:58.993793 25230 pending_rounds.cc:85] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce: Aborting all ops after (but not including) 7
I20260709 13:11:59.009301 25230 pending_rounds.cc:107] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:11:59.009662 25230 raft_consensus.cc:2889] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:58.982553 28574 raft_consensus.cc:515] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:58.636782 28749 raft_consensus.cc:515] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:59.008201 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 632971us
I20260709 13:11:58.991380 28746 raft_consensus.cc:493] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:11:58.741577 28715 leader_election.cc:290] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:58.991592 28739 raft_consensus.cc:493] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:59.002027 25271 leader_election.cc:304] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:59.024111 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:59.024371 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:59.024770 25222 raft_consensus.cc:2468] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 7.
I20260709 13:11:59.024900 25226 raft_consensus.cc:2468] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 7.
I20260709 13:11:59.027808 25271 leader_election.cc:304] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:59.029035 25271 leader_election.cc:304] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:58.995607 28598 raft_consensus.cc:493] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
W20260709 13:11:59.048110 25874 leader_election.cc:336] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Timed out: RequestConsensusVote RPC to 127.23.140.65:39361 timed out after 2.062s (SENT)
I20260709 13:11:59.048729 25874 leader_election.cc:304] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:59.012876 28714 raft_consensus.cc:2749] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:59.046650 28775 raft_consensus.cc:2804] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:59.026007 28739 raft_consensus.cc:3060] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:59.020731 28746 raft_consensus.cc:3060] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:59.021798 28614 raft_consensus.cc:493] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:59.050163 28770 raft_consensus.cc:2749] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:59.016544 28512 raft_consensus.cc:515] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:59.030443 28584 raft_consensus.cc:493] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:58.995294 28573 raft_consensus.cc:515] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:59.063103 28560 raft_consensus.cc:2804] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:58.990001 28737 raft_consensus.cc:515] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:11:59.076267 25873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:59.063457 28693 raft_consensus.cc:2804] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:59.047423 28598 raft_consensus.cc:3060] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:59.062655 28749 leader_election.cc:290] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:59.065770 28775 raft_consensus.cc:493] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:59.083757 28560 raft_consensus.cc:493] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:59.076265 28614 raft_consensus.cc:515] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:59.111503 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 99128.8us
I20260709 13:11:59.094712 28775 raft_consensus.cc:3060] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:59.083113 28584 raft_consensus.cc:515] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:59.097307 28693 raft_consensus.cc:697] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 10 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:59.112375 25270 leader_election.cc:304] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:59.110473 28560 raft_consensus.cc:3060] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:59.121013 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 92071.3us
I20260709 13:11:59.126150 25194 leader_election.cc:304] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:59.139626 28265 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:11:59.140221 28265 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:59.142765 28265 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:59.143947 28693 consensus_queue.cc:237] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:59.147964 28402 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.148559 28402 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:11:59.149081 28788 log.cc:927] Time spent T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:11:58.058059 25906 rpcz_store.cc:276] 0709 13:11:56.943347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:56.999346 (+ 55999us) service_pool.cc:224] Handling call
0709 13:11:57.022172 (+ 22826us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:57.022389 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:11:57.022674 (+   285us) log.cc:844] Serialized 14 byte log entry
0709 13:11:58.018436 (+995762us) log.cc:844] Serialized 14 byte log entry
0709 13:11:58.018660 (+   224us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:58.018709 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:58.018754 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:58.019314 (+   560us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:58.019435 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":608,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":8814,"raft.queue_time_us":234236,"raft.run_cpu_time_us":354,"raft.run_wall_time_us":63767,"thread_start_us":995131,"threads_started":2,"wal-append.queue_time_us":694655}
I20260709 13:11:59.150626 28402 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:59.152101 25195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:59.153293 25195 leader_election.cc:400] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Vote denied by peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085) with higher term. Message: Invalid argument: T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 8. Current term is 9.
I20260709 13:11:59.157071 25195 leader_election.cc:304] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:59.136293 28714 raft_consensus.cc:2804] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:59.136628 28556 raft_consensus.cc:2804] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:59.176769 25195 leader_election.cc:304] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:59.158749 28743 raft_consensus.cc:493] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.160444 28584 leader_election.cc:290] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:59.130198 28716 consensus_queue.cc:1059] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:11:59.147987 28600 raft_consensus.cc:493] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:11:59.161928 28569 raft_consensus.cc:2749] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:59.198935 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:59.200467 25304 raft_consensus.cc:2393] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 10: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:59.181582 28556 raft_consensus.cc:493] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:59.203856 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:59.205067 25304 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 6.
I20260709 13:11:59.189841 28574 leader_election.cc:290] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:59.214026 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 55055.8us
I20260709 13:11:59.192675 28686 raft_consensus.cc:493] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:59.205477 28556 raft_consensus.cc:3060] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:11:59.232175 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 55481.5us
I20260709 13:11:59.240428 25195 leader_election.cc:304] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:59.194756 28743 raft_consensus.cc:515] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:11:59.208161 28569 raft_consensus.cc:2749] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:59.247574 25195 leader_election.cc:304] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:59.198117 28600 raft_consensus.cc:515] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:59.250936 28573 leader_election.cc:290] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:59.246435 28614 leader_election.cc:290] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:59.261327 25195 leader_election.cc:304] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:59.229807 28686 raft_consensus.cc:515] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:59.261722 28569 raft_consensus.cc:2749] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:59.259164 28714 raft_consensus.cc:697] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 9 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:59.281847 28600 leader_election.cc:290] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:59.282986 28512 leader_election.cc:290] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:59.268972 28614 raft_consensus.cc:2749] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:59.288717 28746 raft_consensus.cc:515] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:59.292482 28556 raft_consensus.cc:515] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:59.254988 28741 raft_consensus.cc:515] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:59.271375 28530 raft_consensus.cc:2749] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:59.304864 25195 leader_election.cc:304] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:59.305649 28560 raft_consensus.cc:515] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:59.307488 25300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57256 (request call id 1868) took 2497 ms. Trace:
I20260709 13:11:59.307966 25300 rpcz_store.cc:276] 0709 13:11:56.810254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:56.822305 (+ 12051us) service_pool.cc:224] Handling call
0709 13:11:56.822690 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:58.615764 (+1793074us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:59.307219 (+691455us) spinlock_profiling.cc:243] Waited 1.77 s on lock 0x7b5400400bd4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:59.307423 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4077581056}
I20260709 13:11:59.309229 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:59.305104 28746 leader_election.cc:290] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:11:59.311249 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:59.313069 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:59.314808 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:59.317433 25301 raft_consensus.cc:2393] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 10: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
W20260709 13:11:59.318858 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:59.326912 25195 leader_election.cc:304] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:59.339536 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:59.325445 28319 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:59.342288 28614 raft_consensus.cc:2749] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:59.346040 25195 leader_election.cc:304] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:59.346939 28716 raft_consensus.cc:2764] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:11:59.348269 25195 leader_election.cc:304] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:59.349002 28716 raft_consensus.cc:3060] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:59.340855 28530 raft_consensus.cc:2804] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:59.350121 28530 raft_consensus.cc:493] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:59.350495 28530 raft_consensus.cc:3060] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:59.310478 28714 consensus_queue.cc:237] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:59.307485 28743 leader_election.cc:290] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361)
I20260709 13:11:59.356446 25222 raft_consensus.cc:1240] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 9. Current term is 10. Ops: [7.7-9.8]
I20260709 13:11:59.357349 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:59.358372 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:59.359354 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:59.371044 25229 raft_consensus.cc:2368] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 6. Current term is 7.
I20260709 13:11:59.361109 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:59.373601 25225 raft_consensus.cc:2410] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:11:59.374369 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:59.375312 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:59.370306 25226 raft_consensus.cc:2468] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 8.
I20260709 13:11:59.369809 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:59.362869 28556 leader_election.cc:290] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:59.362957 25228 raft_consensus.cc:1240] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:59.363365 28741 leader_election.cc:290] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:59.364903 25227 raft_consensus.cc:1275] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:11:59.366973 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:59.366741 28739 raft_consensus.cc:515] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:59.381477 28739 leader_election.cc:290] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:59.381203 28598 raft_consensus.cc:515] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:59.378757 25227 pending_rounds.cc:85] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce: Aborting all ops after (but not including) 5
I20260709 13:11:59.382630 25227 pending_rounds.cc:107] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:11:59.382905 25227 raft_consensus.cc:2889] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:59.382963 25377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56308 (request call id 550) took 1163 ms. Trace:
I20260709 13:11:59.383314 25377 rpcz_store.cc:276] 0709 13:11:58.219338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:58.219481 (+   143us) service_pool.cc:224] Handling call
0709 13:11:58.233125 (+ 13644us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:58.475320 (+242195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:58.475363 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:58.475428 (+    65us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:58.475473 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:59.382744 (+907271us) spinlock_profiling.cc:243] Waited 242 ms on lock 0x7b5400129dd4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:59.382801 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:59.382911 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":556464000}
I20260709 13:11:59.324952 28771 raft_consensus.cc:515] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:59.386842 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:59.367822 28775 raft_consensus.cc:515] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:59.389880 25300 raft_consensus.cc:2368] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 8. Current term is 9.
I20260709 13:11:59.397279 28598 leader_election.cc:290] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:59.398079 28560 leader_election.cc:290] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:59.402480 25297 leader_election.cc:290] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:59.402976 25297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:57272 (request call id 1769) took 1299 ms. Trace:
I20260709 13:11:59.403265 25297 rpcz_store.cc:276] 0709 13:11:58.103228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:58.292001 (+188773us) service_pool.cc:224] Handling call
0709 13:11:59.399990 (+1107989us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x7b54001e9954. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc66a3d 00007fd734c36cd0 00007fd72e1bb254 00007fd72e1bb1e2 00007fd72e1bb111 00007fd72e1bb08c 00007fd72e1ba342 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:59.402914 (+  2924us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":645454208}
I20260709 13:11:59.404247 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:59.404866 25297 raft_consensus.cc:2468] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 7.
I20260709 13:11:59.412233 28771 leader_election.cc:290] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:59.412575 28721 leader_election.cc:290] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:59.405679 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:59.414479 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:59.415119 25223 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 9.
I20260709 13:11:59.425072 28775 leader_election.cc:290] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:59.434870 25303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57272 (request call id 1766) took 1336 ms. Trace:
I20260709 13:11:59.435348 25303 rpcz_store.cc:276] 0709 13:11:58.098656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:58.100566 (+  1910us) service_pool.cc:224] Handling call
0709 13:11:59.434681 (+1334115us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b540018d3d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:59.434797 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":370588544}
I20260709 13:11:59.436622 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:11:59.437062 28796 log.cc:927] Time spent T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.287s	user 0.000s	sys 0.001s
I20260709 13:11:59.453076 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:59.456377 25223 raft_consensus.cc:1240] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
W20260709 13:11:59.462425 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:59.465070 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:59.465298 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:59.465941 25297 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 5.
I20260709 13:11:59.468477 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:59.464306 28716 raft_consensus.cc:2749] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:59.473340 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:59.474628 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:59.477962 28530 raft_consensus.cc:515] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:59.479197 25225 raft_consensus.cc:2368] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 7. Current term is 8.
I20260709 13:11:59.478415 25302 raft_consensus.cc:1240] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:59.482291 28689 leader_election.cc:290] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:59.483076 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:59.491623 25302 raft_consensus.cc:2393] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 8: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:11:59.492714 25302 raft_consensus.cc:1240] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:11:59.482386 28530 leader_election.cc:290] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:59.493227 28747 leader_election.cc:290] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:59.488102 28687 leader_election.cc:290] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:59.483803 28690 raft_consensus.cc:3055] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:59.495003 28690 raft_consensus.cc:740] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:11:59.495790 28690 consensus_queue.cc:260] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:59.496767 28690 raft_consensus.cc:3060] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:59.496804 25298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57272 (request call id 1764) took 1398 ms. Trace:
I20260709 13:11:59.497323 25298 rpcz_store.cc:276] 0709 13:11:58.098200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:58.253831 (+155631us) service_pool.cc:224] Handling call
0709 13:11:58.290073 (+ 36242us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:58.409830 (+119757us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:59.496542 (+1086712us) spinlock_profiling.cc:243] Waited 90.3 ms on lock 0x7b540029b154. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:59.496733 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":207684864}
I20260709 13:11:59.500744 25224 raft_consensus.cc:2468] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 8.
W20260709 13:11:59.489701 28792 log.cc:927] Time spent T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.344s	user 0.000s	sys 0.001s
I20260709 13:11:59.502347 25305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46556 (request call id 454) took 1015 ms. Trace:
I20260709 13:11:59.502681 25305 rpcz_store.cc:276] 0709 13:11:58.487424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:58.974091 (+486667us) service_pool.cc:224] Handling call
0709 13:11:58.974406 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:58.984403 (+  9997us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:11:58.984435 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:58.984848 (+   413us) log.cc:844] Serialized 26 byte log entry
0709 13:11:59.090790 (+105942us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:59.090847 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:59.090945 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:59.489075 (+398130us) spinlock_profiling.cc:243] Waited 9.74 ms on lock 0x7b4400022b4c. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72caa8c85 00007fd72caa96a2 00007fd72f81b1db 00007fd72f816aaf 00007fd72f80a86e 00007fd72f809bb6 00007fd72f8097d8 00007fd72f813221 00007fd72f8131d9 00007fd72f813169
0709 13:11:59.502079 (+ 13004us) raft_consensus.cc:1685] finished
0709 13:11:59.502102 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:59.502292 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12967,"raft.queue_time_us":653,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":4272,"spinlock_wait_cycles":22412672,"thread_start_us":96405,"threads_started":1,"wal-append.queue_time_us":129042}
I20260709 13:11:59.506093 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:59.506755 25222 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 5.
I20260709 13:11:59.508097 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:59.508648 25222 raft_consensus.cc:2468] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 7.
I20260709 13:11:59.509738 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:11:59.490366 28574 raft_consensus.cc:3055] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:59.511008 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:59.511525 28574 raft_consensus.cc:740] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:11:59.511776 25222 raft_consensus.cc:2468] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 10.
I20260709 13:11:59.512346 28574 consensus_queue.cc:260] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:59.513329 28574 raft_consensus.cc:3060] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:59.517560 28620 leader_election.cc:290] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:59.526213 25270 leader_election.cc:304] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:11:59.527427 25270 leader_election.cc:304] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:59.528891 25270 leader_election.cc:304] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:59.530921 25195 leader_election.cc:304] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:59.531370 28716 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.535804 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:59.537268 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
W20260709 13:11:59.537406 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:59.541261 25343 leader_election.cc:304] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:59.544872 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:59.545629 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:59.546433 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:59.546916 25371 raft_consensus.cc:3060] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:59.547775 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:59.548764 25376 raft_consensus.cc:1275] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:11:59.534711 28557 raft_consensus.cc:2804] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:59.549927 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:59.551229 25377 raft_consensus.cc:2393] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 8: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:59.552610 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:59.553527 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:59.554059 25376 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 6.
I20260709 13:11:59.531556 28620 raft_consensus.cc:493] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.531535 28578 raft_consensus.cc:493] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.557909 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:59.534715 28799 raft_consensus.cc:2804] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:59.563277 28557 raft_consensus.cc:697] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 7 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:59.563642 28799 raft_consensus.cc:493] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:59.563511 28809 consensus_queue.cc:1048] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:11:59.564280 28799 raft_consensus.cc:3060] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:59.533828 28793 raft_consensus.cc:2749] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:59.534889 28596 raft_consensus.cc:493] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.565135 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:59.570277 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:59.538329 28147 raft_consensus.cc:493] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.571854 25372 raft_consensus.cc:3060] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:59.571976 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:59.573416 25378 raft_consensus.cc:2393] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 9: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:59.550907 28642 raft_consensus.cc:493] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:59.575839 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:59.554971 28598 raft_consensus.cc:2804] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:59.533843 28530 consensus_queue.cc:1059] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:11:59.578903 25297 raft_consensus.cc:2468] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 7.
I20260709 13:11:59.533635 28716 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:59.580470 25305 raft_consensus.cc:1275] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:11:59.565047 28800 raft_consensus.cc:493] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:11:59.585706 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:59.564677 28557 consensus_queue.cc:237] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:59.588107 28800 raft_consensus.cc:515] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:59.570317 28620 raft_consensus.cc:515] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:59.592370 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:11:59.568158 28578 raft_consensus.cc:515] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:59.580973 28598 raft_consensus.cc:493] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:59.583472 28645 raft_consensus.cc:2804] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:59.598117 25370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36254 (request call id 1975) took 1373 ms. Trace:
I20260709 13:11:59.605602 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:59.606165 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:59.606963 25226 raft_consensus.cc:2468] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 9.
I20260709 13:11:59.575678 28596 raft_consensus.cc:515] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:59.609465 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:59.609863 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:59.603233 25370 rpcz_store.cc:276] 0709 13:11:58.224892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:58.225012 (+   120us) service_pool.cc:224] Handling call
0709 13:11:58.225336 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:58.274556 (+ 49220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:58.274585 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:58.275112 (+   527us) log.cc:844] Serialized 26 byte log entry
0709 13:11:58.510221 (+235109us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:58.635415 (+125194us) log.cc:844] Serialized 14 byte log entry
0709 13:11:58.635682 (+   267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:59.597691 (+962009us) spinlock_profiling.cc:243] Waited 31.9 ms on lock 0x7b540009d3d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:59.597746 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:59.597825 (+    79us) raft_consensus.cc:1685] finished
0709 13:11:59.597916 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:59.598059 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16921,"prepare.queue_time_us":38827,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":3840,"raft.queue_time_us":31295,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":8628,"spinlock_wait_cycles":73465088,"thread_start_us":277658,"threads_started":2,"wal-append.queue_time_us":326784}
I20260709 13:11:59.616245 25345 leader_election.cc:304] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:59.610677 28666 raft_consensus.cc:493] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.618899 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:59.618809 28666 raft_consensus.cc:515] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:59.620003 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:59.620559 25375 raft_consensus.cc:2468] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 8.
I20260709 13:11:59.620854 28666 leader_election.cc:290] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:59.610734 28809 raft_consensus.cc:493] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.621353 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:59.618114 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:59.624022 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:59.622925 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:59.640010 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:59.640769 25377 raft_consensus.cc:2468] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 8.
I20260709 13:11:59.641737 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:59.621948 28630 raft_consensus.cc:2749] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:59.643458 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:11:59.602684 28598 raft_consensus.cc:3060] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:59.646726 25229 raft_consensus.cc:2468] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 5.
I20260709 13:11:59.578563 28147 raft_consensus.cc:515] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:59.649292 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:59.650048 25345 leader_election.cc:304] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:59.651815 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:59.622197 28746 raft_consensus.cc:493] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.655620 28800 leader_election.cc:290] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:59.656769 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:59.658092 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:59.658739 25375 raft_consensus.cc:2393] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 8: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:59.659448 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:59.661957 28799 raft_consensus.cc:515] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:59.663545 28147 leader_election.cc:290] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:59.664939 28799 leader_election.cc:290] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:11:59.665773 28818 log.cc:927] Time spent T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:11:59.650727 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:59.667886 25377 raft_consensus.cc:2393] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 9: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:11:59.668772 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:59.669906 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:59.670460 25375 raft_consensus.cc:3060] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:59.681367 25372 raft_consensus.cc:2468] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 10.
I20260709 13:11:59.621711 28809 raft_consensus.cc:515] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:11:59.688797 28809 leader_election.cc:290] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:59.689592 25345 leader_election.cc:304] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:59.692932 25270 leader_election.cc:304] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:11:59.693789 28666 raft_consensus.cc:2749] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:59.694823 28666 consensus_queue.cc:1048] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:59.697680 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:11:59.699931 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:59.702291 25229 raft_consensus.cc:2393] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 9: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:11:59.712534 25270 leader_election.cc:304] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
W20260709 13:11:59.717043 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:59.581507 28642 raft_consensus.cc:515] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:59.698506 28147 raft_consensus.cc:2749] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:59.699998 28809 raft_consensus.cc:2749] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:59.725457 25345 leader_election.cc:304] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:59.727593 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:11:59.686203 28746 raft_consensus.cc:515] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:59.736693 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:11:59.737637 28687 raft_consensus.cc:2749] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:59.719242 28588 raft_consensus.cc:2749] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:59.744220 25229 raft_consensus.cc:1275] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:11:59.748010 28596 leader_election.cc:290] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:59.751120 25229 raft_consensus.cc:1275] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:11:59.751650 28746 leader_election.cc:290] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:59.741828 28620 leader_election.cc:290] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:59.758526 28578 leader_election.cc:290] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:59.759306 28716 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:59.763617 28734 leader_election.cc:290] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:11:59.764787 28549 raft_consensus.cc:493] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.751155 28737 leader_election.cc:290] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:11:59.766649 25296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57256 (request call id 1872) took 1647 ms. Trace:
I20260709 13:11:59.767053 25296 rpcz_store.cc:276] 0709 13:11:58.118851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:58.381490 (+262639us) service_pool.cc:224] Handling call
0709 13:11:58.392348 (+ 10858us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:58.594113 (+201765us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:59.766427 (+1172314us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b540029a754. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:59.766586 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":462558080}
I20260709 13:11:59.769424 25379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56308 (request call id 549) took 1550 ms. Trace:
I20260709 13:11:59.769812 25379 rpcz_store.cc:276] 0709 13:11:58.219035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:58.219691 (+   656us) service_pool.cc:224] Handling call
0709 13:11:58.241528 (+ 21837us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:58.421397 (+179869us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:59.769177 (+1347780us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b5400458dd4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:11:59.769362 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":345996672}
I20260709 13:11:59.771189 25379 raft_consensus.cc:1240] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 7. Current term is 8. Ops: []
W20260709 13:11:59.773406 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:59.782657 25379 raft_consensus.cc:1275] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:11:59.784458 25371 raft_consensus.cc:2468] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 11.
I20260709 13:11:59.785715 25370 raft_consensus.cc:1240] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 10. Current term is 11. Ops: [8.6-10.7]
I20260709 13:11:59.787369 25270 leader_election.cc:304] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:59.791358 25375 raft_consensus.cc:2468] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 9.
I20260709 13:11:59.806488 25371 raft_consensus.cc:1275] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:59.808902 25371 raft_consensus.cc:1275] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 8 index: 3. (index mismatch)
I20260709 13:11:59.810341 25372 raft_consensus.cc:1240] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 8. Current term is 10. Ops: []
I20260709 13:11:59.811838 28725 raft_consensus.cc:2804] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:59.813601 28725 raft_consensus.cc:697] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 10 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:11:59.814492 28725 consensus_queue.cc:237] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:59.816337 25270 leader_election.cc:304] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:11:59.903695 25874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:59.904091 25873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:59.905221 25874 leader_election.cc:336] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Timed out: RequestConsensusVote RPC to 127.23.140.65:39361 timed out after 2.071s (SENT)
I20260709 13:11:59.819129 28549 raft_consensus.cc:515] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:11:59.905740 25874 leader_election.cc:304] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:11:59.919955 25298 raft_consensus.cc:1240] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 9. Current term is 10. Ops: []
W20260709 13:11:59.924937 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 108665us
I20260709 13:11:59.919080 25301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46556 (request call id 452) took 1436 ms. Trace:
W20260709 13:11:59.974077 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 68896.4us
W20260709 13:11:59.975255 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 108866us
I20260709 13:11:59.975983 25345 leader_election.cc:304] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:11:59.976191 25270 leader_election.cc:304] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:11:59.938747 25301 rpcz_store.cc:276] 0709 13:11:58.482339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:58.544960 (+ 62621us) service_pool.cc:224] Handling call
0709 13:11:59.918662 (+1373702us) spinlock_profiling.cc:243] Waited 767 ms on lock 0x7b540029ac54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:11:59.919019 (+   357us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1763320192}
I20260709 13:11:59.916497 28549 leader_election.cc:290] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:11:59.991046 25874 leader_election.cc:304] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:11:59.993320 28690 consensus_queue.cc:1059] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:59.984220 28801 raft_consensus.cc:2804] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:59.995743 25377 raft_consensus.cc:1240] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:11:59.980456 28500 raft_consensus.cc:2749] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:59.998451 28588 raft_consensus.cc:2804] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:59.984119 28550 consensus_queue.cc:1048] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:11:59.998929 28638 consensus_queue.cc:1048] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:00.032071 28696 raft_consensus.cc:2804] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:00.032590 28696 raft_consensus.cc:493] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:00.033074 28696 raft_consensus.cc:3060] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:00.003265 25904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50058 (request call id 708) took 1371 ms. Trace:
I20260709 13:12:00.001842 28620 consensus_queue.cc:1048] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:00.018746 28690 raft_consensus.cc:3055] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:00.025197 25270 leader_election.cc:304] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:00.027942 25874 leader_election.cc:304] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
W20260709 13:11:59.990509 28776 log.cc:927] Time spent T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.066s	user 0.006s	sys 0.008s
I20260709 13:11:59.920295 28809 consensus_queue.cc:1048] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.086s
I20260709 13:12:00.000665 28651 consensus_queue.cc:1048] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:12:00.040182 25872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:00.043073 25270 leader_election.cc:304] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:00.036943 25904 rpcz_store.cc:276] 0709 13:11:58.631875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:58.632013 (+   138us) service_pool.cc:224] Handling call
0709 13:11:58.632308 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:59.046575 (+414267us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:59.046630 (+    55us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:59.046691 (+    61us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:59.046737 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:00.002968 (+956231us) spinlock_profiling.cc:243] Waited 414 ms on lock 0x7b54006e1254. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:00.003035 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:00.003193 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":952127232}
I20260709 13:11:59.978080 28805 consensus_queue.cc:1048] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:11:59.990733 28508 consensus_queue.cc:1059] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:12:00.066933 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:00.067132 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:00.069825 28645 raft_consensus.cc:493] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:00.066713 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:00.088095 25301 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 5.
I20260709 13:12:00.072319 25230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1902) took 2016 ms. Trace:
I20260709 13:12:00.040940 28690 raft_consensus.cc:740] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:00.057214 28638 raft_consensus.cc:3060] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:00.081002 28686 leader_election.cc:290] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:00.082906 28500 raft_consensus.cc:2804] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:55.718245 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:00.089025 25230 rpcz_store.cc:276] 0709 13:11:58.056188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:58.056340 (+   152us) service_pool.cc:224] Handling call
0709 13:11:58.087608 (+ 31268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:59.010353 (+922745us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:00.072064 (+1061711us) spinlock_profiling.cc:243] Waited 862 ms on lock 0x7b5400435b54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:00.072259 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1982068992}
I20260709 13:12:00.107707 28690 consensus_queue.cc:260] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:00.109097 28690 raft_consensus.cc:3060] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:00.098901 28666 raft_consensus.cc:2804] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:00.114253 28666 raft_consensus.cc:697] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 8 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:00.115149 28666 consensus_queue.cc:237] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:00.093140 28645 raft_consensus.cc:3060] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:00.125277 28598 raft_consensus.cc:515] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:00.125713 25225 raft_consensus.cc:1275] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:12:00.126096 28578 raft_consensus.cc:493] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.126749 28578 raft_consensus.cc:515] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:00.127594 28598 leader_election.cc:290] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:00.128710 25378 raft_consensus.cc:2393] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 10: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:00.129177 28578 leader_election.cc:290] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:00.131117 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:00.131901 25230 raft_consensus.cc:2468] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 9.
I20260709 13:12:00.134392 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:00.135258 25227 raft_consensus.cc:2468] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 8.
I20260709 13:12:00.134469 28642 leader_election.cc:290] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:00.138696 28379 raft_consensus.cc:3060] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:00.139364 28717 raft_consensus.cc:493] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.139863 28717 raft_consensus.cc:515] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:00.140208 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:00.142125 28717 leader_election.cc:290] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:00.142652 28717 raft_consensus.cc:493] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:00.143112 28717 raft_consensus.cc:515] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:00.143561 28799 raft_consensus.cc:493] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.144060 28799 raft_consensus.cc:515] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:00.145123 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:00.145907 28716 raft_consensus.cc:493] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.146426 28716 raft_consensus.cc:515] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:00.146771 28799 leader_election.cc:290] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:00.147317 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:00.148412 28716 leader_election.cc:290] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:00.148628 25227 raft_consensus.cc:2468] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 8.
I20260709 13:12:00.145905 28717 leader_election.cc:290] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:00.058559 28801 raft_consensus.cc:697] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 11 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:00.156638 28801 consensus_queue.cc:237] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:00.139875 28578 raft_consensus.cc:493] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
W20260709 13:12:00.164496 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:00.175976 25229 raft_consensus.cc:1275] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:12:00.169183 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:00.170212 25224 raft_consensus.cc:1275] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:12:00.170876 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:00.179472 25228 raft_consensus.cc:3060] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:00.177676 25225 raft_consensus.cc:3060] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:00.183346 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:00.184317 25227 raft_consensus.cc:2393] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 8: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:00.085860 28588 raft_consensus.cc:697] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 9 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:00.187011 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:00.189329 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:00.190438 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:00.105649 28500 raft_consensus.cc:493] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:00.196107 28500 raft_consensus.cc:3060] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:00.198282 28588 consensus_queue.cc:237] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:00.198881 28556 raft_consensus.cc:3055] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:00.199268 28556 raft_consensus.cc:740] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:00.200105 28556 consensus_queue.cc:260] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:00.200991 28556 raft_consensus.cc:3060] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:00.202384 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:00.203331 25221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1886) took 2872 ms. Trace:
I20260709 13:12:00.205196 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:00.205781 25222 raft_consensus.cc:2468] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 10.
I20260709 13:12:00.166343 28716 raft_consensus.cc:493] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.207975 28716 raft_consensus.cc:515] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:12:00.202733 25299 raft_consensus.cc:2468] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 7.
I20260709 13:12:00.209843 28708 raft_consensus.cc:493] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.210080 28716 leader_election.cc:290] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:00.210335 28708 raft_consensus.cc:515] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:00.212249 28821 log.cc:927] Time spent T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.193s	user 0.003s	sys 0.000s
I20260709 13:12:00.217213 25228 raft_consensus.cc:2468] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 7.
I20260709 13:12:00.175405 28799 raft_consensus.cc:493] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.176574 28717 raft_consensus.cc:493] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.221112 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:00.203733 25221 rpcz_store.cc:276] 0709 13:11:57.331957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:57.332133 (+   176us) service_pool.cc:224] Handling call
0709 13:11:57.358765 (+ 26632us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:57.374793 (+ 16028us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:11:58.082377 (+707584us) log.cc:844] Serialized 14 byte log entry
0709 13:11:58.474693 (+392316us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:58.474740 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:58.474784 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:00.203103 (+1728319us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b5400436054. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:00.203149 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:00.203257 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52657,"prepare.queue_time_us":607356,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":94,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":5971,"spinlock_wait_cycles":36184320,"thread_start_us":1039599,"threads_started":2,"wal-append.queue_time_us":531369,"wal-append.run_cpu_time_us":3487,"wal-append.run_wall_time_us":1356496}
I20260709 13:12:00.223522 25225 raft_consensus.cc:2468] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 10.
I20260709 13:12:00.248986 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:00.269233 25305 raft_consensus.cc:2468] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 7.
I20260709 13:12:00.249997 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:12:00.262864 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 286926us
I20260709 13:12:00.270490 25345 leader_election.cc:304] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:00.271566 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 296771us
I20260709 13:12:00.224522 28611 raft_consensus.cc:493] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.276587 25371 raft_consensus.cc:1275] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:12:00.277134 25379 raft_consensus.cc:1240] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:00.276921 28611 raft_consensus.cc:515] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:00.274097 28717 raft_consensus.cc:515] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:00.280747 25379 raft_consensus.cc:1275] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:12:00.274682 25297 raft_consensus.cc:1275] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:12:00.275712 25377 raft_consensus.cc:1240] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:00.191434 28578 raft_consensus.cc:515] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:00.280634 28717 leader_election.cc:290] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:00.273427 28746 raft_consensus.cc:2764] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 13:12:00.294754 28578 leader_election.cc:290] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:00.294987 28768 consensus_queue.cc:1048] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:00.296679 28611 leader_election.cc:290] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:00.288982 28379 consensus_queue.cc:1059] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:12:00.298064 28379 raft_consensus.cc:3055] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:00.281003 28652 raft_consensus.cc:493] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:00.273792 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 273784us
I20260709 13:12:00.302544 25345 leader_election.cc:304] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:00.280755 28638 raft_consensus.cc:2749] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:00.298408 28379 raft_consensus.cc:740] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:00.308519 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:00.273149 28799 raft_consensus.cc:515] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:00.289821 28797 consensus_queue.cc:1048] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:12:00.309262 25379 raft_consensus.cc:2468] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 7.
W20260709 13:12:00.310551 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:00.322371 25296 raft_consensus.cc:1240] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:00.322597 25270 leader_election.cc:304] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:00.314661 28379 consensus_queue.cc:260] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:00.328694 28379 raft_consensus.cc:3060] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:00.320256 28549 raft_consensus.cc:2749] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:00.330106 28686 raft_consensus.cc:2804] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:00.330602 28686 raft_consensus.cc:493] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:00.330885 28549 raft_consensus.cc:493] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.331058 28686 raft_consensus.cc:3060] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:00.331449 28549 raft_consensus.cc:515] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:00.284956 28696 raft_consensus.cc:515] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:00.317871 28550 consensus_queue.cc:1048] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:12:00.334769 28550 consensus_queue.cc:1243] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer 1f539ba21487460085b837e7529a78ce log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:12:00.335264 28696 leader_election.cc:290] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:00.326830 25226 raft_consensus.cc:1275] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 13:12:00.341567 25226 pending_rounds.cc:85] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce: Aborting all ops after (but not including) 6
I20260709 13:12:00.341838 25226 pending_rounds.cc:107] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 7.7
I20260709 13:12:00.346596 25226 raft_consensus.cc:2917] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Aborting config change with OpId 7.7: Aborted: Op aborted by new leader
I20260709 13:12:00.347082 25226 raft_consensus.cc:2889] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:00.337538 28651 raft_consensus.cc:2804] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:00.350546 28651 raft_consensus.cc:493] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:00.350905 28651 raft_consensus.cc:3060] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:00.351143 25221 raft_consensus.cc:1275] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 3. (term mismatch)
I20260709 13:12:00.351482 25221 pending_rounds.cc:85] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce: Aborting all ops after (but not including) 2
I20260709 13:12:00.351689 25221 pending_rounds.cc:107] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:12:00.351902 25221 raft_consensus.cc:2889] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:00.352195 25221 pending_rounds.cc:107] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:12:00.352403 25221 raft_consensus.cc:2889] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:12:00.358014 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 330122us
I20260709 13:12:00.327190 28715 raft_consensus.cc:493] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.305200 28652 raft_consensus.cc:515] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:00.364807 25343 leader_election.cc:304] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:00.366211 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:00.369850 25228 raft_consensus.cc:3060] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:00.340128 28696 raft_consensus.cc:493] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:00.318822 28147 consensus_queue.cc:1048] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:12:00.372359 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:00.367672 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:00.380478 25227 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 9.
I20260709 13:12:00.375870 25874 leader_election.cc:400] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 election: Vote denied by peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361) with higher term. Message: Invalid argument: T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 7. Current term is 8.
I20260709 13:12:00.376288 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:00.381948 25230 raft_consensus.cc:3060] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:00.383639 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:00.383929 25872 leader_election.cc:304] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:00.380359 25221 raft_consensus.cc:2468] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 9.
I20260709 13:12:00.384770 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:00.384256 25222 raft_consensus.cc:3060] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:00.386443 25874 leader_election.cc:403] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:12:00.386672 25343 leader_election.cc:304] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:00.387964 25343 leader_election.cc:304] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:00.388839 28598 raft_consensus.cc:2749] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:00.390785 28734 consensus_queue.cc:1059] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:00.391930 28596 raft_consensus.cc:3055] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:00.392459 28596 raft_consensus.cc:740] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:00.392807 28725 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:00.393507 28725 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:00.393407 28596 consensus_queue.cc:260] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:00.395798 25343 leader_election.cc:304] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:00.397420 25872 leader_election.cc:304] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:00.401283 25224 raft_consensus.cc:1275] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:12:00.403307 25224 raft_consensus.cc:1240] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:00.404690 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:00.405488 25226 raft_consensus.cc:2468] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 8.
I20260709 13:12:00.406701 28550 consensus_queue.cc:1048] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:12:00.368642 28549 leader_election.cc:290] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:00.413969 28508 raft_consensus.cc:2749] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361) with higher term. Message: Invalid argument: T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 7. Current term is 8.
I20260709 13:12:00.415050 28508 raft_consensus.cc:3060] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:00.422539 25872 leader_election.cc:304] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:00.423090 28799 leader_election.cc:290] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:00.423372 28689 raft_consensus.cc:2749] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:00.423789 25872 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:00.424105 28689 raft_consensus.cc:3060] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:00.425550 28513 raft_consensus.cc:2804] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:00.425925 28513 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:00.426245 28513 raft_consensus.cc:3060] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:00.427791 25872 leader_election.cc:304] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:00.428542 28511 raft_consensus.cc:2804] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:00.428942 28511 raft_consensus.cc:493] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:00.428782 28500 raft_consensus.cc:515] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:00.429360 28511 raft_consensus.cc:3060] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:00.429641 28652 leader_election.cc:290] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:00.430210 28611 consensus_queue.cc:1048] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:00.430856 25905 raft_consensus.cc:1275] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:12:00.384753 28696 raft_consensus.cc:515] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:00.433317 28696 leader_election.cc:290] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:00.371820 28715 raft_consensus.cc:515] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:00.434083 28645 raft_consensus.cc:515] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:00.435698 28715 leader_election.cc:290] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:00.436098 28645 leader_election.cc:290] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:00.396283 28642 raft_consensus.cc:2804] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:00.439033 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:12:00.439131 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:00.439910 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:00.440591 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:00.440989 25901 raft_consensus.cc:3060] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:00.441593 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:00.442411 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:00.447502 25907 raft_consensus.cc:3060] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:00.447536 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 50197us
I20260709 13:12:00.448558 25874 leader_election.cc:304] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:12:00.450696 25230 raft_consensus.cc:2468] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 9.
I20260709 13:12:00.398877 25343 leader_election.cc:304] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:00.452113 25222 raft_consensus.cc:2468] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 6.
I20260709 13:12:00.441008 28642 raft_consensus.cc:493] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
W20260709 13:12:00.452013 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 53193.7us
I20260709 13:12:00.453938 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:00.455042 25221 raft_consensus.cc:3060] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:00.455713 25907 raft_consensus.cc:2468] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 9.
I20260709 13:12:00.449604 25874 leader_election.cc:304] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:12:00.456488 25379 raft_consensus.cc:1275] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:12:00.454315 28642 raft_consensus.cc:3060] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:00.457542 28549 consensus_queue.cc:1048] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:00.460917 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:00.461787 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:00.454918 28781 raft_consensus.cc:2804] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:00.463056 28805 consensus_queue.cc:1048] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:12:00.463317 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:00.463096 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:00.464974 25902 raft_consensus.cc:2410] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:12:00.441690 28265 consensus_queue.cc:1048] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:12:00.465318 28620 raft_consensus.cc:3055] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:00.465739 28620 raft_consensus.cc:740] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:00.439612 28686 raft_consensus.cc:515] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:00.465986 28725 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:00.467401 25903 raft_consensus.cc:2368] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 8. Current term is 9.
I20260709 13:12:00.463219 28781 raft_consensus.cc:493] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:00.469662 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:00.472599 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:00.473021 25908 raft_consensus.cc:2368] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 8. Current term is 9.
I20260709 13:12:00.473278 25379 raft_consensus.cc:2468] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 8.
I20260709 13:12:00.484925 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:00.485003 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:00.485735 25900 raft_consensus.cc:2393] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 8: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:00.454437 28715 raft_consensus.cc:2804] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:00.490957 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:00.492062 25903 raft_consensus.cc:2410] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:12:00.493070 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:00.501005 25901 raft_consensus.cc:1275] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 13:12:00.505270 25901 pending_rounds.cc:85] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6: Aborting all ops after (but not including) 6
I20260709 13:12:00.505599 25901 pending_rounds.cc:107] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 7.7
I20260709 13:12:00.505954 25901 raft_consensus.cc:2917] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Aborting config change with OpId 7.7: Aborted: Op aborted by new leader
I20260709 13:12:00.506417 25901 raft_consensus.cc:2889] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:00.501636 25228 raft_consensus.cc:2468] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 9.
I20260709 13:12:00.462671 28737 raft_consensus.cc:2804] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:00.500653 25270 leader_election.cc:304] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:00.453851 28611 consensus_queue.cc:1048] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:12:00.504511 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:12:00.526163 25195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:00.486092 28781 raft_consensus.cc:3060] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:00.454291 28794 consensus_queue.cc:1048] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:12:00.533820 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:00.493958 28715 raft_consensus.cc:493] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:00.533643 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:12:00.541867 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:00.470536 28645 consensus_queue.cc:1048] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:12:00.554564 28651 raft_consensus.cc:515] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:00.556730 28651 leader_election.cc:290] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:00.558275 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:00.559556 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:00.559633 25221 raft_consensus.cc:2468] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 7.
I20260709 13:12:00.560642 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:00.437701 28513 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:00.563086 28513 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:00.563541 28147 consensus_queue.cc:1059] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:00.564365 25906 raft_consensus.cc:2393] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 6: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:12:00.564673 28147 consensus_queue.cc:1059] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:00.566349 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:12:00.567855 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 96081.3us
I20260709 13:12:00.547924 25902 raft_consensus.cc:1240] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:12:00.569392 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:00.569662 25195 leader_election.cc:304] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:00.570024 25225 raft_consensus.cc:3060] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:00.569788 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:00.571195 25228 raft_consensus.cc:2376] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 8. Re-sending same reply.
I20260709 13:12:00.568740 25271 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:00.583580 25195 leader_election.cc:400] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Vote denied by peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085) with higher term. Message: Invalid argument: T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 8. Current term is 9.
I20260709 13:12:00.584767 25195 leader_election.cc:400] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 election: Vote denied by peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085) with higher term. Message: Invalid argument: T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 8. Current term is 9.
I20260709 13:12:00.585094 25195 leader_election.cc:403] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:12:00.586031 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
W20260709 13:12:00.591681 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:00.600268 25225 raft_consensus.cc:2468] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 8.
I20260709 13:12:00.528182 28737 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
W20260709 13:12:00.604825 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:00.604243 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 103649us
I20260709 13:12:00.606460 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:00.607717 25874 leader_election.cc:304] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:12:00.604539 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:00.608671 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:00.610267 28694 raft_consensus.cc:2804] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:00.610728 28694 raft_consensus.cc:493] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:00.610843 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:00.611124 28694 raft_consensus.cc:3060] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:00.611224 28500 leader_election.cc:290] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:00.612424 28508 raft_consensus.cc:2749] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:00.612571 28640 raft_consensus.cc:2749] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:00.607204 28709 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:00.614048 28709 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:00.616091 28709 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:00.567453 28715 raft_consensus.cc:3060] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:00.618348 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:00.532564 28725 consensus_queue.cc:1048] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 13:12:00.625391 25899 raft_consensus.cc:2468] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 10.
I20260709 13:12:00.622382 25271 leader_election.cc:304] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:12:00.626626 25271 leader_election.cc:304] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:12:00.629495 25374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36254 (request call id 1998) took 1079 ms. Trace:
I20260709 13:12:00.632054 25374 rpcz_store.cc:276] 0709 13:11:59.549896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:59.556702 (+  6806us) service_pool.cc:224] Handling call
0709 13:11:59.576483 (+ 19781us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:59.576631 (+   148us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:11:59.643447 (+ 66816us) log.cc:844] Serialized 14 byte log entry
0709 13:12:00.267803 (+624356us) log.cc:844] Serialized 14 byte log entry
0709 13:12:00.297704 (+ 29901us) spinlock_profiling.cc:243] Waited 2.72 ms on lock 0x7b1800378dc0. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72cb502a6 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd734b98aa1 00007fd734b8fb37 00007fd734b8f9ca 00007fd734c8726f
0709 13:12:00.629142 (+331438us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:00.629197 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:00.629239 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:00.629308 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:00.629427 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":279149,"prepare.queue_time_us":237130,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":77,"raft.queue_time_us":317240,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":2712,"spinlock_wait_cycles":9665152,"thread_start_us":772209,"threads_started":3,"wal-append.queue_time_us":546810}
I20260709 13:12:00.601017 28578 raft_consensus.cc:2749] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:00.636030 25271 leader_election.cc:304] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:12:00.604431 28717 raft_consensus.cc:2749] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085) with higher term. Message: Invalid argument: T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 8. Current term is 9.
I20260709 13:12:00.609620 28737 raft_consensus.cc:3060] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:00.679208 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:00.638659 25271 leader_election.cc:304] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:00.617328 28549 raft_consensus.cc:3055] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:00.617986 28147 raft_consensus.cc:3055] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:12:00.642726 25195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:00.505456 28620 consensus_queue.cc:260] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:00.624935 28500 raft_consensus.cc:2804] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:00.694504 25225 raft_consensus.cc:3060] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:00.634784 28797 raft_consensus.cc:2804] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:00.695443 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:00.756156 25374 raft_consensus.cc:3060] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:00.748584 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:00.695663 25221 raft_consensus.cc:2393] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 9: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:00.752655 25906 raft_consensus.cc:1240] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:00.685588 28775 raft_consensus.cc:2804] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:00.639605 28530 raft_consensus.cc:493] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.686295 28666 raft_consensus.cc:493] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.634644 28652 raft_consensus.cc:2804] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:12:00.757723 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 457598us
I20260709 13:12:00.756094 28689 raft_consensus.cc:2749] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:00.729700 28147 raft_consensus.cc:740] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:00.690165 28638 consensus_queue.cc:1048] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 13:12:00.644191 28651 consensus_queue.cc:1048] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.120s
I20260709 13:12:00.730720 28549 raft_consensus.cc:740] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
W20260709 13:12:00.779748 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 477308us
I20260709 13:12:00.688066 28265 consensus_queue.cc:1048] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
W20260709 13:12:00.754920 28588 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.035s	sys 0.030s
W20260709 13:12:00.763422 28556 consensus_meta.cc:287] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 0.562s	user 0.010s	sys 0.001s
I20260709 13:12:00.784268 25194 leader_election.cc:304] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:00.786942 25374 raft_consensus.cc:2468] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 8.
I20260709 13:12:00.764930 28500 raft_consensus.cc:697] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:00.793159 25345 leader_election.cc:304] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:00.778048 25225 raft_consensus.cc:2468] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 11.
I20260709 13:12:00.798646 25874 leader_election.cc:304] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:12:00.762373 28775 raft_consensus.cc:493] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:00.799398 28775 raft_consensus.cc:3060] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:00.799490 28689 raft_consensus.cc:2804] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:00.800141 28689 raft_consensus.cc:697] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:00.800973 28689 consensus_queue.cc:237] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:00.802623 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:00.759253 28513 raft_consensus.cc:493] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:00.790591 25905 raft_consensus.cc:1240] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:00.772521 28652 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:00.763841 28797 raft_consensus.cc:697] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 7 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:00.768641 28640 raft_consensus.cc:2804] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:00.639701 28511 raft_consensus.cc:515] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:00.787351 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:00.808753 25194 leader_election.cc:304] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:00.778929 28620 raft_consensus.cc:3060] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:00.804723 25223 raft_consensus.cc:2468] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 9.
I20260709 13:12:00.786230 28598 raft_consensus.cc:2749] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:12:00.795245 28588 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.036s	sys 0.030s
I20260709 13:12:00.791414 28550 raft_consensus.cc:2749] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:00.811365 28837 raft_consensus.cc:2804] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:00.806559 28652 raft_consensus.cc:3060] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:00.772809 28666 raft_consensus.cc:515] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:00.765945 28530 raft_consensus.cc:515] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:00.815382 25345 leader_election.cc:304] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:00.829324 25345 leader_election.cc:304] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:00.831003 25345 leader_election.cc:304] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:00.816982 25194 leader_election.cc:304] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:00.763855 28736 consensus_queue.cc:1059] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:12:00.822238 25901 raft_consensus.cc:1240] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:00.786430 28746 consensus_queue.cc:1059] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:12:00.808251 28556 raft_consensus.cc:2749] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:00.821801 28717 raft_consensus.cc:2749] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:00.808935 28640 raft_consensus.cc:493] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:00.820703 28837 raft_consensus.cc:493] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:00.810635 28513 raft_consensus.cc:515] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:00.836175 28578 raft_consensus.cc:2749] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:00.873319 25345 leader_election.cc:304] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:00.874656 28736 raft_consensus.cc:2749] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:00.875509 28736 raft_consensus.cc:3055] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:00.875964 28736 raft_consensus.cc:740] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:00.820403 28797 consensus_queue.cc:237] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:00.841490 28640 raft_consensus.cc:3060] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:00.883440 28746 raft_consensus.cc:3055] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:00.865253 28837 raft_consensus.cc:3060] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:00.886857 28746 raft_consensus.cc:740] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:00.864917 28799 consensus_queue.cc:1059] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:12:00.834141 28147 consensus_queue.cc:260] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:00.882433 28845 raft_consensus.cc:2804] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:00.825331 28549 consensus_queue.cc:260] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:00.929855 28717 raft_consensus.cc:493] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.930491 28717 raft_consensus.cc:515] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:00.931183 28640 raft_consensus.cc:515] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:00.933873 28717 leader_election.cc:290] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:00.934768 28835 log.cc:927] Time spent T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:12:00.937194 28640 leader_election.cc:290] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:00.937872 25874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:00.940290 28511 leader_election.cc:290] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:00.943571 25874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:00.940862 28147 raft_consensus.cc:3060] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:00.941354 28843 raft_consensus.cc:2749] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:00.911513 28845 raft_consensus.cc:493] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
W20260709 13:12:00.965339 28838 log.cc:927] Time spent T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:12:00.877188 28736 consensus_queue.cc:260] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:00.884183 28500 consensus_queue.cc:237] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:00.920528 28842 raft_consensus.cc:2804] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:00.960675 28549 raft_consensus.cc:3060] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:00.978682 28596 raft_consensus.cc:3060] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:12:00.982314 28836 log.cc:927] Time spent T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:12:00.949121 28694 raft_consensus.cc:515] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:00.965945 28799 raft_consensus.cc:493] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.991685 28708 leader_election.cc:290] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:00.996416 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:12:00.998248 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 359654us
W20260709 13:12:01.000290 25195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:01.003940 25904 raft_consensus.cc:2468] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 7.
I20260709 13:12:00.969352 28845 raft_consensus.cc:3060] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:00.986663 28736 raft_consensus.cc:3060] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:00.976835 28842 raft_consensus.cc:493] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:01.006567 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:01.005671 25195 leader_election.cc:304] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:12:01.004446 25271 leader_election.cc:304] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:01.013741 25271 leader_election.cc:304] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
W20260709 13:12:01.033349 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:00.941156 28642 raft_consensus.cc:515] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:01.037609 25271 leader_election.cc:304] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:12:01.038986 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:01.041426 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:01.042253 25904 raft_consensus.cc:2468] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 11.
I20260709 13:12:01.044450 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:01.046716 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:01.047211 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:01.047515 25904 raft_consensus.cc:2468] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 8.
I20260709 13:12:01.048882 25344 leader_election.cc:304] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:01.049741 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:01.053174 25377 raft_consensus.cc:1275] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:12:01.055349 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:01.046530 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:01.036480 28530 leader_election.cc:290] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:01.059017 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:01.037315 28842 raft_consensus.cc:3060] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:01.040932 28708 raft_consensus.cc:2804] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:01.066177 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:01.061827 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:01.038585 28717 raft_consensus.cc:2804] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:01.007050 28781 raft_consensus.cc:515] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:01.067363 25298 raft_consensus.cc:1240] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:01.043768 28742 raft_consensus.cc:2804] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:01.061730 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:01.068684 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:01.071976 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:01.071875 25902 raft_consensus.cc:2368] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 9. Current term is 10.
I20260709 13:12:01.072474 25304 raft_consensus.cc:2410] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 11 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:12:01.048135 28640 raft_consensus.cc:2804] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:01.076427 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:01.004419 28652 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:01.064057 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:01.067543 28717 raft_consensus.cc:493] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:01.088004 28717 raft_consensus.cc:3060] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:01.089854 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:01.071892 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:01.043852 28666 leader_election.cc:290] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:01.007290 28799 raft_consensus.cc:515] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:01.092918 28742 raft_consensus.cc:697] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 6 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:01.093936 28742 consensus_queue.cc:237] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:01.094604 28799 leader_election.cc:290] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:01.074532 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:01.055164 28809 raft_consensus.cc:2804] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:01.096535 28809 raft_consensus.cc:493] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:01.096942 28809 raft_consensus.cc:3060] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:01.080085 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:01.084478 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:01.085292 28578 raft_consensus.cc:3055] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:01.098949 28578 raft_consensus.cc:740] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:01.099150 25302 raft_consensus.cc:1275] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:12:01.099936 28578 consensus_queue.cc:260] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:01.101235 28578 raft_consensus.cc:3060] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:01.101547 25900 raft_consensus.cc:2468] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 9.
I20260709 13:12:01.061365 28513 leader_election.cc:290] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:01.102305 28686 leader_election.cc:290] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:01.103965 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:01.106824 25344 leader_election.cc:304] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:01.109030 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:01.110214 25300 raft_consensus.cc:2393] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 9: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:01.111182 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:01.111739 25300 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 6.
I20260709 13:12:01.112635 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:01.113762 28640 raft_consensus.cc:697] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 7 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:01.114780 28640 consensus_queue.cc:237] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:01.115504 25906 raft_consensus.cc:1275] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:12:01.116727 28642 leader_election.cc:290] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:01.117309 28642 raft_consensus.cc:2804] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:01.117689 28642 raft_consensus.cc:493] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:01.113724 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:01.118256 28642 raft_consensus.cc:3060] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:01.119027 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:01.119323 28652 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:01.120105 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:01.120289 25297 raft_consensus.cc:2393] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 11: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:01.120996 25300 raft_consensus.cc:2410] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:12:01.121729 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:12:01.122143 25299 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46556 (request call id 441) took 4827 ms (client timeout 2083 ms). Trace:
W20260709 13:12:01.122530 25299 rpcz_store.cc:269] 0709 13:11:56.294907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:56.295039 (+   132us) service_pool.cc:224] Handling call
0709 13:12:01.121971 (+4826932us) spinlock_profiling.cc:243] Waited 3.85 s on lock 0x7b54000a6254. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:01.122062 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8861242112}
I20260709 13:12:01.123179 25376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36254 (request call id 2003) took 1555 ms. Trace:
I20260709 13:12:01.123373 28846 raft_consensus.cc:493] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:01.123961 28846 raft_consensus.cc:515] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:01.125804 28598 raft_consensus.cc:493] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:01.126296 28598 raft_consensus.cc:515] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:01.128271 28598 leader_election.cc:290] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:01.130259 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:01.130882 25223 raft_consensus.cc:2468] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 9.
I20260709 13:12:01.122691 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:01.131326 28781 leader_election.cc:290] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:01.131685 25300 raft_consensus.cc:2468] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 8.
W20260709 13:12:01.120311 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:01.132938 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:01.105152 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:00.974443 28746 consensus_queue.cc:260] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:01.123536 25376 rpcz_store.cc:276] 0709 13:11:59.567876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:59.568010 (+   134us) service_pool.cc:224] Handling call
0709 13:11:59.568306 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:59.722039 (+153733us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:11:59.995321 (+273282us) log.cc:844] Serialized 14 byte log entry
0709 13:12:00.336711 (+341390us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:00.336780 (+    69us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:00.336848 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:01.122983 (+786135us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b54000ba254. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:01.123024 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:01.123129 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17188,"prepare.queue_time_us":89011,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":26,"raft.queue_time_us":18838,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":13622,"spinlock_wait_cycles":353046272,"thread_start_us":596686,"threads_started":2,"wal-append.queue_time_us":564378}
I20260709 13:12:01.142035 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:01.146050 25227 raft_consensus.cc:1240] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:01.157394 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:01.158288 25223 raft_consensus.cc:2468] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 7.
I20260709 13:12:01.159474 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:01.160157 25223 raft_consensus.cc:3060] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:01.162125 25343 leader_election.cc:304] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:01.163407 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:01.164312 25301 raft_consensus.cc:1240] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:12:01.166025 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:01.166911 25222 raft_consensus.cc:2410] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:12:01.170781 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:01.171530 25222 raft_consensus.cc:2393] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 11: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:01.172569 25222 raft_consensus.cc:1275] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:12:01.056057 28775 raft_consensus.cc:515] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:12:01.080591 28708 raft_consensus.cc:697] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 9 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:01.183014 25903 raft_consensus.cc:1240] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 9. Current term is 10. Ops: []
W20260709 13:12:01.184923 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:01.189003 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 315742us
I20260709 13:12:01.191521 25344 leader_election.cc:400] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 election: Vote denied by peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085) with higher term. Message: Invalid argument: T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 9. Current term is 10.
I20260709 13:12:01.205523 25344 leader_election.cc:403] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:12:01.176119 28598 raft_consensus.cc:2749] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:01.197383 25305 raft_consensus.cc:2393] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 10: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:01.200903 25373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36264 (request call id 1697) took 1589 ms. Trace:
I20260709 13:12:01.207269 28844 consensus_queue.cc:1048] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:12:01.196699 28715 consensus_meta.cc:287] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.561s	user 0.007s	sys 0.004s
I20260709 13:12:01.210043 28686 consensus_queue.cc:1048] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:01.218210 25373 rpcz_store.cc:276] 0709 13:11:59.611413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:59.611666 (+   253us) service_pool.cc:224] Handling call
0709 13:11:59.643198 (+ 31532us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:59.647789 (+  4591us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:59.647820 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:59.648310 (+   490us) log.cc:844] Serialized 52 byte log entry
0709 13:11:59.979935 (+331625us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:59.984705 (+  4770us) log.cc:844] Serialized 14 byte log entry
0709 13:12:00.300868 (+316163us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:00.300971 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:01.059306 (+758335us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b2400382868. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72ca089c4 00007fd72ca06acb 00007fd72cbc1dc9 00007fd72cbc1a55 00007fd72cbc0fb0 00007fd72f837488 00007fd72f837be8 00007fd72f80f398 00007fd72f80a76a 00007fd72f809bb6
0709 13:12:01.195695 (+136389us) raft_consensus.cc:1685] finished
0709 13:12:01.200555 (+  4860us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:01.200754 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":332569,"prepare.queue_time_us":8958,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"raft.queue_time_us":327333,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":25959,"spinlock_wait_cycles":25939840,"thread_start_us":324557,"threads_started":1,"wal-append.queue_time_us":443492}
I20260709 13:12:01.210381 25372 raft_consensus.cc:1275] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:12:01.195304 28746 raft_consensus.cc:3060] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:01.193697 28737 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:01.192494 28734 consensus_queue.cc:1048] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
W20260709 13:12:01.232496 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:01.255609 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:01.257071 25304 raft_consensus.cc:1240] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:01.258665 25343 leader_election.cc:304] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:01.262645 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:01.263240 25304 raft_consensus.cc:3060] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:01.260754 25343 leader_election.cc:304] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:01.265960 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:01.220890 28694 leader_election.cc:290] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:01.275315 25907 raft_consensus.cc:2393] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 9: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:12:01.264779 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:01.275977 25304 raft_consensus.cc:2468] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 8.
W20260709 13:12:01.277227 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 426455us
I20260709 13:12:01.279655 25194 leader_election.cc:400] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 election: Vote denied by peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127) with higher term. Message: Invalid argument: T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 8. Current term is 9.
I20260709 13:12:01.282501 25194 leader_election.cc:304] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:01.285669 25297 raft_consensus.cc:2410] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:12:01.244763 28717 raft_consensus.cc:515] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:01.264616 25271 leader_election.cc:304] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:12:01.268407 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:01.269411 28596 raft_consensus.cc:2749] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:01.247011 28588 raft_consensus.cc:493] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:01.272369 28842 raft_consensus.cc:515] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:01.273881 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:01.222505 28843 raft_consensus.cc:3060] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:01.295243 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:01.295739 25271 leader_election.cc:304] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:01.305459 28530 raft_consensus.cc:493] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:01.308763 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:01.310900 25373 raft_consensus.cc:2410] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:12:01.324270 25271 leader_election.cc:304] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:01.359159 25227 raft_consensus.cc:1240] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:12:01.353564 25195 leader_election.cc:304] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:01.226140 28715 raft_consensus.cc:515] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:01.262933 28846 leader_election.cc:290] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:01.360651 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:01.273422 28598 raft_consensus.cc:2804] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:01.330986 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:01.366964 25195 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:01.308929 25125 catalog_manager.cc:5697] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 4 to 5, leader changed from 79d99c0e498349bda74127365219e468 (127.23.140.67) to 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68). New cstate: current_term: 5 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:01.378093 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:01.324146 28801 raft_consensus.cc:2804] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:01.381620 25195 leader_election.cc:304] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:01.284070 28549 consensus_queue.cc:1059] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.087s
W20260709 13:12:01.368007 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 43840.3us
I20260709 13:12:01.284929 28837 raft_consensus.cc:515] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:01.388065 25908 raft_consensus.cc:1240] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:01.360111 28596 raft_consensus.cc:493] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:01.391449 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:01.331172 28694 raft_consensus.cc:2804] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:01.369887 28799 raft_consensus.cc:2749] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:01.260155 28708 consensus_queue.cc:237] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:01.383147 25223 raft_consensus.cc:2468] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 10.
I20260709 13:12:01.377946 28853 raft_consensus.cc:2749] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:01.327301 28588 raft_consensus.cc:515] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:01.383675 28578 raft_consensus.cc:2749] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:01.407828 28578 raft_consensus.cc:2749] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:01.407889 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:01.408566 28578 raft_consensus.cc:2749] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:01.409034 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:01.327895 28530 raft_consensus.cc:515] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:01.402266 25370 raft_consensus.cc:1240] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:01.411199 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:01.410442 28689 consensus_queue.cc:1048] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:12:01.412214 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:01.416716 28530 leader_election.cc:290] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:01.417577 25372 raft_consensus.cc:1240] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:01.419000 25372 raft_consensus.cc:1240] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:01.421499 28651 consensus_queue.cc:1048] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:12:01.422731 28858 log.cc:927] Time spent T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.093s	user 0.002s	sys 0.000s
I20260709 13:12:01.437323 25375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36254 (request call id 2033) took 1129 ms. Trace:
I20260709 13:12:01.437693 25375 rpcz_store.cc:276] 0709 13:12:00.308359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:00.309443 (+  1084us) service_pool.cc:224] Handling call
0709 13:12:00.309813 (+   370us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:00.808948 (+499135us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:00.808980 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:00.835094 (+ 26114us) log.cc:844] Serialized 52 byte log entry
0709 13:12:01.073195 (+238101us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:01.073233 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:01.073308 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:01.422003 (+348695us) spinlock_profiling.cc:243] Waited 28.2 ms on lock 0x7b4400022b4c. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72caa8c85 00007fd72caa96a2 00007fd72f81b1db 00007fd72f816aaf 00007fd72f80a86e 00007fd72f809bb6 00007fd72f8097d8 00007fd72f813221 00007fd72f8131d9 00007fd72f813169
0709 13:12:01.437061 (+ 15058us) raft_consensus.cc:1685] finished
0709 13:12:01.437081 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:01.437268 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14688,"raft.queue_time_us":20522,"raft.run_cpu_time_us":51,"raft.run_wall_time_us":50,"spinlock_wait_cycles":64852352,"thread_start_us":682195,"threads_started":2,"wal-append.queue_time_us":337972}
I20260709 13:12:01.440626 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:01.430456 25343 leader_election.cc:304] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:01.443853 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:01.444718 25301 raft_consensus.cc:2368] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 8. Current term is 9.
I20260709 13:12:01.444828 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:01.444068 28736 raft_consensus.cc:2804] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:01.445703 28736 raft_consensus.cc:697] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 8 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:01.446187 28686 consensus_queue.cc:1059] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:01.446710 28736 consensus_queue.cc:237] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:01.447480 28686 raft_consensus.cc:3055] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:01.447939 28686 raft_consensus.cc:740] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:01.448838 28686 consensus_queue.cc:260] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:01.449981 28686 raft_consensus.cc:3060] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:01.434003 28549 consensus_queue.cc:1059] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:01.451521 28549 raft_consensus.cc:3055] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:01.451869 28549 raft_consensus.cc:740] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:01.452833 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:01.452637 28549 consensus_queue.cc:260] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:12:01.454659 28643 consensus_queue.cc:1059] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:01.455559 28643 raft_consensus.cc:3055] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:01.455909 28643 raft_consensus.cc:740] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:01.456461 25194 leader_election.cc:400] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Vote denied by peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127) with higher term. Message: Invalid argument: T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 8. Current term is 9.
I20260709 13:12:01.456885 25194 leader_election.cc:403] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:01.457530 28556 raft_consensus.cc:3060] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:12:01.464100 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:01.465031 25298 raft_consensus.cc:2468] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 9.
I20260709 13:12:01.466894 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:01.467872 25227 raft_consensus.cc:3060] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:01.472385 28643 consensus_queue.cc:260] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:01.473951 28643 raft_consensus.cc:3060] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:01.474411 25194 leader_election.cc:304] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:01.475533 28530 raft_consensus.cc:2804] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:01.476019 28530 raft_consensus.cc:493] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:01.476431 28530 raft_consensus.cc:3060] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:01.477934 28549 raft_consensus.cc:3060] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:01.486413 25127 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40020 (request call id 264) took 19028 ms (client timeout 15000 ms). Trace:
I20260709 13:12:01.489956 28556 raft_consensus.cc:2749] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127) with higher term. Message: Invalid argument: T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 8. Current term is 9.
I20260709 13:12:01.492002 28530 raft_consensus.cc:515] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:01.515821 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:01.518708 28530 leader_election.cc:290] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:01.494599 25125 catalog_manager.cc:5697] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 4 to 6, leader changed from 79d99c0e498349bda74127365219e468 (127.23.140.67) to 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68). New cstate: current_term: 6 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:01.521011 25125 catalog_manager.cc:5697] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 6 to 7, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 7 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:12:01.523504 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:01.524255 25298 raft_consensus.cc:3060] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:01.532701 25298 raft_consensus.cc:2468] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 10.
I20260709 13:12:01.512136 25227 raft_consensus.cc:2468] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 11.
I20260709 13:12:01.408964 28588 leader_election.cc:290] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:01.383217 28598 raft_consensus.cc:493] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:01.536067 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:01.392560 28801 raft_consensus.cc:697] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 9 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:01.400337 28694 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:01.404721 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:01.544229 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
W20260709 13:12:01.547664 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:01.512638 25127 rpcz_store.cc:269] 0709 13:11:42.458329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:42.458576 (+   247us) service_pool.cc:224] Handling call
0709 13:12:01.486311 (+19027735us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:54.182087 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:54.182762 (+   675us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:54.182815 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:11:54.182836 (+    21us) tablet.cc:662] Decoding operations
0709 13:11:54.289102 (+106266us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:54.289180 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:54.289208 (+    28us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:11:54.290488 (+  1280us) tablet.cc:701] Row locks acquired
0709 13:11:54.290540 (+    52us) write_op.cc:260] PREPARE: finished
0709 13:11:54.290695 (+   155us) write_op.cc:270] Start()
0709 13:11:54.290861 (+   166us) write_op.cc:276] Timestamp: P: 1783602714290640 usec, L: 0
0709 13:11:54.290901 (+    40us) op_driver.cc:348] REPLICATION: starting
0709 13:11:54.344716 (+ 53815us) log.cc:844] Serialized 6827 byte log entry
0709 13:11:54.915924 (+571208us) op_driver.cc:464] REPLICATION: finished
0709 13:11:55.231219 (+315295us) write_op.cc:301] APPLY: starting
0709 13:11:55.272052 (+ 40833us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:55.354394 (+ 82342us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:55.354549 (+   155us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:55.356875 (+  2326us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:55.357349 (+   474us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=17
0709 13:11:55.357410 (+    61us) write_op.cc:312] APPLY: finished
0709 13:11:55.434221 (+ 76811us) log.cc:844] Serialized 119 byte log entry
0709 13:11:55.452237 (+ 18016us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:55.482294 (+ 30057us) write_op.cc:454] Released schema lock
0709 13:11:55.499563 (+ 17269us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:55.554466 (+ 54903us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:55.564786 (+ 10320us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":57396,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":214591,"apply.run_cpu_time_us":7598,"apply.run_wall_time_us":309262,"num_ops":17,"prepare.queue_time_us":81996,"prepare.run_cpu_time_us":11847,"prepare.run_wall_time_us":224132,"raft.queue_time_us":163328,"raft.run_cpu_time_us":23272,"raft.run_wall_time_us":236089,"replication_time_us":606974,"thread_start_us":310552,"threads_started":4,"wal-append.queue_time_us":133174,"wal-append.run_cpu_time_us":90330,"wal-append.run_wall_time_us":2053577}]]}
I20260709 13:12:01.388857 28379 consensus_queue.cc:1059] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.146s
I20260709 13:12:01.384507 28642 raft_consensus.cc:515] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:01.559763 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:01.617064 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:01.556872 25874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:01.396202 28596 raft_consensus.cc:515] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:01.594331 25223 raft_consensus.cc:2468] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 10.
I20260709 13:12:01.620903 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:01.597782 28598 raft_consensus.cc:3060] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:01.594941 25271 leader_election.cc:304] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:01.545257 28775 leader_election.cc:290] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361)
I20260709 13:12:01.603245 25379 raft_consensus.cc:2410] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
W20260709 13:12:01.605883 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:01.617735 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:01.661893 25227 raft_consensus.cc:2410] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:12:01.654631 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:01.663700 25374 raft_consensus.cc:1240] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 8. Current term is 10. Ops: []
W20260709 13:12:01.665660 25270 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.041s	sys 0.064s
I20260709 13:12:01.614846 28694 raft_consensus.cc:3060] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:01.666056 25270 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.041s	sys 0.064s
W20260709 13:12:01.673072 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 619493us
I20260709 13:12:01.675766 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
W20260709 13:12:01.678453 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 83635.6us
I20260709 13:12:01.523037 25125 catalog_manager.cc:5697] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:01.681036 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:01.688830 25298 raft_consensus.cc:2410] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:12:01.680939 25271 leader_election.cc:304] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:01.693727 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:01.695137 25223 raft_consensus.cc:2468] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 9.
I20260709 13:12:01.696193 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:01.700093 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:01.700766 25230 raft_consensus.cc:2468] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 10.
I20260709 13:12:01.703824 25301 raft_consensus.cc:1275] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:12:01.704738 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
W20260709 13:12:01.706710 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:01.625916 28737 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 9 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:01.707935 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:01.698386 25125 catalog_manager.cc:5697] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 5 to 6, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 6 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } }
I20260709 13:12:01.709142 25125 catalog_manager.cc:5697] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:12:01.692862 28868 log.cc:927] Time spent T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:12:01.559316 28844 consensus_queue.cc:1059] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.138s
I20260709 13:12:01.717123 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:01.716295 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:01.724836 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:01.725579 25227 raft_consensus.cc:2468] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 9.
I20260709 13:12:01.727131 25304 raft_consensus.cc:1240] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:01.731274 25223 raft_consensus.cc:2410] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:12:01.731844 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:01.696911 28379 raft_consensus.cc:2804] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:01.732637 25298 raft_consensus.cc:3060] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:01.732982 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:01.734273 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:01.735154 25296 raft_consensus.cc:1240] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:12:01.734148 25271 leader_election.cc:304] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:01.739056 25297 raft_consensus.cc:3060] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:01.714207 28849 log.cc:927] Time spent T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
W20260709 13:12:01.710335 28850 log.cc:927] Time spent T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
W20260709 13:12:01.725937 28839 log.cc:927] Time spent T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.667s	user 0.000s	sys 0.004s
I20260709 13:12:01.749202 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:01.755324 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:01.742764 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:01.745709 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:01.757004 25227 raft_consensus.cc:3060] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:01.757205 25230 raft_consensus.cc:2393] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 10: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:01.762450 25297 raft_consensus.cc:2468] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 8.
W20260709 13:12:01.763437 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 381903us
W20260709 13:12:01.764750 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 314684us
I20260709 13:12:01.765638 25874 leader_election.cc:304] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
W20260709 13:12:01.768106 25195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:01.734639 28717 leader_election.cc:290] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:01.773404 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:01.737782 28842 leader_election.cc:290] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:01.739022 28801 consensus_queue.cc:237] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:01.961766 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:01.788618 25874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:01.878161 28379 raft_consensus.cc:697] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 11 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
W20260709 13:12:01.815958 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:01.879087 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 84331.7us
I20260709 13:12:01.803098 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:02.144011 25223 raft_consensus.cc:2410] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 13:12:02.145112 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:01.862548 25345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:01.799695 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:12:01.774880 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:02.021077 28873 log.cc:927] Time spent T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.298s	user 0.000s	sys 0.001s
W20260709 13:12:01.950379 28147 consensus_meta.cc:287] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.995s	user 0.001s	sys 0.016s
I20260709 13:12:01.812827 28511 consensus_queue.cc:1048] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.322s
W20260709 13:12:01.864753 28870 log.cc:927] Time spent T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
W20260709 13:12:01.869213 28874 log.cc:927] Time spent T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
W20260709 13:12:02.048856 28859 log.cc:927] Time spent T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.249s	user 0.000s	sys 0.001s
W20260709 13:12:02.231889 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:01.934784 28865 log.cc:927] Time spent T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
W20260709 13:12:01.859380 28871 log.cc:927] Time spent T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:12:01.750644 28645 raft_consensus.cc:2804] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:02.128712 25908 raft_consensus.cc:3060] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:01.890125 28857 raft_consensus.cc:3055] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:01.864493 25296 raft_consensus.cc:1240] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:12:01.769685 28715 leader_election.cc:290] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:01.797284 25298 raft_consensus.cc:2468] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 8.
W20260709 13:12:02.134203 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:01.773547 28809 consensus_meta.cc:287] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.676s	user 0.001s	sys 0.010s
I20260709 13:12:02.136402 25194 leader_election.cc:304] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:01.812609 25873 leader_election.cc:304] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:02.275151 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 462648us
I20260709 13:12:02.276834 25873 leader_election.cc:304] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:01.868571 25230 raft_consensus.cc:1275] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:12:01.888767 28845 consensus_meta.cc:287] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.850s	user 0.010s	sys 0.000s
I20260709 13:12:01.865717 25224 raft_consensus.cc:1275] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:12:02.280817 25224 pending_rounds.cc:85] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce: Aborting all ops after (but not including) 6
I20260709 13:12:02.281132 25224 pending_rounds.cc:107] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:12:02.281412 25224 raft_consensus.cc:2889] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:02.281613 25908 raft_consensus.cc:2468] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 8.
I20260709 13:12:02.282258 25224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1959) took 1065 ms. Trace:
I20260709 13:12:01.941080 28686 raft_consensus.cc:493] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:01.788822 28737 raft_consensus.cc:2804] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:01.889478 28794 raft_consensus.cc:3055] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:01.770406 25227 raft_consensus.cc:2468] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 10.
I20260709 13:12:01.796550 28837 leader_election.cc:290] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:01.889478 28642 leader_election.cc:290] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:02.141952 25874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:02.326967 25227 raft_consensus.cc:1240] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:02.032998 25125 catalog_manager.cc:5697] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 6 to 8, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68). New cstate: current_term: 8 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:12:02.328521 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 199811us
I20260709 13:12:02.329082 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:02.148939 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:02.149910 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:02.330255 25370 raft_consensus.cc:3060] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:02.330767 25379 raft_consensus.cc:2410] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:12:02.332033 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:02.153007 25375 raft_consensus.cc:1240] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:12:02.333829 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:02.143380 25270 leader_election.cc:304] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
W20260709 13:12:01.865185 28860 log.cc:927] Time spent T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.486s	user 0.000s	sys 0.001s
I20260709 13:12:02.182318 25299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57256 (request call id 1905) took 1072 ms. Trace:
I20260709 13:12:02.186278 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:02.337668 25379 raft_consensus.cc:2410] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:12:02.337980 25378 raft_consensus.cc:2393] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 10: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:02.131137 28690 raft_consensus.cc:493] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:02.202234 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:02.340073 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:02.340498 25374 raft_consensus.cc:2468] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 6.
I20260709 13:12:02.340657 25907 raft_consensus.cc:3060] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:02.143018 28846 raft_consensus.cc:3055] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:02.206527 25223 raft_consensus.cc:1275] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:12:02.313943 28742 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.886s	user 0.015s	sys 0.020s
I20260709 13:12:02.347393 25223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1965) took 1039 ms. Trace:
W20260709 13:12:02.177650 28746 consensus_meta.cc:287] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.950s	user 0.010s	sys 0.007s
W20260709 13:12:02.249346 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:02.249812 28147 raft_consensus.cc:493] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:02.166481 28853 raft_consensus.cc:493] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:02.266696 28645 raft_consensus.cc:697] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 9 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
W20260709 13:12:02.258821 28854 log.cc:927] Time spent T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.713s	user 0.003s	sys 0.001s
I20260709 13:12:02.282696 25224 rpcz_store.cc:276] 0709 13:12:01.216749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:01.865039 (+648290us) service_pool.cc:224] Handling call
0709 13:12:01.865345 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:02.281963 (+416618us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:02.282192 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:02.381568 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:02.382186 25224 raft_consensus.cc:3060] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:02.315528 25230 raft_consensus.cc:1240] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:02.263352 28857 raft_consensus.cc:740] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:02.263721 28550 raft_consensus.cc:493] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:02.335438 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 192158us
I20260709 13:12:02.337096 25299 rpcz_store.cc:276] 0709 13:12:01.109883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:01.123444 (+ 13561us) service_pool.cc:224] Handling call
0709 13:12:01.123744 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:01.124087 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:12:01.394646 (+270559us) log.cc:844] Serialized 14 byte log entry
0709 13:12:01.729543 (+334897us) log.cc:844] Serialized 14 byte log entry
0709 13:12:01.741427 (+ 11884us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:01.745356 (+  3929us) log.cc:844] Serialized 26 byte log entry
0709 13:12:01.745489 (+   133us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:01.745519 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:01.745581 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:01.875444 (+129863us) spinlock_profiling.cc:243] Waited 2.54 ms on lock 0x7b1800468b20. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72cafcc0a 00007fd73623c219 00007fd733b4358f 00007fd72cb82571 00007fd72cb847c1 00007fd72cb84779 00007fd72cb84709 00007fd72cb846d1 00007fd72cb839cd
0709 13:12:01.884166 (+  8722us) spinlock_profiling.cc:243] Waited 4.2 ms on lock 0x7b1800468b20. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72cb823f3 00007fd72cb847c1 00007fd72cb84779 00007fd72cb84709 00007fd72cb846d1 00007fd72cb839cd 000000000038f354 000000000038f199 00007fd72cb6583a
0709 13:12:02.182075 (+297909us) raft_consensus.cc:1685] finished
0709 13:12:02.182103 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:02.182254 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2488,"prepare.queue_time_us":799588,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":67,"raft.queue_time_us":14968,"raft.run_cpu_time_us":299,"raft.run_wall_time_us":9471,"spinlock_wait_cycles":15509504,"thread_start_us":604157,"threads_started":2,"wal-append.queue_time_us":785337}
I20260709 13:12:02.382493 25370 raft_consensus.cc:2468] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 9.
I20260709 13:12:02.348722 25221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1952) took 1191 ms. Trace:
I20260709 13:12:02.314532 28781 raft_consensus.cc:2749] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:02.313050 28734 raft_consensus.cc:493] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:02.386744 28734 raft_consensus.cc:515] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:02.356877 28742 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.929s	user 0.015s	sys 0.021s
I20260709 13:12:02.387252 28645 consensus_queue.cc:237] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:02.355255 28690 raft_consensus.cc:515] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:02.311756 28832 raft_consensus.cc:2749] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 LEARNER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:02.372241 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:02.355826 28846 raft_consensus.cc:740] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:02.336890 28652 raft_consensus.cc:2749] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:02.326719 28875 raft_consensus.cc:2804] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:02.391136 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:02.384123 28550 raft_consensus.cc:515] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:02.391656 28875 raft_consensus.cc:697] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 10 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:02.391764 25372 raft_consensus.cc:2468] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 6.
I20260709 13:12:02.392629 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:02.392539 28875 consensus_queue.cc:237] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:02.393432 25372 raft_consensus.cc:2410] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:12:02.373298 25227 raft_consensus.cc:1240] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:02.394380 25375 raft_consensus.cc:2410] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 9 because replica has last-logged OpId of term: 8 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260709 13:12:02.394490 28872 log.cc:927] Time spent T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.238s	user 0.000s	sys 0.000s
I20260709 13:12:02.395182 25227 raft_consensus.cc:1275] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:12:02.395568 25227 pending_rounds.cc:85] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce: Aborting all ops after (but not including) 4
I20260709 13:12:02.383844 28857 consensus_queue.cc:260] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:02.395803 25227 pending_rounds.cc:107] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:12:02.395738 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:02.396204 25227 raft_consensus.cc:2889] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:02.396416 28857 raft_consensus.cc:3060] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:02.396908 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:02.397444 25374 raft_consensus.cc:3060] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:02.397994 25225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1945) took 1253 ms. Trace:
I20260709 13:12:02.393666 28550 leader_election.cc:290] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:02.389498 28734 leader_election.cc:290] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:02.398414 25225 rpcz_store.cc:276] 0709 13:12:01.144944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:01.156061 (+ 11117us) service_pool.cc:224] Handling call
0709 13:12:01.156443 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:01.160795 (+  4352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:01.160826 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:01.187891 (+ 27065us) log.cc:844] Serialized 26 byte log entry
0709 13:12:01.596338 (+408447us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:01.596376 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:01.596442 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:02.397817 (+801375us) raft_consensus.cc:1685] finished
0709 13:12:02.397834 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:02.397945 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3947,"raft.queue_time_us":9368,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":10227,"thread_start_us":394079,"threads_started":1,"wal-append.queue_time_us":556351}
I20260709 13:12:02.385592 25221 rpcz_store.cc:276] 0709 13:12:01.156983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:01.188060 (+ 31077us) service_pool.cc:224] Handling call
0709 13:12:01.188367 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:01.191060 (+  2693us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:01.191091 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:01.191513 (+   422us) log.cc:844] Serialized 26 byte log entry
0709 13:12:01.410361 (+218848us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:01.410417 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:01.410515 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:02.348429 (+937914us) raft_consensus.cc:1685] finished
0709 13:12:02.348459 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:02.348607 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2261,"raft.queue_time_us":2561,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":4892,"thread_start_us":204376,"threads_started":1,"wal-append.queue_time_us":396723}
I20260709 13:12:02.368458 25343 leader_election.cc:304] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:02.371930 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:02.402334 25373 raft_consensus.cc:2410] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:12:02.403184 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:02.312870 28549 raft_consensus.cc:493] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:02.403972 28549 raft_consensus.cc:515] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:02.314005 28794 raft_consensus.cc:740] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:02.337514 28737 raft_consensus.cc:697] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:02.418068 25374 raft_consensus.cc:2468] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 10.
I20260709 13:12:02.419077 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:02.419659 25370 raft_consensus.cc:2468] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 10.
I20260709 13:12:02.420423 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:02.421181 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:02.421782 25370 raft_consensus.cc:2410] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:12:02.422857 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:02.423746 25372 raft_consensus.cc:2376] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 10. Re-sending same reply.
I20260709 13:12:02.425792 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:02.314878 28686 raft_consensus.cc:515] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:02.303089 25300 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.766s	user 0.013s	sys 0.020s
W20260709 13:12:02.429517 25300 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.892s	user 0.013s	sys 0.021s
I20260709 13:12:02.390056 28690 leader_election.cc:290] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:02.381067 25371 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 6.
I20260709 13:12:02.407612 25907 raft_consensus.cc:2468] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 10.
W20260709 13:12:02.407823 25345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:02.406220 28549 leader_election.cc:290] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:02.438349 25370 raft_consensus.cc:1240] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:12:02.295001 28809 raft_consensus.cc:515] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:02.412122 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 43740.8us
W20260709 13:12:02.387323 28843 consensus_meta.cc:287] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 1.026s	user 0.009s	sys 0.001s
I20260709 13:12:02.428169 25372 raft_consensus.cc:2410] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:12:02.312420 28845 raft_consensus.cc:515] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:02.409741 28837 raft_consensus.cc:493] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:02.410355 28147 raft_consensus.cc:515] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:02.435796 28640 raft_consensus.cc:2804] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:02.449970 25376 raft_consensus.cc:1240] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 7. Current term is 9. Ops: []
I20260709 13:12:02.451650 25372 raft_consensus.cc:1275] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:12:02.452072 25372 pending_rounds.cc:85] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468: Aborting all ops after (but not including) 8
I20260709 13:12:02.435626 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:02.345322 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:02.380091 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:02.341950 28500 consensus_queue.cc:1059] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.091s
I20260709 13:12:02.425977 28746 raft_consensus.cc:2804] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:02.381464 28642 consensus_queue.cc:1059] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:12:02.453492 25379 raft_consensus.cc:2468] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 7.
W20260709 13:12:02.454433 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 141944us
I20260709 13:12:02.452324 25372 pending_rounds.cc:107] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:12:02.456446 25372 raft_consensus.cc:2889] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:02.456523 25873 leader_election.cc:304] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:02.458439 25373 raft_consensus.cc:2393] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 10: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:02.454795 25378 raft_consensus.cc:2468] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 7.
I20260709 13:12:02.461481 28832 raft_consensus.cc:2749] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:02.408824 28379 consensus_queue.cc:237] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:02.410514 28853 raft_consensus.cc:515] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:02.447650 28843 raft_consensus.cc:2749] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085) with higher term. Message: Invalid argument: T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 9. Current term is 10.
I20260709 13:12:02.471021 28809 leader_election.cc:290] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:02.448426 28794 consensus_queue.cc:260] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:02.463338 28737 consensus_queue.cc:237] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:02.472764 28794 raft_consensus.cc:3060] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:02.462782 28746 raft_consensus.cc:697] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 8 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:02.449471 28837 raft_consensus.cc:515] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:02.472764 28845 leader_election.cc:290] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:02.350541 25195 leader_election.cc:304] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
W20260709 13:12:02.294023 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 157712us
W20260709 13:12:02.520538 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 169863us
I20260709 13:12:02.522209 25195 leader_election.cc:304] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:02.522825 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:02.527168 25195 leader_election.cc:304] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:02.524137 25125 catalog_manager.cc:5697] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 3 to 5, leader changed from 79d99c0e498349bda74127365219e468 (127.23.140.67) to 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68). New cstate: current_term: 5 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:12:02.371488 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:02.347772 25223 rpcz_store.cc:276] 0709 13:12:01.308578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:02.165522 (+856944us) service_pool.cc:224] Handling call
0709 13:12:02.206131 (+ 40609us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:02.347122 (+140991us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:02.347341 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:02.533066 25226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1953) took 1342 ms. Trace:
I20260709 13:12:02.533547 25226 rpcz_store.cc:276] 0709 13:12:01.190181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:01.775375 (+585194us) service_pool.cc:224] Handling call
0709 13:12:01.775653 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:01.776007 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:01.776035 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:01.776434 (+   399us) log.cc:844] Serialized 26 byte log entry
0709 13:12:02.295745 (+519311us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:02.295786 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:02.295853 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:02.532387 (+236534us) raft_consensus.cc:1685] finished
0709 13:12:02.532483 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:02.532863 (+   380us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12133,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":13073,"thread_start_us":492866,"threads_started":1,"wal-append.queue_time_us":665766}
I20260709 13:12:02.536599 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:02.542757 25228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54000 (request call id 553) took 1786 ms. Trace:
I20260709 13:12:02.543399 25228 rpcz_store.cc:276] 0709 13:12:00.755850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:00.755995 (+   145us) service_pool.cc:224] Handling call
0709 13:12:00.756302 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:00.756635 (+   333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:00.756661 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:00.761435 (+  4774us) log.cc:844] Serialized 26 byte log entry
0709 13:12:01.207134 (+445699us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:01.207175 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:01.207393 (+   218us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:01.891882 (+684489us) spinlock_profiling.cc:243] Waited 28.4 ms on lock 0x7b4400022b4c. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72caa8c85 00007fd72caa96a2 00007fd72f81b1db 00007fd72f816aaf 00007fd72f80a86e 00007fd72f809bb6 00007fd72f8097d8 00007fd72f813221 00007fd72f8131d9 00007fd72f813169
0709 13:12:02.542016 (+650134us) raft_consensus.cc:1685] finished
0709 13:12:02.542061 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:02.542485 (+   424us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":76,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":5512,"spinlock_wait_cycles":65262848,"thread_start_us":418455,"threads_started":1,"wal-append.queue_time_us":616008}
I20260709 13:12:02.546260 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:02.547209 25228 raft_consensus.cc:3060] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:02.555498 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:02.556154 25300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57256 (request call id 1909) took 1445 ms. Trace:
I20260709 13:12:02.384678 25270 leader_election.cc:304] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
W20260709 13:12:02.437901 25303 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57272 (request call id 1789) took 1379 ms (client timeout 1635 ms). Trace:
I20260709 13:12:02.436539 25345 leader_election.cc:304] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
W20260709 13:12:02.558400 25303 rpcz_store.cc:269] 0709 13:12:01.058631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:01.060155 (+  1524us) service_pool.cc:224] Handling call
0709 13:12:02.437665 (+1377510us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b5400099f54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:02.437849 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3026886400}
W20260709 13:12:02.559409 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 174669us
W20260709 13:12:02.560714 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 124229us
I20260709 13:12:02.562402 25345 leader_election.cc:304] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:02.565191 25345 leader_election.cc:304] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:02.566596 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:02.438198 25302 raft_consensus.cc:1240] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 6 LEADER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:02.568428 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
W20260709 13:12:02.569509 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 104952us
W20260709 13:12:02.577080 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:02.571487 25371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56308 (request call id 563) took 1303 ms. Trace:
I20260709 13:12:02.556641 25300 rpcz_store.cc:276] 0709 13:12:01.110977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:01.132287 (+ 21310us) service_pool.cc:224] Handling call
0709 13:12:01.173931 (+ 41644us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:01.186938 (+ 13007us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:12:01.186977 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:01.536396 (+349419us) spinlock_profiling.cc:243] Waited 1.75 ms on lock 0x7b2c0015a8d8. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72e568a11 00007fd72e578372 00007fd72fcaaa01 00007fd72fc6f43a 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2
0709 13:12:01.536873 (+   477us) log.cc:844] Serialized 26 byte log entry
0709 13:12:02.429941 (+893068us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:12:02.429981 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:02.430054 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:02.555356 (+125302us) raft_consensus.cc:1685] finished
0709 13:12:02.555401 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:02.555862 (+   461us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12605,"raft.queue_time_us":18380,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":9370,"spinlock_wait_cycles":4018432,"thread_start_us":892719,"threads_started":1,"wal-append.queue_time_us":930472}
I20260709 13:12:02.577971 25371 rpcz_store.cc:276] 0709 13:12:01.268077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:01.268193 (+   116us) service_pool.cc:224] Handling call
0709 13:12:02.570782 (+1302589us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54002887d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:02.571157 (+   375us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2501219712}
I20260709 13:12:02.569615 25225 raft_consensus.cc:3060] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:02.580345 25374 raft_consensus.cc:2410] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:12:02.579075 25376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56308 (request call id 557) took 1371 ms. Trace:
I20260709 13:12:02.580204 25230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58418 (request call id 1951) took 1227 ms. Trace:
W20260709 13:12:02.583088 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:02.536334 25125 catalog_manager.cc:5697] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 8 to 11, leader changed from 79d99c0e498349bda74127365219e468 (127.23.140.67) to 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68). New cstate: current_term: 11 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:02.596603 25873 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:02.574673 25221 raft_consensus.cc:1275] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:12:02.572299 25377 raft_consensus.cc:2468] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 10.
I20260709 13:12:02.581995 25230 rpcz_store.cc:276] 0709 13:12:01.353074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:02.304214 (+951140us) service_pool.cc:224] Handling call
0709 13:12:02.315289 (+ 11075us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:02.382959 (+ 67670us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:02.579803 (+196844us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b540024c050. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6e8ad 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:02.580033 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24473344}
I20260709 13:12:02.571516 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:02.581801 25376 rpcz_store.cc:276] 0709 13:12:01.207827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:01.207982 (+   155us) service_pool.cc:224] Handling call
0709 13:12:01.208619 (+   637us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:02.450429 (+1241810us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:02.578503 (+128074us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54004583d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:02.578810 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2854349696}
W20260709 13:12:02.626410 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 65668.3us
I20260709 13:12:02.629434 28799 raft_consensus.cc:2804] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:12:02.630740 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 100824us
I20260709 13:12:02.631695 28901 raft_consensus.cc:493] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:02.633888 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:02.637498 28500 raft_consensus.cc:493] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:02.638427 28500 raft_consensus.cc:515] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:02.638970 25344 leader_election.cc:304] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:02.625240 25221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1971) took 1098 ms. Trace:
I20260709 13:12:02.646868 25221 rpcz_store.cc:276] 0709 13:12:01.522943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:02.573011 (+1050068us) service_pool.cc:224] Handling call
0709 13:12:02.573832 (+   821us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:02.616886 (+ 43054us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:02.621331 (+  4445us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:02.631688 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:02.652016 28837 leader_election.cc:290] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:02.652191 25228 raft_consensus.cc:2468] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 8.
I20260709 13:12:02.630741 25224 raft_consensus.cc:2468] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 9.
I20260709 13:12:02.655895 28686 leader_election.cc:290] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:02.662263 28500 leader_election.cc:290] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:02.662400 28877 raft_consensus.cc:2749] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:02.662894 25195 leader_election.cc:304] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:02.663203 25874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:02.670647 25221 raft_consensus.cc:1240] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:12:02.671530 25221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58418 (request call id 1958) took 1106 ms. Trace:
I20260709 13:12:02.671906 25221 rpcz_store.cc:276] 0709 13:12:01.565492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:02.648041 (+1082549us) service_pool.cc:224] Handling call
0709 13:12:02.670269 (+ 22228us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:02.671185 (+   916us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:02.671450 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:12:02.674374 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 109565us
I20260709 13:12:02.675449 25345 leader_election.cc:304] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:02.682593 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:02.684692 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:02.685154 28746 consensus_queue.cc:237] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:02.691146 28742 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:02.692022 28742 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:02.687858 25225 raft_consensus.cc:2468] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 10.
I20260709 13:12:02.701100 25225 raft_consensus.cc:1275] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:12:02.701910 28717 raft_consensus.cc:2749] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:02.702543 28809 raft_consensus.cc:2749] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:02.703529 28809 raft_consensus.cc:2749] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:02.704267 28809 raft_consensus.cc:493] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:02.632769 28901 raft_consensus.cc:515] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:02.706176 28843 raft_consensus.cc:2749] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:02.706715 25225 raft_consensus.cc:1240] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:02.706972 28843 raft_consensus.cc:493] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:02.707666 28843 raft_consensus.cc:515] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:02.708283 28901 leader_election.cc:290] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:02.708772 25225 raft_consensus.cc:1275] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:12:02.709200 25270 leader_election.cc:304] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:02.710201 28845 raft_consensus.cc:493] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
W20260709 13:12:02.710420 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 71708.4us
I20260709 13:12:02.710614 28837 raft_consensus.cc:2804] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:02.711274 28837 raft_consensus.cc:697] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 10 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:02.712646 28832 consensus_queue.cc:1059] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:02.714227 28894 consensus_queue.cc:1059] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:02.714504 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:02.711041 28845 raft_consensus.cc:515] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:02.705056 28809 raft_consensus.cc:515] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:02.706210 25300 raft_consensus.cc:1240] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:02.476248 28147 leader_election.cc:290] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:02.754283 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:02.759029 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:02.765158 28725 consensus_queue.cc:1048] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:02.731313 28500 raft_consensus.cc:2749] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:02.766414 25230 raft_consensus.cc:1240] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 10. Current term is 11. Ops: [8.5-10.6]
I20260709 13:12:02.728207 28901 raft_consensus.cc:493] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:02.767272 25230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58418 (request call id 1961) took 1188 ms. Trace:
I20260709 13:12:02.767313 28901 raft_consensus.cc:515] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:02.768043 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 59085.4us
I20260709 13:12:02.767913 25230 rpcz_store.cc:276] 0709 13:12:01.578742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:02.717553 (+1138811us) service_pool.cc:224] Handling call
0709 13:12:02.766010 (+ 48457us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:02.766922 (+   912us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:02.767177 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:02.766656 28742 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:02.770210 28643 raft_consensus.cc:493] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:02.771344 28645 raft_consensus.cc:2749] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:02.771958 28809 leader_election.cc:290] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:02.776109 28690 raft_consensus.cc:3055] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:02.713197 28837 consensus_queue.cc:237] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:02.738445 28799 raft_consensus.cc:697] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 8 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
W20260709 13:12:02.782609 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 186283us
I20260709 13:12:02.770255 28845 leader_election.cc:290] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:12:02.791170 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 59230.1us
I20260709 13:12:02.793210 28881 raft_consensus.cc:493] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:02.785504 28690 raft_consensus.cc:740] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:02.787467 28843 leader_election.cc:290] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:02.791064 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:02.793467 28853 leader_election.cc:290] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:02.799507 25271 leader_election.cc:304] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:12:02.800079 25874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:02.800727 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 125490us
I20260709 13:12:02.820580 25345 leader_election.cc:304] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:02.820292 28799 consensus_queue.cc:237] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:02.821346 25222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1951) took 1671 ms. Trace:
I20260709 13:12:02.821842 25222 rpcz_store.cc:276] 0709 13:12:01.149662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:01.173382 (+ 23720us) service_pool.cc:224] Handling call
0709 13:12:01.173667 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:01.174674 (+  1007us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:01.174719 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:01.175295 (+   576us) log.cc:844] Serialized 26 byte log entry
0709 13:12:01.618710 (+443415us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:12:01.618762 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:01.618852 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:02.816441 (+1197589us) spinlock_profiling.cc:243] Waited 8.97 ms on lock 0x7b2400169058. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72ca089c4 00007fd72ca06acb 00007fd72cbc1dc9 00007fd72cbc1a55 00007fd72cbc0fb0 00007fd72f837488 00007fd72f837be8 00007fd72f80f398 00007fd72f80a76a 00007fd72f809bb6
0709 13:12:02.820827 (+  4386us) raft_consensus.cc:1685] finished
0709 13:12:02.820852 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:02.821177 (+   325us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":95,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":2037,"spinlock_wait_cycles":20636032,"thread_start_us":425496,"threads_started":1,"wal-append.queue_time_us":544872}
I20260709 13:12:02.823611 25345 leader_election.cc:304] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:02.800762 28549 raft_consensus.cc:2749] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:02.791071 28708 raft_consensus.cc:2749] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:02.785789 28877 consensus_queue.cc:1059] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
W20260709 13:12:02.804425 28694 consensus_meta.cc:287] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 1.107s	user 0.011s	sys 0.006s
I20260709 13:12:02.805588 28902 raft_consensus.cc:2749] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:02.826159 25229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1948) took 1677 ms. Trace:
I20260709 13:12:02.826357 28902 raft_consensus.cc:3055] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:02.803283 28742 consensus_queue.cc:1048] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:02.826951 28902 raft_consensus.cc:740] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:02.826671 25229 rpcz_store.cc:276] 0709 13:12:01.148115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:01.148886 (+   771us) service_pool.cc:224] Handling call
0709 13:12:01.153681 (+  4795us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:01.154245 (+   564us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:01.154289 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:01.154878 (+   589us) log.cc:844] Serialized 26 byte log entry
0709 13:12:01.380568 (+225690us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:01.380626 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:01.380790 (+   164us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:02.813036 (+1432246us) spinlock_profiling.cc:243] Waited 1.93 ms on lock 0x7b2400169058. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72ca089c4 00007fd72ca06acb 00007fd72cbc1dc9 00007fd72cbc1a55 00007fd72cbc0fb0 00007fd72f837488 00007fd72f837be8 00007fd72f80f398 00007fd72f80a76a 00007fd72f809bb6
0709 13:12:02.825558 (+ 12522us) raft_consensus.cc:1685] finished
0709 13:12:02.825588 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:02.825950 (+   362us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7485,"raft.queue_time_us":1511,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":15262,"spinlock_wait_cycles":4438784,"thread_start_us":195710,"threads_started":1,"wal-append.queue_time_us":537809}
I20260709 13:12:02.830240 25908 raft_consensus.cc:1240] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:02.830642 25907 raft_consensus.cc:1240] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:12:02.808142 28907 raft_consensus.cc:493] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:02.831792 28907 raft_consensus.cc:515] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:02.809408 28500 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:02.834174 28500 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:02.835181 28897 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:02.836102 28897 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:02.837121 28500 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:02.795320 28906 raft_consensus.cc:493] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:02.838047 28906 raft_consensus.cc:515] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:02.839138 28897 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:02.839257 25224 raft_consensus.cc:1240] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 10. Current term is 11. Ops: [7.7-10.9]
I20260709 13:12:02.839986 25224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58418 (request call id 1962) took 1260 ms. Trace:
I20260709 13:12:02.840319 28906 leader_election.cc:290] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:02.793427 28643 raft_consensus.cc:515] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:02.841372 25270 leader_election.cc:304] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:12:02.842816 28643 leader_election.cc:290] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:02.828333 28902 consensus_queue.cc:260] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:02.845041 28902 raft_consensus.cc:3060] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:02.840315 25224 rpcz_store.cc:276] 0709 13:12:01.580114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:02.838490 (+1258376us) service_pool.cc:224] Handling call
0709 13:12:02.838929 (+   439us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:12:02.839708 (+   779us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:02.839932 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:02.848153 28906 raft_consensus.cc:493] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:02.848477 25222 raft_consensus.cc:1240] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
W20260709 13:12:02.849252 25343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:02.848909 28906 raft_consensus.cc:515] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:02.795495 28881 raft_consensus.cc:515] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:02.850903 28801 raft_consensus.cc:2804] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:02.851249 28906 leader_election.cc:290] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:02.820940 28853 raft_consensus.cc:2804] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:02.851897 28881 leader_election.cc:290] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:02.820593 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 55810.7us
I20260709 13:12:02.852377 28694 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:02.852067 28853 raft_consensus.cc:697] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 10 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:02.890230 28853 consensus_queue.cc:237] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:12:02.808668 28894 raft_consensus.cc:493] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:02.859798 28781 raft_consensus.cc:493] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:02.892186 28894 raft_consensus.cc:515] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:02.859359 28500 raft_consensus.cc:493] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:02.864073 28907 leader_election.cc:290] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:02.866915 28737 raft_consensus.cc:3055] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:02.821991 28843 raft_consensus.cc:3060] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:02.857180 28694 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:02.870260 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:02.908382 25907 raft_consensus.cc:2468] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 10.
I20260709 13:12:02.870260 28640 raft_consensus.cc:493] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
W20260709 13:12:02.909406 28598 consensus_meta.cc:287] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 1.221s	user 0.009s	sys 0.010s
I20260709 13:12:02.909523 28640 raft_consensus.cc:3060] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:02.910307 28598 raft_consensus.cc:515] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:02.851306 28801 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:02.913988 28801 raft_consensus.cc:3060] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:02.914670 28899 consensus_queue.cc:1048] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:12:02.818662 28901 leader_election.cc:290] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:02.871248 28596 leader_election.cc:290] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:02.859875 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:02.855216 28690 consensus_queue.cc:260] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:02.849565 25302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57256 (request call id 1900) took 1741 ms. Trace:
I20260709 13:12:02.886267 25270 leader_election.cc:304] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:02.833544 25229 raft_consensus.cc:1240] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:02.892331 28781 raft_consensus.cc:515] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:02.853699 25301 raft_consensus.cc:1240] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 9. Current term is 10. Ops: []
W20260709 13:12:02.914014 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 61149.5us
I20260709 13:12:02.918545 25903 raft_consensus.cc:3060] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:02.917608 28737 raft_consensus.cc:740] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:02.917968 25302 rpcz_store.cc:276] 0709 13:12:01.108290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:01.132001 (+ 23711us) service_pool.cc:224] Handling call
0709 13:12:02.438035 (+1306034us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:02.569359 (+131324us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:02.848181 (+278822us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b54002d8d20. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fbe6dc0 00007fd72fc72a02 00007fd72fc6edd6 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2
0709 13:12:02.849256 (+  1075us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b5400099f50. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6e8ad 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:02.849421 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3438019840}
I20260709 13:12:02.923413 28845 raft_consensus.cc:2749] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:12:02.923962 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 262755us
I20260709 13:12:02.924311 25344 leader_election.cc:304] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:02.925065 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:02.916770 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:02.930624 25301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46556 (request call id 477) took 1193 ms. Trace:
I20260709 13:12:02.925675 25370 raft_consensus.cc:2468] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 9.
I20260709 13:12:02.934204 25301 rpcz_store.cc:276] 0709 13:12:01.737079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:01.740360 (+  3281us) service_pool.cc:224] Handling call
0709 13:12:01.740658 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:02.922893 (+1182235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:02.930355 (+  7462us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54002ca954. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:02.930562 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2558975872}
I20260709 13:12:02.922245 28894 leader_election.cc:290] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:02.961841 28643 raft_consensus.cc:2749] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:02.964135 28781 leader_election.cc:290] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:02.965166 28690 raft_consensus.cc:3060] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:02.973124 25228 raft_consensus.cc:1240] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:02.965898 28906 raft_consensus.cc:493] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:02.973937 25228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58418 (request call id 1963) took 1372 ms. Trace:
I20260709 13:12:02.974131 28906 raft_consensus.cc:515] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:02.974331 25228 rpcz_store.cc:276] 0709 13:12:01.601745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:02.972508 (+1370763us) service_pool.cc:224] Handling call
0709 13:12:02.972940 (+   432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:02.973608 (+   668us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:02.973877 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:02.975891 28737 consensus_queue.cc:260] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:02.976616 28906 leader_election.cc:290] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:02.966965 25377 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56308 (request call id 564) took 1675 ms (client timeout 1860 ms). Trace:
I20260709 13:12:02.881897 28846 consensus_queue.cc:260] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:02.970435 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:02.979650 28775 consensus_queue.cc:1059] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:02.980894 28694 consensus_queue.cc:1048] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:02.982753 28708 consensus_queue.cc:1048] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:02.983809 28694 raft_consensus.cc:3055] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:02.984272 28694 raft_consensus.cc:740] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:02.966558 28900 raft_consensus.cc:3055] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:02.986443 28900 raft_consensus.cc:740] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
W20260709 13:12:02.976786 28879 log.cc:927] Time spent T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.540s	user 0.001s	sys 0.002s
W20260709 13:12:02.987180 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 163748us
I20260709 13:12:02.977487 28737 raft_consensus.cc:3060] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:02.987319 25377 rpcz_store.cc:269] 0709 13:12:01.292613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:01.292820 (+   207us) service_pool.cc:224] Handling call
0709 13:12:02.966704 (+1673884us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b540033ed54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:02.966903 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2760904960}
I20260709 13:12:02.922120 28500 raft_consensus.cc:515] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:03.033097 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:03.033838 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:03.034085 25904 raft_consensus.cc:2468] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 7.
I20260709 13:12:03.034418 25874 leader_election.cc:304] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:12:02.988142 28598 leader_election.cc:290] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:03.036168 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:03.036701 28809 raft_consensus.cc:2804] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:03.037083 25901 raft_consensus.cc:2410] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:12:03.038385 28379 consensus_queue.cc:1048] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:12:03.039207 28686 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:03.038414 28794 consensus_meta.cc:287] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.554s	user 0.005s	sys 0.007s
I20260709 13:12:03.036283 28907 raft_consensus.cc:2804] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:03.040774 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:03.041064 28907 raft_consensus.cc:697] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:03.041610 25228 raft_consensus.cc:2468] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 10.
I20260709 13:12:03.042348 28907 consensus_queue.cc:237] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:03.043903 28799 consensus_queue.cc:1059] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:03.045015 28799 raft_consensus.cc:3055] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:03.045550 28799 raft_consensus.cc:740] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:03.046196 25345 leader_election.cc:304] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:03.047304 28837 raft_consensus.cc:2804] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:03.047785 25345 leader_election.cc:304] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:03.048832 28845 raft_consensus.cc:2749] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:03.049901 28809 raft_consensus.cc:493] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:03.050086 28911 raft_consensus.cc:493] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.050433 28809 raft_consensus.cc:3060] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:03.050776 28911 raft_consensus.cc:515] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:03.052104 28500 leader_election.cc:290] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:03.050454 28640 raft_consensus.cc:515] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:03.046787 28799 consensus_queue.cc:260] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:03.055363 28799 raft_consensus.cc:3060] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:03.056330 28640 leader_election.cc:290] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:03.056751 28598 raft_consensus.cc:493] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:03.047853 28837 raft_consensus.cc:493] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:03.057461 28598 raft_consensus.cc:515] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:03.053682 28911 leader_election.cc:290] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:03.060499 28598 leader_election.cc:290] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:03.058470 28837 raft_consensus.cc:3060] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:02.969326 28596 raft_consensus.cc:493] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:03.061591 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:03.023654 25908 raft_consensus.cc:2468] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 6.
I20260709 13:12:03.049441 25345 leader_election.cc:304] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:03.072849 25903 raft_consensus.cc:2468] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 9.
W20260709 13:12:03.078871 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:03.081204 25228 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 5.
I20260709 13:12:02.985488 28694 consensus_queue.cc:260] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:03.084369 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:03.091634 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
W20260709 13:12:03.087363 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 201273us
W20260709 13:12:03.088980 25195 connection.cc:256] RPC call timeout handler was delayed by -1.2445331309999119s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1827s for a response
W20260709 13:12:03.099819 25195 connection.cc:256] RPC call timeout handler was delayed by -1.2317383179998842s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1503s for a response
W20260709 13:12:03.105530 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:03.039925 28686 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:03.078069 28690 consensus_queue.cc:1048] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:12:03.081817 28801 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:03.114712 25270 leader_election.cc:304] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:12:03.122112 28511 consensus_queue.cc:1048] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:03.125856 28690 consensus_queue.cc:1243] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer 1f539ba21487460085b837e7529a78ce log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:12:03.113515 28914 log.cc:927] Time spent T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
W20260709 13:12:03.132134 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 82776us
I20260709 13:12:03.134850 25344 leader_election.cc:304] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:03.136000 25344 leader_election.cc:304] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:03.137044 28734 raft_consensus.cc:2804] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:03.137398 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:03.137619 28734 raft_consensus.cc:697] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 9 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:03.137981 28642 raft_consensus.cc:2804] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:03.138455 28642 raft_consensus.cc:493] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:03.138883 28642 raft_consensus.cc:3060] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:03.139613 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:03.140380 25908 raft_consensus.cc:2468] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 9.
I20260709 13:12:03.140859 28900 consensus_queue.cc:260] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:03.131659 28717 raft_consensus.cc:493] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:03.142153 28900 raft_consensus.cc:3060] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:03.142526 25271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:03.142357 28717 raft_consensus.cc:515] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:03.144356 28550 raft_consensus.cc:493] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.144968 28550 raft_consensus.cc:515] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:12:03.147377 28550 leader_election.cc:290] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:12:02.987735 28549 consensus_queue.cc:1175] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" responder_term: 8 status { last_received { term: 5 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 7. Current term is 8. Ops: [7.8-7.8]" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:12:03.148734 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:03.182523 25344 leader_election.cc:304] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:03.149413 25221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58418 (request call id 1966) took 1526 ms. Trace:
I20260709 13:12:03.149744 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:03.147859 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:03.159686 28734 consensus_queue.cc:237] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:03.109869 28596 raft_consensus.cc:515] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:03.153316 28642 raft_consensus.cc:515] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:03.164757 28742 raft_consensus.cc:2804] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:03.189114 28746 raft_consensus.cc:2804] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:03.195384 28746 raft_consensus.cc:493] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:03.195895 28746 raft_consensus.cc:3060] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:03.196233 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:03.197109 25300 raft_consensus.cc:2410] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:12:03.197926 25345 leader_election.cc:304] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:03.199759 28642 leader_election.cc:290] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:03.199947 25345 leader_election.cc:304] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:03.200321 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:03.201032 25904 raft_consensus.cc:3060] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:12:03.194610 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 90166.2us
W20260709 13:12:03.176901 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:03.109365 28845 consensus_queue.cc:1059] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 13:12:03.164073 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:03.144397 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:12:03.190559 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 80801.6us
I20260709 13:12:03.194723 28742 raft_consensus.cc:697] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 10 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:03.172235 28857 raft_consensus.cc:2749] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:03.163318 28694 raft_consensus.cc:3060] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:03.203559 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:03.204146 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:12:03.211149 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:03.212592 28550 raft_consensus.cc:2749] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:03.204612 28843 raft_consensus.cc:2749] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:12:03.222188 25871 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:03.192080 28809 raft_consensus.cc:515] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:03.209118 28642 raft_consensus.cc:2749] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:03.245959 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:03.247418 25302 raft_consensus.cc:1275] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:12:03.248350 25872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:03.241576 25906 raft_consensus.cc:2468] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 9.
I20260709 13:12:03.259516 28742 consensus_queue.cc:237] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:03.185079 25221 rpcz_store.cc:276] 0709 13:12:01.622791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:02.672811 (+1050020us) service_pool.cc:224] Handling call
0709 13:12:02.673301 (+   490us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:02.889039 (+215738us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:12:02.890703 (+  1664us) log.cc:844] Serialized 14 byte log entry
0709 13:12:03.109719 (+219016us) log.cc:844] Serialized 14 byte log entry
0709 13:12:03.109983 (+   264us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:03.129861 (+ 19878us) log.cc:844] Serialized 26 byte log entry
0709 13:12:03.130100 (+   239us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:03.130131 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:03.130213 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:03.149180 (+ 18967us) raft_consensus.cc:1685] finished
0709 13:12:03.149202 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:03.149347 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2361,"prepare.queue_time_us":38891,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":59,"raft.queue_time_us":113620,"raft.run_cpu_time_us":402,"raft.run_wall_time_us":28122,"spinlock_wait_cycles":2714880,"thread_start_us":387589,"threads_started":3,"wal-append.queue_time_us":193122}
W20260709 13:12:03.240458 28922 log.cc:927] Time spent T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.061s	user 0.000s	sys 0.002s
W20260709 13:12:03.270869 25874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:03.278878 28686 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:03.281402 28596 leader_election.cc:290] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:03.222682 28845 consensus_queue.cc:1243] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer da445ce82dc4467f95f4fa52297eaa19 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:12:03.324527 25904 raft_consensus.cc:2468] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 7.
I20260709 13:12:03.241050 28911 raft_consensus.cc:493] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.338721 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:03.350395 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:03.353853 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:12:03.355306 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:03.355592 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 114137us
I20260709 13:12:03.365242 25302 raft_consensus.cc:3060] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:03.369527 25227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1970) took 1913 ms. Trace:
I20260709 13:12:03.352496 28717 leader_election.cc:290] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:03.370100 25227 rpcz_store.cc:276] 0709 13:12:01.455688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:02.538815 (+1083127us) service_pool.cc:224] Handling call
0709 13:12:02.539442 (+   627us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:02.717032 (+177590us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:12:02.795725 (+ 78693us) log.cc:844] Serialized 14 byte log entry
0709 13:12:02.988572 (+192847us) log.cc:844] Serialized 14 byte log entry
0709 13:12:02.989544 (+   972us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:03.017535 (+ 27991us) log.cc:844] Serialized 26 byte log entry
0709 13:12:03.017736 (+   201us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:03.017806 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:03.017908 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:03.047493 (+ 29585us) spinlock_profiling.cc:243] Waited 2.81 ms on lock 0x7b180045f460. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72cb82522 00007fd72cb847c1 00007fd72cb84779 00007fd72cb84709 00007fd72cb846d1 00007fd72cb839cd 000000000038f354 000000000038f199 00007fd72cb6583a
0709 13:12:03.058267 (+ 10774us) spinlock_profiling.cc:243] Waited 2.78 ms on lock 0x7b180045f460. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72cb82522 00007fd72cb847c1 00007fd72cb84779 00007fd72cb84709 00007fd72cb846d1 00007fd72cb839cd 000000000038f354 000000000038f199 00007fd72cb6583a
0709 13:12:03.360604 (+302337us) raft_consensus.cc:1685] finished
0709 13:12:03.360635 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:03.365090 (+  4455us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23767,"prepare.queue_time_us":158606,"prepare.run_cpu_time_us":101,"prepare.run_wall_time_us":2388,"raft.queue_time_us":128967,"raft.run_cpu_time_us":560,"raft.run_wall_time_us":31098,"spinlock_wait_cycles":12846720,"thread_start_us":272146,"threads_started":3,"wal-append.queue_time_us":135825}
I20260709 13:12:03.379477 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:03.383080 28846 raft_consensus.cc:3060] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:03.375882 28911 raft_consensus.cc:515] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:03.386672 28911 leader_election.cc:290] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:03.389294 25344 leader_election.cc:304] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:03.390461 28642 raft_consensus.cc:2804] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:03.391106 28642 raft_consensus.cc:697] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 7 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:03.392288 28642 consensus_queue.cc:237] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:03.363761 28801 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:03.400530 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:03.401975 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:03.402985 28549 raft_consensus.cc:3055] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:03.403576 28549 raft_consensus.cc:740] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:03.405169 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:03.408720 28837 raft_consensus.cc:515] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:03.411357 28837 leader_election.cc:290] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:03.412360 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:03.414007 25303 raft_consensus.cc:1240] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:03.415409 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:03.416141 25305 raft_consensus.cc:3060] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:03.418567 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:03.418591 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:03.421285 25302 raft_consensus.cc:2468] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 9.
I20260709 13:12:03.421460 25345 leader_election.cc:304] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:03.361318 28809 leader_election.cc:290] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:03.423025 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:03.426661 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
W20260709 13:12:03.427292 25874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:03.430431 25225 raft_consensus.cc:2468] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 8.
W20260709 13:12:03.397330 28927 log.cc:927] Time spent T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.223s	user 0.003s	sys 0.000s
I20260709 13:12:03.404865 28549 consensus_queue.cc:260] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:03.443679 28549 raft_consensus.cc:3060] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:03.447471 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:03.448807 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:03.449505 25221 raft_consensus.cc:2468] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 11.
I20260709 13:12:03.451889 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:03.452556 25902 raft_consensus.cc:3060] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:03.457129 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:03.458045 25377 raft_consensus.cc:2410] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:12:03.455753 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:03.459545 25906 raft_consensus.cc:1275] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:12:03.461221 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:03.469419 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:03.470826 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:03.470885 25376 raft_consensus.cc:1240] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:03.397490 28746 raft_consensus.cc:515] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:03.476100 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:12:03.479575 25873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:03.480630 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:03.481141 25227 pending_rounds.cc:85] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce: Aborting all ops after (but not including) 6
I20260709 13:12:03.481298 25300 raft_consensus.cc:2468] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 9.
I20260709 13:12:03.481787 25227 pending_rounds.cc:107] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:12:03.482261 25227 raft_consensus.cc:2889] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:03.489221 25373 raft_consensus.cc:1275] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:12:03.490864 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:03.491986 25374 raft_consensus.cc:2410] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:12:03.492909 25872 leader_election.cc:304] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:03.495313 25378 raft_consensus.cc:1275] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:12:03.495738 25378 pending_rounds.cc:85] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468: Aborting all ops after (but not including) 4
I20260709 13:12:03.496001 25378 pending_rounds.cc:107] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:12:03.496258 25378 raft_consensus.cc:2889] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:03.497000 25230 raft_consensus.cc:1275] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:12:03.490900 25908 raft_consensus.cc:1275] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 13:12:03.498131 25908 pending_rounds.cc:85] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6: Aborting all ops after (but not including) 5
W20260709 13:12:03.525436 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:03.526710 25908 pending_rounds.cc:107] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:12:03.499435 25377 raft_consensus.cc:2468] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 9.
I20260709 13:12:03.524471 25305 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 7.
I20260709 13:12:03.528467 25908 raft_consensus.cc:2889] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:03.530481 25378 raft_consensus.cc:1240] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:03.532941 28746 leader_election.cc:290] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:03.492939 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:03.526854 28900 raft_consensus.cc:2749] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:12:03.531975 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:03.527000 28837 raft_consensus.cc:2804] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:03.534983 28837 raft_consensus.cc:697] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 8 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:03.535097 25908 pending_rounds.cc:107] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:12:03.536692 25908 raft_consensus.cc:2889] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:12:03.538061 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 45297.8us
I20260709 13:12:03.536293 28837 consensus_queue.cc:237] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:03.540671 25872 leader_election.cc:304] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:12:03.546341 25874 leader_election.cc:304] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:12:03.549892 25230 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b"
dest_uuid: "1f539ba21487460085b837e7529a78ce"
mode: GRACEFUL
new_leader_uuid: "da445ce82dc4467f95f4fa52297eaa19"
 from {username='slave'} at 127.0.0.1:45014
I20260709 13:12:03.550859 25230 raft_consensus.cc:606] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 8 LEADER]: Received request to transfer leadership to TS da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:03.558084 25230 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119"
dest_uuid: "1f539ba21487460085b837e7529a78ce"
mode: GRACEFUL
new_leader_uuid: "79d99c0e498349bda74127365219e468"
 from {username='slave'} at 127.0.0.1:45014
I20260709 13:12:03.573846 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:03.579586 25874 leader_election.cc:304] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
W20260709 13:12:03.585652 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:03.496264 25195 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 1.503s (SENT) [suppressed 23 similar messages]
W20260709 13:12:03.498224 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 120218us
W20260709 13:12:03.590955 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 94707.3us
I20260709 13:12:03.558811 25230 raft_consensus.cc:606] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Received request to transfer leadership to TS 79d99c0e498349bda74127365219e468
I20260709 13:12:03.593263 25230 raft_consensus.cc:614] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:03.594777 25902 raft_consensus.cc:2468] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 11.
I20260709 13:12:03.587080 28900 raft_consensus.cc:2804] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:03.582067 28737 raft_consensus.cc:2804] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:03.609707 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:03.612058 25901 raft_consensus.cc:3060] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:03.608273 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:03.582547 28596 raft_consensus.cc:493] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.618534 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:03.619292 25344 leader_election.cc:304] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:03.621640 25908 raft_consensus.cc:1275] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:12:03.617796 25195 leader_election.cc:336] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 1.559s (SENT)
I20260709 13:12:03.581683 28690 consensus_queue.cc:1059] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:12:03.650173 25195 leader_election.cc:304] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:03.624200 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 83662.3us
I20260709 13:12:03.621958 25376 raft_consensus.cc:1240] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 7 LEADER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 6. Current term is 7. Ops: []
W20260709 13:12:03.654175 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:03.612330 28905 raft_consensus.cc:2804] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:12:03.658015 28936 log.cc:927] Time spent T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:12:03.658108 28905 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:03.658588 28905 raft_consensus.cc:3060] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:03.661242 25906 raft_consensus.cc:1275] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:12:03.662196 28717 raft_consensus.cc:493] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:03.662779 28717 raft_consensus.cc:515] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:12:03.664996 28717 leader_election.cc:290] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:03.621796 28737 raft_consensus.cc:697] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:03.666636 28737 consensus_queue.cc:237] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:03.667492 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:03.605962 28900 raft_consensus.cc:493] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:03.649847 28734 raft_consensus.cc:2804] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:03.678849 25226 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92f679df8187472794ba8595642f63f9"
dest_uuid: "1f539ba21487460085b837e7529a78ce"
mode: GRACEFUL
new_leader_uuid: "da445ce82dc4467f95f4fa52297eaa19"
 from {username='slave'} at 127.0.0.1:45014
I20260709 13:12:03.677577 25299 raft_consensus.cc:1275] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:12:03.669672 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:03.617631 28746 consensus_queue.cc:1048] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:12:03.679423 25226 raft_consensus.cc:606] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 10 LEADER]: Received request to transfer leadership to TS da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:03.689790 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:03.684598 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:03.672458 28832 raft_consensus.cc:3055] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:03.691582 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:03.698127 25872 leader_election.cc:304] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:03.694321 25378 raft_consensus.cc:2468] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 10.
I20260709 13:12:03.678364 28900 raft_consensus.cc:3060] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:03.656114 28596 raft_consensus.cc:515] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:03.711738 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 100366us
I20260709 13:12:03.677470 28717 raft_consensus.cc:2749] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:03.720320 25377 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 6.
I20260709 13:12:03.722168 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:03.718081 28907 raft_consensus.cc:2749] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:03.733242 25901 raft_consensus.cc:2468] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 10.
I20260709 13:12:03.691890 28734 raft_consensus.cc:697] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 11 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
W20260709 13:12:03.740756 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:03.737524 25344 leader_election.cc:304] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:03.741981 25229 raft_consensus.cc:1275] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:12:03.695598 28832 raft_consensus.cc:740] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:03.677110 28642 consensus_queue.cc:1048] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
W20260709 13:12:03.750739 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:03.754822 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 70292.5us
I20260709 13:12:03.759040 25377 raft_consensus.cc:1275] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 4. (term mismatch)
W20260709 13:12:03.761279 25270 connection.cc:256] RPC call timeout handler was delayed by -1.2456633289999672s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1554s for a response
W20260709 13:12:03.762859 25874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:03.710264 28799 consensus_queue.cc:1048] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:12:03.748229 28742 raft_consensus.cc:493] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:03.761112 25195 leader_election.cc:336] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 1.605s (SENT)
I20260709 13:12:03.766278 25195 leader_election.cc:304] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:03.759378 25377 pending_rounds.cc:85] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468: Aborting all ops after (but not including) 3
I20260709 13:12:03.762734 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:03.768374 25377 pending_rounds.cc:107] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:12:03.753779 28845 raft_consensus.cc:2804] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:03.770370 25226 raft_consensus.cc:2393] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 11: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:03.772727 25377 raft_consensus.cc:2889] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:03.773379 25377 pending_rounds.cc:107] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:12:03.773669 25377 raft_consensus.cc:2889] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:03.776018 25343 leader_election.cc:304] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:03.762027 28725 raft_consensus.cc:493] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.742467 28905 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:03.786586 25270 leader_election.cc:304] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:03.799852 25374 raft_consensus.cc:1275] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:12:03.802081 25375 raft_consensus.cc:1275] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:12:03.805529 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:03.806375 25901 raft_consensus.cc:2468] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 8.
I20260709 13:12:03.822088 25226 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff"
dest_uuid: "1f539ba21487460085b837e7529a78ce"
mode: GRACEFUL
new_leader_uuid: "da445ce82dc4467f95f4fa52297eaa19"
 from {username='slave'} at 127.0.0.1:45014
W20260709 13:12:03.834311 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 58361.9us
I20260709 13:12:03.840076 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:03.848213 25226 raft_consensus.cc:606] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Received request to transfer leadership to TS da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:03.848483 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 92062.7us
I20260709 13:12:03.838721 28907 consensus_queue.cc:1059] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:12:03.804917 28846 raft_consensus.cc:2749] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:03.800093 28717 raft_consensus.cc:2749] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:03.790194 28845 raft_consensus.cc:697] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 10 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:03.853838 25226 raft_consensus.cc:614] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:03.856608 25901 raft_consensus.cc:2393] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 6: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
W20260709 13:12:03.857599 25195 leader_election.cc:336] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 1.643s (SENT)
I20260709 13:12:03.858220 25195 leader_election.cc:304] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:03.781533 28899 consensus_queue.cc:1048] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 13:12:03.785205 28742 raft_consensus.cc:515] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:03.865792 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:03.870613 25901 raft_consensus.cc:2393] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 6: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:12:03.871245 25343 leader_election.cc:304] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:03.800992 28725 raft_consensus.cc:515] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:03.885138 28948 log.cc:927] Time spent T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:12:03.867190 28801 raft_consensus.cc:2804] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:03.849447 28746 consensus_queue.cc:1059] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 2, Time since last communication: 0.031s
W20260709 13:12:03.886037 28947 log.cc:927] Time spent T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 13:12:03.886893 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:03.897179 28686 raft_consensus.cc:2804] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:03.898370 25907 raft_consensus.cc:1240] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
W20260709 13:12:03.908399 28938 log.cc:927] Time spent T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.371s	user 0.000s	sys 0.005s
I20260709 13:12:03.913250 25908 raft_consensus.cc:1240] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 LEADER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:03.868470 28911 raft_consensus.cc:2749] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:12:03.943791 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:03.866991 28832 consensus_queue.cc:260] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:03.922941 28596 leader_election.cc:290] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:03.924625 28690 raft_consensus.cc:3055] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:03.927834 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:03.928606 28717 raft_consensus.cc:493] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:03.888358 28846 raft_consensus.cc:493] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.937536 25906 raft_consensus.cc:2468] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 8.
W20260709 13:12:03.945125 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 95798.7us
I20260709 13:12:03.851218 28734 consensus_queue.cc:237] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:03.940898 28686 raft_consensus.cc:493] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:03.968704 25906 raft_consensus.cc:1275] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:12:03.972218 25223 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05"
dest_uuid: "1f539ba21487460085b837e7529a78ce"
mode: GRACEFUL
new_leader_uuid: "da445ce82dc4467f95f4fa52297eaa19"
 from {username='slave'} at 127.0.0.1:45014
I20260709 13:12:03.974242 25223 raft_consensus.cc:606] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Received request to transfer leadership to TS da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:03.974702 25223 raft_consensus.cc:614] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:03.948864 28801 raft_consensus.cc:697] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 8 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:03.951963 28690 raft_consensus.cc:740] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
W20260709 13:12:03.990315 28944 log.cc:927] Time spent T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 13:12:03.997997 28846 raft_consensus.cc:515] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:04.002789 28832 raft_consensus.cc:3060] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:04.013840 28725 leader_election.cc:290] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:04.024075 25874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:03.978188 28686 raft_consensus.cc:3060] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:03.961376 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 67998.8us
I20260709 13:12:04.056092 25907 raft_consensus.cc:1240] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:04.065521 28905 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 12 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:12:04.067927 28940 log.cc:927] Time spent T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
W20260709 13:12:04.075747 25872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:04.042122 28717 raft_consensus.cc:515] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:03.980348 28845 consensus_queue.cc:237] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:04.095960 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:04.091095 24113 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:12:04.102000 25907 raft_consensus.cc:2368] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for earlier term 11. Current term is 12.
I20260709 13:12:04.099527 24113 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:12:04.112166 25871 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:04.146035 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 377777us
I20260709 13:12:04.117825 28799 raft_consensus.cc:493] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:04.156450 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 299287us
I20260709 13:12:04.159688 25907 raft_consensus.cc:1275] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:12:04.120606 28742 leader_election.cc:290] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:04.148837 28746 raft_consensus.cc:3055] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:04.104285 28801 consensus_queue.cc:237] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:04.109697 28690 consensus_queue.cc:260] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:04.169051 28746 raft_consensus.cc:740] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:04.162389 28799 raft_consensus.cc:515] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:04.188119 25195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:04.188621 25195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:04.189128 25195 leader_election.cc:304] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:04.190297 25195 leader_election.cc:304] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:04.190869 28911 raft_consensus.cc:2804] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:04.191320 28911 raft_consensus.cc:493] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:04.191705 28911 raft_consensus.cc:3060] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:04.198521 28961 raft_consensus.cc:2749] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:04.198920 28717 leader_election.cc:290] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:04.178836 28956 consensus_queue.cc:1048] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:12:04.206290 28717 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:04.207036 28717 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:04.211050 25195 leader_election.cc:304] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:04.212846 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:04.214556 28717 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:04.218240 25271 leader_election.cc:304] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:04.221920 28961 raft_consensus.cc:2804] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:04.222391 28961 raft_consensus.cc:493] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:04.222783 28961 raft_consensus.cc:3060] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:04.230844 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:04.231097 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:04.231688 25230 raft_consensus.cc:2468] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 7.
I20260709 13:12:04.231817 25222 raft_consensus.cc:2468] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 10.
I20260709 13:12:04.233522 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:04.234258 25225 raft_consensus.cc:2468] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 8.
I20260709 13:12:04.238258 28746 consensus_queue.cc:260] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:04.239573 28746 raft_consensus.cc:3060] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:04.238586 28500 consensus_queue.cc:1048] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:04.219152 28742 raft_consensus.cc:2804] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:04.256304 28742 raft_consensus.cc:493] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:04.288787 25195 leader_election.cc:336] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 1.616s (SENT)
I20260709 13:12:04.289479 25195 leader_election.cc:304] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:04.255955 28717 consensus_queue.cc:1048] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:12:04.287768 28742 raft_consensus.cc:3060] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:04.313387 28971 raft_consensus.cc:493] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.314108 28971 raft_consensus.cc:515] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:04.316232 28971 leader_election.cc:290] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:04.316759 28971 raft_consensus.cc:2749] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:04.309562 28961 raft_consensus.cc:515] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:04.330605 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 89378.6us
I20260709 13:12:04.334380 25903 raft_consensus.cc:1275] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:12:04.336390 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:04.341777 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:12:04.344066 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 74960.7us
I20260709 13:12:04.322467 28734 raft_consensus.cc:493] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.355206 28799 leader_election.cc:290] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:04.356973 28962 log.cc:927] Time spent T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:12:04.364305 28686 raft_consensus.cc:515] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:04.373899 25874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:04.376616 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 94955.1us
W20260709 13:12:04.382225 25195 leader_election.cc:336] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 1.824s (SENT)
I20260709 13:12:04.377795 28694 consensus_queue.cc:1048] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:12:04.389083 28734 raft_consensus.cc:515] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:04.393739 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:04.396013 28734 leader_election.cc:290] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:04.396302 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:04.396999 25230 raft_consensus.cc:2468] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 7.
I20260709 13:12:04.397936 28961 leader_election.cc:290] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:04.400930 28500 consensus_queue.cc:1059] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:04.346604 28809 consensus_queue.cc:1048] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:12:04.401706 28911 raft_consensus.cc:515] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:04.402669 25225 raft_consensus.cc:3060] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:04.404220 28911 leader_election.cc:290] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:04.412148 28725 raft_consensus.cc:493] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.415187 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:04.416714 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:04.418155 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:04.419453 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:04.402026 28500 consensus_queue.cc:1048] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:12:04.436012 25874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:04.438812 25195 leader_election.cc:304] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:04.412990 28725 raft_consensus.cc:515] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:04.448174 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:04.456512 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:04.457250 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:04.665421 25222 raft_consensus.cc:3060] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:04.459273 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:12:04.416724 28900 consensus_meta.cc:287] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent flushing consensus metadata: real 0.698s	user 0.003s	sys 0.007s
W20260709 13:12:04.526970 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 253838us
W20260709 13:12:04.582733 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 163162us
W20260709 13:12:04.583596 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 262459us
W20260709 13:12:04.646109 25343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:04.646000 25225 raft_consensus.cc:2468] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 10.
I20260709 13:12:04.650220 25227 raft_consensus.cc:1275] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:12:04.452131 25223 raft_consensus.cc:3060] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:04.675264 25228 raft_consensus.cc:2468] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 11.
I20260709 13:12:04.679594 25230 raft_consensus.cc:2410] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:12:04.676959 25221 raft_consensus.cc:2468] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 10.
W20260709 13:12:04.683212 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:04.682885 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 300575us
I20260709 13:12:04.453807 28832 raft_consensus.cc:3055] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:04.661892 28846 leader_election.cc:290] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:04.662300 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:04.698334 25902 raft_consensus.cc:2468] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 7.
I20260709 13:12:04.646685 28746 raft_consensus.cc:493] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:04.675513 28642 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.688442 28832 raft_consensus.cc:740] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:04.671252 28961 raft_consensus.cc:493] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:04.677878 28911 raft_consensus.cc:2749] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:04.677389 28717 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.717064 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:04.694446 28781 raft_consensus.cc:493] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.685524 28972 raft_consensus.cc:493] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:04.746276 25344 leader_election.cc:304] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:04.708618 28596 raft_consensus.cc:493] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:04.679689 28900 raft_consensus.cc:515] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:04.756836 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 69941.1us
I20260709 13:12:04.733903 28971 raft_consensus.cc:493] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.733908 28799 raft_consensus.cc:493] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.774175 28799 raft_consensus.cc:515] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:04.776844 28799 leader_election.cc:290] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:04.777696 28686 leader_election.cc:290] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:04.778285 28725 leader_election.cc:290] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:04.742841 28642 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:04.780380 28642 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:04.756265 28781 raft_consensus.cc:515] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:04.756460 28717 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:04.785399 28717 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:04.785965 28956 raft_consensus.cc:2804] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:04.786450 28956 raft_consensus.cc:493] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:04.786938 28956 raft_consensus.cc:3060] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:04.742414 28846 raft_consensus.cc:493] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.790486 28846 raft_consensus.cc:515] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:04.792980 28846 leader_election.cc:290] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:04.793609 28961 raft_consensus.cc:515] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:04.786556 28596 raft_consensus.cc:515] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:04.798285 28832 consensus_queue.cc:260] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:04.799346 28832 raft_consensus.cc:3060] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:04.800125 25222 raft_consensus.cc:2468] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 11.
I20260709 13:12:04.803920 28690 raft_consensus.cc:3060] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:04.807592 28971 raft_consensus.cc:515] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:04.750044 28742 raft_consensus.cc:515] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:04.813961 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 142384us
I20260709 13:12:04.845093 25223 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 7.
I20260709 13:12:04.857064 25195 leader_election.cc:304] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:04.833647 28694 raft_consensus.cc:493] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:04.877094 25872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:04.876266 25873 leader_election.cc:336] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 1.860s (SENT)
I20260709 13:12:04.752985 28746 raft_consensus.cc:515] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:04.877508 25872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:04.883496 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
W20260709 13:12:04.888976 25872 leader_election.cc:336] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Timed out: RequestConsensusVote RPC to 127.23.140.66:33127 timed out after 1.986s (SENT)
W20260709 13:12:04.896086 25874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:04.842314 28734 raft_consensus.cc:493] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.916769 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:04.876832 28781 leader_election.cc:290] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:04.902877 28549 raft_consensus.cc:493] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.941188 25902 raft_consensus.cc:1275] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:12:04.923939 28717 raft_consensus.cc:2749] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:12:04.951309 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 138318us
I20260709 13:12:04.839926 28972 raft_consensus.cc:515] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:04.957111 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 68158.7us
I20260709 13:12:04.939687 28742 leader_election.cc:290] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:04.952626 28781 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.929246 28734 raft_consensus.cc:515] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:05.004115 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 139918us
I20260709 13:12:04.936106 28694 raft_consensus.cc:515] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:04.959255 28971 leader_election.cc:290] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:05.011129 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 173096us
I20260709 13:12:04.938524 28984 consensus_queue.cc:1059] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 13:12:04.985143 28961 leader_election.cc:290] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:05.017076 25873 leader_election.cc:336] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 2.189s (SENT)
W20260709 13:12:05.022188 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 183318us
I20260709 13:12:04.961923 28549 raft_consensus.cc:515] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:05.006820 28717 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:05.015607 28642 raft_consensus.cc:493] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:05.070209 28846 raft_consensus.cc:493] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.071105 28995 consensus_queue.cc:1048] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:05.071969 25195 leader_election.cc:304] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:05.070998 28846 raft_consensus.cc:515] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:05.019730 28837 raft_consensus.cc:493] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
W20260709 13:12:05.074823 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 62554us
I20260709 13:12:05.009696 28781 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:05.059932 28845 raft_consensus.cc:493] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.074872 28961 raft_consensus.cc:493] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:05.092649 28971 raft_consensus.cc:2749] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:12:05.102774 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 90126.9us
I20260709 13:12:05.110003 29003 consensus_queue.cc:1048] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:05.128726 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:05.140123 25301 raft_consensus.cc:2393] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 10: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:05.140326 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:05.140945 25299 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 9.
I20260709 13:12:05.141053 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:05.141631 25305 raft_consensus.cc:2468] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 8.
I20260709 13:12:05.096623 28981 raft_consensus.cc:493] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:05.144963 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:05.145671 25301 raft_consensus.cc:2393] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 11: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
W20260709 13:12:05.147894 28983 log.cc:927] Time spent T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
W20260709 13:12:05.148178 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 131134us
W20260709 13:12:05.148417 29000 log.cc:927] Time spent T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:12:05.148677 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:12:05.148885 25873 leader_election.cc:336] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 2.199s (SENT)
I20260709 13:12:05.150838 28972 leader_election.cc:290] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:05.151850 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 103901us
I20260709 13:12:05.154250 25230 raft_consensus.cc:1275] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:12:05.155040 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:05.155622 25224 raft_consensus.cc:1240] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:05.156132 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:05.156663 25221 raft_consensus.cc:3060] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:05.157124 28846 leader_election.cc:290] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:05.159703 28781 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:05.074640 28717 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:05.105221 28596 leader_election.cc:290] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:05.163622 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:05.134825 28978 raft_consensus.cc:3055] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:05.169960 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:05.167730 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:05.173146 25194 leader_election.cc:304] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:05.171458 25224 raft_consensus.cc:1275] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 10 index: 4. (index mismatch)
I20260709 13:12:05.176507 25221 raft_consensus.cc:2468] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 12.
I20260709 13:12:05.173035 25229 raft_consensus.cc:2468] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 10.
I20260709 13:12:05.074932 28642 raft_consensus.cc:515] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:12:05.098404 28837 raft_consensus.cc:515] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:05.189654 28990 log.cc:927] Time spent T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
I20260709 13:12:05.190112 28734 leader_election.cc:290] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:05.171540 28961 raft_consensus.cc:515] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:05.190721 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 54399.2us
I20260709 13:12:05.191285 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:05.191529 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:05.191299 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:05.203500 25370 raft_consensus.cc:2376] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 9. Re-sending same reply.
W20260709 13:12:05.192458 28994 log.cc:927] Time spent T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:12:05.192881 28549 leader_election.cc:290] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:05.102540 28845 raft_consensus.cc:515] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:05.193272 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:05.182420 28976 consensus_queue.cc:1048] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:12:05.194906 28642 leader_election.cc:290] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:05.196719 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:05.186674 28596 consensus_queue.cc:1048] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:12:05.198304 25303 raft_consensus.cc:1275] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:12:05.200191 25223 raft_consensus.cc:1275] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:12:05.177814 25221 raft_consensus.cc:1240] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:12:05.205209 25903 raft_consensus.cc:2468] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 10.
I20260709 13:12:05.205912 28972 raft_consensus.cc:2804] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:12:05.222321 25872 leader_election.cc:336] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Timed out: RequestConsensusVote RPC to 127.23.140.66:33127 timed out after 2.156s (SENT)
I20260709 13:12:05.234793 25872 leader_election.cc:304] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:05.226954 25303 pending_rounds.cc:85] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19: Aborting all ops after (but not including) 7
I20260709 13:12:05.171980 28978 raft_consensus.cc:740] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:05.224713 25229 raft_consensus.cc:3060] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:05.228211 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:05.203128 28832 raft_consensus.cc:493] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.235759 25303 pending_rounds.cc:107] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:12:05.238237 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:05.254563 25303 raft_consensus.cc:2889] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:05.254874 25370 raft_consensus.cc:2468] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 13.
I20260709 13:12:05.164753 28981 raft_consensus.cc:515] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:05.237622 25371 raft_consensus.cc:2468] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 11.
I20260709 13:12:05.257619 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:05.269117 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:05.271693 25377 raft_consensus.cc:2410] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 12 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:12:05.273968 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 55163.6us
I20260709 13:12:05.274109 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:05.238242 28690 raft_consensus.cc:2749] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:05.236937 28972 raft_consensus.cc:493] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:05.266476 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:05.281174 28986 consensus_queue.cc:1059] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:05.283070 28991 raft_consensus.cc:493] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:05.283573 25271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:05.257234 28899 raft_consensus.cc:493] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:05.300010 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:05.304872 25370 raft_consensus.cc:1275] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:12:05.297927 25376 raft_consensus.cc:2468] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 7.
I20260709 13:12:05.259760 28799 raft_consensus.cc:493] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:05.350623 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:12:05.351871 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 55626.8us
I20260709 13:12:05.355266 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:12:05.359464 29010 log.cc:927] Time spent T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:12:05.260298 28832 raft_consensus.cc:515] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:05.363500 25343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:05.364436 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:05.365412 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:05.304836 28972 raft_consensus.cc:3060] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:05.368847 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:05.372293 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:12:05.372813 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 150520us
W20260709 13:12:05.373741 25872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:05.374382 25872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:05.354517 28642 raft_consensus.cc:493] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.371304 25374 raft_consensus.cc:2468] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 7.
I20260709 13:12:05.377383 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:05.377961 25907 raft_consensus.cc:3060] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:05.372932 25370 raft_consensus.cc:2468] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 6.
I20260709 13:12:05.380599 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:05.381385 25376 raft_consensus.cc:2410] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:12:05.366053 28911 raft_consensus.cc:493] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
W20260709 13:12:05.389273 25872 leader_election.cc:336] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Timed out: RequestConsensusVote RPC to 127.23.140.66:33127 timed out after 2.224s (SENT)
I20260709 13:12:05.360628 28799 raft_consensus.cc:515] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:05.350252 28809 consensus_queue.cc:1048] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:12:05.392886 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:05.393460 25270 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:05.395737 25270 leader_election.cc:304] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:05.354663 28899 raft_consensus.cc:515] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:05.402032 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:05.408437 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:05.409073 25376 raft_consensus.cc:2468] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 8.
W20260709 13:12:05.411782 25874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:05.412277 25874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:05.413617 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:05.416110 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:05.416417 25299 raft_consensus.cc:1275] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:12:05.417495 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:05.417812 25300 raft_consensus.cc:3055] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:05.418236 25300 raft_consensus.cc:740] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:05.418666 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:05.418999 25300 consensus_queue.cc:260] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:05.419963 25303 raft_consensus.cc:3055] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:05.420025 25300 raft_consensus.cc:3060] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:05.420378 25303 raft_consensus.cc:740] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:05.420981 25229 raft_consensus.cc:2468] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 11.
I20260709 13:12:05.422010 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:12:05.422596 29006 log.cc:927] Time spent T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:12:05.423158 25229 raft_consensus.cc:1240] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:05.427673 29014 raft_consensus.cc:2749] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:05.428674 29014 consensus_queue.cc:1048] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:05.429976 29005 consensus_queue.cc:1048] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:05.430274 28955 consensus_queue.cc:1048] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:05.438072 28734 raft_consensus.cc:493] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:05.438683 28734 raft_consensus.cc:515] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:05.439210 28899 leader_election.cc:290] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:05.375672 28991 raft_consensus.cc:515] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:05.441301 25223 raft_consensus.cc:2468] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 8.
I20260709 13:12:05.440651 28734 leader_election.cc:290] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:12:05.442090 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 52871.3us
I20260709 13:12:05.442517 28991 leader_election.cc:290] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:05.442679 25872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:05.443218 25301 raft_consensus.cc:2468] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 9.
I20260709 13:12:05.443557 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:05.444119 25297 raft_consensus.cc:3060] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:05.444422 28737 raft_consensus.cc:670] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } [suppressed 2 similar messages]
I20260709 13:12:05.445729 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:05.415648 28976 raft_consensus.cc:2804] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:05.447580 28976 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:05.447966 28976 raft_consensus.cc:3060] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:05.451161 28845 leader_election.cc:290] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:05.451246 28832 leader_election.cc:290] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:05.421186 25303 consensus_queue.cc:260] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:05.453372 28955 consensus_queue.cc:1059] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:05.454139 28955 consensus_queue.cc:1243] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Peer 79d99c0e498349bda74127365219e468 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:12:05.396828 28956 consensus_meta.cc:287] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.609s	user 0.012s	sys 0.000s
I20260709 13:12:05.389010 28911 raft_consensus.cc:515] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:05.455372 28956 raft_consensus.cc:515] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:05.455802 28972 raft_consensus.cc:515] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:05.457927 28961 leader_election.cc:290] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:05.458477 28961 raft_consensus.cc:493] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:05.458966 28961 raft_consensus.cc:515] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:05.422806 25370 raft_consensus.cc:2410] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:12:05.460131 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:05.461004 28961 leader_election.cc:290] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:05.461248 25374 raft_consensus.cc:2410] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:12:05.461512 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:05.461820 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:05.462221 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:05.462400 25375 raft_consensus.cc:2376] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 10. Re-sending same reply.
I20260709 13:12:05.462536 25373 raft_consensus.cc:2393] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 9: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:05.463104 28837 leader_election.cc:290] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:05.457927 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:05.385998 28978 consensus_queue.cc:260] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:05.463840 25899 raft_consensus.cc:2468] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 8.
I20260709 13:12:05.464360 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:05.464632 28978 raft_consensus.cc:3060] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:05.457989 28911 leader_election.cc:290] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:05.465190 25373 raft_consensus.cc:2468] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 7.
I20260709 13:12:05.465734 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:05.466444 25376 raft_consensus.cc:2393] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 10: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:05.467083 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:05.467975 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:05.468775 25373 raft_consensus.cc:2468] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 10.
I20260709 13:12:05.403460 28596 raft_consensus.cc:493] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.470242 28596 raft_consensus.cc:515] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:05.472448 28596 leader_election.cc:290] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:05.381872 28642 raft_consensus.cc:515] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:05.473906 25377 raft_consensus.cc:2468] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 9.
I20260709 13:12:05.474640 28642 leader_election.cc:290] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:05.477684 28956 leader_election.cc:290] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:05.478574 25226 raft_consensus.cc:2393] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 9: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:05.480059 28642 consensus_queue.cc:1048] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:05.480731 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:05.481359 25226 raft_consensus.cc:2468] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 9.
I20260709 13:12:05.481846 28972 leader_election.cc:290] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:05.482169 28717 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:05.484782 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:05.482116 25907 raft_consensus.cc:2468] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 10.
I20260709 13:12:05.492857 25378 raft_consensus.cc:2410] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 13:12:05.493388 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 80623.2us
W20260709 13:12:05.502702 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:05.502575 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:05.494961 25271 leader_election.cc:304] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:05.505914 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:05.508538 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:05.509358 25370 raft_consensus.cc:2376] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 10. Re-sending same reply.
I20260709 13:12:05.506381 25874 leader_election.cc:304] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:12:05.487149 28976 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:05.511294 28975 raft_consensus.cc:2804] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:05.511816 28975 raft_consensus.cc:697] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:05.512702 28975 consensus_queue.cc:237] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:05.515235 28781 raft_consensus.cc:493] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:05.515753 28781 raft_consensus.cc:515] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:05.516896 25300 raft_consensus.cc:1275] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:12:05.518585 28781 leader_election.cc:290] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:05.509068 25373 raft_consensus.cc:2468] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 9.
I20260709 13:12:05.520615 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:05.507406 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:05.522346 25374 raft_consensus.cc:2468] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 10.
I20260709 13:12:05.505038 25195 leader_election.cc:304] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:05.513157 28976 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:05.502285 28746 leader_election.cc:290] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:05.524482 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:05.525135 25226 raft_consensus.cc:1240] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:05.525277 25376 raft_consensus.cc:2410] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:12:05.522291 25271 leader_election.cc:304] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:05.526279 25195 leader_election.cc:304] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:12:05.552027 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:05.553117 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:05.553742 25899 raft_consensus.cc:2468] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 9.
I20260709 13:12:05.554576 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:05.555123 25900 raft_consensus.cc:2468] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 8.
I20260709 13:12:05.552625 25874 leader_election.cc:304] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:12:05.557335 25300 raft_consensus.cc:1275] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:12:05.558180 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:05.558950 25900 raft_consensus.cc:2393] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 6: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:12:05.502125 29014 consensus_queue.cc:1048] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:12:05.503615 28832 consensus_queue.cc:1048] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:12:05.522197 28991 consensus_queue.cc:1048] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:12:05.564759 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:05.569042 25374 raft_consensus.cc:2468] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 10.
I20260709 13:12:05.570236 25298 raft_consensus.cc:1275] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:12:05.508003 28690 consensus_queue.cc:1059] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:12:05.549381 29002 raft_consensus.cc:2804] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:05.549446 28717 raft_consensus.cc:2804] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:05.572561 25271 leader_election.cc:304] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:05.543548 28995 consensus_queue.cc:1059] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:12:05.620438 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:05.610818 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:05.621194 25374 raft_consensus.cc:2468] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 8.
I20260709 13:12:05.612872 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:05.623641 25373 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 6.
I20260709 13:12:05.624015 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:05.561818 28986 consensus_queue.cc:1059] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:12:05.613513 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:05.622474 28746 consensus_queue.cc:1048] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:05.613185 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:05.621109 25376 raft_consensus.cc:2468] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 6.
I20260709 13:12:05.627130 25375 raft_consensus.cc:2393] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 8: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:05.627316 25374 raft_consensus.cc:2393] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 8: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:05.629518 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:05.630245 25298 raft_consensus.cc:2468] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 11.
W20260709 13:12:05.630324 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 76953.8us
W20260709 13:12:05.631158 25195 leader_election.cc:336] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 1.622s (SENT)
I20260709 13:12:05.623194 28956 consensus_queue.cc:1048] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:12:05.564364 28781 consensus_queue.cc:1059] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:12:05.621579 29002 raft_consensus.cc:697] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 11 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:05.632108 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:05.632234 25195 leader_election.cc:304] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:05.634207 25370 raft_consensus.cc:2468] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 7.
I20260709 13:12:05.663223 25373 raft_consensus.cc:2368] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 8. Current term is 9.
I20260709 13:12:05.664340 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:05.665078 25376 raft_consensus.cc:2468] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 10.
I20260709 13:12:05.663295 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:05.666786 25230 raft_consensus.cc:3060] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:12:05.675225 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 44101us
W20260709 13:12:05.792768 25343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:05.863582 25195 leader_election.cc:336] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 1.635s (SENT)
I20260709 13:12:05.778525 25194 leader_election.cc:304] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:05.772611 25372 raft_consensus.cc:1217] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 8 LEADER]: Deduplicated request from leader. Original: 3.5->[5.6-7.7]   Dedup: 5.6->[7.7-7.7]
I20260709 13:12:05.744587 25297 raft_consensus.cc:2468] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 10.
W20260709 13:12:05.747762 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 56754.8us
W20260709 13:12:05.745713 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:05.867223 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 88771.5us
W20260709 13:12:05.778402 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:05.727214 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:05.675487 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:05.742394 25373 raft_consensus.cc:1240] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 8 LEADER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:05.869098 25372 raft_consensus.cc:1240] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 8 LEADER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 7. Current term is 8. Ops: [5.6-7.7]
I20260709 13:12:05.864269 25195 leader_election.cc:304] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:05.666232 28690 raft_consensus.cc:3055] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:12:05.772415 29023 log.cc:927] Time spent T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
W20260709 13:12:05.774605 29025 log.cc:927] Time spent T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:12:05.875404 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
W20260709 13:12:05.773934 29028 log.cc:927] Time spent T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
W20260709 13:12:05.773154 29037 log.cc:927] Time spent T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
W20260709 13:12:05.745944 29026 log.cc:927] Time spent T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:12:05.675326 29001 raft_consensus.cc:2804] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:12:05.771971 29018 log.cc:927] Time spent T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.338s	user 0.003s	sys 0.000s
I20260709 13:12:05.664433 28961 raft_consensus.cc:2749] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:05.719758 28978 raft_consensus.cc:493] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.720031 28900 leader_election.cc:290] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:05.771593 29007 raft_consensus.cc:2804] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:05.745163 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:05.872601 28717 raft_consensus.cc:697] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 10 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:05.889328 25375 raft_consensus.cc:1275] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:12:05.891724 25378 raft_consensus.cc:1240] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:05.890247 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:12:05.896710 29031 log.cc:927] Time spent T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
W20260709 13:12:05.897639 29029 log.cc:927] Time spent T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
W20260709 13:12:05.887627 25195 leader_election.cc:336] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 1.763s (SENT)
I20260709 13:12:05.899974 25373 raft_consensus.cc:1240] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:05.901999 25379 raft_consensus.cc:2410] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:12:05.877858 28690 raft_consensus.cc:740] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:05.903761 25343 leader_election.cc:304] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:05.891095 29001 raft_consensus.cc:493] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:05.915474 25195 leader_election.cc:304] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:05.765844 28999 raft_consensus.cc:2804] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:05.872466 29035 raft_consensus.cc:2749] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:05.908835 29024 consensus_queue.cc:1048] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:12:05.925740 25343 leader_election.cc:304] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:05.927205 28746 raft_consensus.cc:2804] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:05.931684 25372 raft_consensus.cc:1275] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:12:05.938028 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:05.901455 29007 raft_consensus.cc:493] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:05.940493 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:05.940903 25378 raft_consensus.cc:2393] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 8: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:05.746392 29002 consensus_queue.cc:237] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:05.943106 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:05.944468 25373 raft_consensus.cc:1275] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:12:05.944842 25373 pending_rounds.cc:85] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468: Aborting all ops after (but not including) 7
W20260709 13:12:05.932169 29030 log.cc:927] Time spent T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:12:05.945254 25373 pending_rounds.cc:107] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468: Aborting uncommitted NO_OP operation due to leader change: 7.8
W20260709 13:12:05.930922 29032 log.cc:927] Time spent T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:12:05.952430 25373 raft_consensus.cc:2889] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:05.927970 28956 raft_consensus.cc:2804] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:05.961274 28956 raft_consensus.cc:493] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:05.961676 28956 raft_consensus.cc:3060] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:05.945544 29024 raft_consensus.cc:493] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.961933 28690 consensus_queue.cc:260] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:05.962707 29024 raft_consensus.cc:515] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:05.963200 28690 raft_consensus.cc:3060] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:05.924193 29001 raft_consensus.cc:3060] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:05.901013 28978 raft_consensus.cc:515] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:05.955427 29035 raft_consensus.cc:2749] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:05.956923 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:05.965734 25374 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 6.
I20260709 13:12:05.930120 28999 raft_consensus.cc:697] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:05.958078 29038 raft_consensus.cc:2749] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:12:05.959223 29034 log.cc:927] Time spent T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 13:12:05.930022 28746 raft_consensus.cc:697] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 10 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:05.968492 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:05.981243 28999 consensus_queue.cc:237] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:05.979765 25379 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 6.
I20260709 13:12:05.952657 28972 raft_consensus.cc:2749] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:12:05.998512 25271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:05.997213 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 213642us
W20260709 13:12:06.000890 25872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:06.023697 25874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:06.061264 25872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:05.965690 29007 raft_consensus.cc:3060] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:06.063630 25271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:06.067884 25271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:06.066013 25375 raft_consensus.cc:1240] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:12:06.064888 25230 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 6.
I20260709 13:12:06.092995 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:06.095177 25302 raft_consensus.cc:2393] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 6: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:06.096318 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:06.104096 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:06.104739 25370 raft_consensus.cc:2376] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 9. Re-sending same reply.
I20260709 13:12:06.107503 25303 raft_consensus.cc:3060] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:06.111753 28993 raft_consensus.cc:3055] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:06.112303 28993 raft_consensus.cc:740] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:06.117995 25303 raft_consensus.cc:1275] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:12:06.067701 28717 consensus_queue.cc:237] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:06.118496 28746 consensus_queue.cc:237] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:06.122954 29024 leader_election.cc:290] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:06.125456 28832 raft_consensus.cc:493] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:06.125834 28978 leader_election.cc:290] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:06.126107 28832 raft_consensus.cc:515] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:06.128118 28832 leader_election.cc:290] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:06.130647 25903 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50056 (request call id 689) took 1789 ms (client timeout 1760 ms). Trace:
W20260709 13:12:06.131085 25903 rpcz_store.cc:269] 0709 13:12:04.341300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:04.341440 (+   140us) service_pool.cc:224] Handling call
0709 13:12:06.130437 (+1788997us) spinlock_profiling.cc:243] Waited 862 ms on lock 0x7b540066f154. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:06.130541 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1983444224}
W20260709 13:12:06.134387 29017 log.cc:927] Time spent T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:12:06.134547 28984 raft_consensus.cc:3055] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:06.135005 28984 raft_consensus.cc:740] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:06.137084 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:06.144657 25225 raft_consensus.cc:1240] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 10. Current term is 11. Ops: []
W20260709 13:12:06.153910 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 266301us
W20260709 13:12:06.155512 25195 leader_election.cc:336] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 1.819s (SENT)
I20260709 13:12:06.155932 25195 leader_election.cc:304] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:06.158675 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:06.160449 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:06.160583 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:06.166324 29040 consensus_queue.cc:1059] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:06.168844 28975 raft_consensus.cc:493] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:06.175530 29005 raft_consensus.cc:3055] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:06.175977 29005 raft_consensus.cc:740] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:06.147392 28998 consensus_queue.cc:1048] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:12:06.177906 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:06.178516 25222 raft_consensus.cc:2468] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 8.
I20260709 13:12:06.177320 28956 raft_consensus.cc:515] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:06.185633 28694 leader_election.cc:290] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:06.178166 28984 consensus_queue.cc:260] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:06.186898 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:06.188565 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:06.189174 25227 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 6.
I20260709 13:12:06.190620 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:06.190964 25874 leader_election.cc:304] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:12:06.194588 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:06.168898 29024 raft_consensus.cc:2749] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:06.186189 28956 leader_election.cc:290] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:06.197499 25229 raft_consensus.cc:2393] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 8: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:06.192555 25195 leader_election.cc:304] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:12:06.201113 25195 leader_election.cc:304] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:06.207234 25195 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:06.213416 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:06.176798 29005 consensus_queue.cc:260] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:06.169456 28975 raft_consensus.cc:515] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:06.215013 25225 raft_consensus.cc:1240] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:06.230397 25195 leader_election.cc:304] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:06.206771 28832 raft_consensus.cc:2804] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:06.210300 29038 raft_consensus.cc:2804] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:06.215612 28971 raft_consensus.cc:2804] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:06.246059 25903 raft_consensus.cc:2410] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 13:12:06.272982 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:06.224900 28961 raft_consensus.cc:2749] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:12:06.284400 25343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:06.240756 28832 raft_consensus.cc:493] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:06.289532 25225 raft_consensus.cc:1275] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:12:06.303107 25377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36264 (request call id 1741) took 1003 ms. Trace:
I20260709 13:12:06.321383 25377 rpcz_store.cc:276] 0709 13:12:05.299322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:05.310536 (+ 11214us) service_pool.cc:224] Handling call
0709 13:12:06.302871 (+992335us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b5400306e54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:06.303026 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":235421952}
I20260709 13:12:06.270332 28971 raft_consensus.cc:493] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:06.269805 29038 raft_consensus.cc:493] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:06.278697 29005 raft_consensus.cc:3060] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:06.298980 28832 raft_consensus.cc:3060] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:06.321141 28988 raft_consensus.cc:493] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:06.286515 28900 consensus_queue.cc:1059] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
W20260709 13:12:06.339896 25195 leader_election.cc:336] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 1.503s (SENT)
I20260709 13:12:06.302014 29046 raft_consensus.cc:2804] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:12:06.349475 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 66043.2us
I20260709 13:12:06.350701 25195 leader_election.cc:304] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:06.328552 28971 raft_consensus.cc:3060] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:06.331436 29038 raft_consensus.cc:3060] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:06.349395 25371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36264 (request call id 1739) took 1085 ms. Trace:
W20260709 13:12:06.357167 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:06.325845 29001 raft_consensus.cc:515] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:06.352013 29046 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
W20260709 13:12:06.372359 25195 leader_election.cc:336] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 1.827s (SENT)
I20260709 13:12:06.374943 25195 leader_election.cc:304] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:06.356096 28717 raft_consensus.cc:2749] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:06.392887 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:06.388540 29035 raft_consensus.cc:2749] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:06.394878 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:06.395478 25300 raft_consensus.cc:3060] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:06.400712 29007 raft_consensus.cc:515] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:06.351824 28988 raft_consensus.cc:515] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:06.376888 29046 raft_consensus.cc:3060] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:06.414005 29050 log.cc:927] Time spent T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:12:06.420763 28742 raft_consensus.cc:3055] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:06.427865 28832 raft_consensus.cc:515] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:06.431074 28988 leader_election.cc:290] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:06.433954 29063 raft_consensus.cc:493] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
W20260709 13:12:06.446295 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:06.465373 29015 log.cc:927] Time spent T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 1.184s	user 0.000s	sys 0.005s
I20260709 13:12:06.467852 29014 raft_consensus.cc:493] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:06.384613 28781 consensus_queue.cc:1048] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.054s
W20260709 13:12:06.477437 29047 log.cc:927] Time spent T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
I20260709 13:12:06.480448 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:06.482297 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:06.482908 25302 raft_consensus.cc:3060] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:06.483579 29001 leader_election.cc:290] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:06.484817 29060 log.cc:927] Time spent T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:12:06.473812 29014 raft_consensus.cc:515] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:06.487779 25873 connection.cc:256] RPC call timeout handler was delayed by -1.1402109880000353s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18620000000000003s for a response
W20260709 13:12:06.488204 25873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:06.491413 29014 leader_election.cc:290] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:06.496150 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:06.496965 25297 raft_consensus.cc:2393] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 9: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:06.497777 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:06.498767 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:06.499219 25297 raft_consensus.cc:3060] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:06.481681 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:06.503129 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:06.503377 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:06.503764 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:06.504110 25296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57256 (request call id 1951) took 1033 ms. Trace:
I20260709 13:12:06.504273 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:06.504508 25296 rpcz_store.cc:276] 0709 13:12:05.470684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:06.503130 (+1032446us) service_pool.cc:224] Handling call
0709 13:12:06.504057 (+   927us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:06.504979 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:06.505301 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:06.506059 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:06.507090 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:06.508129 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:06.508010 28993 consensus_queue.cc:260] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:06.467751 28832 leader_election.cc:290] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:06.474843 29063 raft_consensus.cc:515] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:06.511672 28981 leader_election.cc:290] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:06.512782 25271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:06.505512 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:06.513676 25301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57256 (request call id 1946) took 1100 ms. Trace:
I20260709 13:12:06.514349 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:06.515444 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:06.515939 25296 raft_consensus.cc:2468] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 9.
I20260709 13:12:06.516672 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:06.517275 25296 raft_consensus.cc:2393] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 6: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:06.509539 28993 raft_consensus.cc:3060] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:06.517455 28971 raft_consensus.cc:515] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:06.520707 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:06.521209 29063 leader_election.cc:290] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:06.508725 25303 raft_consensus.cc:2468] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 7.
I20260709 13:12:06.523821 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:06.525079 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:12:06.526345 29049 log.cc:927] Time spent T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.221s	user 0.003s	sys 0.000s
I20260709 13:12:06.532409 25226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 2018) took 1057 ms. Trace:
I20260709 13:12:06.508278 29038 raft_consensus.cc:515] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:06.529372 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:06.514073 25301 rpcz_store.cc:276] 0709 13:12:05.413289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:05.413397 (+   108us) service_pool.cc:224] Handling call
0709 13:12:06.513487 (+1100090us) spinlock_profiling.cc:243] Waited 27.9 ms on lock 0x7b540018ddd4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:06.513589 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":64140032}
I20260709 13:12:06.535096 25305 raft_consensus.cc:1240] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:06.530329 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:06.536206 25305 raft_consensus.cc:1240] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 9. Current term is 10. Ops: []
W20260709 13:12:06.537212 25271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:06.438090 28975 leader_election.cc:290] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:06.543210 25297 raft_consensus.cc:2468] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 12.
I20260709 13:12:06.532833 25226 rpcz_store.cc:276] 0709 13:12:05.474611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:05.558389 (+ 83778us) service_pool.cc:224] Handling call
0709 13:12:05.558685 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:05.568456 (+  9771us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:05.568487 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:05.962653 (+394166us) spinlock_profiling.cc:243] Waited 4.37 ms on lock 0x7b2c000014c8. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72e568a11 00007fd72e578372 00007fd72fcaaa01 00007fd72fc6f43a 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2
0709 13:12:05.963111 (+   458us) log.cc:844] Serialized 26 byte log entry
0709 13:12:06.151574 (+188463us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:06.151617 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:06.151690 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:06.525796 (+374106us) spinlock_profiling.cc:243] Waited 5.46 ms on lock 0x7b4400022b4c. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72caa8c85 00007fd72caa96a2 00007fd72f81b1db 00007fd72f816aaf 00007fd72f80a86e 00007fd72f809bb6 00007fd72f8097d8 00007fd72f813221 00007fd72f8131d9 00007fd72f813169
0709 13:12:06.532201 (+  6405us) raft_consensus.cc:1685] finished
0709 13:12:06.532223 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:06.532354 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11277,"raft.queue_time_us":11429,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":32202,"spinlock_wait_cycles":22614144,"thread_start_us":188065,"threads_started":1,"wal-append.queue_time_us":260114}
W20260709 13:12:06.547247 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 174912us
W20260709 13:12:06.548785 25195 leader_election.cc:336] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 1.901s (SENT)
I20260709 13:12:06.550570 25302 raft_consensus.cc:2468] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 9.
I20260709 13:12:06.549355 25195 leader_election.cc:304] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:06.551717 25194 leader_election.cc:304] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:06.532433 28799 leader_election.cc:290] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:06.553126 28911 raft_consensus.cc:2804] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:06.553648 28911 raft_consensus.cc:697] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 9 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:06.554708 29038 leader_election.cc:290] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:06.554893 28911 consensus_queue.cc:237] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:06.439551 28742 raft_consensus.cc:740] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:06.551829 28961 raft_consensus.cc:2749] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:12:06.559851 25271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:06.561856 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:06.562665 25305 raft_consensus.cc:2393] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 9: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
W20260709 13:12:06.567682 25195 leader_election.cc:336] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 1.983s (SENT)
I20260709 13:12:06.570019 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:06.570603 25901 raft_consensus.cc:3060] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:12:06.571940 25303 raft_consensus.cc:1275] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:12:06.576336 25344 leader_election.cc:304] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:06.567173 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:06.578349 25296 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 6.
W20260709 13:12:06.593451 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:06.593672 25300 raft_consensus.cc:2468] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 12.
I20260709 13:12:06.597548 25901 raft_consensus.cc:2468] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 9.
I20260709 13:12:06.605825 25904 raft_consensus.cc:1275] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:12:06.568719 28746 raft_consensus.cc:493] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
W20260709 13:12:06.619084 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 51422.1us
W20260709 13:12:06.620422 25195 leader_election.cc:336] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 2.144s (SENT)
W20260709 13:12:06.624861 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 48675.7us
I20260709 13:12:06.625128 25195 leader_election.cc:304] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:06.626554 25874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:06.614569 28971 leader_election.cc:290] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:06.630676 25270 connection.cc:256] RPC call timeout handler was delayed by -1.7228550160000395s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1605s for a response
W20260709 13:12:06.623210 29065 log.cc:927] Time spent T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
W20260709 13:12:06.632311 25270 connection.cc:256] RPC call timeout handler was delayed by -1.6346550160000106s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1703s for a response
W20260709 13:12:06.633711 25270 connection.cc:256] RPC call timeout handler was delayed by -1.6247550159999946s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1714s for a response
W20260709 13:12:06.634080 25270 connection.cc:256] RPC call timeout handler was delayed by -1.5023550160000241s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18500000000000003s for a response
W20260709 13:12:06.634370 25270 connection.cc:256] RPC call timeout handler was delayed by -1.4141550159999952s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1948s for a response
W20260709 13:12:06.634672 25270 connection.cc:256] RPC call timeout handler was delayed by -1.4132550159999937s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19490000000000002s for a response
W20260709 13:12:06.635632 25195 leader_election.cc:336] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 2.188s (SENT)
I20260709 13:12:06.636605 25195 leader_election.cc:304] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:06.616675 28746 raft_consensus.cc:515] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:06.637682 28961 raft_consensus.cc:493] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:06.649024 25270 leader_election.cc:304] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:12:06.628710 29068 raft_consensus.cc:2749] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:12:06.656296 25874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:06.653117 28961 raft_consensus.cc:515] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:06.687287 28746 leader_election.cc:290] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:06.648231 28596 raft_consensus.cc:2804] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:06.695426 28596 raft_consensus.cc:493] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:06.695823 28596 raft_consensus.cc:3060] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:06.647269 28911 raft_consensus.cc:2749] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:12:06.699743 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 64155.5us
I20260709 13:12:06.701692 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:06.702379 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:06.703058 25372 raft_consensus.cc:2468] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 10.
I20260709 13:12:06.705936 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:06.706635 25226 raft_consensus.cc:2468] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 10.
W20260709 13:12:06.707425 29070 log.cc:927] Time spent T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:12:06.707856 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:06.708468 25228 raft_consensus.cc:3060] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:06.709728 29024 raft_consensus.cc:493] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:06.355405 25371 rpcz_store.cc:276] 0709 13:12:05.263730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:05.263911 (+   181us) service_pool.cc:224] Handling call
0709 13:12:05.285252 (+ 21341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:05.349297 (+ 64045us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:12:05.370072 (+ 20775us) log.cc:844] Serialized 14 byte log entry
0709 13:12:06.101204 (+731132us) spinlock_profiling.cc:243] Waited 2.87 ms on lock 0x7b180034afe0. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72cb64e07 00007fd7359bfab9 00007fd72cb8169b 00007fd72cb7f93f 00007fd72cb81c02 00007fd72f80920b 00007fd72f80ed23 00007fd72f80f23a 00007fd72fc79a2a
0709 13:12:06.348927 (+247723us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:06.348998 (+    71us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:06.349059 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:06.349142 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:06.349317 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5214,"prepare.queue_time_us":19076,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":3886,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":3710,"spinlock_wait_cycles":6602624,"thread_start_us":237649,"threads_started":1,"wal-append.queue_time_us":973463}
I20260709 13:12:06.710429 29024 raft_consensus.cc:515] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:06.714659 29024 leader_election.cc:290] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:06.716028 25376 raft_consensus.cc:1240] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 10. Current term is 11. Ops: []
W20260709 13:12:06.718070 25872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:06.718856 25872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:06.719288 25271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:06.721026 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:06.725186 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:06.726830 29007 leader_election.cc:290] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:06.716086 29059 log.cc:927] Time spent T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.306s	user 0.001s	sys 0.000s
I20260709 13:12:06.732864 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:06.733842 25906 raft_consensus.cc:2410] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:12:06.735433 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:06.737165 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:06.738166 25901 raft_consensus.cc:2393] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 6: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:12:06.740298 25224 raft_consensus.cc:1275] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:12:06.740530 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:06.741168 25900 raft_consensus.cc:2468] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 9.
I20260709 13:12:06.746869 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:06.747085 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:06.747581 25227 raft_consensus.cc:2468] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 8.
I20260709 13:12:06.748111 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:06.748705 25904 raft_consensus.cc:2468] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 8.
I20260709 13:12:06.749707 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:06.752475 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:06.753520 25222 raft_consensus.cc:2468] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 9.
I20260709 13:12:06.757058 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:06.758280 25226 raft_consensus.cc:1275] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:12:06.758425 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:06.757738 25224 raft_consensus.cc:2468] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 7.
W20260709 13:12:06.760772 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:06.770208 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 144542us
I20260709 13:12:06.784281 25344 leader_election.cc:304] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:06.787647 29075 log.cc:927] Time spent T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 13:12:06.790807 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:06.791218 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:06.792707 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:06.793641 25227 raft_consensus.cc:2468] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 8.
I20260709 13:12:06.795562 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:06.796497 25227 raft_consensus.cc:2468] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 8.
I20260709 13:12:06.790156 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:06.790446 25874 leader_election.cc:304] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:12:06.800964 25874 leader_election.cc:304] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:12:06.805099 25228 raft_consensus.cc:2468] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 10.
I20260709 13:12:06.813103 25906 raft_consensus.cc:2368] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 9. Current term is 10.
I20260709 13:12:06.655942 29046 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:06.812916 28975 raft_consensus.cc:2804] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:06.819903 28975 raft_consensus.cc:493] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:06.820354 28975 raft_consensus.cc:3060] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:06.820650 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:06.825589 28971 raft_consensus.cc:493] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:06.828099 25195 leader_election.cc:304] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:06.826288 28971 raft_consensus.cc:515] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:06.839722 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:06.841629 25906 raft_consensus.cc:3060] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:06.849705 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:06.853330 25298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57256 (request call id 1959) took 1234 ms. Trace:
I20260709 13:12:06.858405 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:06.855455 25298 rpcz_store.cc:276] 0709 13:12:05.618725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:05.875300 (+256575us) service_pool.cc:224] Handling call
0709 13:12:05.879347 (+  4047us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:05.990133 (+110786us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:05.990182 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:06.073548 (+ 83366us) log.cc:844] Serialized 26 byte log entry
0709 13:12:06.243714 (+170166us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:06.243775 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:06.852885 (+609110us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b54000f8a54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:06.852942 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:06.852999 (+    57us) raft_consensus.cc:1685] finished
0709 13:12:06.853014 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:06.853259 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":357,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":75920,"spinlock_wait_cycles":253698432,"thread_start_us":152281,"threads_started":1,"wal-append.queue_time_us":254083}
I20260709 13:12:06.854522 28746 raft_consensus.cc:2804] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:06.873965 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:06.874575 25379 raft_consensus.cc:3060] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:06.874644 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 228623us
I20260709 13:12:06.855871 28993 raft_consensus.cc:2804] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:12:06.875934 25873 leader_election.cc:336] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 1.862s (SENT)
I20260709 13:12:06.867014 28690 raft_consensus.cc:493] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:06.886194 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:12:06.887151 25872 leader_election.cc:336] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Timed out: RequestConsensusVote RPC to 127.23.140.66:33127 timed out after 1.629s (SENT)
I20260709 13:12:06.871712 29063 raft_consensus.cc:493] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:06.857626 28832 consensus_queue.cc:1048] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:12:06.878474 28993 raft_consensus.cc:493] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
W20260709 13:12:06.913214 25873 leader_election.cc:336] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 1.537s (SENT)
I20260709 13:12:06.919230 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:06.889997 28999 raft_consensus.cc:493] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:06.895956 28690 raft_consensus.cc:515] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:06.917517 28993 raft_consensus.cc:3060] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:06.938858 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:06.945583 25271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:06.950066 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:06.953053 25371 raft_consensus.cc:1240] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 10 LEADER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:06.949414 28549 raft_consensus.cc:493] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:06.956624 25345 leader_election.cc:304] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:06.956965 28549 raft_consensus.cc:515] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:06.913033 29063 raft_consensus.cc:515] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:06.962749 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:06.967526 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:06.970932 28549 leader_election.cc:290] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:06.931747 28999 raft_consensus.cc:515] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:06.994481 25872 leader_election.cc:336] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Timed out: RequestConsensusVote RPC to 127.23.140.66:33127 timed out after 1.930s (SENT)
I20260709 13:12:07.021142 25872 leader_election.cc:304] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:07.023141 25874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:07.024916 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:07.026901 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:06.973209 28742 consensus_queue.cc:260] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:07.020761 29067 raft_consensus.cc:493] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:06.972820 28746 raft_consensus.cc:697] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 9 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:07.034441 25374 raft_consensus.cc:1240] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 9. Current term is 10. Ops: []
W20260709 13:12:07.062402 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 234422us
I20260709 13:12:07.027951 29091 raft_consensus.cc:2749] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:07.043118 28971 leader_election.cc:290] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:07.042871 29067 raft_consensus.cc:515] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:07.036003 29083 log.cc:927] Time spent T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260709 13:12:07.030081 29072 log.cc:927] Time spent T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.386s	user 0.005s	sys 0.000s
W20260709 13:12:07.137389 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:07.076654 25271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:06.971392 29076 consensus_queue.cc:1048] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.196s
I20260709 13:12:07.024202 29046 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:07.187466 25271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:07.187350 25379 raft_consensus.cc:2468] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 11.
I20260709 13:12:07.030344 28690 leader_election.cc:290] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:07.188951 25872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:07.222173 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 409851us
I20260709 13:12:07.225528 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:07.226549 25303 raft_consensus.cc:2393] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 10: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
W20260709 13:12:07.236322 25872 leader_election.cc:336] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Timed out: RequestConsensusVote RPC to 127.23.140.66:33127 timed out after 2.019s (SENT)
I20260709 13:12:07.051932 25906 raft_consensus.cc:2468] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 9.
I20260709 13:12:07.190587 28981 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.190699 28717 raft_consensus.cc:493] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:07.190779 29077 raft_consensus.cc:493] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.187361 28972 raft_consensus.cc:2749] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:12:07.199316 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 136053us
I20260709 13:12:07.034770 29092 raft_consensus.cc:493] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.201448 28961 leader_election.cc:290] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:07.201686 28746 consensus_queue.cc:237] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:07.037053 29086 raft_consensus.cc:2804] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:12:07.266307 25874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:07.179838 29091 raft_consensus.cc:493] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.040966 28596 raft_consensus.cc:515] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:07.199958 29068 consensus_queue.cc:1048] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:07.275857 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:12:07.287253 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 330689us
I20260709 13:12:07.289605 25195 leader_election.cc:304] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:07.289860 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:07.293409 25900 raft_consensus.cc:1275] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:12:07.302062 25345 leader_election.cc:304] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:07.294402 29081 log.cc:927] Time spent T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:12:07.315852 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:07.320242 25372 raft_consensus.cc:2468] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 9.
I20260709 13:12:07.322218 25195 leader_election.cc:304] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
W20260709 13:12:07.322690 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:07.323385 25872 leader_election.cc:336] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Timed out: RequestConsensusVote RPC to 127.23.140.66:33127 timed out after 2.101s (SENT)
I20260709 13:12:07.323777 25195 leader_election.cc:304] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:07.325623 25872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:07.325662 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:07.296097 29086 raft_consensus.cc:493] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:07.274895 28981 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:07.312489 28961 raft_consensus.cc:2764] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
W20260709 13:12:07.342724 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:07.330193 28975 consensus_meta.cc:287] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent flushing consensus metadata: real 0.509s	user 0.011s	sys 0.001s
I20260709 13:12:07.274115 29077 raft_consensus.cc:515] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:07.300480 29092 raft_consensus.cc:515] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:07.408550 25378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56308 (request call id 598) took 1588 ms. Trace:
I20260709 13:12:07.305312 29091 raft_consensus.cc:515] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:07.409000 25378 rpcz_store.cc:276] 0709 13:12:05.820333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:05.954561 (+134228us) service_pool.cc:224] Handling call
0709 13:12:05.975720 (+ 21159us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:06.063319 (+ 87599us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:12:06.075669 (+ 12350us) log.cc:844] Serialized 14 byte log entry
0709 13:12:07.079675 (+1004006us) spinlock_profiling.cc:243] Waited 3.12 ms on lock 0x7b18001a4b20. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72cb64e07 00007fd7359bfab9 00007fd72cb8169b 00007fd72cb7f93f 00007fd72cb81c02 00007fd72f80920b 00007fd72f80ed23 00007fd72f80f23a 00007fd72fc79a2a
0709 13:12:07.314299 (+234624us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:07.332611 (+ 18312us) log.cc:844] Serialized 26 byte log entry
0709 13:12:07.332761 (+   150us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:07.333011 (+   250us) log.cc:844] Serialized 14 byte log entry
0709 13:12:07.382708 (+ 49697us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:07.382782 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:07.408339 (+ 25557us) raft_consensus.cc:1685] finished
0709 13:12:07.408360 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:07.408487 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":117171,"prepare.queue_time_us":16300,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":78070,"raft.run_cpu_time_us":362,"raft.run_wall_time_us":84553,"spinlock_wait_cycles":14444032,"thread_start_us":212015,"threads_started":1,"wal-append.queue_time_us":1314707}
I20260709 13:12:07.293514 28717 raft_consensus.cc:515] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:07.331595 28972 raft_consensus.cc:2764] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:12:07.407985 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:07.400789 25903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50056 (request call id 700) took 1210 ms. Trace:
I20260709 13:12:07.347988 25301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57256 (request call id 1963) took 1062 ms. Trace:
I20260709 13:12:07.348388 25345 leader_election.cc:304] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:07.388335 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
W20260709 13:12:07.523939 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 200070us
I20260709 13:12:07.337294 29086 raft_consensus.cc:3060] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:07.521598 25903 rpcz_store.cc:276] 0709 13:12:06.190155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:06.190300 (+   145us) service_pool.cc:224] Handling call
0709 13:12:07.400548 (+1210248us) spinlock_profiling.cc:243] Waited 54.3 ms on lock 0x7b5400710f54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:07.400723 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":124939648}
I20260709 13:12:07.544260 28911 raft_consensus.cc:493] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.340869 29046 raft_consensus.cc:2749] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:07.498718 25372 raft_consensus.cc:2468] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 8.
I20260709 13:12:07.544873 28911 raft_consensus.cc:515] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:07.548138 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:12:07.398568 29089 log.cc:927] Time spent T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:12:07.552300 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
W20260709 13:12:07.378708 29093 log.cc:927] Time spent T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:12:07.378993 28596 leader_election.cc:290] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:07.553920 25227 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 7.
I20260709 13:12:07.375147 28999 leader_election.cc:290] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:07.375764 28981 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:07.586879 25376 raft_consensus.cc:1275] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:12:07.459942 28975 raft_consensus.cc:515] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:07.590638 25902 raft_consensus.cc:1240] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:07.591634 28975 leader_election.cc:290] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:07.595696 28993 consensus_meta.cc:287] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent flushing consensus metadata: real 0.641s	user 0.004s	sys 0.005s
I20260709 13:12:07.596349 28993 raft_consensus.cc:515] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:07.559353 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:07.396319 28984 raft_consensus.cc:3060] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:07.599788 25224 raft_consensus.cc:3060] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:07.611496 28717 leader_election.cc:290] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:07.613865 29077 leader_election.cc:290] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:07.615942 29092 leader_election.cc:290] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:07.553839 29091 leader_election.cc:290] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:07.551292 29024 raft_consensus.cc:493] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:07.617738 29024 raft_consensus.cc:515] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:07.622516 28694 consensus_queue.cc:1048] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:12:07.651652 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:07.654879 25224 raft_consensus.cc:2468] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 11.
I20260709 13:12:07.382143 29095 raft_consensus.cc:2804] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:07.389735 29067 leader_election.cc:290] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:07.576742 25371 raft_consensus.cc:1240] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 9 LEADER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:07.586249 29088 raft_consensus.cc:2804] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:12:07.596906 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:07.799943 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 1.15091e+06us
W20260709 13:12:07.755102 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 274549us
I20260709 13:12:07.520917 25301 rpcz_store.cc:276] 0709 13:12:06.285362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:06.534106 (+248744us) service_pool.cc:224] Handling call
0709 13:12:06.534773 (+   667us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:06.535132 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:06.535160 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:06.544379 (+  9219us) log.cc:844] Serialized 26 byte log entry
0709 13:12:06.608801 (+ 64422us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:06.623217 (+ 14416us) log.cc:844] Serialized 14 byte log entry
0709 13:12:06.629923 (+  6706us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:06.629997 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:06.725138 (+ 95141us) spinlock_profiling.cc:243] Waited 2.28 ms on lock 0x7b180031f4e0. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72cb82522 00007fd72cb847c1 00007fd72cb84779 00007fd72cb84709 00007fd72cb846d1 00007fd72cb839cd 000000000038f354 000000000038f199 00007fd72cb6583a
0709 13:12:07.029515 (+304377us) spinlock_profiling.cc:243] Waited 7.28 ms on lock 0x7b4400022b4c. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72caa8c85 00007fd72caa96a2 00007fd72f81b1db 00007fd72f816aaf 00007fd72f80a86e 00007fd72f809bb6 00007fd72f8097d8 00007fd72f813221 00007fd72f8131d9 00007fd72f813169
0709 13:12:07.347639 (+318124us) raft_consensus.cc:1685] finished
0709 13:12:07.347661 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:07.347917 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18526,"prepare.queue_time_us":14225,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":1741,"raft.queue_time_us":16118,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":3659,"spinlock_wait_cycles":60140928,"thread_start_us":50400,"threads_started":1,"wal-append.queue_time_us":85280}
I20260709 13:12:07.808138 25343 leader_election.cc:304] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:12:07.807217 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 459020us
I20260709 13:12:07.817265 25296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57256 (request call id 1964) took 1096 ms. Trace:
W20260709 13:12:07.818383 25873 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.898s	user 0.008s	sys 0.030s
I20260709 13:12:07.818332 25343 leader_election.cc:304] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:12:07.820135 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:07.817777 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 277450us
I20260709 13:12:07.822957 25195 leader_election.cc:304] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:07.818920 25873 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.899s	user 0.009s	sys 0.030s
I20260709 13:12:07.824913 25195 leader_election.cc:304] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:07.824654 25345 leader_election.cc:304] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:07.825552 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:07.798991 28986 raft_consensus.cc:2764] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:12:07.818822 25296 rpcz_store.cc:276] 0709 13:12:06.720389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:06.720506 (+   117us) service_pool.cc:224] Handling call
0709 13:12:06.720828 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:06.721037 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:12:06.721318 (+   281us) log.cc:844] Serialized 14 byte log entry
0709 13:12:07.816887 (+1095569us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:07.816940 (+    53us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:07.817008 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:07.817076 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:07.817203 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1095340,"prepare.queue_time_us":687,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":41}
W20260709 13:12:07.842598 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 922474us
I20260709 13:12:07.844946 25229 raft_consensus.cc:3060] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:07.912293 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 87600.1us
W20260709 13:12:07.979225 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:08.010381 25195 leader_election.cc:304] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:07.807585 29088 raft_consensus.cc:493] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:08.023461 25225 raft_consensus.cc:1275] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:12:07.800655 28717 raft_consensus.cc:493] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
W20260709 13:12:07.929265 25343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:07.817643 28993 leader_election.cc:290] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 9 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:07.792683 29095 raft_consensus.cc:493] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
W20260709 13:12:08.011687 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:07.838030 29092 raft_consensus.cc:2804] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:07.844981 29038 raft_consensus.cc:2804] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:12:08.070818 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:07.823549 28972 raft_consensus.cc:493] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:07.908128 28746 raft_consensus.cc:2804] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:07.946805 29008 raft_consensus.cc:493] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.100594 25300 raft_consensus.cc:1275] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:12:08.108467 25300 pending_rounds.cc:85] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19: Aborting all ops after (but not including) 8
I20260709 13:12:08.108829 25300 pending_rounds.cc:107] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:12:08.109176 25300 raft_consensus.cc:2889] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:08.026250 29088 raft_consensus.cc:3060] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:07.906418 29068 raft_consensus.cc:2804] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:07.958226 29024 leader_election.cc:290] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:08.117815 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 293359us
I20260709 13:12:07.903787 28961 raft_consensus.cc:493] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:08.042448 29095 raft_consensus.cc:3060] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:08.147958 25345 leader_election.cc:304] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:08.158703 25345 leader_election.cc:304] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:08.105019 29038 raft_consensus.cc:493] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:08.090086 29092 raft_consensus.cc:493] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:08.089679 28975 raft_consensus.cc:493] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
W20260709 13:12:08.130424 28781 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.017s	sys 0.066s
I20260709 13:12:08.038195 29091 consensus_queue.cc:1048] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.106s
I20260709 13:12:08.120708 28596 raft_consensus.cc:2804] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:08.068619 28717 raft_consensus.cc:515] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:08.107402 29067 consensus_queue.cc:1059] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
W20260709 13:12:08.193423 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 392722us
I20260709 13:12:08.194754 25229 raft_consensus.cc:2468] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 10.
I20260709 13:12:08.153831 28993 consensus_queue.cc:1048] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
W20260709 13:12:08.170115 28781 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.018s	sys 0.067s
I20260709 13:12:08.199849 25270 leader_election.cc:304] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:08.131646 29008 raft_consensus.cc:515] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:08.165483 29038 raft_consensus.cc:3060] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:08.168351 29092 raft_consensus.cc:3060] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:08.172268 28596 raft_consensus.cc:493] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:08.163925 28911 leader_election.cc:290] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:08.206673 25270 leader_election.cc:304] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:12:08.163522 28972 raft_consensus.cc:515] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:08.171948 28975 raft_consensus.cc:515] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:08.171074 28961 raft_consensus.cc:515] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:08.164600 29110 consensus_queue.cc:1048] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.074s
I20260709 13:12:08.208902 29104 raft_consensus.cc:2749] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:12:08.259763 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 249449us
I20260709 13:12:08.228595 29076 raft_consensus.cc:2749] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:08.227160 28986 raft_consensus.cc:493] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
W20260709 13:12:08.272212 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:08.230711 28984 raft_consensus.cc:2749] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:12:08.250048 29086 consensus_meta.cc:287] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.674s	user 0.010s	sys 0.000s
W20260709 13:12:08.290729 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 59013.1us
I20260709 13:12:08.145901 29068 raft_consensus.cc:493] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
W20260709 13:12:08.305087 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:08.162999 29024 raft_consensus.cc:2749] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:08.229178 28596 raft_consensus.cc:3060] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:08.263391 29013 raft_consensus.cc:2804] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:12:08.395783 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:08.264062 25195 leader_election.cc:304] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:08.400060 25270 leader_election.cc:400] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 election: Vote denied by peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085) with higher term. Message: Invalid argument: T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for earlier term 11. Current term is 12.
I20260709 13:12:08.400518 25270 leader_election.cc:403] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:12:08.260423 28911 raft_consensus.cc:493] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:08.404635 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 140655us
I20260709 13:12:08.408346 25195 leader_election.cc:304] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:08.372172 29068 raft_consensus.cc:3060] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:08.405007 28694 raft_consensus.cc:2749] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085) with higher term. Message: Invalid argument: T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for earlier term 11. Current term is 12.
I20260709 13:12:08.408896 25270 leader_election.cc:304] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:08.410825 25195 leader_election.cc:304] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:08.413419 25375 consensus_meta.cc:287] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.874s	user 0.007s	sys 0.002s
I20260709 13:12:08.417346 25375 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 6.
I20260709 13:12:08.394595 29013 raft_consensus.cc:493] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:08.417977 25375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36254 (request call id 2091) took 1096 ms. Trace:
I20260709 13:12:08.419452 25375 rpcz_store.cc:276] 0709 13:12:07.321357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:07.388074 (+ 66717us) service_pool.cc:224] Handling call
0709 13:12:08.417909 (+1029835us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:08.403595 28984 raft_consensus.cc:493] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.372459 28986 raft_consensus.cc:515] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:08.423080 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 302843us
I20260709 13:12:08.404965 29024 raft_consensus.cc:2764] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
W20260709 13:12:08.404492 29004 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.779s	user 0.026s	sys 0.106s
I20260709 13:12:08.378780 29086 raft_consensus.cc:515] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:08.462608 25873 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
W20260709 13:12:08.434214 29113 log.cc:927] Time spent T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.208s	user 0.001s	sys 0.001s
W20260709 13:12:08.430285 29107 log.cc:927] Time spent T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
W20260709 13:12:08.429679 29114 log.cc:927] Time spent T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
I20260709 13:12:08.433645 28961 leader_election.cc:290] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:08.432446 28975 leader_election.cc:290] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:08.421324 29013 raft_consensus.cc:3060] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:08.424068 28955 raft_consensus.cc:2804] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:12:08.464128 29004 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.838s	user 0.026s	sys 0.107s
I20260709 13:12:08.419301 28911 raft_consensus.cc:515] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:08.469843 29024 raft_consensus.cc:2804] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:08.484520 29024 raft_consensus.cc:493] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:08.485038 29024 raft_consensus.cc:3060] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:08.471128 29110 raft_consensus.cc:2804] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:08.431192 29095 raft_consensus.cc:515] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:08.471380 28746 raft_consensus.cc:697] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 12 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:08.480312 28955 raft_consensus.cc:493] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:08.504920 28955 raft_consensus.cc:3060] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:08.520044 25372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36254 (request call id 2089) took 1210 ms. Trace:
I20260709 13:12:08.520474 25372 rpcz_store.cc:276] 0709 13:12:07.310052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:07.325332 (+ 15280us) service_pool.cc:224] Handling call
0709 13:12:08.519868 (+1194536us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b54002882d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:08.519984 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":394295552}
I20260709 13:12:08.522296 25224 raft_consensus.cc:1240] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:08.528327 25378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36254 (request call id 2090) took 1209 ms. Trace:
I20260709 13:12:08.528792 25378 rpcz_store.cc:276] 0709 13:12:07.319003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:07.410952 (+ 91949us) service_pool.cc:224] Handling call
0709 13:12:07.411289 (+   337us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:07.520120 (+108831us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:07.520153 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:07.546296 (+ 26143us) log.cc:844] Serialized 52 byte log entry
0709 13:12:07.843873 (+297577us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:07.999603 (+155730us) log.cc:844] Serialized 14 byte log entry
0709 13:12:07.999920 (+   317us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:08.000041 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:08.528097 (+528056us) raft_consensus.cc:1685] finished
0709 13:12:08.528118 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:08.528268 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":70310,"prepare.queue_time_us":154670,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":139377,"raft.run_cpu_time_us":333,"raft.run_wall_time_us":69909,"thread_start_us":246225,"threads_started":1,"wal-append.queue_time_us":611745}
I20260709 13:12:08.491611 29110 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:08.531631 29110 raft_consensus.cc:3060] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:08.535044 28911 leader_election.cc:290] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:08.535730 28972 leader_election.cc:290] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:08.487712 29115 raft_consensus.cc:2804] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:08.536432 29115 raft_consensus.cc:493] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:08.536839 29115 raft_consensus.cc:3060] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:12:08.538223 29108 log.cc:927] Time spent T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.936s	user 0.002s	sys 0.015s
I20260709 13:12:08.539669 28717 leader_election.cc:290] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:08.541118 29086 leader_election.cc:290] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:08.542119 28746 consensus_queue.cc:237] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:08.543994 29109 log.cc:927] Time spent T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.941s	user 0.009s	sys 0.007s
I20260709 13:12:08.547231 25902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50060 (request call id 640) took 1975 ms. Trace:
I20260709 13:12:08.547766 25902 rpcz_store.cc:276] 0709 13:12:06.571322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:06.571464 (+   142us) service_pool.cc:224] Handling call
0709 13:12:07.403210 (+831746us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:07.591043 (+187833us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:08.545700 (+954657us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b5400710f54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:08.546909 (+  1209us) spinlock_profiling.cc:243] Waited 810 ms on lock 0x7b5400710f50. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6e8ad 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:08.547118 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2294065280}
W20260709 13:12:08.549091 25343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:08.549837 29008 leader_election.cc:290] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:08.551323 28986 leader_election.cc:290] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:08.552174 25374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36254 (request call id 2084) took 1471 ms. Trace:
I20260709 13:12:08.552568 25374 rpcz_store.cc:276] 0709 13:12:07.080980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:07.190243 (+109263us) service_pool.cc:224] Handling call
0709 13:12:07.190629 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:07.222271 (+ 31642us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:07.222311 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:07.266231 (+ 43920us) log.cc:844] Serialized 26 byte log entry
0709 13:12:07.550513 (+284282us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:07.550549 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:07.550615 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:08.551979 (+1001364us) raft_consensus.cc:1685] finished
0709 13:12:08.551997 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:08.552119 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45201,"raft.queue_time_us":105375,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":17919,"thread_start_us":211678,"threads_started":1,"wal-append.queue_time_us":886069}
I20260709 13:12:08.550067 28955 raft_consensus.cc:515] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:08.542510 25300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57272 (request call id 1835) took 1934 ms. Trace:
I20260709 13:12:08.558888 25300 rpcz_store.cc:276] 0709 13:12:06.608369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:06.615009 (+  6640us) service_pool.cc:224] Handling call
0709 13:12:06.629740 (+ 14731us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:08.130775 (+1501035us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:08.542195 (+411420us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b54002fb054. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:08.542432 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3381628672}
I20260709 13:12:08.566309 25379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36254 (request call id 2085) took 1346 ms. Trace:
I20260709 13:12:08.468178 28984 raft_consensus.cc:515] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:08.566875 25379 rpcz_store.cc:276] 0709 13:12:07.219911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:07.220750 (+   839us) service_pool.cc:224] Handling call
0709 13:12:07.221106 (+   356us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:07.290300 (+ 69194us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:12:07.303175 (+ 12875us) log.cc:844] Serialized 14 byte log entry
0709 13:12:07.542016 (+238841us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:07.557246 (+ 15230us) log.cc:844] Serialized 52 byte log entry
0709 13:12:07.557492 (+   246us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:07.558675 (+  1183us) log.cc:844] Serialized 14 byte log entry
0709 13:12:07.755906 (+197231us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:07.756012 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:08.537396 (+781384us) spinlock_profiling.cc:243] Waited 3.46 ms on lock 0x7b4400022b4c. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72caa8c85 00007fd72caa96a2 00007fd72f81b1db 00007fd72f816aaf 00007fd72f80a86e 00007fd72f809bb6 00007fd72f8097d8 00007fd72f813221 00007fd72f8131d9 00007fd72f813169
0709 13:12:08.565968 (+ 28572us) raft_consensus.cc:1685] finished
0709 13:12:08.566007 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:08.566226 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":273856,"prepare.queue_time_us":13417,"prepare.run_cpu_time_us":143,"prepare.run_wall_time_us":4973,"raft.queue_time_us":278934,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":15352,"spinlock_wait_cycles":15944960,"thread_start_us":180394,"threads_started":1,"wal-append.queue_time_us":282378}
W20260709 13:12:08.574079 25872 leader_election.cc:336] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Timed out: RequestConsensusVote RPC to 127.23.140.66:33127 timed out after 1.710s (SENT)
W20260709 13:12:08.575313 25872 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.140.66:33127 timed out after 2.717s (SENT) [suppressed 30 similar messages]
I20260709 13:12:08.536813 29095 leader_election.cc:290] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:08.581698 29063 leader_election.cc:290] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:08.593495 25230 raft_consensus.cc:1275] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:12:08.594353 25230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 2047) took 1001 ms. Trace:
I20260709 13:12:08.594743 25230 rpcz_store.cc:276] 0709 13:12:07.593054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:07.593883 (+   829us) service_pool.cc:224] Handling call
0709 13:12:08.592791 (+998908us) spinlock_profiling.cc:243] Waited 1.61 ms on lock 0x7b5800002a98. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72cb4ab71 00007fd72cb4aa22 00007fd735a63c09 00007fd734bbdee0 00007fd734c870ab 00007fd734c87131 00007fd734c48fc0 00007fd734c33929 00007fd734c333d2 00007fd72e1aabd4
0709 13:12:08.593057 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:08.594040 (+   983us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:08.594284 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3704064}
I20260709 13:12:08.600436 25223 raft_consensus.cc:1240] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 8. Current term is 9. Ops: []
W20260709 13:12:08.600684 29112 log.cc:927] Time spent T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.492s	user 0.000s	sys 0.005s
I20260709 13:12:08.601289 25223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 2048) took 1008 ms. Trace:
I20260709 13:12:08.601706 25223 rpcz_store.cc:276] 0709 13:12:07.593321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:07.610231 (+ 16910us) service_pool.cc:224] Handling call
0709 13:12:08.599928 (+989697us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b5800002a98. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72cb4ab71 00007fd72cb4aa22 00007fd735a63c09 00007fd734bbdee0 00007fd734c870ab 00007fd734c87131 00007fd734c48fc0 00007fd734c33929 00007fd734c333d2 00007fd72e1aabd4
0709 13:12:08.600173 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:08.601000 (+   827us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:08.601222 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36523904}
I20260709 13:12:08.602355 25370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36254 (request call id 2087) took 1313 ms. Trace:
I20260709 13:12:08.602883 25370 rpcz_store.cc:276] 0709 13:12:07.288566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:07.310521 (+ 21955us) service_pool.cc:224] Handling call
0709 13:12:07.328847 (+ 18326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:07.329126 (+   279us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:07.329163 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:07.329775 (+   612us) log.cc:844] Serialized 26 byte log entry
0709 13:12:07.559195 (+229420us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:07.559234 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:07.559299 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:08.599983 (+1040684us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b4400022b4c. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72caa8c85 00007fd72caa96a2 00007fd72f81b1db 00007fd72f816aaf 00007fd72f80a86e 00007fd72f809bb6 00007fd72f8097d8 00007fd72f813221 00007fd72f8131d9 00007fd72f813169
0709 13:12:08.602011 (+  2028us) raft_consensus.cc:1685] finished
0709 13:12:08.602040 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:08.602280 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26412416,"thread_start_us":93521,"threads_started":1,"wal-append.queue_time_us":675866}
W20260709 13:12:08.590761 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 432118us
I20260709 13:12:08.609253 25345 leader_election.cc:304] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:08.610914 25345 leader_election.cc:304] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:08.634194 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 225330us
I20260709 13:12:08.635253 25270 leader_election.cc:304] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:08.638842 25345 leader_election.cc:304] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:08.619781 29095 raft_consensus.cc:2749] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:08.651620 25345 leader_election.cc:304] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:08.650134 25270 leader_election.cc:304] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:08.659546 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:08.660211 25222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 2042) took 1109 ms. Trace:
I20260709 13:12:08.660778 25222 rpcz_store.cc:276] 0709 13:12:07.551338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:07.551489 (+   151us) service_pool.cc:224] Handling call
0709 13:12:08.658371 (+1106882us) spinlock_profiling.cc:243] Waited 1.62 ms on lock 0x7b5800002a98. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72cb4ab71 00007fd72cb4aa22 00007fd735a63c09 00007fd734bbdee0 00007fd734c870ab 00007fd734c87131 00007fd734c48fc0 00007fd734c33929 00007fd734c333d2 00007fd72e1aabd4
0709 13:12:08.658633 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:08.658871 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:08.659783 (+   912us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:08.659846 (+    63us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:08.659897 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:08.659987 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:08.660136 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3729792}
W20260709 13:12:08.662200 25873 leader_election.cc:336] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 1.629s (SENT)
I20260709 13:12:08.660193 25227 raft_consensus.cc:2468] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 10.
I20260709 13:12:08.662663 25873 leader_election.cc:304] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:08.663678 25345 leader_election.cc:304] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:08.664834 25345 leader_election.cc:304] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:08.667893 25345 leader_election.cc:304] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:08.626253 28955 leader_election.cc:290] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:08.669137 25227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58422 (request call id 2044) took 1087 ms. Trace:
I20260709 13:12:08.676301 25227 rpcz_store.cc:276] 0709 13:12:07.576152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:07.590152 (+ 14000us) service_pool.cc:224] Handling call
0709 13:12:08.659407 (+1069255us) spinlock_profiling.cc:243] Waited 2.02 ms on lock 0x7b5800002a98. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72cb4ab71 00007fd72cb4aa22 00007fd735a63c09 00007fd734bbdee0 00007fd734c870ab 00007fd734c87131 00007fd734c350a0 00007fd734c34984 00007fd72e1af6d4 00007fd72e1af662
0709 13:12:08.663205 (+  3798us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4653440}
I20260709 13:12:08.654736 29120 raft_consensus.cc:2804] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:08.671542 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:08.671852 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:08.674998 25375 raft_consensus.cc:1240] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 11 LEADER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:08.681238 25379 raft_consensus.cc:3060] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:08.669440 28801 raft_consensus.cc:2749] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:08.658138 28991 raft_consensus.cc:2804] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:08.698379 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:12:08.679133 25873 leader_election.cc:336] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 2.101s (SENT)
I20260709 13:12:08.701846 25873 leader_election.cc:304] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:08.702422 25270 leader_election.cc:304] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:12:08.666051 29104 raft_consensus.cc:2804] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:08.691658 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:08.688652 25225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 2055) took 1093 ms. Trace:
I20260709 13:12:08.669205 29076 raft_consensus.cc:2749] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:08.669375 29077 raft_consensus.cc:2804] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:08.669390 28781 raft_consensus.cc:2749] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:08.693079 25345 leader_election.cc:304] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
W20260709 13:12:08.690388 29088 consensus_meta.cc:287] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.524s	user 0.005s	sys 0.005s
I20260709 13:12:08.652453 29086 consensus_queue.cc:1048] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:12:08.620548 29115 raft_consensus.cc:515] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:08.696550 25271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:08.670557 29117 raft_consensus.cc:2804] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:08.711992 25223 raft_consensus.cc:2468] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 10.
I20260709 13:12:08.705061 25225 rpcz_store.cc:276] 0709 13:12:07.595094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:08.026968 (+431874us) service_pool.cc:224] Handling call
0709 13:12:08.027238 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:08.197951 (+170713us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:08.197997 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:08.198053 (+    56us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:08.198101 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:08.688336 (+490235us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b5400435b54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:08.688412 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:08.688574 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":392037760}
I20260709 13:12:08.704506 25227 raft_consensus.cc:2468] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 11.
I20260709 13:12:08.720602 25379 raft_consensus.cc:2468] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 11.
I20260709 13:12:08.700587 28955 raft_consensus.cc:493] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.703828 29095 raft_consensus.cc:2804] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:08.699867 28991 raft_consensus.cc:493] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
W20260709 13:12:08.764760 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:08.703770 29104 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:08.713709 28832 raft_consensus.cc:2749] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:08.715128 29077 raft_consensus.cc:493] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:08.717010 29008 raft_consensus.cc:493] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:08.719094 28801 raft_consensus.cc:2804] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:12:08.722863 29094 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.089s	sys 0.138s
I20260709 13:12:08.770581 29117 raft_consensus.cc:697] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 11 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:08.776409 29110 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:08.776945 29117 consensus_queue.cc:237] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:08.766160 29038 consensus_meta.cc:287] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 0.536s	user 0.010s	sys 0.001s
I20260709 13:12:05.906139 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:08.780799 25902 raft_consensus.cc:1240] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:08.721657 28984 leader_election.cc:290] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:08.770145 28991 raft_consensus.cc:3060] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:08.772023 29104 raft_consensus.cc:3060] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:12:08.786095 25125 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33566 (request call id 177) took 26758 ms (client timeout 15000 ms). Trace:
W20260709 13:12:08.774848 29094 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.089s	sys 0.140s
I20260709 13:12:08.774152 29077 raft_consensus.cc:3060] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:08.772722 29095 raft_consensus.cc:697] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 7 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:08.770670 28955 raft_consensus.cc:515] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:08.774997 28801 raft_consensus.cc:493] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:08.785914 25124 catalog_manager.cc:5697] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 6 to 9, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 9 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:08.723387 28998 consensus_queue.cc:1048] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 13:12:08.794720 29110 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:08.818732 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
W20260709 13:12:08.788923 25125 rpcz_store.cc:269] 0709 13:11:42.019320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:42.021965 (+  2645us) service_pool.cc:224] Handling call
0709 13:11:42.525141 (+503176us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b54002e0090. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72cb4b640 00007fd735a22b76 00007fd735b2cc3e 00007fd733fed2a4 00007fd733fed232 00007fd733fed161 00007fd733fed0dc 00007fd733fec392 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:08.777779 (+26252638us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:02.954327 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:02.955339 (+  1012us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:02.955425 (+    86us) write_op.cc:435] Acquired schema lock
0709 13:12:02.955481 (+    56us) tablet.cc:662] Decoding operations
0709 13:12:02.956859 (+  1378us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:02.956980 (+   121us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:02.957022 (+    42us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:12:03.130347 (+173325us) tablet.cc:701] Row locks acquired
0709 13:12:03.137949 (+  7602us) write_op.cc:260] PREPARE: finished
0709 13:12:03.138133 (+   184us) write_op.cc:270] Start()
0709 13:12:03.153530 (+ 15397us) write_op.cc:276] Timestamp: P: 1783602723138068 usec, L: 0
0709 13:12:03.153560 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 13:12:03.262049 (+108489us) log.cc:844] Serialized 3664 byte log entry
0709 13:12:03.800602 (+538553us) op_driver.cc:464] REPLICATION: finished
0709 13:12:04.190903 (+390301us) write_op.cc:301] APPLY: starting
0709 13:12:04.191023 (+   120us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:04.191252 (+   229us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:04.191387 (+   135us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:04.198850 (+  7463us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:04.199182 (+   332us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 13:12:04.199228 (+    46us) write_op.cc:312] APPLY: finished
0709 13:12:04.199571 (+   343us) log.cc:844] Serialized 71 byte log entry
0709 13:12:04.199749 (+   178us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:04.199879 (+   130us) write_op.cc:454] Released schema lock
0709 13:12:04.199951 (+    72us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:04.203027 (+  3076us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:04.203057 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2454516,"reported_tablets":26,"spinlock_wait_cycles":32529280,"child_traces":[["op",{"apply.queue_time_us":339914,"apply.run_cpu_time_us":3663,"apply.run_wall_time_us":20064,"num_ops":9,"prepare.queue_time_us":153802,"prepare.run_cpu_time_us":21170,"prepare.run_wall_time_us":419292,"raft.queue_time_us":266681,"raft.run_cpu_time_us":16651,"raft.run_wall_time_us":393157,"replication_time_us":615360,"thread_start_us":622519,"threads_started":4,"wal-append.queue_time_us":204224,"wal-append.run_cpu_time_us":21390,"wal-append.run_wall_time_us":1731945}]]}
I20260709 13:12:08.817111 28801 raft_consensus.cc:3060] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:08.810638 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:08.774783 29076 raft_consensus.cc:2749] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:08.722819 28596 raft_consensus.cc:515] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:08.828336 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 417571us
I20260709 13:12:08.831210 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:08.833339 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:08.842559 25195 leader_election.cc:304] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:08.824440 25124 catalog_manager.cc:5697] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 1 to 8, leader changed from 79d99c0e498349bda74127365219e468 (127.23.140.67) to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 8 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
I20260709 13:12:08.844201 25195 leader_election.cc:304] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:08.838137 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:08.839449 25378 raft_consensus.cc:1240] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:08.869433 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:08.785517 29038 raft_consensus.cc:515] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:08.720614 29088 raft_consensus.cc:515] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:08.778960 29008 raft_consensus.cc:515] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:08.878886 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:08.879798 25906 raft_consensus.cc:2410] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:12:08.887245 25195 connection.cc:256] RPC call timeout handler was delayed by -1.2104697620000024s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1615s for a response
W20260709 13:12:08.887996 25195 connection.cc:256] RPC call timeout handler was delayed by -1.0637697619999926s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1778s for a response
W20260709 13:12:08.888391 25195 connection.cc:256] RPC call timeout handler was delayed by -1.0583697619999839s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1784s for a response
I20260709 13:12:08.879904 25124 catalog_manager.cc:5697] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 6 to 7, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68). New cstate: current_term: 7 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:12:08.872411 29046 raft_consensus.cc:2804] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:08.871069 28971 raft_consensus.cc:3060] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:08.866345 28717 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.900017 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:08.902675 25229 raft_consensus.cc:1240] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:08.903960 25124 catalog_manager.cc:5697] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 3 to 5, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 5 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:08.904870 28900 raft_consensus.cc:3055] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:08.914058 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:08.914247 25906 raft_consensus.cc:1275] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:12:08.916400 29090 consensus_queue.cc:1059] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:08.916507 29115 leader_election.cc:290] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:08.909063 29046 raft_consensus.cc:493] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:08.924075 29046 raft_consensus.cc:3060] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:08.924072 29115 consensus_queue.cc:1048] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:08.912971 25124 catalog_manager.cc:5697] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:12:08.920476 25227 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 9.
I20260709 13:12:08.931902 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:08.933218 25225 raft_consensus.cc:2468] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 10.
W20260709 13:12:08.931051 25874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:08.976754 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:08.897727 28911 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:08.986554 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:08.920128 28900 raft_consensus.cc:740] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:08.993330 25904 raft_consensus.cc:1275] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:12:08.998071 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:08.998786 25901 raft_consensus.cc:2468] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 7.
I20260709 13:12:08.984292 28832 raft_consensus.cc:493] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:09.002590 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 427274us
I20260709 13:12:09.000082 25124 catalog_manager.cc:5697] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 5 to 7, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 7 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
I20260709 13:12:08.983448 28961 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.923197 29076 consensus_queue.cc:1048] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 13:12:09.009284 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:08.986886 28781 raft_consensus.cc:493] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
W20260709 13:12:08.997820 29024 consensus_meta.cc:287] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 0.509s	user 0.011s	sys 0.000s
I20260709 13:12:09.032358 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:09.033118 25301 raft_consensus.cc:2468] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 8.
I20260709 13:12:09.020406 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:09.027161 25904 raft_consensus.cc:2468] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 6.
I20260709 13:12:09.012310 25303 raft_consensus.cc:1240] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:09.026351 25124 catalog_manager.cc:5697] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 3 to 6, leader changed from 79d99c0e498349bda74127365219e468 (127.23.140.67) to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 6 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
I20260709 13:12:09.028347 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:09.029057 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:09.029337 25300 raft_consensus.cc:1275] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:12:08.930011 29094 consensus_queue.cc:1059] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 13:12:08.935539 29013 raft_consensus.cc:515] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:08.922734 28717 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:09.036394 25872 leader_election.cc:336] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Timed out: RequestConsensusVote RPC to 127.23.140.66:33127 timed out after 1.588s (SENT)
I20260709 13:12:09.070812 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:08.989379 28911 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:09.071507 25224 raft_consensus.cc:3060] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:09.036307 25227 raft_consensus.cc:3060] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:09.090278 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:09.009364 29120 raft_consensus.cc:697] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 10 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
W20260709 13:12:09.075974 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 361905us
I20260709 13:12:09.092075 25872 leader_election.cc:304] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:09.079780 25874 leader_election.cc:304] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:12:09.009791 29124 raft_consensus.cc:493] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:09.099910 25300 raft_consensus.cc:3055] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:09.100286 25300 raft_consensus.cc:740] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:09.100973 25300 consensus_queue.cc:260] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:09.097699 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:09.102502 25300 raft_consensus.cc:3060] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:09.095443 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 402406us
I20260709 13:12:09.103749 25124 catalog_manager.cc:5697] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 4 to 7, leader changed from 79d99c0e498349bda74127365219e468 (127.23.140.67) to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 7 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
I20260709 13:12:09.107846 25124 catalog_manager.cc:5697] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 7 to 10, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 10 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:09.110505 28975 raft_consensus.cc:2749] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:09.112982 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:08.942855 29095 consensus_queue.cc:237] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:09.119338 25227 raft_consensus.cc:2468] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 11.
I20260709 13:12:09.122651 25900 raft_consensus.cc:2468] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 10.
I20260709 13:12:09.126113 25345 leader_election.cc:304] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:09.127300 25300 raft_consensus.cc:1275] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:12:09.127820 25300 pending_rounds.cc:85] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19: Aborting all ops after (but not including) 8
I20260709 13:12:09.128105 25300 pending_rounds.cc:107] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:12:09.128397 25300 raft_consensus.cc:2889] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:09.143784 25124 catalog_manager.cc:5697] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:09.144280 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:09.148809 25345 leader_election.cc:304] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:09.152309 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 53030.8us
W20260709 13:12:09.154050 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 54762.1us
I20260709 13:12:09.031723 29104 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:09.155649 25345 leader_election.cc:304] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:09.164671 25301 raft_consensus.cc:2368] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 10. Current term is 11.
W20260709 13:12:09.158646 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 78911.2us
I20260709 13:12:09.159874 25224 raft_consensus.cc:2468] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 9.
I20260709 13:12:09.096856 28746 raft_consensus.cc:3055] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:12:09.168267 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 74810.1us
I20260709 13:12:09.027945 28832 raft_consensus.cc:515] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:09.168076 25124 catalog_manager.cc:5697] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 6 to 7, leader changed from 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 7 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:12:09.042145 29024 raft_consensus.cc:515] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:09.170593 25345 leader_election.cc:304] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:09.173249 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:09.173502 25345 leader_election.cc:304] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:09.173707 25900 raft_consensus.cc:1240] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:09.113857 29063 raft_consensus.cc:2804] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:09.175518 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:09.176811 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:09.180788 25195 leader_election.cc:400] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 election: Vote denied by peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085) with higher term. Message: Invalid argument: T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 9. Current term is 10.
I20260709 13:12:09.180147 25124 catalog_manager.cc:5697] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:09.181224 25195 leader_election.cc:403] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:12:09.187397 25903 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 7.
I20260709 13:12:09.109467 28801 raft_consensus.cc:515] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:09.038635 28781 raft_consensus.cc:515] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:09.199765 25900 raft_consensus.cc:1240] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:12:09.059957 28961 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:09.202239 25228 raft_consensus.cc:1240] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:09.182893 25195 leader_election.cc:304] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:09.169019 28746 raft_consensus.cc:740] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:09.162884 29119 raft_consensus.cc:2749] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:09.177600 29080 raft_consensus.cc:2749] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:09.192200 25375 raft_consensus.cc:1240] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:09.194211 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:09.210245 25907 raft_consensus.cc:3060] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:09.204517 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:09.204413 25124 catalog_manager.cc:5697] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 4 to 6, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 6 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
I20260709 13:12:09.177469 29132 raft_consensus.cc:2804] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:09.189390 28972 raft_consensus.cc:2749] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085) with higher term. Message: Invalid argument: T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 9. Current term is 10.
I20260709 13:12:09.197881 29076 raft_consensus.cc:2749] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:12:09.215103 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 82433.6us
I20260709 13:12:09.217172 25904 raft_consensus.cc:2468] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 9.
I20260709 13:12:09.185137 28596 leader_election.cc:290] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:09.223492 28742 raft_consensus.cc:3060] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:09.205210 29038 leader_election.cc:290] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:09.227937 25222 raft_consensus.cc:3060] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:09.228847 25907 raft_consensus.cc:2468] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 10.
I20260709 13:12:09.204811 29088 leader_election.cc:290] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:09.216539 29132 raft_consensus.cc:493] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:09.200423 29063 raft_consensus.cc:697] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
W20260709 13:12:09.236529 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 81759.9us
I20260709 13:12:09.209478 29115 raft_consensus.cc:2804] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:09.184422 29118 consensus_queue.cc:1048] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:12:09.155681 29124 raft_consensus.cc:515] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:09.271788 29124 leader_election.cc:290] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:09.237771 25195 leader_election.cc:304] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:12:09.161293 28900 consensus_queue.cc:260] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:09.273694 28900 raft_consensus.cc:3060] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:09.274653 29115 raft_consensus.cc:697] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 9 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
W20260709 13:12:09.226071 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 52627.3us
I20260709 13:12:09.275792 29115 consensus_queue.cc:237] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:09.276561 29086 raft_consensus.cc:3055] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:09.276988 29086 raft_consensus.cc:740] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:09.277817 29086 consensus_queue.cc:260] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:09.279001 29086 raft_consensus.cc:3060] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:09.279531 28832 leader_election.cc:290] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:09.217823 29008 leader_election.cc:290] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:09.281584 28801 leader_election.cc:290] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:09.275766 25345 leader_election.cc:304] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:09.283583 29090 raft_consensus.cc:2749] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:09.245826 29013 leader_election.cc:290] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:09.274772 29144 raft_consensus.cc:2804] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:09.284719 29144 raft_consensus.cc:493] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:09.285359 29144 raft_consensus.cc:3060] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:09.240389 29123 consensus_queue.cc:1048] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.048s
W20260709 13:12:09.287953 29127 log.cc:927] Time spent T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:12:09.233421 29120 consensus_queue.cc:237] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:09.232594 29129 raft_consensus.cc:2804] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:09.290035 29129 raft_consensus.cc:493] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:09.290406 29129 raft_consensus.cc:3060] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:09.291527 25345 leader_election.cc:304] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:09.244306 28746 consensus_queue.cc:260] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:09.293416 25874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:09.274260 25195 leader_election.cc:304] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:12:09.295666 25195 leader_election.cc:304] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:09.241868 29121 log.cc:927] Time spent T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.252s	user 0.000s	sys 0.001s
I20260709 13:12:09.300217 25124 catalog_manager.cc:5697] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 3 to 6, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 6 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
W20260709 13:12:09.303411 25195 leader_election.cc:336] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 1.553s (SENT)
I20260709 13:12:09.310489 25195 leader_election.cc:304] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:09.311718 25343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:09.312638 25874 leader_election.cc:304] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
W20260709 13:12:09.315891 25195 leader_election.cc:336] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 1.615s (SENT)
I20260709 13:12:09.317261 25874 leader_election.cc:304] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
W20260709 13:12:09.321555 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 60270.3us
I20260709 13:12:09.321929 25195 leader_election.cc:304] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:09.322556 25229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 2056) took 1727 ms. Trace:
I20260709 13:12:09.322970 25229 rpcz_store.cc:276] 0709 13:12:07.595347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:08.371959 (+776612us) service_pool.cc:224] Handling call
0709 13:12:08.397181 (+ 25222us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:08.912096 (+514915us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:09.322336 (+410240us) spinlock_profiling.cc:243] Waited 505 ms on lock 0x7b54000889d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:09.322502 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1161971968}
I20260709 13:12:09.318950 25124 catalog_manager.cc:5697] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 2 to 5, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 5 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:09.327549 25902 raft_consensus.cc:1275] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:12:09.325240 25124 catalog_manager.cc:5697] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:12:09.256143 29132 raft_consensus.cc:3060] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:09.338320 29125 log.cc:927] Time spent T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 13:12:09.339383 29137 raft_consensus.cc:2804] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:09.339953 29137 raft_consensus.cc:697] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:09.340788 29137 consensus_queue.cc:237] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:09.342589 29092 consensus_meta.cc:287] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 1.093s	user 0.012s	sys 0.000s
I20260709 13:12:09.343022 29092 raft_consensus.cc:515] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:09.295050 28993 consensus_queue.cc:1175] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "da445ce82dc4467f95f4fa52297eaa19" responder_term: 10 status { last_received { term: 9 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 9. Current term is 10. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:12:09.327346 29141 raft_consensus.cc:2804] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:09.346603 29141 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:09.316959 29123 raft_consensus.cc:2749] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:09.346963 29141 raft_consensus.cc:3060] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:09.347545 29123 raft_consensus.cc:2749] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:09.348721 28971 raft_consensus.cc:2749] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:09.350567 28694 raft_consensus.cc:1064] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19: attempting to promote NON_VOTER 6c4b021f3f9e41adb75e870a08ad88b6 to VOTER
W20260709 13:12:09.355145 29135 log.cc:927] Time spent T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:12:09.355947 28717 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:09.355196 28911 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:09.358150 29063 consensus_queue.cc:237] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:09.305733 29038 raft_consensus.cc:2804] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:09.360231 28746 raft_consensus.cc:3060] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:09.360173 29038 raft_consensus.cc:697] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 10 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:09.361413 29038 consensus_queue.cc:237] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:09.362151 25372 raft_consensus.cc:2393] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 10: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:09.239136 29076 consensus_queue.cc:1048] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.079s
I20260709 13:12:09.330621 25345 leader_election.cc:304] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:09.364182 29090 raft_consensus.cc:2749] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:09.331506 25124 catalog_manager.cc:5697] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 7 to 8, leader changed from 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 8 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:09.305316 28972 raft_consensus.cc:2804] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:09.396512 25222 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 7.
W20260709 13:12:09.386451 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 55902.6us
W20260709 13:12:09.393957 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 223433us
W20260709 13:12:09.409629 29134 log.cc:927] Time spent T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
I20260709 13:12:09.411052 29009 raft_consensus.cc:493] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.411566 29009 raft_consensus.cc:515] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:09.413516 25228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 2045) took 1821 ms. Trace:
I20260709 13:12:09.413921 25228 rpcz_store.cc:276] 0709 13:12:07.592409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:07.597182 (+  4773us) service_pool.cc:224] Handling call
0709 13:12:08.775177 (+1177995us) spinlock_profiling.cc:243] Waited 7.7 ms on lock 0x7b5800002a98. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72cb4ab71 00007fd72cb4aa22 00007fd735a63c09 00007fd734bbdee0 00007fd734c870ab 00007fd734c87131 00007fd734c48fc0 00007fd734c33929 00007fd734c333d2 00007fd72e1aabd4
0709 13:12:08.775369 (+   192us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:09.202756 (+427387us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:09.413298 (+210542us) spinlock_profiling.cc:243] Waited 427 ms on lock 0x7b54002d2154. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:09.413462 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":998898816}
I20260709 13:12:09.414870 25345 leader_election.cc:304] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:09.330387 29068 consensus_meta.cc:287] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 0.910s	user 0.011s	sys 0.000s
I20260709 13:12:09.437394 25124 catalog_manager.cc:5697] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
I20260709 13:12:09.451231 29068 raft_consensus.cc:515] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:09.457252 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 50215.8us
W20260709 13:12:09.460124 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 142939us
I20260709 13:12:09.447590 28911 raft_consensus.cc:493] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:09.462847 28911 raft_consensus.cc:515] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:09.465143 28911 leader_election.cc:290] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:09.469564 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 54786.2us
I20260709 13:12:09.470091 25874 leader_election.cc:304] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:12:09.471412 25345 leader_election.cc:304] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:09.472601 25345 leader_election.cc:304] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:09.474460 29118 raft_consensus.cc:2804] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:09.474999 29118 raft_consensus.cc:697] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:09.375665 29143 raft_consensus.cc:2749] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:09.480538 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:09.488143 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:09.489379 25227 raft_consensus.cc:1240] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:12:09.490412 25225 raft_consensus.cc:1240] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:12:09.507172 25224 raft_consensus.cc:2368] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 10. Current term is 11.
I20260709 13:12:09.508155 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:09.508770 25225 raft_consensus.cc:3060] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:09.391160 28972 raft_consensus.cc:493] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:09.447942 29024 leader_election.cc:290] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:09.515859 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:09.511991 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 358451us
I20260709 13:12:09.516840 25902 raft_consensus.cc:1240] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:12:09.517525 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:09.518322 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:09.522925 25230 raft_consensus.cc:3060] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:09.519075 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:09.520290 25226 raft_consensus.cc:1240] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:09.524415 25221 raft_consensus.cc:3060] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:09.513676 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
W20260709 13:12:09.512650 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 144903us
I20260709 13:12:09.526456 25227 raft_consensus.cc:3060] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:09.527423 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:09.529193 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:09.530280 25224 raft_consensus.cc:2393] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 10: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
W20260709 13:12:09.530330 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:09.537863 25271 leader_election.cc:304] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:09.545308 25227 raft_consensus.cc:2468] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 9.
W20260709 13:12:09.549661 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:09.511258 29090 raft_consensus.cc:2749] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:09.510164 29080 raft_consensus.cc:2749] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:12:09.578274 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 44843.8us
W20260709 13:12:09.551438 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 235566us
I20260709 13:12:09.510684 28961 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:09.510185 28717 raft_consensus.cc:493] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:09.521406 28972 raft_consensus.cc:3060] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:12:09.598881 25195 leader_election.cc:336] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 1.778s (SENT)
I20260709 13:12:09.618384 25195 leader_election.cc:304] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:09.619835 25195 leader_election.cc:336] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 1.784s (SENT)
W20260709 13:12:09.598836 25872 leader_election.cc:336] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Timed out: RequestConsensusVote RPC to 127.23.140.66:33127 timed out after 1.965s (SENT)
I20260709 13:12:09.603999 25225 raft_consensus.cc:2468] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 12.
I20260709 13:12:09.620368 25195 leader_election.cc:304] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:09.513305 28596 raft_consensus.cc:2749] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:09.620469 25872 leader_election.cc:304] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:09.599023 25271 leader_election.cc:304] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:12:09.625974 25195 leader_election.cc:336] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 2.199s (SENT)
I20260709 13:12:09.626408 25195 leader_election.cc:304] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:09.622783 25230 raft_consensus.cc:2468] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 8.
I20260709 13:12:09.624607 25221 raft_consensus.cc:2410] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:12:09.549077 28911 raft_consensus.cc:493] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:09.628381 28911 raft_consensus.cc:515] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:09.631247 28911 leader_election.cc:290] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:09.633499 25195 leader_election.cc:336] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 2.206s (SENT)
I20260709 13:12:09.634083 25195 leader_election.cc:304] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
W20260709 13:12:09.622303 29077 consensus_meta.cc:287] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.803s	user 0.003s	sys 0.015s
I20260709 13:12:09.638064 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:09.639123 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:09.680450 25221 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 7.
I20260709 13:12:09.644457 29092 leader_election.cc:290] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:09.648070 28694 consensus_queue.cc:237] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:09.671649 25374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36254 (request call id 2097) took 1008 ms. Trace:
I20260709 13:12:09.684926 25374 rpcz_store.cc:276] 0709 13:12:08.662782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:08.662884 (+   102us) service_pool.cc:224] Handling call
0709 13:12:09.671382 (+1008498us) spinlock_profiling.cc:243] Waited 776 ms on lock 0x7b54000b9354. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:09.671574 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1785257728}
I20260709 13:12:09.475896 29118 consensus_queue.cc:237] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:09.570230 29008 consensus_queue.cc:1048] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.080s
I20260709 13:12:09.618331 29124 raft_consensus.cc:2804] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:12:09.690281 25872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:09.627146 28961 raft_consensus.cc:2749] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:12:09.700918 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 81437.7us
W20260709 13:12:09.701575 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 102629us
I20260709 13:12:09.636711 28832 raft_consensus.cc:3060] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:09.667217 29046 consensus_meta.cc:287] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 0.743s	user 0.010s	sys 0.002s
I20260709 13:12:09.634133 28781 leader_election.cc:290] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:09.677935 28911 raft_consensus.cc:2749] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:09.636271 29024 raft_consensus.cc:2749] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:09.682896 29115 raft_consensus.cc:2749] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:09.709239 25270 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:09.841392 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:09.841065 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:09.842000 25370 raft_consensus.cc:1240] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:09.842500 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:09.707758 29152 raft_consensus.cc:493] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
W20260709 13:12:09.759207 28991 consensus_meta.cc:287] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.944s	user 0.004s	sys 0.008s
I20260709 13:12:09.691493 29077 raft_consensus.cc:515] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:12:09.636483 29139 consensus_queue.cc:1048] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.075s
I20260709 13:12:09.809077 28972 raft_consensus.cc:515] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:09.713017 29046 raft_consensus.cc:515] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:09.797459 29068 leader_election.cc:290] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:09.749864 28961 consensus_queue.cc:1048] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:12:09.708267 29144 raft_consensus.cc:515] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:09.759239 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:09.699127 29123 raft_consensus.cc:493] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:09.843637 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:09.705853 28801 raft_consensus.cc:2804] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:12:09.826505 28900 consensus_meta.cc:287] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent flushing consensus metadata: real 0.552s	user 0.009s	sys 0.000s
I20260709 13:12:09.771368 28955 leader_election.cc:290] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:09.712018 29124 raft_consensus.cc:697] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 10 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:09.632383 28717 raft_consensus.cc:515] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:09.756089 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:09.882805 25375 raft_consensus.cc:2468] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 6.
I20260709 13:12:09.844385 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:12:09.843048 29132 consensus_meta.cc:287] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.504s	user 0.008s	sys 0.000s
I20260709 13:12:09.884605 28801 raft_consensus.cc:697] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 11 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:09.884891 29132 raft_consensus.cc:515] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:09.885280 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:09.885866 25371 raft_consensus.cc:2468] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 6.
I20260709 13:12:09.885582 28801 consensus_queue.cc:237] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:09.886209 29124 consensus_queue.cc:237] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:09.887303 29132 leader_election.cc:290] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:09.887460 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:09.757215 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:09.888010 25375 raft_consensus.cc:3060] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:12:09.775063 29151 log.cc:927] Time spent T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
W20260709 13:12:09.890419 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 430845us
I20260709 13:12:09.750581 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:12:09.860805 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 151698us
I20260709 13:12:09.866631 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:09.867404 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:09.868948 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:12:09.863507 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 198126us
W20260709 13:12:09.876690 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:09.863550 29154 raft_consensus.cc:2804] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:12:09.874696 29165 log.cc:927] Time spent T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:12:09.881563 25229 raft_consensus.cc:2410] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:12:09.900840 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:09.923868 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:09.936159 25373 raft_consensus.cc:2410] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:12:09.927496 25195 leader_election.cc:304] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:12:09.922338 28717 leader_election.cc:290] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:09.935967 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:12:09.896267 29129 consensus_meta.cc:287] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.605s	user 0.011s	sys 0.000s
I20260709 13:12:09.939073 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:09.926542 25270 leader_election.cc:304] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:09.869992 28991 raft_consensus.cc:515] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:09.933571 29086 consensus_meta.cc:287] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.654s	user 0.010s	sys 0.000s
I20260709 13:12:09.864332 29152 raft_consensus.cc:515] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:09.937345 25375 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 7.
I20260709 13:12:09.942709 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:12:09.938763 29156 log.cc:927] Time spent T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.224s	user 0.003s	sys 0.000s
I20260709 13:12:09.948359 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:09.949510 25370 raft_consensus.cc:2410] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:12:09.945217 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:09.946940 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:09.945040 25378 raft_consensus.cc:2468] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 11.
I20260709 13:12:09.953190 25298 raft_consensus.cc:1240] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:09.956115 29013 consensus_queue.cc:1059] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:09.956969 29013 consensus_queue.cc:1243] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer 79d99c0e498349bda74127365219e468 log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:12:09.957418 29013 raft_consensus.cc:3055] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:09.883067 29123 raft_consensus.cc:515] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:09.958277 25375 raft_consensus.cc:2393] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 6: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:09.964735 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:09.967407 25299 raft_consensus.cc:1275] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:12:09.967782 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:09.970760 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:09.971135 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:09.971629 25303 raft_consensus.cc:2468] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 7.
I20260709 13:12:09.973711 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:09.975723 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:09.976388 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:09.976564 25302 raft_consensus.cc:2468] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 9.
I20260709 13:12:09.977244 25303 raft_consensus.cc:2468] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 10.
I20260709 13:12:09.978873 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:09.979705 25302 raft_consensus.cc:2468] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 9.
I20260709 13:12:09.981427 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:09.982323 25302 raft_consensus.cc:2468] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 10.
I20260709 13:12:09.983836 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:09.984862 25302 raft_consensus.cc:2393] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 9: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:09.986734 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:09.987612 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:09.987934 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:09.989781 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:12:09.998266 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:10.014705 29163 consensus_queue.cc:1059] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:12:10.015923 28746 consensus_meta.cc:287] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.655s	user 0.007s	sys 0.003s
I20260709 13:12:10.016333 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:10.017167 25301 raft_consensus.cc:3060] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:09.945551 29154 raft_consensus.cc:697] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 6 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:09.943090 29129 raft_consensus.cc:515] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:12:09.947538 28717 raft_consensus.cc:2804] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:10.029893 25374 raft_consensus.cc:2393] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 8: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:10.037297 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:10.023856 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:10.023339 25377 raft_consensus.cc:2468] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 9.
I20260709 13:12:10.022801 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:09.974557 25305 raft_consensus.cc:2468] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 10.
I20260709 13:12:09.945005 29170 raft_consensus.cc:2804] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:10.036531 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:10.038110 25303 raft_consensus.cc:2468] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 7.
I20260709 13:12:10.038276 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:10.041040 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
W20260709 13:12:09.961473 29141 consensus_meta.cc:287] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent flushing consensus metadata: real 0.614s	user 0.009s	sys 0.002s
I20260709 13:12:10.038066 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:09.957722 29013 raft_consensus.cc:740] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:10.045848 25370 raft_consensus.cc:2393] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 9: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:10.126340 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:10.046309 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:10.019017 29152 leader_election.cc:290] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:10.126821 25374 raft_consensus.cc:2468] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 11.
W20260709 13:12:10.023593 29165 log.cc:927] Time spent T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:12:10.017675 28991 leader_election.cc:290] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:10.022322 29144 leader_election.cc:290] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:10.015939 29163 consensus_queue.cc:1243] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer 79d99c0e498349bda74127365219e468 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:12:10.043505 29170 raft_consensus.cc:493] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:10.141253 25373 raft_consensus.cc:2393] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 9: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:10.125936 28746 raft_consensus.cc:493] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.045615 29068 raft_consensus.cc:493] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:10.179994 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:10.144049 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:10.145073 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:10.181514 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:10.200542 28746 raft_consensus.cc:515] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:10.201093 25372 raft_consensus.cc:3060] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:10.202107 29154 consensus_queue.cc:237] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:10.202936 28746 leader_election.cc:290] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:10.203682 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:10.204917 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:10.205555 25370 raft_consensus.cc:2468] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 10.
I20260709 13:12:10.206442 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:10.141584 25299 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 7.
W20260709 13:12:10.130281 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 161423us
I20260709 13:12:10.020654 29046 leader_election.cc:290] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:10.186585 29013 consensus_queue.cc:260] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:10.142525 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:10.023114 29086 raft_consensus.cc:493] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:10.156036 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:12:10.214361 25873 leader_election.cc:336] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 1.588s (SENT)
I20260709 13:12:10.214646 25195 leader_election.cc:304] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:10.215016 25873 leader_election.cc:304] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:10.218017 25221 raft_consensus.cc:1275] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:12:10.218593 25195 leader_election.cc:304] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
W20260709 13:12:10.189392 25270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:10.220177 25873 leader_election.cc:304] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:10.220700 25372 raft_consensus.cc:2468] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 9.
I20260709 13:12:10.187568 28832 raft_consensus.cc:2749] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:10.025967 28972 leader_election.cc:290] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:10.190405 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:10.042819 28717 raft_consensus.cc:493] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:10.021392 29077 leader_election.cc:290] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:10.226011 25902 raft_consensus.cc:1240] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:10.194226 29009 leader_election.cc:290] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:10.196269 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:10.196321 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:10.227747 25873 leader_election.cc:304] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:12:10.228302 25907 raft_consensus.cc:3060] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:10.228663 28832 raft_consensus.cc:2804] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:10.229133 28832 raft_consensus.cc:493] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:10.229472 28832 raft_consensus.cc:3060] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:10.197741 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:10.230088 25230 raft_consensus.cc:3060] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:10.231446 29129 leader_election.cc:290] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:10.227232 29123 leader_election.cc:290] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:10.221988 29174 raft_consensus.cc:2749] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:10.222838 29068 raft_consensus.cc:515] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
W20260709 13:12:10.234741 25270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:10.235562 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:10.236343 25373 raft_consensus.cc:2468] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 7.
I20260709 13:12:10.237144 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:10.227219 28900 raft_consensus.cc:2749] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:10.199939 29170 raft_consensus.cc:3060] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:10.240506 25270 leader_election.cc:304] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:10.243057 29009 raft_consensus.cc:2749] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:10.244462 29009 consensus_queue.cc:1059] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:10.202626 25304 raft_consensus.cc:2468] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 10.
I20260709 13:12:10.184794 25872 leader_election.cc:304] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:10.245271 29163 raft_consensus.cc:3055] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:10.245823 29163 raft_consensus.cc:740] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:10.246055 28900 raft_consensus.cc:2804] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:10.246646 28900 raft_consensus.cc:493] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:10.247176 28900 raft_consensus.cc:3060] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:10.246937 29163 consensus_queue.cc:260] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:10.248747 29163 raft_consensus.cc:3060] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:10.142525 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:10.250272 25345 leader_election.cc:400] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 election: Vote denied by peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361) with higher term. Message: Invalid argument: T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 10. Current term is 11.
I20260709 13:12:10.210243 25375 raft_consensus.cc:2393] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 9: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:10.212817 25301 raft_consensus.cc:2468] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 10.
I20260709 13:12:10.250612 25345 leader_election.cc:403] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:12:10.222597 28781 raft_consensus.cc:2749] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:10.222486 25296 raft_consensus.cc:2468] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 10.
I20260709 13:12:10.145942 25904 raft_consensus.cc:1240] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 8. Current term is 9. Ops: []
W20260709 13:12:10.223001 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 476754us
I20260709 13:12:10.213071 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:10.221966 29167 raft_consensus.cc:2804] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:10.221849 29086 raft_consensus.cc:515] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:10.244586 25270 leader_election.cc:304] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:12:10.222110 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:12:10.245833 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 61108.5us
I20260709 13:12:10.274904 25872 leader_election.cc:304] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:10.237712 25373 raft_consensus.cc:3060] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:10.275519 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:10.276176 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:10.210711 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:10.276952 25375 raft_consensus.cc:3060] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:10.047657 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:10.267658 25907 raft_consensus.cc:2468] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 9.
I20260709 13:12:10.266494 25230 raft_consensus.cc:2468] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 9.
I20260709 13:12:10.270008 25345 leader_election.cc:304] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:10.141191 29141 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:10.278080 25303 raft_consensus.cc:2468] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 9.
I20260709 13:12:10.239332 29162 raft_consensus.cc:493] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.225446 28717 raft_consensus.cc:3060] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:10.223562 29132 raft_consensus.cc:493] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:10.283232 25345 leader_election.cc:304] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
W20260709 13:12:10.328743 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 45583.8us
I20260709 13:12:10.223875 29137 consensus_queue.cc:1059] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:12:10.294356 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:10.330823 25371 raft_consensus.cc:2393] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 8: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:10.294978 29162 raft_consensus.cc:515] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:10.332423 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 53597.9us
I20260709 13:12:10.329676 25345 leader_election.cc:304] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:10.334604 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:10.296018 29138 raft_consensus.cc:2749] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:10.296319 29141 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:10.298116 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:10.298509 29086 leader_election.cc:290] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:10.294389 29068 leader_election.cc:290] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:10.273201 28746 raft_consensus.cc:2749] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361) with higher term. Message: Invalid argument: T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 10. Current term is 11.
I20260709 13:12:10.305068 28832 raft_consensus.cc:515] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:10.308571 25375 raft_consensus.cc:2468] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 11.
I20260709 13:12:10.282142 29140 consensus_queue.cc:1059] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
W20260709 13:12:10.328644 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 84129.4us
I20260709 13:12:10.292214 29129 raft_consensus.cc:2749] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:10.333143 25271 leader_election.cc:304] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:12:10.270761 29167 raft_consensus.cc:493] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:10.341051 25374 raft_consensus.cc:2468] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 7.
I20260709 13:12:10.348222 25372 raft_consensus.cc:2393] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 11: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:10.351557 25270 leader_election.cc:304] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:12:10.348536 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:10.354849 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:10.355350 25375 raft_consensus.cc:2468] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 9.
I20260709 13:12:10.358402 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:10.359426 25375 raft_consensus.cc:2393] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 7: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:12:10.338030 29008 raft_consensus.cc:2804] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:10.362313 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:10.362592 25271 leader_election.cc:304] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:12:10.364476 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:10.365516 25370 raft_consensus.cc:2393] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 6: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:10.367684 25379 raft_consensus.cc:2468] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 13.
I20260709 13:12:10.347334 29086 raft_consensus.cc:2804] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:10.368031 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:10.347146 29077 raft_consensus.cc:2804] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:10.370208 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:10.369040 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:10.375685 25374 raft_consensus.cc:3060] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:10.382089 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:10.383040 25370 raft_consensus.cc:2468] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 9.
I20260709 13:12:10.357707 29167 raft_consensus.cc:3060] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:10.382002 29131 raft_consensus.cc:2804] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:10.354159 29137 raft_consensus.cc:3055] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:10.337869 29132 raft_consensus.cc:515] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:10.346786 29185 consensus_queue.cc:1048] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:12:10.371186 28991 raft_consensus.cc:2804] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:10.393994 25371 raft_consensus.cc:1240] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 10 LEADER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:10.382038 28955 raft_consensus.cc:2804] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:10.398703 25371 raft_consensus.cc:1240] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 10. Current term is 11. Ops: [8.5-10.6]
I20260709 13:12:10.382602 29086 raft_consensus.cc:697] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 12 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:10.426323 25373 raft_consensus.cc:2468] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 7.
I20260709 13:12:10.428995 25373 raft_consensus.cc:1275] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:12:10.391052 29131 raft_consensus.cc:493] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:10.392153 29077 raft_consensus.cc:697] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 9 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:10.460124 29123 raft_consensus.cc:493] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.421904 29141 raft_consensus.cc:493] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.400233 28991 raft_consensus.cc:493] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:10.394232 29137 raft_consensus.cc:740] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:10.426741 28955 raft_consensus.cc:493] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:10.513612 25371 raft_consensus.cc:1240] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:10.426259 29068 raft_consensus.cc:493] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
W20260709 13:12:10.522784 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 247950us
I20260709 13:12:10.437203 28972 raft_consensus.cc:493] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:10.466537 29131 raft_consensus.cc:3060] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:10.527110 25872 leader_election.cc:304] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:10.437536 29174 raft_consensus.cc:493] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:10.515611 28991 raft_consensus.cc:3060] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:10.523047 28955 raft_consensus.cc:3060] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:10.535168 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 171169us
W20260709 13:12:10.539594 25872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:10.536978 29138 raft_consensus.cc:2804] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:10.515755 29141 raft_consensus.cc:515] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:10.537599 25271 leader_election.cc:304] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:10.544183 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:10.564924 25907 raft_consensus.cc:3060] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:10.539490 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 188021us
I20260709 13:12:10.569218 25872 leader_election.cc:304] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
W20260709 13:12:10.570940 25270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:10.592617 29185 raft_consensus.cc:2804] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:10.619472 29185 raft_consensus.cc:493] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:10.619868 29185 raft_consensus.cc:3060] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:10.620532 29187 raft_consensus.cc:2804] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:10.620931 29187 raft_consensus.cc:493] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:10.621138 28742 raft_consensus.cc:3055] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:10.595695 29013 raft_consensus.cc:3060] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:10.562973 29138 raft_consensus.cc:493] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:10.630103 29138 raft_consensus.cc:3060] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:10.598304 29188 log.cc:927] Time spent T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:12:10.599092 29144 raft_consensus.cc:493] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:10.634538 29144 raft_consensus.cc:515] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:10.637295 29144 leader_election.cc:290] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:10.599777 29167 raft_consensus.cc:515] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:10.537315 29008 raft_consensus.cc:697] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 10 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:10.600451 25221 raft_consensus.cc:1275] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:12:10.540645 29086 consensus_queue.cc:237] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:10.601015 29186 log.cc:927] Time spent T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:12:10.522905 29123 raft_consensus.cc:515] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:10.543177 29137 consensus_queue.cc:260] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:10.603348 25303 raft_consensus.cc:1240] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:10.603526 29155 consensus_queue.cc:1059] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:10.599784 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:10.646670 25230 raft_consensus.cc:3060] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:10.531423 29063 consensus_queue.cc:1048] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:12:10.605844 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:10.533250 28972 raft_consensus.cc:515] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:10.541714 28832 leader_election.cc:290] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:10.606724 25296 raft_consensus.cc:1240] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:10.661059 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:10.610256 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:10.610911 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:10.611539 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:10.612510 25305 raft_consensus.cc:1275] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:12:10.663609 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:10.612603 25270 leader_election.cc:304] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:10.617022 29162 leader_election.cc:290] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:10.610924 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:10.617656 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:12:10.667919 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 55394.2us
I20260709 13:12:10.618595 29132 leader_election.cc:290] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:10.621299 29187 raft_consensus.cc:3060] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:10.593959 29140 consensus_queue.cc:1059] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:10.622397 25229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58418 (request call id 2010) took 1137 ms. Trace:
I20260709 13:12:10.703915 25229 rpcz_store.cc:276] 0709 13:12:09.485083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:09.485207 (+   124us) service_pool.cc:224] Handling call
0709 13:12:10.622168 (+1136961us) spinlock_profiling.cc:243] Waited 359 ms on lock 0x7b54002c0bd4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:10.622329 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":825087232}
W20260709 13:12:10.561494 29184 log.cc:927] Time spent T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 13:12:10.534132 29174 raft_consensus.cc:515] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:10.704810 29185 raft_consensus.cc:515] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:10.706753 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:10.525681 29068 raft_consensus.cc:515] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:10.647189 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:10.709600 25221 raft_consensus.cc:1240] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:10.711009 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:10.712574 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:10.645499 25907 raft_consensus.cc:2468] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 9.
I20260709 13:12:10.606117 25372 raft_consensus.cc:1240] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:12:10.715551 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:10.655264 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:10.655953 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:10.657171 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:10.658272 25222 raft_consensus.cc:1240] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:10.667936 25378 raft_consensus.cc:2393] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 9: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:10.684779 25374 raft_consensus.cc:2410] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:12:10.721719 25374 raft_consensus.cc:1240] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:10.688254 25230 raft_consensus.cc:2468] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 11.
I20260709 13:12:10.690117 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:10.693281 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:10.724182 25304 raft_consensus.cc:3060] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:10.694409 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:10.725854 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:10.696156 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:10.727583 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:10.698511 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:10.626784 28742 raft_consensus.cc:740] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:10.701043 29131 raft_consensus.cc:515] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:10.728286 25305 raft_consensus.cc:2468] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 12.
I20260709 13:12:10.736984 25229 raft_consensus.cc:1240] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:10.736877 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:10.730823 25372 raft_consensus.cc:1240] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:10.732175 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:10.733268 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:10.734375 25223 raft_consensus.cc:1240] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 10. Current term is 11. Ops: []
W20260709 13:12:10.740477 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 48895.6us
I20260709 13:12:10.641175 29008 consensus_queue.cc:237] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:10.707545 29154 raft_consensus.cc:2804] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:10.744102 25270 leader_election.cc:304] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:10.745263 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:10.745628 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:10.572031 29077 consensus_queue.cc:237] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:10.748696 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:10.758095 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:10.658864 29090 consensus_queue.cc:1059] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:12:10.691315 29158 consensus_queue.cc:1048] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 13:12:10.756963 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:10.761044 25229 raft_consensus.cc:1240] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 11. Current term is 12. Ops: [8.5-11.6]
I20260709 13:12:10.747368 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:10.759225 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:10.712415 28900 raft_consensus.cc:515] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:10.764112 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:10.715672 29162 consensus_queue.cc:1048] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.042s
W20260709 13:12:10.754521 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 424920us
I20260709 13:12:10.707402 29119 consensus_queue.cc:1048] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:12:10.781876 25305 raft_consensus.cc:1275] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:12:10.778060 25345 leader_election.cc:304] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:10.785828 25230 raft_consensus.cc:1275] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:12:10.786258 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 217113us
I20260709 13:12:10.788901 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:10.790491 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:10.791139 25226 raft_consensus.cc:3060] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:10.792933 29063 raft_consensus.cc:493] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:10.795562 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 54038.4us
I20260709 13:12:10.781078 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:10.798838 25872 leader_election.cc:304] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:12:10.793449 29063 raft_consensus.cc:515] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:10.796650 25270 leader_election.cc:304] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:10.734839 28717 raft_consensus.cc:515] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:10.754070 29009 consensus_queue.cc:1059] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:12:10.808794 25222 raft_consensus.cc:1275] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:12:10.808631 25345 leader_election.cc:304] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:10.814117 25904 raft_consensus.cc:1240] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:10.816848 25902 raft_consensus.cc:1275] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:12:10.818446 25873 leader_election.cc:304] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:10.811820 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:10.819566 25229 raft_consensus.cc:2393] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 9: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:10.819456 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:10.820029 25301 raft_consensus.cc:3060] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:10.821523 25195 leader_election.cc:304] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:10.826269 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:10.827405 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:10.828483 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:10.779170 29197 raft_consensus.cc:493] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:10.828493 25906 raft_consensus.cc:1275] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:12:10.842417 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:10.843993 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:10.832449 25305 raft_consensus.cc:1240] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:10.845386 25301 raft_consensus.cc:2468] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 9.
I20260709 13:12:10.858150 25900 raft_consensus.cc:1240] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:10.808719 29163 raft_consensus.cc:3055] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:10.863523 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:10.867733 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:10.866957 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:10.870793 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:10.809960 29104 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:10.815907 29129 raft_consensus.cc:2804] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:10.875789 25377 raft_consensus.cc:2393] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 11: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
W20260709 13:12:10.876314 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 69839.5us
I20260709 13:12:10.820202 29140 raft_consensus.cc:2749] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:10.877550 25270 leader_election.cc:304] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:12:10.877681 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:10.838083 28746 raft_consensus.cc:2804] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:10.857688 29174 leader_election.cc:290] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:10.811556 29158 consensus_queue.cc:1059] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 13:12:10.817605 29090 consensus_queue.cc:1048] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 13:12:10.890182 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:10.890754 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:12:10.898190 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 76738.4us
I20260709 13:12:10.867061 29163 raft_consensus.cc:740] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:10.898860 25195 leader_election.cc:304] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:10.889663 25874 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:10.782011 28742 consensus_queue.cc:260] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:10.902662 28742 raft_consensus.cc:3060] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:10.896564 25225 raft_consensus.cc:1240] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:10.867182 29009 raft_consensus.cc:2804] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:10.875309 29200 raft_consensus.cc:2804] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:10.901746 25195 leader_election.cc:304] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:10.910708 25226 raft_consensus.cc:2468] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 7.
I20260709 13:12:10.917634 25379 raft_consensus.cc:2468] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 11.
I20260709 13:12:10.918462 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:10.918970 25379 raft_consensus.cc:3060] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:10.866894 29195 consensus_queue.cc:1059] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:12:10.888980 29129 raft_consensus.cc:697] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 8 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:10.892072 29155 raft_consensus.cc:3055] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:10.899008 28972 leader_election.cc:290] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:10.941148 25226 raft_consensus.cc:1275] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:12:10.924538 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 106139us
I20260709 13:12:10.926890 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:10.885154 29167 leader_election.cc:290] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:10.897480 28781 raft_consensus.cc:2749] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:10.863073 29197 raft_consensus.cc:515] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:10.923774 25270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:10.920403 29185 leader_election.cc:290] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:10.958474 29155 raft_consensus.cc:740] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:10.899762 29141 leader_election.cc:290] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:10.867461 29138 raft_consensus.cc:515] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:10.900547 28746 raft_consensus.cc:697] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 9 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:10.929140 29068 leader_election.cc:290] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:10.921133 29200 raft_consensus.cc:493] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:10.979707 25270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:10.930346 29004 raft_consensus.cc:2804] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:12:10.970045 29170 consensus_meta.cc:287] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.694s	user 0.011s	sys 0.006s
I20260709 13:12:10.984552 25379 raft_consensus.cc:2468] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 12.
I20260709 13:12:11.022643 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:12:10.976984 29198 log.cc:927] Time spent T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:12:10.963670 29191 raft_consensus.cc:2804] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:10.929859 29009 raft_consensus.cc:697] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 9 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:10.976725 28972 raft_consensus.cc:2804] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:10.990064 29167 raft_consensus.cc:2804] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:11.064146 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:11.082417 25379 raft_consensus.cc:3060] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:11.083573 25304 raft_consensus.cc:2468] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 11.
W20260709 13:12:11.032636 29190 log.cc:927] Time spent T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.282s	user 0.001s	sys 0.001s
I20260709 13:12:11.084672 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:11.054688 25903 raft_consensus.cc:1240] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:11.033813 25873 leader_election.cc:304] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:11.004369 29144 raft_consensus.cc:2804] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:11.096410 25304 raft_consensus.cc:2468] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 10.
I20260709 13:12:11.098554 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:11.100193 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:10.990658 29131 leader_election.cc:290] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:11.097224 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 63505.8us
I20260709 13:12:11.101786 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:11.103900 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:11.107841 25905 raft_consensus.cc:2468] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 10.
W20260709 13:12:11.109551 28955 consensus_meta.cc:287] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.569s	user 0.009s	sys 0.000s
I20260709 13:12:11.110226 25304 raft_consensus.cc:1275] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:12:11.110086 28955 raft_consensus.cc:515] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:11.078748 29129 consensus_queue.cc:237] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:11.113086 28955 leader_election.cc:290] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:11.113688 28717 leader_election.cc:290] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:11.114153 29202 log.cc:927] Time spent T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
W20260709 13:12:11.114830 29201 log.cc:927] Time spent T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.242s	user 0.000s	sys 0.001s
I20260709 13:12:11.084564 28900 leader_election.cc:290] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:11.102587 29167 raft_consensus.cc:697] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 9 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:11.116660 29167 consensus_queue.cc:237] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:11.118345 29009 consensus_queue.cc:237] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:11.119097 25376 raft_consensus.cc:2468] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 9.
I20260709 13:12:11.120246 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:11.121848 25376 raft_consensus.cc:1240] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:11.122329 25303 raft_consensus.cc:1275] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:12:11.122766 25303 pending_rounds.cc:85] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19: Aborting all ops after (but not including) 8
I20260709 13:12:11.123024 25303 pending_rounds.cc:107] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:12:11.123286 25303 raft_consensus.cc:2889] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:12:11.128566 29204 log.cc:927] Time spent T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
W20260709 13:12:11.095882 29192 log.cc:927] Time spent T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.313s	user 0.000s	sys 0.001s
W20260709 13:12:11.133978 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 232286us
I20260709 13:12:11.085974 29154 raft_consensus.cc:697] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 11 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:11.014833 29200 raft_consensus.cc:3060] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:11.079710 29191 raft_consensus.cc:697] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:11.086015 29004 raft_consensus.cc:697] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 9 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:11.139622 25195 leader_election.cc:304] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:11.102530 29199 raft_consensus.cc:2749] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:11.102726 29144 raft_consensus.cc:493] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:11.155690 25195 leader_election.cc:304] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
W20260709 13:12:11.156556 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 230207us
I20260709 13:12:11.157610 25874 leader_election.cc:304] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:11.160426 25874 leader_election.cc:304] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:12:11.146914 29154 consensus_queue.cc:237] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:11.086400 28972 raft_consensus.cc:493] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:11.163182 25195 leader_election.cc:304] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:11.137404 25379 raft_consensus.cc:2468] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 7.
I20260709 13:12:11.055449 29170 raft_consensus.cc:515] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:11.172317 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:11.186249 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:11.188203 25379 raft_consensus.cc:1275] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:12:11.143252 29063 leader_election.cc:290] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:11.151633 29138 leader_election.cc:290] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:11.182050 25195 leader_election.cc:304] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:11.023877 29163 consensus_queue.cc:260] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:11.159488 28717 raft_consensus.cc:2804] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:11.159029 29144 raft_consensus.cc:3060] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:11.167107 29217 raft_consensus.cc:2749] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:11.184537 28781 raft_consensus.cc:2804] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:11.158087 29221 raft_consensus.cc:2749] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:11.184377 28972 raft_consensus.cc:3060] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:11.203547 25300 raft_consensus.cc:1240] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:12:11.196344 25195 leader_election.cc:304] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:11.087169 29155 consensus_queue.cc:260] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:11.212576 29210 raft_consensus.cc:493] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:11.198370 29197 leader_election.cc:290] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:11.214779 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:11.174068 28900 consensus_queue.cc:1048] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:12:11.189981 29219 raft_consensus.cc:2749] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:11.212932 29167 raft_consensus.cc:2804] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:11.205150 28781 raft_consensus.cc:493] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:11.221025 29170 leader_election.cc:290] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:11.157091 28746 consensus_queue.cc:237] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:11.199456 28717 raft_consensus.cc:493] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:11.199326 29068 raft_consensus.cc:2804] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:11.168417 29216 consensus_queue.cc:1059] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
W20260709 13:12:11.226788 28991 consensus_meta.cc:287] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.689s	user 0.009s	sys 0.003s
I20260709 13:12:11.201417 29063 consensus_queue.cc:1048] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:12:11.193461 29187 raft_consensus.cc:515] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:11.248301 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:11.250463 25905 raft_consensus.cc:1240] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:11.234669 29221 raft_consensus.cc:493] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.151588 29191 consensus_queue.cc:237] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:11.245626 29155 raft_consensus.cc:3060] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:11.235852 28781 raft_consensus.cc:3060] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:11.259626 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:11.257938 29167 raft_consensus.cc:697] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 7 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:11.255577 29068 raft_consensus.cc:493] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:11.252018 28717 raft_consensus.cc:3060] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:11.290488 29068 raft_consensus.cc:3060] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:11.224386 29004 consensus_queue.cc:237] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:11.317286 29225 log.cc:927] Time spent T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:12:11.224294 29214 consensus_queue.cc:1059] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:12:11.323737 25299 raft_consensus.cc:2410] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:12:11.328001 29194 consensus_queue.cc:1048] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:11.331194 29194 consensus_queue.cc:1059] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:11.332397 29207 consensus_queue.cc:1048] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:11.233430 29210 raft_consensus.cc:515] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:12:11.334036 29129 raft_consensus.cc:3055] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:11.334474 29129 raft_consensus.cc:740] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:11.335975 29210 leader_election.cc:290] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:11.335747 29129 consensus_queue.cc:260] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:11.290840 29167 consensus_queue.cc:237] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:11.256860 28991 raft_consensus.cc:515] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:11.307305 25270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:11.353781 28991 leader_election.cc:290] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:11.359368 25298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57256 (request call id 1970) took 2348 ms. Trace:
I20260709 13:12:11.359928 25298 rpcz_store.cc:276] 0709 13:12:09.008752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:09.010252 (+  1500us) service_pool.cc:224] Handling call
0709 13:12:09.037961 (+ 27709us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:09.953616 (+915655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:11.357221 (+1403605us) spinlock_profiling.cc:243] Waited 915 ms on lock 0x7b54000f9454. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:11.357435 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2104398592}
I20260709 13:12:11.360607 29147 raft_consensus.cc:3055] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:11.362165 25298 raft_consensus.cc:1240] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:11.312124 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:11.313369 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:12:11.316079 29224 log.cc:927] Time spent T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:12:11.337023 29210 raft_consensus.cc:493] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.342694 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
W20260709 13:12:11.291361 29229 log.cc:927] Time spent T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:12:11.345938 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:11.377413 29187 leader_election.cc:290] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:11.377562 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:11.346879 28986 raft_consensus.cc:3055] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:11.378544 28986 raft_consensus.cc:740] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:11.361239 29147 raft_consensus.cc:740] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:11.379668 29147 consensus_queue.cc:260] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:11.381377 28986 consensus_queue.cc:260] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:11.382951 29147 raft_consensus.cc:3060] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:11.365056 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:11.383770 25379 raft_consensus.cc:2393] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 9: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:11.384581 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:11.384841 28717 raft_consensus.cc:515] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:11.385149 25379 raft_consensus.cc:2468] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 11.
I20260709 13:12:11.363811 28991 raft_consensus.cc:493] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.386075 28991 raft_consensus.cc:515] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:11.386623 25302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46556 (request call id 518) took 1400 ms. Trace:
I20260709 13:12:11.388406 28991 leader_election.cc:290] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:11.264312 29221 raft_consensus.cc:515] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:11.390503 29221 leader_election.cc:290] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:11.391487 29144 raft_consensus.cc:515] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:11.366545 29227 log.cc:927] Time spent T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:12:11.394441 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:11.395303 25899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50058 (request call id 760) took 1212 ms. Trace:
I20260709 13:12:11.395637 25899 rpcz_store.cc:276] 0709 13:12:10.183264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:10.185379 (+  2115us) service_pool.cc:224] Handling call
0709 13:12:11.394269 (+1208890us) spinlock_profiling.cc:243] Waited 1.61 ms on lock 0x7b58001a3198. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72cb4ab71 00007fd72cb4aa22 00007fd735a63c09 00007fd734bbdee0 00007fd734c870ab 00007fd734c87131 00007fd734c350a0 00007fd734c34984 00007fd72e1af6d4 00007fd72e1af662
0709 13:12:11.395243 (+   974us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3692928}
I20260709 13:12:11.396457 29137 raft_consensus.cc:3060] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:11.396993 25899 raft_consensus.cc:1240] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:11.399277 25374 raft_consensus.cc:1275] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:12:11.385188 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:11.386392 28986 raft_consensus.cc:3060] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:11.403283 25906 raft_consensus.cc:3060] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:11.404762 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:11.405009 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:11.405385 25223 raft_consensus.cc:3060] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Advancing to term 13
I20260709 13:12:11.405854 25900 raft_consensus.cc:2368] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 6. Current term is 7.
I20260709 13:12:11.387068 25302 rpcz_store.cc:276] 0709 13:12:09.985988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:09.986459 (+   471us) service_pool.cc:224] Handling call
0709 13:12:11.386429 (+1399970us) spinlock_profiling.cc:243] Waited 477 ms on lock 0x7b54001694d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:11.386562 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1097028864}
I20260709 13:12:11.408429 25226 raft_consensus.cc:1240] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 9 LEADER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:11.374634 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:11.409471 25225 raft_consensus.cc:1275] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:12:11.307888 25874 leader_election.cc:304] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:12:11.412307 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:11.412907 25225 raft_consensus.cc:3060] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:11.368396 28781 raft_consensus.cc:515] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:11.412974 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 105396us
I20260709 13:12:11.414903 25226 raft_consensus.cc:1240] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 7. Current term is 9. Ops: []
I20260709 13:12:11.417665 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:11.420399 25227 raft_consensus.cc:3060] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:11.425949 25900 raft_consensus.cc:1240] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:11.373366 29129 raft_consensus.cc:3060] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:11.433475 25270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:11.444239 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:11.444600 25905 raft_consensus.cc:1240] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:12:11.445006 25228 raft_consensus.cc:3060] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:11.447690 25899 raft_consensus.cc:1275] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:12:11.438967 25227 raft_consensus.cc:2468] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 11.
I20260709 13:12:11.435369 25906 raft_consensus.cc:2468] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 9.
I20260709 13:12:11.393545 29144 leader_election.cc:290] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:11.451229 25271 leader_election.cc:304] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:11.453043 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:11.419894 29118 raft_consensus.cc:2804] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:11.347249 29200 raft_consensus.cc:515] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:11.455435 25270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:11.474011 25223 raft_consensus.cc:2468] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 13.
I20260709 13:12:11.460624 25225 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 8.
I20260709 13:12:11.453445 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:11.476987 25271 leader_election.cc:304] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:11.462221 25379 raft_consensus.cc:2393] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 9: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:11.464704 28717 leader_election.cc:290] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:11.465443 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:11.454934 25195 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
W20260709 13:12:11.461627 29234 log.cc:927] Time spent T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.088s	user 0.006s	sys 0.002s
I20260709 13:12:11.496069 25195 leader_election.cc:304] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:11.479035 25899 raft_consensus.cc:1240] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:12:11.489033 25228 raft_consensus.cc:2468] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 12.
I20260709 13:12:11.493861 29197 raft_consensus.cc:2749] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:11.493662 25901 raft_consensus.cc:2468] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 9.
I20260709 13:12:11.415099 29210 raft_consensus.cc:515] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:11.500386 25195 leader_election.cc:400] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 election: Vote denied by peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085) with higher term. Message: Invalid argument: T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 6. Current term is 7.
I20260709 13:12:11.500705 25195 leader_election.cc:403] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:12:11.501955 25907 raft_consensus.cc:1240] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:12:11.494889 29185 raft_consensus.cc:2749] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:11.494331 29008 consensus_queue.cc:1059] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:12:11.501279 28717 raft_consensus.cc:2749] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:11.477813 29118 raft_consensus.cc:697] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:11.512836 29197 consensus_queue.cc:1059] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:11.510188 29214 consensus_queue.cc:1059] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:12:11.506125 29206 consensus_queue.cc:1059] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:12:11.517853 29120 consensus_queue.cc:1059] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:11.518349 29237 consensus_queue.cc:1059] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:11.519450 29214 raft_consensus.cc:3055] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:11.519179 29118 consensus_queue.cc:237] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:11.519887 29214 raft_consensus.cc:740] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:11.520684 29214 consensus_queue.cc:260] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:11.519622 29208 consensus_queue.cc:1048] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:12:11.528254 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:11.530702 28781 leader_election.cc:290] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:11.532572 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:11.535530 29240 raft_consensus.cc:2749] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:11.536489 29239 raft_consensus.cc:493] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.537156 29239 raft_consensus.cc:515] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:11.538077 29199 raft_consensus.cc:3055] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:11.538513 29199 raft_consensus.cc:740] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:11.539113 29210 leader_election.cc:290] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:11.539347 29199 consensus_queue.cc:260] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:11.540685 29199 raft_consensus.cc:3060] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:11.500814 29144 consensus_queue.cc:1059] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:12:11.552227 29197 raft_consensus.cc:3055] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:11.552723 29197 raft_consensus.cc:740] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:11.553727 29197 consensus_queue.cc:260] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:11.555191 29197 raft_consensus.cc:3060] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:11.558499 25271 leader_election.cc:304] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:11.512516 29167 raft_consensus.cc:2749] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085) with higher term. Message: Invalid argument: T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 6. Current term is 7.
I20260709 13:12:11.559530 25270 leader_election.cc:304] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:12:11.561331 25872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:11.573005 25902 raft_consensus.cc:1240] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 LEADER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:11.555191 29163 raft_consensus.cc:3060] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:11.576074 25375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36264 (request call id 1785) took 1643 ms. Trace:
I20260709 13:12:11.577735 25378 raft_consensus.cc:1240] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 12 LEADER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:12:11.576709 25375 rpcz_store.cc:276] 0709 13:12:09.933135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:10.364111 (+430976us) service_pool.cc:224] Handling call
0709 13:12:11.575889 (+1211778us) spinlock_profiling.cc:243] Waited 779 ms on lock 0x7b54000e4cd4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:11.576021 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1791557376}
I20260709 13:12:11.576897 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:11.573782 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:11.576112 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:11.539353 29239 leader_election.cc:290] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:11.586500 29189 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.967s	user 0.007s	sys 0.012s
W20260709 13:12:11.587162 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 83486.1us
I20260709 13:12:11.528167 29185 consensus_queue.cc:1059] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 10.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 13:12:11.557297 28972 raft_consensus.cc:515] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:11.589454 25872 leader_election.cc:304] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:12:11.589845 25908 raft_consensus.cc:1275] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:12:11.590071 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:11.591061 25872 leader_election.cc:304] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:11.596167 25195 leader_election.cc:304] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:12:11.596843 28900 raft_consensus.cc:2804] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:11.598976 25271 leader_election.cc:304] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:11.600097 25271 leader_election.cc:304] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:12:11.587038 29189 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.070s	user 0.007s	sys 0.013s
I20260709 13:12:11.606200 25345 leader_election.cc:304] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:11.607463 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:11.607831 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:11.608242 25302 raft_consensus.cc:2368] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 11. Current term is 13.
I20260709 13:12:11.608327 29090 raft_consensus.cc:2749] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:11.607625 29147 consensus_queue.cc:1048] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:11.608986 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:11.608518 25297 raft_consensus.cc:2393] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 8: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:11.609985 29195 raft_consensus.cc:2804] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:11.610630 29195 raft_consensus.cc:697] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 11 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:11.607476 25345 leader_election.cc:304] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:11.611658 29195 consensus_queue.cc:237] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:11.612856 29090 raft_consensus.cc:2804] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:11.613341 29090 raft_consensus.cc:697] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 11 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:11.613874 29137 raft_consensus.cc:493] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.614457 29137 raft_consensus.cc:515] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:11.614849 29212 raft_consensus.cc:2804] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:11.615432 29212 raft_consensus.cc:697] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 13 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:11.615653 28986 raft_consensus.cc:2804] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:11.616178 28986 raft_consensus.cc:697] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 12 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:11.616559 29137 leader_election.cc:290] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:11.616288 29212 consensus_queue.cc:237] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:11.617151 29154 raft_consensus.cc:2804] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:11.617022 28986 consensus_queue.cc:237] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:11.617587 29154 raft_consensus.cc:493] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:11.614217 29090 consensus_queue.cc:237] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:12:11.619565 25225 raft_consensus.cc:1240] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 7. Current term is 8. Ops: []
W20260709 13:12:11.623683 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:11.624181 25225 raft_consensus.cc:1275] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:12:11.626124 25225 raft_consensus.cc:1240] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:11.626434 25223 raft_consensus.cc:1240] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:11.614120 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:11.628530 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:11.629551 25224 raft_consensus.cc:2393] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 8: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:11.584270 29208 raft_consensus.cc:3055] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:11.636832 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:11.637368 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:11.638494 25227 raft_consensus.cc:1240] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:11.632438 28961 raft_consensus.cc:2804] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:11.636533 29208 raft_consensus.cc:740] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:11.639750 28961 raft_consensus.cc:697] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 9 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:11.640306 29208 consensus_queue.cc:260] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:11.640678 28961 consensus_queue.cc:237] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:11.642251 25221 raft_consensus.cc:1240] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:11.642765 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:11.634637 25343 leader_election.cc:304] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:11.567325 29160 consensus_queue.cc:1059] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:12:11.645888 25270 leader_election.cc:304] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:11.622934 29154 raft_consensus.cc:3060] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:11.648679 25343 leader_election.cc:304] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:11.632637 28900 raft_consensus.cc:697] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:11.652443 29143 raft_consensus.cc:2749] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:11.573346 29124 consensus_queue.cc:1048] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:12:11.644486 29208 raft_consensus.cc:3060] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:11.633694 28781 raft_consensus.cc:2804] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:12:11.693828 29248 log.cc:927] Time spent T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
W20260709 13:12:11.669621 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:11.619323 29187 consensus_queue.cc:1048] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:12:11.644253 29200 leader_election.cc:290] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:12:11.707828 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:11.637938 29144 consensus_queue.cc:1059] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.068s
I20260709 13:12:11.624838 29167 consensus_queue.cc:1048] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 13:12:11.633361 29155 consensus_queue.cc:1048] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.060s
W20260709 13:12:11.715631 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 93464.8us
W20260709 13:12:11.771042 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 55054.1us
W20260709 13:12:11.769070 29236 log.cc:927] Time spent T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
W20260709 13:12:11.819782 25873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:11.728018 25300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46556 (request call id 524) took 1703 ms. Trace:
I20260709 13:12:11.842478 25300 rpcz_store.cc:276] 0709 13:12:10.024716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:10.041460 (+ 16744us) service_pool.cc:224] Handling call
0709 13:12:10.041774 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:11.210421 (+1168647us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:11.727706 (+517285us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b5400099554. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:11.727950 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2670935296}
I20260709 13:12:11.729321 25378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36254 (request call id 2126) took 1119 ms. Trace:
I20260709 13:12:11.844406 25378 rpcz_store.cc:276] 0709 13:12:10.609692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:10.733137 (+123445us) service_pool.cc:224] Handling call
0709 13:12:11.577369 (+844232us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:11.578319 (+   950us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:11.729102 (+150783us) spinlock_profiling.cc:243] Waited 844 ms on lock 0x7b54000e4cd0. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6e8ad 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:11.729256 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1940614912}
W20260709 13:12:11.934953 29243 log.cc:927] Time spent T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.203s	user 0.000s	sys 0.000s
I20260709 13:12:11.722599 29162 raft_consensus.cc:2749] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:11.705179 29160 consensus_queue.cc:1243] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer 1f539ba21487460085b837e7529a78ce log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:12:11.720881 29210 raft_consensus.cc:3055] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:11.971773 29200 raft_consensus.cc:493] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:11.971666 25873 leader_election.cc:336] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 1.528s (SENT)
I20260709 13:12:11.991585 29200 raft_consensus.cc:515] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:11.992491 25873 leader_election.cc:336] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 1.571s (SENT)
I20260709 13:12:11.974148 29123 leader_election.cc:290] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:11.993945 29123 consensus_queue.cc:1059] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:11.994427 29200 leader_election.cc:290] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:11.995087 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:11.995545 28972 leader_election.cc:290] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:11.993409 25873 leader_election.cc:336] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 1.579s (SENT)
W20260709 13:12:11.999214 29241 log.cc:927] Time spent T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260709 13:12:11.998137 29210 raft_consensus.cc:740] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:12.000357 25297 raft_consensus.cc:1240] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 10 LEADER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:11.982723 29104 raft_consensus.cc:493] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:12.002439 29104 raft_consensus.cc:515] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:11.769513 29220 consensus_queue.cc:1059] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.325s
I20260709 13:12:11.716718 28900 consensus_queue.cc:237] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:11.979701 29154 raft_consensus.cc:515] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:11.980556 28781 raft_consensus.cc:493] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
W20260709 13:12:11.982080 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 333452us
I20260709 13:12:11.983837 25300 raft_consensus.cc:1240] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:11.720084 28991 raft_consensus.cc:3055] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:12:11.985898 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 340117us
I20260709 13:12:11.986428 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:11.988063 29191 consensus_queue.cc:1048] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:11.988762 29239 consensus_queue.cc:1059] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:11.716914 29194 raft_consensus.cc:2749] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:11.724493 29068 raft_consensus.cc:515] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:11.984880 29120 raft_consensus.cc:493] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:11.717296 29221 raft_consensus.cc:3055] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:11.806315 28801 consensus_queue.cc:1059] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.150s
I20260709 13:12:11.722836 29185 consensus_queue.cc:1059] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.255s
I20260709 13:12:11.971037 29143 raft_consensus.cc:493] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.015051 25343 leader_election.cc:304] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:12.016944 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:12.050768 25222 raft_consensus.cc:1240] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 9. Current term is 10. Ops: []
W20260709 13:12:12.023752 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 196417us
I20260709 13:12:12.018090 28781 raft_consensus.cc:3060] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:12.018474 28991 raft_consensus.cc:740] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:12.030457 29221 raft_consensus.cc:740] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:12.025007 29104 leader_election.cc:290] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:12.090590 25304 raft_consensus.cc:1240] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
W20260709 13:12:12.093619 25373 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.036s	sys 0.067s
W20260709 13:12:12.094120 25373 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.036s	sys 0.067s
I20260709 13:12:12.046927 29155 consensus_queue.cc:1059] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 10.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:12:12.051949 29239 raft_consensus.cc:493] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:12.100054 29257 raft_consensus.cc:493] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.111577 29208 consensus_queue.cc:1059] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:12:12.031530 29120 raft_consensus.cc:515] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:12.054404 29143 raft_consensus.cc:515] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:12.127466 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 77518us
I20260709 13:12:12.139010 25343 leader_election.cc:304] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:12.141397 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:12.139195 29163 consensus_meta.cc:287] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.564s	user 0.009s	sys 0.001s
W20260709 13:12:12.140774 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 328488us
I20260709 13:12:12.149287 25228 raft_consensus.cc:1240] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:12.149739 25194 leader_election.cc:304] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:12.150487 29167 consensus_queue.cc:1048] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:12.150774 29144 raft_consensus.cc:2749] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:12.152536 25194 leader_election.cc:304] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:12.152694 29147 raft_consensus.cc:493] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
W20260709 13:12:12.140626 29211 log.cc:927] Time spent T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.312s	user 0.001s	sys 0.000s
I20260709 13:12:12.167963 25901 raft_consensus.cc:1240] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:12.134748 29262 raft_consensus.cc:493] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:12.177434 25230 raft_consensus.cc:1275] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:12:12.175629 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:12.116149 29239 raft_consensus.cc:515] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:12.155295 25908 raft_consensus.cc:1240] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:12.161872 25194 leader_election.cc:304] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:12.178622 25195 leader_election.cc:304] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:12:12.205402 29259 raft_consensus.cc:2804] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:12.206025 29259 raft_consensus.cc:493] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
W20260709 13:12:12.205457 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 43714.1us
I20260709 13:12:12.209894 25194 leader_election.cc:304] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:12.139699 29194 raft_consensus.cc:2749] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:12.214911 25194 leader_election.cc:304] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:12.127357 29257 raft_consensus.cc:515] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:12.123981 29221 consensus_queue.cc:260] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:12.180470 29220 raft_consensus.cc:493] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.218713 25194 leader_election.cc:304] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:12.153343 29167 raft_consensus.cc:2749] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:12.191186 29002 raft_consensus.cc:3055] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:12.206494 29259 raft_consensus.cc:3060] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:12.153483 29147 raft_consensus.cc:515] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:12.236656 29221 raft_consensus.cc:3060] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:12.249985 25194 leader_election.cc:304] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:12.180771 29187 consensus_queue.cc:1059] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
W20260709 13:12:12.257314 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 208959us
I20260709 13:12:12.215283 29240 raft_consensus.cc:2749] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:12.236927 25228 raft_consensus.cc:1275] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:12:12.179679 29270 consensus_queue.cc:1059] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 13:12:12.186290 29262 raft_consensus.cc:515] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:12.216429 29199 consensus_queue.cc:1048] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:12:12.235566 29002 raft_consensus.cc:740] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
W20260709 13:12:12.263343 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 211487us
I20260709 13:12:12.166568 29210 consensus_queue.cc:260] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:12.252415 29068 leader_election.cc:290] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:12.216106 29144 consensus_queue.cc:1059] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:12:12.288156 25872 leader_election.cc:304] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:12.245936 28961 raft_consensus.cc:2749] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:12.271739 25194 leader_election.cc:304] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:12.237051 29220 raft_consensus.cc:515] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:12.253904 29104 raft_consensus.cc:2749] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:12.279623 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:12.280956 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:12.281951 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:12.253723 29154 leader_election.cc:290] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:12.256628 29167 raft_consensus.cc:493] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:12.259543 29194 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.287743 25298 raft_consensus.cc:1240] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 11 LEADER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:12.306854 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:12.286065 29270 raft_consensus.cc:493] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
W20260709 13:12:12.302132 29256 log.cc:927] Time spent T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
W20260709 13:12:12.301416 29254 log.cc:927] Time spent T 00000000000000000000000000000000 P 5140a3161b944724a989995efdc4a818: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260709 13:12:12.262784 29261 raft_consensus.cc:2749] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:12.305160 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:12.327687 25373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36254 (request call id 2115) took 2113 ms. Trace:
I20260709 13:12:12.304307 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:12.328912 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:12.314930 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:12.315408 25296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57272 (request call id 1847) took 1709 ms. Trace:
I20260709 13:12:12.300657 29195 raft_consensus.cc:493] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.317363 25301 raft_consensus.cc:2468] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 10.
I20260709 13:12:12.328087 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:12.330891 25300 raft_consensus.cc:2468] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 10.
I20260709 13:12:12.329815 25296 rpcz_store.cc:276] 0709 13:12:10.606101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:10.754519 (+148418us) service_pool.cc:224] Handling call
0709 13:12:12.306751 (+1552232us) spinlock_profiling.cc:243] Waited 1.09 ms on lock 0x7b5800114098. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72cb4ab71 00007fd72cb4aeee 0000000000375939 00007fd734bbe1e0 00007fd734c870c4 00007fd734c87131 00007fd734c350a0 00007fd734c34984 00007fd72e1af6d4 00007fd72e1af662
0709 13:12:12.315351 (+  8600us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2501504}
I20260709 13:12:12.333544 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:12.332590 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:12.343430 25297 raft_consensus.cc:1240] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:12.314932 29104 raft_consensus.cc:493] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:12.345889 29104 raft_consensus.cc:515] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:12.304947 29160 raft_consensus.cc:493] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.309808 29144 raft_consensus.cc:2749] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:12.303918 29260 raft_consensus.cc:2804] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:12.361290 28991 consensus_queue.cc:260] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:12.303224 29267 consensus_queue.cc:1059] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 13:12:12.353163 29143 leader_election.cc:290] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:12.364923 25222 raft_consensus.cc:1240] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 9 LEADER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:12.355756 29170 raft_consensus.cc:3055] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:12.366779 29170 raft_consensus.cc:740] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:12.305001 29068 raft_consensus.cc:2749] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:12.310412 29266 raft_consensus.cc:493] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
W20260709 13:12:12.376372 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:12.303297 29187 raft_consensus.cc:2749] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:12.447742 25873 leader_election.cc:304] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:12.448408 29220 leader_election.cc:290] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:12.449138 29213 raft_consensus.cc:2749] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:12:12.390317 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 251378us
I20260709 13:12:12.342839 29129 raft_consensus.cc:493] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:12.450047 29129 raft_consensus.cc:515] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:12.451043 29187 consensus_queue.cc:1048] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:12.451694 29118 consensus_queue.cc:1048] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:12.407838 25370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56308 (request call id 624) took 2527 ms. Trace:
I20260709 13:12:12.452796 25370 rpcz_store.cc:276] 0709 13:12:09.883856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:10.397210 (+513354us) service_pool.cc:224] Handling call
0709 13:12:10.626161 (+228951us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:10.626390 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:10.626427 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:10.626477 (+    50us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:12:10.626519 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:10.626588 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:12.407582 (+1780994us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b540009c9d0. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6e8ad 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:12.407748 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":424104704}
I20260709 13:12:12.420387 25904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50060 (request call id 657) took 1617 ms. Trace:
W20260709 13:12:12.420624 29253 log.cc:927] Time spent T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
W20260709 13:12:12.421422 29258 log.cc:927] Time spent T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260709 13:12:12.431252 29139 raft_consensus.cc:3055] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:12.440779 29199 raft_consensus.cc:493] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.314893 29167 raft_consensus.cc:515] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:12.444907 25872 leader_election.cc:304] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:12.352968 29195 raft_consensus.cc:515] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:12.447921 28991 raft_consensus.cc:3060] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:12.449193 29104 leader_election.cc:290] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:12.326169 29265 raft_consensus.cc:3055] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:12.367894 29170 consensus_queue.cc:260] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.4, Last appended by leader: 4, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:12:12.328064 25373 rpcz_store.cc:276] 0709 13:12:10.213932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:10.463101 (+249169us) service_pool.cc:224] Handling call
0709 13:12:10.463409 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:10.463624 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:12:10.473815 (+ 10191us) log.cc:844] Serialized 14 byte log entry
0709 13:12:11.543128 (+1069313us) spinlock_profiling.cc:243] Waited 1.99 ms on lock 0x7b18000f31c0. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72cb64e07 00007fd7359bfab9 00007fd72cb8169b 00007fd72cb7f93f 00007fd72cb81c02 00007fd72f80920b 00007fd72f80ed23 00007fd72f80f23a 00007fd72fc79a2a
0709 13:12:12.327141 (+784013us) log.cc:844] Serialized 14 byte log entry
0709 13:12:12.327369 (+   228us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:12.327417 (+    48us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:12.327463 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:12.327527 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:12.327631 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":3807,"prepare.run_cpu_time_us":4516,"prepare.run_wall_time_us":17965,"raft.queue_time_us":57892,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":106,"spinlock_wait_cycles":4578688,"thread_start_us":781394,"threads_started":2,"wal-append.queue_time_us":1718853}
W20260709 13:12:12.458087 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 186426us
I20260709 13:12:12.454079 25904 rpcz_store.cc:276] 0709 13:12:10.803169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:10.803273 (+   104us) service_pool.cc:224] Handling call
0709 13:12:10.811488 (+  8215us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:10.814555 (+  3067us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:12.420094 (+1605539us) spinlock_profiling.cc:243] Waited 2.45 ms on lock 0x7b54004d6554. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:12.420314 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5624064}
I20260709 13:12:12.463194 25222 raft_consensus.cc:1240] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:12.326363 29194 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:12.469583 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 251496us
I20260709 13:12:12.328114 29270 raft_consensus.cc:515] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:12.478106 25270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:12.481743 25872 leader_election.cc:304] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:12.482026 25376 raft_consensus.cc:1240] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 10. Current term is 11. Ops: [8.5-10.6]
I20260709 13:12:12.482466 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:12.356688 29260 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:12.482995 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:12.541154 25379 raft_consensus.cc:3060] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:12.484012 29257 leader_election.cc:290] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:12.484908 25374 raft_consensus.cc:1275] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:12:12.543960 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:12.450064 29213 consensus_queue.cc:1059] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:12:12.486430 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:12.482115 29120 leader_election.cc:290] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:12.578404 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 120931us
I20260709 13:12:12.372567 29002 consensus_queue.cc:260] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:12.347453 29160 raft_consensus.cc:515] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:12.494629 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 43960.2us
W20260709 13:12:12.517621 25195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:12.519979 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:12.467566 28984 raft_consensus.cc:493] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.467408 29139 raft_consensus.cc:740] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:12.467748 28694 raft_consensus.cc:493] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
W20260709 13:12:12.542629 25270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:12.586344 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 319762us
I20260709 13:12:12.585381 25195 leader_election.cc:304] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:12.587015 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:12.483069 29187 raft_consensus.cc:2749] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:12:12.544240 29253 log.cc:927] Time spent T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:12:12.543241 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:12.546487 25371 raft_consensus.cc:3060] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:12.486627 25370 raft_consensus.cc:1275] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:12:12.489162 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:12:12.583860 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 64008.1us
I20260709 13:12:12.587929 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:12.493525 29265 raft_consensus.cc:740] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:12.589208 25304 raft_consensus.cc:2410] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:12:12.589550 25377 raft_consensus.cc:1275] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:12:12.407038 29266 raft_consensus.cc:515] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:12.592694 25195 leader_election.cc:304] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
W20260709 13:12:12.636123 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:12.638310 25379 raft_consensus.cc:2468] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 11.
I20260709 13:12:12.650355 25375 raft_consensus.cc:2468] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 10.
W20260709 13:12:12.583822 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 55039.2us
I20260709 13:12:12.653321 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:12.660210 25296 raft_consensus.cc:3060] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:12.660542 25194 leader_election.cc:400] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Vote denied by peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127) with higher term. Message: Invalid argument: T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 11. Current term is 13.
I20260709 13:12:12.660990 25194 leader_election.cc:403] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:12.544787 29260 raft_consensus.cc:3060] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:12.488094 29199 raft_consensus.cc:515] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:12.544324 29250 consensus_queue.cc:1048] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.114s
I20260709 13:12:12.528705 29104 consensus_queue.cc:1059] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.100s
W20260709 13:12:12.681820 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 89211.9us
I20260709 13:12:12.629868 29257 raft_consensus.cc:2804] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:12.653505 29120 raft_consensus.cc:493] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:12.547360 29276 consensus_queue.cc:1048] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.131s
I20260709 13:12:12.671608 25296 raft_consensus.cc:2468] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 10.
I20260709 13:12:12.595932 29239 leader_election.cc:290] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:12.657544 29196 raft_consensus.cc:493] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:12.683873 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 142828us
I20260709 13:12:12.582273 29147 leader_election.cc:290] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:12.685781 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:12.718201 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:12.626585 28694 raft_consensus.cc:515] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:12.685050 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:12:12.676898 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 195219us
I20260709 13:12:12.723001 25872 leader_election.cc:304] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:12.723199 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:12.703733 29281 raft_consensus.cc:2749] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127) with higher term. Message: Invalid argument: T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 11. Current term is 13.
I20260709 13:12:12.724447 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:12.669824 29213 raft_consensus.cc:2749] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:12.655177 29200 consensus_queue.cc:1048] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 13:12:12.595606 28984 raft_consensus.cc:515] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:12.719359 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:12:12.688375 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 104437us
I20260709 13:12:12.670069 29002 raft_consensus.cc:3060] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:12.730182 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:12.750130 25375 raft_consensus.cc:3060] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:12.750591 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:12.728930 29199 leader_election.cc:290] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:12.681504 29269 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:12.732277 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:12.733155 25379 raft_consensus.cc:1275] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:12:12.762979 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:12.736800 25373 raft_consensus.cc:2410] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:12:12.741817 29274 raft_consensus.cc:493] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.705789 29262 leader_election.cc:290] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:12.704469 29278 raft_consensus.cc:2804] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:12.720969 29257 raft_consensus.cc:697] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 12 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:12.718003 29120 raft_consensus.cc:515] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:12.764103 29197 consensus_meta.cc:287] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 1.188s	user 0.016s	sys 0.003s
I20260709 13:12:12.759970 29261 raft_consensus.cc:3055] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:12.784607 29261 raft_consensus.cc:740] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
W20260709 13:12:12.775089 29263 log.cc:927] Time spent T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.363s	user 0.000s	sys 0.001s
I20260709 13:12:12.738224 29147 consensus_queue.cc:1059] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:12:12.785175 29199 raft_consensus.cc:2749] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:12.774439 29104 raft_consensus.cc:3055] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:12.801847 25375 raft_consensus.cc:2468] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 10.
I20260709 13:12:12.747665 29239 consensus_queue.cc:1048] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
W20260709 13:12:12.785208 29275 log.cc:927] Time spent T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
W20260709 13:12:12.808862 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 77678.3us
I20260709 13:12:12.785562 28984 leader_election.cc:290] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:12.720685 29196 raft_consensus.cc:515] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:12.714409 29139 consensus_queue.cc:260] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:12.816104 29282 raft_consensus.cc:493] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.816250 29160 leader_election.cc:290] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:12.782343 29278 raft_consensus.cc:493] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
W20260709 13:12:12.815945 29280 log.cc:927] Time spent T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:12:12.807237 29104 raft_consensus.cc:740] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:12.780118 29262 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:12.816712 29282 raft_consensus.cc:515] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:12.818868 29287 log.cc:927] Time spent T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:12:12.821707 29195 leader_election.cc:290] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:12.773253 29269 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:12.786564 29274 raft_consensus.cc:515] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:12.822652 29278 raft_consensus.cc:3060] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:12.785828 29261 consensus_queue.cc:260] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:12.832082 29284 log.cc:927] Time spent T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 13:12:12.832890 29270 leader_election.cc:290] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:12.834259 29265 consensus_queue.cc:260] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:12.837538 29294 log.cc:927] Time spent T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:12:12.838090 29265 raft_consensus.cc:3060] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:12.839555 29274 leader_election.cc:290] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:12.840335 29266 leader_election.cc:290] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:12.827620 29257 consensus_queue.cc:237] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:12.844357 29259 consensus_meta.cc:287] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 0.591s	user 0.009s	sys 0.006s
I20260709 13:12:12.824971 29262 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:12.847994 29262 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:12.844779 29259 raft_consensus.cc:515] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:12.848784 29282 leader_election.cc:290] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:12.850211 29259 leader_election.cc:290] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:12.851315 29278 raft_consensus.cc:515] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:12.856421 29278 leader_election.cc:290] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:12.858336 29260 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:12.888682 25224 raft_consensus.cc:1240] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:12.740772 25195 leader_election.cc:304] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:12.723806 25222 raft_consensus.cc:2468] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 10.
I20260709 13:12:12.747121 25223 raft_consensus.cc:2393] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 10: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
W20260709 13:12:12.905079 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:12.908846 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 327116us
W20260709 13:12:12.910418 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 163174us
I20260709 13:12:12.911617 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:12.912624 25904 raft_consensus.cc:1275] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:12:12.913286 25228 raft_consensus.cc:2393] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 8: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:12.921267 29187 consensus_queue.cc:1059] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:12.924521 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:12.922168 29120 leader_election.cc:290] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:12.899349 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:12.926348 29120 consensus_queue.cc:1059] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:12.927414 25223 raft_consensus.cc:2468] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 6.
I20260709 13:12:12.927784 29120 raft_consensus.cc:3055] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:12.928365 29120 raft_consensus.cc:740] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:12.929060 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:12.931285 29120 consensus_queue.cc:260] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:12.941982 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:12:12.933727 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 200519us
I20260709 13:12:12.935318 29120 raft_consensus.cc:3060] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:12.942196 29194 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:13.004772 29259 raft_consensus.cc:493] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.006580 28972 raft_consensus.cc:3055] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:13.010466 25375 raft_consensus.cc:1240] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:13.024302 29300 consensus_queue.cc:1048] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:12:13.026525 25223 raft_consensus.cc:2393] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 11: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:13.028424 25223 raft_consensus.cc:1240] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:12:13.030532 25222 raft_consensus.cc:2410] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:12:13.030614 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:13.031599 25905 raft_consensus.cc:2468] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 11.
I20260709 13:12:13.032485 25222 raft_consensus.cc:1275] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:12:13.032855 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:13.033361 28746 raft_consensus.cc:3055] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:13.033882 28746 raft_consensus.cc:740] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:12.860481 29260 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:13.035905 28746 consensus_queue.cc:260] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:13.038640 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:13.040729 25222 raft_consensus.cc:1240] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:12:13.041326 29063 raft_consensus.cc:3055] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:13.041818 29063 raft_consensus.cc:740] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:13.041970 29259 raft_consensus.cc:515] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:13.011200 28972 raft_consensus.cc:740] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:13.048087 25222 raft_consensus.cc:1275] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:12:13.054772 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:13.058395 29313 raft_consensus.cc:3055] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:13.062340 29313 raft_consensus.cc:740] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:13.067369 25228 raft_consensus.cc:1240] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:13.067855 25227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 2094) took 1441 ms. Trace:
I20260709 13:12:13.068269 25227 rpcz_store.cc:276] 0709 13:12:11.626313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:11.626430 (+   117us) service_pool.cc:224] Handling call
0709 13:12:11.626673 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:11.638927 (+ 12254us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:13.067318 (+1428391us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b540025cbd4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:13.067647 (+   329us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26773376}
I20260709 13:12:13.071552 25298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57256 (request call id 1996) took 1377 ms. Trace:
I20260709 13:12:13.072064 25298 rpcz_store.cc:276] 0709 13:12:11.693983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:11.694097 (+   114us) service_pool.cc:224] Handling call
0709 13:12:11.694425 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:12.312600 (+618175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:13.070937 (+758337us) spinlock_profiling.cc:243] Waited 591 ms on lock 0x7b540018ced4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:13.071275 (+   338us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1358242176}
I20260709 13:12:13.077282 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:13.077927 29303 raft_consensus.cc:493] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:13.078851 28972 consensus_queue.cc:260] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:13.105783 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:13.078958 29303 raft_consensus.cc:515] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:13.127741 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:13.128485 25902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50058 (request call id 764) took 2166 ms. Trace:
I20260709 13:12:13.130699 25902 rpcz_store.cc:276] 0709 13:12:10.962318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:11.087736 (+125418us) service_pool.cc:224] Handling call
0709 13:12:11.105244 (+ 17508us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:11.573613 (+468369us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:13.127940 (+1554327us) spinlock_profiling.cc:243] Waited 467 ms on lock 0x7b54006c0554. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:13.128261 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1075232640}
I20260709 13:12:13.132079 29303 leader_election.cc:290] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:13.073364 29162 raft_consensus.cc:3055] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:13.132853 29162 raft_consensus.cc:740] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:13.106534 29313 consensus_queue.cc:260] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:13.135632 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:13.105896 29257 raft_consensus.cc:2749] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:13.137528 29162 consensus_queue.cc:260] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:13.138651 29210 raft_consensus.cc:3060] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:13.132100 29196 leader_election.cc:290] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:13.140096 29196 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.140836 29196 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:13.112635 25300 raft_consensus.cc:1275] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:12:13.142364 25300 pending_rounds.cc:85] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19: Aborting all ops after (but not including) 6
I20260709 13:12:13.142982 25300 pending_rounds.cc:107] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:12:13.143307 25300 raft_consensus.cc:2889] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:13.145380 29222 raft_consensus.cc:3055] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:12:13.142520 29309 log.cc:927] Time spent T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.185s	user 0.003s	sys 0.000s
I20260709 13:12:13.145839 29222 raft_consensus.cc:740] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
W20260709 13:12:13.142702 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:13.105697 28972 raft_consensus.cc:3060] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:13.149271 29222 consensus_queue.cc:260] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:13.160107 25371 consensus_meta.cc:287] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.509s	user 0.006s	sys 0.013s
W20260709 13:12:13.162031 29247 log.cc:927] Time spent T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 1.149s	user 0.009s	sys 0.005s
I20260709 13:12:12.410125 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:12:13.175505 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:13.175765 29222 raft_consensus.cc:3060] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:13.208483 25371 raft_consensus.cc:2468] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 10.
I20260709 13:12:13.208791 25229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 2076) took 2343 ms. Trace:
I20260709 13:12:13.209172 25229 rpcz_store.cc:276] 0709 13:12:10.865315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:10.867166 (+  1851us) service_pool.cc:224] Handling call
0709 13:12:10.885713 (+ 18547us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:11.401644 (+515931us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b18000df000. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72f8174bc 00007fd72cb6548b 00007fd7359bfab9 00007fd72cb8169b 00007fd72cb7f93f 00007fd72cb7f455 00007fd72fc67060 00007fd72fc67bfb 00007fd72fc7264b
0709 13:12:11.401802 (+   158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:11.401827 (+    25us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:11.402407 (+   580us) log.cc:844] Serialized 52 byte log entry
0709 13:12:11.503665 (+101258us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:11.503706 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:11.503774 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:13.149957 (+1646183us) spinlock_profiling.cc:243] Waited 1.79 ms on lock 0x7b4400022b4c. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72caa8c85 00007fd72caa96a2 00007fd72f81b1db 00007fd72f816aaf 00007fd72f80a86e 00007fd72f809bb6 00007fd72f8097d8 00007fd72f813221 00007fd72f8131d9 00007fd72f813169
0709 13:12:13.208326 (+ 58369us) raft_consensus.cc:1685] finished
0709 13:12:13.208352 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:13.208622 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":97555,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":67975,"spinlock_wait_cycles":33734656,"thread_start_us":269188,"threads_started":2,"wal-append.queue_time_us":343740}
I20260709 13:12:13.209194 29129 leader_election.cc:290] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:13.218530 25872 leader_election.cc:304] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:13.220342 29286 raft_consensus.cc:493] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:13.221263 29286 raft_consensus.cc:515] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:13.283543 25305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57256 (request call id 1981) took 2493 ms. Trace:
I20260709 13:12:13.284281 25374 raft_consensus.cc:1240] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:13.284157 25305 rpcz_store.cc:276] 0709 13:12:10.760279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:10.846422 (+ 86143us) service_pool.cc:224] Handling call
0709 13:12:10.846744 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:12.150431 (+1303687us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:12.150462 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:12.150503 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:12.150538 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:13.217486 (+1066948us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b54002fba54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:13.217547 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:13.253308 (+ 35761us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2997751680}
W20260709 13:12:13.284790 25230 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.000s	sys 0.025s
W20260709 13:12:13.284013 29077 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.132s	user 0.005s	sys 0.026s
I20260709 13:12:13.294112 29226 raft_consensus.cc:493] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.294324 29307 raft_consensus.cc:493] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:13.286446 29303 raft_consensus.cc:493] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:13.292798 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:13.286459 29259 leader_election.cc:290] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:13.295560 29196 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:13.298825 29002 consensus_meta.cc:287] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.540s	user 0.009s	sys 0.009s
I20260709 13:12:13.293284 28746 raft_consensus.cc:3060] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:13.299888 29077 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.158s	user 0.005s	sys 0.026s
I20260709 13:12:13.306344 29312 raft_consensus.cc:493] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.299345 29286 leader_election.cc:290] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:12:13.316524 28991 consensus_meta.cc:287] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.822s	user 0.008s	sys 0.014s
I20260709 13:12:13.312268 29307 raft_consensus.cc:515] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:13.320132 29312 raft_consensus.cc:515] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:13.324033 29303 raft_consensus.cc:515] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:13.334975 29307 leader_election.cc:290] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:13.335204 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 117037us
I20260709 13:12:13.336041 29303 leader_election.cc:290] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:12:13.331091 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 544648us
I20260709 13:12:13.348752 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:13.341789 29261 raft_consensus.cc:3060] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:13.358726 25372 raft_consensus.cc:1240] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 9 LEADER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:13.359151 29312 leader_election.cc:290] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:13.342928 29259 raft_consensus.cc:493] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.352121 29162 raft_consensus.cc:3060] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:13.327355 29226 raft_consensus.cc:515] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:13.364861 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:13.364847 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:13.357268 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:13.373817 25370 raft_consensus.cc:1240] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:13.374063 29063 consensus_queue.cc:260] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:13.376940 29267 raft_consensus.cc:493] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:13.377735 29267 raft_consensus.cc:515] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:13.378536 28781 consensus_meta.cc:287] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent flushing consensus metadata: real 1.226s	user 0.033s	sys 0.021s
I20260709 13:12:13.378701 29104 consensus_queue.cc:260] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:13.379019 28781 raft_consensus.cc:515] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:13.379869 29104 raft_consensus.cc:3060] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:13.380141 25904 raft_consensus.cc:1240] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:13.381201 29144 raft_consensus.cc:493] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.383867 25905 raft_consensus.cc:2410] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:12:13.384887 25379 raft_consensus.cc:2410] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:12:13.383493 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:13.367678 29124 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.390012 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:13.392633 25902 raft_consensus.cc:2393] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 9: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:13.393240 25901 raft_consensus.cc:2393] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 11: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:12:13.392773 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:13.397728 28781 leader_election.cc:290] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:13.400049 25871 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:13.401477 25229 raft_consensus.cc:1275] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:12:13.381836 29144 raft_consensus.cc:515] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:13.407580 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:13.406375 25195 leader_election.cc:304] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:13.414963 25899 raft_consensus.cc:1275] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:12:13.414680 29124 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:13.404536 29312 raft_consensus.cc:493] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:13.407019 29267 leader_election.cc:290] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:13.427379 29226 leader_election.cc:290] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:13.429379 29245 log.cc:927] Time spent T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 1.810s	user 0.000s	sys 0.005s
I20260709 13:12:13.429666 29124 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:13.430359 29267 raft_consensus.cc:2804] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:13.432821 25370 raft_consensus.cc:2468] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 10.
W20260709 13:12:13.433396 25194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:13.431308 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:13.433738 25225 raft_consensus.cc:2468] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 9.
I20260709 13:12:13.430382 25195 leader_election.cc:304] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:13.437117 25902 raft_consensus.cc:1275] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 LEARNER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:12:13.439322 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:13.440693 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:13.441447 25229 raft_consensus.cc:2468] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 10.
I20260709 13:12:13.412515 29259 raft_consensus.cc:515] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:13.444027 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:13.433197 29312 raft_consensus.cc:515] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:13.446312 25194 leader_election.cc:304] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:13.447990 25194 leader_election.cc:304] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:13.448079 29312 leader_election.cc:290] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:13.465718 25373 raft_consensus.cc:1240] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:13.467007 25373 raft_consensus.cc:1240] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:13.459656 25872 leader_election.cc:304] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:12:13.484311 25194 leader_election.cc:304] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:13.485224 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 53602.8us
I20260709 13:12:13.485450 29278 raft_consensus.cc:2749] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:13.472334 25370 raft_consensus.cc:2410] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
W20260709 13:12:13.489612 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:13.490572 29213 raft_consensus.cc:2804] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:13.491122 29213 raft_consensus.cc:697] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:13.492223 25376 raft_consensus.cc:1275] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:12:13.494940 25374 raft_consensus.cc:1240] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:13.495867 29077 raft_consensus.cc:493] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.496541 25374 raft_consensus.cc:1275] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:12:13.496465 29077 raft_consensus.cc:515] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:13.498857 29077 leader_election.cc:290] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:13.479072 29123 raft_consensus.cc:2804] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:13.499835 29123 raft_consensus.cc:493] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:13.500262 29123 raft_consensus.cc:3060] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:13.501448 29259 leader_election.cc:290] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:13.503532 25344 leader_election.cc:304] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:13.504460 29120 consensus_queue.cc:1059] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:12:13.505580 29276 raft_consensus.cc:2804] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:13.481559 25195 leader_election.cc:304] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:13.481920 29046 consensus_queue.cc:1048] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:13.472334 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
W20260709 13:12:13.492718 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:13.492265 29213 consensus_queue.cc:237] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:13.495023 25376 raft_consensus.cc:1240] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 10. Current term is 11. Ops: []
W20260709 13:12:13.478338 25345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:13.479940 28717 raft_consensus.cc:493] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.497900 25373 raft_consensus.cc:1240] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 11 LEADER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:13.508404 25374 raft_consensus.cc:1275] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:12:13.458083 29210 raft_consensus.cc:2749] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:13.505717 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:13.511029 25194 leader_election.cc:304] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:13.468806 29267 raft_consensus.cc:697] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 11 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
W20260709 13:12:13.518059 25343 connection.cc:256] RPC call timeout handler was delayed by -1.51051071400002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1653s for a response
I20260709 13:12:13.506078 29276 raft_consensus.cc:493] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:13.521032 25229 raft_consensus.cc:1240] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:13.521353 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:13.521879 25379 raft_consensus.cc:3060] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:13.522466 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:13.524705 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:13.526165 29276 raft_consensus.cc:3060] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:13.530791 25222 raft_consensus.cc:1240] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 7. Current term is 8. Ops: []
W20260709 13:12:13.528177 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 46741.8us
I20260709 13:12:13.523180 29077 raft_consensus.cc:493] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.542490 29172 raft_consensus.cc:493] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:13.542657 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:13.549542 29219 raft_consensus.cc:2749] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:13.549777 29210 raft_consensus.cc:2804] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:13.542714 29077 raft_consensus.cc:515] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:13.550282 29210 raft_consensus.cc:493] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:13.552287 25376 raft_consensus.cc:1275] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:12:13.529889 28717 raft_consensus.cc:515] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:13.554598 29317 log.cc:927] Time spent T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 13:12:13.554909 29221 raft_consensus.cc:493] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:13.555632 29221 raft_consensus.cc:515] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:13.556257 28717 leader_election.cc:290] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:13.553076 29086 raft_consensus.cc:493] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.558971 29086 raft_consensus.cc:515] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:13.559576 25225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54000 (request call id 644) took 1384 ms. Trace:
I20260709 13:12:13.560040 25221 raft_consensus.cc:1275] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:12:13.559995 25225 rpcz_store.cc:276] 0709 13:12:12.175159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:12.175289 (+   130us) service_pool.cc:224] Handling call
0709 13:12:13.559319 (+1384030us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b540025dfd4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:13.559487 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2822354176}
I20260709 13:12:13.561224 29086 leader_election.cc:290] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:13.561470 25221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 2099) took 1271 ms. Trace:
I20260709 13:12:13.561926 25372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36254 (request call id 2128) took 2938 ms. Trace:
I20260709 13:12:13.561889 25221 rpcz_store.cc:276] 0709 13:12:12.289738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:12.289923 (+   185us) service_pool.cc:224] Handling call
0709 13:12:13.559529 (+1269606us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:13.560436 (+   907us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:13.561283 (+   847us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b540025dfd0. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6e8ad 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:13.561417 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2872932096}
I20260709 13:12:13.562372 25372 rpcz_store.cc:276] 0709 13:12:10.623248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:10.740400 (+117152us) service_pool.cc:224] Handling call
0709 13:12:10.740652 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:13.359306 (+2618654us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:13.561645 (+202339us) spinlock_profiling.cc:243] Waited 2.61 s on lock 0x7b5400305f54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:13.561858 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6008791296}
I20260709 13:12:13.563690 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:13.546993 29143 raft_consensus.cc:3055] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:13.564368 29143 raft_consensus.cc:740] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:13.564881 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:12:13.565734 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 59370.4us
I20260709 13:12:13.563783 29144 leader_election.cc:290] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:13.548579 29259 raft_consensus.cc:2804] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:12:13.570571 25873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:13.571489 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 124064us
W20260709 13:12:13.573046 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:13.573827 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:13.568164 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:12:13.579924 25872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:13.557106 29210 raft_consensus.cc:3060] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:13.582515 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:13.587028 25194 leader_election.cc:304] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:13.548344 29172 raft_consensus.cc:515] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:13.588936 25270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:13.589579 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:13.565482 29143 consensus_queue.cc:260] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:13.597515 25229 raft_consensus.cc:1240] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:13.598304 25305 raft_consensus.cc:1275] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:12:13.599403 25227 raft_consensus.cc:1275] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:12:13.604157 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:13.605779 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:13.593657 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:13.606815 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:13.606217 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:13.608915 25901 raft_consensus.cc:1240] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:13.613924 25194 leader_election.cc:304] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:13.586194 29259 raft_consensus.cc:697] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 10 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
W20260709 13:12:13.616182 25270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:13.616430 25222 raft_consensus.cc:2468] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 8.
I20260709 13:12:13.620051 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:13.622012 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:13.624001 25305 raft_consensus.cc:1240] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 9. Current term is 10. Ops: [8.9-9.10]
I20260709 13:12:13.624706 29260 raft_consensus.cc:493] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:13.624965 29172 leader_election.cc:290] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:13.625278 29260 raft_consensus.cc:515] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:13.627931 29260 leader_election.cc:290] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:13.630215 29269 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:13.621673 25901 raft_consensus.cc:2468] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 11.
I20260709 13:12:13.622846 25374 raft_consensus.cc:2468] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 9.
I20260709 13:12:13.632798 25908 raft_consensus.cc:2468] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 9.
I20260709 13:12:13.636884 29214 raft_consensus.cc:3060] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:13.638825 25296 raft_consensus.cc:1275] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:12:13.638901 25194 leader_election.cc:304] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:13.632969 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:12:13.640969 25270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:13.642977 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:13.643659 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:13.645301 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:13.643754 25305 raft_consensus.cc:2468] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 11.
I20260709 13:12:13.645964 25304 raft_consensus.cc:2468] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 8.
I20260709 13:12:13.646548 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:13.647449 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:13.648299 25304 raft_consensus.cc:2393] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 11: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
W20260709 13:12:13.651511 25195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:13.651942 25195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:13.653342 29222 consensus_queue.cc:1048] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:13.654101 25302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57256 (request call id 1998) took 1924 ms. Trace:
I20260709 13:12:13.657991 25874 leader_election.cc:304] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:13.659447 29210 raft_consensus.cc:515] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:13.660524 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:13.661320 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:13.662253 28694 leader_election.cc:290] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:13.615912 29144 raft_consensus.cc:2749] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:13.654528 25302 rpcz_store.cc:276] 0709 13:12:11.695904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:11.696984 (+  1080us) service_pool.cc:224] Handling call
0709 13:12:13.220483 (+1523499us) spinlock_profiling.cc:243] Waited 21.4 ms on lock 0x7b5800114098. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72cb4ab71 00007fd72cb4aeee 0000000000375939 00007fd734bbe1e0 00007fd734c870c4 00007fd734c87131 00007fd734c48fc0 00007fd734c33929 00007fd734c333d2 00007fd72e1aabd4
0709 13:12:13.220809 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:13.281894 (+ 61085us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:13.281932 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:13.283555 (+  1623us) log.cc:844] Serialized 26 byte log entry
0709 13:12:13.499055 (+215500us) spinlock_profiling.cc:243] Waited 4.25 ms on lock 0x7b180030a180. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72cb64e07 00007fd7359bfab9 00007fd72cb8169b 00007fd72cb7f93f 00007fd72cb81c02 00007fd72f80920b 00007fd72f80ed23 00007fd72f80f0d1 00007fd72fc2aa0f
0709 13:12:13.543696 (+ 44641us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:13.543772 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:13.543836 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:13.614904 (+ 71068us) raft_consensus.cc:1685] finished
0709 13:12:13.614922 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:13.620637 (+  5715us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58770,"raft.queue_time_us":60875,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":15471,"spinlock_wait_cycles":58940288,"thread_start_us":44468,"threads_started":1,"wal-append.queue_time_us":302422}
W20260709 13:12:13.663256 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:13.663375 25301 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57256 (request call id 1991) took 2737 ms (client timeout 1653 ms). Trace:
W20260709 13:12:13.673902 25343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:13.662003 29172 consensus_queue.cc:1059] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:13.665983 25300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46556 (request call id 543) took 1078 ms. Trace:
I20260709 13:12:13.674912 25300 rpcz_store.cc:276] 0709 13:12:12.587825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:12.651918 (+ 64093us) service_pool.cc:224] Handling call
0709 13:12:12.652284 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:13.111720 (+459436us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b54003b7f20. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fbe6dc0 00007fd72fc711c0 00007fd72fc72231 00007fd72fc6ed8f 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c
0709 13:12:13.296064 (+184344us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:13.665600 (+369536us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b54001694d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:13.665910 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":568974464}
W20260709 13:12:13.673687 25301 rpcz_store.cc:269] 0709 13:12:10.926163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:10.926617 (+   454us) service_pool.cc:224] Handling call
0709 13:12:13.663042 (+2736425us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b540018d3d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:13.663175 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3098392320}
W20260709 13:12:13.684700 25343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:13.682549 29260 raft_consensus.cc:2749] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:13.665596 29210 leader_election.cc:290] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:13.686775 29259 consensus_queue.cc:237] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:13.688997 29118 raft_consensus.cc:2804] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:13.689427 29118 raft_consensus.cc:493] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:13.689743 29118 raft_consensus.cc:3060] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:13.690060 29077 leader_election.cc:290] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:13.633278 29267 consensus_queue.cc:237] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:13.686838 29139 raft_consensus.cc:3060] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:13.697093 29167 leader_election.cc:290] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:13.698202 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 59415.9us
I20260709 13:12:13.698345 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:13.701670 25195 leader_election.cc:304] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:13.633644 28717 raft_consensus.cc:3060] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:13.713936 25375 raft_consensus.cc:1275] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:12:13.723807 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:13.708142 29210 raft_consensus.cc:493] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.726445 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:13.726740 29210 raft_consensus.cc:515] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:13.727260 25221 raft_consensus.cc:2468] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 9.
I20260709 13:12:13.728283 25195 leader_election.cc:304] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
W20260709 13:12:13.728904 29323 log.cc:927] Time spent T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:12:13.729264 25374 raft_consensus.cc:1240] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:13.731127 29260 raft_consensus.cc:2749] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:13.731323 25226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54000 (request call id 631) took 2105 ms. Trace:
I20260709 13:12:13.732007 29260 raft_consensus.cc:2749] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:13.731773 25226 rpcz_store.cc:276] 0709 13:12:11.625563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:11.626922 (+  1359us) service_pool.cc:224] Handling call
0709 13:12:11.627217 (+   295us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:11.637496 (+ 10279us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:12:13.372108 (+1734612us) spinlock_profiling.cc:243] Waited 2.83 ms on lock 0x7b1800417100. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72cb64e07 00007fd7359bfab9 00007fd72cb8169b 00007fd72cb7f93f 00007fd72cb7f455 00007fd7336673c7 00007fd72fc799a7 00007fd72fc890bf 00007fd72fc89038
0709 13:12:13.443382 (+ 71274us) log.cc:844] Serialized 14 byte log entry
0709 13:12:13.540002 (+ 96620us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:13.541064 (+  1062us) log.cc:844] Serialized 52 byte log entry
0709 13:12:13.541282 (+   218us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:13.541667 (+   385us) log.cc:844] Serialized 14 byte log entry
0709 13:12:13.541923 (+   256us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:13.542070 (+   147us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:13.627940 (+ 85870us) spinlock_profiling.cc:243] Waited 1.19 ms on lock 0x7b1800417100. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72cb823f3 00007fd72cb847c1 00007fd72cb84779 00007fd72cb84709 00007fd72cb846d1 00007fd72cb839cd 000000000038f354 000000000038f199 00007fd72cb6583a
0709 13:12:13.699885 (+ 71945us) spinlock_profiling.cc:243] Waited 1.11 ms on lock 0x7b1800417100. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72cb823f3 00007fd72cb847c1 00007fd72cb84779 00007fd72cb84709 00007fd72cb846d1 00007fd72cb839cd 000000000038f354 000000000038f199 00007fd72cb6583a
0709 13:12:13.730986 (+ 31101us) raft_consensus.cc:1685] finished
0709 13:12:13.731008 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:13.731151 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60270,"prepare.queue_time_us":648129,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":84,"raft.queue_time_us":5827,"raft.run_cpu_time_us":377,"raft.run_wall_time_us":10515,"spinlock_wait_cycles":11782528,"thread_start_us":111830,"threads_started":2,"wal-append.queue_time_us":84495}
I20260709 13:12:13.730412 25195 leader_election.cc:304] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:12:13.729069 29210 leader_election.cc:290] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:13.734045 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:13.734324 29144 raft_consensus.cc:2804] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:13.734848 25227 raft_consensus.cc:2468] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 13.
I20260709 13:12:13.735553 25195 leader_election.cc:304] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:12:13.736299 29210 raft_consensus.cc:2804] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:13.734885 29144 raft_consensus.cc:697] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 9 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:13.736672 29210 raft_consensus.cc:493] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:13.737102 29210 raft_consensus.cc:3060] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:13.737516 25345 leader_election.cc:304] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:13.737612 29144 consensus_queue.cc:237] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:13.702735 29269 raft_consensus.cc:493] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:13.740216 29269 raft_consensus.cc:515] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:13.713583 29172 consensus_queue.cc:1243] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer da445ce82dc4467f95f4fa52297eaa19 log is divergent from this leader: its last log entry 11.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:12:13.742779 25226 raft_consensus.cc:1240] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:13.743328 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:13.743605 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:13.744457 29276 raft_consensus.cc:515] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:13.744837 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:13.745942 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:13.747262 25226 raft_consensus.cc:1240] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:13.726274 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:13.750758 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:13.752135 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:13.758136 25379 raft_consensus.cc:2410] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:12:13.758908 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:13.762679 25872 leader_election.cc:304] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:13.764117 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:13.764791 25901 raft_consensus.cc:2468] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 8.
I20260709 13:12:13.763536 25872 leader_election.cc:304] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:12:13.770313 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:13.775777 25229 raft_consensus.cc:2393] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 10: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:13.774231 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:13.784736 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:13.775254 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:13.787624 25225 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 7.
I20260709 13:12:13.788367 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:13.773015 29143 raft_consensus.cc:3060] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:13.791229 25903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50060 (request call id 659) took 2981 ms. Trace:
I20260709 13:12:13.793869 29208 consensus_queue.cc:1048] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:12:13.794050 29206 consensus_queue.cc:1048] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:12:13.795264 29191 raft_consensus.cc:2804] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:13.796060 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:12:13.797680 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 60244.3us
I20260709 13:12:13.798659 29269 leader_election.cc:290] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:13.789026 25270 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 1.746s (SENT) [suppressed 35 similar messages]
I20260709 13:12:13.804141 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:13.800124 25903 rpcz_store.cc:276] 0709 13:12:10.809817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:10.809963 (+   146us) service_pool.cc:224] Handling call
0709 13:12:10.810255 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:11.095982 (+285727us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:13.772829 (+2676847us) spinlock_profiling.cc:243] Waited 244 ms on lock 0x7b5400276ad4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:13.791037 (+ 18208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":561561984}
I20260709 13:12:13.788658 28746 raft_consensus.cc:2749] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:13.797276 29210 raft_consensus.cc:515] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:13.797222 29200 raft_consensus.cc:2804] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:13.811436 29118 raft_consensus.cc:515] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:13.814399 28781 consensus_queue.cc:1048] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:13.815081 25221 raft_consensus.cc:2393] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 10: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:13.817639 25904 raft_consensus.cc:1240] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 LEADER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:12:13.821615 29313 raft_consensus.cc:3060] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:13.823463 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:12:13.824661 25299 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57272 (request call id 1855) took 3216 ms (client timeout 2721 ms). Trace:
I20260709 13:12:13.824818 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:12:13.825145 25299 rpcz_store.cc:269] 0709 13:12:10.608275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:10.748434 (+140159us) service_pool.cc:224] Handling call
0709 13:12:13.824253 (+3075819us) spinlock_profiling.cc:243] Waited 565 ms on lock 0x7b5400168fd4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:13.824481 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1298890624}
I20260709 13:12:13.801842 29260 raft_consensus.cc:493] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.806746 29191 raft_consensus.cc:493] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:13.834442 25379 raft_consensus.cc:2468] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 9.
I20260709 13:12:13.818066 29200 raft_consensus.cc:493] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:13.828603 29129 raft_consensus.cc:493] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.835986 29191 raft_consensus.cc:3060] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:13.846763 25345 leader_election.cc:304] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:13.852555 25303 raft_consensus.cc:1275] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:12:13.834281 29286 consensus_queue.cc:1059] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:12:13.857769 25377 raft_consensus.cc:2410] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:12:13.843998 29086 raft_consensus.cc:493] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.858544 25379 raft_consensus.cc:3055] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:13.875569 25379 raft_consensus.cc:740] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:13.875622 29086 raft_consensus.cc:515] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:13.876693 25379 consensus_queue.cc:260] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:13.847143 29200 raft_consensus.cc:3060] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:13.861867 28746 raft_consensus.cc:2804] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:13.838914 29123 raft_consensus.cc:515] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:13.864809 29172 consensus_queue.cc:1059] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:13.866381 29223 raft_consensus.cc:493] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.854990 29276 leader_election.cc:290] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:13.869688 29206 raft_consensus.cc:493] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.870644 29286 raft_consensus.cc:3055] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:13.870714 29139 raft_consensus.cc:493] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.843499 29260 raft_consensus.cc:515] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:13.880748 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:12:13.860967 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 52799.4us
I20260709 13:12:13.869113 25270 leader_election.cc:304] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:13.858219 29129 raft_consensus.cc:515] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:13.880753 28746 raft_consensus.cc:493] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:13.898032 25379 raft_consensus.cc:3060] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:13.878403 29221 leader_election.cc:290] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:13.856400 29213 consensus_queue.cc:1059] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:12:13.888893 29086 leader_election.cc:290] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:13.912302 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:13.897586 29286 raft_consensus.cc:740] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
W20260709 13:12:13.913542 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 44550us
I20260709 13:12:13.887153 29208 consensus_queue.cc:1059] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:12:13.905409 28746 raft_consensus.cc:3060] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:13.928277 29129 leader_election.cc:290] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:13.929981 29140 raft_consensus.cc:2804] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:13.930433 29140 raft_consensus.cc:493] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:13.930781 29140 raft_consensus.cc:3060] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:13.932245 29260 leader_election.cc:290] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:13.937558 29261 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.938138 29261 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:13.924607 29210 leader_election.cc:290] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:13.942474 29286 consensus_queue.cc:260] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:13.924796 29221 raft_consensus.cc:493] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:13.944243 29221 raft_consensus.cc:515] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:13.946661 28717 raft_consensus.cc:2749] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:13.903877 29223 raft_consensus.cc:515] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:13.950464 29118 leader_election.cc:290] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:13.950974 29223 leader_election.cc:290] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:13.943673 29286 raft_consensus.cc:3060] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:13.946565 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:13.941548 25375 raft_consensus.cc:2468] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 11.
I20260709 13:12:13.923975 25345 leader_election.cc:304] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:13.901130 29206 raft_consensus.cc:515] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:13.904039 29139 raft_consensus.cc:515] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:13.954799 25370 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 7.
W20260709 13:12:13.957378 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:13.960723 29206 leader_election.cc:290] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:13.974066 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 65128us
I20260709 13:12:13.991271 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:13.992717 25375 raft_consensus.cc:2410] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:12:14.014467 25379 raft_consensus.cc:1275] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 5. (term mismatch)
I20260709 13:12:14.014925 25379 pending_rounds.cc:85] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468: Aborting all ops after (but not including) 4
I20260709 13:12:14.015156 25379 pending_rounds.cc:107] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468: Aborting uncommitted NO_OP operation due to leader change: 10.5
I20260709 13:12:14.001729 29086 raft_consensus.cc:2804] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:14.015414 25379 raft_consensus.cc:2889] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:14.018863 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:14.027336 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:14.028738 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:14.029361 25372 raft_consensus.cc:2468] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 7.
I20260709 13:12:14.031421 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:14.027356 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:14.017495 29086 raft_consensus.cc:493] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:14.030365 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:14.010623 29013 consensus_queue.cc:1048] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
W20260709 13:12:14.044999 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:14.047574 29276 consensus_queue.cc:1048] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:14.047999 29086 raft_consensus.cc:3060] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:14.049737 29311 raft_consensus.cc:2749] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:14.050105 25906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50056 (request call id 728) took 1873 ms. Trace:
I20260709 13:12:14.033073 25299 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 9.
I20260709 13:12:14.050776 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:14.051479 25903 raft_consensus.cc:2468] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 9.
I20260709 13:12:14.052310 29123 leader_election.cc:290] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:14.053182 29328 log.cc:927] Time spent T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.196s	user 0.000s	sys 0.000s
I20260709 13:12:14.023775 29140 raft_consensus.cc:515] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:14.055328 29140 leader_election.cc:290] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:14.050498 25906 rpcz_store.cc:276] 0709 13:12:12.176390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:12.177770 (+  1380us) service_pool.cc:224] Handling call
0709 13:12:12.178089 (+   319us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:12.178440 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:12.178466 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:12.181924 (+  3458us) log.cc:844] Serialized 52 byte log entry
0709 13:12:12.453168 (+271244us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:13.867857 (+1414689us) spinlock_profiling.cc:243] Waited 7.35 ms on lock 0x7b1800394180. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72f8174bc 00007fd72cb6548b 00007fd7359bfab9 00007fd72cb8169b 00007fd72cb7f93f 00007fd72cb7f455 00007fd7336673c7 00007fd72fc799a7 00007fd72fc890bf
0709 13:12:13.868040 (+   183us) log.cc:844] Serialized 14 byte log entry
0709 13:12:14.020326 (+152286us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:14.026893 (+  6567us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:14.030042 (+  3149us) raft_consensus.cc:1685] finished
0709 13:12:14.049713 (+ 19671us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:14.049935 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":306556,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":57,"raft.queue_time_us":9392,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":4411,"spinlock_wait_cycles":16896384,"thread_start_us":337402,"threads_started":3,"wal-append.queue_time_us":446368,"wal-append.run_cpu_time_us":3890,"wal-append.run_wall_time_us":1331910}
W20260709 13:12:14.057718 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:14.058936 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:14.060740 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:14.064960 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:14.042487 29139 leader_election.cc:290] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:14.042837 25230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54000 (request call id 646) took 1837 ms. Trace:
I20260709 13:12:14.043732 29221 leader_election.cc:290] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:14.036703 29191 raft_consensus.cc:515] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:14.069185 25230 rpcz_store.cc:276] 0709 13:12:12.205851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:12.209855 (+  4004us) service_pool.cc:224] Handling call
0709 13:12:12.210321 (+   466us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:12.452425 (+242104us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:12.452551 (+   126us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:12.466719 (+ 14168us) log.cc:844] Serialized 52 byte log entry
0709 13:12:13.303025 (+836306us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:13.303090 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:14.042395 (+739305us) spinlock_profiling.cc:243] Waited 39.6 ms on lock 0x7b54003a6454. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:14.042445 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:14.042506 (+    61us) raft_consensus.cc:1685] finished
0709 13:12:14.042517 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:14.042760 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":50597,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":4095,"spinlock_wait_cycles":91053440,"thread_start_us":948641,"threads_started":2,"wal-append.queue_time_us":628206}
W20260709 13:12:14.074045 25194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:14.072242 25905 raft_consensus.cc:2468] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 11.
I20260709 13:12:14.087905 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:14.092662 25344 leader_election.cc:304] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:14.097215 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
W20260709 13:12:14.111166 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:14.096527 29139 consensus_queue.cc:1048] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:12:14.109864 29140 raft_consensus.cc:493] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.127151 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:14.127691 25345 leader_election.cc:304] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:14.127467 29140 raft_consensus.cc:515] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:14.128687 25345 leader_election.cc:304] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:14.129936 29104 consensus_queue.cc:1048] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:14.130976 29191 leader_election.cc:290] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:14.131269 29104 raft_consensus.cc:2804] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:14.131852 29104 raft_consensus.cc:493] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:14.132220 29104 raft_consensus.cc:3060] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:14.131243 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:14.106040 29129 raft_consensus.cc:2804] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:14.086716 28746 raft_consensus.cc:515] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:14.139842 25230 raft_consensus.cc:2410] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:12:14.142959 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:14.145357 25299 raft_consensus.cc:3060] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:14.155056 25344 leader_election.cc:304] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:14.156044 29276 raft_consensus.cc:2804] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:14.162281 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:14.163501 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:14.164448 29013 consensus_queue.cc:1059] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:14.165923 29143 raft_consensus.cc:2804] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:14.166404 29143 raft_consensus.cc:493] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:14.166807 29143 raft_consensus.cc:3060] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:14.170497 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:14.171300 25302 raft_consensus.cc:2410] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:12:14.174028 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:14.176381 29200 raft_consensus.cc:515] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:14.178681 29191 consensus_queue.cc:1048] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:14.144390 25297 raft_consensus.cc:2468] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 9.
W20260709 13:12:14.186504 25872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:14.165640 29013 raft_consensus.cc:3055] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:12:14.192821 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:14.144191 29129 raft_consensus.cc:493] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:14.201601 25370 raft_consensus.cc:1240] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 10. Current term is 11. Ops: []
W20260709 13:12:14.205487 25872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:14.199712 29267 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.003s	sys 0.025s
I20260709 13:12:14.191123 29013 raft_consensus.cc:740] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:14.213663 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:14.214375 25230 raft_consensus.cc:2468] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 11.
I20260709 13:12:14.215278 25221 raft_consensus.cc:1275] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:12:14.217180 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:14.203938 29129 raft_consensus.cc:3060] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:14.208138 25873 leader_election.cc:304] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:14.203781 29140 leader_election.cc:290] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:14.216414 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:14.220932 25371 raft_consensus.cc:2393] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 11: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:12:14.221339 25371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36254 (request call id 2152) took 1072 ms. Trace:
I20260709 13:12:14.205118 29206 consensus_queue.cc:1059] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 10.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:12:14.221634 29212 consensus_queue.cc:1048] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:14.221731 25371 rpcz_store.cc:276] 0709 13:12:13.149020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:13.209505 (+ 60485us) service_pool.cc:224] Handling call
0709 13:12:14.216271 (+1006766us) spinlock_profiling.cc:243] Waited 4.42 ms on lock 0x7b580014fd98. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72cb4ab71 00007fd72cb4aa22 00007fd735a63c09 00007fd734bbdee0 00007fd734c870ab 00007fd734c87131 00007fd734c350a0 00007fd734c34984 00007fd72e1af6d4 00007fd72e1af662
0709 13:12:14.221273 (+  5002us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10171136}
I20260709 13:12:14.222213 29206 consensus_queue.cc:1243] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Peer 79d99c0e498349bda74127365219e468 log is divergent from this leader: its last log entry 11.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:12:14.212252 29139 consensus_queue.cc:1059] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:12:14.221261 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:14.225630 25299 raft_consensus.cc:1275] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:12:14.229127 25225 raft_consensus.cc:2410] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:12:14.229588 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:14.234987 28746 leader_election.cc:290] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:14.236825 28746 raft_consensus.cc:493] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:14.238047 29200 leader_election.cc:290] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 12 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:14.243829 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 86430.1us
I20260709 13:12:14.244494 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:14.245203 25230 raft_consensus.cc:2410] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:12:14.227516 29191 raft_consensus.cc:2804] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:14.237551 28746 raft_consensus.cc:515] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:14.266122 25223 raft_consensus.cc:1275] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 10 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
W20260709 13:12:14.272660 25195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:14.275563 29120 raft_consensus.cc:493] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:14.277010 29077 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 13:12:14.277952 29145 consensus_queue.cc:1059] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:14.295374 25195 leader_election.cc:304] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:14.280695 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:14.281102 25873 leader_election.cc:304] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:14.283870 28717 raft_consensus.cc:493] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.285239 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:14.252202 29191 raft_consensus.cc:493] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:14.292062 29170 raft_consensus.cc:3060] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:14.293038 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:14.248629 29276 raft_consensus.cc:697] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 11 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:14.278581 29086 raft_consensus.cc:515] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:14.288733 29129 raft_consensus.cc:515] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:14.298441 25905 raft_consensus.cc:1240] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:14.285205 29104 raft_consensus.cc:515] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:14.297659 25873 leader_election.cc:304] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:12:14.298566 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:14.299975 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:14.316007 25908 raft_consensus.cc:3060] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:14.300334 28717 raft_consensus.cc:515] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:14.301005 29120 raft_consensus.cc:515] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:14.304495 25874 leader_election.cc:304] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:14.306425 25901 raft_consensus.cc:1275] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:12:14.307247 25230 raft_consensus.cc:2368] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 11. Current term is 12.
I20260709 13:12:14.310169 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:14.297607 29200 raft_consensus.cc:2749] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:14.303186 29191 raft_consensus.cc:3060] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:14.324427 25904 raft_consensus.cc:1240] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:14.325016 25270 leader_election.cc:304] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:14.334878 25873 leader_election.cc:304] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:14.335731 25871 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:14.327169 25906 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 8.
I20260709 13:12:14.345583 25270 leader_election.cc:304] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:14.329912 29303 raft_consensus.cc:3060] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:14.350088 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 48597.4us
I20260709 13:12:14.350639 29283 consensus_queue.cc:1059] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 8.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:12:14.350639 25224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58418 (request call id 2026) took 1667 ms. Trace:
I20260709 13:12:14.350804 29350 consensus_queue.cc:1059] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:14.356976 25303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57256 (request call id 2000) took 2659 ms. Trace:
I20260709 13:12:14.341288 29312 raft_consensus.cc:2804] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:14.357589 25224 rpcz_store.cc:276] 0709 13:12:12.683250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:12.686410 (+  3160us) service_pool.cc:224] Handling call
0709 13:12:12.686721 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:12.890086 (+203365us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:14.350324 (+1460238us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b5400436554. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:14.350574 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":462503168}
I20260709 13:12:14.341658 29267 raft_consensus.cc:2804] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:14.359400 29145 raft_consensus.cc:2749] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:14.373383 29120 leader_election.cc:290] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:14.363999 29312 raft_consensus.cc:493] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:14.374462 29283 consensus_queue.cc:1243] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer 79d99c0e498349bda74127365219e468 log is divergent from this leader: its last log entry 9.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:12:14.376880 29143 raft_consensus.cc:515] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:14.380538 29191 raft_consensus.cc:515] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:14.362083 25303 rpcz_store.cc:276] 0709 13:12:11.697632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:11.697813 (+   181us) service_pool.cc:224] Handling call
0709 13:12:12.162402 (+464589us) spinlock_profiling.cc:243] Waited 1.53 ms on lock 0x7b5800114098. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72cb4ab71 00007fd72cb4aa22 00007fd735a63c09 00007fd734bbdee0 00007fd734c870ab 00007fd734c87131 00007fd734c48fc0 00007fd734c33929 00007fd734c333d2 00007fd72e1aabd4
0709 13:12:13.825951 (+1663549us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:13.852987 (+ 27036us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:14.351652 (+498665us) spinlock_profiling.cc:243] Waited 1.66 s on lock 0x7b5400168fd0. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6e8ad 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:14.356906 (+  5254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3828634624}
I20260709 13:12:14.380429 25908 raft_consensus.cc:2468] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 12.
I20260709 13:12:14.353677 29140 raft_consensus.cc:3060] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:14.387034 29312 raft_consensus.cc:3060] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:14.396572 29013 consensus_queue.cc:260] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:14.389096 29267 raft_consensus.cc:697] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 10 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
W20260709 13:12:14.441867 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:14.398022 29223 raft_consensus.cc:3055] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:14.400315 29143 leader_election.cc:290] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:14.381894 29213 raft_consensus.cc:2804] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:14.452134 25195 leader_election.cc:304] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:12:14.402872 29313 raft_consensus.cc:3055] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:14.403724 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:14.405362 25372 raft_consensus.cc:1275] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:12:14.405902 29086 leader_election.cc:290] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:14.406141 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:14.407501 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
W20260709 13:12:14.493233 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:14.407557 29145 consensus_queue.cc:1048] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:14.408200 25270 leader_election.cc:304] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:14.408300 29206 consensus_queue.cc:1048] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:14.408300 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:14.409466 25227 raft_consensus.cc:1240] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:14.410068 29269 raft_consensus.cc:3055] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:14.410648 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:14.411550 29063 raft_consensus.cc:3060] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:14.411898 25226 raft_consensus.cc:1275] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:12:14.412163 29147 raft_consensus.cc:3055] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:14.412961 29303 raft_consensus.cc:2749] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:14.413655 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:14.414741 25228 raft_consensus.cc:1240] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:14.415336 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:14.416384 25230 raft_consensus.cc:1240] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 12 LEADER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:14.416917 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:14.419185 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:14.501654 25375 raft_consensus.cc:2393] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 9: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:14.420511 25224 raft_consensus.cc:1275] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:12:14.420626 29123 consensus_queue.cc:1059] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:14.421224 29273 raft_consensus.cc:3055] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:14.421231 29221 consensus_queue.cc:1048] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:14.444115 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:12:14.513345 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:14.468863 25345 leader_election.cc:304] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:14.483286 25872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:14.495579 25221 raft_consensus.cc:3060] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:14.498560 25226 pending_rounds.cc:85] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce: Aborting all ops after (but not including) 9
I20260709 13:12:14.502017 25224 pending_rounds.cc:85] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce: Aborting all ops after (but not including) 8
I20260709 13:12:14.515338 25224 pending_rounds.cc:107] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:12:14.492547 29313 raft_consensus.cc:740] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:14.515290 25226 pending_rounds.cc:107] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:12:14.517722 25226 raft_consensus.cc:2889] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:14.515751 25224 raft_consensus.cc:2889] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:14.447324 29223 raft_consensus.cc:740] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:14.498564 29350 raft_consensus.cc:493] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.519683 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:14.523204 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:14.498088 29269 raft_consensus.cc:740] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:14.530602 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:14.499508 29213 raft_consensus.cc:697] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:14.499490 29147 raft_consensus.cc:740] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:14.383973 29276 consensus_queue.cc:237] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:14.531538 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:14.536095 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:14.535562 25377 raft_consensus.cc:2393] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 9: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:14.541148 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:14.541801 25371 raft_consensus.cc:3060] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:14.542510 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:14.505872 29273 raft_consensus.cc:740] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:14.521708 29013 raft_consensus.cc:3060] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:14.550529 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:14.522234 29172 raft_consensus.cc:2749] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:12:14.560936 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 152822us
I20260709 13:12:14.563427 25377 raft_consensus.cc:1240] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:14.567047 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:14.537714 29208 raft_consensus.cc:2749] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:14.534652 29292 consensus_queue.cc:1059] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
W20260709 13:12:14.605557 29352 log.cc:927] Time spent T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:12:14.577857 28717 leader_election.cc:290] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:14.609146 29213 consensus_queue.cc:237] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:14.609987 29118 raft_consensus.cc:493] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.571014 29267 consensus_queue.cc:237] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:14.610996 29303 raft_consensus.cc:493] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.611490 29303 raft_consensus.cc:515] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:14.612619 29273 consensus_queue.cc:260] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.3, Last appended by leader: 3, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:14.538982 29350 raft_consensus.cc:515] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:14.614019 29273 raft_consensus.cc:3060] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:14.584152 29129 leader_election.cc:290] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:14.617297 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:14.621243 25270 leader_election.cc:304] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:14.622627 25372 raft_consensus.cc:2410] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:12:14.624223 29147 consensus_queue.cc:260] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:14.624614 25229 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05"
dest_uuid: "1f539ba21487460085b837e7529a78ce"
mode: GRACEFUL
new_leader_uuid: "da445ce82dc4467f95f4fa52297eaa19"
 from {username='slave'} at 127.0.0.1:45014
I20260709 13:12:14.625625 29147 raft_consensus.cc:3060] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:14.625334 25229 raft_consensus.cc:606] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Received request to transfer leadership to TS da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:14.627502 25229 raft_consensus.cc:614] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:14.630276 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:14.630982 25904 raft_consensus.cc:3060] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:14.597509 29221 raft_consensus.cc:2804] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:14.632167 24113 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:12:14.585454 29145 consensus_queue.cc:1059] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:12:14.628191 29139 raft_consensus.cc:2749] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:14.635056 29223 consensus_queue.cc:260] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:14.628449 28746 leader_election.cc:290] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:14.575709 29104 leader_election.cc:290] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:12:14.627719 29354 log.cc:927] Time spent T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:12:14.682039 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:14.719313 25871 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:14.794719 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 326190us
W20260709 13:12:14.809964 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 271176us
I20260709 13:12:14.802351 24113 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:14.819082 25345 leader_election.cc:304] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
W20260709 13:12:14.823941 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:14.828795 29129 raft_consensus.cc:2749] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:14.829449 25345 leader_election.cc:304] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:14.830379 29129 raft_consensus.cc:2749] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:14.830888 25345 leader_election.cc:304] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:14.831739 29129 raft_consensus.cc:2804] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:12:14.833101 25343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:14.847781 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 285793us
I20260709 13:12:14.848085 25371 raft_consensus.cc:2468] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 11.
I20260709 13:12:14.610500 29118 raft_consensus.cc:515] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:14.851117 29129 raft_consensus.cc:493] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:14.798458 29310 raft_consensus.cc:493] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:14.879180 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 293935us
I20260709 13:12:14.820443 29200 consensus_queue.cc:1048] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
W20260709 13:12:14.891417 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 439679us
I20260709 13:12:14.809176 29239 raft_consensus.cc:493] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:14.920917 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 51046.7us
I20260709 13:12:14.922235 25345 leader_election.cc:304] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:14.928540 25345 leader_election.cc:304] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:14.832242 29261 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:14.915436 29353 log.cc:927] Time spent T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:12:14.837805 29191 leader_election.cc:290] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:14.915392 29129 raft_consensus.cc:3060] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:14.832885 29286 consensus_queue.cc:1048] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.099s
W20260709 13:12:14.931789 29170 consensus_meta.cc:287] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.625s	user 0.016s	sys 0.004s
W20260709 13:12:14.952833 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 72462.2us
I20260709 13:12:14.931869 29143 raft_consensus.cc:2749] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:14.950052 29172 raft_consensus.cc:2749] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:14.918138 29310 raft_consensus.cc:515] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:14.952420 29368 raft_consensus.cc:493] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:14.983050 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 59498.7us
I20260709 13:12:14.982028 29267 raft_consensus.cc:493] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.932096 29239 raft_consensus.cc:515] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:15.003800 25194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:15.000106 29155 raft_consensus.cc:493] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.000241 29375 raft_consensus.cc:493] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.980183 29212 consensus_queue.cc:1048] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
W20260709 13:12:15.017894 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 63721.2us
I20260709 13:12:15.000407 29267 raft_consensus.cc:515] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:14.984485 29368 raft_consensus.cc:515] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:15.021821 25228 raft_consensus.cc:1240] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:15.025445 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
W20260709 13:12:15.019867 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:15.018579 25270 leader_election.cc:304] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:15.026997 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:15.027791 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:15.028541 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:15.032372 25226 raft_consensus.cc:3060] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:15.029151 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:15.029727 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:15.016348 29261 raft_consensus.cc:493] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:15.015906 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 87479.6us
I20260709 13:12:15.033910 29261 raft_consensus.cc:515] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:15.034217 29118 leader_election.cc:290] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:15.034780 29377 raft_consensus.cc:493] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:15.034837 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:15.019402 29350 leader_election.cc:290] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:15.045037 25345 leader_election.cc:304] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
W20260709 13:12:15.046417 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:15.037714 29378 raft_consensus.cc:493] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:15.013029 29155 raft_consensus.cc:515] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:12:15.049904 25225 raft_consensus.cc:3060] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:15.011358 29351 consensus_queue.cc:1048] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.134s
I20260709 13:12:15.049540 25908 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 8.
W20260709 13:12:15.058005 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 102415us
W20260709 13:12:15.051397 29370 log.cc:927] Time spent T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:12:15.068820 25230 raft_consensus.cc:2393] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 8: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:15.066247 29350 raft_consensus.cc:2749] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:15.037997 29283 consensus_queue.cc:1048] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:12:15.071627 25345 leader_election.cc:304] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:15.066332 29376 raft_consensus.cc:493] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.058961 29377 raft_consensus.cc:515] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:15.070036 29383 raft_consensus.cc:493] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.030153 29375 raft_consensus.cc:515] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:15.102202 25221 consensus_meta.cc:287] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 0.588s	user 0.016s	sys 0.004s
I20260709 13:12:15.102826 25221 raft_consensus.cc:2468] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 10.
I20260709 13:12:15.104969 25904 raft_consensus.cc:2468] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 10.
I20260709 13:12:15.073365 29212 raft_consensus.cc:2804] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:15.067091 29292 consensus_queue.cc:1059] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:12:15.107484 25874 leader_election.cc:304] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:12:15.109146 25345 leader_election.cc:400] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 election: Vote denied by peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361) with higher term. Message: Invalid argument: T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 11. Current term is 12.
I20260709 13:12:15.115475 25224 raft_consensus.cc:2410] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:12:15.087141 29382 consensus_queue.cc:1048] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:12:15.109330 29212 raft_consensus.cc:493] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:15.109328 29143 raft_consensus.cc:2749] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:15.108867 29383 raft_consensus.cc:515] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:15.127821 29383 leader_election.cc:290] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:15.128247 29147 consensus_meta.cc:287] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.502s	user 0.010s	sys 0.010s
I20260709 13:12:15.129799 29239 leader_election.cc:290] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:15.129992 29368 leader_election.cc:290] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:15.130728 29261 leader_election.cc:290] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:15.131899 29375 leader_election.cc:290] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:15.132723 29373 log.cc:927] Time spent T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:12:15.134373 29269 consensus_queue.cc:260] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:15.135653 29269 raft_consensus.cc:3060] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:15.111178 29310 leader_election.cc:290] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:15.112751 29213 raft_consensus.cc:2804] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:15.142235 29213 raft_consensus.cc:697] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:15.143249 29213 consensus_queue.cc:237] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:15.147032 29377 leader_election.cc:290] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:15.111752 29376 raft_consensus.cc:515] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:12:15.123994 29212 raft_consensus.cc:3060] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:15.150619 29376 leader_election.cc:290] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:15.070878 29378 raft_consensus.cc:515] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:15.155375 29140 consensus_meta.cc:287] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.717s	user 0.010s	sys 0.017s
W20260709 13:12:15.186525 29063 consensus_meta.cc:287] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent flushing consensus metadata: real 0.684s	user 0.015s	sys 0.004s
W20260709 13:12:15.157651 29374 log.cc:927] Time spent T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:12:15.190244 29140 raft_consensus.cc:2749] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:15.191794 25899 raft_consensus.cc:1275] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:12:15.192587 29344 raft_consensus.cc:493] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.193239 29344 raft_consensus.cc:515] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:15.198906 25899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50056 (request call id 738) took 1450 ms. Trace:
I20260709 13:12:15.158846 29223 raft_consensus.cc:3060] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:15.124305 29123 consensus_queue.cc:1048] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:12:15.200258 25899 rpcz_store.cc:276] 0709 13:12:13.748464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:13.748571 (+   107us) service_pool.cc:224] Handling call
0709 13:12:13.764215 (+ 15644us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:15.192287 (+1428072us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:15.198567 (+  6280us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b540055d054. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:15.198829 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3282022144}
I20260709 13:12:15.124539 25195 leader_election.cc:304] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:15.201713 29377 raft_consensus.cc:2749] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:12:15.202622 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 78343.8us
I20260709 13:12:15.203397 25195 leader_election.cc:304] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:15.204180 29377 raft_consensus.cc:2749] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:12:15.205010 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:15.207129 25195 leader_election.cc:304] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:15.207700 29212 raft_consensus.cc:515] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:15.208562 29362 log.cc:927] Time spent T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.590s	user 0.002s	sys 0.000s
I20260709 13:12:15.168478 29286 consensus_queue.cc:1059] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:12:15.211627 29311 raft_consensus.cc:3055] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:15.211967 29311 raft_consensus.cc:740] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:15.212863 29311 consensus_queue.cc:260] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:15.213838 29311 raft_consensus.cc:3060] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:15.213790 25225 raft_consensus.cc:2468] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 11.
I20260709 13:12:15.161011 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:15.165678 25226 raft_consensus.cc:2468] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 7.
I20260709 13:12:15.215103 25221 raft_consensus.cc:3060] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:15.167973 29312 consensus_meta.cc:287] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent flushing consensus metadata: real 0.720s	user 0.011s	sys 0.008s
I20260709 13:12:15.215731 29312 raft_consensus.cc:515] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:15.185689 29355 log.cc:927] Time spent T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.577s	user 0.005s	sys 0.009s
I20260709 13:12:15.188745 29378 leader_election.cc:290] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:15.177017 29129 raft_consensus.cc:515] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:15.185544 29363 raft_consensus.cc:493] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
W20260709 13:12:15.157920 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 47591.2us
W20260709 13:12:15.164199 29013 consensus_meta.cc:287] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.599s	user 0.020s	sys 0.016s
I20260709 13:12:15.227376 25221 raft_consensus.cc:2468] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 10.
I20260709 13:12:15.229125 25906 raft_consensus.cc:1240] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 9. Current term is 10. Ops: [9.10-9.10]
W20260709 13:12:15.228700 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 169328us
I20260709 13:12:15.229687 25344 leader_election.cc:304] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
W20260709 13:12:15.230930 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:15.231222 25195 leader_election.cc:304] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:15.236357 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:15.239295 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:15.243799 25226 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 8.
I20260709 13:12:15.217809 29312 leader_election.cc:290] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:15.244117 25371 raft_consensus.cc:1275] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:12:15.228856 29377 raft_consensus.cc:2749] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:15.250459 25378 raft_consensus.cc:1275] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:12:15.246773 25271 leader_election.cc:304] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
W20260709 13:12:15.247596 25871 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:15.243799 25376 raft_consensus.cc:2468] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 11.
I20260709 13:12:15.218763 29267 leader_election.cc:290] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:15.251930 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:15.255383 25379 raft_consensus.cc:1275] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:12:15.253454 25270 leader_election.cc:304] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:15.251001 29351 raft_consensus.cc:2804] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:15.250521 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:15.263381 29351 raft_consensus.cc:697] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 10 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:15.263458 25377 raft_consensus.cc:3060] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:15.264469 29351 consensus_queue.cc:237] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:15.251180 29388 consensus_queue.cc:1048] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 13:12:15.266008 29013 raft_consensus.cc:2749] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:15.258826 29371 raft_consensus.cc:2749] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:15.259444 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:15.267989 25372 raft_consensus.cc:2468] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 8.
W20260709 13:12:15.268163 29359 log.cc:927] Time spent T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.639s	user 0.001s	sys 0.008s
W20260709 13:12:15.261291 25343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:15.241529 29363 raft_consensus.cc:515] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:15.270633 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:15.240131 28746 raft_consensus.cc:493] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.271193 25379 raft_consensus.cc:3060] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:15.271553 28746 raft_consensus.cc:515] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:15.272631 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:15.267894 29371 consensus_queue.cc:1059] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:15.251896 29129 leader_election.cc:290] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:15.273684 28746 leader_election.cc:290] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:15.275053 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:15.275913 25899 raft_consensus.cc:1240] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:15.279031 25376 raft_consensus.cc:2468] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 11.
I20260709 13:12:15.279229 29223 raft_consensus.cc:3055] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:15.269549 25271 leader_election.cc:304] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:15.276172 29267 raft_consensus.cc:2804] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:15.280915 29267 raft_consensus.cc:697] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 11 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:15.281653 25271 leader_election.cc:304] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:12:15.279645 29223 raft_consensus.cc:740] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:15.281919 29140 consensus_queue.cc:1048] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:15.281832 29267 consensus_queue.cc:237] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:15.283030 29223 consensus_queue.cc:260] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:15.271201 29363 leader_election.cc:290] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:15.277202 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:15.305660 25372 raft_consensus.cc:2468] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 8.
I20260709 13:12:15.274085 25370 raft_consensus.cc:1275] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:12:15.309870 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:15.310719 25904 raft_consensus.cc:2468] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 11.
I20260709 13:12:15.256623 25345 leader_election.cc:304] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
W20260709 13:12:15.311650 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 55102.2us
I20260709 13:12:15.312484 25345 leader_election.cc:304] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:15.281541 29145 raft_consensus.cc:2749] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:15.315212 29129 raft_consensus.cc:2749] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:12:15.280591 28746 consensus_queue.cc:1059] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:15.305176 29377 raft_consensus.cc:493] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.318226 29377 raft_consensus.cc:515] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:15.320385 29377 leader_election.cc:290] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:15.321182 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:15.322544 29344 leader_election.cc:290] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:15.314250 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:15.325176 25899 raft_consensus.cc:2468] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 10.
I20260709 13:12:15.325515 28717 raft_consensus.cc:3055] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:15.325923 28717 raft_consensus.cc:740] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:15.326035 29371 raft_consensus.cc:2804] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:15.326489 29371 raft_consensus.cc:493] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:15.326822 29371 raft_consensus.cc:3060] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:15.314194 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:15.330499 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
W20260709 13:12:15.330610 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 49028.8us
I20260709 13:12:15.332976 25377 raft_consensus.cc:2468] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 10.
I20260709 13:12:15.333210 25379 raft_consensus.cc:2468] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 10.
I20260709 13:12:15.336375 25345 leader_election.cc:304] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:15.334494 25271 leader_election.cc:304] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
W20260709 13:12:15.376341 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:15.327740 29221 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.696s	user 0.009s	sys 0.012s
I20260709 13:12:15.383769 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:15.384603 25378 raft_consensus.cc:2468] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 8.
I20260709 13:12:15.388530 25270 leader_election.cc:304] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:15.383782 29129 raft_consensus.cc:3055] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:15.390709 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:15.396062 29377 consensus_queue.cc:1048] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:12:15.398068 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 69419.1us
W20260709 13:12:15.400341 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:15.377225 29086 raft_consensus.cc:2804] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:12:15.382954 29221 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.751s	user 0.009s	sys 0.012s
I20260709 13:12:15.385471 29147 raft_consensus.cc:2804] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:12:15.414199 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:15.414922 29223 raft_consensus.cc:3060] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:15.390137 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:15.411580 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:15.445065 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:15.456291 25372 raft_consensus.cc:3060] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:15.486716 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:15.391016 29276 raft_consensus.cc:493] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:15.394253 29129 raft_consensus.cc:740] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:15.409829 29212 leader_election.cc:290] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:15.487542 25224 raft_consensus.cc:2468] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 11.
W20260709 13:12:15.493515 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 155312us
I20260709 13:12:15.497797 25345 leader_election.cc:304] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
W20260709 13:12:15.499003 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 63085.8us
I20260709 13:12:15.495180 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:15.500178 25377 raft_consensus.cc:2468] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 7.
I20260709 13:12:15.484513 29273 raft_consensus.cc:2749] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:15.326833 28717 consensus_queue.cc:260] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:15.485069 29086 raft_consensus.cc:697] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 11 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:15.505919 25345 leader_election.cc:304] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:15.436493 29221 raft_consensus.cc:697] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 12 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:15.492486 29147 raft_consensus.cc:697] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 7 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:15.510350 25297 raft_consensus.cc:1275] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:12:15.508796 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 176771us
I20260709 13:12:15.513883 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:15.514515 25297 raft_consensus.cc:3060] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:15.515368 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:15.498538 29170 raft_consensus.cc:2749] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:15.519055 25300 raft_consensus.cc:1275] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:12:15.506021 29311 raft_consensus.cc:670] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } [suppressed 4 similar messages]
I20260709 13:12:15.522995 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:15.535072 25226 raft_consensus.cc:1240] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:15.530844 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:15.535710 25299 raft_consensus.cc:3060] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:15.531461 29129 consensus_queue.cc:260] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:15.532658 29405 raft_consensus.cc:2804] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:12:15.532972 25194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:15.511710 29143 raft_consensus.cc:2804] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:15.536530 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:15.535384 25874 leader_election.cc:304] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:12:15.499256 29276 raft_consensus.cc:515] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:15.543620 29344 raft_consensus.cc:2804] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:15.545503 25899 raft_consensus.cc:1240] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:12:15.561508 25224 raft_consensus.cc:1240] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:15.540884 29405 raft_consensus.cc:493] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:15.570485 29405 raft_consensus.cc:3060] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:15.571278 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:15.573289 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:15.573921 25305 raft_consensus.cc:2468] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 7.
I20260709 13:12:15.579032 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:15.579632 25305 raft_consensus.cc:2468] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 11.
I20260709 13:12:15.580391 29389 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.580854 25270 leader_election.cc:304] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:15.580950 29389 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:15.581832 29170 raft_consensus.cc:2749] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:15.583436 29389 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:15.584717 25299 raft_consensus.cc:2468] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 12.
W20260709 13:12:15.590673 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:15.594996 25194 leader_election.cc:336] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Timed out: RequestConsensusVote RPC to 127.23.140.66:33127 timed out after 2.806s (SENT)
I20260709 13:12:15.538954 28717 raft_consensus.cc:3060] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:15.594233 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:15.597795 29129 raft_consensus.cc:3060] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:15.599784 29313 consensus_queue.cc:260] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:15.600895 29313 raft_consensus.cc:3060] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:15.602088 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:15.603466 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:12:15.604383 29393 log.cc:927] Time spent T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:12:15.604863 25226 raft_consensus.cc:1240] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:15.562381 29344 raft_consensus.cc:493] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:15.610291 29344 raft_consensus.cc:3060] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:15.610833 29221 consensus_queue.cc:237] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:15.611934 25221 raft_consensus.cc:1275] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:12:15.602093 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:15.616742 25270 leader_election.cc:304] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:15.613003 25128 catalog_manager.cc:5697] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 5 to 6, leader changed from 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 6 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:12:15.627108 25376 raft_consensus.cc:2468] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 11.
I20260709 13:12:15.628762 25270 leader_election.cc:304] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
W20260709 13:12:15.641973 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:15.592510 29143 raft_consensus.cc:697] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 10 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:15.643972 25226 raft_consensus.cc:1240] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 9. Current term is 10. Ops: []
W20260709 13:12:15.651077 25871 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:15.624683 29013 raft_consensus.cc:2804] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:12:15.682368 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:15.706905 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 133621us
W20260709 13:12:15.717475 25343 leader_election.cc:336] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Timed out: RequestConsensusVote RPC to 127.23.140.66:33127 timed out after 1.653s (SENT)
I20260709 13:12:15.712007 25128 catalog_manager.cc:5697] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:15.718981 25343 leader_election.cc:304] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:15.724068 25271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:15.724711 25271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:15.725241 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 96575.4us
I20260709 13:12:15.728075 25270 leader_election.cc:304] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:15.705870 29145 raft_consensus.cc:2749] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:15.747138 25374 raft_consensus.cc:1240] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:12:15.706143 29013 raft_consensus.cc:493] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:15.711241 29267 raft_consensus.cc:493] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.711915 29394 raft_consensus.cc:493] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.745970 25128 catalog_manager.cc:5697] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:15.756716 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:12:15.766861 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 251942us
W20260709 13:12:15.769506 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 52064.8us
I20260709 13:12:15.662417 29147 consensus_queue.cc:237] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:15.752065 29212 raft_consensus.cc:2804] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:15.799600 29212 raft_consensus.cc:493] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:15.800001 29212 raft_consensus.cc:3060] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:15.774143 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:15.661144 29086 consensus_queue.cc:237] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:15.796810 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:15.756300 29013 raft_consensus.cc:3060] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:15.768978 25128 catalog_manager.cc:5697] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 6 to 8, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68). New cstate: current_term: 8 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:15.802366 25305 raft_consensus.cc:2468] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 8.
I20260709 13:12:15.803382 25299 raft_consensus.cc:1240] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:15.721312 29377 consensus_queue.cc:1048] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:12:15.797529 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:15.759313 29170 raft_consensus.cc:493] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.810242 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:12:15.817122 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 77296.9us
I20260709 13:12:15.817688 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:15.818387 25270 leader_election.cc:304] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:15.813189 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:15.815939 25300 raft_consensus.cc:1240] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:12:15.804090 29143 consensus_queue.cc:237] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:15.828352 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:15.828866 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:15.831044 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:15.836078 25873 leader_election.cc:304] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:15.837438 25301 raft_consensus.cc:1240] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 13 LEADER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:12:15.841212 25375 raft_consensus.cc:1240] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:15.845738 25873 leader_election.cc:304] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:15.846683 25374 raft_consensus.cc:1240] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:12:15.860464 25372 raft_consensus.cc:2468] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 11.
I20260709 13:12:15.847522 25128 catalog_manager.cc:5697] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:12:15.768380 29267 raft_consensus.cc:515] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:15.863773 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 66548.8us
I20260709 13:12:15.865370 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:15.867758 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:15.870699 25873 leader_election.cc:304] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:15.873313 25128 catalog_manager.cc:5697] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 2 to 7. New cstate: current_term: 7 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:15.869614 25372 raft_consensus.cc:1240] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
W20260709 13:12:15.877108 25871 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:15.836998 29145 raft_consensus.cc:2804] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:15.835332 29276 leader_election.cc:290] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:15.882995 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:15.830264 29303 leader_election.cc:290] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:15.880393 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 61130.9us
I20260709 13:12:15.846661 29312 raft_consensus.cc:2804] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:15.904268 25300 raft_consensus.cc:1275] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 10 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:12:15.909716 25296 raft_consensus.cc:1240] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 12 LEADER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:12:15.870460 29340 raft_consensus.cc:2804] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:15.808470 29378 consensus_queue.cc:1048] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:12:15.912353 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:15.761638 29394 raft_consensus.cc:515] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:15.945057 25375 pending_rounds.cc:85] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468: Aborting all ops after (but not including) 6
I20260709 13:12:15.874279 29120 raft_consensus.cc:2749] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:15.946377 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:15.956838 25302 raft_consensus.cc:2368] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 10. Current term is 11.
I20260709 13:12:15.947368 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:12:15.949934 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 76668.9us
I20260709 13:12:15.823125 29170 raft_consensus.cc:515] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:15.944305 29303 raft_consensus.cc:2804] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:15.961979 25299 raft_consensus.cc:2468] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 9.
W20260709 13:12:15.962924 29412 log.cc:927] Time spent T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
I20260709 13:12:15.963101 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:12:15.963888 25124 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40034 (request call id 262) took 14307 ms (client timeout 15000 ms). Trace:
I20260709 13:12:15.964191 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
W20260709 13:12:15.965158 29371 consensus_meta.cc:287] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.630s	user 0.008s	sys 0.001s
W20260709 13:12:15.965912 29410 log.cc:927] Time spent T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:12:15.966589 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:15.967522 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:15.950939 25296 raft_consensus.cc:2468] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 10.
I20260709 13:12:15.968642 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:15.970220 25222 raft_consensus.cc:1240] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:15.971247 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:15.971793 25222 raft_consensus.cc:2468] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 8.
I20260709 13:12:15.972432 29170 leader_election.cc:290] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:15.973166 29303 raft_consensus.cc:697] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
W20260709 13:12:15.975802 29401 log.cc:927] Time spent T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
I20260709 13:12:15.977041 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:15.977705 25301 raft_consensus.cc:2468] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 9.
I20260709 13:12:15.978657 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:15.979693 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:15.980134 25301 raft_consensus.cc:3060] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:15.982244 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:15.914364 25128 catalog_manager.cc:5697] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 6 to 7, leader changed from 79d99c0e498349bda74127365219e468 (127.23.140.67) to 1f539ba21487460085b837e7529a78ce (127.23.140.65), now has a pending config: VOTER 1f539ba21487460085b837e7529a78ce (127.23.140.65), VOTER da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66), VOTER 79d99c0e498349bda74127365219e468 (127.23.140.67), VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68). New cstate: current_term: 7 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } } pending_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
W20260709 13:12:15.986562 29409 log.cc:927] Time spent T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:12:15.987535 25128 catalog_manager.cc:5697] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 2 to 5, leader changed from 79d99c0e498349bda74127365219e468 (127.23.140.67) to 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68). New cstate: current_term: 5 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:15.989044 25195 leader_election.cc:304] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
W20260709 13:12:15.954169 25872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:15.957722 25194 leader_election.cc:304] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:15.950955 25375 pending_rounds.cc:107] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:12:15.911257 29312 raft_consensus.cc:493] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:15.884116 29145 raft_consensus.cc:493] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:15.967607 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:15.968742 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:15.916478 29340 raft_consensus.cc:493] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:15.992194 25375 raft_consensus.cc:2889] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:15.960659 25300 raft_consensus.cc:1275] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:12:15.950584 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:12:16.001932 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 206192us
I20260709 13:12:16.002946 25229 raft_consensus.cc:2468] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 8.
I20260709 13:12:15.961915 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:15.992990 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:16.004498 25225 raft_consensus.cc:3060] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:15.965394 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:16.005129 25299 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 8.
I20260709 13:12:15.996548 25195 leader_election.cc:304] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:12:15.997295 25222 raft_consensus.cc:1240] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 11 LEADER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:15.995707 25128 catalog_manager.cc:5697] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 7 to 9, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68). New cstate: current_term: 9 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:16.007230 25227 raft_consensus.cc:1240] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 8. Current term is 9. Ops: []
W20260709 13:12:15.975046 29406 log.cc:927] Time spent T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:12:15.991693 25194 leader_election.cc:304] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:16.008598 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:16.009975 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:15.956902 29221 raft_consensus.cc:493] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:16.019980 25296 raft_consensus.cc:1275] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:12:16.003785 29223 consensus_meta.cc:287] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.512s	user 0.009s	sys 0.001s
I20260709 13:12:15.999397 29145 raft_consensus.cc:3060] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:16.001979 29377 raft_consensus.cc:2804] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:15.994774 29312 raft_consensus.cc:3060] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:15.997812 29378 raft_consensus.cc:2749] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:16.002797 29340 raft_consensus.cc:3060] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:16.021872 25128 catalog_manager.cc:5697] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:12:16.034085 25297 consensus_meta.cc:287] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.519s	user 0.011s	sys 0.001s
I20260709 13:12:16.030486 25304 raft_consensus.cc:2468] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 11.
I20260709 13:12:16.035804 25229 raft_consensus.cc:1240] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:16.045217 25297 raft_consensus.cc:2468] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 10.
I20260709 13:12:15.980027 29417 raft_consensus.cc:493] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.057646 25128 catalog_manager.cc:5697] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:12:15.969601 29344 raft_consensus.cc:515] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:16.050676 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:16.070835 25871 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:15.965680 29371 raft_consensus.cc:515] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:16.081322 25226 raft_consensus.cc:1240] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:12:16.081322 25229 raft_consensus.cc:1240] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:16.082401 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:16.088608 25297 raft_consensus.cc:2468] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 11.
I20260709 13:12:16.091917 25225 raft_consensus.cc:2468] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 11.
W20260709 13:12:16.094401 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:16.003197 29375 consensus_queue.cc:1059] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:12:16.043169 29377 raft_consensus.cc:493] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:16.097924 25343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:16.098695 25128 catalog_manager.cc:5697] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 3 to 6, leader changed from 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 6 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:12:16.106492 25305 raft_consensus.cc:1240] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:16.107210 25128 catalog_manager.cc:5697] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 6 to 7, leader changed from 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 7 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:12:16.167702 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:16.168421 25297 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 8.
I20260709 13:12:16.094270 29378 raft_consensus.cc:2804] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:16.169293 25128 catalog_manager.cc:5697] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:16.104662 29377 raft_consensus.cc:3060] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:16.043370 29221 raft_consensus.cc:515] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:16.107044 29351 raft_consensus.cc:493] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.203429 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
W20260709 13:12:15.964248 25124 rpcz_store.cc:269] 0709 13:12:01.604075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:01.604328 (+   253us) service_pool.cc:224] Handling call
0709 13:12:15.888194 (+14283866us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:09.889141 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:09.925434 (+ 36293us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:09.925480 (+    46us) write_op.cc:435] Acquired schema lock
0709 13:12:09.925504 (+    24us) tablet.cc:662] Decoding operations
0709 13:12:09.927032 (+  1528us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:09.927110 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:09.927137 (+    27us) tablet.cc:685] Acquiring locks for 18 operations
0709 13:12:09.931287 (+  4150us) tablet.cc:701] Row locks acquired
0709 13:12:09.931305 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:12:09.931458 (+   153us) write_op.cc:270] Start()
0709 13:12:09.931575 (+   117us) write_op.cc:276] Timestamp: P: 1783602729931409 usec, L: 0
0709 13:12:09.931601 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:12:09.932356 (+   755us) log.cc:844] Serialized 7162 byte log entry
0709 13:12:10.516336 (+583980us) op_driver.cc:464] REPLICATION: finished
0709 13:12:11.340244 (+823908us) spinlock_profiling.cc:243] Waited 5.57 ms on lock 0x7b4400022b4c. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72caa8c85 00007fd72caa96a2 00007fd72f81b1db 00007fd72f816aaf 00007fd72cb650ac 00007fd7359bfab9 00007fd72cb8169b 00007fd72cb7f93f 00007fd72cb81c02 00007fd7336a5ef0
0709 13:12:11.582343 (+242099us) write_op.cc:301] APPLY: starting
0709 13:12:11.585713 (+  3370us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:11.609034 (+ 23321us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:11.609058 (+    24us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:11.612606 (+  3548us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:11.612922 (+   316us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=18
0709 13:12:11.612967 (+    45us) write_op.cc:312] APPLY: finished
0709 13:12:11.613462 (+   495us) log.cc:844] Serialized 125 byte log entry
0709 13:12:11.810408 (+196946us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:11.971726 (+161318us) write_op.cc:454] Released schema lock
0709 13:12:11.971792 (+    66us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:11.990420 (+ 18628us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:11.990467 (+    47us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3918614,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":1034568,"apply.run_cpu_time_us":61000,"apply.run_wall_time_us":422585,"num_ops":18,"prepare.queue_time_us":105717,"prepare.run_cpu_time_us":35523,"prepare.run_wall_time_us":248682,"raft.queue_time_us":289016,"raft.run_cpu_time_us":20836,"raft.run_wall_time_us":1095321,"replication_time_us":584559,"spinlock_wait_cycles":12844160,"thread_start_us":1623284,"threads_started":5,"wal-append.queue_time_us":737153,"wal-append.run_cpu_time_us":20199,"wal-append.run_wall_time_us":2432362}]]}
I20260709 13:12:16.088461 29417 raft_consensus.cc:515] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:16.176584 29378 raft_consensus.cc:493] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:16.219578 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:16.212186 25128 catalog_manager.cc:5697] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:16.178735 29170 raft_consensus.cc:493] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:16.208598 28717 consensus_meta.cc:287] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 0.594s	user 0.008s	sys 0.002s
I20260709 13:12:16.182964 29313 raft_consensus.cc:493] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.205999 29375 raft_consensus.cc:2749] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:12:16.211647 29402 log.cc:927] Time spent T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.334s	user 0.000s	sys 0.001s
I20260709 13:12:16.238723 29378 raft_consensus.cc:3060] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:16.259186 25871 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:16.262009 25298 raft_consensus.cc:1275] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:12:16.253307 25128 catalog_manager.cc:5697] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 4 to 7, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68). New cstate: current_term: 7 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:16.262733 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:16.104180 29303 consensus_queue.cc:237] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:16.189612 29212 raft_consensus.cc:515] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:16.265105 25270 leader_election.cc:304] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:16.206316 29013 raft_consensus.cc:515] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:16.285010 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 288539us
I20260709 13:12:16.296793 25377 pending_rounds.cc:85] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468: Aborting all ops after (but not including) 5
I20260709 13:12:16.296890 25300 raft_consensus.cc:2393] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 9: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:16.297358 25377 pending_rounds.cc:107] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468: Aborting uncommitted NO_OP operation due to leader change: 12.6
I20260709 13:12:16.297658 25377 raft_consensus.cc:2889] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:12:16.298308 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 306673us
I20260709 13:12:16.299311 25194 leader_election.cc:304] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:16.211089 29351 raft_consensus.cc:515] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:16.254513 29267 leader_election.cc:290] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:16.303072 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 432433us
I20260709 13:12:16.304298 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:16.306756 25873 leader_election.cc:304] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:16.307013 25297 raft_consensus.cc:2468] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 11.
W20260709 13:12:16.277387 29420 log.cc:927] Time spent T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.316s	user 0.001s	sys 0.000s
W20260709 13:12:16.291450 29405 consensus_meta.cc:287] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.719s	user 0.012s	sys 0.000s
I20260709 13:12:16.308902 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:12:16.318998 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:16.319638 25301 raft_consensus.cc:2468] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 10.
I20260709 13:12:16.277168 29369 raft_consensus.cc:2804] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:16.262199 29143 consensus_queue.cc:1048] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:12:16.324411 25372 raft_consensus.cc:2468] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 10.
I20260709 13:12:16.296402 28717 raft_consensus.cc:3055] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:16.337049 25372 raft_consensus.cc:1240] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:16.343425 25372 raft_consensus.cc:1240] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 10 LEADER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:16.271317 29313 raft_consensus.cc:515] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:16.337949 25270 leader_election.cc:304] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:16.285054 29269 consensus_queue.cc:1059] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:12:16.356001 25230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58418 (request call id 2070) took 1135 ms. Trace:
I20260709 13:12:16.357792 25230 rpcz_store.cc:276] 0709 13:12:15.220989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:15.221091 (+   102us) service_pool.cc:224] Handling call
0709 13:12:15.237814 (+ 16723us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:15.238063 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:15.238100 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:15.243215 (+  5115us) log.cc:844] Serialized 26 byte log entry
0709 13:12:15.484600 (+241385us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:15.484636 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:15.484718 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:16.355716 (+870998us) raft_consensus.cc:1685] finished
0709 13:12:16.355744 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:16.355922 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":157150,"threads_started":1,"wal-append.queue_time_us":304742}
I20260709 13:12:16.308271 25195 leader_election.cc:304] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
W20260709 13:12:16.325850 29400 log.cc:927] Time spent T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.791s	user 0.006s	sys 0.000s
I20260709 13:12:16.274739 29170 raft_consensus.cc:515] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:16.276273 29389 consensus_queue.cc:1059] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
W20260709 13:12:16.368345 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 60144.5us
W20260709 13:12:16.370499 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:16.365103 25301 raft_consensus.cc:1275] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:12:16.332836 29143 consensus_queue.cc:1243] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer da445ce82dc4467f95f4fa52297eaa19 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:12:16.375526 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:16.339524 28717 raft_consensus.cc:740] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:16.353335 29436 raft_consensus.cc:493] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:16.357558 29223 raft_consensus.cc:2804] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:16.366303 29344 leader_election.cc:290] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 12 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:16.395319 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:16.331274 29405 raft_consensus.cc:515] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:16.404104 29448 raft_consensus.cc:493] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.373261 29371 leader_election.cc:290] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:16.377780 29269 raft_consensus.cc:3055] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:16.478511 29155 leader_election.cc:290] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361)
I20260709 13:12:16.478754 29269 raft_consensus.cc:740] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
W20260709 13:12:16.477118 29421 log.cc:927] Time spent T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
I20260709 13:12:16.479971 29269 consensus_queue.cc:260] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:16.481002 25378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36254 (request call id 2183) took 1130 ms. Trace:
W20260709 13:12:16.477792 29427 log.cc:927] Time spent T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
I20260709 13:12:16.481633 29269 raft_consensus.cc:3060] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:16.481406 25378 rpcz_store.cc:276] 0709 13:12:15.350630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:15.614325 (+263695us) service_pool.cc:224] Handling call
0709 13:12:15.614675 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:15.650327 (+ 35652us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:15.650355 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:15.650802 (+   447us) log.cc:844] Serialized 26 byte log entry
0709 13:12:15.896062 (+245260us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:15.896120 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:15.896246 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:16.480788 (+584542us) raft_consensus.cc:1685] finished
0709 13:12:16.480811 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:16.480943 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10004,"raft.queue_time_us":36879,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":41229,"thread_start_us":235183,"threads_started":1,"wal-append.queue_time_us":461407}
I20260709 13:12:16.477504 29442 consensus_queue.cc:1048] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:16.484884 29442 raft_consensus.cc:2749] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:12:16.486621 29425 log.cc:927] Time spent T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
W20260709 13:12:16.488538 29429 log.cc:927] Time spent T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 13:12:16.489398 29432 raft_consensus.cc:2804] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:16.490258 29432 raft_consensus.cc:697] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:16.491961 29432 consensus_queue.cc:237] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:16.493705 29441 raft_consensus.cc:2804] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:16.494357 29441 raft_consensus.cc:493] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:16.494875 29441 raft_consensus.cc:3060] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:16.499552 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:16.373931 29391 consensus_queue.cc:1059] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
W20260709 13:12:16.399621 29423 log.cc:927] Time spent T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.218s	user 0.001s	sys 0.001s
I20260709 13:12:16.396835 29223 raft_consensus.cc:493] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:16.526351 25301 raft_consensus.cc:2468] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 10.
W20260709 13:12:16.501914 29424 log.cc:927] Time spent T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.370s	user 0.001s	sys 0.000s
I20260709 13:12:16.544960 29212 leader_election.cc:290] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:16.545542 29430 log.cc:927] Time spent T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.263s	user 0.000s	sys 0.001s
I20260709 13:12:16.545859 25228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58418 (request call id 2071) took 1324 ms. Trace:
I20260709 13:12:16.546896 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:16.546295 25228 rpcz_store.cc:276] 0709 13:12:15.221565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:15.221691 (+   126us) service_pool.cc:224] Handling call
0709 13:12:15.237220 (+ 15529us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:15.248451 (+ 11231us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:12:15.248480 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:15.269948 (+ 21468us) log.cc:844] Serialized 26 byte log entry
0709 13:12:15.395643 (+125695us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:15.395692 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:15.395756 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:16.296206 (+900450us) spinlock_profiling.cc:243] Waited 3.16 ms on lock 0x7b24001d4c68. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72ca089c4 00007fd72ca06acb 00007fd72cbc1dc9 00007fd72cbc1a55 00007fd72cbc109d 00007fd72f7f310e 00007fd72f80a88c 00007fd72f809bb6 00007fd72f8097d8 00007fd72f813221
0709 13:12:16.545460 (+249254us) raft_consensus.cc:1685] finished
0709 13:12:16.545480 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:16.545775 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6373,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":4968,"spinlock_wait_cycles":7270784,"thread_start_us":125304,"threads_started":1,"wal-append.queue_time_us":182735}
I20260709 13:12:16.548100 29013 leader_election.cc:290] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:16.551492 29170 leader_election.cc:290] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:16.386456 29273 consensus_queue.cc:1059] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.124s
I20260709 13:12:16.396085 29394 leader_election.cc:290] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:16.565991 25345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:16.530325 29223 raft_consensus.cc:3060] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:16.571832 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 265128us
W20260709 13:12:16.564594 29147 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.008s	sys 0.045s
W20260709 13:12:16.588186 25871 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:16.547461 29417 leader_election.cc:290] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:12:16.573244 29422 log.cc:927] Time spent T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.371s	user 0.002s	sys 0.000s
W20260709 13:12:16.578586 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 279366us
I20260709 13:12:16.575171 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:16.503098 29448 raft_consensus.cc:515] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:16.579180 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:16.563974 29221 leader_election.cc:290] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:16.581103 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:16.532054 29267 consensus_queue.cc:1048] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:12:16.468693 29436 raft_consensus.cc:515] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:16.600564 25305 raft_consensus.cc:2468] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 10.
I20260709 13:12:16.600553 25194 leader_election.cc:304] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:12:16.578969 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:16.529620 28717 consensus_queue.cc:260] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:16.591763 29147 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.009s	sys 0.045s
I20260709 13:12:16.578600 29273 consensus_queue.cc:1243] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer 79d99c0e498349bda74127365219e468 log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:12:16.605420 25372 raft_consensus.cc:2468] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 8.
I20260709 13:12:16.626725 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:16.620764 29221 raft_consensus.cc:2804] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:16.619555 25378 raft_consensus.cc:2468] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 7.
W20260709 13:12:16.614804 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 247103us
W20260709 13:12:16.627609 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:16.628748 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:16.631358 25194 leader_election.cc:304] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:16.632357 25222 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.006s	sys 0.006s
W20260709 13:12:16.632793 25222 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.006s	sys 0.006s
I20260709 13:12:16.634195 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:16.635345 25373 raft_consensus.cc:1240] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 7 LEADER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:16.634646 25194 leader_election.cc:304] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:16.640127 25194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:16.642709 25270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:16.648937 25379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36254 (request call id 2178) took 1311 ms. Trace:
I20260709 13:12:16.649561 25379 rpcz_store.cc:276] 0709 13:12:15.337268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:15.495977 (+158709us) service_pool.cc:224] Handling call
0709 13:12:15.505538 (+  9561us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:15.595815 (+ 90277us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:12:15.614269 (+ 18454us) log.cc:844] Serialized 14 byte log entry
0709 13:12:15.875727 (+261458us) log.cc:844] Serialized 14 byte log entry
0709 13:12:15.969569 (+ 93842us) spinlock_profiling.cc:243] Waited 1.84 ms on lock 0x7b180044c2c0. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72cb823f3 00007fd72cb847c1 00007fd72cb84779 00007fd72cb84709 00007fd72cb846d1 00007fd72cb839cd 000000000038f354 000000000038f199 00007fd72cb6583a
0709 13:12:16.268227 (+298658us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:16.268312 (+    85us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:16.268377 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:16.648602 (+380225us) spinlock_profiling.cc:243] Waited 90 ms on lock 0x7b54003115d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:16.648671 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:16.648829 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57891,"prepare.queue_time_us":18461,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":71,"raft.queue_time_us":99463,"raft.run_cpu_time_us":283,"raft.run_wall_time_us":20250,"spinlock_wait_cycles":211361792,"thread_start_us":602022,"threads_started":2,"wal-append.queue_time_us":473422}
W20260709 13:12:16.656412 29404 log.cc:927] Time spent T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.941s	user 0.002s	sys 0.000s
I20260709 13:12:16.661386 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:16.662233 25371 raft_consensus.cc:3060] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:16.665336 25225 raft_consensus.cc:1275] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:12:16.666312 25370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36264 (request call id 1836) took 1428 ms. Trace:
I20260709 13:12:16.666807 25370 rpcz_store.cc:276] 0709 13:12:15.238277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:15.238443 (+   166us) service_pool.cc:224] Handling call
0709 13:12:15.252974 (+ 14531us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:15.306558 (+ 53584us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:16.665983 (+1359425us) spinlock_profiling.cc:243] Waited 20.8 ms on lock 0x7b540037bed4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:16.666229 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47755648}
W20260709 13:12:16.667410 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:16.667900 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:16.669013 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:16.670141 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:16.670804 25370 raft_consensus.cc:2468] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 9.
I20260709 13:12:16.671787 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:16.672443 25370 raft_consensus.cc:2468] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 12.
I20260709 13:12:16.673404 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:16.681905 29170 raft_consensus.cc:3055] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:16.682583 29170 raft_consensus.cc:740] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:16.686517 29170 consensus_queue.cc:260] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:16.688151 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:16.695425 29416 log.cc:927] Time spent T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.737s	user 0.002s	sys 0.000s
I20260709 13:12:16.696079 29013 raft_consensus.cc:493] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.697398 25906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50056 (request call id 754) took 1154 ms. Trace:
I20260709 13:12:16.697916 25906 rpcz_store.cc:276] 0709 13:12:15.543425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:15.546183 (+  2758us) service_pool.cc:224] Handling call
0709 13:12:15.546596 (+   413us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:15.547016 (+   420us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:15.547055 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:15.547711 (+   656us) log.cc:844] Serialized 26 byte log entry
0709 13:12:15.707537 (+159826us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:15.707681 (+   144us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:15.707965 (+   284us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:16.694571 (+986606us) spinlock_profiling.cc:243] Waited 34 ms on lock 0x7b4400022b4c. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72caa8c85 00007fd72caa96a2 00007fd72f81b1db 00007fd72f816aaf 00007fd72f80a86e 00007fd72f809bb6 00007fd72f8097d8 00007fd72f813221 00007fd72f8131d9 00007fd72f813169
0709 13:12:16.697016 (+  2445us) raft_consensus.cc:1685] finished
0709 13:12:16.697044 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:16.697318 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2167,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":111,"spinlock_wait_cycles":78130048,"thread_start_us":159014,"threads_started":1,"wal-append.queue_time_us":314850}
I20260709 13:12:16.706209 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:16.696869 29013 raft_consensus.cc:515] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:16.718161 29371 raft_consensus.cc:3055] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:16.719581 29371 raft_consensus.cc:740] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:16.720695 29371 consensus_queue.cc:260] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:16.722826 29371 raft_consensus.cc:3060] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:16.729176 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:16.729911 25225 raft_consensus.cc:2468] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 11.
I20260709 13:12:16.732672 29375 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:16.733536 29375 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:16.715030 25370 raft_consensus.cc:2468] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 8.
I20260709 13:12:16.652523 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:16.741505 29170 raft_consensus.cc:3060] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:16.743598 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:16.689193 25371 raft_consensus.cc:2468] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 9.
I20260709 13:12:16.752410 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:16.747146 29013 leader_election.cc:290] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:16.750250 25370 raft_consensus.cc:2468] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 7.
I20260709 13:12:16.755177 29375 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:16.780690 25373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36254 (request call id 2182) took 1430 ms. Trace:
I20260709 13:12:16.789173 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:16.789574 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:16.792299 25305 raft_consensus.cc:2468] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 10.
I20260709 13:12:16.787065 25373 rpcz_store.cc:276] 0709 13:12:15.350407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:15.502150 (+151743us) service_pool.cc:224] Handling call
0709 13:12:15.525226 (+ 23076us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:16.636391 (+1111165us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:16.780365 (+143974us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b5400307354. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:16.780606 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2547828608}
W20260709 13:12:16.768942 29145 consensus_meta.cc:287] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.719s	user 0.007s	sys 0.004s
I20260709 13:12:16.629433 29221 raft_consensus.cc:493] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
W20260709 13:12:16.769439 29129 consensus_meta.cc:287] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 1.170s	user 0.013s	sys 0.000s
W20260709 13:12:16.810801 25343 leader_election.cc:336] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Timed out: RequestConsensusVote RPC to 127.23.140.66:33127 timed out after 1.511s (SENT)
I20260709 13:12:16.626235 29394 consensus_queue.cc:1048] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.168s
I20260709 13:12:16.635056 29351 leader_election.cc:290] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:16.769254 29442 raft_consensus.cc:2749] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:16.769963 29310 raft_consensus.cc:493] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:16.771005 29444 raft_consensus.cc:2749] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:16.791661 29086 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:16.781500 29286 raft_consensus.cc:493] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.775035 29313 leader_election.cc:290] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:16.849783 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:12:16.801635 29428 log.cc:927] Time spent T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
I20260709 13:12:16.849860 29200 raft_consensus.cc:493] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:16.851125 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:16.851502 29200 raft_consensus.cc:515] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:16.816247 29145 raft_consensus.cc:515] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:16.854991 29145 leader_election.cc:290] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:16.855772 25302 raft_consensus.cc:2368] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 8. Current term is 9.
I20260709 13:12:16.857829 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:16.858017 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:16.858506 25906 raft_consensus.cc:2468] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 8.
I20260709 13:12:16.859601 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:16.792429 29063 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.842878 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:16.864110 25305 raft_consensus.cc:2393] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 9: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
W20260709 13:12:16.864392 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:16.825985 29434 log.cc:927] Time spent T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.264s	user 0.001s	sys 0.000s
I20260709 13:12:16.843178 25373 raft_consensus.cc:1240] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
W20260709 13:12:16.825460 29443 log.cc:927] Time spent T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.260s	user 0.000s	sys 0.001s
I20260709 13:12:16.819244 29221 raft_consensus.cc:3060] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:16.871675 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:16.877830 25378 raft_consensus.cc:2468] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 9.
I20260709 13:12:16.872103 25270 leader_election.cc:304] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:16.882341 25270 leader_election.cc:304] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:16.822870 29213 raft_consensus.cc:493] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:16.859800 29155 raft_consensus.cc:3055] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:16.887588 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:16.888128 29447 raft_consensus.cc:493] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:16.888566 29382 raft_consensus.cc:493] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:16.888978 29387 raft_consensus.cc:2804] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:16.883731 29442 raft_consensus.cc:493] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.889336 29129 raft_consensus.cc:493] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:16.863821 29273 raft_consensus.cc:493] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:16.890364 29435 log.cc:927] Time spent T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.269s	user 0.000s	sys 0.000s
I20260709 13:12:16.879478 29063 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:16.865144 29086 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:16.910702 29155 raft_consensus.cc:740] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:16.893065 29454 consensus_queue.cc:1059] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:16.969009 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:12:16.890333 29433 log.cc:927] Time spent T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.293s	user 0.001s	sys 0.000s
I20260709 13:12:16.930652 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:16.933118 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:16.972273 25297 raft_consensus.cc:2468] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 11.
I20260709 13:12:16.933880 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:16.879118 29200 leader_election.cc:290] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:16.842713 29310 raft_consensus.cc:515] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:16.932564 29369 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.001s	sys 0.013s
I20260709 13:12:16.935712 29387 raft_consensus.cc:697] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 8 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:16.950011 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:16.951210 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:12:16.998145 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 62152.9us
I20260709 13:12:16.998519 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:16.999173 25227 raft_consensus.cc:3060] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:16.951706 25223 raft_consensus.cc:1240] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 12 LEADER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:16.955037 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:17.000461 25230 raft_consensus.cc:2393] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 12: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:16.955381 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:16.956676 25226 raft_consensus.cc:1275] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:12:16.892472 29389 raft_consensus.cc:2804] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:16.865381 29286 raft_consensus.cc:515] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:17.012938 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:17.013973 25229 raft_consensus.cc:1275] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:12:16.963202 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 383033us
I20260709 13:12:16.966951 25377 raft_consensus.cc:2468] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 9.
I20260709 13:12:16.890264 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:16.969041 28746 raft_consensus.cc:493] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:16.987643 25345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:16.993364 29369 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.001s	sys 0.013s
I20260709 13:12:16.994765 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:17.024595 25373 raft_consensus.cc:3060] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:12:16.934710 29013 consensus_queue.cc:1059] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:12:16.941207 29129 raft_consensus.cc:515] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:16.969798 25375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36254 (request call id 2193) took 1303 ms. Trace:
I20260709 13:12:17.016063 25305 raft_consensus.cc:2468] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 10.
I20260709 13:12:17.017736 25873 leader_election.cc:304] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:12:16.934372 29382 raft_consensus.cc:515] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:16.948573 29375 raft_consensus.cc:493] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:17.027747 25195 leader_election.cc:304] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:16.931339 29213 raft_consensus.cc:515] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:17.025810 25375 rpcz_store.cc:276] 0709 13:12:15.672303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:15.882991 (+210688us) service_pool.cc:224] Handling call
0709 13:12:15.944866 (+ 61875us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:16.005584 (+ 60718us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:16.005618 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:16.006199 (+   581us) log.cc:844] Serialized 26 byte log entry
0709 13:12:16.339287 (+333088us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:16.339325 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:16.339397 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:16.969614 (+630217us) raft_consensus.cc:1685] finished
0709 13:12:16.969632 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:16.969733 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":256892,"threads_started":1,"wal-append.queue_time_us":507432}
I20260709 13:12:17.032259 25195 leader_election.cc:304] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:17.034544 25872 leader_election.cc:304] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:12:17.005105 29453 raft_consensus.cc:493] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:17.088749 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:16.930843 29447 raft_consensus.cc:515] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:16.937120 29442 raft_consensus.cc:515] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:17.095738 25224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 2136) took 1147 ms. Trace:
I20260709 13:12:16.966568 29273 raft_consensus.cc:515] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:17.020201 29454 consensus_queue.cc:1243] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer 79d99c0e498349bda74127365219e468 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:12:16.991647 29450 consensus_queue.cc:1048] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 13:12:17.027233 29389 raft_consensus.cc:697] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 9 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:17.026440 29350 raft_consensus.cc:493] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.022265 29267 raft_consensus.cc:493] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:17.024170 29369 raft_consensus.cc:697] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 11 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:17.103272 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:12:17.114058 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 256839us
I20260709 13:12:17.122124 25302 raft_consensus.cc:2468] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 11.
I20260709 13:12:17.057441 29451 raft_consensus.cc:493] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.102048 25224 rpcz_store.cc:276] 0709 13:12:15.948766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:15.981935 (+ 33169us) service_pool.cc:224] Handling call
0709 13:12:15.982214 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:15.982572 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:15.982599 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:15.983110 (+   511us) log.cc:844] Serialized 26 byte log entry
0709 13:12:16.332127 (+349017us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:16.332188 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:16.332278 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:17.095472 (+763194us) raft_consensus.cc:1685] finished
0709 13:12:17.095499 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:17.095665 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3569,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":104,"thread_start_us":348618,"threads_started":1,"wal-append.queue_time_us":577338}
W20260709 13:12:17.138274 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 120667us
W20260709 13:12:17.196139 25270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:17.141237 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 106760us
W20260709 13:12:17.143589 25871 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:17.153227 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 119713us
I20260709 13:12:17.158973 29267 raft_consensus.cc:515] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:17.128098 29269 consensus_meta.cc:287] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.645s	user 0.010s	sys 0.002s
I20260709 13:12:17.028801 28746 raft_consensus.cc:515] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:17.094790 29375 raft_consensus.cc:515] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:17.161375 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:17.134390 25303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46556 (request call id 552) took 1633 ms. Trace:
I20260709 13:12:17.194432 25379 raft_consensus.cc:3055] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:17.108106 29013 raft_consensus.cc:493] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:17.200335 25872 leader_election.cc:304] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:12:17.123975 29444 raft_consensus.cc:2804] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:17.117993 29120 raft_consensus.cc:493] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:17.108172 29405 leader_election.cc:290] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:17.124857 29448 leader_election.cc:290] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:17.225329 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:17.246721 25302 raft_consensus.cc:2468] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 8.
W20260709 13:12:17.228909 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:17.235726 25195 leader_election.cc:304] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:17.124704 29436 leader_election.cc:290] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:17.246933 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:17.248595 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:17.162919 29471 raft_consensus.cc:493] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:17.251510 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:17.228274 25379 raft_consensus.cc:740] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:17.299299 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:17.301707 25379 consensus_queue.cc:260] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:17.303068 25379 raft_consensus.cc:3060] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:17.227871 25303 rpcz_store.cc:276] 0709 13:12:15.500553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:15.500680 (+   127us) service_pool.cc:224] Handling call
0709 13:12:15.508912 (+  8232us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:15.520638 (+ 11726us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:15.520671 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:15.521123 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 13:12:15.963058 (+441935us) spinlock_profiling.cc:243] Waited 5.36 ms on lock 0x7b18003574c0. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72cb64e07 00007fd7359bfab9 00007fd72cb8169b 00007fd72cb7f93f 00007fd72cb81c02 00007fd72f80920b 00007fd72f80ed23 00007fd72f80f0d1 00007fd72fc2aa0f
0709 13:12:16.326852 (+363794us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:16.326891 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:16.326960 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:17.124511 (+797551us) raft_consensus.cc:1685] finished
0709 13:12:17.124537 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:17.134309 (+  9772us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10042,"raft.queue_time_us":7034,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":2783,"spinlock_wait_cycles":12336384,"thread_start_us":363597,"threads_started":1,"wal-append.queue_time_us":1002427}
I20260709 13:12:17.312952 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:17.100935 29453 raft_consensus.cc:515] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:17.239966 29444 raft_consensus.cc:493] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:17.163354 29350 raft_consensus.cc:515] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:17.197285 29466 consensus_queue.cc:1048] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.183s
I20260709 13:12:17.346050 29463 raft_consensus.cc:2804] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:17.346566 29463 raft_consensus.cc:493] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:17.346897 29463 raft_consensus.cc:3060] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:17.349291 29340 consensus_meta.cc:287] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent flushing consensus metadata: real 1.255s	user 0.010s	sys 0.000s
I20260709 13:12:17.205371 29451 raft_consensus.cc:515] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:17.314221 29436 raft_consensus.cc:2804] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:17.310894 29170 raft_consensus.cc:493] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:17.350907 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:17.358039 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:17.383275 25304 raft_consensus.cc:2468] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 9.
I20260709 13:12:17.245910 29013 raft_consensus.cc:515] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:17.391753 25375 raft_consensus.cc:1275] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:12:17.250679 29120 raft_consensus.cc:515] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:17.399650 25305 raft_consensus.cc:1240] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 7. Current term is 8. Ops: [7.6-7.6]
W20260709 13:12:17.400063 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:17.400489 25379 raft_consensus.cc:1275] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
W20260709 13:12:17.350548 29483 log.cc:927] Time spent T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:12:17.400887 25379 pending_rounds.cc:85] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468: Aborting all ops after (but not including) 9
I20260709 13:12:17.333719 29444 raft_consensus.cc:3060] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:17.404348 25379 pending_rounds.cc:107] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:12:17.409199 25379 raft_consensus.cc:2889] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:12:17.355347 29476 log.cc:927] Time spent T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 13:12:17.320358 29458 raft_consensus.cc:493] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
W20260709 13:12:17.356401 29461 log.cc:927] Time spent T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.330s	user 0.001s	sys 0.000s
I20260709 13:12:17.427789 29458 raft_consensus.cc:515] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:17.430474 29458 leader_election.cc:290] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:17.431543 29013 leader_election.cc:290] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:17.378265 29223 consensus_meta.cc:287] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.785s	user 0.008s	sys 0.003s
W20260709 13:12:17.355788 29468 log.cc:927] Time spent T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.333s	user 0.000s	sys 0.001s
I20260709 13:12:17.433475 29223 raft_consensus.cc:515] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:17.434763 25297 raft_consensus.cc:1240] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:17.435773 29223 leader_election.cc:290] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:17.437325 29469 log.cc:927] Time spent T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.202s	user 0.000s	sys 0.000s
I20260709 13:12:17.353809 29490 raft_consensus.cc:2804] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:17.357561 29442 leader_election.cc:290] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:17.439360 29490 raft_consensus.cc:697] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:17.440548 29490 consensus_queue.cc:237] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:17.340634 29405 raft_consensus.cc:493] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:17.342015 29450 raft_consensus.cc:2804] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:17.354686 29460 raft_consensus.cc:2804] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:17.224720 29155 consensus_queue.cc:260] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:17.411046 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:12:17.410272 25114 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 8d0f43a786a846b49924a589e4a36f2f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 79d99c0e498349bda74127365219e468 (127.23.140.67:34091) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 79d99c0e498349bda74127365219e468 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:12:17.415360 29465 raft_consensus.cc:493] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:17.361251 29447 leader_election.cc:290] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:17.360469 29375 leader_election.cc:290] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:17.311638 29471 raft_consensus.cc:515] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:17.352540 29470 raft_consensus.cc:493] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:17.416827 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:17.410285 29475 raft_consensus.cc:493] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:17.417351 29145 raft_consensus.cc:493] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:17.351922 29451 leader_election.cc:290] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:17.361555 29350 leader_election.cc:290] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:17.419312 29452 log.cc:927] Time spent T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.418s	user 0.000s	sys 0.001s
I20260709 13:12:17.377537 29313 consensus_queue.cc:1048] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:12:17.398363 29063 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:17.398208 29369 consensus_queue.cc:237] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:17.424178 29312 consensus_meta.cc:287] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent flushing consensus metadata: real 1.346s	user 0.013s	sys 0.001s
I20260709 13:12:17.414017 29170 raft_consensus.cc:515] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:17.438742 25222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 2140) took 1489 ms. Trace:
I20260709 13:12:17.350710 29086 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:17.383361 29436 raft_consensus.cc:493] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:17.362607 29213 leader_election.cc:290] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:17.247510 29387 consensus_queue.cc:237] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:17.317188 29462 consensus_queue.cc:1048] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.107s
I20260709 13:12:17.349740 29340 raft_consensus.cc:515] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:17.357614 29389 consensus_queue.cc:237] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:17.614432 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 380785us
I20260709 13:12:17.688480 25874 leader_election.cc:304] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:12:17.445657 25227 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 9.
W20260709 13:12:17.488157 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:17.692677 25373 consensus_meta.cc:287] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.668s	user 0.010s	sys 0.000s
W20260709 13:12:17.666913 25194 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.004s	sys 0.026s
W20260709 13:12:17.694205 25194 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.004s	sys 0.027s
I20260709 13:12:17.694010 25373 raft_consensus.cc:2468] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 9.
W20260709 13:12:17.694722 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 680267us
I20260709 13:12:17.445732 25377 raft_consensus.cc:1275] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:12:17.695534 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:17.696673 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:12:17.693521 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:17.689157 25114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 298027us
W20260709 13:12:17.689649 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 489362us
I20260709 13:12:17.694046 29460 raft_consensus.cc:493] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:17.436213 29120 leader_election.cc:290] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:17.702193 25908 raft_consensus.cc:1240] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 LEADER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:12:17.706806 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:12:17.537598 29221 consensus_meta.cc:287] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 0.646s	user 0.006s	sys 0.001s
W20260709 13:12:17.470295 29378 consensus_meta.cc:287] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 1.192s	user 0.008s	sys 0.004s
W20260709 13:12:17.688858 29388 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.794s	user 0.000s	sys 0.010s
I20260709 13:12:17.699747 29473 raft_consensus.cc:2804] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:12:17.584807 29377 consensus_meta.cc:287] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 1.374s	user 0.011s	sys 0.002s
I20260709 13:12:17.705224 25271 leader_election.cc:304] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:17.720528 25271 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:17.689823 25222 rpcz_store.cc:276] 0709 13:12:15.961464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:16.028860 (+ 67396us) service_pool.cc:224] Handling call
0709 13:12:16.029341 (+   481us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:16.633228 (+603887us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:16.633260 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:16.775158 (+141898us) log.cc:844] Serialized 26 byte log entry
0709 13:12:16.973035 (+197877us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:16.973088 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:16.973176 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:17.438497 (+465321us) raft_consensus.cc:1685] finished
0709 13:12:17.438524 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:17.438674 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":233753,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":11058,"thread_start_us":736625,"threads_started":2,"wal-append.queue_time_us":282885}
W20260709 13:12:17.657792 29441 consensus_meta.cc:287] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 1.147s	user 0.013s	sys 0.000s
I20260709 13:12:17.540493 29453 leader_election.cc:290] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:17.465443 29442 raft_consensus.cc:493] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:17.695546 25194 leader_election.cc:336] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Timed out: RequestConsensusVote RPC to 127.23.140.66:33127 timed out after 1.619s (SENT)
I20260709 13:12:17.736744 25194 leader_election.cc:304] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:17.707758 25375 raft_consensus.cc:2468] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 12.
I20260709 13:12:17.541635 29310 leader_election.cc:290] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:17.477082 29286 leader_election.cc:290] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:17.719372 29473 raft_consensus.cc:493] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:17.713363 25908 raft_consensus.cc:1240] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 LEADER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:17.694058 29436 raft_consensus.cc:3060] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:17.715579 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:17.516254 29466 raft_consensus.cc:493] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
W20260709 13:12:17.775445 29487 log.cc:927] Time spent T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.271s	user 0.001s	sys 0.000s
I20260709 13:12:17.775734 29466 raft_consensus.cc:515] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:17.776703 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 81197.3us
W20260709 13:12:17.777328 25194 leader_election.cc:336] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Timed out: RequestConsensusVote RPC to 127.23.140.66:33127 timed out after 1.676s (SENT)
I20260709 13:12:17.777920 29466 leader_election.cc:290] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:17.779444 29170 leader_election.cc:290] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:17.743875 29442 raft_consensus.cc:515] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:17.785061 29120 consensus_queue.cc:1048] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:17.785516 29447 consensus_queue.cc:1048] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:17.748245 29473 raft_consensus.cc:3060] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:17.731911 29441 raft_consensus.cc:515] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:17.794135 25905 raft_consensus.cc:1240] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:17.795445 29441 leader_election.cc:290] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:17.796339 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:17.720994 29378 raft_consensus.cc:515] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:17.798962 29378 leader_election.cc:290] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:17.799057 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:17.745215 29463 raft_consensus.cc:515] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:17.802982 29463 leader_election.cc:290] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:17.804499 29471 leader_election.cc:290] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:17.695231 29465 raft_consensus.cc:515] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:17.807090 29140 raft_consensus.cc:493] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.807607 29140 raft_consensus.cc:515] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:17.809764 25900 raft_consensus.cc:1275] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:12:17.809985 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:17.810534 29208 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:17.810745 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:17.811110 29208 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:17.812240 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:17.813225 29208 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:17.814342 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:17.814778 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:12:17.815009 25194 leader_election.cc:336] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Timed out: RequestConsensusVote RPC to 127.23.140.66:33127 timed out after 2.035s (SENT)
I20260709 13:12:17.815570 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:12:17.815846 25194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:17.816591 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:17.816684 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:17.817231 29442 leader_election.cc:290] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:17.817364 25907 raft_consensus.cc:2468] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 14.
I20260709 13:12:17.722815 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:17.724588 25271 leader_election.cc:304] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:17.815860 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:12:17.831588 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 107089us
I20260709 13:12:17.810550 25905 raft_consensus.cc:3060] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:17.832443 25271 leader_election.cc:304] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:17.701190 29450 raft_consensus.cc:697] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:17.700677 29458 raft_consensus.cc:493] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:17.476485 29474 consensus_queue.cc:1048] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.594s
W20260709 13:12:17.715579 29388 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.821s	user 0.000s	sys 0.010s
I20260709 13:12:17.707865 29460 raft_consensus.cc:3060] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:17.734246 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:17.451537 29405 raft_consensus.cc:515] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:17.713699 28746 leader_election.cc:290] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:17.539350 29267 leader_election.cc:290] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:17.698230 29312 raft_consensus.cc:515] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:17.709192 29223 consensus_queue.cc:1048] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:12:17.864763 29450 consensus_queue.cc:237] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:17.729760 29350 raft_consensus.cc:493] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.866246 29350 raft_consensus.cc:515] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:17.866600 29436 raft_consensus.cc:515] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:17.857025 25901 raft_consensus.cc:1240] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:17.698347 29470 raft_consensus.cc:515] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:17.835255 29170 raft_consensus.cc:2749] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:17.746948 25374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36254 (request call id 2191) took 2172 ms. Trace:
W20260709 13:12:17.849346 29446 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.018s	sys 0.067s
I20260709 13:12:17.756048 29340 leader_election.cc:290] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 12 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:17.725919 29377 raft_consensus.cc:515] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:17.701484 29145 raft_consensus.cc:515] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:17.764334 28717 raft_consensus.cc:3060] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:17.717459 29221 raft_consensus.cc:515] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:17.766454 29371 raft_consensus.cc:3055] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:17.769848 29451 raft_consensus.cc:2749] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:17.769941 29273 leader_election.cc:290] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:17.771011 29485 log.cc:927] Time spent T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
W20260709 13:12:17.772123 29431 log.cc:927] Time spent T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 1.295s	user 0.000s	sys 0.013s
I20260709 13:12:17.898051 29350 leader_election.cc:290] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:17.772585 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:17.899992 29470 leader_election.cc:290] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:17.726315 29454 raft_consensus.cc:2749] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:17.698235 29475 raft_consensus.cc:515] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:17.775120 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:17.818274 25194 leader_election.cc:304] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:17.902104 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 83903.4us
I20260709 13:12:17.903349 25194 leader_election.cc:304] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:17.904011 29377 leader_election.cc:290] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:17.904606 29377 raft_consensus.cc:2749] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:17.905344 25228 raft_consensus.cc:2393] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 12: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:17.807106 29465 leader_election.cc:290] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:17.818936 29442 consensus_queue.cc:1048] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:17.819149 29463 consensus_queue.cc:1048] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:17.907275 25370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36264 (request call id 1856) took 1072 ms. Trace:
I20260709 13:12:17.820693 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:17.908010 29145 leader_election.cc:290] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:17.908460 25372 raft_consensus.cc:2393] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 12: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:17.908519 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:17.909330 29436 leader_election.cc:290] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:17.889081 29371 raft_consensus.cc:740] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:17.911482 25194 leader_election.cc:304] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:12:17.829974 25195 leader_election.cc:304] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:17.913368 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:17.478495 29129 leader_election.cc:290] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:17.839763 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:17.839998 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:17.914688 25375 raft_consensus.cc:3060] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:17.907646 25370 rpcz_store.cc:276] 0709 13:12:16.834697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:17.188211 (+353514us) service_pool.cc:224] Handling call
0709 13:12:17.224840 (+ 36629us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:17.239598 (+ 14758us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:17.239629 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:17.290989 (+ 51360us) log.cc:844] Serialized 26 byte log entry
0709 13:12:17.719364 (+428375us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:17.719403 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:17.719475 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:17.907084 (+187609us) raft_consensus.cc:1685] finished
0709 13:12:17.907104 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:17.907220 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":280,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":45394,"thread_start_us":378242,"threads_started":1,"wal-append.queue_time_us":535980}
I20260709 13:12:17.839493 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:12:17.844673 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:17.854442 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:17.916436 25230 raft_consensus.cc:1240] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:17.809653 29140 leader_election.cc:290] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:17.863307 29405 leader_election.cc:290] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:17.863832 25379 raft_consensus.cc:2468] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 7.
I20260709 13:12:17.864393 29312 leader_election.cc:290] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 9 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:17.868436 25899 raft_consensus.cc:2368] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for earlier term 8. Current term is 9.
I20260709 13:12:17.870476 25271 leader_election.cc:304] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
W20260709 13:12:17.926081 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 55691.9us
I20260709 13:12:17.725893 29013 raft_consensus.cc:2749] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:17.838016 29208 raft_consensus.cc:2749] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:17.877050 25374 rpcz_store.cc:276] 0709 13:12:15.575034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:15.859853 (+284819us) service_pool.cc:224] Handling call
0709 13:12:15.880205 (+ 20352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:16.322476 (+442271us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:16.322522 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:16.329097 (+  6575us) log.cc:844] Serialized 26 byte log entry
0709 13:12:16.579039 (+249942us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:16.579076 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:16.579317 (+   241us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:17.746709 (+1167392us) raft_consensus.cc:1685] finished
0709 13:12:17.746735 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:17.746869 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63065,"raft.queue_time_us":89378,"raft.run_cpu_time_us":55,"raft.run_wall_time_us":55,"thread_start_us":590204,"threads_started":2,"wal-append.queue_time_us":541158}
I20260709 13:12:17.754156 29505 consensus_queue.cc:1059] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:17.879222 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:12:17.880944 29446 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.018s	sys 0.068s
I20260709 13:12:17.891319 25905 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 9.
W20260709 13:12:17.833988 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 45334.7us
I20260709 13:12:17.936205 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:17.936791 25297 raft_consensus.cc:2468] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 11.
I20260709 13:12:17.938349 25297 raft_consensus.cc:1275] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:12:17.918702 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:17.939721 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:17.918771 25194 leader_election.cc:304] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:17.918977 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 89168.7us
I20260709 13:12:17.923756 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:17.851600 29458 raft_consensus.cc:515] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:17.905215 29473 raft_consensus.cc:515] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:17.927724 29465 consensus_queue.cc:1059] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:17.928561 29140 consensus_queue.cc:1059] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:17.929309 25376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36254 (request call id 2186) took 2536 ms. Trace:
I20260709 13:12:17.929613 29145 raft_consensus.cc:2749] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:17.931201 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:17.942442 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:17.974149 25297 raft_consensus.cc:2393] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 11: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:17.943216 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:17.943898 25195 leader_election.cc:304] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:17.944052 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:17.944900 29221 leader_election.cc:290] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:17.974710 25303 raft_consensus.cc:2468] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 11.
I20260709 13:12:17.945642 29470 raft_consensus.cc:2749] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:17.905220 29377 raft_consensus.cc:2804] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:17.988929 25904 raft_consensus.cc:2368] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for earlier term 11. Current term is 12.
I20260709 13:12:17.947731 25228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54000 (request call id 685) took 1244 ms. Trace:
I20260709 13:12:17.989576 25228 rpcz_store.cc:276] 0709 13:12:16.703513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:16.705883 (+  2370us) service_pool.cc:224] Handling call
0709 13:12:17.947569 (+1241686us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54003a6e54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:17.947680 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2723288320}
I20260709 13:12:17.990063 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:17.919183 29451 raft_consensus.cc:2804] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:17.964107 25375 raft_consensus.cc:2468] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 12.
I20260709 13:12:17.937923 29463 raft_consensus.cc:2804] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:18.002174 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:18.002916 25303 raft_consensus.cc:2368] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 8. Current term is 9.
I20260709 13:12:17.966174 25344 leader_election.cc:304] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:17.910611 29371 consensus_queue.cc:260] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:17.976238 25343 leader_election.cc:336] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Timed out: RequestConsensusVote RPC to 127.23.140.66:33127 timed out after 1.776s (SENT)
I20260709 13:12:17.945067 25194 leader_election.cc:304] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:12:17.979910 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:17.980361 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:17.970014 25376 rpcz_store.cc:276] 0709 13:12:15.393215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:15.627722 (+234507us) service_pool.cc:224] Handling call
0709 13:12:15.628061 (+   339us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:12:15.745106 (+117045us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:15.745432 (+   326us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:12:15.789513 (+ 44081us) log.cc:844] Serialized 78 byte log entry
0709 13:12:16.241794 (+452281us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:16.264308 (+ 22514us) log.cc:844] Serialized 14 byte log entry
0709 13:12:16.270564 (+  6256us) log.cc:844] Serialized 14 byte log entry
0709 13:12:16.389198 (+118634us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:16.389299 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:16.549874 (+160575us) spinlock_profiling.cc:243] Waited 4.01 ms on lock 0x7b180041eba0. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72cb823f3 00007fd72cb847c1 00007fd72cb84779 00007fd72cb84709 00007fd72cb846d1 00007fd72cb839cd 000000000038f354 000000000038f199 00007fd72cb6583a
0709 13:12:17.771570 (+1221696us) spinlock_profiling.cc:243] Waited 24.7 ms on lock 0x7b4400022b4c. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72caa8c85 00007fd72caa96a2 00007fd72f81b1db 00007fd72f816aaf 00007fd72f80a86e 00007fd72f809bb6 00007fd72f8097d8 00007fd72f813221 00007fd72f8131d9 00007fd72f813169
0709 13:12:17.929069 (+157499us) raft_consensus.cc:1685] finished
0709 13:12:17.929088 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:17.929241 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61124,"prepare.queue_time_us":314042,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"raft.queue_time_us":412382,"raft.run_cpu_time_us":433,"raft.run_wall_time_us":25512,"spinlock_wait_cycles":66066176,"thread_start_us":521572,"threads_started":2,"wal-append.queue_time_us":654082}
I20260709 13:12:17.945210 29505 raft_consensus.cc:3055] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:17.948045 25299 raft_consensus.cc:1275] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:12:17.991376 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:17.992012 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:17.996834 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:18.013386 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:18.014008 25374 raft_consensus.cc:2468] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 14.
I20260709 13:12:18.014809 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:18.015455 25370 raft_consensus.cc:3060] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:17.938091 28746 consensus_queue.cc:1048] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:12:18.000870 25225 raft_consensus.cc:2468] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 13.
W20260709 13:12:18.005599 29444 consensus_meta.cc:287] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 0.573s	user 0.008s	sys 0.003s
I20260709 13:12:18.047869 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:18.065006 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:18.009227 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:18.065241 29444 raft_consensus.cc:515] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:18.038918 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:18.066774 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:18.037951 29465 consensus_queue.cc:1059] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:12:18.067561 25901 raft_consensus.cc:3060] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:18.067735 29465 consensus_queue.cc:1243] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer 6c4b021f3f9e41adb75e870a08ad88b6 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:12:18.030385 29212 consensus_queue.cc:1059] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:12:18.010564 25301 pending_rounds.cc:85] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19: Aborting all ops after (but not including) 5
I20260709 13:12:18.061841 29506 raft_consensus.cc:3055] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:18.069931 25301 pending_rounds.cc:107] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:12:18.070418 25301 raft_consensus.cc:2889] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:17.979550 29446 raft_consensus.cc:493] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:18.026772 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:18.038065 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:12:18.042814 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 66620.9us
I20260709 13:12:17.984517 29442 raft_consensus.cc:2749] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:18.078500 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:18.039310 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:12:18.016999 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 50871.7us
I20260709 13:12:18.079790 25302 raft_consensus.cc:2468] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 11.
I20260709 13:12:18.062911 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:18.044067 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:18.058880 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:18.082067 25298 raft_consensus.cc:3060] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:18.082288 25375 raft_consensus.cc:3060] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Advancing to term 9
W20260709 13:12:18.043341 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 98309.9us
I20260709 13:12:18.048465 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:18.083279 25194 leader_election.cc:304] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:18.031304 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:18.084303 25303 raft_consensus.cc:2468] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 12.
I20260709 13:12:18.071339 29446 raft_consensus.cc:515] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:18.070259 29506 raft_consensus.cc:740] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:18.054216 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:18.052953 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:18.043712 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:17.997989 25873 leader_election.cc:304] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
W20260709 13:12:18.098693 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 100765us
I20260709 13:12:18.099596 25873 leader_election.cc:304] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:18.065573 25305 raft_consensus.cc:2468] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 10.
I20260709 13:12:18.101104 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:18.101709 25305 raft_consensus.cc:2468] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 12.
I20260709 13:12:18.079909 25299 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 9.
I20260709 13:12:17.999974 29377 raft_consensus.cc:493] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:18.001380 29451 raft_consensus.cc:493] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
W20260709 13:12:18.089418 25271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:18.058714 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:18.039508 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:18.045288 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:18.092083 25194 leader_election.cc:304] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:18.159003 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 67013.8us
I20260709 13:12:18.092779 28717 raft_consensus.cc:2749] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:18.093387 25300 raft_consensus.cc:2393] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 8: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:18.099917 25344 leader_election.cc:304] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
W20260709 13:12:18.161577 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 61773.1us
I20260709 13:12:18.005105 29086 raft_consensus.cc:493] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:18.102672 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:18.103469 25195 leader_election.cc:304] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:18.087893 25304 raft_consensus.cc:2468] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 10.
I20260709 13:12:18.105077 25873 leader_election.cc:304] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:18.041589 29155 raft_consensus.cc:3060] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:18.001600 29463 raft_consensus.cc:493] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:18.106068 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:18.079352 25226 raft_consensus.cc:2468] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 13.
I20260709 13:12:18.012959 29208 raft_consensus.cc:3055] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:18.045899 29221 raft_consensus.cc:2764] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:12:18.033495 29405 raft_consensus.cc:2804] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:18.056613 29170 consensus_queue.cc:1059] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.125s
I20260709 13:12:18.154443 29340 raft_consensus.cc:2804] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:18.278971 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:18.281215 25302 raft_consensus.cc:2468] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 10.
I20260709 13:12:18.282181 25901 raft_consensus.cc:2468] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 11.
I20260709 13:12:18.176065 29451 raft_consensus.cc:3060] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:18.169340 25375 raft_consensus.cc:2468] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 9.
I20260709 13:12:18.054394 29382 leader_election.cc:290] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:18.039489 29473 leader_election.cc:290] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 12 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:18.158085 25899 raft_consensus.cc:2468] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 13.
I20260709 13:12:18.012166 29505 raft_consensus.cc:740] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:18.034199 29475 leader_election.cc:290] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:18.067348 29444 leader_election.cc:290] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:18.105104 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:18.180014 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:18.063472 29458 leader_election.cc:290] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:18.185060 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 80043.3us
I20260709 13:12:18.185669 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:18.320724 25904 raft_consensus.cc:1240] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:18.186982 28717 consensus_queue.cc:1059] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:18.190507 25872 leader_election.cc:304] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:18.179514 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:18.095019 29147 raft_consensus.cc:493] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:18.192319 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:12:18.182375 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 78968.6us
W20260709 13:12:18.322078 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 131654us
I20260709 13:12:18.322423 25304 raft_consensus.cc:2468] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 8.
I20260709 13:12:18.323439 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:18.323752 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:18.186012 29086 raft_consensus.cc:515] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:18.184171 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:17.997347 29200 consensus_queue.cc:1048] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.114s
I20260709 13:12:18.154747 29312 raft_consensus.cc:2804] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:18.155560 29377 raft_consensus.cc:3060] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:18.336017 25195 leader_election.cc:304] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:18.338165 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:18.338220 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:18.338863 25225 raft_consensus.cc:3060] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:18.172996 25370 raft_consensus.cc:2468] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 9.
I20260709 13:12:18.104506 29378 consensus_queue.cc:1048] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.171s
I20260709 13:12:18.272430 29405 raft_consensus.cc:493] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:18.198140 29442 raft_consensus.cc:2804] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:18.197587 29463 raft_consensus.cc:3060] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:18.180557 29499 raft_consensus.cc:2749] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:18.180624 29350 raft_consensus.cc:2804] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:18.317623 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:18.196686 29286 raft_consensus.cc:2804] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:18.157291 29441 consensus_queue.cc:1048] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.146s
I20260709 13:12:18.186769 29466 consensus_queue.cc:1059] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.128s
I20260709 13:12:18.197024 29208 raft_consensus.cc:740] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
W20260709 13:12:18.319416 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:18.427613 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:18.088791 29129 raft_consensus.cc:493] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:18.324842 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:18.304994 29223 raft_consensus.cc:493] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:18.326915 25299 raft_consensus.cc:3060] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:12:18.346565 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:18.326195 29394 raft_consensus.cc:3055] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:18.348728 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:18.354446 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:18.363744 25226 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92f679df8187472794ba8595642f63f9"
dest_uuid: "1f539ba21487460085b837e7529a78ce"
mode: GRACEFUL
new_leader_uuid: "da445ce82dc4467f95f4fa52297eaa19"
 from {username='slave'} at 127.0.0.1:45014
I20260709 13:12:18.328233 29474 raft_consensus.cc:2804] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:18.366323 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:18.413944 29286 raft_consensus.cc:493] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:18.417032 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:18.452275 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:18.453213 25302 raft_consensus.cc:3060] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:12:18.404091 29389 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.033s	sys 0.025s
I20260709 13:12:18.323372 29147 raft_consensus.cc:515] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:18.367100 29405 raft_consensus.cc:3060] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:18.482008 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:18.364784 29442 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:18.447228 25226 raft_consensus.cc:606] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Received request to transfer leadership to TS da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:18.334290 29312 raft_consensus.cc:493] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:18.313239 29506 consensus_queue.cc:260] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:18.453858 25225 raft_consensus.cc:2410] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:12:18.479907 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:18.534438 25305 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 9.
W20260709 13:12:18.474082 29389 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.033s	sys 0.025s
I20260709 13:12:18.484068 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:18.535920 25223 raft_consensus.cc:2410] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 10 because replica has last-logged OpId of term: 9 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 3.
I20260709 13:12:18.479599 25271 leader_election.cc:304] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
W20260709 13:12:18.536890 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 57359.9us
I20260709 13:12:18.537869 25271 leader_election.cc:304] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:18.539300 25271 leader_election.cc:304] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:18.425212 29267 raft_consensus.cc:2749] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:18.486558 25224 raft_consensus.cc:2393] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 13: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:18.486847 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:18.487658 25226 raft_consensus.cc:614] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:12:18.478363 29511 log.cc:927] Time spent T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 13:12:18.447248 29394 raft_consensus.cc:740] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:18.428150 29350 raft_consensus.cc:697] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 9 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:18.451508 29499 raft_consensus.cc:493] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:18.558034 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:18.558827 25305 raft_consensus.cc:3060] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:12:18.559906 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:18.560299 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:18.560883 25225 raft_consensus.cc:2393] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 11: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:18.459127 29286 raft_consensus.cc:3060] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:18.450187 29474 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:18.546742 25302 raft_consensus.cc:2468] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 12.
I20260709 13:12:18.498432 29442 raft_consensus.cc:3060] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:18.567812 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:18.568678 25302 raft_consensus.cc:2393] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 12: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:12:18.502632 25299 raft_consensus.cc:2468] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 12.
I20260709 13:12:18.457204 29223 raft_consensus.cc:515] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:18.535157 29312 raft_consensus.cc:3060] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:18.562584 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:18.576486 25271 leader_election.cc:304] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:18.577061 25303 raft_consensus.cc:2468] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 8.
I20260709 13:12:18.569545 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:18.575886 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:18.578410 25299 raft_consensus.cc:2376] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 79d99c0e498349bda74127365219e468 in term 10. Re-sending same reply.
I20260709 13:12:18.579418 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:18.580189 25299 raft_consensus.cc:2468] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 10.
I20260709 13:12:18.581183 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:12:18.565685 29450 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.006s	sys 0.052s
I20260709 13:12:18.428874 29505 consensus_queue.cc:260] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:18.477672 29129 raft_consensus.cc:515] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:18.592813 25299 raft_consensus.cc:1275] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:12:18.558436 29378 raft_consensus.cc:3055] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:18.570030 29474 raft_consensus.cc:3060] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:12:18.636375 25298 consensus_meta.cc:287] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.534s	user 0.008s	sys 0.003s
I20260709 13:12:18.637207 25298 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 9.
I20260709 13:12:18.647071 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:18.666531 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:18.668280 25302 raft_consensus.cc:2468] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 12.
I20260709 13:12:18.572602 29389 raft_consensus.cc:2749] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:18.575966 29145 raft_consensus.cc:2749] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:12:18.599820 29450 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.006s	sys 0.052s
I20260709 13:12:18.580705 29388 raft_consensus.cc:2749] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:12:18.646960 29510 log.cc:927] Time spent T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.299s	user 0.001s	sys 0.001s
I20260709 13:12:18.679194 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:18.680225 29394 consensus_queue.cc:260] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:18.682586 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:18.685240 29460 consensus_meta.cc:287] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 0.809s	user 0.008s	sys 0.002s
I20260709 13:12:18.685642 29474 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:18.610634 29378 raft_consensus.cc:740] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:18.700162 25222 raft_consensus.cc:2393] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 9: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:18.572947 29208 consensus_queue.cc:260] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:18.706287 25377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36264 (request call id 1860) took 1322 ms. Trace:
I20260709 13:12:18.670771 29454 raft_consensus.cc:2749] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:18.698863 29505 raft_consensus.cc:3060] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:18.565327 29499 raft_consensus.cc:515] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:18.710429 25377 rpcz_store.cc:276] 0709 13:12:17.383806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:17.710564 (+326758us) service_pool.cc:224] Handling call
0709 13:12:17.710891 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:17.723560 (+ 12669us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:17.723599 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:17.736044 (+ 12445us) log.cc:844] Serialized 26 byte log entry
0709 13:12:17.985253 (+249209us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:17.985292 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:17.985368 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:18.706014 (+720646us) raft_consensus.cc:1685] finished
0709 13:12:18.706042 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:18.706202 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":99,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":6576,"thread_start_us":243268,"threads_started":1,"wal-append.queue_time_us":532642}
W20260709 13:12:18.715982 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 526385us
I20260709 13:12:18.721518 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:12:18.722154 25194 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.009s	sys 0.011s
W20260709 13:12:18.722517 25194 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.009s	sys 0.011s
I20260709 13:12:18.720918 25270 leader_election.cc:304] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:18.723935 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:18.748960 25222 raft_consensus.cc:3060] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:12:18.698297 29509 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.033s	sys 0.042s
I20260709 13:12:18.709887 29340 raft_consensus.cc:697] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
W20260709 13:12:18.724503 25227 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.013s	sys 0.043s
W20260709 13:12:18.749969 29509 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.033s	sys 0.043s
W20260709 13:12:18.750206 25227 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.013s	sys 0.043s
I20260709 13:12:18.751613 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:18.752250 25227 raft_consensus.cc:2468] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 11.
I20260709 13:12:18.724237 29208 raft_consensus.cc:3060] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:18.753513 29340 consensus_queue.cc:237] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:18.755219 29474 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 14 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:12:18.756973 29518 log.cc:927] Time spent T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:12:18.757299 29223 leader_election.cc:290] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:18.757920 29223 raft_consensus.cc:2804] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:18.758355 29223 raft_consensus.cc:697] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 9 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:18.758415 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:18.759227 29223 consensus_queue.cc:237] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:18.751001 29378 consensus_queue.cc:260] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:18.729552 29394 raft_consensus.cc:3060] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:18.763072 29463 raft_consensus.cc:515] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:18.766352 29516 log.cc:927] Time spent T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
I20260709 13:12:18.767622 25906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50058 (request call id 788) took 1065 ms. Trace:
I20260709 13:12:18.767994 25906 rpcz_store.cc:276] 0709 13:12:17.701792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:17.702003 (+   211us) service_pool.cc:224] Handling call
0709 13:12:17.713004 (+ 11001us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:17.716430 (+  3426us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:17.716472 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:17.743018 (+ 26546us) log.cc:844] Serialized 564 byte log entry
0709 13:12:18.103150 (+360132us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:18.103187 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:18.103246 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:18.767371 (+664125us) raft_consensus.cc:1685] finished
0709 13:12:18.767392 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:18.767542 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":255623,"threads_started":1,"wal-append.queue_time_us":617689}
I20260709 13:12:18.769789 29463 leader_election.cc:290] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:18.774776 29517 log.cc:927] Time spent T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:12:18.776503 29515 log.cc:927] Time spent T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
I20260709 13:12:18.782196 25224 raft_consensus.cc:2393] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 10: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:18.712383 29460 raft_consensus.cc:515] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:18.785104 29460 leader_election.cc:290] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:18.682013 29350 consensus_queue.cc:237] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:18.786069 25229 raft_consensus.cc:2393] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 9: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
W20260709 13:12:18.789871 25271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:18.793601 25270 leader_election.cc:400] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085) with higher term. Message: Invalid argument: T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for earlier term 11. Current term is 12.
I20260709 13:12:18.794157 25229 raft_consensus.cc:1240] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 9. Current term is 11. Ops: []
I20260709 13:12:18.801986 25229 raft_consensus.cc:1240] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:12:18.815083 25229 raft_consensus.cc:1240] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:18.762943 29499 leader_election.cc:290] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:18.792428 29086 leader_election.cc:290] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:12:18.823340 29155 consensus_meta.cc:287] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.628s	user 0.012s	sys 0.000s
I20260709 13:12:18.826460 25300 raft_consensus.cc:2410] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:12:18.826875 29465 raft_consensus.cc:493] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:18.827351 29465 raft_consensus.cc:515] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:18.836664 29312 raft_consensus.cc:515] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:18.843767 29405 raft_consensus.cc:515] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:18.845086 25374 raft_consensus.cc:2368] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 14. Current term is 15.
I20260709 13:12:18.847193 29405 leader_election.cc:290] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:18.677868 29446 leader_election.cc:290] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:18.749290 25305 raft_consensus.cc:2468] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 12.
I20260709 13:12:18.794610 25270 leader_election.cc:403] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:12:18.816777 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:18.851245 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:18.734984 25874 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.010s	sys 0.011s
W20260709 13:12:18.877821 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 125292us
I20260709 13:12:18.878898 25270 leader_election.cc:304] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
W20260709 13:12:18.721840 25301 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.003s	sys 0.019s
W20260709 13:12:18.881042 25301 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.809s	user 0.003s	sys 0.019s
W20260709 13:12:18.877508 25874 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.809s	user 0.010s	sys 0.011s
W20260709 13:12:18.882308 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 813576us
I20260709 13:12:18.886624 25305 raft_consensus.cc:1275] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:12:18.887207 25305 pending_rounds.cc:85] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19: Aborting all ops after (but not including) 8
I20260709 13:12:18.887463 25305 pending_rounds.cc:107] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:12:18.887733 25305 raft_consensus.cc:2889] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:12:18.734601 25343 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.016s	sys 0.006s
W20260709 13:12:18.855852 29377 consensus_meta.cc:287] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 0.509s	user 0.010s	sys 0.000s
W20260709 13:12:18.845002 29451 consensus_meta.cc:287] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 0.526s	user 0.003s	sys 0.003s
I20260709 13:12:18.865450 25901 raft_consensus.cc:1240] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:18.873735 25902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50056 (request call id 758) took 1021 ms. Trace:
I20260709 13:12:18.890846 25902 rpcz_store.cc:276] 0709 13:12:17.852877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:17.853021 (+   144us) service_pool.cc:224] Handling call
0709 13:12:17.853314 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:17.911607 (+ 58293us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:17.911639 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:17.911679 (+    40us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:17.911709 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:18.873509 (+961800us) spinlock_profiling.cc:243] Waited 58.1 ms on lock 0x7b540066e4d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:18.873563 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:18.873681 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":133629824}
W20260709 13:12:18.871330 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 710795us
W20260709 13:12:18.889474 25343 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.816s	user 0.017s	sys 0.006s
W20260709 13:12:18.918574 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 845071us
I20260709 13:12:18.923550 25872 leader_election.cc:304] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:18.891950 29208 raft_consensus.cc:2749] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085) with higher term. Message: Invalid argument: T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for earlier term 11. Current term is 12.
I20260709 13:12:18.939682 25872 leader_election.cc:304] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:18.942250 25194 leader_election.cc:304] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
W20260709 13:12:18.941496 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:18.946973 25872 leader_election.cc:304] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:18.949112 25902 raft_consensus.cc:1240] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 LEADER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:12:18.939702 25874 leader_election.cc:304] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:18.951814 25194 leader_election.cc:304] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:18.915618 29527 raft_consensus.cc:493] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:18.958750 25194 leader_election.cc:304] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:18.939836 29444 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.008s	sys 0.013s
I20260709 13:12:18.963634 28717 raft_consensus.cc:2749] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:18.938416 29471 raft_consensus.cc:2749] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:18.913496 29451 raft_consensus.cc:515] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:12:18.910211 29377 raft_consensus.cc:515] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:18.951749 29450 raft_consensus.cc:2749] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:18.952900 29405 raft_consensus.cc:493] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
W20260709 13:12:18.972193 25270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:18.955153 29155 raft_consensus.cc:2804] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:18.954213 29460 raft_consensus.cc:2804] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:12:19.007759 25271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:19.008793 28717 raft_consensus.cc:493] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.009415 28717 raft_consensus.cc:515] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:18.965090 29463 raft_consensus.cc:2749] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:19.010910 25221 raft_consensus.cc:1240] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 10. Current term is 11. Ops: []
W20260709 13:12:18.966041 29444 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.008s	sys 0.014s
W20260709 13:12:19.018942 25270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:19.028410 28717 leader_election.cc:290] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:19.029165 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:18.975374 29454 raft_consensus.cc:493] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.002326 29474 raft_consensus.cc:2749] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:19.031348 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:12:19.034186 25195 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 1.662s (SENT) [suppressed 37 similar messages]
I20260709 13:12:19.034569 25229 raft_consensus.cc:1240] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:19.034794 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:19.006275 29499 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:18.976082 29371 raft_consensus.cc:3060] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:19.006521 29460 raft_consensus.cc:493] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:19.005215 29155 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:18.965862 29446 raft_consensus.cc:2804] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:18.971100 29527 raft_consensus.cc:515] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:18.977356 25230 raft_consensus.cc:1275] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:12:18.974259 29442 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:19.004029 29405 raft_consensus.cc:515] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:19.058365 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:19.059357 25229 raft_consensus.cc:2468] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 11.
I20260709 13:12:19.063723 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:19.064551 25304 raft_consensus.cc:2468] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 10.
I20260709 13:12:19.042495 29460 raft_consensus.cc:3060] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:19.046593 29391 raft_consensus.cc:493] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.070309 29391 raft_consensus.cc:515] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:19.046739 29312 leader_election.cc:290] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:19.047313 29155 raft_consensus.cc:3060] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:19.075208 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:19.045074 29499 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:19.076789 25222 raft_consensus.cc:2468] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 12.
I20260709 13:12:19.075644 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:19.063750 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:19.080323 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:19.054260 29446 raft_consensus.cc:697] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:19.081313 25222 raft_consensus.cc:2468] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 8.
I20260709 13:12:19.085588 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:19.087210 25230 raft_consensus.cc:2393] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 10: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:19.091418 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:19.092355 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:19.037992 29454 raft_consensus.cc:515] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:19.099233 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:19.100410 25222 raft_consensus.cc:2468] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 13.
I20260709 13:12:19.123014 29442 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:19.109490 29451 leader_election.cc:290] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:19.111332 29377 leader_election.cc:290] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:19.128279 25297 raft_consensus.cc:2468] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 7.
W20260709 13:12:19.129071 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 182159us
I20260709 13:12:19.130270 25872 leader_election.cc:304] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:12:19.134147 25872 leader_election.cc:304] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:12:19.139560 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 219194us
I20260709 13:12:19.132225 29313 raft_consensus.cc:2804] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:19.160835 25872 leader_election.cc:304] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:19.157123 29312 raft_consensus.cc:2804] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:19.172447 29312 raft_consensus.cc:697] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:19.173712 29312 consensus_queue.cc:237] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:19.157246 29313 raft_consensus.cc:493] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:19.175654 29313 raft_consensus.cc:3060] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:19.162974 29474 consensus_queue.cc:1048] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:12:19.166308 29286 consensus_meta.cc:287] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent flushing consensus metadata: real 0.586s	user 0.007s	sys 0.004s
I20260709 13:12:19.134112 29155 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:19.169806 29460 raft_consensus.cc:515] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:19.112991 29446 consensus_queue.cc:237] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:19.170266 29454 leader_election.cc:290] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:19.180143 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 145976us
I20260709 13:12:19.183068 25304 raft_consensus.cc:3060] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:19.183949 25905 raft_consensus.cc:1240] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 8. Current term is 9. Ops: []
W20260709 13:12:19.187207 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 247552us
I20260709 13:12:19.188863 25874 leader_election.cc:304] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:19.190728 29454 consensus_queue.cc:1059] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:19.191892 29454 raft_consensus.cc:3055] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:19.192322 29454 raft_consensus.cc:740] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:19.177774 29286 raft_consensus.cc:515] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:19.206437 25379 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36264 (request call id 1861) took 1814 ms (client timeout 1662 ms). Trace:
I20260709 13:12:19.198192 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:19.195705 25901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50056 (request call id 759) took 1342 ms. Trace:
I20260709 13:12:19.218165 25874 leader_election.cc:304] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:19.206003 25302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57272 (request call id 1936) took 1017 ms. Trace:
I20260709 13:12:19.180025 29405 leader_election.cc:290] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:19.218869 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 57731.6us
I20260709 13:12:19.205299 25907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50060 (request call id 714) took 1230 ms. Trace:
I20260709 13:12:19.218799 25302 rpcz_store.cc:276] 0709 13:12:18.188602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:18.569285 (+380683us) service_pool.cc:224] Handling call
0709 13:12:19.205819 (+636534us) spinlock_profiling.cc:243] Waited 89.2 ms on lock 0x7b540029b154. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:19.205939 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":205072768}
I20260709 13:12:19.229825 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:19.228734 25907 rpcz_store.cc:276] 0709 13:12:17.974511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:18.058444 (+ 83933us) service_pool.cc:224] Handling call
0709 13:12:19.205027 (+1146583us) spinlock_profiling.cc:243] Waited 849 ms on lock 0x7b54004d6554. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:19.205193 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1952723328}
W20260709 13:12:19.193576 29539 log.cc:927] Time spent T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:12:19.239025 25225 raft_consensus.cc:1275] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:12:19.239923 25194 leader_election.cc:304] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:12:19.189224 29544 raft_consensus.cc:2804] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:19.196942 29155 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:19.218518 25901 rpcz_store.cc:276] 0709 13:12:17.853172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:18.300072 (+446900us) service_pool.cc:224] Handling call
0709 13:12:18.319038 (+ 18966us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:18.890547 (+571509us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:19.195450 (+304903us) spinlock_profiling.cc:243] Waited 546 ms on lock 0x7b54004d58d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:19.195641 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1255985536}
I20260709 13:12:19.244266 25343 leader_election.cc:304] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:19.213102 29513 log.cc:927] Time spent T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.537s	user 0.001s	sys 0.000s
I20260709 13:12:19.244882 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:19.194679 29129 leader_election.cc:290] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:19.201463 29499 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:19.224884 25304 raft_consensus.cc:2468] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 14.
W20260709 13:12:19.217882 25379 rpcz_store.cc:269] 0709 13:12:17.392244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:17.410731 (+ 18487us) service_pool.cc:224] Handling call
0709 13:12:19.206231 (+1795500us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b5400129dd4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:19.206334 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":406326016}
I20260709 13:12:19.200307 29460 leader_election.cc:290] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:19.198796 29466 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:19.249157 29086 raft_consensus.cc:2749] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:19.251436 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:19.259085 25194 leader_election.cc:304] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:19.254323 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:19.254097 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:19.279805 25230 raft_consensus.cc:2393] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 13: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:19.244138 29531 raft_consensus.cc:2804] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:19.280377 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:19.254662 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:19.281605 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:19.280735 25195 leader_election.cc:304] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:12:19.282823 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:19.284996 25901 raft_consensus.cc:2368] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 14. Current term is 15.
I20260709 13:12:19.285907 25302 raft_consensus.cc:2468] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 9.
I20260709 13:12:19.241590 29545 raft_consensus.cc:2749] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:12:19.246688 29458 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.826s	user 0.006s	sys 0.020s
I20260709 13:12:19.287859 25194 leader_election.cc:304] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:19.288205 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:19.300952 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:19.288748 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:19.252157 29474 raft_consensus.cc:2749] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:19.293725 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:19.304188 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:19.295972 24113 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
W20260709 13:12:19.299005 25114 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 8d0f43a786a846b49924a589e4a36f2f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 79d99c0e498349bda74127365219e468 (127.23.140.67:34091) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 79d99c0e498349bda74127365219e468 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:12:19.300030 25271 leader_election.cc:304] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:19.246294 29544 raft_consensus.cc:493] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:19.300395 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 51616.6us
I20260709 13:12:19.302335 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:19.295076 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:19.283983 29377 raft_consensus.cc:2749] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:12:19.314556 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:19.288765 29531 raft_consensus.cc:493] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:19.309211 25271 leader_election.cc:304] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:19.327716 25227 raft_consensus.cc:2393] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 12: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:19.300472 29499 raft_consensus.cc:2804] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:19.328079 25226 raft_consensus.cc:3060] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:19.328630 25343 leader_election.cc:304] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:12:19.290596 29466 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:19.308005 29086 raft_consensus.cc:493] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:19.298676 29394 consensus_queue.cc:1059] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:12:19.247618 29454 consensus_queue.cc:260] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:19.248268 29405 consensus_queue.cc:1048] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:12:19.306881 25302 raft_consensus.cc:3060] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:19.300899 29458 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.888s	user 0.007s	sys 0.022s
I20260709 13:12:19.283396 29129 consensus_queue.cc:1048] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:12:19.335044 25271 leader_election.cc:304] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:19.304518 29439 raft_consensus.cc:493] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:19.338662 29466 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:19.329732 25230 raft_consensus.cc:1240] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:19.308789 29460 raft_consensus.cc:2804] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:19.330971 29531 raft_consensus.cc:3060] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:19.332186 29389 raft_consensus.cc:2749] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:19.341198 29086 raft_consensus.cc:515] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:19.368386 29439 raft_consensus.cc:515] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:19.384277 25374 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36264 (request call id 1867) took 1336 ms (client timeout 1515 ms). Trace:
W20260709 13:12:19.384852 25374 rpcz_store.cc:269] 0709 13:12:18.047577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:18.064779 (+ 17202us) service_pool.cc:224] Handling call
0709 13:12:19.384088 (+1319309us) spinlock_profiling.cc:243] Waited 779 ms on lock 0x7b540009c9d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:19.384220 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1792202112}
I20260709 13:12:19.386215 25300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57256 (request call id 2065) took 1357 ms. Trace:
I20260709 13:12:19.386606 25300 rpcz_store.cc:276] 0709 13:12:18.028819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:18.179225 (+150406us) service_pool.cc:224] Handling call
0709 13:12:19.385997 (+1206772us) spinlock_profiling.cc:243] Waited 504 ms on lock 0x7b54000f9454. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:19.386139 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1159344512}
I20260709 13:12:19.387629 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:19.388782 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:19.335440 29269 raft_consensus.cc:2804] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:19.298722 29451 consensus_queue.cc:1059] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:12:19.389729 29269 raft_consensus.cc:493] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:19.390079 29451 raft_consensus.cc:3055] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:19.390195 29269 raft_consensus.cc:3060] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:19.390537 29451 raft_consensus.cc:740] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:19.390761 29286 leader_election.cc:290] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 15 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:19.331185 29544 raft_consensus.cc:3060] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:19.393603 25298 raft_consensus.cc:1275] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:12:19.389297 25300 raft_consensus.cc:2468] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 11.
I20260709 13:12:19.395066 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:19.369000 29557 raft_consensus.cc:2804] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:19.374122 29454 raft_consensus.cc:3060] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:19.346987 29499 raft_consensus.cc:697] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 11 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:19.374667 29405 consensus_queue.cc:1059] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:19.376914 25303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46556 (request call id 573) took 1306 ms. Trace:
I20260709 13:12:19.377569 29378 raft_consensus.cc:3060] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:19.378302 29535 log.cc:927] Time spent T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.251s	user 0.001s	sys 0.000s
I20260709 13:12:19.378614 25227 pending_rounds.cc:85] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce: Aborting all ops after (but not including) 9
I20260709 13:12:19.402002 25227 pending_rounds.cc:107] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:12:19.402546 25227 raft_consensus.cc:2889] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:19.368223 29460 raft_consensus.cc:493] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:19.350798 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:19.363729 25302 raft_consensus.cc:2468] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 10.
I20260709 13:12:19.367192 25226 raft_consensus.cc:2468] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 14.
I20260709 13:12:19.395788 25300 raft_consensus.cc:2393] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 12: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:12:19.398244 25303 rpcz_store.cc:276] 0709 13:12:18.070055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:18.672249 (+602194us) service_pool.cc:224] Handling call
0709 13:12:18.707622 (+ 35373us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:18.708019 (+   397us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:18.708062 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:18.708746 (+   684us) log.cc:844] Serialized 52 byte log entry
0709 13:12:19.203138 (+494392us) spinlock_profiling.cc:243] Waited 2.01 ms on lock 0x7b18003b9740. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72cb64e07 00007fd7359bfab9 00007fd72cb8169b 00007fd72cb7f93f 00007fd72cb81c02 00007fd72f80920b 00007fd72f80ed23 00007fd72f80f0d1 00007fd72fc2aa0f
0709 13:12:19.282191 (+ 79053us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:19.282228 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:19.282293 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:19.376556 (+ 94263us) raft_consensus.cc:1685] finished
0709 13:12:19.376592 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:19.376851 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10642,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":4735,"spinlock_wait_cycles":4619136,"thread_start_us":78874,"threads_started":1,"wal-append.queue_time_us":608846}
I20260709 13:12:19.401949 25194 leader_election.cc:304] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:19.408188 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:19.384344 29086 leader_election.cc:290] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:19.391392 29451 consensus_queue.cc:260] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:19.408687 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:19.419026 25230 raft_consensus.cc:2393] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 9: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:19.415901 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:19.419591 25194 leader_election.cc:304] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:19.419981 25300 raft_consensus.cc:2393] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 9: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:19.420825 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:19.421386 25300 raft_consensus.cc:3060] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:19.416776 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:19.424696 25302 raft_consensus.cc:3060] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:19.426250 29562 raft_consensus.cc:493] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
W20260709 13:12:19.426741 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:19.427054 29562 raft_consensus.cc:515] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:19.432268 25222 raft_consensus.cc:1275] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:12:19.406678 29529 consensus_queue.cc:1048] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:12:19.434495 29562 leader_election.cc:290] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:19.397881 29557 raft_consensus.cc:493] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:19.435813 29557 raft_consensus.cc:3060] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:19.438120 25194 leader_election.cc:304] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:19.439193 25194 leader_election.cc:304] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:19.440140 29313 raft_consensus.cc:515] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:19.442020 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:19.442529 29313 leader_election.cc:290] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 9 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:19.436949 29442 raft_consensus.cc:2749] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:19.384861 29439 leader_election.cc:290] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:19.444517 29394 raft_consensus.cc:2749] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:19.401664 29013 consensus_queue.cc:1048] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:12:19.447403 25302 raft_consensus.cc:2468] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 9.
I20260709 13:12:19.450758 25194 leader_election.cc:304] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:19.413941 29460 raft_consensus.cc:3060] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:19.448819 29377 raft_consensus.cc:2804] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:19.458328 29377 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:19.458725 29377 raft_consensus.cc:3060] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:19.457917 29442 raft_consensus.cc:2804] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:19.460004 29269 raft_consensus.cc:515] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:19.460378 29442 raft_consensus.cc:697] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 10 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:19.461352 29286 raft_consensus.cc:493] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.461447 29442 consensus_queue.cc:237] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:19.400631 29155 consensus_queue.cc:1059] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:12:19.466501 29499 consensus_queue.cc:237] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:19.445411 29531 raft_consensus.cc:515] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:19.474962 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
W20260709 13:12:19.476975 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 112951us
I20260709 13:12:19.480054 25302 raft_consensus.cc:3060] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:19.478896 25194 leader_election.cc:304] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:19.482129 28717 raft_consensus.cc:2804] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:19.482117 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:19.482870 28717 raft_consensus.cc:697] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 9 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:19.483258 25902 raft_consensus.cc:2393] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 15: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:12:19.480581 25343 leader_election.cc:304] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:19.477007 25303 raft_consensus.cc:2468] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 11.
I20260709 13:12:19.484725 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:19.484874 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:19.482790 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:19.486896 25907 raft_consensus.cc:2393] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 13: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:12:19.489069 25902 raft_consensus.cc:1240] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:19.489395 25195 leader_election.cc:400] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 pre-election: Vote denied by peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085) with higher term. Message: Invalid argument: T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 14. Current term is 15.
I20260709 13:12:19.489693 25195 leader_election.cc:403] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:19.470434 29451 raft_consensus.cc:3060] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:19.520493 28717 consensus_queue.cc:237] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:19.524399 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:19.524746 25195 leader_election.cc:304] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:19.525452 25303 raft_consensus.cc:2468] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 11.
I20260709 13:12:19.535650 25300 raft_consensus.cc:2468] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 11.
I20260709 13:12:19.495303 29221 raft_consensus.cc:2749] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:12:19.539659 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 47618.1us
I20260709 13:12:19.487391 29439 raft_consensus.cc:2749] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:19.486534 29458 raft_consensus.cc:493] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:19.542176 29561 consensus_queue.cc:1048] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:12:19.538234 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:19.548134 25303 raft_consensus.cc:3060] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:19.539006 25874 leader_election.cc:304] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:12:19.551645 29405 consensus_queue.cc:1059] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:19.552763 29405 raft_consensus.cc:3055] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:19.553090 29405 raft_consensus.cc:740] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:19.520964 29444 raft_consensus.cc:3060] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:12:19.545820 25298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46556 (request call id 568) took 1477 ms. Trace:
I20260709 13:12:19.556700 25298 rpcz_store.cc:276] 0709 13:12:18.068649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:18.638182 (+569533us) service_pool.cc:224] Handling call
0709 13:12:19.392140 (+753958us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:19.394031 (+  1891us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:19.545592 (+151561us) spinlock_profiling.cc:243] Waited 754 ms on lock 0x7b54000f9450. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6e8ad 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:19.545722 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1733059328}
I20260709 13:12:19.540624 29530 consensus_queue.cc:1059] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:12:19.479703 29286 raft_consensus.cc:515] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:19.540843 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 54648.5us
W20260709 13:12:19.564064 29525 log.cc:927] Time spent T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.542s	user 0.000s	sys 0.001s
I20260709 13:12:19.564302 29286 leader_election.cc:290] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:19.564931 29286 raft_consensus.cc:3055] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:19.566331 29391 leader_election.cc:290] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:19.578474 29446 consensus_queue.cc:1048] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:19.567529 29557 raft_consensus.cc:515] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:19.528373 29536 raft_consensus.cc:2749] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:19.561887 29465 leader_election.cc:290] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:19.582670 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:19.559140 29269 leader_election.cc:290] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:19.586097 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:19.595611 25224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58422 (request call id 2151) took 1246 ms. Trace:
I20260709 13:12:19.584262 29563 raft_consensus.cc:2804] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:19.596843 29563 raft_consensus.cc:697] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:19.545775 29458 raft_consensus.cc:515] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:19.598558 29544 raft_consensus.cc:515] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:19.599705 29458 leader_election.cc:290] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:19.604456 29460 raft_consensus.cc:515] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:19.605332 25900 raft_consensus.cc:1240] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:12:19.544412 29147 leader_election.cc:290] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:19.606385 29563 consensus_queue.cc:237] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:19.612931 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:19.637889 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 62899us
I20260709 13:12:19.590842 29405 consensus_queue.cc:260] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:19.582705 29557 leader_election.cc:290] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:12:19.618568 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:19.619903 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:19.643368 25227 raft_consensus.cc:3060] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:19.642238 29208 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:19.645272 29208 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:19.647357 29208 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:19.647534 25221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54000 (request call id 692) took 1662 ms. Trace:
I20260709 13:12:19.647919 25221 rpcz_store.cc:276] 0709 13:12:17.984946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:17.985108 (+   162us) service_pool.cc:224] Handling call
0709 13:12:18.003418 (+ 18310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:19.011297 (+1007879us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:19.647331 (+636034us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b5400421654. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:19.647482 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2316542208}
I20260709 13:12:19.648574 25302 raft_consensus.cc:2468] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 9.
I20260709 13:12:19.649426 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:19.625826 25303 raft_consensus.cc:2468] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 10.
I20260709 13:12:19.626542 25194 leader_election.cc:304] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:19.655783 25302 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 9.
I20260709 13:12:19.627605 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:19.628108 29375 raft_consensus.cc:3055] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:19.664005 25303 raft_consensus.cc:1275] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:12:19.629518 29520 log.cc:927] Time spent T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.713s	user 0.000s	sys 0.002s
I20260709 13:12:19.596019 25224 rpcz_store.cc:276] 0709 13:12:18.348958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:18.560018 (+211060us) service_pool.cc:224] Handling call
0709 13:12:19.593665 (+1033647us) spinlock_profiling.cc:243] Waited 221 ms on lock 0x7b5400421154. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:19.595551 (+  1886us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":507884288}
I20260709 13:12:19.586524 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:19.605674 25222 raft_consensus.cc:1240] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:19.574913 29377 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:19.565478 25343 leader_election.cc:304] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:19.641556 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:12:19.620745 25271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:19.650255 25373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56308 (request call id 674) took 2628 ms. Trace:
I20260709 13:12:19.650545 25227 raft_consensus.cc:2468] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 13.
I20260709 13:12:19.681391 25872 leader_election.cc:304] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:19.629926 29444 raft_consensus.cc:2749] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085) with higher term. Message: Invalid argument: T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 14. Current term is 15.
I20260709 13:12:19.654536 29405 raft_consensus.cc:3060] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:19.676048 25303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57272 (request call id 1931) took 1477 ms. Trace:
I20260709 13:12:19.639762 29286 raft_consensus.cc:740] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:19.681967 25373 rpcz_store.cc:276] 0709 13:12:17.022297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:17.699955 (+677658us) service_pool.cc:224] Handling call
0709 13:12:19.206353 (+1506398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:19.206558 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:19.206604 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:19.206644 (+    40us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:19.206674 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:19.206724 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:19.650107 (+443383us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b5400129dd0. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6e8ad 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:19.650203 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3463687040}
I20260709 13:12:19.683673 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:19.683077 25345 leader_election.cc:304] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:19.682677 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:19.686638 25303 rpcz_store.cc:276] 0709 13:12:18.187006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:19.661230 (+1474224us) service_pool.cc:224] Handling call
0709 13:12:19.661614 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:19.664417 (+  2803us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:19.664588 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:19.674347 29536 raft_consensus.cc:2804] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:19.699344 29562 raft_consensus.cc:2804] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:19.699592 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:12:19.692977 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 127564us
I20260709 13:12:19.700507 25343 leader_election.cc:304] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:19.700737 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:19.701599 25343 leader_election.cc:304] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:19.694416 29208 consensus_queue.cc:1048] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:19.695946 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:19.697577 29129 raft_consensus.cc:2749] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:19.690243 29086 consensus_queue.cc:1059] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:12:19.698814 25345 leader_election.cc:304] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:19.686887 29147 raft_consensus.cc:493] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.699780 29562 raft_consensus.cc:493] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:19.693223 29286 consensus_queue.cc:260] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:19.702180 25225 raft_consensus.cc:2468] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 15.
I20260709 13:12:19.662856 29375 raft_consensus.cc:740] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:19.703974 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:19.688474 29561 consensus_queue.cc:1059] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:12:19.690462 29446 raft_consensus.cc:2804] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:19.715126 25305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46556 (request call id 575) took 1644 ms. Trace:
I20260709 13:12:19.722705 25301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57256 (request call id 2044) took 1776 ms. Trace:
I20260709 13:12:19.723145 25907 raft_consensus.cc:1240] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 12. Current term is 13. Ops: []
W20260709 13:12:19.726142 29537 log.cc:927] Time spent T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.600s	user 0.002s	sys 0.000s
W20260709 13:12:19.732661 25297 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57256 (request call id 2054) took 1782 ms (client timeout 2061 ms). Trace:
I20260709 13:12:19.742033 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:19.732962 25299 raft_consensus.cc:1275] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:12:19.733379 25271 leader_election.cc:304] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:19.734586 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:19.699359 29536 raft_consensus.cc:493] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:19.708180 29439 raft_consensus.cc:2749] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:12:19.768035 25297 rpcz_store.cc:269] 0709 13:12:17.950508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:17.980149 (+ 29641us) service_pool.cc:224] Handling call
0709 13:12:19.732485 (+1752336us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54000a5854. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:19.732606 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2556582656}
I20260709 13:12:19.709436 29378 consensus_queue.cc:1048] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 13:12:19.778220 25296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57256 (request call id 2046) took 1831 ms. Trace:
I20260709 13:12:19.778728 29543 raft_consensus.cc:3055] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:19.809876 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:19.809978 29543 raft_consensus.cc:740] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:19.811256 29543 consensus_queue.cc:260] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:19.813719 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:19.814534 25223 raft_consensus.cc:2393] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 10: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:19.774947 25305 rpcz_store.cc:276] 0709 13:12:18.070703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:18.910053 (+839350us) service_pool.cc:224] Handling call
0709 13:12:18.910478 (+   425us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:18.918250 (+  7772us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:18.918278 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:18.938932 (+ 20654us) log.cc:844] Serialized 52 byte log entry
0709 13:12:19.190264 (+251332us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:19.239320 (+ 49056us) log.cc:844] Serialized 14 byte log entry
0709 13:12:19.714336 (+475016us) spinlock_profiling.cc:243] Waited 3.04 ms on lock 0x7b180045ec20. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72cafcc0a 00007fd73623c219 00007fd72cb84a40 00007fd72cb7f4e4 00007fd72cb7f455 00007fd7336673c7 00007fd72fc799a7 00007fd72fc890bf 00007fd72fc89038
0709 13:12:19.714525 (+   189us) log.cc:844] Serialized 14 byte log entry
0709 13:12:19.714724 (+   199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:19.714811 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:19.714926 (+   115us) raft_consensus.cc:1685] finished
0709 13:12:19.714942 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:19.715069 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":445456,"prepare.queue_time_us":533558,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":71,"raft.queue_time_us":17588,"raft.run_cpu_time_us":267,"raft.run_wall_time_us":21843,"spinlock_wait_cycles":16896000,"thread_start_us":221015,"threads_started":1,"wal-append.queue_time_us":237973}
I20260709 13:12:19.773371 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:19.816398 25226 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 9.
I20260709 13:12:19.816576 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:19.817867 25226 raft_consensus.cc:1240] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:19.795336 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:19.785161 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:19.738672 29562 raft_consensus.cc:3060] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:19.817838 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:19.820577 25221 raft_consensus.cc:1240] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:19.821060 25305 raft_consensus.cc:3060] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:19.736304 29554 raft_consensus.cc:2749] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:19.789976 29350 raft_consensus.cc:3060] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:19.792696 29086 raft_consensus.cc:2749] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:19.823827 25298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46556 (request call id 576) took 1752 ms. Trace:
I20260709 13:12:19.837792 25298 rpcz_store.cc:276] 0709 13:12:18.070935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:19.587042 (+1516107us) service_pool.cc:224] Handling call
0709 13:12:19.587403 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:19.587653 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:12:19.717717 (+130064us) log.cc:844] Serialized 14 byte log entry
0709 13:12:19.823283 (+105566us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:19.823350 (+    67us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:19.823419 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:19.823498 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:19.823723 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":129758,"prepare.queue_time_us":130305,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":96,"thread_start_us":105173,"threads_started":1}
I20260709 13:12:19.839586 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:19.840094 25298 raft_consensus.cc:3060] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:19.829559 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 92139.4us
W20260709 13:12:19.830518 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 128979us
I20260709 13:12:19.843912 25343 leader_election.cc:304] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:19.791339 29170 raft_consensus.cc:2804] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:19.776361 25301 rpcz_store.cc:276] 0709 13:12:17.946247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:17.946465 (+   218us) service_pool.cc:224] Handling call
0709 13:12:17.966513 (+ 20048us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:18.071300 (+104787us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:18.071331 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:18.071861 (+   530us) log.cc:844] Serialized 52 byte log entry
0709 13:12:18.881537 (+809676us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:18.915507 (+ 33970us) log.cc:844] Serialized 14 byte log entry
0709 13:12:18.948120 (+ 32613us) log.cc:844] Serialized 14 byte log entry
0709 13:12:18.965420 (+ 17300us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:19.563814 (+598394us) spinlock_profiling.cc:243] Waited 4.11 ms on lock 0x7b2400430958. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72ca089c4 00007fd72ca06acb 00007fd72cbc1dc9 00007fd72cbc1a55 00007fd72cbc109d 00007fd72f7f310e 00007fd72f80a88c 00007fd72f809bb6 00007fd72f8097d8 00007fd72f813221
0709 13:12:19.722367 (+158553us) spinlock_profiling.cc:243] Waited 32.1 ms on lock 0x7b5400168fd4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:19.722419 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:19.722461 (+    42us) raft_consensus.cc:1685] finished
0709 13:12:19.722473 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:19.722650 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26070,"prepare.queue_time_us":33151,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":70,"raft.queue_time_us":45046,"raft.run_cpu_time_us":332,"raft.run_wall_time_us":9634,"spinlock_wait_cycles":83267200,"thread_start_us":809262,"threads_started":1,"wal-append.queue_time_us":746651}
I20260709 13:12:19.845803 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:19.848037 25301 raft_consensus.cc:2468] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 9.
I20260709 13:12:19.849182 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:19.850610 25298 raft_consensus.cc:2468] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 11.
I20260709 13:12:19.847177 25343 leader_election.cc:304] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:19.834386 25305 raft_consensus.cc:2468] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 12.
I20260709 13:12:19.853404 25343 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:19.798391 29536 raft_consensus.cc:3060] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:19.813560 29561 raft_consensus.cc:3055] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:19.858961 25298 raft_consensus.cc:1275] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:12:19.853593 25305 raft_consensus.cc:1240] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:19.797631 29446 raft_consensus.cc:697] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:19.865816 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:19.866569 25304 raft_consensus.cc:2468] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 12.
I20260709 13:12:19.868074 29460 leader_election.cc:290] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:19.862195 29375 consensus_queue.cc:260] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:19.869266 29375 raft_consensus.cc:3060] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:19.873448 29129 raft_consensus.cc:3060] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:19.885784 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:19.863447 25305 raft_consensus.cc:1275] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:12:19.766083 29147 raft_consensus.cc:515] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:19.858304 29439 raft_consensus.cc:2804] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:19.863205 29561 raft_consensus.cc:740] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:19.864969 29170 raft_consensus.cc:697] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 13 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:19.904201 29086 raft_consensus.cc:2749] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:19.904263 29439 raft_consensus.cc:493] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:19.937089 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 238343us
I20260709 13:12:19.941283 25194 leader_election.cc:304] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:19.922549 29544 leader_election.cc:290] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:19.930138 29439 raft_consensus.cc:3060] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:19.956691 29140 raft_consensus.cc:3055] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:19.954905 29561 consensus_queue.cc:260] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:19.808835 25296 rpcz_store.cc:276] 0709 13:12:17.947025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:17.947129 (+   104us) service_pool.cc:224] Handling call
0709 13:12:17.966111 (+ 18982us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:17.984123 (+ 18012us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:12:18.009895 (+ 25772us) log.cc:844] Serialized 14 byte log entry
0709 13:12:18.479966 (+470071us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:18.480016 (+    50us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:18.480066 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:19.777983 (+1297917us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b54000a6254. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:19.778027 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:19.778161 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":32007,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":48780,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":22318,"spinlock_wait_cycles":40876800,"thread_start_us":469734,"threads_started":1,"wal-append.queue_time_us":710543,"wal-append.run_cpu_time_us":1291,"wal-append.run_wall_time_us":1072794}
I20260709 13:12:19.959676 29465 consensus_queue.cc:1059] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:19.959653 29562 raft_consensus.cc:515] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:19.960690 25271 leader_election.cc:304] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
W20260709 13:12:19.961170 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 117429us
W20260709 13:12:19.961550 25872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:19.963295 25194 leader_election.cc:304] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:12:19.963996 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 109038us
W20260709 13:12:19.954192 29572 log.cc:927] Time spent T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:12:19.964586 25345 leader_election.cc:304] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:19.970600 25194 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:19.970624 25343 leader_election.cc:400] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Vote denied by peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127) with higher term. Message: Invalid argument: T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 8. Current term is 9.
I20260709 13:12:19.973577 25874 leader_election.cc:304] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:19.973942 25343 leader_election.cc:403] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:12:19.982633 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:19.965385 29378 raft_consensus.cc:2749] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:19.945998 29575 consensus_queue.cc:1048] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:12:19.949468 29446 consensus_queue.cc:237] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:20.018818 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 54452.4us
I20260709 13:12:19.980027 25194 leader_election.cc:304] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
W20260709 13:12:20.022743 29576 log.cc:927] Time spent T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:12:19.978021 29544 consensus_queue.cc:1059] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:12:20.025979 29544 consensus_queue.cc:1243] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer 1f539ba21487460085b837e7529a78ce log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:12:19.963210 29170 consensus_queue.cc:237] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:19.975867 25343 leader_election.cc:304] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:20.005767 29561 raft_consensus.cc:3060] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:20.028957 29405 raft_consensus.cc:2749] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:19.967207 29140 raft_consensus.cc:740] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
W20260709 13:12:20.030907 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 57391.2us
W20260709 13:12:20.031629 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 55846.7us
I20260709 13:12:20.028405 25345 leader_election.cc:304] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:19.998804 29460 raft_consensus.cc:2749] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:12:20.030418 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 50514.4us
I20260709 13:12:19.997223 29580 raft_consensus.cc:2749] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127) with higher term. Message: Invalid argument: T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 8. Current term is 9.
I20260709 13:12:20.004863 29583 raft_consensus.cc:2804] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:20.026508 29471 raft_consensus.cc:3055] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:12:20.036158 29538 log.cc:927] Time spent T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.914s	user 0.004s	sys 0.000s
I20260709 13:12:19.976423 29545 consensus_queue.cc:1059] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:12:20.037508 25194 leader_election.cc:304] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:20.030087 28717 raft_consensus.cc:2804] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:20.041337 25221 raft_consensus.cc:1240] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:20.053735 28717 raft_consensus.cc:697] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 11 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:20.053839 25194 leader_election.cc:304] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:19.967422 29369 raft_consensus.cc:2749] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:20.023675 29086 raft_consensus.cc:2749] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:19.975168 29527 leader_election.cc:290] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:20.096875 29506 raft_consensus.cc:3060] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:19.975986 29444 raft_consensus.cc:2804] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:20.097954 29444 raft_consensus.cc:493] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:20.098436 29444 raft_consensus.cc:3060] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:20.102854 29458 raft_consensus.cc:493] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.103375 29458 raft_consensus.cc:515] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:20.103926 29531 leader_election.cc:290] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:20.105417 29458 leader_election.cc:290] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:20.106648 29286 raft_consensus.cc:3060] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:20.109512 29530 raft_consensus.cc:493] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:20.110096 29530 raft_consensus.cc:515] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:20.114094 29562 leader_election.cc:290] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:20.116550 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:20.117576 25223 raft_consensus.cc:1240] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:20.123080 29450 consensus_queue.cc:1059] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:20.123550 29546 consensus_queue.cc:1048] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:20.124043 29543 raft_consensus.cc:3060] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:20.123972 29450 consensus_queue.cc:1048] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:12:20.128552 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:20.129341 25227 raft_consensus.cc:2368] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 9. Current term is 10.
I20260709 13:12:20.132884 25223 raft_consensus.cc:1275] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:12:20.029784 29147 leader_election.cc:290] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:20.054937 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:12:20.139365 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 111245us
I20260709 13:12:20.054641 28717 consensus_queue.cc:237] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:20.045936 29583 raft_consensus.cc:493] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:20.057137 29545 raft_consensus.cc:3055] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:20.060422 29221 raft_consensus.cc:2804] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:12:20.065248 25194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:20.162592 29221 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:20.068307 29580 raft_consensus.cc:2804] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:20.163539 29580 raft_consensus.cc:493] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:20.163973 29580 raft_consensus.cc:3060] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:20.164927 29350 raft_consensus.cc:2749] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:20.167093 29439 raft_consensus.cc:515] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:20.070479 25226 raft_consensus.cc:1275] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:12:20.084722 29587 consensus_queue.cc:1059] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:20.170132 29587 raft_consensus.cc:3055] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:20.170460 29587 raft_consensus.cc:740] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:20.171144 29129 raft_consensus.cc:2749] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:20.171252 29587 consensus_queue.cc:260] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:20.172580 29587 raft_consensus.cc:3060] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:20.091387 25302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46556 (request call id 577) took 2020 ms. Trace:
I20260709 13:12:20.057615 25299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57256 (request call id 2060) took 2082 ms. Trace:
I20260709 13:12:20.173667 25299 rpcz_store.cc:276] 0709 13:12:17.975192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:18.601102 (+625910us) service_pool.cc:224] Handling call
0709 13:12:19.732612 (+1131510us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:19.768710 (+ 36098us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:20.057442 (+288732us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54000a5850. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6e8ad 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:20.057564 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2601421184}
I20260709 13:12:20.173611 25302 rpcz_store.cc:276] 0709 13:12:18.071184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:19.674945 (+1603761us) service_pool.cc:224] Handling call
0709 13:12:19.689306 (+ 14361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:19.704083 (+ 14777us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:19.704113 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:19.767846 (+ 63733us) log.cc:844] Serialized 26 byte log entry
0709 13:12:19.928224 (+160378us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:20.062516 (+134292us) log.cc:844] Serialized 14 byte log entry
0709 13:12:20.091048 (+ 28532us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:20.091145 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:20.091200 (+    55us) raft_consensus.cc:1685] finished
0709 13:12:20.091212 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:20.091333 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":176472,"prepare.queue_time_us":134944,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":48127,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":29941,"thread_start_us":104313,"threads_started":1,"wal-append.queue_time_us":150870}
I20260709 13:12:20.046140 29471 raft_consensus.cc:740] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
W20260709 13:12:20.092792 29581 log.cc:927] Time spent T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:12:20.135739 25270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:20.180668 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:20.181284 25298 raft_consensus.cc:3060] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:20.181450 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:20.182013 25300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57272 (request call id 1949) took 1198 ms. Trace:
I20260709 13:12:20.182164 29458 raft_consensus.cc:493] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.033128 25343 leader_election.cc:304] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:20.137832 25874 leader_election.cc:304] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:12:20.140098 25345 leader_election.cc:304] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:20.046438 29405 consensus_queue.cc:1059] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.099s
I20260709 13:12:20.134405 29530 leader_election.cc:290] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:20.148250 29583 raft_consensus.cc:3060] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:20.182816 29458 raft_consensus.cc:515] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:20.177063 29471 consensus_queue.cc:260] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:20.182029 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:20.182044 25296 raft_consensus.cc:3060] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:20.190672 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:20.224449 25305 raft_consensus.cc:2368] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 9. Current term is 10.
I20260709 13:12:20.187312 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
W20260709 13:12:20.206840 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 174109us
I20260709 13:12:20.226882 25298 raft_consensus.cc:2468] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 10.
I20260709 13:12:20.227983 25343 leader_election.cc:304] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:12:20.194334 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:12:20.207333 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 67322us
I20260709 13:12:20.233331 25345 leader_election.cc:304] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
W20260709 13:12:20.207795 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 70099.1us
I20260709 13:12:20.236389 25874 leader_election.cc:400] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361) with higher term. Message: Invalid argument: T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 9. Current term is 10.
I20260709 13:12:20.236783 25874 leader_election.cc:403] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:20.184866 25301 raft_consensus.cc:1275] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:12:20.184072 25297 raft_consensus.cc:1275] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:12:20.091548 29460 raft_consensus.cc:2804] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:20.182420 25300 rpcz_store.cc:276] 0709 13:12:18.983426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:19.675666 (+692240us) service_pool.cc:224] Handling call
0709 13:12:19.691904 (+ 16238us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:19.703250 (+ 11346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:19.703290 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:19.703812 (+   522us) log.cc:844] Serialized 26 byte log entry
0709 13:12:19.924023 (+220211us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:19.924972 (+   949us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:19.926163 (+  1191us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:20.181808 (+255645us) raft_consensus.cc:1685] finished
0709 13:12:20.181827 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:20.181956 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10902,"raft.queue_time_us":11802,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":2977,"thread_start_us":130641,"threads_started":1,"wal-append.queue_time_us":236791}
I20260709 13:12:20.217387 29546 raft_consensus.cc:2804] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:20.217818 29147 raft_consensus.cc:2804] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:20.163070 29221 raft_consensus.cc:3060] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:20.245138 29546 raft_consensus.cc:697] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:20.245256 29313 raft_consensus.cc:3060] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:12:20.240516 25872 leader_election.cc:400] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 9 pre-election: Vote denied by peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127) with higher term. Message: Invalid argument: T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 9. Current term is 10.
I20260709 13:12:20.245464 29578 consensus_queue.cc:1048] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:20.246219 29546 consensus_queue.cc:237] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:20.246978 29578 consensus_queue.cc:1048] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:20.243242 29147 raft_consensus.cc:493] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:20.247409 29530 consensus_queue.cc:1048] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:12:20.247776 29147 raft_consensus.cc:3060] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:20.251165 29580 raft_consensus.cc:515] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:20.252887 25297 raft_consensus.cc:1275] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:12:20.254371 29460 raft_consensus.cc:697] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 12 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:20.255344 29460 consensus_queue.cc:237] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:12:20.184190 29140 consensus_queue.cc:260] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:20.183987 29536 raft_consensus.cc:515] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:20.259796 29377 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:20.260001 29147 raft_consensus.cc:515] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:20.260608 29536 leader_election.cc:290] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:20.187525 29499 raft_consensus.cc:493] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.261490 29499 raft_consensus.cc:515] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:20.263091 25228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 2155) took 1911 ms. Trace:
I20260709 13:12:20.214479 29439 leader_election.cc:290] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:20.263428 25228 rpcz_store.cc:276] 0709 13:12:18.351634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:18.756267 (+404633us) service_pool.cc:224] Handling call
0709 13:12:18.756639 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:18.756865 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:18.756893 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:18.757330 (+   437us) log.cc:844] Serialized 26 byte log entry
0709 13:12:18.972625 (+215295us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:19.042672 (+ 70047us) log.cc:844] Serialized 14 byte log entry
0709 13:12:19.042891 (+   219us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:19.042966 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:19.125729 (+ 82763us) spinlock_profiling.cc:243] Waited 2.91 ms on lock 0x7b180031bdc0. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72cb823f3 00007fd72cb847c1 00007fd72cb84779 00007fd72cb84709 00007fd72cb846d1 00007fd72cb839cd 000000000038f354 000000000038f199 00007fd72cb6583a
0709 13:12:20.026879 (+901150us) spinlock_profiling.cc:243] Waited 8.69 ms on lock 0x7b4400022b4c. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72caa8c85 00007fd72caa96a2 00007fd72f81b1db 00007fd72f816aaf 00007fd72f80a86e 00007fd72f809bb6 00007fd72f8097d8 00007fd72f813221 00007fd72f8131d9 00007fd72f813169
0709 13:12:20.262872 (+235993us) raft_consensus.cc:1685] finished
0709 13:12:20.262893 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:20.263036 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":71076,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":1219,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":85,"spinlock_wait_cycles":26675328,"thread_start_us":214934,"threads_started":1,"wal-append.queue_time_us":350397}
I20260709 13:12:20.265168 29458 leader_election.cc:290] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:20.263440 29471 raft_consensus.cc:3060] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:20.148130 29545 raft_consensus.cc:740] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:20.267675 29545 consensus_queue.cc:260] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:20.222023 29350 raft_consensus.cc:3060] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:20.216037 29444 raft_consensus.cc:515] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:20.271899 29147 leader_election.cc:290] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:20.273619 29444 leader_election.cc:290] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:20.290738 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:20.292090 25301 raft_consensus.cc:1275] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:12:20.290784 25296 raft_consensus.cc:2468] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 11.
I20260709 13:12:20.291870 25230 raft_consensus.cc:1275] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:12:20.295728 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:20.294123 25194 leader_election.cc:304] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:20.296175 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:20.253492 29580 leader_election.cc:290] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:20.296842 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:20.303071 25301 raft_consensus.cc:3060] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:20.298143 25271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:20.298688 29442 consensus_queue.cc:1048] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:12:20.301146 29378 consensus_queue.cc:1048] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:20.302906 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:20.302340 25227 raft_consensus.cc:1240] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:20.296985 25297 raft_consensus.cc:3060] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:12:20.322527 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 94615.6us
I20260709 13:12:20.323385 25343 leader_election.cc:304] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:20.262449 29221 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:20.291983 29499 leader_election.cc:290] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:20.301688 29527 raft_consensus.cc:2804] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:20.331337 29350 raft_consensus.cc:2749] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:20.291797 29405 raft_consensus.cc:2749] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:20.322755 29451 consensus_queue.cc:1048] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:12:20.302547 29086 raft_consensus.cc:2764] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:12:20.302397 29561 raft_consensus.cc:493] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.332990 29583 raft_consensus.cc:515] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:20.337965 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:20.350952 29439 raft_consensus.cc:2749] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:20.355983 25229 raft_consensus.cc:1240] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 11 LEADER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:12:20.355532 25302 raft_consensus.cc:2468] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 12.
I20260709 13:12:20.333695 25301 raft_consensus.cc:2468] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 10.
W20260709 13:12:20.349728 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 46903.4us
I20260709 13:12:20.348290 25297 raft_consensus.cc:2468] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 12.
I20260709 13:12:20.354825 25343 leader_election.cc:304] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:20.363481 25345 leader_election.cc:304] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:20.371861 25270 leader_election.cc:304] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:20.372632 25907 raft_consensus.cc:1275] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:12:20.354537 29527 raft_consensus.cc:697] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 10 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:20.355582 29561 raft_consensus.cc:515] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:12:20.380203 29527 consensus_queue.cc:237] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:20.381137 29561 leader_election.cc:290] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:20.385221 25902 raft_consensus.cc:2468] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 12.
I20260709 13:12:20.349207 29286 consensus_queue.cc:1059] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:12:20.362711 29387 raft_consensus.cc:493] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.395638 25343 leader_election.cc:304] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:12:20.343354 29585 consensus_queue.cc:1048] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.052s
W20260709 13:12:20.422000 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 58604.1us
I20260709 13:12:20.407819 29086 raft_consensus.cc:2749] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:12:20.425384 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:20.427101 29584 log.cc:927] Time spent T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.395s	user 0.004s	sys 0.000s
W20260709 13:12:20.427834 25114 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 8d0f43a786a846b49924a589e4a36f2f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 79d99c0e498349bda74127365219e468 (127.23.140.67:34091) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 79d99c0e498349bda74127365219e468 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:12:20.428236 25303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57272 (request call id 1950) took 1444 ms. Trace:
I20260709 13:12:20.428591 25303 rpcz_store.cc:276] 0709 13:12:18.983699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:19.690614 (+706915us) service_pool.cc:224] Handling call
0709 13:12:19.735369 (+ 44755us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:19.735679 (+   310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:19.735708 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:19.736113 (+   405us) log.cc:844] Serialized 26 byte log entry
0709 13:12:19.919265 (+183152us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:19.919303 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:19.919367 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:20.343970 (+424603us) spinlock_profiling.cc:243] Waited 2.07 ms on lock 0x7b4400022b4c. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72caa8c85 00007fd72caa96a2 00007fd72f81b1db 00007fd72f816aaf 00007fd72f80a86e 00007fd72f809bb6 00007fd72f8097d8 00007fd72f813221 00007fd72f8131d9 00007fd72f813169
0709 13:12:20.427997 (+ 84027us) raft_consensus.cc:1685] finished
0709 13:12:20.428018 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:20.428184 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4477,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":22303,"spinlock_wait_cycles":4771584,"thread_start_us":99693,"threads_started":1,"wal-append.queue_time_us":208521}
I20260709 13:12:20.430444 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:20.431041 25228 raft_consensus.cc:2468] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 12.
I20260709 13:12:20.431339 29221 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:20.397570 29170 raft_consensus.cc:2749] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:12:20.441632 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:20.442464 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 46918.6us
I20260709 13:12:20.408078 29313 raft_consensus.cc:2749] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361) with higher term. Message: Invalid argument: T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 9. Current term is 10.
I20260709 13:12:20.449360 25345 leader_election.cc:304] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:20.384738 29531 consensus_queue.cc:1048] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:12:20.451520 25343 leader_election.cc:304] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:20.460193 25302 raft_consensus.cc:1275] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:12:20.467571 29451 raft_consensus.cc:493] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.468116 29451 raft_consensus.cc:515] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:20.453576 29086 raft_consensus.cc:2804] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:20.470278 29451 leader_election.cc:290] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:20.470539 29086 raft_consensus.cc:493] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:20.471021 29086 raft_consensus.cc:3060] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:20.472851 29439 raft_consensus.cc:2749] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:20.440881 29561 raft_consensus.cc:3060] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:20.418330 29387 raft_consensus.cc:515] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:20.479663 29387 leader_election.cc:290] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:20.480474 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:20.484182 29405 consensus_queue.cc:1059] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:12:20.485157 29405 raft_consensus.cc:3055] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:20.485545 29405 raft_consensus.cc:740] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:20.502951 25343 leader_election.cc:304] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:20.459995 29129 raft_consensus.cc:493] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.460206 29575 raft_consensus.cc:2749] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:12:20.514019 25302 raft_consensus.cc:1275] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:12:20.507763 25343 leader_election.cc:304] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:20.510859 29543 raft_consensus.cc:2749] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:20.507576 29350 consensus_queue.cc:1048] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:12:20.540122 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:20.541589 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:20.542341 25376 raft_consensus.cc:2468] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 9.
I20260709 13:12:20.544248 25377 raft_consensus.cc:2410] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:12:20.544170 25379 raft_consensus.cc:1240] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:20.546073 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:20.547039 25379 raft_consensus.cc:2393] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 12: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:20.528570 29575 raft_consensus.cc:2749] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:20.512218 29129 raft_consensus.cc:515] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:20.572263 25872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:20.602465 25194 leader_election.cc:304] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:20.603442 25194 leader_election.cc:304] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:20.604305 25194 leader_election.cc:304] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:20.577291 29611 consensus_queue.cc:1048] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:12:20.605253 28717 raft_consensus.cc:2804] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:12:20.582015 29600 log.cc:927] Time spent T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
W20260709 13:12:20.586320 29606 log.cc:927] Time spent T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:12:20.602725 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:20.610741 28717 raft_consensus.cc:697] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 10 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:20.588881 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:20.620623 25379 raft_consensus.cc:2393] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 13: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:20.591257 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:20.592043 25370 raft_consensus.cc:1275] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:12:20.596724 25372 raft_consensus.cc:1240] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:20.595746 25375 raft_consensus.cc:1275] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:12:20.590294 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:20.597683 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:20.625324 25371 raft_consensus.cc:2468] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 12.
I20260709 13:12:20.625334 25271 leader_election.cc:304] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:20.629985 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:20.630859 25224 raft_consensus.cc:2410] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:12:20.632263 25378 raft_consensus.cc:1240] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 7 LEADER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:20.621703 29221 raft_consensus.cc:2804] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:20.633215 29221 raft_consensus.cc:697] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 12 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:20.634100 29221 consensus_queue.cc:237] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:20.639032 29086 raft_consensus.cc:515] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:20.641203 29086 leader_election.cc:290] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:20.641916 29170 raft_consensus.cc:2804] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:20.643337 29170 raft_consensus.cc:493] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:20.643690 29170 raft_consensus.cc:3060] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:20.646638 25872 leader_election.cc:304] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:20.648164 29583 leader_election.cc:290] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:20.648989 29587 consensus_queue.cc:1048] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:20.649236 29303 consensus_queue.cc:1048] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:20.654736 29589 raft_consensus.cc:3055] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:20.655205 29589 raft_consensus.cc:740] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:20.656021 29589 consensus_queue.cc:260] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:20.657189 29589 raft_consensus.cc:3060] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:20.610441 29499 raft_consensus.cc:493] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:20.632304 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:20.658905 25303 raft_consensus.cc:3060] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:20.621871 28717 consensus_queue.cc:237] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:20.663470 25874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:20.659741 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:20.665269 25230 raft_consensus.cc:3060] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:20.665877 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:20.669905 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:20.670533 25304 raft_consensus.cc:3060] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:20.666486 25299 raft_consensus.cc:2468] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 11.
I20260709 13:12:20.674965 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:20.675765 25902 raft_consensus.cc:2468] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 9.
I20260709 13:12:20.604317 29394 raft_consensus.cc:2804] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:20.588145 29129 leader_election.cc:290] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:20.579157 29561 raft_consensus.cc:2749] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:12:20.678098 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 228816us
I20260709 13:12:20.627327 29377 raft_consensus.cc:493] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:20.700352 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:20.711834 25371 raft_consensus.cc:2468] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 11.
I20260709 13:12:20.704160 25377 raft_consensus.cc:1275] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:12:20.648211 29446 raft_consensus.cc:2804] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:20.715458 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:20.716543 25372 raft_consensus.cc:2393] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 12: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:20.731750 25303 raft_consensus.cc:2468] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 13.
I20260709 13:12:20.733932 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:20.734206 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:20.734772 25377 raft_consensus.cc:3060] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:20.735206 25370 raft_consensus.cc:2393] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 9: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
W20260709 13:12:20.735781 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:20.737411 25371 raft_consensus.cc:1240] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:20.696657 29394 raft_consensus.cc:493] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:20.658164 29499 raft_consensus.cc:515] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:20.753813 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:20.755332 25371 raft_consensus.cc:1240] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:20.745469 25304 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 10.
I20260709 13:12:20.770268 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:20.786558 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:20.787091 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:20.787367 25371 raft_consensus.cc:2393] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 9: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:20.791244 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:20.792855 25371 raft_consensus.cc:2468] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 9.
I20260709 13:12:20.797494 25375 raft_consensus.cc:2468] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 10.
I20260709 13:12:20.751842 29394 raft_consensus.cc:3060] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:20.726267 29377 raft_consensus.cc:515] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:20.812019 25377 raft_consensus.cc:2468] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 13.
W20260709 13:12:20.801479 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 106429us
I20260709 13:12:20.810595 25373 raft_consensus.cc:1240] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:20.813886 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:20.810889 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:20.814633 25372 raft_consensus.cc:3060] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:20.814951 25371 raft_consensus.cc:2468] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 9.
I20260709 13:12:20.817557 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:20.752652 29446 raft_consensus.cc:697] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:20.819864 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:12:20.820607 25871 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:20.826021 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:20.826256 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:20.826790 25373 raft_consensus.cc:2393] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 13: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
W20260709 13:12:20.826306 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 125829us
I20260709 13:12:20.829164 25344 leader_election.cc:304] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:20.829861 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:20.830853 25373 raft_consensus.cc:2468] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 9.
I20260709 13:12:20.832391 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:20.833202 25373 raft_consensus.cc:2468] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 12.
I20260709 13:12:20.844544 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:20.853456 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
W20260709 13:12:20.854987 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 159340us
I20260709 13:12:20.860237 25372 raft_consensus.cc:2468] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 10.
I20260709 13:12:20.865427 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:20.865782 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:20.868269 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:12:20.869881 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:20.869376 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:20.870528 25372 raft_consensus.cc:2468] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 7.
I20260709 13:12:20.869344 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:20.872040 25377 raft_consensus.cc:2410] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:12:20.866443 25373 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 7.
I20260709 13:12:20.874754 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:20.877693 25373 raft_consensus.cc:2393] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 12: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:20.878233 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:20.879033 25377 raft_consensus.cc:2410] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:12:20.835213 29617 raft_consensus.cc:2804] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:12:20.868543 29621 log.cc:927] Time spent T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.065s	user 0.000s	sys 0.003s
I20260709 13:12:20.885910 25371 raft_consensus.cc:1240] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:20.897542 25375 raft_consensus.cc:2468] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 10.
I20260709 13:12:20.902516 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:20.903381 25372 raft_consensus.cc:2368] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 14. Current term is 15.
I20260709 13:12:20.904534 25373 raft_consensus.cc:1275] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:12:20.910915 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:20.912552 25373 raft_consensus.cc:3060] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:20.884966 29617 raft_consensus.cc:493] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:20.916909 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:20.925098 25371 raft_consensus.cc:1275] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:12:20.927899 25271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:20.929036 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:20.929250 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:20.930064 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:20.930274 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:20.930752 25296 raft_consensus.cc:2368] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 9. Current term is 10.
I20260709 13:12:20.931231 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:20.931715 25296 raft_consensus.cc:1240] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 9. Current term is 10. Ops: [9.4-9.4]
I20260709 13:12:20.932189 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:20.932597 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:20.934183 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:20.935343 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:20.936120 25296 raft_consensus.cc:2410] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:12:20.936828 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:20.939448 25304 raft_consensus.cc:1217] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Deduplicated request from leader. Original: 7.5->[9.6-9.6]   Dedup: 9.6->[]
W20260709 13:12:20.939728 29622 log.cc:927] Time spent T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:12:20.939972 25304 raft_consensus.cc:1240] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:12:20.940904 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:20.941233 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:12:20.941637 29632 log.cc:927] Time spent T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:12:20.941951 25300 raft_consensus.cc:2393] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 10: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:20.943003 25300 raft_consensus.cc:1240] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 10. Current term is 11. Ops: [8.8-10.9]
I20260709 13:12:20.944010 25300 raft_consensus.cc:1240] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 9. Current term is 10. Ops: []
W20260709 13:12:20.944756 25194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:20.941957 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:20.947590 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:20.948264 25371 raft_consensus.cc:2393] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 9: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
W20260709 13:12:20.949803 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:20.953213 25296 raft_consensus.cc:1240] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 8. Current term is 10. Ops: [8.6-8.6]
I20260709 13:12:20.953687 25373 raft_consensus.cc:2468] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 10.
I20260709 13:12:20.955701 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:20.920358 29617 raft_consensus.cc:3060] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:20.941093 29615 log.cc:927] Time spent T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:12:20.951937 25194 leader_election.cc:304] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:12:20.958140 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:20.962638 25194 leader_election.cc:304] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:20.958564 25304 raft_consensus.cc:2393] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 8: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:20.959214 25296 raft_consensus.cc:1275] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:12:20.960098 25299 raft_consensus.cc:1240] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 11. Current term is 12. Ops: [11.5-11.5]
W20260709 13:12:20.951282 29614 log.cc:927] Time spent T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
W20260709 13:12:20.961097 29618 log.cc:927] Time spent T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:12:20.976652 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:20.905886 29446 consensus_queue.cc:237] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:20.983233 25373 raft_consensus.cc:2368] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 12. Current term is 13.
I20260709 13:12:20.996222 25230 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 10.
I20260709 13:12:20.963516 29624 raft_consensus.cc:493] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:20.998605 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 296544us
I20260709 13:12:20.962759 29444 raft_consensus.cc:2804] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:21.077711 24113 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:12:21.079757 25270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:21.085651 25902 raft_consensus.cc:1275] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:12:21.016908 29616 log.cc:927] Time spent T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
W20260709 13:12:21.100381 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 117323us
I20260709 13:12:20.981123 29499 leader_election.cc:290] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:20.998358 29221 raft_consensus.cc:2804] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:21.011453 29377 leader_election.cc:290] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:21.087935 29608 log.cc:927] Time spent T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.071s	user 0.003s	sys 0.000s
W20260709 13:12:21.126036 25271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:21.122754 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
W20260709 13:12:21.097927 29635 log.cc:927] Time spent T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.180s	user 0.001s	sys 0.002s
I20260709 13:12:21.111161 25343 leader_election.cc:304] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:21.133368 25343 leader_election.cc:304] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:21.134891 25343 leader_election.cc:400] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Vote denied by peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127) with higher term. Message: Invalid argument: T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 9. Current term is 10.
I20260709 13:12:21.135877 25343 leader_election.cc:304] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:21.064287 29444 raft_consensus.cc:493] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:21.097668 29630 log.cc:927] Time spent T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.160s	user 0.003s	sys 0.000s
I20260709 13:12:21.111161 25872 leader_election.cc:304] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:21.114195 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:21.114396 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:21.115782 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:21.138969 29444 raft_consensus.cc:3060] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:21.147711 25224 raft_consensus.cc:1275] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:12:21.119634 29499 raft_consensus.cc:493] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:21.129724 29633 log.cc:927] Time spent T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
W20260709 13:12:21.160207 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 49138.3us
I20260709 13:12:21.141115 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:21.164871 25371 raft_consensus.cc:2468] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 11.
I20260709 13:12:21.165722 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:21.143218 25375 raft_consensus.cc:2468] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 12.
I20260709 13:12:21.167667 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:21.141036 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:21.119895 25373 raft_consensus.cc:1275] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:12:21.088686 29619 log.cc:927] Time spent T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.302s	user 0.003s	sys 0.000s
W20260709 13:12:21.103605 29598 log.cc:927] Time spent T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.641s	user 0.000s	sys 0.004s
W20260709 13:12:21.103816 29636 log.cc:927] Time spent T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.105s	user 0.000s	sys 0.003s
I20260709 13:12:21.104503 29545 raft_consensus.cc:3060] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:21.127650 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:21.128720 29536 consensus_queue.cc:1048] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:21.125248 29340 raft_consensus.cc:493] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:21.138672 25195 leader_election.cc:304] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:21.177570 25302 raft_consensus.cc:1275] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:12:21.178526 25373 raft_consensus.cc:1275] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:12:21.137904 29221 raft_consensus.cc:697] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 13 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:21.180830 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:12:21.181946 25872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:21.104353 29624 raft_consensus.cc:515] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:21.143461 29350 raft_consensus.cc:2749] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:21.208113 25371 raft_consensus.cc:1240] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:21.177150 29594 raft_consensus.cc:2749] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:21.180590 29586 raft_consensus.cc:2804] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:21.218621 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:21.132400 29405 consensus_queue.cc:260] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
W20260709 13:12:21.220865 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 82293.1us
I20260709 13:12:21.202514 29451 raft_consensus.cc:493] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.223984 25375 raft_consensus.cc:1240] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:12:21.226192 25372 raft_consensus.cc:1240] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:21.209180 29506 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:21.177266 29499 raft_consensus.cc:515] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:21.254333 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 118558us
I20260709 13:12:21.255813 25343 leader_election.cc:304] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:21.223560 29442 raft_consensus.cc:2804] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:21.270635 25375 raft_consensus.cc:1275] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:12:21.266826 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:21.272403 25343 leader_election.cc:304] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:21.273001 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 175931us
W20260709 13:12:21.272621 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 46526us
W20260709 13:12:21.277365 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 196677us
I20260709 13:12:21.251361 29631 raft_consensus.cc:493] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:21.251596 29586 raft_consensus.cc:697] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:21.219143 29340 raft_consensus.cc:515] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:21.279089 25195 leader_election.cc:336] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 1.662s (SENT)
I20260709 13:12:21.289714 25195 leader_election.cc:304] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:21.251403 29312 raft_consensus.cc:493] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:21.298013 29629 log.cc:927] Time spent T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
I20260709 13:12:21.298278 25299 raft_consensus.cc:1275] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:12:21.251047 29638 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.284147 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:21.301524 25375 raft_consensus.cc:2393] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 15: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:21.243399 29451 raft_consensus.cc:515] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:21.295946 29499 leader_election.cc:290] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:21.296720 29625 log.cc:927] Time spent T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 13:12:21.297250 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:21.274504 29442 raft_consensus.cc:697] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 12 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:21.298038 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:21.251343 29506 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:21.280288 29589 consensus_meta.cc:287] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.623s	user 0.017s	sys 0.000s
I20260709 13:12:21.305585 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:21.298348 29312 raft_consensus.cc:515] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:21.283674 29377 raft_consensus.cc:493] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.309679 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:21.270987 29405 raft_consensus.cc:3060] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:21.310832 25195 leader_election.cc:304] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:21.261314 29531 consensus_queue.cc:1048] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:12:21.260691 29594 consensus_queue.cc:1059] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 8.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:12:21.279829 29561 raft_consensus.cc:2749] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:21.317175 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:21.308115 25370 raft_consensus.cc:1275] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:12:21.278489 25343 leader_election.cc:304] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:21.323277 25373 raft_consensus.cc:2410] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 13:12:21.316015 29170 consensus_meta.cc:287] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.672s	user 0.012s	sys 0.000s
W20260709 13:12:21.341826 25345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:21.344825 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:21.342046 25195 leader_election.cc:304] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:21.346084 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:21.347146 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:21.347748 25375 raft_consensus.cc:2376] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 10. Re-sending same reply.
I20260709 13:12:21.350236 29554 consensus_queue.cc:1048] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:21.356802 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:21.307164 29645 raft_consensus.cc:2749] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:21.299860 29631 raft_consensus.cc:515] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:21.306965 29638 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:21.332511 29377 raft_consensus.cc:515] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:21.312672 29221 consensus_queue.cc:237] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:21.355016 29170 raft_consensus.cc:515] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:21.499435 25271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:21.516165 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 237740us
W20260709 13:12:21.496025 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 151781us
W20260709 13:12:21.474786 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:21.366461 29561 raft_consensus.cc:2749] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:12:21.515480 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 192617us
W20260709 13:12:21.452353 25345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:21.537081 25372 raft_consensus.cc:2468] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 9.
W20260709 13:12:21.415495 29620 log.cc:927] Time spent T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.628s	user 0.002s	sys 0.000s
I20260709 13:12:21.483569 29658 raft_consensus.cc:2749] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:21.534173 25343 leader_election.cc:304] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:21.412309 25378 raft_consensus.cc:1240] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:21.378697 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:21.549687 25375 raft_consensus.cc:2468] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 8.
W20260709 13:12:21.465056 29609 log.cc:927] Time spent T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:12:21.379711 29375 raft_consensus.cc:2749] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:21.549531 25195 leader_election.cc:304] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
W20260709 13:12:21.546443 25873 leader_election.cc:336] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 1.705s (SENT)
W20260709 13:12:21.410177 29642 log.cc:927] Time spent T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 13:12:21.561937 25343 leader_election.cc:304] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:21.406262 29654 raft_consensus.cc:2749] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:21.561833 25873 leader_election.cc:304] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:21.565307 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 242414us
I20260709 13:12:21.567418 25343 leader_election.cc:304] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:21.571532 25195 leader_election.cc:400] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 pre-election: Vote denied by peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091) with higher term. Message: Invalid argument: T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 14. Current term is 15.
I20260709 13:12:21.571650 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:21.409096 29624 leader_election.cc:290] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:21.573239 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:21.426232 29460 raft_consensus.cc:493] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:21.542603 29312 leader_election.cc:290] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:21.575162 25372 raft_consensus.cc:2468] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 13.
I20260709 13:12:21.416023 29583 consensus_queue.cc:1048] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.143s
I20260709 13:12:21.575943 25195 leader_election.cc:304] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:21.426661 29442 consensus_queue.cc:237] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:21.584234 25372 raft_consensus.cc:1275] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:12:21.571255 25270 leader_election.cc:304] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:12:21.391535 29444 raft_consensus.cc:515] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:21.484469 29269 consensus_queue.cc:1048] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.093s
I20260709 13:12:21.565627 29086 raft_consensus.cc:2749] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:21.569793 29140 raft_consensus.cc:3060] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:21.587539 25195 leader_election.cc:400] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 election: Vote denied by peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091) with higher term. Message: Invalid argument: T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 12. Current term is 13.
I20260709 13:12:21.596845 25195 leader_election.cc:403] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:12:21.588876 25372 raft_consensus.cc:3055] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:21.578896 29653 raft_consensus.cc:2804] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:21.597432 25372 raft_consensus.cc:740] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:21.593588 25296 raft_consensus.cc:1240] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:12:21.572244 29587 raft_consensus.cc:493] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.595017 25302 raft_consensus.cc:1240] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:21.574386 29627 raft_consensus.cc:2749] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:21.574187 29644 raft_consensus.cc:2749] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:21.569499 29658 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:21.607281 29658 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:21.598277 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 316153us
I20260709 13:12:21.586814 29661 consensus_queue.cc:1048] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:12:21.584098 29460 raft_consensus.cc:515] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:21.614253 29444 leader_election.cc:290] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:21.586239 29375 consensus_queue.cc:1048] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:12:21.616284 29460 leader_election.cc:290] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:21.590210 29659 raft_consensus.cc:2749] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:21.628170 29666 consensus_queue.cc:1059] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:12:21.628804 29658 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:21.581132 29340 leader_election.cc:290] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:21.621126 25195 leader_election.cc:304] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:21.623476 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:21.634456 25370 raft_consensus.cc:2368] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 9. Current term is 10.
W20260709 13:12:21.591429 29617 consensus_meta.cc:287] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.620s	user 0.009s	sys 0.001s
W20260709 13:12:21.596979 29649 log.cc:927] Time spent T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
I20260709 13:12:21.569700 29129 consensus_queue.cc:1059] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:12:21.643951 25195 leader_election.cc:304] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:21.635826 29446 consensus_queue.cc:1048] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:21.636371 29377 leader_election.cc:290] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:21.637208 29627 raft_consensus.cc:3055] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:21.636590 29667 consensus_queue.cc:1059] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:12:21.590201 29654 raft_consensus.cc:2749] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:21.581657 29531 consensus_queue.cc:1059] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:12:21.655622 29652 consensus_queue.cc:1048] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
W20260709 13:12:21.684046 29394 consensus_meta.cc:287] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 0.862s	user 0.007s	sys 0.004s
I20260709 13:12:21.654451 29627 raft_consensus.cc:740] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:21.630373 29499 raft_consensus.cc:2749] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091) with higher term. Message: Invalid argument: T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 12. Current term is 13.
I20260709 13:12:21.656991 29444 raft_consensus.cc:2749] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:12:21.656471 29668 log.cc:927] Time spent T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:12:21.638581 29530 consensus_queue.cc:1048] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:12:21.644286 29617 raft_consensus.cc:515] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:21.690568 29617 leader_election.cc:290] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:21.685668 29627 consensus_queue.cc:260] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:21.692518 29627 raft_consensus.cc:3060] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:21.692358 25372 consensus_queue.cc:260] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:21.693337 25372 raft_consensus.cc:3060] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:12:21.694371 25114 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 8d0f43a786a846b49924a589e4a36f2f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 79d99c0e498349bda74127365219e468 (127.23.140.67:34091) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 79d99c0e498349bda74127365219e468 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:12:21.695511 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:21.696223 25900 raft_consensus.cc:3060] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:21.696961 25371 raft_consensus.cc:2368] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 9. Current term is 10.
I20260709 13:12:21.595425 29451 leader_election.cc:290] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:21.642289 29653 raft_consensus.cc:697] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 10 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:21.567739 29655 consensus_queue.cc:1059] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.052s
W20260709 13:12:21.644414 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 73239.1us
I20260709 13:12:21.597218 29506 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:21.705622 25270 leader_election.cc:304] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:21.406874 29586 consensus_queue.cc:237] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:21.645395 29661 raft_consensus.cc:2804] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:21.640156 29658 raft_consensus.cc:493] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.655486 29664 raft_consensus.cc:2749] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:21.643667 25873 leader_election.cc:304] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
W20260709 13:12:21.717885 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 74291us
I20260709 13:12:21.633127 29583 consensus_queue.cc:1059] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:12:21.722281 29583 raft_consensus.cc:3055] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:21.722638 29583 raft_consensus.cc:740] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:21.723400 29583 consensus_queue.cc:260] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:21.724745 29583 raft_consensus.cc:3060] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:21.725374 25374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36254 (request call id 2213) took 1193 ms. Trace:
I20260709 13:12:21.726193 29653 consensus_queue.cc:237] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:21.704283 29350 raft_consensus.cc:2749] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:21.711894 25270 leader_election.cc:304] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:21.684510 29394 raft_consensus.cc:515] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:21.631594 29587 raft_consensus.cc:515] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:21.718617 25873 leader_election.cc:304] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:21.720434 29655 raft_consensus.cc:3055] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:21.743893 25873 leader_election.cc:400] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091) with higher term. Message: Invalid argument: T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 9. Current term is 10.
I20260709 13:12:21.745698 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:21.712415 29454 consensus_queue.cc:1048] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
W20260709 13:12:21.661175 29634 log.cc:927] Time spent T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.578s	user 0.001s	sys 0.000s
I20260709 13:12:21.730716 25374 rpcz_store.cc:276] 0709 13:12:20.531686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:20.531794 (+   108us) service_pool.cc:224] Handling call
0709 13:12:20.532038 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:20.537139 (+  5101us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:12:20.566302 (+ 29163us) log.cc:844] Serialized 14 byte log entry
0709 13:12:20.842715 (+276413us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:20.842792 (+    77us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:20.842855 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:21.723681 (+880826us) spinlock_profiling.cc:243] Waited 5.84 ms on lock 0x7b18000fa6c0. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72cb502a6 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419
0709 13:12:21.725158 (+  1477us) spinlock_profiling.cc:243] Waited 4.9 ms on lock 0x7b54000b9854. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:21.725203 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:21.725321 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6383,"prepare.queue_time_us":28437,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":1369,"raft.queue_time_us":117,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":14504,"spinlock_wait_cycles":24704640,"thread_start_us":275880,"threads_started":1,"wal-append.queue_time_us":334268}
I20260709 13:12:21.734272 25270 leader_election.cc:304] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:12:21.756233 25270 leader_election.cc:304] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:21.738737 29589 raft_consensus.cc:3055] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:21.758111 29589 raft_consensus.cc:740] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:21.712808 29506 raft_consensus.cc:3060] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:21.739048 29554 raft_consensus.cc:2749] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:21.746944 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:21.747660 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:21.767791 25370 raft_consensus.cc:2376] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 9. Re-sending same reply.
I20260709 13:12:21.756122 29530 consensus_queue.cc:1048] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:21.747129 29655 raft_consensus.cc:740] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:21.771611 25375 raft_consensus.cc:2393] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 15: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:21.765023 25372 raft_consensus.cc:1275] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:12:21.761813 25270 leader_election.cc:304] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:21.774979 25270 leader_election.cc:304] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:21.752894 25900 raft_consensus.cc:2468] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 10.
I20260709 13:12:21.715822 29661 raft_consensus.cc:493] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:21.730996 29474 raft_consensus.cc:2749] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:21.742660 29208 raft_consensus.cc:493] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.779181 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:21.781841 25222 raft_consensus.cc:1240] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 12 LEADER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:21.779754 25270 leader_election.cc:304] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:21.779883 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:21.783185 25270 leader_election.cc:304] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:21.783538 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:21.792281 25221 raft_consensus.cc:1240] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:21.786688 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
W20260709 13:12:21.786620 25872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:21.730165 29658 raft_consensus.cc:515] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:21.754807 29563 raft_consensus.cc:2804] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:21.770104 29140 raft_consensus.cc:2804] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:21.794929 25270 leader_election.cc:304] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:21.794678 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:21.801005 25375 raft_consensus.cc:2468] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 10.
W20260709 13:12:21.796945 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 155265us
I20260709 13:12:21.798000 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:12:21.798506 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:21.803628 25379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36264 (request call id 1873) took 1040 ms. Trace:
I20260709 13:12:21.780725 29661 raft_consensus.cc:3060] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:21.770771 29660 raft_consensus.cc:2804] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:21.780611 29623 raft_consensus.cc:2749] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:21.802289 25873 leader_election.cc:304] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:21.804140 25379 rpcz_store.cc:276] 0709 13:12:20.763734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:20.763938 (+   204us) service_pool.cc:224] Handling call
0709 13:12:20.767763 (+  3825us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:20.768186 (+   423us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:20.768223 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:20.768747 (+   524us) log.cc:844] Serialized 26 byte log entry
0709 13:12:20.903428 (+134681us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:20.903470 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:20.903535 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:21.660445 (+756910us) spinlock_profiling.cc:243] Waited 3.92 ms on lock 0x7b4400022b4c. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72caa8c85 00007fd72caa96a2 00007fd72f81b1db 00007fd72f816aaf 00007fd72f80a86e 00007fd72f809bb6 00007fd72f8097d8 00007fd72f813221 00007fd72f8131d9 00007fd72f813169
0709 13:12:21.798739 (+138294us) raft_consensus.cc:1685] finished
0709 13:12:21.798762 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:21.803546 (+  4784us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1038,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":16203,"spinlock_wait_cycles":9025920,"thread_start_us":134279,"threads_started":1,"wal-append.queue_time_us":200281}
I20260709 13:12:21.786870 29624 raft_consensus.cc:2749] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:21.806320 25195 leader_election.cc:304] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:21.811429 25270 leader_election.cc:304] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:21.817729 25345 leader_election.cc:304] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:21.817687 25221 raft_consensus.cc:1240] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 13 LEADER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:21.821346 25345 leader_election.cc:304] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:21.798106 29527 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.303s	user 0.005s	sys 0.018s
I20260709 13:12:21.822849 29474 raft_consensus.cc:2804] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:21.823266 29474 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:21.823446 25224 raft_consensus.cc:1240] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 10 LEADER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:21.823616 29474 raft_consensus.cc:3060] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:21.810014 29660 raft_consensus.cc:493] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:21.824429 29660 raft_consensus.cc:3060] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:21.824759 29562 raft_consensus.cc:2749] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:21.825670 29200 raft_consensus.cc:3055] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:21.826077 29200 raft_consensus.cc:740] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:21.826833 29200 consensus_queue.cc:260] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:21.827733 29659 raft_consensus.cc:3055] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:21.828011 29200 raft_consensus.cc:3060] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:21.828140 29659 raft_consensus.cc:740] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:21.833248 29170 leader_election.cc:290] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:21.794703 29208 raft_consensus.cc:515] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:21.834524 29369 raft_consensus.cc:493] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.803958 29140 raft_consensus.cc:493] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:21.835018 29670 raft_consensus.cc:3060] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:21.835376 29140 raft_consensus.cc:3060] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:21.838339 29665 raft_consensus.cc:2749] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:21.831634 29474 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:21.800721 29563 raft_consensus.cc:493] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:21.842533 29563 raft_consensus.cc:3060] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:21.842700 29474 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:21.829046 29659 consensus_queue.cc:260] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:21.844156 29659 raft_consensus.cc:3060] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:21.759060 29589 consensus_queue.cc:260] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:21.845686 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:21.796178 29638 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:21.822171 29527 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.332s	user 0.005s	sys 0.018s
I20260709 13:12:21.835060 29369 raft_consensus.cc:515] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:21.854694 29617 raft_consensus.cc:2749] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:21.855422 29269 raft_consensus.cc:493] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.855484 29631 leader_election.cc:290] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:21.877265 29660 raft_consensus.cc:515] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:21.879432 29660 leader_election.cc:290] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:21.870929 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 51325.3us
I20260709 13:12:21.855979 29623 raft_consensus.cc:2749] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:21.858853 29460 raft_consensus.cc:3055] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:21.894608 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:12:21.864639 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 53311.7us
I20260709 13:12:21.895319 25900 raft_consensus.cc:2468] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 13.
I20260709 13:12:21.895566 25270 leader_election.cc:304] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:21.867038 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:21.900199 25301 raft_consensus.cc:2468] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 8.
W20260709 13:12:21.849766 29669 log.cc:927] Time spent T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 13:12:21.861027 29378 raft_consensus.cc:493] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.910614 29378 raft_consensus.cc:515] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:21.912609 29378 leader_election.cc:290] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:21.870757 29405 consensus_meta.cc:287] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.538s	user 0.010s	sys 0.001s
I20260709 13:12:21.885162 25228 raft_consensus.cc:2468] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 8.
I20260709 13:12:21.889822 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:21.890937 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:21.863740 25345 leader_election.cc:304] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
W20260709 13:12:21.915155 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 51535.2us
W20260709 13:12:21.916100 25345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:21.917008 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:21.918342 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:21.918932 25379 raft_consensus.cc:2376] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 10. Re-sending same reply.
I20260709 13:12:21.920125 25303 raft_consensus.cc:1275] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 8 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:12:21.876142 29269 raft_consensus.cc:515] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:12:21.923626 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:21.906517 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:21.901523 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:21.909386 25270 leader_election.cc:304] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:21.925211 25301 raft_consensus.cc:2468] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 12.
I20260709 13:12:21.837630 29658 leader_election.cc:290] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:21.871282 29589 raft_consensus.cc:3060] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:21.930426 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:21.936506 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:21.940254 25226 raft_consensus.cc:2393] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 13: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:21.927582 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:21.942451 25299 raft_consensus.cc:3060] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:21.860775 29562 consensus_queue.cc:1059] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:12:21.953644 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:21.905824 29460 raft_consensus.cc:740] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:21.959576 25344 leader_election.cc:304] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:21.982754 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:21.990041 25373 raft_consensus.cc:3060] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:21.996567 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:21.997421 25906 raft_consensus.cc:2393] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 12: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:21.941684 29170 raft_consensus.cc:2749] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:21.906185 29531 consensus_queue.cc:1048] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:12:22.004155 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:22.036075 29536 raft_consensus.cc:493] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:21.846517 29655 consensus_queue.cc:260] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:21.970997 29544 raft_consensus.cc:493] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:21.966756 25300 raft_consensus.cc:1275] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 10 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:12:21.979915 29617 consensus_queue.cc:1059] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:12:22.070042 25345 leader_election.cc:304] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:22.030192 29625 log.cc:927] Time spent T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:12:22.030349 29221 raft_consensus.cc:493] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:22.031107 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:22.007848 29645 raft_consensus.cc:2804] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:22.032043 25195 leader_election.cc:304] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
W20260709 13:12:22.083209 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 51257us
I20260709 13:12:22.050496 29536 raft_consensus.cc:515] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:21.947458 29623 consensus_queue.cc:1048] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.103s
I20260709 13:12:22.036885 29561 raft_consensus.cc:493] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:21.928597 29442 raft_consensus.cc:2804] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:21.971673 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:22.098361 25900 raft_consensus.cc:2393] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 10: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:22.076068 29624 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:22.071172 25299 raft_consensus.cc:2468] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 12.
I20260709 13:12:22.062211 29405 raft_consensus.cc:493] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:22.102535 25194 leader_election.cc:304] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:22.017141 29587 leader_election.cc:290] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:22.016396 29394 leader_election.cc:290] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:21.958603 29631 consensus_queue.cc:1048] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.090s
I20260709 13:12:22.042023 29658 raft_consensus.cc:493] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:22.084461 25195 leader_election.cc:304] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:12:22.087178 29527 raft_consensus.cc:2804] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:22.114346 28717 raft_consensus.cc:2804] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:22.118474 28717 raft_consensus.cc:493] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:22.118779 28717 raft_consensus.cc:3060] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:22.111199 25194 leader_election.cc:304] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:22.089879 29617 consensus_queue.cc:1243] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer 1f539ba21487460085b837e7529a78ce log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:12:22.089432 29644 raft_consensus.cc:2804] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:22.114279 25195 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:22.127556 25195 leader_election.cc:304] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:22.107791 29628 raft_consensus.cc:3060] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:22.107735 29405 raft_consensus.cc:515] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:22.116669 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:22.129724 25376 raft_consensus.cc:3060] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:22.077059 29544 raft_consensus.cc:515] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:22.089097 29170 raft_consensus.cc:493] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:22.135566 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:22.143637 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:22.088943 29451 consensus_queue.cc:1048] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:12:22.157842 29394 raft_consensus.cc:2749] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:22.157972 29451 consensus_queue.cc:1243] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer 6c4b021f3f9e41adb75e870a08ad88b6 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:12:22.117664 29675 consensus_queue.cc:1048] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:12:22.077819 29460 consensus_queue.cc:260] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:22.123211 29652 raft_consensus.cc:2804] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:22.161677 29652 raft_consensus.cc:493] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:22.162073 29652 raft_consensus.cc:3060] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:22.164667 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:22.096807 29561 raft_consensus.cc:515] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:22.086699 29221 raft_consensus.cc:515] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:22.153929 29170 raft_consensus.cc:515] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:22.131616 29545 consensus_meta.cc:287] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent flushing consensus metadata: real 0.921s	user 0.008s	sys 0.004s
I20260709 13:12:22.164575 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:22.180517 25372 raft_consensus.cc:2376] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 13. Re-sending same reply.
I20260709 13:12:22.165351 25297 raft_consensus.cc:3060] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:22.181452 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:22.181838 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:22.181995 25372 raft_consensus.cc:3060] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:22.144276 25222 raft_consensus.cc:2468] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 13.
I20260709 13:12:22.182426 25299 raft_consensus.cc:2468] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 9.
I20260709 13:12:22.147274 29536 leader_election.cc:290] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:22.129223 29531 raft_consensus.cc:2804] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:22.169337 25376 raft_consensus.cc:2468] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 11.
I20260709 13:12:22.171072 28717 raft_consensus.cc:515] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:22.130431 29527 raft_consensus.cc:697] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 10 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:22.183331 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:22.184954 29662 raft_consensus.cc:2749] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:12:22.185458 29602 log.cc:927] Time spent T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.945s	user 0.002s	sys 0.003s
W20260709 13:12:22.185798 29676 log.cc:927] Time spent T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.155s	user 0.002s	sys 0.000s
I20260709 13:12:22.186647 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:22.189368 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:22.112200 29624 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:22.206533 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:22.207510 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:22.208019 25376 raft_consensus.cc:2468] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 13.
I20260709 13:12:22.208729 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:22.177547 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:22.201156 28717 leader_election.cc:290] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:22.202646 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:22.193683 25373 raft_consensus.cc:2468] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 13.
I20260709 13:12:22.165851 29644 raft_consensus.cc:697] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 8 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:22.210282 25299 raft_consensus.cc:2393] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 13: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:22.124188 29658 raft_consensus.cc:515] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:22.217957 25372 raft_consensus.cc:2468] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 12.
I20260709 13:12:22.218910 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:22.219563 25372 raft_consensus.cc:2468] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 15.
I20260709 13:12:22.220489 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
W20260709 13:12:22.221233 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:22.221306 25372 raft_consensus.cc:2393] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 13: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:22.223007 29405 leader_election.cc:290] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:22.222685 29644 consensus_queue.cc:237] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:22.225016 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:22.179483 29145 raft_consensus.cc:493] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:22.226254 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:22.227614 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:22.231237 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:22.231536 25376 raft_consensus.cc:2468] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 11.
I20260709 13:12:22.187449 29454 raft_consensus.cc:493] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:22.231886 25373 raft_consensus.cc:2468] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 10.
I20260709 13:12:22.193871 29587 raft_consensus.cc:493] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:22.246049 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:22.247617 25297 raft_consensus.cc:2410] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:12:22.213897 29531 raft_consensus.cc:697] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 12 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:22.230835 29086 raft_consensus.cc:2749] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:22.201181 29140 raft_consensus.cc:515] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:22.269577 25373 raft_consensus.cc:1275] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:12:22.317016 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:22.317655 25299 raft_consensus.cc:3060] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:22.243240 29145 raft_consensus.cc:515] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:22.189743 29563 raft_consensus.cc:515] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:22.245941 25117 maintenance_manager.cc:419] P 5140a3161b944724a989995efdc4a818: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033380
I20260709 13:12:22.243453 29660 raft_consensus.cc:493] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:22.244150 29554 raft_consensus.cc:2764] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 13:12:22.321240 25872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:22.324679 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 244334us
W20260709 13:12:22.333791 25872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:22.337211 25873 leader_election.cc:304] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:22.350728 25296 raft_consensus.cc:1240] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:22.364046 25299 raft_consensus.cc:2468] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 13.
I20260709 13:12:22.243377 29454 raft_consensus.cc:515] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:22.368806 25902 raft_consensus.cc:2393] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 14: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:12:22.246846 29587 raft_consensus.cc:515] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:22.383325 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:22.392871 25900 pending_rounds.cc:85] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6: Aborting all ops after (but not including) 8
I20260709 13:12:22.393260 25900 pending_rounds.cc:107] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:12:22.393584 25900 raft_consensus.cc:2889] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:22.367100 29688 raft_consensus.cc:493] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:22.396136 25303 raft_consensus.cc:2468] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 12.
I20260709 13:12:22.376099 29545 raft_consensus.cc:2804] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:22.335727 29660 raft_consensus.cc:515] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:22.407444 25222 raft_consensus.cc:1275] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:12:22.378952 29530 consensus_queue.cc:1048] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
W20260709 13:12:22.395457 29200 consensus_meta.cc:287] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent flushing consensus metadata: real 0.567s	user 0.011s	sys 0.003s
W20260709 13:12:22.406414 29661 consensus_meta.cc:287] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.560s	user 0.010s	sys 0.000s
I20260709 13:12:22.421476 25375 raft_consensus.cc:1275] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:12:22.421494 29589 raft_consensus.cc:493] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
W20260709 13:12:22.415778 29506 consensus_meta.cc:287] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.645s	user 0.008s	sys 0.001s
I20260709 13:12:22.379402 29527 consensus_queue.cc:237] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:22.453687 29690 log.cc:927] Time spent T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:12:22.437677 29545 raft_consensus.cc:697] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:22.381526 29531 consensus_queue.cc:237] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:22.464366 29628 raft_consensus.cc:2749] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:22.469934 29506 raft_consensus.cc:2749] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:22.468134 29561 leader_election.cc:290] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:22.465139 29661 raft_consensus.cc:515] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:22.494676 29471 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:22.469255 29589 raft_consensus.cc:515] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:22.700486 25298 raft_consensus.cc:1240] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 11. Current term is 12. Ops: []
W20260709 13:12:22.579864 29670 consensus_meta.cc:287] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.744s	user 0.009s	sys 0.002s
I20260709 13:12:22.510277 29658 leader_election.cc:290] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:22.706804 25305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46556 (request call id 608) took 2039 ms. Trace:
I20260709 13:12:22.572183 29628 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:22.572741 29627 raft_consensus.cc:493] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:22.709848 25305 rpcz_store.cc:276] 0709 13:12:20.667208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:20.667325 (+   117us) service_pool.cc:224] Handling call
0709 13:12:20.700845 (+ 33520us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:20.867141 (+166296us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:20.867175 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:21.985472 (+1118297us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b2c0015a8d8. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72e568a11 00007fd72e578372 00007fd72fcaaa01 00007fd72fc6f43a 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2
0709 13:12:22.019799 (+ 34327us) log.cc:844] Serialized 26 byte log entry
0709 13:12:22.240725 (+220926us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:22.240766 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:22.240853 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:22.700735 (+459882us) raft_consensus.cc:1685] finished
0709 13:12:22.700762 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:22.706722 (+  5960us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":37411,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":10457,"spinlock_wait_cycles":24613120,"thread_start_us":327941,"threads_started":2,"wal-append.queue_time_us":305449}
I20260709 13:12:22.707756 29689 raft_consensus.cc:493] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:22.742694 29689 raft_consensus.cc:515] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:22.724728 29454 leader_election.cc:290] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:22.747524 29693 log.cc:927] Time spent T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.173s	user 0.000s	sys 0.000s
W20260709 13:12:22.750090 29686 log.cc:927] Time spent T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.241s	user 0.001s	sys 0.000s
I20260709 13:12:22.407531 29688 raft_consensus.cc:515] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:22.706996 29685 raft_consensus.cc:493] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:22.763520 29685 raft_consensus.cc:515] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:22.766500 29692 log.cc:927] Time spent T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.272s	user 0.000s	sys 0.001s
I20260709 13:12:22.767746 29544 leader_election.cc:290] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:22.769744 25377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36264 (request call id 1898) took 1646 ms. Trace:
I20260709 13:12:22.770349 25377 rpcz_store.cc:276] 0709 13:12:21.123623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:21.143706 (+ 20083us) service_pool.cc:224] Handling call
0709 13:12:21.143978 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:21.942642 (+798664us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:21.942670 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:21.942714 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:21.942746 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:22.769414 (+826668us) spinlock_profiling.cc:243] Waited 788 ms on lock 0x7b54002878d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:22.769485 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:22.769665 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9878,"raft.queue_time_us":10435,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":9492,"spinlock_wait_cycles":1813276416}
I20260709 13:12:22.773028 25377 raft_consensus.cc:1240] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:22.776074 29589 leader_election.cc:290] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:22.720695 29666 raft_consensus.cc:493] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:22.778010 29666 raft_consensus.cc:515] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:22.700579 29140 leader_election.cc:290] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:22.625001 29471 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:22.715256 29563 leader_election.cc:290] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 14 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:22.709288 29145 leader_election.cc:290] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:22.710649 29670 raft_consensus.cc:2749] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:22.745645 29689 leader_election.cc:290] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:22.830155 25301 raft_consensus.cc:1240] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:22.794457 29530 raft_consensus.cc:493] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:22.792469 29624 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:22.723554 29628 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:22.851579 29506 raft_consensus.cc:493] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:22.852514 29506 raft_consensus.cc:515] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:22.853889 29387 raft_consensus.cc:493] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:22.854429 29660 leader_election.cc:290] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:22.854719 29624 raft_consensus.cc:493] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:22.855402 29660 raft_consensus.cc:493] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:22.855275 29624 raft_consensus.cc:515] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:22.854450 29387 raft_consensus.cc:515] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:22.859163 29506 leader_election.cc:290] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:22.860459 29387 leader_election.cc:290] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:22.726497 29627 raft_consensus.cc:515] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:22.867060 25345 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.005s	sys 0.014s
W20260709 13:12:22.869611 25345 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.005s	sys 0.014s
W20260709 13:12:22.870954 25345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:22.872561 25872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:22.712208 29545 consensus_queue.cc:237] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:22.857643 29624 leader_election.cc:290] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:22.907071 29688 leader_election.cc:290] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:22.856215 29660 raft_consensus.cc:515] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:22.846539 29530 raft_consensus.cc:515] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:22.921178 29530 leader_election.cc:290] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:22.909996 29685 leader_election.cc:290] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:22.924926 29442 raft_consensus.cc:493] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:22.930154 29661 leader_election.cc:290] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:22.930387 25304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57272 (request call id 1996) took 1063 ms. Trace:
I20260709 13:12:22.931241 25299 raft_consensus.cc:1240] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 9. Current term is 10. Ops: [9.4-9.4]
W20260709 13:12:22.932408 29697 log.cc:927] Time spent T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:12:22.945510 25304 rpcz_store.cc:276] 0709 13:12:21.867256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:21.887920 (+ 20664us) service_pool.cc:224] Handling call
0709 13:12:21.937648 (+ 49728us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:22.342573 (+404925us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:22.342604 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:22.343187 (+   583us) log.cc:844] Serialized 52 byte log entry
0709 13:12:22.792458 (+449271us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:22.792528 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:22.792622 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:22.930081 (+137459us) raft_consensus.cc:1685] finished
0709 13:12:22.930124 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:22.930314 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13904,"raft.queue_time_us":143218,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":3397,"thread_start_us":781568,"threads_started":2,"wal-append.queue_time_us":530504}
I20260709 13:12:22.946691 25373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56308 (request call id 719) took 1023 ms. Trace:
I20260709 13:12:22.947172 25373 rpcz_store.cc:276] 0709 13:12:21.923438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:22.317719 (+394281us) service_pool.cc:224] Handling call
0709 13:12:22.318057 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:22.318444 (+   387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:22.318483 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:22.318994 (+   511us) log.cc:844] Serialized 26 byte log entry
0709 13:12:22.546571 (+227577us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:22.546618 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:22.546692 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:22.946448 (+399756us) raft_consensus.cc:1685] finished
0709 13:12:22.946471 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:22.946625 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":102892,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":90,"thread_start_us":179431,"threads_started":1,"wal-append.queue_time_us":503914}
I20260709 13:12:22.948896 29442 raft_consensus.cc:3060] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:22.948975 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:22.950299 29170 leader_election.cc:290] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:22.953392 29369 leader_election.cc:290] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:22.934979 29702 log.cc:927] Time spent T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:12:22.956547 25370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36254 (request call id 2253) took 1011 ms. Trace:
I20260709 13:12:22.936925 29666 leader_election.cc:290] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:22.957942 29471 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:22.957007 25370 rpcz_store.cc:276] 0709 13:12:21.944907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:22.421832 (+476925us) service_pool.cc:224] Handling call
0709 13:12:22.422133 (+   301us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:22.422466 (+   333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:22.422497 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:22.423102 (+   605us) log.cc:844] Serialized 52 byte log entry
0709 13:12:22.579851 (+156749us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:22.624495 (+ 44644us) log.cc:844] Serialized 14 byte log entry
0709 13:12:22.631630 (+  7135us) log.cc:844] Serialized 14 byte log entry
0709 13:12:22.633509 (+  1879us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:22.633608 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:22.921086 (+287478us) spinlock_profiling.cc:243] Waited 67.7 ms on lock 0x7b180046c5a0. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72cb823f3 00007fd72cb847c1 00007fd72cb84779 00007fd72cb84709 00007fd72cb846d1 00007fd72cb839cd 000000000038f354 000000000038f199 00007fd72cb6583a
0709 13:12:22.956147 (+ 35061us) raft_consensus.cc:1685] finished
0709 13:12:22.956172 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:22.956442 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":84863,"prepare.queue_time_us":347875,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":56,"raft.queue_time_us":544255,"raft.run_cpu_time_us":556,"raft.run_wall_time_us":95409,"spinlock_wait_cycles":168778368,"thread_start_us":156334,"threads_started":1,"wal-append.queue_time_us":403226}
I20260709 13:12:22.960434 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:22.961243 25370 raft_consensus.cc:3060] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:22.962800 25373 raft_consensus.cc:3060] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:12:22.938894 29628 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:22.942374 25303 raft_consensus.cc:1275] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:12:22.963228 29660 leader_election.cc:290] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:22.938974 29583 consensus_meta.cc:287] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent flushing consensus metadata: real 1.214s	user 0.010s	sys 0.003s
I20260709 13:12:23.006170 25296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46556 (request call id 618) took 1039 ms. Trace:
I20260709 13:12:23.006680 25296 rpcz_store.cc:276] 0709 13:12:21.966354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:22.763488 (+797134us) service_pool.cc:224] Handling call
0709 13:12:22.763937 (+   449us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:22.764227 (+   290us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:12:22.870301 (+106074us) log.cc:844] Serialized 14 byte log entry
0709 13:12:23.005700 (+135399us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:23.005787 (+    87us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:23.005852 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:23.005946 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:23.006108 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":141622,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":57,"thread_start_us":236453,"threads_started":2}
I20260709 13:12:23.017040 25373 raft_consensus.cc:2468] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 13.
I20260709 13:12:23.028762 25370 raft_consensus.cc:2468] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 14.
W20260709 13:12:23.033037 29654 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.191s	user 0.018s	sys 0.037s
W20260709 13:12:23.033529 29557 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.918s	user 0.029s	sys 0.064s
I20260709 13:12:23.045118 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:23.046041 25379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36264 (request call id 1912) took 1124 ms. Trace:
I20260709 13:12:23.046401 25379 rpcz_store.cc:276] 0709 13:12:21.921216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:23.044835 (+1123619us) service_pool.cc:224] Handling call
0709 13:12:23.045980 (+  1145us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:12:23.039294 29652 consensus_meta.cc:287] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 0.877s	user 0.010s	sys 0.003s
W20260709 13:12:23.044114 29654 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.202s	user 0.018s	sys 0.037s
W20260709 13:12:23.045173 29557 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.945s	user 0.029s	sys 0.064s
I20260709 13:12:23.050978 29545 raft_consensus.cc:493] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.077235 29221 leader_election.cc:290] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:23.078605 25298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57272 (request call id 2002) took 1186 ms. Trace:
I20260709 13:12:23.079037 25298 rpcz_store.cc:276] 0709 13:12:21.891810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:21.919025 (+ 27215us) service_pool.cc:224] Handling call
0709 13:12:21.919280 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:22.700986 (+781706us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:23.078361 (+377375us) spinlock_profiling.cc:243] Waited 781 ms on lock 0x7b540018ddd4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:23.078543 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1796144384}
I20260709 13:12:23.084227 25375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36264 (request call id 1908) took 1167 ms. Trace:
I20260709 13:12:23.084757 25375 rpcz_store.cc:276] 0709 13:12:21.916980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:21.919614 (+  2634us) service_pool.cc:224] Handling call
0709 13:12:21.927257 (+  7643us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:22.455475 (+528218us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:23.083957 (+628482us) spinlock_profiling.cc:243] Waited 494 ms on lock 0x7b5400305f54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:23.084167 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1135814912}
I20260709 13:12:23.088012 29208 leader_election.cc:290] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:23.090085 29631 raft_consensus.cc:493] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.090687 29631 raft_consensus.cc:515] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:23.094069 29631 leader_election.cc:290] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:23.095564 25872 leader_election.cc:304] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:23.097685 25872 leader_election.cc:304] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:12:23.104148 29583 raft_consensus.cc:2804] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:23.104655 29583 raft_consensus.cc:493] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:23.105037 29583 raft_consensus.cc:3060] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:23.106158 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:23.053655 29652 raft_consensus.cc:515] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:23.115585 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:23.117867 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:23.119251 29652 leader_election.cc:290] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:23.119351 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:23.094969 29442 raft_consensus.cc:515] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:23.123345 29583 raft_consensus.cc:515] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:23.124557 29442 leader_election.cc:290] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:23.128921 25298 raft_consensus.cc:1240] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:23.111270 29631 raft_consensus.cc:2749] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:23.131397 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:23.127722 29369 raft_consensus.cc:493] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:23.133090 29369 raft_consensus.cc:515] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:23.133872 29594 raft_consensus.cc:3055] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:23.134323 29594 raft_consensus.cc:740] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:23.135289 29594 consensus_queue.cc:260] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:23.136766 29369 leader_election.cc:290] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:23.137507 25301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46556 (request call id 614) took 1188 ms. Trace:
I20260709 13:12:23.137990 25301 rpcz_store.cc:276] 0709 13:12:21.948923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:21.971926 (+ 23003us) service_pool.cc:224] Handling call
0709 13:12:21.972312 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:22.830630 (+858318us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:23.137203 (+306573us) spinlock_profiling.cc:243] Waited 858 ms on lock 0x7b540029ac54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:23.137434 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1972400512}
I20260709 13:12:23.141566 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:23.142726 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:23.146665 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:23.148307 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:23.149622 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:23.150331 25900 raft_consensus.cc:2468] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 11.
I20260709 13:12:23.152012 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:23.117197 29545 raft_consensus.cc:515] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:23.144869 29586 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.302s	user 0.031s	sys 0.052s
W20260709 13:12:23.156492 29586 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.314s	user 0.031s	sys 0.052s
I20260709 13:12:23.158670 29583 leader_election.cc:290] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:23.164208 29545 leader_election.cc:290] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:23.169617 29460 raft_consensus.cc:3060] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:23.170866 29269 leader_election.cc:290] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361)
I20260709 13:12:23.182016 29594 raft_consensus.cc:3060] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:12:23.187784 29679 log.cc:927] Time spent T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 1.222s	user 0.013s	sys 0.009s
W20260709 13:12:23.190793 29673 log.cc:927] Time spent T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 1.368s	user 0.009s	sys 0.001s
W20260709 13:12:23.192667 29677 log.cc:927] Time spent T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 1.264s	user 0.002s	sys 0.000s
W20260709 13:12:23.193419 29717 log.cc:927] Time spent T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
W20260709 13:12:23.197935 29653 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.347s	user 0.023s	sys 0.000s
W20260709 13:12:23.198527 29653 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.349s	user 0.023s	sys 0.000s
W20260709 13:12:23.199354 29719 log.cc:927] Time spent T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
W20260709 13:12:23.199415 29645 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.100s	user 0.000s	sys 0.009s
W20260709 13:12:23.200139 29645 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.104s	user 0.000s	sys 0.009s
I20260709 13:12:23.200495 29645 raft_consensus.cc:697] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 10 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:23.202291 29627 leader_election.cc:290] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:23.201669 29645 consensus_queue.cc:237] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:23.204324 29587 leader_election.cc:290] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:23.248332 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:23.252681 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:23.250662 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:23.253700 25304 raft_consensus.cc:2468] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 11.
I20260709 13:12:23.252676 25299 raft_consensus.cc:1275] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:12:23.253257 25296 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 9.
W20260709 13:12:23.263119 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 302439us
W20260709 13:12:23.267702 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 127007us
I20260709 13:12:23.275457 25376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36254 (request call id 2257) took 1329 ms. Trace:
I20260709 13:12:23.278512 29707 raft_consensus.cc:493] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.279573 29707 raft_consensus.cc:515] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:23.280203 29557 raft_consensus.cc:493] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:23.280931 29644 raft_consensus.cc:493] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:23.281224 29557 raft_consensus.cc:515] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:23.284687 29557 leader_election.cc:290] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:23.263440 25907 raft_consensus.cc:1240] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 LEADER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:23.300474 25229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54000 (request call id 743) took 1168 ms. Trace:
W20260709 13:12:23.292944 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:23.292842 29644 raft_consensus.cc:515] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:23.342474 25224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54000 (request call id 746) took 1180 ms. Trace:
I20260709 13:12:23.302937 25229 rpcz_store.cc:276] 0709 13:12:22.131942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:22.132058 (+   116us) service_pool.cc:224] Handling call
0709 13:12:22.150178 (+ 18120us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:22.247275 (+ 97097us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:22.247305 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:22.247343 (+    38us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:22.247372 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:23.299925 (+1052553us) spinlock_profiling.cc:243] Waited 96.9 ms on lock 0x7b54000884d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:23.299984 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:23.300228 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":222756608}
I20260709 13:12:23.343173 25224 rpcz_store.cc:276] 0709 13:12:22.162032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:22.164171 (+  2139us) service_pool.cc:224] Handling call
0709 13:12:22.191916 (+ 27745us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:22.192176 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:12:22.200665 (+  8489us) log.cc:844] Serialized 14 byte log entry
0709 13:12:23.305113 (+1104448us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b1800187d80. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72cafcc0a 00007fd73623c219 00007fd72cb84a40 00007fd72cb7f4e4 00007fd72cb7f455 00007fd72fc67060 00007fd72fc79716 00007fd72fc8a287 00007fd72fc8a208
0709 13:12:23.307321 (+  2208us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:23.307432 (+   111us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:12:23.307535 (+   103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:23.341993 (+ 34458us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:23.342249 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14820,"prepare.queue_time_us":10350,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"spinlock_wait_cycles":28871424}
I20260709 13:12:23.354480 25300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57272 (request call id 1997) took 1466 ms. Trace:
I20260709 13:12:23.355070 25300 rpcz_store.cc:276] 0709 13:12:21.888107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:21.888253 (+   146us) service_pool.cc:224] Handling call
0709 13:12:21.888680 (+   427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:22.068180 (+179500us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:23.353703 (+1285523us) spinlock_profiling.cc:243] Waited 71.7 ms on lock 0x7b54000f8054. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:23.354234 (+   531us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":164797184}
I20260709 13:12:23.357642 25302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57272 (request call id 2011) took 1184 ms. Trace:
I20260709 13:12:23.358108 25302 rpcz_store.cc:276] 0709 13:12:22.172621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:22.948870 (+776249us) service_pool.cc:224] Handling call
0709 13:12:22.963607 (+ 14737us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:22.963986 (+   379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:22.964025 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:22.964593 (+   568us) log.cc:844] Serialized 52 byte log entry
0709 13:12:23.024559 (+ 59966us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:23.038245 (+ 13686us) log.cc:844] Serialized 14 byte log entry
0709 13:12:23.038486 (+   241us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:23.038564 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:23.093817 (+ 55253us) raft_consensus.cc:1685] finished
0709 13:12:23.093837 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:23.357248 (+263411us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b54002c9a50. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6e8ad 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:23.357471 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":234,"prepare.queue_time_us":13515,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":2986,"raft.queue_time_us":1912,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":1740,"spinlock_wait_cycles":33163520,"thread_start_us":59609,"threads_started":1,"wal-append.queue_time_us":109846}
I20260709 13:12:23.365408 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:23.375273 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:23.376118 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:23.377501 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:23.379442 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:23.276286 25376 rpcz_store.cc:276] 0709 13:12:21.946205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:22.756313 (+810108us) service_pool.cc:224] Handling call
0709 13:12:22.756745 (+   432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:22.791568 (+ 34823us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:22.791612 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:22.792215 (+   603us) log.cc:844] Serialized 26 byte log entry
0709 13:12:22.967824 (+175609us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:22.995857 (+ 28033us) log.cc:844] Serialized 14 byte log entry
0709 13:12:23.274502 (+278645us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:23.274701 (+   199us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:23.274798 (+    97us) raft_consensus.cc:1685] finished
0709 13:12:23.274819 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:23.275136 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":689311,"prepare.queue_time_us":27776,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":2264,"raft.queue_time_us":60842,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":128,"thread_start_us":133193,"threads_started":1,"wal-append.queue_time_us":150549}
I20260709 13:12:23.395123 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:23.399631 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:23.406600 29707 leader_election.cc:290] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:23.414291 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 64825us
I20260709 13:12:23.420173 29644 leader_election.cc:290] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:23.424346 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:23.431290 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:23.434324 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:23.444478 29644 raft_consensus.cc:493] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:22.108572 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:23.445261 29644 raft_consensus.cc:515] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
W20260709 13:12:23.449383 25872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:23.449785 29644 leader_election.cc:290] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:23.455497 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:23.456763 25370 raft_consensus.cc:2393] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 13: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:23.456247 25873 leader_election.cc:304] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:23.456947 29655 raft_consensus.cc:3060] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:23.468907 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:23.480435 29624 raft_consensus.cc:493] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:23.482646 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:23.483481 25304 raft_consensus.cc:3060] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:23.482931 29624 raft_consensus.cc:515] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:23.484189 25296 raft_consensus.cc:1240] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:23.488036 25375 raft_consensus.cc:2393] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 11: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:23.476656 28717 raft_consensus.cc:493] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:23.490024 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:23.497969 25300 raft_consensus.cc:1240] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:23.502585 25298 raft_consensus.cc:2468] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 10.
I20260709 13:12:23.500416 28717 raft_consensus.cc:515] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:23.510243 28717 leader_election.cc:290] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:23.518285 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 62545.6us
W20260709 13:12:23.520246 25371 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36254 (request call id 2252) took 1575 ms (client timeout 1538 ms). Trace:
W20260709 13:12:23.520925 25371 rpcz_store.cc:269] 0709 13:12:21.944122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:22.030846 (+ 86724us) service_pool.cc:224] Handling call
0709 13:12:23.501278 (+1470432us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b540009d3d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:23.519899 (+ 18621us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3004842368}
I20260709 13:12:23.521889 29644 raft_consensus.cc:493] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.527161 29644 raft_consensus.cc:515] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:23.528221 29531 raft_consensus.cc:493] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:23.531483 29531 raft_consensus.cc:515] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:23.532143 29644 leader_election.cc:290] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:23.535020 25345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:23.535233 29499 raft_consensus.cc:493] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:23.535841 29664 raft_consensus.cc:493] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:23.535948 29442 raft_consensus.cc:493] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:23.536275 29645 raft_consensus.cc:493] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.541538 28717 raft_consensus.cc:493] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.547533 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:23.553175 25298 raft_consensus.cc:1275] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:12:23.557790 25902 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50056 (request call id 783) took 1636 ms (client timeout 2154 ms). Trace:
I20260709 13:12:23.557878 29658 raft_consensus.cc:493] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:23.558697 29531 leader_election.cc:290] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:23.558820 29527 raft_consensus.cc:493] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:23.559439 29499 raft_consensus.cc:515] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:23.559685 29527 raft_consensus.cc:515] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:23.558382 25902 rpcz_store.cc:269] 0709 13:12:21.921072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:21.923412 (+  2340us) service_pool.cc:224] Handling call
0709 13:12:23.529439 (+1606027us) spinlock_profiling.cc:243] Waited 444 ms on lock 0x7b540055d054. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:23.557591 (+ 28152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1022043904}
I20260709 13:12:23.562288 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:23.563313 29527 leader_election.cc:290] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:23.563549 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:23.563651 29732 raft_consensus.cc:493] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:23.564477 29732 raft_consensus.cc:515] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:23.565524 25907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50060 (request call id 729) took 2150 ms. Trace:
I20260709 13:12:23.565945 25907 rpcz_store.cc:276] 0709 13:12:21.415502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:21.416162 (+   660us) service_pool.cc:224] Handling call
0709 13:12:21.416439 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:23.292084 (+1875645us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:23.565145 (+273061us) spinlock_profiling.cc:243] Waited 1.84 s on lock 0x7b540056fed4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:23.565418 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4234371456}
I20260709 13:12:23.567024 29732 leader_election.cc:290] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:23.546546 29624 leader_election.cc:290] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:23.567704 29563 raft_consensus.cc:2804] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:23.568397 29563 raft_consensus.cc:697] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:23.569366 28717 raft_consensus.cc:515] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:23.570065 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:23.571084 29527 raft_consensus.cc:493] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:23.571678 29527 raft_consensus.cc:515] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:23.571710 29645 raft_consensus.cc:515] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:23.572804 29221 raft_consensus.cc:493] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:23.573558 29221 raft_consensus.cc:515] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:23.574378 29645 leader_election.cc:290] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:12:23.574896 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:23.575915 29451 raft_consensus.cc:493] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:23.576071 29733 raft_consensus.cc:493] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:23.576766 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:23.576877 29733 raft_consensus.cc:515] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:23.576454 29451 raft_consensus.cc:515] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:23.572181 29734 raft_consensus.cc:493] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:23.579596 29734 raft_consensus.cc:515] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:23.554332 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:23.571825 28717 leader_election.cc:290] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:23.586292 29499 leader_election.cc:290] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:23.551205 29442 raft_consensus.cc:515] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:23.602571 29723 log.cc:927] Time spent T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 13:12:23.611845 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:23.615808 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:23.613866 25228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54000 (request call id 747) took 1378 ms. Trace:
I20260709 13:12:23.558740 29658 raft_consensus.cc:515] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:23.613217 25222 raft_consensus.cc:1240] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:23.605027 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:23.609097 29734 leader_election.cc:290] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:23.613451 25194 leader_election.cc:304] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:23.624431 25221 raft_consensus.cc:2410] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 10 because replica has last-logged OpId of term: 9 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 13:12:23.604214 29664 raft_consensus.cc:515] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:23.623894 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:23.622692 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:23.580729 29451 leader_election.cc:290] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:23.622980 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:23.627549 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:23.631055 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:23.632368 25229 raft_consensus.cc:2393] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 11: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:23.631313 25225 raft_consensus.cc:2468] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 10.
I20260709 13:12:23.627403 29645 raft_consensus.cc:493] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.633314 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:23.638705 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:23.643965 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:23.644820 25907 raft_consensus.cc:2468] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 11.
I20260709 13:12:23.644928 25874 leader_election.cc:304] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:23.639500 25221 raft_consensus.cc:2468] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 12.
I20260709 13:12:23.645018 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:23.645612 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:23.647681 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:23.648252 25902 raft_consensus.cc:3060] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:12:23.639065 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 83937us
I20260709 13:12:23.633957 29221 leader_election.cc:290] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:23.655529 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:23.620179 25228 rpcz_store.cc:276] 0709 13:12:22.162372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:22.163188 (+   816us) service_pool.cc:224] Handling call
0709 13:12:22.163461 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:22.163630 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:12:22.186650 (+ 23020us) log.cc:844] Serialized 14 byte log entry
0709 13:12:23.460800 (+1274150us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:23.476215 (+ 15415us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:23.507944 (+ 31729us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:23.523084 (+ 15140us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:23.541105 (+ 18021us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":959541,"prepare.queue_time_us":27186,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":1042049,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":287,"thread_start_us":237851,"threads_started":2,"wal-append.queue_time_us":270004}
I20260709 13:12:23.653527 25379 raft_consensus.cc:2468] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 12.
I20260709 13:12:23.660320 29732 raft_consensus.cc:493] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:23.661398 25378 raft_consensus.cc:1275] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:12:23.662459 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:23.661857 25378 pending_rounds.cc:85] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468: Aborting all ops after (but not including) 8
I20260709 13:12:23.645831 29645 raft_consensus.cc:515] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:23.658447 29527 leader_election.cc:290] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:23.666922 25378 pending_rounds.cc:107] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:12:23.649981 29451 raft_consensus.cc:493] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:23.672384 29734 raft_consensus.cc:2804] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:23.674000 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:23.660845 29446 raft_consensus.cc:2749] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:23.677775 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:23.675063 25378 raft_consensus.cc:2889] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:23.681090 25304 raft_consensus.cc:2468] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 9.
I20260709 13:12:23.682812 25370 raft_consensus.cc:2468] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 13.
I20260709 13:12:23.682422 29707 raft_consensus.cc:493] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:23.688462 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:23.652487 29563 consensus_queue.cc:237] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:23.678970 29734 raft_consensus.cc:697] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 13 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:23.690647 29734 consensus_queue.cc:237] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:23.688532 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:23.660948 29732 raft_consensus.cc:515] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:23.692335 25379 raft_consensus.cc:2468] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 10.
I20260709 13:12:23.693542 29442 leader_election.cc:290] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:23.689307 25305 raft_consensus.cc:2468] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 13.
I20260709 13:12:23.688643 29707 raft_consensus.cc:515] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:23.672432 29221 consensus_queue.cc:1059] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:12:23.671819 29733 leader_election.cc:290] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:23.696542 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:23.699087 29664 leader_election.cc:290] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:23.700892 25902 raft_consensus.cc:2468] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 14.
I20260709 13:12:23.701503 29645 leader_election.cc:290] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:23.701411 25194 leader_election.cc:304] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:23.694507 25222 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 10.
W20260709 13:12:23.708302 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 63652.7us
I20260709 13:12:23.709600 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:23.709693 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:23.700107 29732 leader_election.cc:290] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:23.715884 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:23.718852 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:23.720317 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:23.707954 29658 leader_election.cc:290] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:23.718151 29738 log.cc:927] Time spent T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:12:23.727386 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:23.734144 29707 leader_election.cc:290] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:12:23.735234 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 57176.5us
I20260709 13:12:23.714335 29451 raft_consensus.cc:515] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:23.744812 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:23.725500 29732 raft_consensus.cc:2804] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:23.743251 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:23.745236 25224 raft_consensus.cc:2410] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:12:23.746999 29086 raft_consensus.cc:493] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:23.748458 29086 raft_consensus.cc:515] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:23.750732 25296 raft_consensus.cc:2468] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 12.
I20260709 13:12:23.768324 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:23.769048 25373 raft_consensus.cc:3060] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:12:23.773849 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:23.774816 29741 log.cc:927] Time spent T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:12:23.747546 29732 raft_consensus.cc:493] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:23.766369 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:23.780112 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:23.780457 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:23.781648 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:23.781838 25372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36254 (request call id 2255) took 1762 ms. Trace:
I20260709 13:12:23.782133 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:23.783121 25305 raft_consensus.cc:1240] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:23.784029 25298 raft_consensus.cc:2468] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 11.
I20260709 13:12:23.783979 25296 raft_consensus.cc:2468] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 10.
I20260709 13:12:23.750061 29707 raft_consensus.cc:493] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:23.790097 25303 raft_consensus.cc:2468] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 12.
I20260709 13:12:23.792126 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:23.784946 25372 rpcz_store.cc:276] 0709 13:12:21.945610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:22.750837 (+805227us) service_pool.cc:224] Handling call
0709 13:12:22.751157 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:22.791226 (+ 40069us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:12:22.938732 (+147506us) spinlock_profiling.cc:243] Waited 4.29 ms on lock 0x7b4800280158. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd734b98aa1 00007fd734b8fb37 00007fd734b8f9ca 00007fd734c8726f 00007fd734c86f37 00007fd734c9b55c 00007fd734c9b508 00007fd734c9b488 00007fd734c9b443 00007fd734c9a6ec 00007fd733bc4a96
0709 13:12:23.364358 (+425626us) spinlock_profiling.cc:243] Waited 8.78 ms on lock 0x7b18003e5ae0. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72cb64e07 00007fd7359bfab9 00007fd72cb8169b 00007fd72cb7f93f 00007fd72cb7f455 00007fd7336673c7 00007fd72fc799a7 00007fd72fc890bf 00007fd72fc89038
0709 13:12:23.385357 (+ 20999us) log.cc:844] Serialized 14 byte log entry
0709 13:12:23.552805 (+167448us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:23.606935 (+ 54130us) spinlock_profiling.cc:243] Waited 3.54 ms on lock 0x7b18003e5ae0. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72cb823f3 00007fd72cb847c1 00007fd72cb84779 00007fd72cb84709 00007fd72cb846d1 00007fd72cb839cd 000000000038f354 000000000038f199 00007fd72cb6583a
0709 13:12:23.655501 (+ 48566us) log.cc:844] Serialized 26 byte log entry
0709 13:12:23.655684 (+   183us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:23.675994 (+ 20310us) log.cc:844] Serialized 14 byte log entry
0709 13:12:23.696551 (+ 20557us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:23.707497 (+ 10946us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:23.707548 (+    51us) raft_consensus.cc:1685] finished
0709 13:12:23.707563 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:23.708359 (+   796us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":389273,"prepare.queue_time_us":150632,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":70,"raft.queue_time_us":70641,"raft.run_cpu_time_us":2723,"raft.run_wall_time_us":171477,"spinlock_wait_cycles":38204416,"thread_start_us":99806,"threads_started":2,"wal-append.queue_time_us":182208}
I20260709 13:12:23.785863 29732 raft_consensus.cc:3060] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:23.800873 25373 raft_consensus.cc:2468] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 12.
I20260709 13:12:23.809675 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:23.808651 29086 leader_election.cc:290] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:23.815449 29451 leader_election.cc:290] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:23.816363 29460 consensus_queue.cc:1048] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:23.817951 29664 consensus_queue.cc:1059] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:23.818933 29664 consensus_queue.cc:1048] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:23.820629 25227 raft_consensus.cc:2468] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 11.
I20260709 13:12:23.821520 29653 raft_consensus.cc:3055] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:23.821959 29531 raft_consensus.cc:493] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.822518 29531 raft_consensus.cc:515] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:23.821990 29653 raft_consensus.cc:740] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:23.825405 29653 consensus_queue.cc:260] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:23.827991 29653 raft_consensus.cc:3060] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:23.828279 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:23.829159 25303 raft_consensus.cc:2410] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:12:23.831400 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:23.831794 29531 leader_election.cc:290] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:23.799103 29707 raft_consensus.cc:515] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:23.833247 25298 raft_consensus.cc:1275] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:12:23.833668 25298 pending_rounds.cc:85] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19: Aborting all ops after (but not including) 7
I20260709 13:12:23.833954 25298 pending_rounds.cc:107] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:12:23.834184 25298 raft_consensus.cc:2889] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:23.835053 29707 leader_election.cc:290] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:23.835513 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:23.821326 29200 consensus_queue.cc:1048] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 13:12:23.820550 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:12:23.822543 25227 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58418 (request call id 2122) took 2036 ms (client timeout 1818 ms). Trace:
I20260709 13:12:23.848533 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:23.845198 25194 leader_election.cc:304] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:23.843878 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:12:23.848798 25227 rpcz_store.cc:269] 0709 13:12:21.786286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:21.786399 (+   113us) service_pool.cc:224] Handling call
0709 13:12:23.822305 (+2035906us) spinlock_profiling.cc:243] Waited 1.97 s on lock 0x7b54000ea1d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:23.822455 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4532749184}
I20260709 13:12:23.851882 29454 raft_consensus.cc:493] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:23.853223 29454 raft_consensus.cc:515] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:23.854360 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:23.855275 25230 raft_consensus.cc:2393] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 13: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:23.855645 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:23.855805 29454 leader_election.cc:290] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:23.856600 25901 raft_consensus.cc:2410] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:12:23.856721 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:23.857455 29663 raft_consensus.cc:493] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.857940 25907 raft_consensus.cc:1240] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:23.858111 29663 raft_consensus.cc:515] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:23.858739 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:23.859208 25902 raft_consensus.cc:2468] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 12.
I20260709 13:12:23.860570 29663 leader_election.cc:290] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:23.868203 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:23.868389 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:23.869903 25223 raft_consensus.cc:3055] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:23.870407 25223 raft_consensus.cc:740] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:23.870483 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:23.871385 25223 consensus_queue.cc:260] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:23.872756 25223 raft_consensus.cc:3060] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:23.869930 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:23.874832 25225 raft_consensus.cc:2468] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 11.
I20260709 13:12:23.878372 29586 consensus_queue.cc:1059] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:23.878718 25872 leader_election.cc:304] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:23.880507 25343 leader_election.cc:304] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:23.883505 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:23.901369 25343 leader_election.cc:304] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:23.902997 25299 raft_consensus.cc:2468] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 10.
W20260709 13:12:23.910889 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 93172us
I20260709 13:12:23.911252 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:23.909157 29645 raft_consensus.cc:2804] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:23.914213 29733 raft_consensus.cc:2804] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:23.911953 25224 raft_consensus.cc:3060] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:23.916635 29733 raft_consensus.cc:493] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:23.928943 29733 raft_consensus.cc:3060] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:23.909489 29086 consensus_queue.cc:1059] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:12:23.930078 29587 consensus_queue.cc:1048] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:12:23.914618 29645 raft_consensus.cc:493] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:23.932265 29645 raft_consensus.cc:3060] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:23.933976 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:23.935408 25194 leader_election.cc:304] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:23.936439 29527 consensus_queue.cc:1048] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:23.938416 29460 raft_consensus.cc:2804] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:23.912544 29707 raft_consensus.cc:2804] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:23.929056 25271 leader_election.cc:304] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:23.945314 29691 raft_consensus.cc:493] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:23.946039 29691 raft_consensus.cc:515] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:23.948480 29691 leader_election.cc:290] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:23.948693 29458 raft_consensus.cc:2804] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:23.949153 29458 raft_consensus.cc:493] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:23.950831 29269 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.951805 29269 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:23.938114 29725 consensus_queue.cc:1048] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:12:23.969028 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 43542.7us
I20260709 13:12:23.949615 29458 raft_consensus.cc:3060] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:23.985430 25223 raft_consensus.cc:1275] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 13:12:23.986080 25223 pending_rounds.cc:85] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce: Aborting all ops after (but not including) 10
I20260709 13:12:23.986373 25223 pending_rounds.cc:107] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 13:12:23.986766 25223 raft_consensus.cc:2889] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:23.988487 29269 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:23.942351 29707 raft_consensus.cc:493] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:23.945319 29460 raft_consensus.cc:697] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 9 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:23.995296 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:23.982388 29663 raft_consensus.cc:2804] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:12:24.004060 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 236242us
I20260709 13:12:24.004487 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:24.024890 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:24.025410 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:24.026135 25223 raft_consensus.cc:2468] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 11.
I20260709 13:12:24.026405 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:23.996611 29707 raft_consensus.cc:3060] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:24.034137 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:24.036293 25372 raft_consensus.cc:1275] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:12:24.044691 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:24.045113 29627 raft_consensus.cc:3055] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:24.045646 29627 raft_consensus.cc:740] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:24.046763 29627 consensus_queue.cc:260] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:24.048512 29499 raft_consensus.cc:3055] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:24.048995 29499 raft_consensus.cc:740] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:24.048605 29460 consensus_queue.cc:237] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:24.049989 29499 consensus_queue.cc:260] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:24.051417 29458 raft_consensus.cc:515] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:24.053586 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:24.055320 25195 leader_election.cc:304] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
W20260709 13:12:24.056151 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 154238us
I20260709 13:12:24.056337 29458 leader_election.cc:290] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:24.061820 25114 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 8d0f43a786a846b49924a589e4a36f2f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 79d99c0e498349bda74127365219e468 (127.23.140.67:34091) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 79d99c0e498349bda74127365219e468 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:12:24.063984 25270 leader_election.cc:304] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:24.065017 29458 raft_consensus.cc:2749] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:24.053587 25344 leader_election.cc:304] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:24.070793 29499 raft_consensus.cc:3060] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:24.072952 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 70314us
I20260709 13:12:24.077971 25873 leader_election.cc:304] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:24.079958 29586 consensus_queue.cc:1048] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:24.002413 29663 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:24.083611 29663 raft_consensus.cc:3060] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:24.079970 25873 leader_election.cc:304] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:24.089517 25195 leader_election.cc:304] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:24.090417 25270 leader_election.cc:304] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:24.078961 29200 raft_consensus.cc:2804] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:24.095134 25370 raft_consensus.cc:3060] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:12:24.096515 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:24.101274 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:24.098577 29624 raft_consensus.cc:2804] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:24.104207 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:24.109576 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:24.100384 29200 raft_consensus.cc:493] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:24.132027 25224 raft_consensus.cc:2468] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 14.
W20260709 13:12:24.131323 29742 log.cc:927] Time spent T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.352s	user 0.002s	sys 0.000s
I20260709 13:12:24.116261 29624 raft_consensus.cc:697] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 13 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:24.126039 29200 raft_consensus.cc:3060] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:24.139106 29638 raft_consensus.cc:2804] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:24.140398 29624 consensus_queue.cc:237] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:24.143054 29377 raft_consensus.cc:2804] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:24.148841 29627 raft_consensus.cc:3060] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:24.136847 29732 raft_consensus.cc:515] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:24.154094 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 96393.3us
I20260709 13:12:24.164511 25195 leader_election.cc:304] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:24.166118 29662 raft_consensus.cc:2749] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:24.133031 29658 raft_consensus.cc:2764] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:12:24.159089 29638 raft_consensus.cc:493] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:24.177526 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 298938us
I20260709 13:12:24.158640 29725 raft_consensus.cc:493] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.158936 29377 raft_consensus.cc:493] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:24.190488 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:24.195190 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 151383us
W20260709 13:12:24.194515 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 119463us
I20260709 13:12:24.182317 29442 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:24.198855 25225 raft_consensus.cc:2468] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 10.
I20260709 13:12:24.183166 29638 raft_consensus.cc:3060] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:24.187985 29377 raft_consensus.cc:3060] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:24.196609 29732 leader_election.cc:290] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:24.214926 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 161411us
I20260709 13:12:24.210665 25345 leader_election.cc:304] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:24.187773 29725 raft_consensus.cc:515] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:24.221786 25344 leader_election.cc:304] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:24.227941 25872 leader_election.cc:304] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:24.206590 29442 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:24.306048 29752 raft_consensus.cc:2749] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:24.306310 25126 catalog_manager.cc:5697] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 6 to 9, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 9 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:24.308595 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 82519.2us
I20260709 13:12:24.320935 29753 raft_consensus.cc:493] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.323104 29753 raft_consensus.cc:515] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:24.313025 29586 raft_consensus.cc:2749] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:24.325277 29753 leader_election.cc:290] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:24.325817 29663 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:24.366226 25270 leader_election.cc:304] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:24.315852 29662 raft_consensus.cc:493] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
W20260709 13:12:24.369608 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 138075us
W20260709 13:12:24.373730 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 148193us
I20260709 13:12:24.317824 29734 raft_consensus.cc:493] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
W20260709 13:12:24.381413 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 54436.7us
I20260709 13:12:24.380318 25271 leader_election.cc:304] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:24.367954 29753 raft_consensus.cc:2749] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:24.316020 29752 consensus_queue.cc:1059] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 13:12:24.322355 29733 raft_consensus.cc:515] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:24.392467 29458 raft_consensus.cc:3060] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:24.415794 25872 leader_election.cc:304] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:24.417327 29755 raft_consensus.cc:2749] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:24.418704 29442 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:24.421312 29756 raft_consensus.cc:2749] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:24.397632 29752 raft_consensus.cc:493] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:24.430310 29752 raft_consensus.cc:515] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:24.432471 29752 leader_election.cc:290] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:24.433948 29563 raft_consensus.cc:2749] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:24.400394 29734 raft_consensus.cc:515] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:24.441437 29734 leader_election.cc:290] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:24.449987 29725 leader_election.cc:290] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:24.451050 29733 leader_election.cc:290] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:24.380061 29662 raft_consensus.cc:515] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:24.461556 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 45864.2us
I20260709 13:12:24.463414 25370 raft_consensus.cc:2468] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 14.
I20260709 13:12:24.470081 29662 leader_election.cc:290] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:24.470866 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 95981.3us
I20260709 13:12:24.473327 25271 leader_election.cc:304] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:24.476047 29269 raft_consensus.cc:2749] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:24.478441 29454 raft_consensus.cc:493] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:24.479059 29454 raft_consensus.cc:515] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:24.486164 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:24.490653 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:24.464385 29691 raft_consensus.cc:493] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.501103 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:24.481536 29454 leader_election.cc:290] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:24.509183 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 44850.7us
I20260709 13:12:24.465112 29707 raft_consensus.cc:515] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:12:24.515261 25872 leader_election.cc:304] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:12:24.516023 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 305475us
I20260709 13:12:24.523526 29761 raft_consensus.cc:493] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:24.544902 29761 raft_consensus.cc:515] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:24.545913 29750 raft_consensus.cc:493] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:24.546605 29750 raft_consensus.cc:515] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:24.549176 29750 leader_election.cc:290] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:24.504271 29691 raft_consensus.cc:515] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:24.541085 29662 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:24.554844 29662 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:24.560485 29761 leader_election.cc:290] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:24.557531 29662 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:24.561686 29750 raft_consensus.cc:493] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:24.562548 29750 raft_consensus.cc:515] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:24.563213 29707 leader_election.cc:290] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:24.563995 29663 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:24.564688 29750 leader_election.cc:290] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:24.565282 29662 consensus_queue.cc:1048] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:24.537791 29563 raft_consensus.cc:2804] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:24.541936 29624 raft_consensus.cc:493] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:24.571434 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 47404.3us
W20260709 13:12:24.567363 25874 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.140.65:39361 timed out after 2.201s (SENT) [suppressed 24 similar messages]
I20260709 13:12:24.577085 25345 leader_election.cc:304] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:24.524742 29200 raft_consensus.cc:515] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:24.580358 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 253594us
I20260709 13:12:24.594678 29750 raft_consensus.cc:2749] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:24.594867 25270 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:24.595868 29200 leader_election.cc:290] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:24.595957 25270 leader_election.cc:304] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
W20260709 13:12:24.596627 29645 consensus_meta.cc:287] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.664s	user 0.011s	sys 0.000s
I20260709 13:12:24.597060 29645 raft_consensus.cc:515] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:24.598177 29756 raft_consensus.cc:2749] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:24.598649 29269 raft_consensus.cc:2749] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:24.597615 25270 leader_election.cc:304] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:24.578775 29624 raft_consensus.cc:515] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:24.571501 29563 raft_consensus.cc:493] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:24.596215 25345 leader_election.cc:304] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:24.612967 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 391250us
I20260709 13:12:24.616120 25344 leader_election.cc:304] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:24.561640 29638 raft_consensus.cc:515] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:24.574913 29377 raft_consensus.cc:515] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:24.612826 29563 raft_consensus.cc:3060] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:24.632745 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:24.619062 29458 raft_consensus.cc:2749] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:24.636145 25345 leader_election.cc:304] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:24.619649 29707 raft_consensus.cc:2804] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:24.625679 29761 raft_consensus.cc:2804] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:24.639595 25345 leader_election.cc:304] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:24.640663 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:24.641687 29638 leader_election.cc:290] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 14 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:24.642056 29763 raft_consensus.cc:2749] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:24.622730 29750 consensus_queue.cc:1059] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:12:24.644200 29624 leader_election.cc:290] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:24.659543 29644 raft_consensus.cc:3055] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:24.635979 29756 raft_consensus.cc:2749] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:24.646517 29377 leader_election.cc:290] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 16 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:24.638312 29200 raft_consensus.cc:493] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:24.656831 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 59274.7us
I20260709 13:12:24.654115 29761 raft_consensus.cc:493] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:24.667515 29761 raft_consensus.cc:3060] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:24.667603 29200 raft_consensus.cc:515] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:24.638772 29707 raft_consensus.cc:493] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:24.670699 29707 raft_consensus.cc:3060] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:24.675742 25128 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33566 (request call id 178) took 24768 ms (client timeout 15000 ms). Trace:
W20260709 13:12:24.660255 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 106939us
I20260709 13:12:24.644665 29645 leader_election.cc:290] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:24.663102 29752 raft_consensus.cc:2749] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:24.683071 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:24.663250 29750 raft_consensus.cc:3055] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:24.664702 25345 leader_election.cc:304] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:24.675640 25270 leader_election.cc:304] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:24.658586 25907 raft_consensus.cc:2468] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 11.
I20260709 13:12:24.677505 25126 catalog_manager.cc:5697] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:24.685015 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:24.685636 25303 raft_consensus.cc:2468] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 12.
I20260709 13:12:24.684085 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:24.687606 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:24.687851 25299 raft_consensus.cc:1275] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:12:24.688129 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:24.688480 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:24.688760 25900 raft_consensus.cc:2468] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 11.
I20260709 13:12:24.689052 25902 raft_consensus.cc:1275] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 13:12:24.690847 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 51847.5us
I20260709 13:12:24.686317 29750 raft_consensus.cc:740] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:24.691983 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:24.692409 29750 consensus_queue.cc:260] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:24.694478 25126 catalog_manager.cc:5697] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 3 to 7, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 7 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:24.696981 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:24.660832 29644 raft_consensus.cc:740] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:24.698590 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:24.693979 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:24.699734 25305 raft_consensus.cc:1275] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:12:24.703493 25874 leader_election.cc:304] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:24.704826 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:24.706578 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:24.707528 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:12:24.709146 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 44635.6us
I20260709 13:12:24.710966 25345 leader_election.cc:304] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:24.716048 29764 raft_consensus.cc:2749] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:24.716362 29446 raft_consensus.cc:2749] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:24.717064 25126 catalog_manager.cc:5697] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:24.717903 25270 leader_election.cc:304] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
W20260709 13:12:24.678448 25128 rpcz_store.cc:269] 0709 13:11:59.907356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:59.907623 (+   267us) service_pool.cc:224] Handling call
0709 13:12:24.675537 (+24767914us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:17.158866 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:17.159532 (+   666us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:17.159587 (+    55us) write_op.cc:435] Acquired schema lock
0709 13:12:17.159604 (+    17us) tablet.cc:662] Decoding operations
0709 13:12:17.161007 (+  1403us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:17.161091 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:17.161124 (+    33us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:12:17.420106 (+258982us) tablet.cc:701] Row locks acquired
0709 13:12:17.420165 (+    59us) write_op.cc:260] PREPARE: finished
0709 13:12:17.420401 (+   236us) write_op.cc:270] Start()
0709 13:12:17.420582 (+   181us) write_op.cc:276] Timestamp: P: 1783602737420331 usec, L: 0
0709 13:12:17.420612 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 13:12:17.421464 (+   852us) log.cc:844] Serialized 6655 byte log entry
0709 13:12:18.856621 (+1435157us) op_driver.cc:464] REPLICATION: finished
0709 13:12:19.164579 (+307958us) write_op.cc:301] APPLY: starting
0709 13:12:19.164712 (+   133us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:19.165058 (+   346us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:19.165213 (+   155us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:19.167156 (+  1943us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:19.167550 (+   394us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 13:12:19.167601 (+    51us) write_op.cc:312] APPLY: finished
0709 13:12:19.168041 (+   440us) log.cc:844] Serialized 113 byte log entry
0709 13:12:19.168236 (+   195us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:19.168403 (+   167us) write_op.cc:454] Released schema lock
0709 13:12:19.168475 (+    72us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:19.168904 (+   429us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:19.168937 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":351187,"reported_tablets":31,"child_traces":[["op",{"apply.queue_time_us":307641,"apply.run_cpu_time_us":4308,"apply.run_wall_time_us":4313,"num_ops":16,"prepare.queue_time_us":311673,"prepare.run_cpu_time_us":109421,"prepare.run_wall_time_us":698441,"raft.queue_time_us":799115,"raft.run_cpu_time_us":28517,"raft.run_wall_time_us":276147,"replication_time_us":1435842,"thread_start_us":1537725,"threads_started":4,"wal-append.queue_time_us":559007,"wal-append.run_cpu_time_us":77863,"wal-append.run_wall_time_us":2183216}]]}
I20260709 13:12:24.719453 25270 leader_election.cc:304] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:24.719305 25126 catalog_manager.cc:5697] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 7 to 8, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 8 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:24.721022 29458 raft_consensus.cc:3060] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:24.721208 25270 leader_election.cc:304] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:24.722748 25874 leader_election.cc:304] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:12:24.717689 29644 consensus_queue.cc:260] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:24.734493 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:24.735097 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:24.735399 29644 raft_consensus.cc:3060] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:24.725121 29624 raft_consensus.cc:2749] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:24.723835 29750 raft_consensus.cc:3060] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:24.725574 29638 raft_consensus.cc:2804] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:24.738588 29638 raft_consensus.cc:493] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:24.739005 29638 raft_consensus.cc:3060] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:24.739219 29200 leader_election.cc:290] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:24.740069 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:24.740974 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:24.727552 29691 leader_election.cc:290] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:24.729287 29759 raft_consensus.cc:493] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:24.742487 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:24.708686 29086 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.743225 29086 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:24.745376 29086 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:24.745002 29563 raft_consensus.cc:515] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:24.759244 25900 raft_consensus.cc:1240] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:12:24.730782 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:24.733686 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:24.734432 25906 raft_consensus.cc:1240] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:24.760808 25901 raft_consensus.cc:2468] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 12.
I20260709 13:12:24.734216 29761 raft_consensus.cc:515] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:24.763119 29761 leader_election.cc:290] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:24.746299 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:24.729422 29446 consensus_queue.cc:1048] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:12:24.747516 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:24.742760 29759 raft_consensus.cc:515] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:24.750583 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:24.714699 29752 raft_consensus.cc:2749] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:24.765676 25126 catalog_manager.cc:5697] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
I20260709 13:12:24.766598 29759 leader_election.cc:290] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:24.767168 29707 raft_consensus.cc:515] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:24.767433 25126 catalog_manager.cc:5697] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 4 to 5, leader changed from 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 5 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:12:24.768909 29707 leader_election.cc:290] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:24.768563 29638 raft_consensus.cc:515] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:24.810215 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 108199us
I20260709 13:12:24.771868 29458 raft_consensus.cc:2749] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:24.811441 25195 leader_election.cc:304] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:12:24.812165 29638 leader_election.cc:290] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 12 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:12:24.773818 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 48679.5us
I20260709 13:12:24.772326 29563 leader_election.cc:290] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:24.794482 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:24.813110 25905 raft_consensus.cc:2393] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 12: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:12:24.796437 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:24.813532 25270 leader_election.cc:304] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:12:24.815081 29458 raft_consensus.cc:2804] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:24.815205 25270 leader_election.cc:304] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:24.815899 29458 raft_consensus.cc:697] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 12 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:24.816349 29762 raft_consensus.cc:2749] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:24.817176 29645 raft_consensus.cc:493] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:24.817103 29458 consensus_queue.cc:237] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:24.817938 29645 raft_consensus.cc:515] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:24.795487 25126 catalog_manager.cc:5697] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 4 to 7, leader changed from 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 7 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:24.797509 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:24.769564 29624 raft_consensus.cc:2749] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:24.820142 29645 leader_election.cc:290] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:24.821028 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 110122us
I20260709 13:12:24.821259 25270 leader_election.cc:304] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:24.821708 25345 leader_election.cc:304] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:24.822412 29756 raft_consensus.cc:2749] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:24.824128 25374 pending_rounds.cc:85] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468: Aborting all ops after (but not including) 6
I20260709 13:12:24.824445 25374 pending_rounds.cc:107] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:12:24.824672 25374 raft_consensus.cc:2889] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:24.824959 25370 raft_consensus.cc:1275] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:12:24.824998 25374 pending_rounds.cc:107] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:12:24.825641 25374 raft_consensus.cc:2889] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:24.824223 29761 raft_consensus.cc:2804] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:24.823997 29691 raft_consensus.cc:2749] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:24.821516 25126 catalog_manager.cc:5697] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 3 to 7, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 7 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:24.831535 25874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:24.812392 29734 raft_consensus.cc:2804] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:24.845336 25344 leader_election.cc:304] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:24.843734 25195 leader_election.cc:304] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:12:24.862888 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:24.864765 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:24.867842 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:24.868755 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:24.869021 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:24.870625 25225 raft_consensus.cc:1240] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:12:24.871455 25379 raft_consensus.cc:2393] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 13: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:24.875211 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:24.876334 25221 raft_consensus.cc:1275] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:12:24.868100 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:24.877995 25900 raft_consensus.cc:3060] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:24.879209 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:24.842892 29761 raft_consensus.cc:493] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:24.882270 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:24.862653 29733 raft_consensus.cc:2804] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:24.883618 25902 raft_consensus.cc:2468] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 14.
I20260709 13:12:24.862936 29725 raft_consensus.cc:2804] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:24.894874 29725 raft_consensus.cc:493] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:24.895309 29725 raft_consensus.cc:3060] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:24.895864 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:24.896517 25376 raft_consensus.cc:3060] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:24.896697 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:24.897333 25226 raft_consensus.cc:2376] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 79d99c0e498349bda74127365219e468 in term 11. Re-sending same reply.
I20260709 13:12:24.899904 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:24.900695 25303 raft_consensus.cc:2468] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 10.
I20260709 13:12:24.867254 29750 consensus_queue.cc:1048] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:12:24.902099 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:24.903270 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:24.904019 25305 raft_consensus.cc:2393] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 10: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:24.880209 29691 raft_consensus.cc:493] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:24.904486 29691 raft_consensus.cc:515] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:24.904796 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:24.906407 25379 raft_consensus.cc:1240] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:12:24.892571 25298 raft_consensus.cc:1275] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:12:24.886183 29761 raft_consensus.cc:3060] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:24.850355 29442 consensus_queue.cc:1059] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:12:24.916957 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:24.917667 25298 raft_consensus.cc:3060] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:12:24.901597 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:24.908653 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:24.882058 29734 raft_consensus.cc:697] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 14 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:24.914362 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:24.920743 25344 leader_election.cc:304] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:24.922245 25305 raft_consensus.cc:2468] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 12.
I20260709 13:12:24.937604 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:24.938298 25377 raft_consensus.cc:3060] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:24.938143 29750 raft_consensus.cc:493] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:24.938704 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:24.939004 29750 raft_consensus.cc:515] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:24.940307 25378 raft_consensus.cc:1275] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:12:24.941789 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:24.944237 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:24.862999 29732 consensus_queue.cc:1059] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:12:24.941493 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:24.945287 25379 raft_consensus.cc:3060] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:24.913196 25900 raft_consensus.cc:2468] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 13.
I20260709 13:12:24.953475 25270 leader_election.cc:304] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:24.890966 29733 raft_consensus.cc:493] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:24.957435 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:24.958457 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:24.958276 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:24.964636 25222 raft_consensus.cc:2468] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 12.
I20260709 13:12:25.014204 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:24.994829 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:25.017549 25344 leader_election.cc:304] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:24.957844 29086 raft_consensus.cc:2804] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:24.952732 29645 raft_consensus.cc:493] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:25.026973 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:25.031745 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:25.028473 25224 raft_consensus.cc:2393] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 12: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:24.984444 29758 raft_consensus.cc:493] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.965348 29733 raft_consensus.cc:3060] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:24.984076 29756 raft_consensus.cc:2749] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:25.014647 29377 raft_consensus.cc:3055] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:24.987998 29691 leader_election.cc:290] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:25.058991 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:24.990597 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:25.061021 25296 raft_consensus.cc:2468] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 12.
I20260709 13:12:25.042694 29750 leader_election.cc:290] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:25.073073 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:25.028061 29086 raft_consensus.cc:493] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:24.984683 29200 consensus_queue.cc:1048] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.067s
I20260709 13:12:24.990212 29749 consensus_queue.cc:1059] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.064s
W20260709 13:12:25.078019 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 124666us
I20260709 13:12:24.992354 29586 consensus_queue.cc:1048] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.070s
I20260709 13:12:25.097889 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:25.054082 29377 raft_consensus.cc:740] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:25.109134 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:25.114396 25378 raft_consensus.cc:2468] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 13.
I20260709 13:12:25.062616 29752 raft_consensus.cc:493] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:25.118184 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:25.062914 29644 raft_consensus.cc:493] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:25.128571 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:25.131757 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:25.048221 29645 raft_consensus.cc:515] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:25.091885 29086 raft_consensus.cc:3060] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:12:25.136838 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 119372us
I20260709 13:12:25.014153 29734 consensus_queue.cc:237] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:25.053552 29758 raft_consensus.cc:515] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:25.095356 29763 raft_consensus.cc:2804] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:25.094080 29691 raft_consensus.cc:493] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:25.090778 29750 raft_consensus.cc:493] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:25.140221 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:25.148691 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:25.162228 25378 raft_consensus.cc:2468] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 11.
I20260709 13:12:25.161435 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:25.171042 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:25.171787 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:25.177542 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:25.178308 25303 raft_consensus.cc:3060] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:25.161113 25377 raft_consensus.cc:2468] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 14.
I20260709 13:12:25.181373 25296 raft_consensus.cc:2393] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 11: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:25.181814 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:25.182503 25378 raft_consensus.cc:2468] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 12.
I20260709 13:12:25.173803 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:25.139513 29752 raft_consensus.cc:515] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:25.185107 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:25.189235 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:25.190455 25377 raft_consensus.cc:2468] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 13.
W20260709 13:12:25.196973 25343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:25.202342 25297 raft_consensus.cc:2468] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 14.
I20260709 13:12:25.210695 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:25.211412 25371 raft_consensus.cc:2468] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 9.
I20260709 13:12:25.212301 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:25.212875 25371 raft_consensus.cc:2468] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 12.
I20260709 13:12:25.154227 29644 raft_consensus.cc:515] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:25.213729 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:12:25.219103 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:25.167713 29750 raft_consensus.cc:515] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:25.242071 25371 raft_consensus.cc:2393] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 11: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:25.168342 29691 raft_consensus.cc:515] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:25.241218 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:25.256019 29691 leader_election.cc:290] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:25.257150 25378 raft_consensus.cc:2468] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 6.
I20260709 13:12:25.214228 29658 raft_consensus.cc:3055] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:25.258580 29658 raft_consensus.cc:740] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:25.258739 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:25.259187 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:25.259356 25371 raft_consensus.cc:2468] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 11.
I20260709 13:12:25.259428 29658 consensus_queue.cc:260] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:25.260401 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:25.260474 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:25.260746 29658 raft_consensus.cc:3060] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:25.183836 29759 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.261641 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:25.262092 29759 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:25.262315 25371 raft_consensus.cc:2468] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 9.
I20260709 13:12:25.264093 29759 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:25.263921 25371 raft_consensus.cc:1275] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:12:25.266954 29752 leader_election.cc:290] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:25.279475 25376 raft_consensus.cc:2468] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 13.
I20260709 13:12:25.286228 25371 raft_consensus.cc:1275] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:12:25.287760 25270 leader_election.cc:304] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:25.287191 25379 raft_consensus.cc:2468] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 11.
I20260709 13:12:25.287428 25303 raft_consensus.cc:2468] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 12.
I20260709 13:12:25.290289 25376 raft_consensus.cc:1275] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:12:25.290609 25298 raft_consensus.cc:2468] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 12.
W20260709 13:12:25.293797 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 51017.9us
I20260709 13:12:25.295233 25195 leader_election.cc:304] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:25.296995 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:25.293500 25375 raft_consensus.cc:2468] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 11.
I20260709 13:12:25.303975 25305 raft_consensus.cc:1240] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 8. Current term is 9. Ops: [7.6-8.7]
I20260709 13:12:25.304682 25372 raft_consensus.cc:1240] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 12. Current term is 13. Ops: [12.6-12.6]
W20260709 13:12:25.311098 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 93475.5us
I20260709 13:12:25.177627 29377 consensus_queue.cc:260] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:25.318384 29775 log.cc:927] Time spent T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 13:12:25.318603 29377 raft_consensus.cc:3060] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:25.319875 29662 consensus_queue.cc:1175] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "79d99c0e498349bda74127365219e468" responder_term: 10 status { last_received { term: 8 index: 7 } last_committed_idx: 7 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:12:25.334317 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:25.300596 29756 raft_consensus.cc:2749] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:25.336490 25270 leader_election.cc:304] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:25.292265 29763 raft_consensus.cc:697] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 13 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
W20260709 13:12:25.344619 25195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:25.344106 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:12:25.346329 25195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:25.353248 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:25.367381 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:25.370683 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:25.372758 29789 raft_consensus.cc:2749] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:25.354024 29624 raft_consensus.cc:2749] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:25.377904 29763 consensus_queue.cc:237] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:25.378122 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:25.372805 25195 leader_election.cc:304] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:25.383982 29789 raft_consensus.cc:2804] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:25.384487 29789 raft_consensus.cc:493] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:25.384861 29789 raft_consensus.cc:3060] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:25.386112 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:25.386914 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:25.389492 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:25.389689 25195 leader_election.cc:304] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:25.390242 25303 raft_consensus.cc:2468] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 13.
I20260709 13:12:25.392158 25301 raft_consensus.cc:2468] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 12.
I20260709 13:12:25.390820 25195 leader_election.cc:304] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
W20260709 13:12:25.395051 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 58620.1us
I20260709 13:12:25.393369 29758 leader_election.cc:290] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:12:25.380641 29780 log.cc:927] Time spent T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:12:25.397218 29442 raft_consensus.cc:2804] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:25.397675 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:25.380215 29544 consensus_queue.cc:1059] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:12:25.398802 25343 leader_election.cc:304] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:25.399734 25296 raft_consensus.cc:2468] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 10.
I20260709 13:12:25.400507 25194 leader_election.cc:304] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:25.402827 25873 leader_election.cc:304] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:25.406188 25194 leader_election.cc:304] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:25.409576 25345 leader_election.cc:304] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:25.402774 25343 leader_election.cc:304] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:25.411332 25270 leader_election.cc:304] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
W20260709 13:12:25.396649 29779 log.cc:927] Time spent T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:12:25.418794 25343 leader_election.cc:304] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:12:25.405720 29783 log.cc:927] Time spent T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:12:25.401592 29784 log.cc:927] Time spent T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:12:25.410121 25195 leader_election.cc:304] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:25.431399 29798 raft_consensus.cc:493] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.431630 25194 leader_election.cc:304] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:25.432750 25343 leader_election.cc:304] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:25.402220 29658 raft_consensus.cc:2804] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:25.380074 29761 raft_consensus.cc:515] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:25.440372 25345 leader_election.cc:304] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:25.441100 29645 leader_election.cc:290] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:25.441609 29752 raft_consensus.cc:2804] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:25.442132 29752 raft_consensus.cc:697] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 11 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:25.442169 25345 leader_election.cc:304] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:25.443128 29752 consensus_queue.cc:237] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:25.399148 29442 raft_consensus.cc:493] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:25.467144 29545 consensus_queue.cc:1048] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:12:25.398217 29725 raft_consensus.cc:515] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:25.418174 29758 raft_consensus.cc:2749] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:12:25.480985 25874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:25.436883 29544 raft_consensus.cc:2804] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:25.444155 29663 raft_consensus.cc:3055] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:25.420176 29787 raft_consensus.cc:2804] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:25.437469 29759 raft_consensus.cc:2804] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:25.470161 29442 raft_consensus.cc:3060] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:25.446151 29707 raft_consensus.cc:2749] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:25.469303 29764 raft_consensus.cc:2749] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:25.465689 29785 raft_consensus.cc:2749] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:12:25.498886 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 88838.5us
I20260709 13:12:25.503319 25373 raft_consensus.cc:1240] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:25.506036 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:12:25.495074 29779 log.cc:927] Time spent T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:12:25.492008 29788 raft_consensus.cc:2749] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:25.450618 29750 leader_election.cc:290] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:25.510529 25225 raft_consensus.cc:1275] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:12:25.509894 25195 leader_election.cc:304] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:25.493711 29663 raft_consensus.cc:740] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
W20260709 13:12:25.515328 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 104088us
I20260709 13:12:25.516004 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:25.439284 29658 raft_consensus.cc:493] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:25.497648 29795 raft_consensus.cc:2804] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:25.501366 29759 raft_consensus.cc:493] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:25.497694 29787 raft_consensus.cc:493] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:25.502069 29544 raft_consensus.cc:697] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
W20260709 13:12:25.524061 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 92515.2us
I20260709 13:12:25.466269 29798 raft_consensus.cc:515] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:25.495293 29086 raft_consensus.cc:515] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:25.523440 29759 raft_consensus.cc:3060] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:25.501736 29733 raft_consensus.cc:515] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:25.531754 29787 raft_consensus.cc:3060] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:25.520834 29658 raft_consensus.cc:3060] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:25.543783 25270 leader_election.cc:304] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:12:25.522964 29795 raft_consensus.cc:493] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:25.551225 25223 raft_consensus.cc:1275] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:12:25.525296 29644 leader_election.cc:290] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:25.552294 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 119627us
W20260709 13:12:25.553087 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 60446.2us
W20260709 13:12:25.534691 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 53061.7us
I20260709 13:12:25.511768 29789 raft_consensus.cc:515] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:25.581780 25343 leader_election.cc:304] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
W20260709 13:12:25.561988 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 52279.7us
W20260709 13:12:25.585238 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 46548.9us
I20260709 13:12:25.584192 25195 leader_election.cc:304] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:25.584693 25228 raft_consensus.cc:2468] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 12.
W20260709 13:12:25.595065 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 61029.3us
I20260709 13:12:25.593693 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:25.596467 25270 leader_election.cc:304] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:25.551748 29795 raft_consensus.cc:3060] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:25.598603 25194 leader_election.cc:304] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:25.584399 29764 raft_consensus.cc:493] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.584312 29801 raft_consensus.cc:2764] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:12:25.597256 29803 raft_consensus.cc:2804] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:12:25.602222 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 158395us
I20260709 13:12:25.602499 29544 consensus_queue.cc:237] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:25.595546 29663 consensus_queue.cc:260] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:25.608858 29663 raft_consensus.cc:3060] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:25.610893 29798 leader_election.cc:290] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:25.611573 29788 raft_consensus.cc:493] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.611785 25345 leader_election.cc:304] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:25.612079 29788 raft_consensus.cc:515] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:25.613404 25345 leader_election.cc:304] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:25.606125 29624 raft_consensus.cc:2749] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:25.614197 29752 raft_consensus.cc:2749] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:25.618899 29789 leader_election.cc:290] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:25.619138 25345 leader_election.cc:304] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:25.620229 25345 leader_election.cc:304] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:25.622675 29624 raft_consensus.cc:493] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.636525 29797 raft_consensus.cc:2749] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:25.621333 29803 raft_consensus.cc:493] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
W20260709 13:12:25.663786 29771 log.cc:927] Time spent T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.477s	user 0.005s	sys 0.000s
I20260709 13:12:25.664017 29803 raft_consensus.cc:3060] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:25.636750 29624 raft_consensus.cc:515] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:25.610927 29764 raft_consensus.cc:515] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:25.650619 29796 log.cc:927] Time spent T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:12:25.646605 29789 raft_consensus.cc:2749] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:25.658413 29725 leader_election.cc:290] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:25.659786 29758 raft_consensus.cc:2749] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:25.639736 29798 raft_consensus.cc:2749] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:25.647042 29804 raft_consensus.cc:2749] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:25.661854 29587 raft_consensus.cc:3055] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:12:25.632412 29752 raft_consensus.cc:2749] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:25.662429 29809 consensus_queue.cc:1048] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:12:25.643100 29807 raft_consensus.cc:2804] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:25.688741 29807 raft_consensus.cc:697] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 12 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:25.672809 29750 raft_consensus.cc:2749] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:25.662765 29086 leader_election.cc:290] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:25.663375 29788 leader_election.cc:290] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:12:25.668318 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 247514us
I20260709 13:12:25.663831 25270 leader_election.cc:304] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:25.682288 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:25.683017 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:25.700815 25908 raft_consensus.cc:3060] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:12:25.701485 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 117436us
I20260709 13:12:25.702675 25195 leader_election.cc:304] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:25.667488 29624 leader_election.cc:290] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:25.686383 29587 raft_consensus.cc:740] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:25.687474 29808 raft_consensus.cc:2804] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:25.684793 29733 leader_election.cc:290] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:25.704371 25873 leader_election.cc:304] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:25.711695 29765 raft_consensus.cc:2804] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:25.713445 29764 leader_election.cc:290] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:25.689693 29807 consensus_queue.cc:237] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:25.705400 29808 raft_consensus.cc:493] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:25.717099 29808 raft_consensus.cc:3060] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:25.717272 25906 raft_consensus.cc:2468] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 11.
I20260709 13:12:25.705117 29458 raft_consensus.cc:2749] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:25.720000 25344 leader_election.cc:304] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:25.720929 29086 raft_consensus.cc:2804] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:25.721441 29086 raft_consensus.cc:697] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 11 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:25.722397 29086 consensus_queue.cc:237] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:25.729206 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 88750.1us
I20260709 13:12:25.731138 25908 raft_consensus.cc:2468] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 15.
I20260709 13:12:25.731910 25195 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:25.732338 25344 leader_election.cc:304] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
W20260709 13:12:25.731720 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 133198us
I20260709 13:12:25.740902 25195 leader_election.cc:304] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:25.742379 25194 leader_election.cc:304] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:25.729719 29765 raft_consensus.cc:697] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:25.746791 25194 leader_election.cc:304] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:25.731948 29733 raft_consensus.cc:2804] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:25.747171 29798 raft_consensus.cc:2804] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:25.754784 29798 raft_consensus.cc:493] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:25.754539 29377 consensus_queue.cc:1048] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:25.755252 29798 raft_consensus.cc:3060] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:25.744459 29763 raft_consensus.cc:2804] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:25.753096 25194 leader_election.cc:304] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:25.757452 25195 leader_election.cc:304] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:25.751657 29733 raft_consensus.cc:493] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:25.760217 29797 consensus_queue.cc:1048] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:25.801853 29733 raft_consensus.cc:3060] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:25.805431 29662 raft_consensus.cc:2804] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:25.805912 29662 raft_consensus.cc:493] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:25.806300 29662 raft_consensus.cc:3060] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:25.760776 29442 raft_consensus.cc:515] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:25.810205 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 52881.2us
I20260709 13:12:25.756518 29809 consensus_queue.cc:1048] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:12:25.811733 29442 leader_election.cc:290] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:25.774637 29759 raft_consensus.cc:515] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:25.813654 29759 leader_election.cc:290] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:25.750173 29789 raft_consensus.cc:3060] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:25.766263 29810 log.cc:927] Time spent T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:12:25.815487 25230 raft_consensus.cc:1240] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:25.817986 29734 raft_consensus.cc:2749] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:25.777330 25271 leader_election.cc:304] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:25.819128 29734 consensus_queue.cc:1059] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:25.820165 29377 raft_consensus.cc:3055] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:25.820551 29377 raft_consensus.cc:740] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:25.820840 29764 raft_consensus.cc:2749] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:25.821928 29458 consensus_queue.cc:1048] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:25.823406 25302 raft_consensus.cc:1275] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:12:25.777741 29658 raft_consensus.cc:515] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:25.825274 29761 leader_election.cc:290] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:25.849897 29816 raft_consensus.cc:2749] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:25.796641 29765 consensus_queue.cc:237] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:25.799196 29763 raft_consensus.cc:697] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 15 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:25.805130 29787 raft_consensus.cc:515] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:25.826620 29658 leader_election.cc:290] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:25.827087 25221 raft_consensus.cc:1240] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:25.749445 29804 raft_consensus.cc:2749] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:25.828779 29733 raft_consensus.cc:515] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:25.821349 29377 consensus_queue.cc:260] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:12:25.833948 29809 raft_consensus.cc:493] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
W20260709 13:12:25.856451 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 236274us
W20260709 13:12:25.836542 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 99472.3us
I20260709 13:12:25.841528 25228 raft_consensus.cc:1240] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:25.843648 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:25.859675 25902 raft_consensus.cc:2368] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 12. Current term is 13.
I20260709 13:12:25.844858 25304 raft_consensus.cc:1275] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:12:25.860417 29377 raft_consensus.cc:3060] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:25.845299 29644 raft_consensus.cc:493] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:25.861169 29644 raft_consensus.cc:515] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:25.856916 29624 consensus_queue.cc:1059] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:12:25.852744 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:25.852283 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:25.858103 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:25.858333 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:25.858107 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:25.834542 29587 consensus_queue.cc:260] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:25.865310 25300 raft_consensus.cc:2393] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 11: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:25.858893 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:25.859537 25270 leader_election.cc:304] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:12:25.844036 25874 leader_election.cc:304] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:25.781162 25194 leader_election.cc:304] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:25.862332 25225 raft_consensus.cc:1240] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:12:25.866284 25301 raft_consensus.cc:2393] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 10: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:25.864778 25303 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 10.
W20260709 13:12:25.866830 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 85792us
I20260709 13:12:25.870558 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:25.871277 25379 raft_consensus.cc:3060] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:25.872691 25194 leader_election.cc:304] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:25.875171 25378 raft_consensus.cc:1240] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:12:25.875174 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:25.877121 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:25.878286 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:25.878568 25194 leader_election.cc:304] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:25.877957 25371 raft_consensus.cc:2468] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 12.
I20260709 13:12:25.886713 25374 raft_consensus.cc:1275] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 13:12:25.880385 25343 leader_election.cc:304] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:25.887183 25374 pending_rounds.cc:85] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468: Aborting all ops after (but not including) 6
I20260709 13:12:25.887403 25374 pending_rounds.cc:107] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 13:12:25.887539 25374 raft_consensus.cc:2889] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:25.890213 25343 leader_election.cc:304] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:25.888510 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
W20260709 13:12:25.892575 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 48672.2us
I20260709 13:12:25.892715 25375 raft_consensus.cc:3060] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:25.894667 25343 leader_election.cc:304] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:25.899498 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:25.900120 25299 raft_consensus.cc:3060] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:25.871927 29734 raft_consensus.cc:2749] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:25.903338 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:25.904310 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:25.904853 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:25.863682 29458 consensus_queue.cc:1048] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:12:25.906278 25226 raft_consensus.cc:2468] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 12.
I20260709 13:12:25.910871 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:25.892896 29762 raft_consensus.cc:2804] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:25.891978 29804 raft_consensus.cc:2804] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:25.914382 25379 raft_consensus.cc:2468] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 13.
I20260709 13:12:25.897356 29442 raft_consensus.cc:2804] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:25.911516 25903 raft_consensus.cc:2468] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 11.
I20260709 13:12:25.900018 29587 raft_consensus.cc:3060] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:25.876847 29658 consensus_queue.cc:1048] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:12:25.901544 29544 raft_consensus.cc:2749] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:25.905032 29761 raft_consensus.cc:2804] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:25.931260 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:12:25.938133 29777 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.017s	sys 0.077s
W20260709 13:12:25.938563 29777 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.017s	sys 0.078s
I20260709 13:12:25.911940 29798 raft_consensus.cc:515] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:25.944238 29798 leader_election.cc:290] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:25.948398 29789 raft_consensus.cc:2749] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:25.946599 29803 raft_consensus.cc:515] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:25.914322 29732 raft_consensus.cc:493] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.914927 29762 raft_consensus.cc:493] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:25.878751 29809 raft_consensus.cc:515] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:25.877717 29795 raft_consensus.cc:515] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:25.921545 29750 raft_consensus.cc:493] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.958206 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:25.916273 29804 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
W20260709 13:12:25.974880 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 76690.7us
I20260709 13:12:25.976264 29832 consensus_queue.cc:1059] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:25.968304 29732 raft_consensus.cc:515] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:26.005638 29823 raft_consensus.cc:2804] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:25.936146 29761 raft_consensus.cc:493] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:25.903311 29763 consensus_queue.cc:237] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:26.016116 29662 raft_consensus.cc:515] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:26.018100 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 113981us
W20260709 13:12:26.010039 29821 log.cc:927] Time spent T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.118s	user 0.000s	sys 0.004s
I20260709 13:12:26.015491 29787 leader_election.cc:290] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:12:26.014129 29824 log.cc:927] Time spent T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:12:26.012814 29804 raft_consensus.cc:3060] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:25.959215 29691 raft_consensus.cc:2804] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:12:26.059701 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 153097us
I20260709 13:12:25.968024 29762 raft_consensus.cc:3060] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:26.086500 25224 raft_consensus.cc:2393] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 13: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:26.053658 25226 raft_consensus.cc:1240] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:25.934317 29442 raft_consensus.cc:697] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 12 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:26.014642 29764 raft_consensus.cc:3055] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:26.069871 29803 leader_election.cc:290] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:26.095391 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:26.046533 29750 raft_consensus.cc:515] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:26.159183 25370 raft_consensus.cc:2393] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 13: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:26.095783 25299 raft_consensus.cc:2468] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 13.
I20260709 13:12:25.958354 29797 consensus_queue.cc:1048] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.118s
I20260709 13:12:26.160740 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:26.161787 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:26.162631 25226 raft_consensus.cc:2468] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 12.
I20260709 13:12:26.138859 25375 raft_consensus.cc:2468] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 14.
I20260709 13:12:26.123407 29761 raft_consensus.cc:3060] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:26.084578 29756 raft_consensus.cc:493] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
W20260709 13:12:26.114975 29776 log.cc:927] Time spent T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 13:12:26.095067 29788 raft_consensus.cc:493] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.142940 25195 leader_election.cc:400] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 election: Vote denied by peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085) with higher term. Message: Invalid argument: T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 12. Current term is 13.
I20260709 13:12:26.147024 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:26.111809 29733 leader_election.cc:290] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:26.116515 29795 leader_election.cc:290] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:26.153431 25227 raft_consensus.cc:1240] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:26.111147 29809 leader_election.cc:290] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:26.151214 29691 raft_consensus.cc:493] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:26.163779 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:26.213330 25221 raft_consensus.cc:2393] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 14: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:26.195125 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:26.197073 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:26.200364 25374 raft_consensus.cc:1240] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:26.197264 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:26.167701 29644 leader_election.cc:290] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:26.203843 25195 leader_election.cc:403] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:12:26.115800 29808 raft_consensus.cc:515] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:26.218489 25225 raft_consensus.cc:2393] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 13: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:26.205739 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:26.157226 29764 raft_consensus.cc:740] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:26.203187 25370 raft_consensus.cc:1275] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:12:26.209954 29756 raft_consensus.cc:515] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:26.211124 29790 log.cc:927] Time spent T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.052s	user 0.000s	sys 0.005s
I20260709 13:12:26.225039 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:12:26.225809 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 89055.4us
I20260709 13:12:26.231633 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:26.234493 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:26.235514 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:26.237107 25195 leader_election.cc:304] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:26.238149 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:26.239993 25195 leader_election.cc:304] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:26.216145 29691 raft_consensus.cc:3060] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:26.242110 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:26.242201 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:26.246052 25378 raft_consensus.cc:1240] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:26.246732 29733 raft_consensus.cc:2804] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:26.246937 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:26.247193 29733 raft_consensus.cc:493] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:26.247613 29733 raft_consensus.cc:3060] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:26.243851 29442 consensus_queue.cc:237] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:26.250186 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:26.224541 29624 raft_consensus.cc:493] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.231091 29795 raft_consensus.cc:3060] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:26.254050 29624 raft_consensus.cc:515] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:26.256114 29624 leader_election.cc:290] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:26.256618 29624 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.256417 29733 raft_consensus.cc:515] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:26.257057 29624 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:26.250342 29732 leader_election.cc:290] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:26.258013 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:26.258948 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:26.245151 25222 raft_consensus.cc:2468] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 11.
I20260709 13:12:26.244443 29734 raft_consensus.cc:2749] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:12:26.267027 25377 raft_consensus.cc:2393] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 13: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:26.269838 25226 raft_consensus.cc:2468] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 10.
I20260709 13:12:26.210947 29788 raft_consensus.cc:515] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:26.259112 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:26.275417 25228 raft_consensus.cc:1240] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:26.275650 25195 leader_election.cc:304] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:26.279973 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:26.238042 29749 raft_consensus.cc:493] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:26.280767 25373 raft_consensus.cc:2393] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 14: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:12:26.238081 29823 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:26.283808 25195 leader_election.cc:304] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:26.285254 25345 leader_election.cc:304] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:26.289539 25345 leader_election.cc:304] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:26.293704 25345 leader_election.cc:304] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:26.310427 25195 leader_election.cc:304] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:26.289985 29823 raft_consensus.cc:3060] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:26.289503 29809 raft_consensus.cc:2804] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:26.298449 29787 raft_consensus.cc:2804] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:26.327551 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:26.338136 25305 raft_consensus.cc:3060] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:26.328362 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
W20260709 13:12:26.329718 25873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:26.331897 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:26.319633 25195 leader_election.cc:304] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:26.338857 25298 raft_consensus.cc:3060] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:12:26.339459 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 185500us
I20260709 13:12:26.341372 25228 raft_consensus.cc:1240] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:26.341961 25226 raft_consensus.cc:1240] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:26.342466 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:26.342984 25221 raft_consensus.cc:1240] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:26.343163 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:26.343888 25222 raft_consensus.cc:1240] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:26.344940 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:26.299594 29811 raft_consensus.cc:2749] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:26.298266 29377 raft_consensus.cc:2804] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:26.343055 25225 raft_consensus.cc:2468] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 10.
I20260709 13:12:26.337271 25345 leader_election.cc:304] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:26.337373 25343 leader_election.cc:304] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:26.345413 25300 raft_consensus.cc:1275] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:12:26.345487 25304 raft_consensus.cc:3060] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:26.347388 25299 raft_consensus.cc:1240] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 11. Current term is 12. Ops: [8.8-11.9]
I20260709 13:12:26.281504 29801 consensus_queue.cc:1059] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:12:26.356812 25345 leader_election.cc:304] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:26.358294 25345 leader_election.cc:304] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:26.346105 29377 raft_consensus.cc:493] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:26.367568 25296 raft_consensus.cc:1275] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:12:26.368227 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:26.368932 25302 raft_consensus.cc:3060] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:26.324208 29803 raft_consensus.cc:2804] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:26.289331 29749 raft_consensus.cc:515] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:26.374912 25271 leader_election.cc:304] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:26.375276 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:26.375447 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:26.384590 25298 raft_consensus.cc:2468] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 13.
I20260709 13:12:26.373845 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:26.386132 25903 raft_consensus.cc:1240] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:26.335352 29086 raft_consensus.cc:3060] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:26.398341 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:26.404975 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:26.405743 25300 raft_consensus.cc:2468] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 10.
I20260709 13:12:26.333523 29809 raft_consensus.cc:493] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:26.349704 29787 raft_consensus.cc:493] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:26.407429 29809 raft_consensus.cc:3060] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:26.407740 29787 raft_consensus.cc:3060] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:26.406939 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:26.372406 29733 leader_election.cc:290] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:26.424182 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:26.424481 29843 consensus_queue.cc:1059] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:12:26.425697 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:26.426857 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:26.351287 29822 raft_consensus.cc:493] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.428153 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
W20260709 13:12:26.426806 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 107272us
I20260709 13:12:26.357856 29545 raft_consensus.cc:493] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.432562 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:26.287482 29764 consensus_queue.cc:260] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:26.372233 29377 raft_consensus.cc:3060] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:26.433210 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:26.323819 29831 consensus_queue.cc:1048] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.271s
I20260709 13:12:26.371376 29811 raft_consensus.cc:2749] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:26.316843 29834 consensus_queue.cc:1059] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.142s
I20260709 13:12:26.367769 29802 raft_consensus.cc:2749] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:26.441294 25304 raft_consensus.cc:2468] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 13.
I20260709 13:12:26.442580 25299 raft_consensus.cc:3060] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:26.346746 29662 leader_election.cc:290] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:26.445717 25297 raft_consensus.cc:2393] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 12: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:26.426312 25296 raft_consensus.cc:3060] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:26.386379 29759 raft_consensus.cc:2749] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:26.447431 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:26.454744 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:26.439849 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
W20260709 13:12:26.463204 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 88259us
I20260709 13:12:26.437994 29797 raft_consensus.cc:2804] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:26.387360 29644 raft_consensus.cc:493] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:26.434744 29803 raft_consensus.cc:697] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 13 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:26.560235 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:26.429226 29832 consensus_queue.cc:1059] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
W20260709 13:12:26.511580 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 136151us
W20260709 13:12:26.565549 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 228221us
W20260709 13:12:26.573666 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 215440us
I20260709 13:12:26.460768 29750 leader_election.cc:290] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:26.583011 25270 leader_election.cc:304] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:26.558763 29764 raft_consensus.cc:3060] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:26.602559 25194 leader_election.cc:304] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:26.461423 29785 raft_consensus.cc:2749] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:26.440439 29822 raft_consensus.cc:515] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:26.424285 29848 consensus_queue.cc:1059] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.140s
I20260709 13:12:26.613121 25345 leader_election.cc:304] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:26.450363 29545 raft_consensus.cc:515] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:26.618929 25297 raft_consensus.cc:1240] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 12. Current term is 13. Ops: [10.8-12.9]
I20260709 13:12:26.589774 29834 raft_consensus.cc:493] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.599931 29808 leader_election.cc:290] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:26.600457 29756 leader_election.cc:290] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:26.657848 29759 raft_consensus.cc:493] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:26.658541 29759 raft_consensus.cc:515] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:26.660882 29759 leader_election.cc:290] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:26.678714 25302 raft_consensus.cc:2468] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 14.
I20260709 13:12:26.603678 29797 raft_consensus.cc:697] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 14 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
W20260709 13:12:26.620137 29839 log.cc:927] Time spent T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.287s	user 0.000s	sys 0.000s
I20260709 13:12:26.622653 29662 raft_consensus.cc:2749] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:26.640316 29802 raft_consensus.cc:2804] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:12:26.642123 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 56776.8us
I20260709 13:12:26.574013 29644 raft_consensus.cc:515] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:26.709647 29854 raft_consensus.cc:3055] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:12:26.710146 29847 log.cc:927] Time spent T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 13:12:26.710323 29854 raft_consensus.cc:740] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
W20260709 13:12:26.710826 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:26.711424 29840 consensus_queue.cc:1059] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.259s
I20260709 13:12:26.711627 29854 consensus_queue.cc:260] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:26.712206 29826 raft_consensus.cc:2804] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:26.712715 29826 raft_consensus.cc:493] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:26.713089 29826 raft_consensus.cc:3060] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:26.713732 29848 raft_consensus.cc:3055] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:26.714262 29848 raft_consensus.cc:740] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:26.715271 29848 consensus_queue.cc:260] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:26.716658 29848 raft_consensus.cc:3060] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:26.700677 25299 raft_consensus.cc:2410] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:12:26.710291 29829 consensus_queue.cc:1048] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.207s
I20260709 13:12:26.703673 25343 leader_election.cc:304] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:12:26.683571 29834 raft_consensus.cc:515] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:26.732172 29749 leader_election.cc:290] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:26.732393 29840 raft_consensus.cc:3055] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:26.664623 29832 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:26.736075 29850 raft_consensus.cc:493] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:26.737643 29804 consensus_meta.cc:287] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 0.582s	user 0.006s	sys 0.002s
I20260709 13:12:26.741911 29803 consensus_queue.cc:237] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:26.708838 29802 raft_consensus.cc:493] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
W20260709 13:12:26.743863 29827 log.cc:927] Time spent T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.776s	user 0.003s	sys 0.000s
I20260709 13:12:26.684330 29852 raft_consensus.cc:493] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
W20260709 13:12:26.751240 29842 log.cc:927] Time spent T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260709 13:12:26.752276 29797 consensus_queue.cc:237] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:26.753489 29833 log.cc:927] Time spent T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.550s	user 0.000s	sys 0.005s
I20260709 13:12:26.690941 29788 leader_election.cc:290] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:26.741212 29787 raft_consensus.cc:515] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:26.685710 29812 consensus_queue.cc:1059] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.381s
W20260709 13:12:26.754154 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 50579us
I20260709 13:12:26.764170 25305 raft_consensus.cc:2468] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 13.
I20260709 13:12:26.689980 29624 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:26.780010 29804 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:26.765236 29762 consensus_meta.cc:287] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.605s	user 0.010s	sys 0.000s
W20260709 13:12:26.826818 29761 consensus_meta.cc:287] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.624s	user 0.011s	sys 0.000s
I20260709 13:12:26.749466 29809 raft_consensus.cc:515] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:26.733470 29822 leader_election.cc:290] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:26.767484 29840 raft_consensus.cc:740] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:26.892135 29798 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.872193 29785 consensus_queue.cc:1048] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:26.767454 29750 raft_consensus.cc:2804] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:26.830551 29802 raft_consensus.cc:3060] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:26.827778 29759 raft_consensus.cc:493] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:26.983824 25230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 2269) took 1134 ms. Trace:
W20260709 13:12:26.983074 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:26.996640 25372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36264 (request call id 1964) took 1131 ms. Trace:
W20260709 13:12:26.997849 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 415032us
I20260709 13:12:26.994283 25296 raft_consensus.cc:2468] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 12.
I20260709 13:12:27.079701 25345 leader_election.cc:304] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:27.118717 25872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:27.118578 25374 raft_consensus.cc:1240] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:26.997586 25373 raft_consensus.cc:1240] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:27.107424 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:12:27.106662 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:27.099216 25376 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.886s	user 0.003s	sys 0.016s
W20260709 13:12:26.876708 29795 consensus_meta.cc:287] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 0.622s	user 0.007s	sys 0.003s
I20260709 13:12:27.080080 25270 leader_election.cc:304] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
W20260709 13:12:27.126394 25376 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.913s	user 0.006s	sys 0.017s
I20260709 13:12:27.124284 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:27.127363 25375 raft_consensus.cc:2468] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 10.
I20260709 13:12:27.070235 25372 rpcz_store.cc:276] 0709 13:12:25.865568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:25.870220 (+  4652us) service_pool.cc:224] Handling call
0709 13:12:25.875152 (+  4932us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:25.889415 (+ 14263us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:25.889461 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:25.899855 (+ 10394us) log.cc:844] Serialized 26 byte log entry
0709 13:12:25.966501 (+ 66646us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:25.966565 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:25.966665 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:26.743117 (+776452us) spinlock_profiling.cc:243] Waited 64.6 ms on lock 0x7b4400022b4c. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72caa8c85 00007fd72caa96a2 00007fd72f81b1db 00007fd72f816aaf 00007fd72f80a86e 00007fd72f809bb6 00007fd72f8097d8 00007fd72f813221 00007fd72f8131d9 00007fd72f813169
0709 13:12:26.996323 (+253206us) raft_consensus.cc:1685] finished
0709 13:12:26.996347 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:26.996559 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26730,"raft.queue_time_us":14430,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":7297,"spinlock_wait_cycles":148550400,"thread_start_us":32167,"threads_started":1,"wal-append.queue_time_us":49665}
W20260709 13:12:27.098863 25379 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.822s	user 0.005s	sys 0.027s
W20260709 13:12:27.133117 25379 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.875s	user 0.007s	sys 0.027s
I20260709 13:12:27.065773 25230 rpcz_store.cc:276] 0709 13:12:25.848963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:25.849821 (+   858us) service_pool.cc:224] Handling call
0709 13:12:25.850165 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:25.850503 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:12:26.154662 (+304159us) log.cc:844] Serialized 14 byte log entry
0709 13:12:26.282843 (+128181us) log.cc:844] Serialized 14 byte log entry
0709 13:12:26.283005 (+   162us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:26.321936 (+ 38931us) log.cc:844] Serialized 26 byte log entry
0709 13:12:26.322126 (+   190us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:26.322176 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:26.322263 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:26.983470 (+661207us) raft_consensus.cc:1685] finished
0709 13:12:26.983512 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:26.983734 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14455,"prepare.queue_time_us":365266,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":65,"raft.queue_time_us":5388,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":17672,"spinlock_wait_cycles":12984064,"thread_start_us":382179,"threads_started":2,"wal-append.queue_time_us":261284}
I20260709 13:12:27.103178 25343 leader_election.cc:304] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:12:27.134945 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 54966.7us
I20260709 13:12:27.137935 25225 raft_consensus.cc:1240] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 11. Current term is 12. Ops: []
W20260709 13:12:27.132804 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 54470.2us
I20260709 13:12:26.864185 29624 raft_consensus.cc:493] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.998028 29854 raft_consensus.cc:3060] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:27.136220 29795 raft_consensus.cc:2749] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085) with higher term. Message: Invalid argument: T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 12. Current term is 13.
W20260709 13:12:27.130052 29691 consensus_meta.cc:287] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.851s	user 0.007s	sys 0.010s
I20260709 13:12:26.993084 29809 leader_election.cc:290] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:27.148973 25222 raft_consensus.cc:1240] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 6. Current term is 7. Ops: []
W20260709 13:12:27.152809 25874 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.009s	sys 0.026s
I20260709 13:12:26.995599 29804 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:26.834300 29832 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:27.176306 29859 raft_consensus.cc:493] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:27.177131 29832 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:27.177174 29859 raft_consensus.cc:515] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:27.151841 29822 raft_consensus.cc:2804] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:27.180683 29859 leader_election.cc:290] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:27.118335 29764 raft_consensus.cc:493] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:27.166108 29826 raft_consensus.cc:515] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:27.184674 29826 leader_election.cc:290] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:26.937220 29855 consensus_queue.cc:1048] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.221s
I20260709 13:12:26.985607 29644 leader_election.cc:290] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:27.163527 25874 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.725s	user 0.009s	sys 0.026s
W20260709 13:12:27.159508 29843 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.734s	user 0.012s	sys 0.029s
I20260709 13:12:27.129732 29645 raft_consensus.cc:493] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:26.834578 29850 raft_consensus.cc:515] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:26.855917 29852 raft_consensus.cc:515] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:26.894009 29761 raft_consensus.cc:515] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:27.169915 29853 raft_consensus.cc:2804] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:27.161692 29691 raft_consensus.cc:515] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:27.229624 29853 raft_consensus.cc:697] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 10 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:27.230708 29853 consensus_queue.cc:237] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:27.181816 29764 raft_consensus.cc:515] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:27.063558 29844 raft_consensus.cc:2749] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:27.055753 29545 leader_election.cc:290] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:26.874521 29762 raft_consensus.cc:515] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:27.123406 29798 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:27.220002 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 781595us
W20260709 13:12:27.173735 29377 consensus_meta.cc:287] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 0.715s	user 0.008s	sys 0.000s
I20260709 13:12:27.136726 29750 raft_consensus.cc:697] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 13 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:27.295401 29798 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:27.296522 25223 raft_consensus.cc:2410] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:12:27.295604 29750 consensus_queue.cc:237] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:27.298802 29761 leader_election.cc:290] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:27.132572 29759 raft_consensus.cc:515] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:27.174193 29862 raft_consensus.cc:2749] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:27.231264 29691 leader_election.cc:290] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:27.220784 29843 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.795s	user 0.012s	sys 0.029s
I20260709 13:12:27.158996 29788 consensus_queue.cc:1059] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
W20260709 13:12:27.236941 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 74605.7us
I20260709 13:12:27.159652 29624 raft_consensus.cc:515] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:27.250895 25370 raft_consensus.cc:1240] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:26.986159 29840 consensus_queue.cc:260] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:27.307898 25298 raft_consensus.cc:1240] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 11. Current term is 12. Ops: []
W20260709 13:12:27.234090 29086 consensus_meta.cc:287] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.804s	user 0.011s	sys 0.000s
I20260709 13:12:27.285624 25874 leader_election.cc:304] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:12:27.293890 29377 raft_consensus.cc:515] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:27.302181 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:27.226068 29645 raft_consensus.cc:515] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:27.306598 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:27.308949 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:27.310511 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:27.314005 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:27.307303 25194 leader_election.cc:304] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:27.319131 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:27.346403 25228 raft_consensus.cc:2393] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 16: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:27.283566 29854 raft_consensus.cc:493] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:27.369382 25194 leader_election.cc:304] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:27.371232 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:27.371507 29658 raft_consensus.cc:493] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:27.372174 29658 raft_consensus.cc:515] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:27.373582 29828 raft_consensus.cc:3055] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:27.374254 29828 raft_consensus.cc:740] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:27.374612 29658 leader_election.cc:290] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:27.379686 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:27.387298 25194 leader_election.cc:304] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:27.388289 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:27.301637 29826 raft_consensus.cc:493] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
W20260709 13:12:27.391341 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 80964.5us
I20260709 13:12:27.389427 25305 raft_consensus.cc:2468] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 13.
W20260709 13:12:27.394129 25224 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58422 (request call id 2264) took 1886 ms (client timeout 1943 ms). Trace:
W20260709 13:12:27.394590 25224 rpcz_store.cc:269] 0709 13:12:25.507953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:25.508059 (+   106us) service_pool.cc:224] Handling call
0709 13:12:27.393916 (+1885857us) spinlock_profiling.cc:243] Waited 565 ms on lock 0x7b540025cbd4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:27.394073 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1300516608}
I20260709 13:12:27.395823 25226 raft_consensus.cc:2393] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 13: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:27.392881 29854 raft_consensus.cc:515] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:27.387326 29815 raft_consensus.cc:2804] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:27.397925 29857 raft_consensus.cc:493] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:27.398805 29857 raft_consensus.cc:515] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:27.399349 29854 leader_election.cc:290] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:27.318641 29086 raft_consensus.cc:2749] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:27.397468 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:27.402601 25901 raft_consensus.cc:2468] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 10.
I20260709 13:12:27.405416 25302 raft_consensus.cc:1275] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:12:27.401491 29857 leader_election.cc:290] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:27.410936 29762 leader_election.cc:290] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:27.411082 29843 consensus_queue.cc:1059] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:27.412086 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:27.412781 25906 raft_consensus.cc:2468] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 10.
I20260709 13:12:27.412999 29624 leader_election.cc:290] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:27.414415 29864 log.cc:927] Time spent T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 13:12:27.386368 29658 raft_consensus.cc:493] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:27.390836 29806 raft_consensus.cc:493] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:27.418071 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:27.418685 29806 raft_consensus.cc:515] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:27.375417 29828 consensus_queue.cc:260] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:27.492285 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:27.691170 25305 raft_consensus.cc:2468] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 9.
I20260709 13:12:27.419255 25376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36264 (request call id 1961) took 1555 ms. Trace:
I20260709 13:12:27.692836 25376 rpcz_store.cc:276] 0709 13:12:25.863806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:25.873018 (+  9212us) service_pool.cc:224] Handling call
0709 13:12:25.892047 (+ 19029us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:25.902208 (+ 10161us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:12:25.902249 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:25.910599 (+  8350us) log.cc:844] Serialized 26 byte log entry
0709 13:12:26.213333 (+302734us) spinlock_profiling.cc:243] Waited 3.23 ms on lock 0x7b180036eb00. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72cb64e07 00007fd7359bfab9 00007fd72cb8169b 00007fd72cb7f93f 00007fd72cb81c02 00007fd72f80920b 00007fd72f80ed23 00007fd72f80f0d1 00007fd72fc2aa0f
0709 13:12:27.127179 (+913846us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:27.127235 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:27.127320 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:27.418918 (+291598us) raft_consensus.cc:1685] finished
0709 13:12:27.418946 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:27.419187 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15525,"raft.queue_time_us":6143,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":14508,"spinlock_wait_cycles":7424768,"thread_start_us":913644,"threads_started":1,"wal-append.queue_time_us":1261796}
W20260709 13:12:27.500527 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 108329us
I20260709 13:12:27.410678 25908 raft_consensus.cc:1275] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 13:12:27.397367 29804 raft_consensus.cc:2749] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:27.422520 25905 raft_consensus.cc:2468] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 16.
I20260709 13:12:27.715970 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:27.716696 25305 raft_consensus.cc:2468] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 9.
I20260709 13:12:27.717741 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:27.698624 25908 pending_rounds.cc:85] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6: Aborting all ops after (but not including) 8
I20260709 13:12:27.719431 25908 pending_rounds.cc:107] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:12:27.719782 25908 raft_consensus.cc:2889] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:12:27.626668 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 239442us
I20260709 13:12:27.724419 25194 leader_election.cc:304] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:27.704528 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 387688us
I20260709 13:12:27.542194 25302 raft_consensus.cc:1275] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:12:27.568650 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
W20260709 13:12:27.544479 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:27.319741 29586 raft_consensus.cc:2764] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:12:27.770313 29750 raft_consensus.cc:493] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:27.417725 29834 leader_election.cc:290] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:27.859525 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 350070us
W20260709 13:12:27.884126 25300 consensus_meta.cc:287] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.804s	user 0.011s	sys 0.000s
I20260709 13:12:27.884711 25300 raft_consensus.cc:2468] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 13.
I20260709 13:12:27.906744 25906 raft_consensus.cc:1275] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:12:27.348099 29822 raft_consensus.cc:697] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 13 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
W20260709 13:12:27.420745 29858 log.cc:927] Time spent T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
I20260709 13:12:27.860972 25343 leader_election.cc:304] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:27.771222 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:27.695292 29840 raft_consensus.cc:3060] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:27.837193 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 128185us
I20260709 13:12:27.920200 25270 leader_election.cc:304] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
W20260709 13:12:27.397502 29863 log.cc:927] Time spent T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 13:12:27.836364 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:27.398007 29815 raft_consensus.cc:493] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:27.918005 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 57149.6us
I20260709 13:12:27.929163 25343 leader_election.cc:304] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:27.478214 29086 raft_consensus.cc:493] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:27.491575 29875 raft_consensus.cc:493] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:27.564513 29871 raft_consensus.cc:2749] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:27.478183 29761 raft_consensus.cc:493] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:27.478412 29788 raft_consensus.cc:493] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:27.543509 29762 raft_consensus.cc:493] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:27.410810 29852 leader_election.cc:290] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:27.913978 29750 raft_consensus.cc:515] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:27.914053 29804 raft_consensus.cc:493] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:27.942471 25902 raft_consensus.cc:1275] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:12:27.917922 29853 raft_consensus.cc:493] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:27.715360 29832 consensus_queue.cc:1048] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.216s
I20260709 13:12:27.917418 29862 raft_consensus.cc:493] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:27.418433 29658 raft_consensus.cc:515] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:27.922482 29377 leader_election.cc:290] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:27.934978 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 210666us
I20260709 13:12:27.925137 29859 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:27.931744 29815 raft_consensus.cc:3060] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:27.925009 29869 raft_consensus.cc:493] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:27.944576 29644 raft_consensus.cc:2804] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:27.996349 25194 leader_election.cc:304] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:27.929952 29764 leader_election.cc:290] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:27.931540 29880 raft_consensus.cc:493] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:27.935998 29854 raft_consensus.cc:2749] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:27.424341 29826 raft_consensus.cc:515] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
W20260709 13:12:28.039794 25345 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.005s	sys 0.011s
W20260709 13:12:28.077144 25345 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.007s	sys 0.011s
I20260709 13:12:27.982402 29586 raft_consensus.cc:493] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:27.996150 29734 raft_consensus.cc:3055] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:27.943856 29086 raft_consensus.cc:515] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:27.974697 29761 raft_consensus.cc:515] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:28.090523 25304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57272 (request call id 2056) took 1742 ms. Trace:
I20260709 13:12:27.999563 29759 leader_election.cc:290] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:27.981783 29788 raft_consensus.cc:515] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:27.994789 29762 raft_consensus.cc:515] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:28.096797 25304 rpcz_store.cc:276] 0709 13:12:26.348070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:26.566451 (+218381us) service_pool.cc:224] Handling call
0709 13:12:26.601822 (+ 35371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:26.621471 (+ 19649us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:26.621518 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:26.682552 (+ 61034us) log.cc:844] Serialized 26 byte log entry
0709 13:12:27.057382 (+374830us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:27.057453 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:27.057533 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:28.088629 (+1031096us) raft_consensus.cc:1685] finished
0709 13:12:28.090299 (+  1670us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:28.090461 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25989,"raft.queue_time_us":88449,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":9118,"thread_start_us":371712,"threads_started":1,"wal-append.queue_time_us":471530}
I20260709 13:12:28.040405 29377 raft_consensus.cc:493] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:28.080998 29789 raft_consensus.cc:493] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:28.073659 29872 raft_consensus.cc:2804] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:28.016049 29644 raft_consensus.cc:493] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:28.089195 29734 raft_consensus.cc:740] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:28.214663 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:28.031886 29812 raft_consensus.cc:493] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:28.193245 25899 raft_consensus.cc:1275] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:12:28.030267 29859 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:28.219305 25372 raft_consensus.cc:1240] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 15 LEADER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:28.169073 29887 raft_consensus.cc:493] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:28.210268 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:27.988512 29804 raft_consensus.cc:515] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:27.997507 29853 raft_consensus.cc:515] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:28.277611 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:27.944175 29875 raft_consensus.cc:515] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:28.001569 29862 raft_consensus.cc:515] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:28.088982 29874 consensus_queue.cc:1048] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.193s
I20260709 13:12:28.071713 29880 raft_consensus.cc:515] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:28.293146 29886 log.cc:927] Time spent T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.188s	user 0.000s	sys 0.000s
I20260709 13:12:28.293928 29880 leader_election.cc:290] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:28.295648 29882 log.cc:927] Time spent T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.295s	user 0.001s	sys 0.000s
I20260709 13:12:28.298130 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:28.298753 25375 raft_consensus.cc:3060] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:12:28.283300 29881 log.cc:927] Time spent T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.189s	user 0.000s	sys 0.000s
I20260709 13:12:28.283974 29895 raft_consensus.cc:493] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:28.181396 29854 raft_consensus.cc:493] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:28.092061 29586 raft_consensus.cc:515] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:28.101123 25872 leader_election.cc:336] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Timed out: RequestConsensusVote RPC to 127.23.140.66:33127 timed out after 2.091s (SENT)
I20260709 13:12:28.205333 29879 raft_consensus.cc:2749] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:28.194757 29872 raft_consensus.cc:493] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:28.230059 29823 consensus_meta.cc:287] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 1.873s	user 0.015s	sys 0.000s
I20260709 13:12:28.196336 29377 raft_consensus.cc:515] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:28.216516 29644 raft_consensus.cc:3060] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:28.099923 29822 consensus_queue.cc:237] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:28.305186 29875 leader_election.cc:290] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:28.220661 29883 raft_consensus.cc:2749] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:12:28.031651 29869 raft_consensus.cc:515] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:28.347254 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:28.442194 25906 raft_consensus.cc:2468] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 13.
I20260709 13:12:28.351429 25298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57272 (request call id 2059) took 2002 ms. Trace:
W20260709 13:12:28.333649 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 413521us
I20260709 13:12:28.444998 25270 leader_election.cc:304] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:28.208583 29789 raft_consensus.cc:515] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:28.366139 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 265028us
I20260709 13:12:28.371163 29624 raft_consensus.cc:493] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
W20260709 13:12:28.367194 25344 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.832s	user 0.001s	sys 0.025s
W20260709 13:12:28.457475 25344 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.922s	user 0.002s	sys 0.025s
W20260709 13:12:28.457871 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 922421us
I20260709 13:12:28.371423 29843 raft_consensus.cc:493] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:28.370034 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:28.340843 29895 raft_consensus.cc:515] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:28.373837 29734 consensus_queue.cc:260] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:28.377406 29761 leader_election.cc:290] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:28.391165 29890 raft_consensus.cc:493] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:28.341708 29658 leader_election.cc:290] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:28.391482 29586 leader_election.cc:290] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:28.340190 29826 leader_election.cc:290] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361)
I20260709 13:12:28.349246 29086 leader_election.cc:290] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:28.337875 29862 leader_election.cc:290] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:28.391923 29892 raft_consensus.cc:493] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:28.359616 29891 raft_consensus.cc:493] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:28.376432 29377 leader_election.cc:290] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:28.392771 29762 leader_election.cc:290] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:28.443166 29815 raft_consensus.cc:515] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:28.394024 29788 leader_election.cc:290] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:28.361574 29841 raft_consensus.cc:3055] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:28.360903 29855 raft_consensus.cc:493] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:28.316267 29806 leader_election.cc:290] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:28.350207 29787 leader_election.cc:290] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:28.378211 29844 raft_consensus.cc:493] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
W20260709 13:12:28.500854 25269 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.028s	sys 0.058s
W20260709 13:12:28.382287 29848 consensus_meta.cc:287] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 1.665s	user 0.008s	sys 0.008s
I20260709 13:12:28.402515 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:28.407299 25379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56308 (request call id 759) took 2483 ms. Trace:
I20260709 13:12:28.407792 29874 raft_consensus.cc:493] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:28.408077 25227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54000 (request call id 790) took 2530 ms. Trace:
I20260709 13:12:28.519627 25227 rpcz_store.cc:276] 0709 13:12:25.877406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:25.878984 (+  1578us) service_pool.cc:224] Handling call
0709 13:12:25.895547 (+ 16563us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:26.210122 (+314575us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:28.407823 (+2197701us) spinlock_profiling.cc:243] Waited 258 ms on lock 0x7b540025dfd4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:28.407998 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":592420736}
I20260709 13:12:28.408437 29807 raft_consensus.cc:493] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:28.409672 29830 raft_consensus.cc:493] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:28.412585 29852 raft_consensus.cc:493] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:28.319670 29887 raft_consensus.cc:515] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:12:28.364739 29854 raft_consensus.cc:515] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:28.374275 29823 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:28.420076 25300 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57272 (request call id 2057) took 2071 ms (client timeout 2188 ms). Trace:
I20260709 13:12:28.423203 29828 raft_consensus.cc:3060] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:28.421015 29859 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:28.432226 29802 consensus_meta.cc:287] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 1.294s	user 0.011s	sys 0.000s
I20260709 13:12:28.433714 29850 leader_election.cc:290] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:28.435505 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:28.313710 25375 raft_consensus.cc:2468] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 7.
I20260709 13:12:28.443343 25298 rpcz_store.cc:276] 0709 13:12:26.348781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:26.575752 (+226971us) service_pool.cc:224] Handling call
0709 13:12:26.601394 (+ 25642us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:27.308342 (+706948us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:28.351123 (+1042781us) spinlock_profiling.cc:243] Waited 706 ms on lock 0x7b5400169ed4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:28.351357 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1624092032}
I20260709 13:12:28.280253 29812 raft_consensus.cc:515] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:28.459728 25372 raft_consensus.cc:2468] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 9.
I20260709 13:12:28.371024 29872 raft_consensus.cc:3060] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:28.464949 25270 leader_election.cc:304] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:12:28.469820 29873 raft_consensus.cc:2749] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:28.469918 29734 raft_consensus.cc:3060] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:12:28.474730 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 478436us
I20260709 13:12:28.475685 25344 leader_election.cc:304] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:28.462414 29804 leader_election.cc:290] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:28.486691 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:28.491814 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:12:28.503924 25301 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.935s	user 0.004s	sys 0.014s
W20260709 13:12:28.557492 25301 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.989s	user 0.005s	sys 0.014s
I20260709 13:12:28.461398 29624 raft_consensus.cc:515] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:28.517701 25269 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.028s	sys 0.058s
W20260709 13:12:28.560001 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 95171.1us
I20260709 13:12:28.518811 25379 rpcz_store.cc:276] 0709 13:12:25.923849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:25.934725 (+ 10876us) service_pool.cc:224] Handling call
0709 13:12:25.935100 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:26.210036 (+274936us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:12:26.210065 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:26.217118 (+  7053us) log.cc:844] Serialized 26 byte log entry
0709 13:12:27.133604 (+916486us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:27.133633 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:28.406883 (+1273250us) spinlock_profiling.cc:243] Waited 274 ms on lock 0x7b540033fc54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:28.406943 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:28.406989 (+    46us) raft_consensus.cc:1685] finished
0709 13:12:28.407001 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:28.407213 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":601,"raft.queue_time_us":909,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":9184,"spinlock_wait_cycles":631215488,"thread_start_us":875579,"threads_started":1,"wal-append.queue_time_us":1017469,"wal-append.run_cpu_time_us":2078,"wal-append.run_wall_time_us":1156499}
W20260709 13:12:28.523085 25195 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.001s	sys 0.022s
W20260709 13:12:28.561164 25195 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.001s	sys 0.023s
I20260709 13:12:28.479332 29890 raft_consensus.cc:515] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:28.501288 29841 raft_consensus.cc:740] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
W20260709 13:12:28.528402 25300 rpcz_store.cc:269] 0709 13:12:26.348301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:26.443798 (+ 95497us) service_pool.cc:224] Handling call
0709 13:12:28.419852 (+1976054us) spinlock_profiling.cc:243] Waited 504 ms on lock 0x7b54002c9f54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:28.419990 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1158459776}
W20260709 13:12:28.545647 29840 consensus_meta.cc:287] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.619s	user 0.011s	sys 0.002s
I20260709 13:12:28.543041 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:28.487576 29892 raft_consensus.cc:515] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:28.474696 29843 raft_consensus.cc:515] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:28.563037 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:28.570804 25372 raft_consensus.cc:2393] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 13: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:28.563189 25872 leader_election.cc:304] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:28.563913 25899 raft_consensus.cc:1275] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:12:28.564361 29900 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:28.544731 29086 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:28.522320 29874 raft_consensus.cc:515] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:28.527921 29807 raft_consensus.cc:515] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:28.535951 25908 raft_consensus.cc:2468] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 11.
I20260709 13:12:28.574007 25224 raft_consensus.cc:1240] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:28.528146 29852 raft_consensus.cc:515] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:28.569911 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:28.563212 29850 raft_consensus.cc:2804] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:28.524161 29844 raft_consensus.cc:515] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:28.596719 25194 leader_election.cc:304] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:12:28.528185 29830 raft_consensus.cc:515] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:28.594504 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:12:28.625357 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 149725us
I20260709 13:12:28.567505 25375 raft_consensus.cc:2468] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 11.
I20260709 13:12:28.591905 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:28.592203 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:28.627691 25378 raft_consensus.cc:2468] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 9.
I20260709 13:12:28.628840 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:28.589737 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:28.582583 29789 leader_election.cc:290] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:28.635178 29869 leader_election.cc:290] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:28.635397 29807 leader_election.cc:290] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:28.635519 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:28.635831 29788 consensus_queue.cc:1048] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:28.636222 25227 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 9.
I20260709 13:12:28.593349 29801 raft_consensus.cc:3055] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:28.636240 29815 leader_election.cc:290] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:28.638432 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:28.638738 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:28.639583 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:28.640290 25908 raft_consensus.cc:2393] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 10: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:12:28.492882 29891 raft_consensus.cc:515] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:28.586377 29843 leader_election.cc:290] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:28.587749 29624 leader_election.cc:290] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:28.604504 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:28.604786 29750 leader_election.cc:290] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:28.606313 29890 leader_election.cc:290] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:28.539852 29802 raft_consensus.cc:515] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:28.610976 29759 raft_consensus.cc:493] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:28.611485 29761 raft_consensus.cc:493] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:28.614058 29904 raft_consensus.cc:493] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:28.616166 29644 raft_consensus.cc:515] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:28.616770 29892 leader_election.cc:290] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:28.590886 29841 consensus_queue.cc:260] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:28.618577 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:28.619604 29086 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:28.620608 25902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50060 (request call id 755) took 1250 ms. Trace:
I20260709 13:12:28.620707 25229 raft_consensus.cc:1240] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:28.519424 29855 raft_consensus.cc:515] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:12:28.622550 25195 leader_election.cc:304] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:28.630875 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:28.631517 25378 raft_consensus.cc:2410] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:12:28.633579 29908 raft_consensus.cc:2804] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:28.634274 29812 leader_election.cc:290] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:28.578788 29765 raft_consensus.cc:2749] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:28.634810 25379 raft_consensus.cc:1240] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 13 LEADER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:12:28.602114 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:28.602734 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:28.688534 25371 raft_consensus.cc:2393] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 12: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:28.643224 25372 raft_consensus.cc:1240] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:28.632268 29733 raft_consensus.cc:2804] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:28.565625 29902 raft_consensus.cc:493] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:28.574839 29853 leader_election.cc:290] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:28.583309 29854 leader_election.cc:290] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:28.580372 29900 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:28.659291 25296 raft_consensus.cc:2468] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 10.
I20260709 13:12:28.623518 29850 raft_consensus.cc:493] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:28.622061 29804 consensus_queue.cc:1059] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.067s
I20260709 13:12:28.722188 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:12:28.693259 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 66996.6us
I20260709 13:12:28.952024 25906 raft_consensus.cc:2393] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 13: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:12:28.952334 25344 leader_election.cc:304] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:28.934816 29733 raft_consensus.cc:697] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 12 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:28.935573 25376 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 7.
I20260709 13:12:28.935518 29759 raft_consensus.cc:515] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:28.936653 29761 raft_consensus.cc:515] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:28.691618 29749 raft_consensus.cc:493] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:28.944296 29850 raft_consensus.cc:3060] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:28.938601 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:28.822800 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:28.939422 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:28.965706 25372 raft_consensus.cc:2393] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 13: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:28.940513 29908 raft_consensus.cc:493] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:28.940955 29815 raft_consensus.cc:3055] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:28.939646 29904 raft_consensus.cc:515] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:28.940833 25902 rpcz_store.cc:276] 0709 13:12:27.370545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:27.370663 (+   118us) service_pool.cc:224] Handling call
0709 13:12:27.397062 (+ 26399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:27.976013 (+578951us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:28.620220 (+644207us) spinlock_profiling.cc:243] Waited 545 ms on lock 0x7b5400710f54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:28.620424 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1253063040}
I20260709 13:12:28.884881 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:28.961966 29750 raft_consensus.cc:2804] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:28.888792 25370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36264 (request call id 1970) took 2652 ms. Trace:
I20260709 13:12:28.950706 29855 leader_election.cc:290] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:12:28.741822 25271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:28.945713 29907 log.cc:927] Time spent T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:12:28.946213 29874 leader_election.cc:290] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:28.948220 29902 raft_consensus.cc:515] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:28.934643 29841 raft_consensus.cc:3060] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:28.637655 29801 raft_consensus.cc:740] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
W20260709 13:12:28.693482 29803 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.830s	user 0.032s	sys 0.048s
I20260709 13:12:28.961361 25373 raft_consensus.cc:2368] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for earlier term 10. Current term is 11.
W20260709 13:12:28.981938 29803 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.119s	user 0.037s	sys 0.052s
I20260709 13:12:28.591325 29887 leader_election.cc:290] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:28.938196 29086 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:28.964155 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:28.731122 29852 leader_election.cc:290] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:28.727419 29891 leader_election.cc:290] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:28.732101 29802 leader_election.cc:290] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:28.965967 25379 raft_consensus.cc:2393] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 11: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:28.965658 25901 raft_consensus.cc:2468] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 11.
I20260709 13:12:28.965654 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:28.738469 29830 leader_election.cc:290] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:28.853552 29823 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:28.638432 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:28.989426 25375 raft_consensus.cc:2393] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 13: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
W20260709 13:12:28.970834 25299 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57272 (request call id 2076) took 1657 ms (client timeout 1833 ms). Trace:
I20260709 13:12:28.909015 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:28.737443 29872 raft_consensus.cc:515] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:28.971881 25370 rpcz_store.cc:276] 0709 13:12:26.236706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:26.236863 (+   157us) service_pool.cc:224] Handling call
0709 13:12:26.237234 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:27.302877 (+1065643us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:28.888471 (+1585594us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54003124d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:28.888711 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2330541952}
I20260709 13:12:28.962296 29853 consensus_queue.cc:1048] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:12:28.968276 29908 raft_consensus.cc:3060] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:28.968354 29815 raft_consensus.cc:740] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:28.981168 25372 raft_consensus.cc:1240] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:28.971827 29750 raft_consensus.cc:493] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
W20260709 13:12:28.987612 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 186679us
I20260709 13:12:28.990058 25379 raft_consensus.cc:1240] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:28.990437 25374 raft_consensus.cc:2468] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 11.
I20260709 13:12:28.967386 29749 raft_consensus.cc:515] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:28.989907 25299 rpcz_store.cc:269] 0709 13:12:27.313361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:28.884524 (+1571163us) service_pool.cc:224] Handling call
0709 13:12:28.970765 (+ 86241us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:28.996860 29801 consensus_queue.cc:260] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:28.997546 29644 leader_election.cc:290] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:28.994531 29750 raft_consensus.cc:3060] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:29.004390 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:29.004683 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:28.980798 29855 consensus_queue.cc:1048] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:12:29.005301 25298 raft_consensus.cc:3060] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:29.005949 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:29.006505 25908 raft_consensus.cc:3060] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:29.006531 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:29.007164 25300 raft_consensus.cc:3060] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:29.008670 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:29.009303 25305 raft_consensus.cc:2468] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 9.
I20260709 13:12:29.010171 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:29.011220 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:29.011677 25305 raft_consensus.cc:2468] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 9.
I20260709 13:12:29.012364 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:29.014722 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:29.015308 25305 raft_consensus.cc:2468] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 10.
I20260709 13:12:29.017210 25299 raft_consensus.cc:1240] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:12:29.018914 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:29.019814 25297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57272 (request call id 2078) took 1706 ms. Trace:
I20260709 13:12:29.020210 25297 rpcz_store.cc:276] 0709 13:12:27.313912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:29.019092 (+1705180us) service_pool.cc:224] Handling call
0709 13:12:29.019386 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:29.019546 (+   160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:29.019569 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:29.019605 (+    36us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:29.019631 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:29.019676 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:29.019766 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:29.021296 25300 raft_consensus.cc:2468] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 11.
I20260709 13:12:29.022266 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:29.022821 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:29.023137 25300 raft_consensus.cc:2410] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 14 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:12:29.023419 25304 raft_consensus.cc:2468] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 10.
I20260709 13:12:29.021447 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:29.024317 25297 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 7.
I20260709 13:12:29.003749 29801 raft_consensus.cc:3060] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:29.026670 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:29.028288 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:29.028414 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:29.028833 25299 raft_consensus.cc:2468] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 12.
I20260709 13:12:29.029982 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:28.990115 29733 consensus_queue.cc:237] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:29.027499 29749 leader_election.cc:290] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:29.034930 25343 leader_election.cc:304] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:29.039198 25343 leader_election.cc:304] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:29.040128 25343 leader_election.cc:304] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:29.041318 25343 leader_election.cc:304] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:29.013423 29761 leader_election.cc:290] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:29.042550 29644 raft_consensus.cc:2804] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:29.042991 29644 raft_consensus.cc:493] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:29.047232 25298 raft_consensus.cc:2468] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 13.
I20260709 13:12:29.048385 25343 leader_election.cc:304] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:29.043360 29644 raft_consensus.cc:3060] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:29.050925 29691 raft_consensus.cc:3055] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:29.051326 29691 raft_consensus.cc:740] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:29.052171 29802 raft_consensus.cc:2804] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:29.052619 29802 raft_consensus.cc:493] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:29.053004 29802 raft_consensus.cc:3060] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:29.058318 29844 leader_election.cc:290] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:29.058714 29823 raft_consensus.cc:2804] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:29.058631 29750 raft_consensus.cc:515] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:29.059279 29823 raft_consensus.cc:493] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:29.059682 29823 raft_consensus.cc:3060] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:29.061077 29750 leader_election.cc:290] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 16 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:29.062353 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:29.066720 25299 raft_consensus.cc:1240] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:29.067811 29458 raft_consensus.cc:493] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:29.067960 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:29.068344 29458 raft_consensus.cc:515] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:29.068754 29832 raft_consensus.cc:493] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:29.069063 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:29.069416 29764 raft_consensus.cc:493] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:29.069263 29832 raft_consensus.cc:515] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:29.069928 29764 raft_consensus.cc:515] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:29.070590 29458 leader_election.cc:290] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:29.071403 29832 leader_election.cc:290] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:29.075333 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:29.076121 25302 raft_consensus.cc:2410] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 14 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 5.
I20260709 13:12:29.078517 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:29.079111 25302 raft_consensus.cc:2376] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 13. Re-sending same reply.
I20260709 13:12:29.079967 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:29.080312 25302 raft_consensus.cc:2376] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 13. Re-sending same reply.
I20260709 13:12:29.080796 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:29.081207 25302 raft_consensus.cc:2393] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 12: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:29.085106 25908 raft_consensus.cc:2468] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 11.
I20260709 13:12:29.074193 29764 leader_election.cc:290] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:29.086411 25300 raft_consensus.cc:2468] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 11.
I20260709 13:12:29.082101 25343 leader_election.cc:304] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:29.086676 25344 leader_election.cc:304] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:29.088279 29911 raft_consensus.cc:2749] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:29.091809 25343 leader_election.cc:304] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:29.091998 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:29.093011 25299 raft_consensus.cc:2410] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:12:29.093011 25298 raft_consensus.cc:1275] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:12:29.094763 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:29.095255 25302 raft_consensus.cc:2376] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 14. Re-sending same reply.
W20260709 13:12:29.099211 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:29.081825 29910 raft_consensus.cc:2804] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:29.101197 25343 leader_election.cc:304] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:29.104703 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:29.105322 25302 raft_consensus.cc:2468] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 9.
I20260709 13:12:29.107165 25302 raft_consensus.cc:1275] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:12:29.117210 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:29.016523 29815 consensus_queue.cc:260] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:29.117551 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:29.119133 25302 raft_consensus.cc:1240] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:29.118299 25299 raft_consensus.cc:2468] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 9.
I20260709 13:12:29.121269 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:29.074965 29853 consensus_queue.cc:1059] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:12:29.098793 29911 raft_consensus.cc:2804] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:29.098430 29785 raft_consensus.cc:2804] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:29.119092 29761 raft_consensus.cc:2804] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:29.119284 29763 raft_consensus.cc:493] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:29.139792 25901 raft_consensus.cc:2468] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 16.
I20260709 13:12:29.119856 29750 raft_consensus.cc:2804] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:29.128290 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:29.145057 25344 leader_election.cc:304] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:29.146471 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:29.122449 29900 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:29.123921 29910 raft_consensus.cc:697] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 11 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:29.152709 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:29.153558 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:29.127679 29785 raft_consensus.cc:493] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:29.156977 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:29.156152 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:29.135160 29815 raft_consensus.cc:3060] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:12:29.160931 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:29.135648 29911 raft_consensus.cc:697] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 11 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:29.165373 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:29.158181 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:29.166365 25379 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 10.
I20260709 13:12:29.151118 29761 raft_consensus.cc:697] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 13 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:29.152627 29788 raft_consensus.cc:2804] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:12:29.166433 25901 raft_consensus.cc:2468] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 12.
I20260709 13:12:29.173679 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:29.174643 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:29.144147 29750 raft_consensus.cc:493] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:29.161232 29785 raft_consensus.cc:3060] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:29.175987 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:29.178129 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:29.181978 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:29.183034 25872 leader_election.cc:304] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:12:29.184129 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:29.186491 25270 leader_election.cc:304] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:29.148455 29763 raft_consensus.cc:515] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:29.189188 25270 leader_election.cc:304] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:29.194059 25872 leader_election.cc:304] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:29.175870 29902 leader_election.cc:290] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:29.177397 29750 raft_consensus.cc:3060] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:29.202363 29761 consensus_queue.cc:237] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:29.203567 29763 leader_election.cc:290] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:29.203852 29446 raft_consensus.cc:2749] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:29.197652 29765 raft_consensus.cc:2804] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:29.178897 29749 consensus_queue.cc:1059] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:12:29.205543 29802 raft_consensus.cc:515] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:29.196012 29764 raft_consensus.cc:2804] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:29.205745 29908 raft_consensus.cc:515] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:29.206590 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:29.195293 29844 consensus_queue.cc:1059] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:12:29.207139 29812 consensus_queue.cc:1048] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:12:29.202395 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:29.187623 29788 raft_consensus.cc:697] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 16 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:29.219108 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:29.201591 25872 leader_election.cc:304] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:29.227574 29902 raft_consensus.cc:2804] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:29.229795 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:29.231477 25270 leader_election.cc:304] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:29.248477 25372 raft_consensus.cc:2468] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 13.
I20260709 13:12:29.248270 25906 raft_consensus.cc:2468] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 9.
I20260709 13:12:29.250329 29902 raft_consensus.cc:493] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:29.252107 29902 raft_consensus.cc:3060] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:29.252714 29844 raft_consensus.cc:2749] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:29.253594 29844 raft_consensus.cc:3055] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:29.254056 29844 raft_consensus.cc:740] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:29.254990 29844 consensus_queue.cc:260] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:29.255573 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:29.256256 25377 raft_consensus.cc:2468] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 14.
I20260709 13:12:29.256448 29844 raft_consensus.cc:3060] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:29.261080 29788 consensus_queue.cc:237] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:29.235018 29911 consensus_queue.cc:237] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:29.267835 29812 raft_consensus.cc:2749] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:12:29.268059 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 66593.2us
I20260709 13:12:29.270242 29908 leader_election.cc:290] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:29.269666 25872 leader_election.cc:304] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:29.271008 25378 raft_consensus.cc:1240] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:29.271757 29446 raft_consensus.cc:2804] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:29.247267 29764 raft_consensus.cc:493] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:29.274380 29446 raft_consensus.cc:493] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:29.280181 29446 raft_consensus.cc:3060] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:29.275462 29812 consensus_queue.cc:1048] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 13:12:29.198050 29910 consensus_queue.cc:237] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:29.265585 29823 raft_consensus.cc:515] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:29.284792 29823 leader_election.cc:290] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:29.286310 25301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57272 (request call id 2062) took 2936 ms. Trace:
I20260709 13:12:29.286746 25301 rpcz_store.cc:276] 0709 13:12:26.349642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:26.572931 (+223289us) service_pool.cc:224] Handling call
0709 13:12:26.994188 (+421257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:27.250816 (+256628us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:12:27.568711 (+317895us) log.cc:844] Serialized 14 byte log entry
0709 13:12:28.558972 (+990261us) log.cc:844] Serialized 14 byte log entry
0709 13:12:28.584750 (+ 25778us) spinlock_profiling.cc:243] Waited 4.19 ms on lock 0x7b1800473ec0. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72cb82522 00007fd72cb847c1 00007fd72cb84779 00007fd72cb84709 00007fd72cb846d1 00007fd72cb839cd 000000000038f354 000000000038f199 00007fd72cb6583a
0709 13:12:29.063905 (+479155us) spinlock_profiling.cc:243] Waited 3.35 ms on lock 0x7b1800473ec0. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72cafcc0a 00007fd73623c219 00007fd72cb84a40 00007fd72cb7f4e4 00007fd72cb7f455 00007fd72fc67060 00007fd72fc79716 00007fd72fc8a287 00007fd72fc8a208
0709 13:12:29.064071 (+   166us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:29.064121 (+    50us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:29.064165 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:29.286055 (+221890us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b5400099a54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:29.286102 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:29.286223 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":488643,"prepare.queue_time_us":752703,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":2436,"raft.queue_time_us":510660,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":4753,"spinlock_wait_cycles":606727040,"thread_start_us":1250871,"threads_started":2,"wal-append.queue_time_us":964650}
I20260709 13:12:29.265221 29902 raft_consensus.cc:515] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:29.294298 29764 raft_consensus.cc:3060] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:29.310083 29895 leader_election.cc:290] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:12:29.323946 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 51952.8us
I20260709 13:12:29.324645 25305 raft_consensus.cc:2468] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 10.
I20260709 13:12:29.327248 25872 leader_election.cc:304] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:29.332747 29765 raft_consensus.cc:697] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:29.344879 29644 raft_consensus.cc:515] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:29.348255 29644 leader_election.cc:290] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:29.349785 29812 consensus_queue.cc:1059] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 13:12:29.350713 29802 leader_election.cc:290] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:29.350978 29812 raft_consensus.cc:3055] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:29.351374 29812 raft_consensus.cc:740] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:29.352185 29812 consensus_queue.cc:260] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:29.352416 29850 raft_consensus.cc:515] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:29.353355 29812 raft_consensus.cc:3060] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:29.353629 25304 raft_consensus.cc:1240] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:12:29.356392 29785 raft_consensus.cc:515] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:29.356781 29765 consensus_queue.cc:237] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:29.357861 25374 raft_consensus.cc:2393] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 11: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:29.359521 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:29.359992 29850 leader_election.cc:290] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:29.343953 29926 raft_consensus.cc:2764] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:12:29.356395 29446 raft_consensus.cc:515] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:29.368098 29446 leader_election.cc:290] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:29.371083 29785 leader_election.cc:290] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:29.374663 29645 leader_election.cc:290] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:12:29.386607 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 52687.7us
I20260709 13:12:29.388417 25270 leader_election.cc:304] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:29.390914 29850 raft_consensus.cc:2804] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:29.391346 29850 raft_consensus.cc:493] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:29.391726 29850 raft_consensus.cc:3060] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:29.391513 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:29.392817 25372 raft_consensus.cc:2393] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 10: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:29.394659 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:29.394966 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:29.395392 25904 raft_consensus.cc:3060] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:29.400574 25303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57272 (request call id 2071) took 3033 ms. Trace:
I20260709 13:12:29.401177 25303 rpcz_store.cc:276] 0709 13:12:26.366670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:27.079808 (+713138us) service_pool.cc:224] Handling call
0709 13:12:27.131712 (+ 51904us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:27.478370 (+346658us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:27.478405 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:27.493155 (+ 14750us) log.cc:844] Serialized 26 byte log entry
0709 13:12:27.821913 (+328758us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:27.821960 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:29.400076 (+1578116us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b54002debd4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:29.400149 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:29.400209 (+    60us) raft_consensus.cc:1685] finished
0709 13:12:29.400228 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:29.400495 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":216484,"raft.queue_time_us":160103,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":51051,"spinlock_wait_cycles":429559040,"thread_start_us":194673,"threads_started":1,"wal-append.queue_time_us":421351,"wal-append.run_cpu_time_us":2615,"wal-append.run_wall_time_us":1299494}
I20260709 13:12:29.407457 25222 raft_consensus.cc:1275] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:12:29.408634 25222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58418 (request call id 2172) took 2104 ms. Trace:
I20260709 13:12:29.408958 25222 rpcz_store.cc:276] 0709 13:12:27.304548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:27.304687 (+   139us) service_pool.cc:224] Handling call
0709 13:12:27.318538 (+ 13851us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:29.407901 (+2089363us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:29.408402 (+   501us) spinlock_profiling.cc:243] Waited 2.09 s on lock 0x7b54000eb5d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:29.408578 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4803304192}
I20260709 13:12:29.418577 29764 raft_consensus.cc:515] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:29.422783 29764 leader_election.cc:290] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:29.423617 25226 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58418 (request call id 2175) took 2117 ms (client timeout 2063 ms). Trace:
W20260709 13:12:29.426357 25226 rpcz_store.cc:269] 0709 13:12:27.305890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:27.308694 (+  2804us) service_pool.cc:224] Handling call
0709 13:12:29.423329 (+2114635us) spinlock_profiling.cc:243] Waited 76 ms on lock 0x7b54000893d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:29.423483 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":174809344}
I20260709 13:12:29.425832 25903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50060 (request call id 754) took 2078 ms. Trace:
I20260709 13:12:29.428534 29902 leader_election.cc:290] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:29.429563 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:29.430233 25899 raft_consensus.cc:3060] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:29.427454 25903 rpcz_store.cc:276] 0709 13:12:27.370117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:27.390549 (+ 20432us) service_pool.cc:224] Handling call
0709 13:12:27.415694 (+ 25145us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:27.821797 (+406103us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:27.821835 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:27.821892 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:27.821940 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:29.425564 (+1603624us) spinlock_profiling.cc:243] Waited 406 ms on lock 0x7b54006e4bd4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:29.425616 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:29.425725 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":933374720}
I20260709 13:12:29.431041 25904 raft_consensus.cc:2468] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 12.
I20260709 13:12:29.434242 29733 raft_consensus.cc:493] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:29.434196 29750 raft_consensus.cc:515] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:29.435045 29733 raft_consensus.cc:515] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:29.436058 29691 consensus_queue.cc:260] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:29.437065 29691 raft_consensus.cc:3060] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:29.437320 29733 leader_election.cc:290] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:29.440404 25270 leader_election.cc:304] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:29.440447 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:29.448946 25899 raft_consensus.cc:2468] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 13.
I20260709 13:12:29.452476 25270 leader_election.cc:304] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:29.450295 29801 raft_consensus.cc:2804] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:29.457532 29764 raft_consensus.cc:2804] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:29.463792 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:29.466179 25900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50056 (request call id 818) took 1364 ms. Trace:
I20260709 13:12:29.466566 25900 rpcz_store.cc:276] 0709 13:12:28.101577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:29.463515 (+1361938us) service_pool.cc:224] Handling call
0709 13:12:29.466110 (+  2595us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:29.465453 29801 raft_consensus.cc:697] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 12 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:29.471496 29801 consensus_queue.cc:237] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:29.471784 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 849245us
I20260709 13:12:29.473244 25195 leader_election.cc:304] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:12:29.473933 29808 raft_consensus.cc:2749] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:29.473961 29733 consensus_queue.cc:1048] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:12:29.476100 29733 raft_consensus.cc:2804] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:29.476485 29733 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:29.476790 29733 raft_consensus.cc:3060] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:29.466179 29764 raft_consensus.cc:697] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 13 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:29.492579 25379 raft_consensus.cc:2410] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
W20260709 13:12:29.483261 25195 connection.cc:256] RPC call timeout handler was delayed by -1.3085936740000079s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1922s for a response
W20260709 13:12:29.497318 25195 connection.cc:256] RPC call timeout handler was delayed by -1.0469909170000165s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20270000000000002s for a response
W20260709 13:12:29.498265 25195 connection.cc:256] RPC call timeout handler was delayed by -1.0421936739999182s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2218s for a response
I20260709 13:12:29.467180 29850 raft_consensus.cc:515] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:29.500619 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:29.500442 29815 raft_consensus.cc:493] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:29.501350 29815 raft_consensus.cc:515] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:29.504062 29815 leader_election.cc:290] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:29.493587 29733 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:29.505785 29850 leader_election.cc:290] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:29.506417 29904 leader_election.cc:290] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:29.506562 25297 raft_consensus.cc:2393] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 10: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:29.509620 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:29.510416 25900 raft_consensus.cc:2393] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 10: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:12:29.511875 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:29.512706 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:29.513268 25298 raft_consensus.cc:3060] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:12:29.513351 25303 raft_consensus.cc:1275] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:12:29.513813 25302 raft_consensus.cc:1240] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:29.515775 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:29.517396 25270 leader_election.cc:304] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:29.518798 29844 consensus_queue.cc:1059] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:29.519167 25270 leader_election.cc:304] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:29.522352 25299 raft_consensus.cc:1240] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:12:29.521740 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:29.522734 25270 leader_election.cc:304] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:29.523877 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:29.527293 29733 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:29.524750 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:29.530174 25302 raft_consensus.cc:3060] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:29.530786 25298 raft_consensus.cc:2468] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 11.
I20260709 13:12:29.531358 29750 leader_election.cc:290] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:29.532152 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:29.533890 29904 consensus_queue.cc:1048] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:29.535471 29691 consensus_queue.cc:1059] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:12:29.538223 29691 raft_consensus.cc:493] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:29.538363 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:29.538944 25299 raft_consensus.cc:3060] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:29.538746 29691 raft_consensus.cc:515] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:29.539623 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:29.540838 29691 leader_election.cc:290] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:29.541165 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:29.548204 25301 raft_consensus.cc:3060] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:29.541419 29691 raft_consensus.cc:3055] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:29.545375 25270 leader_election.cc:304] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:29.548724 25299 raft_consensus.cc:2468] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 10.
W20260709 13:12:29.549222 25271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:29.551074 29691 raft_consensus.cc:740] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:29.552202 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:29.541939 29844 raft_consensus.cc:2804] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:29.554203 29844 raft_consensus.cc:493] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:29.554651 29844 raft_consensus.cc:3060] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:29.552421 29691 consensus_queue.cc:260] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:29.542531 29826 raft_consensus.cc:3055] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:29.558343 29826 raft_consensus.cc:740] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:29.546129 29841 raft_consensus.cc:2749] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:29.559234 29832 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:29.545856 29850 raft_consensus.cc:2749] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:29.559973 29832 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:29.561303 25270 leader_election.cc:304] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:29.562032 29832 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:29.562294 29903 raft_consensus.cc:2804] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:29.562704 29903 raft_consensus.cc:493] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:29.562834 29902 raft_consensus.cc:2804] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:29.563167 29903 raft_consensus.cc:3060] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:29.563565 29902 raft_consensus.cc:493] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:29.564101 29902 raft_consensus.cc:3060] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:29.567552 25270 leader_election.cc:304] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:29.557528 25302 raft_consensus.cc:2468] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 11.
I20260709 13:12:29.570065 29691 raft_consensus.cc:3060] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:29.577250 25343 leader_election.cc:304] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:29.578213 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:29.578955 25302 raft_consensus.cc:2468] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 14.
I20260709 13:12:29.541802 25298 raft_consensus.cc:2468] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 13.
I20260709 13:12:29.581115 25343 leader_election.cc:304] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:29.584264 25343 leader_election.cc:304] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:29.585179 29891 raft_consensus.cc:2804] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:29.585623 29891 raft_consensus.cc:493] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:29.586097 29891 raft_consensus.cc:3060] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:29.589056 25299 raft_consensus.cc:2468] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 12.
I20260709 13:12:29.593819 25374 raft_consensus.cc:1240] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 6. Current term is 7. Ops: []
W20260709 13:12:29.595372 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:29.595049 25343 leader_election.cc:304] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:29.596969 29910 raft_consensus.cc:2804] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:29.597128 25343 leader_election.cc:304] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:29.597409 29910 raft_consensus.cc:493] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:29.597820 29910 raft_consensus.cc:3060] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:29.600540 29844 raft_consensus.cc:515] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:29.606665 29911 raft_consensus.cc:2804] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:29.607424 29911 raft_consensus.cc:697] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 12 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:29.608484 29911 consensus_queue.cc:237] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:29.582878 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 82529.2us
I20260709 13:12:29.616235 25195 leader_election.cc:304] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:29.571305 29850 raft_consensus.cc:2749] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:29.617607 25195 leader_election.cc:304] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
W20260709 13:12:29.674329 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 56797.6us
I20260709 13:12:29.678561 29733 raft_consensus.cc:2804] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:29.678985 29733 raft_consensus.cc:493] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:29.679544 29733 raft_consensus.cc:3060] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:29.583369 29787 raft_consensus.cc:2804] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:29.685441 29787 raft_consensus.cc:697] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 10 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:29.689999 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:29.691069 25374 raft_consensus.cc:2393] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 14: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:29.559231 29826 consensus_queue.cc:260] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:29.699760 29826 raft_consensus.cc:3060] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:29.699573 29787 consensus_queue.cc:237] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:29.703351 29902 raft_consensus.cc:515] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:29.707252 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:29.672181 29809 raft_consensus.cc:2804] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:29.620244 29750 raft_consensus.cc:2804] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:12:29.701723 29832 consensus_queue.cc:1175] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "79d99c0e498349bda74127365219e468" responder_term: 7 status { last_received { term: 6 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 6. Current term is 7. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:12:29.583483 29904 consensus_queue.cc:1059] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.132s
I20260709 13:12:29.730480 29904 raft_consensus.cc:3055] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:29.583314 29830 consensus_queue.cc:1059] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.135s
I20260709 13:12:29.734669 29844 leader_election.cc:290] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:29.582616 29764 consensus_queue.cc:237] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:29.724498 29809 raft_consensus.cc:697] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 7 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
W20260709 13:12:29.747336 25873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:29.742633 25302 raft_consensus.cc:1275] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:12:29.750212 29563 raft_consensus.cc:3055] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:29.750757 29563 raft_consensus.cc:740] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:29.751814 29563 consensus_queue.cc:260] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:29.765863 29765 raft_consensus.cc:493] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:29.770100 29765 raft_consensus.cc:515] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:29.773051 29765 leader_election.cc:290] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:29.777132 29809 consensus_queue.cc:237] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:29.779052 25229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54000 (request call id 806) took 1158 ms. Trace:
I20260709 13:12:29.779543 25229 rpcz_store.cc:276] 0709 13:12:28.620133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:28.620249 (+   116us) service_pool.cc:224] Handling call
0709 13:12:28.620539 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:29.778687 (+1158148us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:29.778970 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:29.787619 29903 raft_consensus.cc:515] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:29.789384 25299 raft_consensus.cc:1240] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:29.789992 29841 raft_consensus.cc:493] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:29.790525 29841 raft_consensus.cc:515] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:29.791385 25301 raft_consensus.cc:2468] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 11.
I20260709 13:12:29.792620 29841 leader_election.cc:290] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:29.731402 29750 raft_consensus.cc:697] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 11 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:29.743053 29904 raft_consensus.cc:740] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
W20260709 13:12:29.803602 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 54395us
I20260709 13:12:29.809151 25343 leader_election.cc:304] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:29.804884 29891 raft_consensus.cc:515] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:29.824072 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:29.807758 29563 raft_consensus.cc:3060] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:29.807179 29761 consensus_queue.cc:1048] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
W20260709 13:12:29.833448 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 158130us
I20260709 13:12:29.816176 29788 raft_consensus.cc:2804] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:29.837925 25195 leader_election.cc:304] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:29.841536 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:29.842211 25378 raft_consensus.cc:3060] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:29.834235 29904 consensus_queue.cc:260] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:29.847254 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:29.847860 25377 raft_consensus.cc:3060] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:29.849624 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:29.850260 25907 raft_consensus.cc:3060] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:29.853580 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:29.854842 29903 leader_election.cc:290] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:28.739367 25194 leader_election.cc:304] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:29.846470 29446 consensus_queue.cc:1059] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 13:12:29.870388 25343 leader_election.cc:304] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:29.872344 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:29.872651 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:29.872977 25305 raft_consensus.cc:3060] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:29.874982 29733 raft_consensus.cc:515] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:29.877303 29733 leader_election.cc:290] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:29.878258 29910 raft_consensus.cc:515] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:29.849857 29788 raft_consensus.cc:697] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 11 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:29.880519 29910 leader_election.cc:290] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:29.880154 29788 consensus_queue.cc:237] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:29.851459 29750 consensus_queue.cc:237] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:29.870559 29891 leader_election.cc:290] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:29.885167 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:29.894421 25301 raft_consensus.cc:3060] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:12:29.885954 25874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:29.898137 29446 consensus_queue.cc:1059] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:29.900375 29926 consensus_queue.cc:1059] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:12:29.856879 29904 raft_consensus.cc:3060] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:29.917788 25301 raft_consensus.cc:2468] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 14.
I20260709 13:12:29.850139 29808 raft_consensus.cc:2804] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:29.920033 25305 raft_consensus.cc:2468] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 15.
I20260709 13:12:29.887851 25907 raft_consensus.cc:2468] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 12.
I20260709 13:12:29.875074 29645 raft_consensus.cc:2804] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:12:29.938938 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 90632.5us
W20260709 13:12:29.939000 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 86977.4us
I20260709 13:12:29.883797 29902 leader_election.cc:290] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:29.949173 25302 raft_consensus.cc:1240] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:29.936555 25377 raft_consensus.cc:2468] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 14.
W20260709 13:12:29.952842 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 1.21347e+06us
I20260709 13:12:29.948675 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:29.996832 25299 raft_consensus.cc:2393] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 12: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:29.966943 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 16 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:29.937381 29808 raft_consensus.cc:493] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:29.967826 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:29.970310 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:29.938881 29645 raft_consensus.cc:493] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:29.902096 29733 consensus_queue.cc:1059] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.064s
W20260709 13:12:29.974244 25195 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 1.833s (SENT) [suppressed 16 similar messages]
I20260709 13:12:29.974488 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:29.976630 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
W20260709 13:12:29.994444 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 96997.8us
W20260709 13:12:29.995479 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 123438us
I20260709 13:12:29.967144 29945 raft_consensus.cc:2749] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:12:29.998586 25229 raft_consensus.cc:2410] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:12:30.004673 25378 raft_consensus.cc:2468] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 12.
I20260709 13:12:30.005859 29645 raft_consensus.cc:3060] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:30.000839 29808 raft_consensus.cc:3060] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:12:30.007602 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:30.016062 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 47481us
I20260709 13:12:30.029104 25299 raft_consensus.cc:1275] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:12:30.030038 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:30.029995 25343 leader_election.cc:304] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:30.030156 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:30.031090 25343 leader_election.cc:304] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:30.031303 25378 raft_consensus.cc:3060] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:30.031836 29691 raft_consensus.cc:2804] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:30.032361 29691 raft_consensus.cc:697] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 14 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:30.032476 29891 raft_consensus.cc:2804] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:30.033109 29891 raft_consensus.cc:697] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 15 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:30.033248 29691 consensus_queue.cc:237] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:30.034040 29891 consensus_queue.cc:237] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:30.039157 29954 consensus_queue.cc:1048] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:29.999635 29765 raft_consensus.cc:3055] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:30.043360 25299 raft_consensus.cc:1275] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:12:29.998735 29948 consensus_queue.cc:1059] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
W20260709 13:12:30.054025 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:30.017103 29732 consensus_queue.cc:1048] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:12:30.044103 29733 raft_consensus.cc:3055] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:30.044566 29765 raft_consensus.cc:740] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:30.056980 25378 raft_consensus.cc:2468] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 15.
W20260709 13:12:30.064358 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 89868.1us
I20260709 13:12:30.052855 29947 consensus_queue.cc:1059] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:12:30.079386 29947 raft_consensus.cc:3055] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:30.079770 29947 raft_consensus.cc:740] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:30.080538 29947 consensus_queue.cc:260] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:30.082005 29947 raft_consensus.cc:3060] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:30.063318 29446 consensus_queue.cc:1059] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:12:30.056831 29733 raft_consensus.cc:740] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:30.068454 29691 consensus_queue.cc:1048] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:12:30.087492 29765 consensus_queue.cc:260] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:30.087323 29733 consensus_queue.cc:260] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:30.070637 29948 raft_consensus.cc:3055] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:12:30.097301 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:30.101315 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 50328.4us
I20260709 13:12:30.088248 29830 consensus_queue.cc:1059] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:12:30.097018 29949 raft_consensus.cc:493] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:30.098681 29948 raft_consensus.cc:740] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:30.122376 25874 leader_election.cc:304] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:30.124804 25874 leader_election.cc:304] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:30.118083 29949 raft_consensus.cc:515] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:30.112195 29733 raft_consensus.cc:3060] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:30.127948 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:30.129494 25905 raft_consensus.cc:2468] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 13.
I20260709 13:12:30.132524 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:30.132447 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:30.133543 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:30.134363 25904 raft_consensus.cc:1240] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:12:30.124337 29765 raft_consensus.cc:3060] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:30.091953 25116 maintenance_manager.cc:643] P 5140a3161b944724a989995efdc4a818: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 7.702s	user 0.186s	sys 0.084s Metrics: {"bytes_written":30463,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":535214,"dirs.run_cpu_time_us":617,"dirs.run_wall_time_us":63100,"drs_written":1,"lbm_read_time_us":199564,"lbm_reads_1-10_ms":1,"lbm_reads_10-100_ms":2,"lbm_reads_gt_100_ms":1,"lbm_write_time_us":40252,"lbm_writes_1-10_ms":2,"lbm_writes_10-100_ms":2,"lbm_writes_lt_1ms":30,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":70438,"threads_started":1,"update_count":9}
I20260709 13:12:30.128578 29952 raft_consensus.cc:2749] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:30.135289 29965 raft_consensus.cc:2749] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:30.170050 25903 raft_consensus.cc:1240] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:30.169926 29945 consensus_queue.cc:1059] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:12:30.170936 29945 raft_consensus.cc:3055] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:30.171272 29945 raft_consensus.cc:740] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:30.172034 29945 consensus_queue.cc:260] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:30.173188 29945 raft_consensus.cc:3060] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:12:30.175091 25271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:30.176043 25373 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36254 (request call id 2305) took 1599 ms (client timeout 2069 ms). Trace:
W20260709 13:12:30.176429 25373 rpcz_store.cc:269] 0709 13:12:28.576355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:28.618180 (+ 41825us) service_pool.cc:224] Handling call
0709 13:12:30.175853 (+1557673us) spinlock_profiling.cc:243] Waited 26 ms on lock 0x7b54002e0754. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:30.175987 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":59799296}
I20260709 13:12:30.176990 25301 raft_consensus.cc:1275] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:12:30.177448 25345 connection.cc:256] RPC call timeout handler was delayed by -1.0683589140001004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2158s for a response
I20260709 13:12:30.178473 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:30.179131 25303 raft_consensus.cc:2468] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 12.
I20260709 13:12:30.180914 29587 raft_consensus.cc:3055] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:30.181319 29587 raft_consensus.cc:740] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:30.182232 29587 consensus_queue.cc:260] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:30.183368 29587 raft_consensus.cc:3060] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:30.192847 29908 raft_consensus.cc:493] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.193481 29908 raft_consensus.cc:515] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:30.194002 29922 raft_consensus.cc:3055] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:30.194224 29645 raft_consensus.cc:515] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:30.194670 29922 raft_consensus.cc:740] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:30.195511 29922 consensus_queue.cc:260] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:30.196344 29645 leader_election.cc:290] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:30.196677 29922 raft_consensus.cc:3060] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:30.199407 25300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57256 (request call id 2178) took 1173 ms. Trace:
I20260709 13:12:30.199466 29908 leader_election.cc:290] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:30.199896 25300 rpcz_store.cc:276] 0709 13:12:29.028056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:29.028243 (+   187us) service_pool.cc:224] Handling call
0709 13:12:30.199235 (+1170992us) spinlock_profiling.cc:243] Waited 57.1 ms on lock 0x7b54000f9e54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:30.199351 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":131216256}
I20260709 13:12:30.190704 29970 consensus_queue.cc:1059] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:12:30.202843 29970 raft_consensus.cc:3055] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:30.203195 29970 raft_consensus.cc:740] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:30.205783 29970 consensus_queue.cc:260] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:30.207278 29970 raft_consensus.cc:3060] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:30.210510 29902 raft_consensus.cc:3055] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:30.210948 29902 raft_consensus.cc:740] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:30.211760 29902 consensus_queue.cc:260] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:30.212486 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:30.213006 29902 raft_consensus.cc:3060] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:30.214304 25379 raft_consensus.cc:1240] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 13 LEADER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:30.214641 25222 raft_consensus.cc:1240] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:30.216131 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:30.218400 25379 raft_consensus.cc:1240] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:30.136018 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:30.220258 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:30.136974 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:30.139686 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:30.139760 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:30.226219 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:30.226683 25379 raft_consensus.cc:1275] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:12:30.226964 25373 raft_consensus.cc:2393] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 11: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:30.140443 25901 raft_consensus.cc:1275] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:12:30.149926 29948 consensus_queue.cc:260] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:30.153383 25117 maintenance_manager.cc:419] P 5140a3161b944724a989995efdc4a818: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 9965 bytes on disk
I20260709 13:12:30.151036 29850 raft_consensus.cc:493] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.154075 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:30.229400 29850 raft_consensus.cc:515] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:30.157998 25296 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57272 (request call id 2074) took 2871 ms (client timeout 2027 ms). Trace:
W20260709 13:12:30.230309 25296 rpcz_store.cc:269] 0709 13:12:27.286346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:27.310316 (+ 23970us) service_pool.cc:224] Handling call
0709 13:12:30.157813 (+2847497us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b540009a454. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:30.157907 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2762192256}
I20260709 13:12:30.231441 29850 leader_election.cc:290] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:30.157536 25371 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36264 (request call id 1978) took 1943 ms (client timeout 1833 ms). Trace:
W20260709 13:12:30.232429 25371 rpcz_store.cc:269] 0709 13:12:28.213843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:28.214453 (+   610us) service_pool.cc:224] Handling call
0709 13:12:30.157320 (+1942867us) spinlock_profiling.cc:243] Waited 469 ms on lock 0x7b540033f254. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:30.157471 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1077964160}
I20260709 13:12:30.232878 25116 maintenance_manager.cc:643] P 5140a3161b944724a989995efdc4a818: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":316,"lbm_reads_lt_1ms":4}
I20260709 13:12:30.165633 25370 raft_consensus.cc:1240] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:30.235292 25370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36254 (request call id 2308) took 1634 ms. Trace:
I20260709 13:12:30.235658 25370 rpcz_store.cc:276] 0709 13:12:28.600629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:28.992936 (+392307us) service_pool.cc:224] Handling call
0709 13:12:30.165459 (+1172523us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:30.233619 (+ 68160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:30.235098 (+  1479us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b540033f250. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6e8ad 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:30.235241 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2695905664}
I20260709 13:12:30.138087 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:30.139268 29949 leader_election.cc:290] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:30.142928 25229 raft_consensus.cc:1240] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 13. Current term is 14. Ops: []
W20260709 13:12:30.164548 29944 log.cc:927] Time spent T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.175s	user 0.000s	sys 0.000s
I20260709 13:12:30.227586 29808 raft_consensus.cc:515] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:30.240871 29759 leader_election.cc:290] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:30.242560 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:30.243244 29808 leader_election.cc:290] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:30.243700 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:30.261049 29844 raft_consensus.cc:3055] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:30.261611 29844 raft_consensus.cc:740] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:30.262558 29844 consensus_queue.cc:260] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:30.263610 29844 raft_consensus.cc:3060] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:30.269466 29872 leader_election.cc:290] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:30.277002 29927 consensus_queue.cc:1059] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:12:30.269487 25908 raft_consensus.cc:1275] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:12:30.278973 29957 raft_consensus.cc:3055] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:30.279361 29957 raft_consensus.cc:740] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:30.280198 29957 consensus_queue.cc:260] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:30.278297 29927 consensus_queue.cc:1059] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:12:30.294374 29927 consensus_queue.cc:1243] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer 1f539ba21487460085b837e7529a78ce log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:12:30.294971 29966 raft_consensus.cc:3055] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:30.295401 29966 raft_consensus.cc:740] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:30.296454 29966 consensus_queue.cc:260] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:30.302095 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:30.303678 29957 raft_consensus.cc:3060] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:30.342358 25223 raft_consensus.cc:2468] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 10.
I20260709 13:12:30.358583 29812 raft_consensus.cc:3055] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:30.359294 29812 raft_consensus.cc:740] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:30.360428 29812 consensus_queue.cc:260] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:30.362480 29812 raft_consensus.cc:3060] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:30.461998 25114 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 8d0f43a786a846b49924a589e4a36f2f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 79d99c0e498349bda74127365219e468 (127.23.140.67:34091) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 79d99c0e498349bda74127365219e468 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
W20260709 13:12:30.518850 29943 log.cc:927] Time spent T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.538s	user 0.003s	sys 0.002s
I20260709 13:12:30.563421 29934 raft_consensus.cc:493] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.564285 29934 raft_consensus.cc:515] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:30.566854 29934 leader_election.cc:290] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:30.572713 29973 raft_consensus.cc:493] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:30.573319 29973 raft_consensus.cc:515] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:30.575490 29973 leader_election.cc:290] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:30.576861 29973 raft_consensus.cc:493] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
W20260709 13:12:30.579275 29815 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.965s	user 0.012s	sys 0.007s
I20260709 13:12:30.579358 29970 raft_consensus.cc:493] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
W20260709 13:12:30.579640 29815 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.997s	user 0.012s	sys 0.007s
I20260709 13:12:30.579991 29970 raft_consensus.cc:515] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:30.563483 29961 raft_consensus.cc:493] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.582597 29961 raft_consensus.cc:515] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:30.584297 29970 leader_election.cc:290] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:30.585142 29947 raft_consensus.cc:493] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:30.585788 29947 raft_consensus.cc:515] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:30.587392 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:30.587530 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:30.587999 25228 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 7.
I20260709 13:12:30.588498 29947 leader_election.cc:290] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:30.588896 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
W20260709 13:12:30.585843 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 311289us
I20260709 13:12:30.589639 25228 raft_consensus.cc:2393] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 11: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:30.589203 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:30.590323 25226 raft_consensus.cc:2393] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 13: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:30.586283 25222 raft_consensus.cc:1240] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:30.577307 29973 raft_consensus.cc:515] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:30.592602 29973 leader_election.cc:290] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:30.593672 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:12:30.595130 25874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:30.595244 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
W20260709 13:12:30.595901 25874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:30.602111 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:30.604034 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:30.604995 25226 raft_consensus.cc:2393] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 13: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:30.605479 29973 raft_consensus.cc:493] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.605851 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:30.606040 29973 raft_consensus.cc:515] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:30.606495 25228 raft_consensus.cc:2468] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 13.
I20260709 13:12:30.607647 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:30.608644 29973 leader_election.cc:290] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:30.585559 29961 leader_election.cc:290] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:30.610203 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:30.610935 25224 raft_consensus.cc:2393] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 15: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:30.613600 25226 raft_consensus.cc:1240] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 11. Current term is 12. Ops: []
W20260709 13:12:30.614439 25194 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.002s	sys 0.014s
W20260709 13:12:30.614858 25194 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.003s	sys 0.014s
I20260709 13:12:30.614537 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:30.616055 25224 raft_consensus.cc:2393] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 12: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:30.616189 25222 raft_consensus.cc:2468] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 12.
I20260709 13:12:30.618098 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:30.618835 25222 raft_consensus.cc:2410] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
W20260709 13:12:30.618153 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 570660us
I20260709 13:12:30.619622 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:30.620266 25224 raft_consensus.cc:2468] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 10.
I20260709 13:12:30.621482 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:30.621604 25194 leader_election.cc:304] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:12:30.622184 25224 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 9.
I20260709 13:12:30.623445 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:30.625217 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:30.626969 29947 raft_consensus.cc:2804] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:12:30.627311 25305 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.015s	sys 0.000s
W20260709 13:12:30.627641 25305 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.015s	sys 0.000s
I20260709 13:12:30.627591 29947 raft_consensus.cc:697] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 10 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:30.628686 29947 consensus_queue.cc:237] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:30.638957 25194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:30.639102 25195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:30.638854 29973 raft_consensus.cc:493] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:30.639814 29973 raft_consensus.cc:515] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:30.642555 29973 leader_election.cc:290] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:30.644907 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:12:30.648875 25871 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:30.649430 25871 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:30.656322 25905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50058 (request call id 837) took 2062 ms. Trace:
I20260709 13:12:30.656821 25905 rpcz_store.cc:276] 0709 13:12:28.594099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:29.856558 (+1262459us) service_pool.cc:224] Handling call
0709 13:12:30.656107 (+799549us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b5400640354. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:30.656232 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":589181184}
I20260709 13:12:30.661037 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:30.662351 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:30.662425 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:30.663371 25221 raft_consensus.cc:2393] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 11: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:30.663313 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:30.663334 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:30.665696 25224 raft_consensus.cc:2410] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:12:30.667340 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:30.667850 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:30.668377 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:30.669045 25230 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 7.
I20260709 13:12:30.669967 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
W20260709 13:12:30.670487 25271 leader_election.cc:336] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Timed out: RequestConsensusVote RPC to 127.23.140.65:39361 timed out after 1.943s (SENT)
I20260709 13:12:30.670934 25271 leader_election.cc:304] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:30.671656 29801 raft_consensus.cc:2749] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:30.670652 25224 raft_consensus.cc:2393] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 11: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:30.674530 29801 raft_consensus.cc:493] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.674991 29801 raft_consensus.cc:515] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:30.668411 25222 raft_consensus.cc:2468] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 14.
I20260709 13:12:30.677439 29801 leader_election.cc:290] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:30.684235 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:30.685503 25908 raft_consensus.cc:2393] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 12: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:30.173535 25903 raft_consensus.cc:1275] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:12:30.692363 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:30.692598 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:30.693256 25305 raft_consensus.cc:2393] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 12: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:30.693449 25227 raft_consensus.cc:2410] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:12:30.688411 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:30.695376 25226 raft_consensus.cc:2368] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for earlier term 13. Current term is 14.
I20260709 13:12:30.696350 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:30.696485 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:30.696604 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:30.697310 25305 raft_consensus.cc:2410] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:12:30.698004 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:30.698551 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:30.698927 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:30.699692 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:30.700439 25301 raft_consensus.cc:2393] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 11: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:30.700966 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:30.702353 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:30.702929 25222 raft_consensus.cc:2376] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 12. Re-sending same reply.
I20260709 13:12:30.703586 25301 raft_consensus.cc:1240] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:30.705628 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:12:30.707015 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:30.707617 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:30.707995 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:30.709671 25222 raft_consensus.cc:2468] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 14.
I20260709 13:12:30.710986 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:12:30.759611 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:30.724509 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:30.712837 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:30.711865 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:30.743896 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:30.765662 25221 raft_consensus.cc:2393] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 12: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:30.717607 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:30.769025 25224 raft_consensus.cc:2468] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 10.
I20260709 13:12:30.769591 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:30.769989 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:30.765879 25222 raft_consensus.cc:2393] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 12: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:30.770659 25224 raft_consensus.cc:2468] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 13.
I20260709 13:12:30.771421 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:30.765844 25305 raft_consensus.cc:3060] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:30.724871 25225 raft_consensus.cc:1275] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 13:12:30.772809 25225 pending_rounds.cc:85] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce: Aborting all ops after (but not including) 10
I20260709 13:12:30.773039 25225 pending_rounds.cc:107] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:12:30.773267 25225 raft_consensus.cc:2889] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:30.746212 29832 raft_consensus.cc:493] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.774911 29832 raft_consensus.cc:515] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:30.777000 29832 leader_election.cc:290] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:30.766389 25226 raft_consensus.cc:3060] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:30.778916 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:30.779713 25222 raft_consensus.cc:2393] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 10: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:30.743896 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:30.767709 25300 raft_consensus.cc:1240] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 13 LEADER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:12:30.780763 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:30.781435 25300 raft_consensus.cc:2393] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 12: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
W20260709 13:12:30.781561 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:30.712324 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:30.783383 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:30.784364 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:30.784898 25300 raft_consensus.cc:2393] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 13: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:30.785833 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:30.782191 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:30.786442 25300 raft_consensus.cc:2468] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 12.
I20260709 13:12:30.786931 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:30.787763 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:30.788902 25222 raft_consensus.cc:2393] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 12: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:30.789646 25305 raft_consensus.cc:2468] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 14.
W20260709 13:12:30.791208 25271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:30.791917 25271 leader_election.cc:336] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Timed out: RequestConsensusVote RPC to 127.23.140.65:39361 timed out after 1.501s (SENT)
I20260709 13:12:30.792347 25271 leader_election.cc:304] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:30.793819 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:30.794273 25225 raft_consensus.cc:1240] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 12 LEADER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:12:30.795290 25222 raft_consensus.cc:1275] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:12:30.795459 25227 raft_consensus.cc:1240] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:30.795650 25222 pending_rounds.cc:85] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce: Aborting all ops after (but not including) 10
I20260709 13:12:30.796312 25222 pending_rounds.cc:107] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:12:30.796526 25222 raft_consensus.cc:2889] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:30.797086 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:30.798101 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:30.793896 29939 raft_consensus.cc:2749] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:30.799633 25305 raft_consensus.cc:1275] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:12:30.801578 25305 raft_consensus.cc:1275] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:12:30.802436 29939 raft_consensus.cc:493] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.802983 29939 raft_consensus.cc:515] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:30.805029 29939 leader_election.cc:290] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:30.821240 25226 raft_consensus.cc:2468] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 15.
W20260709 13:12:30.830574 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:30.908234 25271 leader_election.cc:304] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
W20260709 13:12:30.884202 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:30.813692 25230 raft_consensus.cc:2468] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 14.
I20260709 13:12:30.814178 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:30.910307 25194 leader_election.cc:304] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:30.912995 25271 leader_election.cc:304] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:30.914162 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:30.914618 25305 raft_consensus.cc:1240] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:30.914780 25194 leader_election.cc:304] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:30.916321 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:30.917470 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:30.916337 25194 leader_election.cc:304] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:30.918418 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:30.919477 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:30.920815 25224 raft_consensus.cc:2410] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 14 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 5.
I20260709 13:12:30.834227 29947 raft_consensus.cc:493] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.921413 25222 raft_consensus.cc:2393] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 12: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:30.915652 29832 raft_consensus.cc:3060] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:30.924455 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:30.915822 29973 raft_consensus.cc:2749] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:30.924043 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:30.922329 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:30.927687 25227 raft_consensus.cc:2393] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 16: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:30.918190 29970 consensus_queue.cc:1059] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:12:30.924988 29961 raft_consensus.cc:2804] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:30.924177 29732 raft_consensus.cc:2804] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:30.925536 29947 raft_consensus.cc:515] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:30.930454 25271 leader_election.cc:304] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:30.933921 29939 raft_consensus.cc:2749] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:30.938835 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:30.958563 29939 raft_consensus.cc:3060] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:30.958886 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:12:30.960039 25296 consensus_meta.cc:287] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.717s	user 0.011s	sys 0.000s
I20260709 13:12:30.960093 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:30.940291 29970 raft_consensus.cc:3055] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:30.942484 29947 leader_election.cc:290] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:30.942915 29732 raft_consensus.cc:697] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 14 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:30.961274 29970 raft_consensus.cc:740] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:30.961592 29732 consensus_queue.cc:237] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:30.960551 29902 consensus_meta.cc:287] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.747s	user 0.005s	sys 0.009s
I20260709 13:12:30.962200 29970 consensus_queue.cc:260] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:30.963294 29970 raft_consensus.cc:3060] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:30.963833 29832 raft_consensus.cc:2749] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:30.941898 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:30.968765 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:30.950171 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:30.971714 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:30.972378 25221 raft_consensus.cc:2468] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 11.
I20260709 13:12:30.973268 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:30.948200 25297 raft_consensus.cc:1240] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:30.973824 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:30.974495 25901 raft_consensus.cc:2468] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 13.
I20260709 13:12:30.974954 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:30.976008 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:30.976603 29939 raft_consensus.cc:2749] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:30.941557 29966 raft_consensus.cc:3060] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:30.942598 29973 consensus_queue.cc:1048] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:12:30.978499 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:30.980288 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:30.960525 25296 raft_consensus.cc:2468] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 10.
I20260709 13:12:30.949445 25271 leader_election.cc:304] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:30.970503 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:30.981815 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:30.982424 25221 raft_consensus.cc:2468] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 11.
I20260709 13:12:30.982937 25271 leader_election.cc:304] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:30.983256 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:30.984912 25221 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 7.
I20260709 13:12:30.984776 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:30.985633 25225 raft_consensus.cc:2468] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 13.
I20260709 13:12:30.987334 29832 raft_consensus.cc:2749] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:30.983870 29939 raft_consensus.cc:2749] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:30.988921 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:30.989212 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:30.990520 25225 raft_consensus.cc:1275] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:12:30.991740 25225 raft_consensus.cc:1275] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 13:12:30.992015 25225 pending_rounds.cc:85] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce: Aborting all ops after (but not including) 8
I20260709 13:12:30.992213 25225 pending_rounds.cc:107] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 13:12:30.992435 25225 raft_consensus.cc:2889] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:30.993503 25225 raft_consensus.cc:3055] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:30.993839 25225 raft_consensus.cc:740] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:30.994536 25225 consensus_queue.cc:260] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:30.995502 25225 raft_consensus.cc:3060] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:30.996148 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:31.000006 25344 leader_election.cc:304] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:30.997639 25271 leader_election.cc:304] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:31.001037 29939 raft_consensus.cc:2749] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:31.002400 25271 leader_election.cc:304] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:31.003140 29939 raft_consensus.cc:2749] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:31.004293 25271 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:31.005033 29939 raft_consensus.cc:2804] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:31.005450 29939 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:31.005887 29939 raft_consensus.cc:3060] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:31.017084 25229 raft_consensus.cc:1240] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:12:31.021687 29948 raft_consensus.cc:3060] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:31.031322 25344 leader_election.cc:304] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:31.032823 25344 leader_election.cc:304] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:31.035315 29988 raft_consensus.cc:493] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.035836 29988 raft_consensus.cc:515] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:31.038460 25271 leader_election.cc:400] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361) with higher term. Message: Invalid argument: T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for earlier term 13. Current term is 14.
I20260709 13:12:31.038878 25271 leader_election.cc:403] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:31.027462 29939 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:31.041772 29832 raft_consensus.cc:2749] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361) with higher term. Message: Invalid argument: T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for earlier term 13. Current term is 14.
I20260709 13:12:31.043280 25271 leader_election.cc:304] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:31.044564 25228 raft_consensus.cc:2468] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 11.
I20260709 13:12:31.043843 25222 raft_consensus.cc:2468] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 11.
I20260709 13:12:31.046360 25271 leader_election.cc:304] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:31.047778 29832 raft_consensus.cc:2749] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:31.048421 29802 raft_consensus.cc:2749] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:31.044597 29939 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:31.049161 29802 raft_consensus.cc:2749] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:31.049829 29802 consensus_queue.cc:1048] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:12:31.050259 25271 leader_election.cc:304] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:31.051074 29832 raft_consensus.cc:2749] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:31.051698 29832 raft_consensus.cc:2804] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:31.052295 29832 raft_consensus.cc:697] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 12 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:31.053246 29832 consensus_queue.cc:237] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:31.052330 25271 leader_election.cc:304] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:12:31.062480 29902 raft_consensus.cc:2804] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:31.063014 29902 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:31.063413 29902 raft_consensus.cc:3060] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:12:31.065415 25874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:31.071947 25271 leader_election.cc:304] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:12:31.076750 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:31.077458 29966 raft_consensus.cc:493] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.078047 29966 raft_consensus.cc:515] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:31.081962 25296 raft_consensus.cc:1240] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:31.082389 25271 leader_election.cc:304] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:31.051663 29802 raft_consensus.cc:2749] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:31.084033 25271 leader_election.cc:304] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:31.085078 25296 raft_consensus.cc:1240] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:31.086138 25297 raft_consensus.cc:1240] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:31.089764 25297 raft_consensus.cc:1240] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:31.092962 29966 leader_election.cc:290] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:31.093765 29802 consensus_queue.cc:1048] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:12:31.045632 29988 leader_election.cc:290] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:31.096756 29988 consensus_queue.cc:1048] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:31.097901 29939 raft_consensus.cc:493] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.098462 29939 raft_consensus.cc:515] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:31.100739 29939 leader_election.cc:290] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:31.100885 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:31.101701 25900 raft_consensus.cc:2410] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
W20260709 13:12:31.101970 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 96946.1us
I20260709 13:12:31.101475 29902 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:31.108109 29902 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:31.108750 29902 raft_consensus.cc:2804] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:31.109134 29902 raft_consensus.cc:493] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:31.109501 29902 raft_consensus.cc:3060] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:31.111284 25195 leader_election.cc:304] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:31.112277 25195 leader_election.cc:304] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:31.113057 29732 raft_consensus.cc:2749] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:31.113657 29732 raft_consensus.cc:2804] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:31.114008 29732 raft_consensus.cc:493] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:31.114365 29732 raft_consensus.cc:3060] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:31.114470 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:31.115154 25227 raft_consensus.cc:2468] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 16.
I20260709 13:12:31.115379 29939 raft_consensus.cc:2749] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:31.116176 29939 raft_consensus.cc:2804] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:31.116649 29939 raft_consensus.cc:697] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 15 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:31.120030 25271 leader_election.cc:304] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:31.121619 25271 leader_election.cc:304] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:31.129489 25343 leader_election.cc:304] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:31.129312 25874 leader_election.cc:304] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:12:31.131096 25343 leader_election.cc:304] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:31.132203 25343 leader_election.cc:304] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:31.133363 25271 leader_election.cc:304] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
W20260709 13:12:31.133986 25195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:31.135730 25271 leader_election.cc:304] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:31.132639 29927 raft_consensus.cc:2804] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:31.136924 25271 leader_election.cc:304] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:31.134585 25270 leader_election.cc:304] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:31.138897 25271 leader_election.cc:304] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:31.123026 29939 consensus_queue.cc:237] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:31.145704 29802 consensus_queue.cc:1048] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:31.138221 29927 raft_consensus.cc:493] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:31.147194 29992 consensus_queue.cc:1048] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:31.153656 29927 raft_consensus.cc:3060] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:31.160954 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:31.163957 25227 raft_consensus.cc:3060] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:31.161226 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:31.161504 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:31.165899 25225 raft_consensus.cc:2393] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 14: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:31.168874 29759 raft_consensus.cc:2804] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:31.169520 29759 raft_consensus.cc:493] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:31.170893 29903 raft_consensus.cc:2749] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:31.172477 29904 raft_consensus.cc:2804] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:31.174588 29910 raft_consensus.cc:2749] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:12:31.178334 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:31.180721 29801 raft_consensus.cc:2804] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:31.185279 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:12:31.236305 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:31.236806 25378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56308 (request call id 779) took 1010 ms. Trace:
I20260709 13:12:31.159377 29732 raft_consensus.cc:515] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:31.198011 25370 raft_consensus.cc:1240] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:31.159071 29995 raft_consensus.cc:493] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.163362 29832 raft_consensus.cc:2749] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:12:31.205698 25194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:31.205977 29948 consensus_queue.cc:1059] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:12:31.210654 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:31.166994 29970 consensus_queue.cc:1048] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:12:31.215349 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:31.206534 29992 raft_consensus.cc:2804] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:31.227399 29904 raft_consensus.cc:493] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:31.217206 25374 raft_consensus.cc:1240] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:12:31.218668 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:31.204604 29934 raft_consensus.cc:493] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.209054 29902 raft_consensus.cc:515] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
W20260709 13:12:31.224148 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:31.227921 25227 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 8.
I20260709 13:12:31.253623 25300 raft_consensus.cc:1275] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:12:31.237350 25378 rpcz_store.cc:276] 0709 13:12:30.226066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.184874 (+958808us) service_pool.cc:224] Handling call
0709 13:12:31.236722 (+ 51848us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:31.226994 29759 raft_consensus.cc:3060] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:31.248409 25222 raft_consensus.cc:2468] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 13.
I20260709 13:12:31.216429 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:31.257054 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:31.257571 25371 raft_consensus.cc:2468] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 7.
I20260709 13:12:31.254843 25305 raft_consensus.cc:1275] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:12:31.252348 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:31.238631 29947 raft_consensus.cc:493] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.238451 29801 raft_consensus.cc:493] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:31.258774 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:31.259351 25305 raft_consensus.cc:2468] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 12.
I20260709 13:12:31.264302 25296 raft_consensus.cc:1275] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:12:31.255170 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:31.275003 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:31.275635 25374 raft_consensus.cc:2468] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 13.
I20260709 13:12:31.276669 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:31.277393 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:31.277963 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:31.278617 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:31.279343 25221 raft_consensus.cc:2393] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 10: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:31.280229 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:12:31.279258 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 144930us
I20260709 13:12:31.278627 25375 raft_consensus.cc:2393] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 12: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:31.281461 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:31.249939 29992 raft_consensus.cc:493] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:31.253994 29904 raft_consensus.cc:3060] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:31.282883 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:31.283778 25225 raft_consensus.cc:1275] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:12:31.304512 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:31.249727 29903 raft_consensus.cc:2804] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:31.284904 25221 raft_consensus.cc:1275] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:12:31.283793 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:31.277236 29832 raft_consensus.cc:493] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.287339 25229 raft_consensus.cc:2393] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 13: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:31.287927 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:31.389184 25371 raft_consensus.cc:2468] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 13.
I20260709 13:12:31.390480 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:31.289081 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:12:31.287115 25345 connection.cc:256] RPC call timeout handler was delayed by -1.089759863999916s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17490000000000003s for a response
W20260709 13:12:31.391883 25345 connection.cc:256] RPC call timeout handler was delayed by -1.0838601859999244s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21920000000000003s for a response
W20260709 13:12:31.392271 25345 connection.cc:256] RPC call timeout handler was delayed by -1.0402598639999496s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1804s for a response
I20260709 13:12:31.282228 25270 leader_election.cc:304] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
W20260709 13:12:31.394169 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 112017us
I20260709 13:12:31.395695 25270 leader_election.cc:400] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091) with higher term. Message: Invalid argument: T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for earlier term 10. Current term is 11.
I20260709 13:12:31.396055 25270 leader_election.cc:403] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:31.286551 25195 leader_election.cc:304] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
W20260709 13:12:31.397250 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 110769us
W20260709 13:12:31.294972 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 150922us
I20260709 13:12:31.403080 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:31.295737 29732 leader_election.cc:290] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:31.305646 25230 raft_consensus.cc:3055] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:31.407197 25230 raft_consensus.cc:740] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:31.302219 29992 raft_consensus.cc:3060] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:31.274628 29801 raft_consensus.cc:3060] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:12:31.312333 25251 debug-util.cc:398] Leaking SignalData structure 0x7b08001e04e0 after lost signal to thread 24116
I20260709 13:12:31.252502 29998 raft_consensus.cc:2749] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:31.382148 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:31.383167 25372 raft_consensus.cc:2393] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 12: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:31.291468 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:31.404111 25378 raft_consensus.cc:2410] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:12:31.404718 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:31.427834 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:31.428457 25371 raft_consensus.cc:2468] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 9.
W20260709 13:12:31.319667 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:31.411638 25230 consensus_queue.cc:260] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:31.430888 25230 raft_consensus.cc:3060] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:31.412623 25195 leader_election.cc:304] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:31.246908 29995 raft_consensus.cc:515] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:31.290951 29948 consensus_queue.cc:1048] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.117s
I20260709 13:12:31.277447 29934 raft_consensus.cc:515] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:31.436206 25223 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54000 (request call id 805) took 2816 ms (client timeout 2730 ms). Trace:
I20260709 13:12:31.440430 25343 leader_election.cc:304] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:31.442250 25305 raft_consensus.cc:1240] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 13. Current term is 14. Ops: []
W20260709 13:12:31.443130 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 47606.2us
I20260709 13:12:31.444371 29998 raft_consensus.cc:2804] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:31.445012 29998 raft_consensus.cc:697] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 12 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:31.282390 29947 raft_consensus.cc:515] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:31.438836 25223 rpcz_store.cc:269] 0709 13:12:28.619806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:28.630618 (+ 10812us) service_pool.cc:224] Handling call
0709 13:12:31.436055 (+2805437us) spinlock_profiling.cc:243] Waited 78.6 ms on lock 0x7b5400196254. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:31.436144 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":180709120}
I20260709 13:12:31.449131 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:31.450462 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:31.450691 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:31.451226 25378 raft_consensus.cc:2468] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 10.
I20260709 13:12:31.452824 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:31.429577 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:31.454248 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:31.454859 25372 raft_consensus.cc:2468] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 13.
W20260709 13:12:31.455353 25251 debug-util.cc:398] Leaking SignalData structure 0x7b08000bc8a0 after lost signal to thread 25162
W20260709 13:12:31.456591 25251 debug-util.cc:398] Leaking SignalData structure 0x7b080024ef40 after lost signal to thread 25254
W20260709 13:12:31.457406 25251 debug-util.cc:398] Leaking SignalData structure 0x7b08001581c0 after lost signal to thread 25255
I20260709 13:12:31.458686 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:31.459395 25378 raft_consensus.cc:2393] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 10: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:31.413960 29973 raft_consensus.cc:2749] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:31.462458 25374 raft_consensus.cc:1240] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 11 LEADER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:31.466136 25371 raft_consensus.cc:1240] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 14 LEADER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:31.466966 25378 raft_consensus.cc:1240] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 15 LEADER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:31.468117 25378 raft_consensus.cc:1240] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:31.472326 25373 raft_consensus.cc:2410] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:12:31.475595 25372 raft_consensus.cc:1240] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 11 LEADER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:31.477020 25372 raft_consensus.cc:1275] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 13:12:31.477331 25372 pending_rounds.cc:85] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468: Aborting all ops after (but not including) 8
I20260709 13:12:31.477533 25372 pending_rounds.cc:107] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:12:31.477766 25372 raft_consensus.cc:2889] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:31.478885 30010 raft_consensus.cc:493] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:31.479049 25372 raft_consensus.cc:1275] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:12:31.479426 30010 raft_consensus.cc:515] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:31.480058 25372 raft_consensus.cc:3060] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:30.649715 25871 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:31.539088 29934 leader_election.cc:290] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:31.539076 25372 raft_consensus.cc:1275] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:12:31.540359 29947 leader_election.cc:290] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:31.447080 29733 raft_consensus.cc:2749] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:12:31.548476 25126 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40026 (request call id 242) took 33395 ms (client timeout 15000 ms). Trace:
I20260709 13:12:31.402535 29832 raft_consensus.cc:515] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:31.550267 25230 raft_consensus.cc:1275] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 7. (term mismatch)
I20260709 13:12:31.558192 25230 pending_rounds.cc:85] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce: Aborting all ops after (but not including) 6
I20260709 13:12:31.561296 25230 pending_rounds.cc:107] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce: Aborting uncommitted NO_OP operation due to leader change: 14.7
I20260709 13:12:31.563205 25230 raft_consensus.cc:2889] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:12:31.548992 25126 rpcz_store.cc:269] 0709 13:11:58.153013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:58.174237 (+ 21224us) service_pool.cc:224] Handling call
0709 13:12:31.548403 (+33374166us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:25.185842 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:25.186504 (+   662us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:25.186549 (+    45us) write_op.cc:435] Acquired schema lock
0709 13:12:25.186563 (+    14us) tablet.cc:662] Decoding operations
0709 13:12:25.207968 (+ 21405us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:25.208039 (+    71us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:25.208066 (+    27us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:12:25.208819 (+   753us) tablet.cc:701] Row locks acquired
0709 13:12:25.208876 (+    57us) write_op.cc:260] PREPARE: finished
0709 13:12:25.209044 (+   168us) write_op.cc:270] Start()
0709 13:12:25.209167 (+   123us) write_op.cc:276] Timestamp: P: 1783602745208977 usec, L: 0
0709 13:12:25.209186 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:12:25.209929 (+   743us) log.cc:844] Serialized 3631 byte log entry
0709 13:12:25.724233 (+514304us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b4400022b4c. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72caa8c85 00007fd72caa96a2 00007fd72f81b1db 00007fd72f816aaf 00007fd72cb650ac 00007fd7359bfab9 00007fd72cb8169b 00007fd72cb7f93f 00007fd72cb81c02 00007fd72f80920b
0709 13:12:26.258617 (+534384us) op_driver.cc:464] REPLICATION: finished
0709 13:12:27.386595 (+1127978us) write_op.cc:301] APPLY: starting
0709 13:12:27.426628 (+ 40033us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:27.988689 (+562061us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:28.005341 (+ 16652us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:28.217538 (+212197us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:28.217906 (+   368us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=18
0709 13:12:28.217956 (+    50us) write_op.cc:312] APPLY: finished
0709 13:12:28.218342 (+   386us) log.cc:844] Serialized 71 byte log entry
0709 13:12:28.503051 (+284709us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:28.521868 (+ 18817us) write_op.cc:454] Released schema lock
0709 13:12:28.530038 (+  8170us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:28.568655 (+ 38617us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:28.570961 (+  2306us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1968661,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":1013487,"apply.run_cpu_time_us":40468,"apply.run_wall_time_us":1233572,"num_ops":9,"prepare.queue_time_us":270542,"prepare.run_cpu_time_us":99565,"prepare.run_wall_time_us":761529,"raft.queue_time_us":182484,"raft.run_cpu_time_us":20607,"raft.run_wall_time_us":487567,"replication_time_us":1006974,"spinlock_wait_cycles":37576064,"thread_start_us":1589881,"threads_started":5,"wal-append.queue_time_us":1011900,"wal-append.run_cpu_time_us":17351,"wal-append.run_wall_time_us":1202239}]]}
I20260709 13:12:31.569728 29902 leader_election.cc:290] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361)
I20260709 13:12:31.572844 25302 raft_consensus.cc:1240] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:31.583024 25229 raft_consensus.cc:1275] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:12:31.584245 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:31.585880 29815 consensus_queue.cc:1059] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:12:31.583792 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 178289us
I20260709 13:12:31.586845 29733 raft_consensus.cc:3055] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:31.587461 29733 raft_consensus.cc:740] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:31.588318 29733 consensus_queue.cc:260] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:31.588939 29961 raft_consensus.cc:493] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:31.589381 29961 raft_consensus.cc:3060] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:31.589529 29733 raft_consensus.cc:3060] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:31.591638 29832 leader_election.cc:290] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:31.592880 29904 raft_consensus.cc:515] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:31.463009 29970 consensus_queue.cc:1059] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.112s
I20260709 13:12:31.600878 25223 raft_consensus.cc:2468] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 13.
I20260709 13:12:31.603701 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:31.609815 25375 raft_consensus.cc:2393] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 12: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:31.613906 25904 raft_consensus.cc:2468] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 13.
I20260709 13:12:31.614207 29903 raft_consensus.cc:697] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 14 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:31.615247 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:31.615218 29903 consensus_queue.cc:237] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:31.616082 25901 raft_consensus.cc:2468] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 11.
I20260709 13:12:31.597085 29948 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.617939 25901 raft_consensus.cc:1275] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:12:31.619295 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:31.626364 25271 leader_election.cc:304] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:31.630280 25195 leader_election.cc:304] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:12:31.632200 25195 leader_election.cc:304] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:12:31.574258 29927 raft_consensus.cc:515] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:31.630487 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:31.638940 29999 raft_consensus.cc:2749] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091) with higher term. Message: Invalid argument: T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for earlier term 10. Current term is 11.
W20260709 13:12:31.642678 25251 debug-util.cc:398] Leaking SignalData structure 0x7b08002a03e0 after lost signal to thread 25329
W20260709 13:12:31.643041 25251 debug-util.cc:398] Leaking SignalData structure 0x7b080034e3c0 after lost signal to thread 25330
I20260709 13:12:31.645820 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:31.646523 25298 raft_consensus.cc:2468] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 12.
I20260709 13:12:31.647405 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:31.647488 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:31.648262 25298 raft_consensus.cc:2393] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 13: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:31.648581 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:31.649199 25300 raft_consensus.cc:2468] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 11.
I20260709 13:12:31.649312 25298 raft_consensus.cc:1275] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
W20260709 13:12:31.649688 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:31.654060 25194 leader_election.cc:304] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:31.634274 29902 raft_consensus.cc:2804] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:31.656950 25900 raft_consensus.cc:1240] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:12:31.634909 29970 raft_consensus.cc:2804] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:12:31.661806 25874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:31.638851 29973 raft_consensus.cc:2804] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:31.662684 29732 raft_consensus.cc:2804] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:31.667646 29732 raft_consensus.cc:493] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:31.667979 29732 raft_consensus.cc:3060] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:31.668510 29904 leader_election.cc:290] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:31.633658 29832 consensus_queue.cc:1048] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
W20260709 13:12:31.673213 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 280242us
I20260709 13:12:31.674014 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:31.674620 25223 raft_consensus.cc:2468] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 10.
I20260709 13:12:31.633322 29948 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:31.639935 29733 consensus_queue.cc:1048] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:12:31.610086 30010 leader_election.cc:290] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:31.665212 29973 raft_consensus.cc:493] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:31.603456 29998 consensus_queue.cc:237] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:31.685660 29733 consensus_queue.cc:1243] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer 6c4b021f3f9e41adb75e870a08ad88b6 log is divergent from this leader: its last log entry 13.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:12:31.691226 29973 raft_consensus.cc:3060] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:12:31.710807 25251 debug-util.cc:398] Leaking SignalData structure 0x7b08003f4300 after lost signal to thread 25403
W20260709 13:12:31.716038 25251 debug-util.cc:398] Leaking SignalData structure 0x7b080005b300 after lost signal to thread 25404
W20260709 13:12:31.716104 25195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:31.699128 25400 debug-util.cc:398] Leaking SignalData structure 0x7b0800058800 after lost signal to thread 24116
I20260709 13:12:31.711993 29948 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:31.713599 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 273286us
I20260709 13:12:31.714390 29910 raft_consensus.cc:2804] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:31.714504 25377 raft_consensus.cc:1240] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:31.717563 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:31.719383 25901 raft_consensus.cc:2468] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 15.
I20260709 13:12:31.686579 29947 consensus_queue.cc:1048] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:12:31.720417 25195 leader_election.cc:304] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:12:31.718704 30015 raft_consensus.cc:493] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.729676 25343 leader_election.cc:304] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:31.694418 29801 raft_consensus.cc:515] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:31.734365 30004 consensus_queue.cc:1048] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:12:31.736537 29732 raft_consensus.cc:515] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:31.737854 29927 leader_election.cc:290] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 17 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:31.728701 29910 raft_consensus.cc:697] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 10 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:31.730892 29966 raft_consensus.cc:493] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:31.750862 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:31.750782 29966 raft_consensus.cc:515] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:31.751495 25901 raft_consensus.cc:3060] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:31.752985 29966 leader_election.cc:290] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:31.739048 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:31.723465 30015 raft_consensus.cc:515] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:31.753993 25230 raft_consensus.cc:3060] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:31.755394 30015 leader_election.cc:290] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:31.757077 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:31.757688 25224 raft_consensus.cc:2468] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 12.
I20260709 13:12:31.741518 29802 raft_consensus.cc:2804] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:31.751116 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:31.728766 29948 raft_consensus.cc:2804] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:31.768229 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:31.696863 29992 raft_consensus.cc:515] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:31.768954 25224 raft_consensus.cc:2468] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 13.
I20260709 13:12:31.749629 29732 leader_election.cc:290] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:31.768275 29802 raft_consensus.cc:493] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:31.772812 29802 raft_consensus.cc:3060] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:12:31.774307 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:31.733484 29961 raft_consensus.cc:515] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:31.775437 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:31.776830 29961 leader_election.cc:290] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:31.780419 29808 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 13:12:31.742009 29988 consensus_queue.cc:1048] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:12:31.782687 25297 raft_consensus.cc:2393] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 12: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:31.764226 25230 raft_consensus.cc:2468] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 17.
I20260709 13:12:31.759071 25271 leader_election.cc:304] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:31.753495 29966 raft_consensus.cc:493] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:31.770368 25874 leader_election.cc:304] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:12:31.791148 25874 leader_election.cc:304] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:12:31.789922 25901 raft_consensus.cc:2468] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 14.
I20260709 13:12:31.792393 30015 raft_consensus.cc:2804] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:31.794492 30015 raft_consensus.cc:493] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:31.794668 25400 debug-util.cc:398] Leaking SignalData structure 0x7b080012dbe0 after lost signal to thread 25123
I20260709 13:12:31.795020 30015 raft_consensus.cc:3060] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:12:31.795634 25400 debug-util.cc:398] Leaking SignalData structure 0x7b080012dea0 after lost signal to thread 25162
I20260709 13:12:31.795343 29910 consensus_queue.cc:237] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:31.795701 29966 raft_consensus.cc:515] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:31.794100 30017 log.cc:927] Time spent T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:12:31.768517 29948 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:31.741989 29970 raft_consensus.cc:697] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 13 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:31.768086 29934 raft_consensus.cc:493] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.810369 25195 leader_election.cc:304] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:12:31.812201 25908 pending_rounds.cc:85] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6: Aborting all ops after (but not including) 9
I20260709 13:12:31.818697 25908 pending_rounds.cc:107] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:12:31.818990 25908 raft_consensus.cc:2889] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:12:31.812602 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:31.783072 29927 raft_consensus.cc:493] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.820845 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:31.821483 25903 raft_consensus.cc:2468] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 12.
W20260709 13:12:31.824395 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 75545us
I20260709 13:12:31.814363 29948 raft_consensus.cc:3060] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:12:31.833149 25195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:31.822654 29733 raft_consensus.cc:2804] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:31.850474 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:31.851107 25230 raft_consensus.cc:3060] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:31.852157 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:31.852758 25303 raft_consensus.cc:2468] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 15.
I20260709 13:12:31.837275 29970 consensus_queue.cc:237] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:31.825563 29927 raft_consensus.cc:515] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:31.847589 29801 leader_election.cc:290] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:31.824679 29966 leader_election.cc:290] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:31.848986 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:12:31.869625 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 44464.6us
I20260709 13:12:31.853523 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:31.870558 25303 raft_consensus.cc:3060] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:31.821434 29934 raft_consensus.cc:515] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:31.859930 25230 raft_consensus.cc:2468] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 12.
I20260709 13:12:31.864787 29902 raft_consensus.cc:697] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 13 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:31.874293 25271 leader_election.cc:304] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:31.862919 29991 raft_consensus.cc:493] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:31.874737 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 66611.5us
I20260709 13:12:31.834837 30027 raft_consensus.cc:2804] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:31.864192 29733 raft_consensus.cc:697] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 14 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
W20260709 13:12:31.874593 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:31.890931 25344 leader_election.cc:304] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:31.893631 25303 raft_consensus.cc:2468] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 13.
I20260709 13:12:31.903100 25194 leader_election.cc:304] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:31.904938 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:31.907706 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:31.909885 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
W20260709 13:12:31.884212 29759 consensus_meta.cc:287] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.596s	user 0.005s	sys 0.006s
I20260709 13:12:31.964092 29759 raft_consensus.cc:515] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:31.966238 29759 leader_election.cc:290] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:31.879112 29966 raft_consensus.cc:2804] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:12:31.967658 29966 raft_consensus.cc:697] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:31.968497 29966 consensus_queue.cc:237] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:31.969975 25378 raft_consensus.cc:1240] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 12. Current term is 13. Ops: []
W20260709 13:12:31.970317 25873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:31.914891 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:31.972433 25230 raft_consensus.cc:3060] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:12:31.942421 30018 log.cc:927] Time spent T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
I20260709 13:12:31.878685 30019 raft_consensus.cc:2804] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:31.922812 29809 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:31.885637 30027 raft_consensus.cc:493] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:31.935912 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:31.913318 29808 raft_consensus.cc:2804] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:31.942813 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:31.948027 29733 consensus_queue.cc:237] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:31.951800 25305 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25e0218933774b319104f23505937179"
dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
mode: GRACEFUL
new_leader_uuid: "1f539ba21487460085b837e7529a78ce"
 from {username='slave'} at 127.0.0.1:35660
I20260709 13:12:32.030733 25305 raft_consensus.cc:606] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Received request to transfer leadership to TS 1f539ba21487460085b837e7529a78ce
I20260709 13:12:32.031165 25305 raft_consensus.cc:614] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:31.955072 29961 consensus_queue.cc:1059] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:31.957042 25271 leader_election.cc:304] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:31.957286 30026 raft_consensus.cc:2804] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:31.958985 29934 leader_election.cc:290] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:31.959515 29902 consensus_queue.cc:237] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:12:31.960932 25228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58422 (request call id 2291) took 1353 ms. Trace:
I20260709 13:12:31.961444 29973 raft_consensus.cc:515] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:32.048380 29973 leader_election.cc:290] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:31.962056 29948 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:32.050064 29815 raft_consensus.cc:3055] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:12:32.050379 30032 log.cc:927] Time spent T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:12:32.050547 29815 raft_consensus.cc:740] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:32.050887 29948 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 16 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:31.898307 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:32.051818 25374 raft_consensus.cc:2393] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 14: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:32.051537 29815 consensus_queue.cc:260] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:32.052619 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:32.052927 29815 raft_consensus.cc:3060] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:31.963349 25872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:31.975519 25303 raft_consensus.cc:3060] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:12:31.971602 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:12:31.985613 25194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:32.005887 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:32.006367 25195 leader_election.cc:336] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 1.833s (SENT)
I20260709 13:12:32.053730 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:32.062494 25195 leader_election.cc:304] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:32.014070 25230 raft_consensus.cc:2468] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 14.
I20260709 13:12:31.887390 29991 raft_consensus.cc:515] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:32.063897 25375 raft_consensus.cc:1275] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:12:32.062103 25378 raft_consensus.cc:2468] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 7.
I20260709 13:12:32.028209 29992 leader_election.cc:290] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:32.068120 25303 raft_consensus.cc:2468] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 14.
I20260709 13:12:32.069543 25903 raft_consensus.cc:1275] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:12:32.069803 29765 raft_consensus.cc:493] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.070295 29765 raft_consensus.cc:515] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:32.072309 25907 raft_consensus.cc:3060] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:12:32.073081 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 219689us
I20260709 13:12:32.027712 30027 raft_consensus.cc:3060] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:12:32.074997 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 93330.2us
I20260709 13:12:32.078233 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:32.079051 25903 raft_consensus.cc:2468] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 13.
I20260709 13:12:32.082567 25303 raft_consensus.cc:1240] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:32.084573 25303 raft_consensus.cc:1275] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:12:32.072250 29765 leader_election.cc:290] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:32.034606 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 58515.2us
W20260709 13:12:32.035297 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 78344.9us
I20260709 13:12:32.090526 25270 leader_election.cc:304] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:12:32.035904 29801 raft_consensus.cc:2804] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:32.036505 29808 raft_consensus.cc:697] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 13 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:32.030170 29809 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:32.037871 30034 raft_consensus.cc:493] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.043522 25228 rpcz_store.cc:276] 0709 13:12:30.607343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:30.607448 (+   105us) service_pool.cc:224] Handling call
0709 13:12:31.960783 (+1353335us) spinlock_profiling.cc:243] Waited 436 ms on lock 0x7b5400040954. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:31.960876 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1003449216}
I20260709 13:12:32.056962 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 16 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:32.027856 25377 raft_consensus.cc:2393] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 13: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:32.066139 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:32.062975 25374 raft_consensus.cc:2468] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 12.
I20260709 13:12:32.117113 25271 leader_election.cc:304] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:32.067094 25900 raft_consensus.cc:1275] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:12:32.034554 30019 raft_consensus.cc:697] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 12 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:32.041461 30026 raft_consensus.cc:493] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:32.086573 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:32.087616 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:32.028620 25376 raft_consensus.cc:2468] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 14.
I20260709 13:12:32.121068 25378 raft_consensus.cc:3060] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:32.121518 25907 raft_consensus.cc:1275] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:12:32.095479 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 89145.5us
I20260709 13:12:32.096562 25230 raft_consensus.cc:1275] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:12:32.028493 25871 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:32.098659 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 207829us
I20260709 13:12:32.099562 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:32.138861 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:32.137501 25378 raft_consensus.cc:2468] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 14.
I20260709 13:12:32.139518 25907 raft_consensus.cc:3060] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:32.104753 25270 leader_election.cc:304] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:32.103538 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:32.117929 25345 leader_election.cc:304] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:32.118348 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:32.093052 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:32.124287 30019 consensus_queue.cc:237] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:32.057651 30030 consensus_queue.cc:1048] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.079s
I20260709 13:12:32.125515 30026 raft_consensus.cc:3060] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:32.174712 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:32.125491 30028 consensus_queue.cc:1059] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:32.126726 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:32.127796 30034 raft_consensus.cc:515] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:32.128134 29802 raft_consensus.cc:515] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:32.131413 29808 consensus_queue.cc:237] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:32.133247 30003 raft_consensus.cc:2804] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:32.099445 30022 raft_consensus.cc:493] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.142446 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:32.110389 29801 raft_consensus.cc:493] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:32.100167 29732 raft_consensus.cc:2749] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:32.111850 29832 raft_consensus.cc:493] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:32.122335 29844 consensus_meta.cc:287] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 1.858s	user 0.022s	sys 0.003s
W20260709 13:12:32.149070 25871 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:32.174669 30020 raft_consensus.cc:493] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:32.164860 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 60175.5us
I20260709 13:12:32.166272 25907 raft_consensus.cc:2468] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 16.
I20260709 13:12:32.176514 25298 raft_consensus.cc:3060] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:32.177101 25296 raft_consensus.cc:3060] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:32.151057 29927 leader_election.cc:290] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:32.174804 30036 log.cc:927] Time spent T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:12:32.113517 30023 consensus_queue.cc:1059] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:12:32.195029 25906 raft_consensus.cc:3060] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:32.137472 29910 consensus_queue.cc:1048] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:12:32.123199 30015 raft_consensus.cc:515] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:32.176635 29903 raft_consensus.cc:3060] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:32.164248 25303 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7"
dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
mode: GRACEFUL
new_leader_uuid: "1f539ba21487460085b837e7529a78ce"
 from {username='slave'} at 127.0.0.1:35660
I20260709 13:12:32.186511 30010 raft_consensus.cc:2804] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:32.200112 29801 raft_consensus.cc:3060] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:32.149937 30031 consensus_queue.cc:1048] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:12:32.175698 29939 consensus_queue.cc:1048] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:12:32.236033 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:32.236701 25228 raft_consensus.cc:2468] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 15.
I20260709 13:12:32.208760 29999 raft_consensus.cc:493] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.225474 25296 raft_consensus.cc:2468] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 16.
I20260709 13:12:32.152091 30038 consensus_queue.cc:1059] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:12:32.205529 30045 raft_consensus.cc:493] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:32.254462 25906 raft_consensus.cc:2468] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 12.
I20260709 13:12:32.209741 30020 raft_consensus.cc:515] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:32.205117 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 87249.9us
I20260709 13:12:32.237982 25271 leader_election.cc:304] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:32.207264 29832 raft_consensus.cc:515] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:32.341578 25296 raft_consensus.cc:1275] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:12:32.293627 25298 raft_consensus.cc:2468] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 12.
W20260709 13:12:32.339087 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 101172us
I20260709 13:12:32.200235 30022 raft_consensus.cc:515] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:32.340880 25251 debug-util.cc:398] Leaking SignalData structure 0x7b0800342ce0 after lost signal to thread 25932
I20260709 13:12:32.274912 29802 leader_election.cc:290] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:32.344883 25345 leader_election.cc:304] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:32.352934 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 169383us
W20260709 13:12:32.353458 25251 debug-util.cc:398] Leaking SignalData structure 0x7b08003ca420 after lost signal to thread 25933
I20260709 13:12:32.354878 25194 leader_election.cc:304] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:32.263875 30044 raft_consensus.cc:493] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:32.359910 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:32.360692 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:32.368463 29809 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:32.358827 25194 leader_election.cc:304] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:12:32.350791 30037 log.cc:927] Time spent T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
I20260709 13:12:32.344027 29844 raft_consensus.cc:2804] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:32.272854 30003 raft_consensus.cc:697] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 14 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:32.274662 30023 raft_consensus.cc:2749] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:32.361791 29732 raft_consensus.cc:493] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
W20260709 13:12:32.418598 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 59843.3us
W20260709 13:12:32.425129 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 72979.7us
I20260709 13:12:32.440213 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:32.449043 29732 raft_consensus.cc:515] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:32.456157 29832 leader_election.cc:290] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:32.456969 29732 leader_election.cc:290] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:32.386498 29844 raft_consensus.cc:493] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:32.381032 30053 raft_consensus.cc:2804] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:12:32.466250 30053 raft_consensus.cc:697] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 16 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:32.425316 29809 raft_consensus.cc:2804] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:32.467777 29809 raft_consensus.cc:697] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 12 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
W20260709 13:12:32.468681 30051 log.cc:927] Time spent T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:12:32.468848 29809 consensus_queue.cc:237] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:32.469583 30039 log.cc:927] Time spent T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.267s	user 0.000s	sys 0.001s
I20260709 13:12:32.475046 30034 leader_election.cc:290] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:32.385277 29961 consensus_queue.cc:1048] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.078s
I20260709 13:12:32.476505 30022 leader_election.cc:290] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:32.462860 29802 raft_consensus.cc:2749] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:32.274418 30045 raft_consensus.cc:515] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:32.480979 25299 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.418s	user 0.024s	sys 0.017s
I20260709 13:12:32.374449 30044 raft_consensus.cc:515] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:32.463702 29844 raft_consensus.cc:3060] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:32.467247 30053 consensus_queue.cc:237] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:32.487180 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:32.380249 30038 consensus_queue.cc:1059] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 13:12:32.418596 30041 raft_consensus.cc:3055] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:12:32.488792 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 144000us
I20260709 13:12:32.332831 29999 raft_consensus.cc:515] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:32.500946 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 284818us
W20260709 13:12:32.502043 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 120156us
W20260709 13:12:32.503049 25299 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.440s	user 0.026s	sys 0.017s
I20260709 13:12:32.508971 25345 leader_election.cc:304] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:32.509195 25299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57256 (request call id 2209) took 2463 ms. Trace:
I20260709 13:12:32.510550 25270 leader_election.cc:304] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:32.510076 25299 rpcz_store.cc:276] 0709 13:12:30.046185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:30.046777 (+   592us) service_pool.cc:224] Handling call
0709 13:12:30.047117 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:30.047497 (+   380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:30.047534 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:30.051177 (+  3643us) log.cc:844] Serialized 26 byte log entry
0709 13:12:32.508844 (+2457667us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:32.508884 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:32.508960 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:32.509001 (+    41us) raft_consensus.cc:1685] finished
0709 13:12:32.509013 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:32.509142 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2974,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":2454,"thread_start_us":2445965,"threads_started":1,"wal-append.queue_time_us":318813,"wal-append.run_cpu_time_us":1760,"wal-append.run_wall_time_us":1007663}
I20260709 13:12:32.510686 25345 leader_election.cc:304] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:32.513201 29832 raft_consensus.cc:2749] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:12:32.509872 29826 raft_consensus.cc:2749] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:32.505247 30003 consensus_queue.cc:237] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:32.504657 30041 raft_consensus.cc:740] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:32.521564 30041 consensus_queue.cc:260] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:32.523010 30041 raft_consensus.cc:3060] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:32.523177 30045 leader_election.cc:290] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:32.487013 30054 consensus_queue.cc:1048] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:12:32.526590 30015 leader_election.cc:290] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:32.529858 30031 raft_consensus.cc:2804] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:32.530495 30031 raft_consensus.cc:697] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 14 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:32.531436 30031 consensus_queue.cc:237] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:32.533651 29801 raft_consensus.cc:515] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:32.523177 30044 leader_election.cc:290] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:32.536249 29801 leader_election.cc:290] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:32.537650 25345 leader_election.cc:304] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:32.538758 30023 raft_consensus.cc:2749] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:32.539233 30044 raft_consensus.cc:2749] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:32.541136 25345 leader_election.cc:304] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:32.543936 30026 raft_consensus.cc:515] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:32.548262 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 103548us
I20260709 13:12:32.550071 25270 leader_election.cc:304] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:12:32.553800 25270 leader_election.cc:304] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:32.570466 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:32.570864 25908 raft_consensus.cc:1275] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:12:32.572098 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:32.573072 25907 raft_consensus.cc:2368] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for earlier term 13. Current term is 14.
I20260709 13:12:32.575634 25907 raft_consensus.cc:1275] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:12:32.575919 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:32.576690 25908 raft_consensus.cc:3060] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:12:32.578079 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 68517.7us
I20260709 13:12:32.577971 25345 leader_election.cc:304] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:32.579349 25873 leader_election.cc:304] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:32.583218 30029 raft_consensus.cc:2749] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:32.577356 30044 raft_consensus.cc:2749] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:32.584182 30026 leader_election.cc:290] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:32.579692 30065 raft_consensus.cc:2804] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:32.584985 30065 raft_consensus.cc:493] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:32.585338 30065 raft_consensus.cc:3060] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:32.586575 29903 raft_consensus.cc:2749] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:32.591823 25345 leader_election.cc:304] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:32.594657 25345 leader_election.cc:304] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
W20260709 13:12:32.597090 29761 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.395s	user 0.006s	sys 0.010s
W20260709 13:12:32.597663 29761 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.395s	user 0.007s	sys 0.010s
I20260709 13:12:32.598177 30041 raft_consensus.cc:2749] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:32.598344 30027 raft_consensus.cc:515] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:32.600760 30027 leader_election.cc:290] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 14 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:32.601251 30065 raft_consensus.cc:515] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:32.603394 25906 raft_consensus.cc:1240] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:32.606236 25908 raft_consensus.cc:2468] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 14.
I20260709 13:12:32.590675 30034 raft_consensus.cc:2749] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:32.566314 29850 consensus_queue.cc:1048] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:12:32.615518 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:32.590694 29801 raft_consensus.cc:2804] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:32.617790 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:32.619715 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:32.623291 25345 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:32.623131 30026 consensus_queue.cc:1048] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:32.624214 30044 raft_consensus.cc:2804] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:32.624608 30044 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:32.625000 30044 raft_consensus.cc:3060] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:32.622810 25270 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:32.628598 30029 consensus_queue.cc:1048] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:32.632104 25270 leader_election.cc:400] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085) with higher term. Message: Invalid argument: T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for earlier term 13. Current term is 14.
I20260709 13:12:32.618175 30064 raft_consensus.cc:493] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:32.632849 25270 leader_election.cc:403] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:32.633496 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:32.630935 29992 consensus_queue.cc:1048] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:12:32.622457 29801 raft_consensus.cc:493] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
W20260709 13:12:32.634397 25194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:32.628724 25345 leader_election.cc:304] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:32.628598 29902 raft_consensus.cc:2749] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:32.622040 30041 raft_consensus.cc:2749] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:12:32.646842 25304 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57272 (request call id 2088) took 1949 ms (client timeout 1529 ms). Trace:
W20260709 13:12:32.647301 25304 rpcz_store.cc:269] 0709 13:12:30.697041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.848615 (+1151574us) service_pool.cc:224] Handling call
0709 13:12:32.646616 (+798001us) spinlock_profiling.cc:243] Waited 514 ms on lock 0x7b54000f8054. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:32.646756 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1181557632}
I20260709 13:12:32.649940 29801 raft_consensus.cc:3060] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:32.659510 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:32.660179 25227 raft_consensus.cc:3060] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:32.660351 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:32.661085 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:32.661665 25230 raft_consensus.cc:2468] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 11.
W20260709 13:12:32.640291 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:32.639902 25270 leader_election.cc:304] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:32.632536 29939 consensus_queue.cc:1048] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:12:32.634151 30055 consensus_queue.cc:1048] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.009s
I20260709 13:12:32.644861 30015 raft_consensus.cc:2749] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085) with higher term. Message: Invalid argument: T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for earlier term 13. Current term is 14.
I20260709 13:12:32.616604 29844 raft_consensus.cc:515] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:32.672847 29844 leader_election.cc:290] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:32.626224 29908 consensus_queue.cc:1048] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:12:32.674683 30026 consensus_queue.cc:1048] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:32.682914 25872 leader_election.cc:304] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:32.687328 25296 raft_consensus.cc:1240] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:32.693274 25227 raft_consensus.cc:2468] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 13.
I20260709 13:12:32.626731 30013 consensus_queue.cc:1048] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:12:32.696909 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:32.699740 25296 raft_consensus.cc:2468] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 11.
I20260709 13:12:32.704327 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:32.704918 25227 raft_consensus.cc:3060] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:32.706673 30023 raft_consensus.cc:493] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.707206 30023 raft_consensus.cc:515] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
I20260709 13:12:32.709414 30023 leader_election.cc:290] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:32.710640 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:32.667779 30041 raft_consensus.cc:2749] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:32.703771 25271 leader_election.cc:304] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:32.720237 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:32.694072 29939 raft_consensus.cc:2804] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:12:32.727787 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:32.664465 29832 consensus_queue.cc:1048] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:12:32.738265 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:32.714416 29844 raft_consensus.cc:493] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:32.713891 30044 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:32.717058 30038 raft_consensus.cc:493] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:32.744309 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:32.740109 29844 raft_consensus.cc:515] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:32.746475 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:32.748034 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:32.748641 25378 raft_consensus.cc:2468] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 14.
I20260709 13:12:32.750540 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:32.750797 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:32.728762 30015 raft_consensus.cc:2804] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:32.716924 30054 consensus_queue.cc:1059] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:12:32.757062 25227 raft_consensus.cc:2468] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 16.
I20260709 13:12:32.757738 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:32.758426 25378 raft_consensus.cc:2468] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 9.
I20260709 13:12:32.751561 25271 leader_election.cc:304] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:32.752485 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:32.759697 25374 raft_consensus.cc:2468] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 12.
I20260709 13:12:32.753019 25379 raft_consensus.cc:2393] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 11: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:32.745404 29939 raft_consensus.cc:697] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 14 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:32.761296 29939 consensus_queue.cc:237] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:32.761322 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:32.765230 25271 leader_election.cc:304] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:32.637929 30064 raft_consensus.cc:515] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:32.768155 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:32.769264 25374 raft_consensus.cc:1240] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:32.768116 25378 raft_consensus.cc:1240] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:32.781471 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:32.781962 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:32.782641 25374 raft_consensus.cc:2393] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 12: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:32.783460 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:32.760354 29902 raft_consensus.cc:2804] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:32.785570 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:32.774107 25873 leader_election.cc:304] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:32.795359 25873 leader_election.cc:304] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:32.787459 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:32.756809 30015 raft_consensus.cc:493] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:32.797960 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 16 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:32.798266 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:32.798671 25873 leader_election.cc:304] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:32.751912 30038 raft_consensus.cc:515] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:32.800762 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:32.802300 29801 raft_consensus.cc:515] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:32.803103 25374 raft_consensus.cc:2410] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:12:32.806859 29801 leader_election.cc:290] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:32.785415 30044 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:32.799540 30013 raft_consensus.cc:2804] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:12:32.810267 30013 raft_consensus.cc:697] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 16 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:32.811137 30013 consensus_queue.cc:237] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:32.799662 30034 raft_consensus.cc:2749] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:32.814666 30062 raft_consensus.cc:2804] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:32.815099 30062 raft_consensus.cc:493] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:32.815253 29844 leader_election.cc:290] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:32.815466 30062 raft_consensus.cc:3060] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:32.816265 30064 leader_election.cc:290] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:32.816876 29902 raft_consensus.cc:697] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 13 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:32.820518 25299 raft_consensus.cc:1240] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:32.798875 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:32.825249 25378 raft_consensus.cc:2410] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:12:32.817844 29902 consensus_queue.cc:237] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:32.843267 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 44669.3us
I20260709 13:12:32.844089 25873 leader_election.cc:304] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:32.844816 25303 raft_consensus.cc:606] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 14 LEADER]: Received request to transfer leadership to TS 1f539ba21487460085b837e7529a78ce
I20260709 13:12:32.818747 30015 raft_consensus.cc:3060] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:32.846506 25873 leader_election.cc:304] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:32.847055 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:32.847224 30028 raft_consensus.cc:2804] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:32.847016 30045 raft_consensus.cc:2749] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:32.842348 29927 raft_consensus.cc:2749] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:32.851792 25873 leader_election.cc:304] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:32.854954 30054 raft_consensus.cc:3060] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:32.856564 29995 leader_election.cc:290] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:32.857988 29765 raft_consensus.cc:3055] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:12:32.861392 29787 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.617s	user 0.009s	sys 0.005s
I20260709 13:12:32.862193 29947 raft_consensus.cc:3055] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:32.853133 30028 raft_consensus.cc:493] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:32.878615 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 113460us
I20260709 13:12:32.872030 29765 raft_consensus.cc:740] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:32.874351 30045 raft_consensus.cc:2749] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:12:32.875253 29787 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.629s	user 0.011s	sys 0.006s
I20260709 13:12:32.885874 25371 raft_consensus.cc:1240] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 10 LEADER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:32.873973 29947 raft_consensus.cc:740] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:32.884606 29765 consensus_queue.cc:260] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:32.877444 30028 raft_consensus.cc:3060] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:32.898713 30034 consensus_queue.cc:1059] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:32.901326 29947 consensus_queue.cc:260] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:32.903349 29947 raft_consensus.cc:3060] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:32.907254 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
W20260709 13:12:32.909373 30009 log.cc:927] Time spent T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 1.237s	user 0.000s	sys 0.003s
I20260709 13:12:32.910776 30049 raft_consensus.cc:3055] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:32.911185 30049 raft_consensus.cc:740] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:32.912009 30049 consensus_queue.cc:260] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:32.913451 30049 raft_consensus.cc:3060] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:32.917290 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:32.922344 25227 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 10.
I20260709 13:12:32.926191 25343 leader_election.cc:304] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:32.926927 29939 raft_consensus.cc:493] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.927461 29939 raft_consensus.cc:515] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:32.928957 30031 raft_consensus.cc:2804] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:32.929371 30031 raft_consensus.cc:493] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:32.929723 30031 raft_consensus.cc:3060] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:32.930140 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:32.930745 25376 raft_consensus.cc:2468] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 10.
I20260709 13:12:32.931501 25374 raft_consensus.cc:1275] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:12:32.931576 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:32.932159 25378 raft_consensus.cc:3060] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:32.933540 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:32.927770 30038 leader_election.cc:290] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:32.946700 25377 raft_consensus.cc:1275] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:12:32.947063 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:32.950073 25873 leader_election.cc:304] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:32.952049 30038 raft_consensus.cc:2749] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:12:32.953459 29998 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.216s	user 0.012s	sys 0.008s
I20260709 13:12:32.914662 29765 raft_consensus.cc:3060] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:32.960152 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:32.958737 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:32.960175 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:32.961536 25374 raft_consensus.cc:3060] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:32.929643 29939 leader_election.cc:290] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:32.963688 30084 log.cc:927] Time spent T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:12:32.970324 25378 raft_consensus.cc:2468] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 13.
I20260709 13:12:32.968488 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:32.969426 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:12:32.960479 29998 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.224s	user 0.013s	sys 0.008s
W20260709 13:12:32.994161 30089 log.cc:927] Time spent T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 13:12:32.994915 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:33.026451 25375 raft_consensus.cc:2468] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 11.
I20260709 13:12:32.964540 29999 leader_election.cc:290] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:33.009898 30065 leader_election.cc:290] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:33.011319 25297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57272 (request call id 2110) took 1381 ms. Trace:
W20260709 13:12:33.013091 25400 debug-util.cc:398] Leaking SignalData structure 0x7b080034e9e0 after lost signal to thread 25254
W20260709 13:12:33.035611 25400 debug-util.cc:398] Leaking SignalData structure 0x7b080005f7c0 after lost signal to thread 25255
I20260709 13:12:33.035516 25297 rpcz_store.cc:276] 0709 13:12:31.630133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.630248 (+   115us) service_pool.cc:224] Handling call
0709 13:12:33.011116 (+1380868us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b54000f9e54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:33.011260 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":310321920}
W20260709 13:12:33.036939 25400 debug-util.cc:398] Leaking SignalData structure 0x7b080026a560 after lost signal to thread 25329
W20260709 13:12:33.037221 25400 debug-util.cc:398] Leaking SignalData structure 0x7b08003577c0 after lost signal to thread 25330
I20260709 13:12:33.037099 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:33.038328 25298 raft_consensus.cc:2393] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 8: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:32.970343 30062 raft_consensus.cc:515] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:33.015026 25376 raft_consensus.cc:1275] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:12:33.044510 25296 raft_consensus.cc:1240] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 16 LEADER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:33.018190 25301 raft_consensus.cc:1240] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:33.019066 25270 leader_election.cc:304] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:33.046164 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:33.020453 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:33.039621 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:33.041527 25374 raft_consensus.cc:2468] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 8.
I20260709 13:12:33.043812 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:33.049642 25908 raft_consensus.cc:2468] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 10.
I20260709 13:12:33.059593 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
W20260709 13:12:33.061913 25400 debug-util.cc:398] Leaking SignalData structure 0x7b0800310e20 after lost signal to thread 25403
W20260709 13:12:33.062279 25400 debug-util.cc:398] Leaking SignalData structure 0x7b08003b4ce0 after lost signal to thread 25404
I20260709 13:12:33.066239 25901 raft_consensus.cc:1240] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:33.043744 29939 raft_consensus.cc:493] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:33.069080 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:33.070005 25226 raft_consensus.cc:2468] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 10.
I20260709 13:12:33.063694 30065 raft_consensus.cc:2804] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:33.080937 30062 leader_election.cc:290] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 15 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:33.069026 30013 consensus_queue.cc:1048] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:12:33.083581 25226 raft_consensus.cc:1275] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:12:33.086071 30054 raft_consensus.cc:2749] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:33.064921 29999 consensus_queue.cc:1048] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:12:33.086659 29990 consensus_queue.cc:1059] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:33.067520 30016 raft_consensus.cc:493] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.087921 29939 raft_consensus.cc:515] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:33.095382 30031 raft_consensus.cc:515] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:33.096128 30015 raft_consensus.cc:515] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:33.073594 25270 leader_election.cc:304] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:33.101934 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:33.100183 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
W20260709 13:12:33.090677 30088 log.cc:927] Time spent T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:12:33.097402 30020 leader_election.cc:290] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:33.118183 25907 raft_consensus.cc:2468] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 11.
W20260709 13:12:33.118319 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 44805.5us
I20260709 13:12:33.120870 25270 leader_election.cc:304] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:12:33.097963 30065 raft_consensus.cc:493] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:33.106820 29947 raft_consensus.cc:493] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.122236 25271 leader_election.cc:304] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:33.121601 29826 raft_consensus.cc:2804] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:33.127871 25302 raft_consensus.cc:1240] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:12:33.119798 29990 consensus_queue.cc:1243] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [LEADER]: Peer da445ce82dc4467f95f4fa52297eaa19 log is divergent from this leader: its last log entry 16.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:12:33.132439 29815 raft_consensus.cc:493] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:33.129246 29826 raft_consensus.cc:493] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:33.127111 30065 raft_consensus.cc:3060] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:33.114878 30016 raft_consensus.cc:515] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:33.135637 25270 leader_election.cc:304] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:33.140522 25900 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 8.
I20260709 13:12:33.126820 29902 raft_consensus.cc:2804] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:33.142938 29815 raft_consensus.cc:515] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:33.123092 29764 consensus_queue.cc:1048] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:12:33.131332 29844 raft_consensus.cc:2804] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:33.173147 25305 raft_consensus.cc:1240] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:33.144826 25371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36264 (request call id 2002) took 1920 ms. Trace:
I20260709 13:12:33.174503 25371 rpcz_store.cc:276] 0709 13:12:31.223958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.472075 (+248117us) service_pool.cc:224] Handling call
0709 13:12:31.472620 (+   545us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:32.886413 (+1413793us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:33.144555 (+258142us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b5400311fd4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:33.144747 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3249518464}
W20260709 13:12:33.145591 25373 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56308 (request call id 782) took 1953 ms (client timeout 1673 ms). Trace:
W20260709 13:12:33.176011 25373 rpcz_store.cc:269] 0709 13:12:31.192574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.210273 (+ 17699us) service_pool.cc:224] Handling call
0709 13:12:33.145371 (+1935098us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b540033f754. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:33.145520 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":517778688}
I20260709 13:12:33.146257 25372 raft_consensus.cc:1240] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:33.147722 25344 leader_election.cc:304] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:33.150631 25377 raft_consensus.cc:1275] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 13:12:33.180662 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:33.128952 29947 raft_consensus.cc:515] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:33.131739 29987 consensus_queue.cc:1059] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
W20260709 13:12:33.188086 25874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:33.185356 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:33.158438 30041 raft_consensus.cc:493] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:33.171239 30085 raft_consensus.cc:2749] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:33.182809 29844 raft_consensus.cc:493] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:33.199436 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 119722us
I20260709 13:12:33.174196 29902 raft_consensus.cc:697] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 8 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:33.202491 29987 raft_consensus.cc:3055] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:12:33.202394 30019 consensus_queue.cc:1048] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:33.202998 29987 raft_consensus.cc:740] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:33.141462 29826 raft_consensus.cc:3060] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:33.192934 29759 raft_consensus.cc:2749] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:12:33.212955 25872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:33.223038 29987 consensus_queue.cc:260] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:33.204257 29844 raft_consensus.cc:3060] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:33.190495 30028 raft_consensus.cc:515] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:33.197515 30041 raft_consensus.cc:515] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:33.240104 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:33.240397 30015 leader_election.cc:290] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:33.241618 29939 leader_election.cc:290] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:33.255118 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:33.268393 25195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:33.230260 29902 consensus_queue.cc:237] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:33.274013 29947 leader_election.cc:290] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:33.274986 30031 leader_election.cc:290] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:33.271755 29815 leader_election.cc:290] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:33.272027 25299 raft_consensus.cc:1275] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:12:33.269515 25226 raft_consensus.cc:3060] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:33.281584 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:33.282963 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:33.287218 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:33.288908 25908 raft_consensus.cc:1275] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:12:33.279609 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 70762us
I20260709 13:12:33.293080 25905 raft_consensus.cc:1240] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 13. Current term is 14. Ops: []
W20260709 13:12:33.294533 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:33.299319 25226 raft_consensus.cc:2468] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 12.
I20260709 13:12:33.301192 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:12:33.298532 25195 connection.cc:256] RPC call timeout handler was delayed by -1.1479916600000024s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2948s for a response
W20260709 13:12:33.301903 25195 connection.cc:256] RPC call timeout handler was delayed by -1.1166548060000423s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1686s for a response
W20260709 13:12:33.302955 25195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:33.308233 25303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:35660 (request call id 18) took 1176 ms. Trace:
I20260709 13:12:33.308889 25303 rpcz_store.cc:276] 0709 13:12:32.129063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.164135 (+ 35072us) service_pool.cc:224] Handling call
0709 13:12:33.304965 (+1140830us) spinlock_profiling.cc:243] Waited 630 ms on lock 0x7b540018ddd4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc69853 00007fd734c3760a 00007fd72e1bd7d4 00007fd72e1bd762 00007fd72e1bd691 00007fd72e1bd60c 00007fd72e1bc8c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:33.305082 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1448008448}
W20260709 13:12:33.308329 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 91089.2us
I20260709 13:12:33.311223 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:33.310819 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:33.294349 29992 consensus_queue.cc:1048] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:12:33.302070 29987 raft_consensus.cc:3060] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:33.294164 30101 consensus_queue.cc:1059] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:12:33.355402 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:33.359006 25270 leader_election.cc:304] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:33.361065 30015 raft_consensus.cc:2749] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:12:33.363224 25303 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b"
dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
mode: GRACEFUL
new_leader_uuid: "1f539ba21487460085b837e7529a78ce"
 from {username='slave'} at 127.0.0.1:35660
I20260709 13:12:33.363935 25303 raft_consensus.cc:606] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Received request to transfer leadership to TS 1f539ba21487460085b837e7529a78ce
I20260709 13:12:33.364349 25303 raft_consensus.cc:614] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:33.361842 30015 consensus_queue.cc:1059] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 13:12:33.366518 30041 leader_election.cc:290] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:33.367961 30065 raft_consensus.cc:515] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:33.344504 30016 leader_election.cc:290] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:33.371456 30028 leader_election.cc:290] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:33.371711 30098 log.cc:927] Time spent T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:12:33.374847 29844 raft_consensus.cc:515] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:33.377188 29844 leader_election.cc:290] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:33.379809 30065 leader_election.cc:290] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:33.381446 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 53808.2us
I20260709 13:12:33.382262 25271 leader_election.cc:304] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:33.384294 30041 consensus_queue.cc:1059] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:12:33.385299 30041 raft_consensus.cc:3055] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:33.385663 30041 raft_consensus.cc:740] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:33.387033 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:33.387344 29991 leader_election.cc:290] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:33.386552 30041 consensus_queue.cc:260] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:33.390316 30041 raft_consensus.cc:3060] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:33.394081 30027 raft_consensus.cc:493] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.394642 30027 raft_consensus.cc:515] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:33.396951 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:33.397660 25901 raft_consensus.cc:3060] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:33.400012 30044 consensus_queue.cc:1048] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:33.407629 25372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36254 (request call id 2337) took 2007 ms. Trace:
W20260709 13:12:33.409853 25370 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36264 (request call id 1993) took 2189 ms (client timeout 1529 ms). Trace:
W20260709 13:12:33.410406 25370 rpcz_store.cc:269] 0709 13:12:31.220354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:33.409534 (+2189180us) service_pool.cc:211] Skipping call since client already timed out
0709 13:12:33.409711 (+   177us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:12:33.410966 25299 raft_consensus.cc:1240] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 16 LEADER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 15. Current term is 16. Ops: [15.7-15.7]
I20260709 13:12:33.410853 29826 raft_consensus.cc:515] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:33.412277 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:33.408581 25901 raft_consensus.cc:2468] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 11.
I20260709 13:12:33.413130 25301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57272 (request call id 2099) took 2645 ms. Trace:
I20260709 13:12:33.413275 29826 leader_election.cc:290] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:33.414077 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:33.414670 25303 raft_consensus.cc:3060] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:33.415547 25901 raft_consensus.cc:1275] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:12:33.397673 30027 leader_election.cc:290] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:33.417655 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
W20260709 13:12:33.419950 30099 log.cc:927] Time spent T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 13:12:33.421475 25270 leader_election.cc:304] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:33.421527 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:33.422483 25297 raft_consensus.cc:2468] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 14.
I20260709 13:12:33.423550 29991 raft_consensus.cc:2804] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:33.425467 25302 raft_consensus.cc:1240] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:33.426761 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:33.427362 25906 raft_consensus.cc:3060] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:33.429085 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:33.430054 25371 raft_consensus.cc:3060] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:33.430883 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:33.434405 25303 raft_consensus.cc:2468] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 12.
I20260709 13:12:33.413550 25301 rpcz_store.cc:276] 0709 13:12:30.767513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:30.808078 (+ 40565us) service_pool.cc:224] Handling call
0709 13:12:32.509568 (+1701490us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:33.045028 (+535460us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:33.411980 (+366952us) spinlock_profiling.cc:243] Waited 508 ms on lock 0x7b54001e9e54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:33.412966 (+   986us) spinlock_profiling.cc:243] Waited 1.7 s on lock 0x7b54001e9e50. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6e8ad 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:33.413077 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5081703424}
I20260709 13:12:33.408277 25372 rpcz_store.cc:276] 0709 13:12:31.399992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.540522 (+140530us) service_pool.cc:224] Handling call
0709 13:12:33.146052 (+1605530us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:33.177475 (+ 31423us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:33.407305 (+229830us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b540033f750. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6e8ad 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:33.407534 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3691481344}
I20260709 13:12:33.442159 25377 raft_consensus.cc:1275] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:12:33.446188 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:33.447069 25370 raft_consensus.cc:3060] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:33.449242 25906 raft_consensus.cc:2468] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 11.
I20260709 13:12:33.387046 29992 raft_consensus.cc:2804] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:33.455490 30010 raft_consensus.cc:493] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:33.456014 30010 raft_consensus.cc:3060] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:33.452805 30046 log.cc:927] Time spent T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 1.250s	user 0.001s	sys 0.004s
I20260709 13:12:33.461212 29855 raft_consensus.cc:3055] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:12:33.461683 29855 raft_consensus.cc:740] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:33.462707 29855 consensus_queue.cc:260] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:33.463704 29855 raft_consensus.cc:3060] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:33.464790 25370 raft_consensus.cc:2468] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 11.
I20260709 13:12:33.426342 29991 raft_consensus.cc:697] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 11 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:33.467257 29992 raft_consensus.cc:697] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 12 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:33.471093 29992 consensus_queue.cc:237] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:33.490695 29991 consensus_queue.cc:237] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:33.558859 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 254587us
W20260709 13:12:33.560369 25195 connection.cc:256] RPC call timeout handler was delayed by -1.0517143259999102s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18220000000000003s for a response
I20260709 13:12:33.566787 25223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 2343) took 1841 ms. Trace:
W20260709 13:12:33.570291 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 118498us
I20260709 13:12:33.570744 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:33.572232 25226 raft_consensus.cc:2468] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 10.
I20260709 13:12:33.576520 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:33.577592 25228 raft_consensus.cc:2468] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 10.
I20260709 13:12:33.579603 29844 consensus_queue.cc:1048] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:12:33.582962 30021 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.317s	user 0.009s	sys 0.006s
W20260709 13:12:33.583636 30021 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.319s	user 0.009s	sys 0.006s
I20260709 13:12:33.584606 30021 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.585649 30021 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:33.567504 25223 rpcz_store.cc:276] 0709 13:12:31.725200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.725363 (+   163us) service_pool.cc:224] Handling call
0709 13:12:31.725665 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:31.726039 (+   374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:31.726066 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:31.726392 (+   326us) log.cc:844] Serialized 26 byte log entry
0709 13:12:31.963458 (+237066us) spinlock_profiling.cc:243] Waited 2.16 ms on lock 0x7b18003edca0. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72cb64e07 00007fd7359bfab9 00007fd72cb8169b 00007fd72cb7f93f 00007fd72cb81c02 00007fd72f80920b 00007fd72f80ed23 00007fd72f80f0d1 00007fd72fc2aa0f
0709 13:12:32.033604 (+ 70146us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:32.033659 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:32.033732 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:33.405217 (+1371485us) spinlock_profiling.cc:243] Waited 2.65 ms on lock 0x7b4400022b4c. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72caa8c85 00007fd72caa96a2 00007fd72f81b1db 00007fd72f816aaf 00007fd72f80a86e 00007fd72f809bb6 00007fd72f8097d8 00007fd72f813221 00007fd72f8131d9 00007fd72f813169
0709 13:12:33.566087 (+160870us) raft_consensus.cc:1685] finished
0709 13:12:33.566135 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:33.566510 (+   375us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":92,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":4522,"spinlock_wait_cycles":11055616,"thread_start_us":69194,"threads_started":1,"wal-append.queue_time_us":443923}
I20260709 13:12:33.600579 25229 raft_consensus.cc:1275] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 16 index: 7. (index mismatch)
I20260709 13:12:33.600369 25195 leader_election.cc:304] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:33.606189 29947 raft_consensus.cc:2749] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:33.605327 25195 leader_election.cc:304] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:33.609849 25195 leader_election.cc:304] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:33.610975 29815 raft_consensus.cc:2749] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:33.612285 25195 leader_election.cc:304] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:33.613500 29815 raft_consensus.cc:2749] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:33.624362 25224 raft_consensus.cc:3055] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:33.624881 25224 raft_consensus.cc:740] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:33.627516 25305 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd"
dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
mode: GRACEFUL
new_leader_uuid: "79d99c0e498349bda74127365219e468"
 from {username='slave'} at 127.0.0.1:35660
I20260709 13:12:33.628592 25305 raft_consensus.cc:606] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Received request to transfer leadership to TS 79d99c0e498349bda74127365219e468
I20260709 13:12:33.629045 25305 raft_consensus.cc:614] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:12:33.640028 25400 debug-util.cc:398] Leaking SignalData structure 0x7b08002321e0 after lost signal to thread 25932
W20260709 13:12:33.640619 25400 debug-util.cc:398] Leaking SignalData structure 0x7b0800324400 after lost signal to thread 25933
I20260709 13:12:33.641577 30054 raft_consensus.cc:493] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:33.642580 30054 raft_consensus.cc:515] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:33.645207 25305 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87"
dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
mode: GRACEFUL
new_leader_uuid: "1f539ba21487460085b837e7529a78ce"
 from {username='slave'} at 127.0.0.1:35660
I20260709 13:12:33.645996 25305 raft_consensus.cc:606] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 11 LEADER]: Received request to transfer leadership to TS 1f539ba21487460085b837e7529a78ce
I20260709 13:12:33.647959 24113 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:12:33.650420 25224 consensus_queue.cc:260] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:33.652266 25224 raft_consensus.cc:3060] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:33.646027 25270 leader_election.cc:304] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:33.656324 30062 raft_consensus.cc:3055] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:33.656785 30062 raft_consensus.cc:740] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:33.658325 30062 consensus_queue.cc:260] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:33.658978 30054 leader_election.cc:290] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:33.661955 25271 leader_election.cc:304] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:12:33.663473 30062 raft_consensus.cc:3060] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:33.663798 25226 raft_consensus.cc:1275] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:12:33.665449 30021 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:33.666399 30043 log.cc:927] Time spent T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 1.325s	user 0.000s	sys 0.004s
W20260709 13:12:33.668102 30093 log.cc:927] Time spent T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.695s	user 0.002s	sys 0.002s
I20260709 13:12:33.673933 24113 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:33.675282 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:33.682752 25226 raft_consensus.cc:1275] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:12:33.687812 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:33.700358 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 79920.5us
I20260709 13:12:33.713783 30025 raft_consensus.cc:2804] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:33.715646 30055 raft_consensus.cc:3055] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:33.716198 30055 raft_consensus.cc:740] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:33.699641 30021 raft_consensus.cc:493] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:33.717949 25194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:33.718060 30025 raft_consensus.cc:697] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 11 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:33.718376 30021 raft_consensus.cc:515] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:33.719895 30025 consensus_queue.cc:237] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:33.721205 30021 leader_election.cc:290] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:33.722487 30055 consensus_queue.cc:260] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:33.724081 29832 raft_consensus.cc:2804] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:33.724360 30055 raft_consensus.cc:3060] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:33.724647 29832 raft_consensus.cc:493] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
W20260709 13:12:33.726928 25345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:33.729797 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:33.697927 29815 raft_consensus.cc:493] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:33.734753 25228 raft_consensus.cc:3060] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:33.729198 29832 raft_consensus.cc:3060] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:33.728426 29947 raft_consensus.cc:2804] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:33.743856 25271 leader_election.cc:304] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
W20260709 13:12:33.748206 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:33.749186 25371 raft_consensus.cc:2468] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 12.
I20260709 13:12:33.754392 30021 raft_consensus.cc:493] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:33.754563 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 142552us
W20260709 13:12:33.755064 25874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:33.755174 30021 raft_consensus.cc:515] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:33.755575 25195 leader_election.cc:304] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:33.757551 25195 leader_election.cc:304] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:33.754439 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:33.769603 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:33.759335 25872 leader_election.cc:304] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:33.757684 30021 leader_election.cc:290] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:33.786679 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:33.794094 29991 raft_consensus.cc:2804] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:12:33.794780 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:33.795143 29991 raft_consensus.cc:493] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:33.795686 29991 raft_consensus.cc:3060] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:33.765424 29815 raft_consensus.cc:515] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:33.799889 29815 leader_election.cc:290] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:33.798280 25300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57272 (request call id 2116) took 2160 ms. Trace:
I20260709 13:12:33.802096 25300 rpcz_store.cc:276] 0709 13:12:31.637313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.650638 (+ 13325us) service_pool.cc:224] Handling call
0709 13:12:31.650911 (+   273us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:31.660416 (+  9505us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:31.660446 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:31.660974 (+   528us) log.cc:844] Serialized 26 byte log entry
0709 13:12:32.076118 (+415144us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:32.076162 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:32.076223 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:33.653028 (+1576805us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b4400022b4c. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72caa8c85 00007fd72caa96a2 00007fd72f81b1db 00007fd72f816aaf 00007fd72f80a86e 00007fd72f809bb6 00007fd72f8097d8 00007fd72f813221 00007fd72f8131d9 00007fd72f813169
0709 13:12:33.788643 (+135615us) spinlock_profiling.cc:243] Waited 2.53 ms on lock 0x7b2400430b08. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72ca089c4 00007fd72ca06acb 00007fd72cbc1dc9 00007fd72cbc1a55 00007fd72cbc0fb0 00007fd72f837488 00007fd72f837be8 00007fd72f80f398 00007fd72f80a76a 00007fd72f809bb6
0709 13:12:33.797850 (+  9207us) raft_consensus.cc:1685] finished
0709 13:12:33.797869 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:33.798110 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18787,"raft.queue_time_us":57414,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":12629,"spinlock_wait_cycles":30305792,"thread_start_us":368849,"threads_started":1,"wal-append.queue_time_us":538368}
I20260709 13:12:33.803526 29947 raft_consensus.cc:493] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:33.804081 29947 raft_consensus.cc:3060] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:33.816341 25224 raft_consensus.cc:1275] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:12:33.816883 25224 pending_rounds.cc:85] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce: Aborting all ops after (but not including) 10
I20260709 13:12:33.817212 25224 pending_rounds.cc:107] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:12:33.817518 25224 raft_consensus.cc:2889] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:33.819938 29801 raft_consensus.cc:493] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.820752 29801 raft_consensus.cc:515] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:33.825934 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:33.826754 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 117743us
I20260709 13:12:33.827241 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:33.828555 29764 consensus_queue.cc:1048] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:33.834993 29733 raft_consensus.cc:2804] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:33.835565 29733 raft_consensus.cc:493] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:33.835683 29991 raft_consensus.cc:515] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:33.837687 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:33.839408 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:33.836133 29733 raft_consensus.cc:3060] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:12:33.843333 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:33.848022 25228 raft_consensus.cc:2468] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 11.
I20260709 13:12:33.851698 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:12:33.853308 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 94312.4us
I20260709 13:12:33.856600 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:33.846359 30021 raft_consensus.cc:2749] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:12:33.858522 25872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:33.870451 25872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:33.854635 29998 consensus_queue.cc:1048] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:12:33.871222 30054 raft_consensus.cc:2804] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:33.871706 30054 raft_consensus.cc:493] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:33.872061 30054 raft_consensus.cc:3060] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:33.859329 25379 raft_consensus.cc:3060] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:12:33.859560 29999 consensus_queue.cc:1048] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:12:33.860450 30019 consensus_queue.cc:1059] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:12:33.867113 30013 raft_consensus.cc:493] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:33.855985 29991 leader_election.cc:290] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:33.897379 25221 raft_consensus.cc:3055] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:33.897920 25221 raft_consensus.cc:740] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:33.898041 25128 catalog_manager.cc:5697] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 6 to 9, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 9 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:33.902695 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:33.906900 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:33.914575 25229 raft_consensus.cc:3060] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:33.882040 30019 consensus_queue.cc:1243] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer 79d99c0e498349bda74127365219e468 log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:12:33.899169 25221 consensus_queue.cc:260] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:33.919926 25270 leader_election.cc:304] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:33.921732 25371 raft_consensus.cc:1275] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 13:12:33.921572 29902 consensus_queue.cc:1048] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:33.922124 25371 pending_rounds.cc:85] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468: Aborting all ops after (but not including) 12
I20260709 13:12:33.922384 25371 pending_rounds.cc:107] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 13:12:33.922636 25371 raft_consensus.cc:2889] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:33.926424 30122 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.927021 29998 raft_consensus.cc:3055] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:33.927531 29998 raft_consensus.cc:740] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:33.930428 30010 raft_consensus.cc:515] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:33.931084 29998 consensus_queue.cc:260] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:33.932502 29998 raft_consensus.cc:3060] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:33.932736 30010 leader_election.cc:290] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:33.934891 25229 raft_consensus.cc:2468] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 11.
W20260709 13:12:33.935555 25343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:33.929230 30013 raft_consensus.cc:515] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:33.939654 29947 raft_consensus.cc:515] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:12:33.942034 29999 raft_consensus.cc:2804] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:33.942602 29999 raft_consensus.cc:697] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 12 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:33.943817 29999 consensus_queue.cc:237] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:33.948961 25343 leader_election.cc:304] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:33.948985 29855 consensus_queue.cc:1059] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:12:33.952507 30013 leader_election.cc:290] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:33.927241 30122 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:33.955580 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 63077.2us
I20260709 13:12:33.954089 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:33.933621 29765 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.975540 25379 raft_consensus.cc:2468] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 11.
I20260709 13:12:33.956979 30122 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:33.989045 25221 raft_consensus.cc:3060] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:33.991971 29787 raft_consensus.cc:493] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.992781 29787 raft_consensus.cc:515] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:33.995824 29787 leader_election.cc:290] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:33.996672 30030 raft_consensus.cc:2804] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:33.997421 30030 raft_consensus.cc:697] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 12 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:33.998901 25299 raft_consensus.cc:1240] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 8 LEADER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:33.998755 30030 consensus_queue.cc:237] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:33.979096 29947 leader_election.cc:290] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:34.019268 25300 raft_consensus.cc:1240] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
W20260709 13:12:34.020404 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:34.040969 25296 raft_consensus.cc:1275] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:12:34.023034 29801 leader_election.cc:290] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:34.044250 30054 raft_consensus.cc:515] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:34.062438 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:12:34.413231 25872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:34.299873 29765 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:34.742863 29765 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:34.745518 30054 leader_election.cc:290] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 15 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:12:34.749365 29998 consensus_meta.cc:287] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.816s	user 0.009s	sys 0.001s
W20260709 13:12:34.753018 30055 consensus_meta.cc:287] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 1.017s	user 0.009s	sys 0.000s
W20260709 13:12:34.749418 29832 consensus_meta.cc:287] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 1.002s	user 0.000s	sys 0.009s
W20260709 13:12:34.808512 29733 consensus_meta.cc:287] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 0.954s	user 0.012s	sys 0.000s
W20260709 13:12:35.026891 29999 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.944s	user 0.011s	sys 0.021s
I20260709 13:12:34.915518 29832 raft_consensus.cc:515] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:34.994002 29733 raft_consensus.cc:515] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:35.313585 29999 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.268s	user 0.011s	sys 0.022s
W20260709 13:12:35.339709 30030 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.038s	sys 0.045s
I20260709 13:12:35.339852 29733 leader_election.cc:290] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:35.340417 30030 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.038s	sys 0.046s
W20260709 13:12:35.361361 30126 log.cc:927] Time spent T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.394s	user 0.000s	sys 0.002s
I20260709 13:12:35.363108 29832 leader_election.cc:290] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:35.388433 25874 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.140.65:39361 timed out after 1.584s (SENT) [suppressed 30 similar messages]
I20260709 13:12:35.402621 30132 raft_consensus.cc:493] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:35.403234 30132 raft_consensus.cc:515] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:35.405560 30132 leader_election.cc:290] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:35.406980 30132 raft_consensus.cc:493] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:35.407505 30133 raft_consensus.cc:493] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:35.407529 30132 raft_consensus.cc:515] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:35.408087 30133 raft_consensus.cc:515] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:35.415748 30132 leader_election.cc:290] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:35.416893 30133 leader_election.cc:290] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:35.419744 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:35.420745 25230 raft_consensus.cc:2468] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 10.
W20260709 13:12:35.421352 25230 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58418 (request call id 2225) took 1460 ms (client timeout 1648 ms). Trace:
W20260709 13:12:35.421787 25230 rpcz_store.cc:269] 0709 13:12:33.960445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:33.971404 (+ 10959us) service_pool.cc:224] Handling call
0709 13:12:35.421247 (+1449843us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:12:35.481518 25907 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.521s	user 0.026s	sys 0.019s
W20260709 13:12:35.482198 25907 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.522s	user 0.030s	sys 0.019s
I20260709 13:12:35.483327 25907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50058 (request call id 887) took 1596 ms. Trace:
I20260709 13:12:35.485957 30129 raft_consensus.cc:493] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.486723 30030 raft_consensus.cc:493] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.486791 30129 raft_consensus.cc:515] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:35.487676 30030 raft_consensus.cc:515] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:35.490223 30030 leader_election.cc:290] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:35.490171 30129 leader_election.cc:290] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:35.483919 25907 rpcz_store.cc:276] 0709 13:12:33.892584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:33.916630 (+ 24046us) service_pool.cc:224] Handling call
0709 13:12:33.957892 (+ 41262us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:33.958634 (+   742us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:12:33.958672 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:33.959483 (+   811us) log.cc:844] Serialized 52 byte log entry
0709 13:12:35.482735 (+1523252us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:35.482793 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:35.482900 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:35.482965 (+    65us) raft_consensus.cc:1685] finished
0709 13:12:35.482983 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:35.483225 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1658,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"thread_start_us":1522734,"threads_started":1,"wal-append.queue_time_us":1375922}
W20260709 13:12:35.497637 25345 connection.cc:256] RPC call timeout handler was delayed by -1.237466730000051s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1778s for a response
W20260709 13:12:35.499404 25345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:35.500001 25345 leader_election.cc:336] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Timed out: RequestConsensusVote RPC to 127.23.140.65:39361 timed out after 1.648s (SENT)
I20260709 13:12:35.500376 25345 leader_election.cc:304] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:35.501173 30030 raft_consensus.cc:2749] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:12:35.501715 25345 connection.cc:256] RPC call timeout handler was delayed by -1.1457754949999526s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1754s for a response
I20260709 13:12:35.502777 30030 raft_consensus.cc:493] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.506668 30137 raft_consensus.cc:493] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:35.506850 30030 raft_consensus.cc:515] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:35.507330 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:35.507874 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:35.507403 30137 raft_consensus.cc:515] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:35.508208 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:35.508616 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:35.509202 30030 leader_election.cc:290] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:35.509336 29733 raft_consensus.cc:493] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.509738 30137 leader_election.cc:290] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:35.508153 25343 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.434s	user 0.017s	sys 0.031s
W20260709 13:12:35.514022 25343 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.440s	user 0.019s	sys 0.032s
I20260709 13:12:35.513861 30030 raft_consensus.cc:493] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:35.513360 30129 raft_consensus.cc:493] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.514818 30030 raft_consensus.cc:515] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:35.515285 30129 raft_consensus.cc:515] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:35.517565 30129 leader_election.cc:290] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:35.518272 30129 raft_consensus.cc:493] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:35.518561 30030 leader_election.cc:290] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:35.518966 30129 raft_consensus.cc:515] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:12:35.510010 29733 raft_consensus.cc:515] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:35.521191 30129 leader_election.cc:290] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:12:35.521816 25224 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.626s	user 0.060s	sys 0.057s
W20260709 13:12:35.522248 25224 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.626s	user 0.060s	sys 0.057s
I20260709 13:12:35.522560 29733 leader_election.cc:290] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:35.523133 25224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 2387) took 1630 ms. Trace:
I20260709 13:12:35.523146 29733 raft_consensus.cc:493] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:35.525780 29733 raft_consensus.cc:515] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:35.527942 29733 leader_election.cc:290] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:35.523623 25224 rpcz_store.cc:276] 0709 13:12:33.892912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:33.894181 (+  1269us) service_pool.cc:224] Handling call
0709 13:12:33.894506 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:33.894994 (+   488us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:33.895033 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:33.895610 (+   577us) log.cc:844] Serialized 26 byte log entry
0709 13:12:35.522671 (+1627061us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:35.522728 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:35.522833 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:35.522895 (+    62us) raft_consensus.cc:1685] finished
0709 13:12:35.522912 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:35.523059 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12847,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":6160,"thread_start_us":1626572,"threads_started":1,"wal-append.queue_time_us":1071239}
I20260709 13:12:35.534752 30138 raft_consensus.cc:493] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:35.535619 30138 raft_consensus.cc:515] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:35.538650 30138 leader_election.cc:290] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:12:35.544962 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:35.547183 30010 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.548051 30010 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:35.550725 30010 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:35.551718 30138 raft_consensus.cc:493] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:35.553049 30138 raft_consensus.cc:515] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:35.554821 30003 raft_consensus.cc:493] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
W20260709 13:12:35.555621 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:35.546509 30139 raft_consensus.cc:493] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:35.557325 30003 raft_consensus.cc:515] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:35.557871 29999 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.559908 29999 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:35.560855 30003 leader_election.cc:290] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:35.560817 30138 leader_election.cc:290] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:35.561172 30139 raft_consensus.cc:515] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:35.563133 30139 leader_election.cc:290] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:35.556710 29832 raft_consensus.cc:493] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:35.564278 30129 raft_consensus.cc:493] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.564443 29832 raft_consensus.cc:515] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:35.564910 30129 raft_consensus.cc:515] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:35.566576 30030 raft_consensus.cc:493] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:35.566692 29832 leader_election.cc:290] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:35.567186 30030 raft_consensus.cc:515] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:35.567592 30137 raft_consensus.cc:493] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:35.568125 30137 raft_consensus.cc:515] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:35.569309 30030 leader_election.cc:290] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:35.569850 30030 raft_consensus.cc:493] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.570132 30137 leader_election.cc:290] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:35.571667 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:35.572970 25907 raft_consensus.cc:2468] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 11.
I20260709 13:12:35.570427 30030 raft_consensus.cc:515] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:35.563534 29999 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:35.574318 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:35.581135 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:35.567101 30129 leader_election.cc:290] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:35.583186 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:35.584205 25900 raft_consensus.cc:2393] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 15: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:12:35.579602 30138 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
W20260709 13:12:35.587355 30127 log.cc:927] Time spent T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.242s	user 0.003s	sys 0.000s
I20260709 13:12:35.587121 30138 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:35.592829 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:35.593888 25904 raft_consensus.cc:2468] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 14.
I20260709 13:12:35.594254 30137 raft_consensus.cc:493] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:35.593112 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:35.595178 30137 raft_consensus.cc:515] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:35.597664 30138 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:35.596535 30030 leader_election.cc:290] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:35.603452 25372 raft_consensus.cc:1275] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 16 index: 7. (term mismatch)
I20260709 13:12:35.603873 25372 pending_rounds.cc:85] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468: Aborting all ops after (but not including) 6
I20260709 13:12:35.604274 25372 pending_rounds.cc:107] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468: Aborting uncommitted NO_OP operation due to leader change: 15.7
I20260709 13:12:35.604530 25372 raft_consensus.cc:2889] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:35.606022 30003 raft_consensus.cc:493] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:35.606590 30003 raft_consensus.cc:515] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:35.607908 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:35.608963 30003 leader_election.cc:290] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:35.609508 30003 raft_consensus.cc:493] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:35.609869 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:35.610138 30003 raft_consensus.cc:515] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:35.611130 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:35.608476 29999 raft_consensus.cc:493] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:35.611896 29999 raft_consensus.cc:515] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:35.612336 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:35.613622 30010 raft_consensus.cc:493] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:35.614089 25372 raft_consensus.cc:2410] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:12:35.614267 30010 raft_consensus.cc:515] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:35.603736 30137 leader_election.cc:290] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:35.614866 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:35.615464 30142 raft_consensus.cc:493] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:35.615809 25230 raft_consensus.cc:2368] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 16. Current term is 17.
I20260709 13:12:35.616144 30142 raft_consensus.cc:515] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:35.614954 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:35.617509 29832 raft_consensus.cc:493] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.618111 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:35.619184 25226 raft_consensus.cc:2410] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
W20260709 13:12:35.619627 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:35.618253 25372 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 8.
I20260709 13:12:35.623045 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:35.621013 30139 raft_consensus.cc:493] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:35.618281 29832 raft_consensus.cc:515] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:35.625006 30139 raft_consensus.cc:515] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:35.627173 30139 leader_election.cc:290] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:35.621821 29733 raft_consensus.cc:493] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:35.628249 29733 raft_consensus.cc:515] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:35.630155 25224 raft_consensus.cc:2368] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 11. Current term is 12.
I20260709 13:12:35.630358 29733 leader_election.cc:290] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:35.631152 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:35.621459 30138 raft_consensus.cc:493] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.631228 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:35.631958 30138 raft_consensus.cc:515] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:35.632495 25226 raft_consensus.cc:2410] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:12:35.633364 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:35.634295 30138 leader_election.cc:290] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:35.617244 30010 leader_election.cc:290] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:35.635253 30010 raft_consensus.cc:493] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:35.631974 25224 raft_consensus.cc:2393] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 8: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:35.637355 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:35.638103 25224 raft_consensus.cc:2468] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 11.
I20260709 13:12:35.638944 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:35.639734 25224 raft_consensus.cc:2410] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:12:35.635972 30010 raft_consensus.cc:515] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:35.649621 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
W20260709 13:12:35.654649 25343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:35.655354 25229 raft_consensus.cc:3060] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:35.658833 25225 raft_consensus.cc:1275] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:12:35.658828 30143 raft_consensus.cc:493] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.659842 30143 raft_consensus.cc:515] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:35.662314 30003 leader_election.cc:290] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:35.663224 30143 leader_election.cc:290] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:35.665925 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 43617.2us
I20260709 13:12:35.666424 30142 leader_election.cc:290] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:35.667375 25344 leader_election.cc:304] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:35.668131 30141 raft_consensus.cc:2804] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:35.668525 30141 raft_consensus.cc:493] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:35.668558 25372 raft_consensus.cc:1275] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:12:35.669006 25344 leader_election.cc:304] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:35.683543 30030 raft_consensus.cc:2804] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:35.684010 30030 raft_consensus.cc:493] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:35.684355 30030 raft_consensus.cc:3060] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:35.685128 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:35.685699 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:35.686075 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:35.686833 25907 raft_consensus.cc:2410] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:12:35.686853 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:35.684227 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:35.668960 30141 raft_consensus.cc:3060] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:12:35.700027 25195 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.891s	user 0.020s	sys 0.041s
W20260709 13:12:35.700999 25195 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.892s	user 0.021s	sys 0.041s
I20260709 13:12:35.705340 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:35.655421 29733 raft_consensus.cc:493] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:35.694726 30142 raft_consensus.cc:493] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.682684 30003 raft_consensus.cc:493] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
W20260709 13:12:35.711149 25345 leader_election.cc:336] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Timed out: RequestConsensusVote RPC to 127.23.140.65:39361 timed out after 1.778s (SENT)
I20260709 13:12:35.712833 29733 raft_consensus.cc:515] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:35.715916 29733 leader_election.cc:290] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:35.720326 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:35.721829 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:35.722687 25372 raft_consensus.cc:2393] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 13: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
W20260709 13:12:35.722533 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 1.96498e+06us
I20260709 13:12:35.708554 30142 raft_consensus.cc:515] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:35.723693 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:35.724493 25195 leader_election.cc:304] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:35.724761 30142 leader_election.cc:290] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:35.725072 25372 raft_consensus.cc:3055] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:35.728322 29832 leader_election.cc:290] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:35.725431 25372 raft_consensus.cc:740] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:35.735810 25195 leader_election.cc:304] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:35.750017 30141 raft_consensus.cc:515] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:35.755692 25229 raft_consensus.cc:2468] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 12.
W20260709 13:12:35.757439 25194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:35.731532 29999 leader_election.cc:290] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:35.758929 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 53326.1us
I20260709 13:12:35.760994 29832 consensus_queue.cc:1048] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:35.762627 30151 consensus_queue.cc:1048] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:35.764127 30141 leader_election.cc:290] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:35.765152 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
W20260709 13:12:35.766170 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 57691.5us
I20260709 13:12:35.767493 30153 raft_consensus.cc:2749] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:12:35.768471 25345 leader_election.cc:336] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Timed out: RequestConsensusVote RPC to 127.23.140.65:39361 timed out after 2.158s (SENT)
I20260709 13:12:35.769726 30150 raft_consensus.cc:2764] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:12:35.771028 25903 raft_consensus.cc:3060] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:35.741742 30003 raft_consensus.cc:515] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:35.779394 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:35.780122 25374 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 10.
I20260709 13:12:35.781122 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:35.782076 25372 consensus_queue.cc:260] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:35.783231 25372 raft_consensus.cc:3060] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:35.786450 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:35.789680 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:35.790589 25229 raft_consensus.cc:2393] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 14: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:35.793922 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:35.794976 30010 leader_election.cc:290] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:35.781678 25374 raft_consensus.cc:2468] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 13.
W20260709 13:12:35.804183 25221 consensus_meta.cc:287] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 1.798s	user 0.021s	sys 0.010s
I20260709 13:12:35.806136 25221 raft_consensus.cc:1275] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:12:35.806895 25221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 2386) took 1915 ms. Trace:
I20260709 13:12:35.807300 25221 rpcz_store.cc:276] 0709 13:12:33.891198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:33.896688 (+  5490us) service_pool.cc:224] Handling call
0709 13:12:33.897075 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:35.806613 (+1909538us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:35.806836 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:35.809000 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:35.810571 25221 raft_consensus.cc:2393] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 12: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:35.812727 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:35.809737 25903 raft_consensus.cc:2468] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 12.
I20260709 13:12:35.811094 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:35.815799 25229 raft_consensus.cc:2468] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 17.
I20260709 13:12:35.820204 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:35.820730 25344 leader_election.cc:304] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:35.820891 25374 raft_consensus.cc:2468] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 10.
I20260709 13:12:35.813992 30139 raft_consensus.cc:493] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.826104 30139 raft_consensus.cc:515] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:35.827467 30141 raft_consensus.cc:2804] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:35.828028 30141 raft_consensus.cc:697] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 12 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:35.834367 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:12:35.842118 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 106474us
I20260709 13:12:35.843331 25195 leader_election.cc:304] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:35.837638 25221 raft_consensus.cc:2468] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 7.
I20260709 13:12:35.845077 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 17 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:35.846915 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:35.849063 25221 raft_consensus.cc:2410] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 17 because replica has last-logged OpId of term: 16 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 6.
I20260709 13:12:35.828980 30141 consensus_queue.cc:237] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:35.853410 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:35.854247 25372 raft_consensus.cc:1275] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:12:35.854743 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:35.855355 25372 pending_rounds.cc:85] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468: Aborting all ops after (but not including) 5
I20260709 13:12:35.855875 25372 pending_rounds.cc:107] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:12:35.856909 25372 raft_consensus.cc:2889] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:35.857518 25230 raft_consensus.cc:2393] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 14: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:35.859203 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:35.859773 25224 raft_consensus.cc:2468] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 11.
I20260709 13:12:35.860316 25221 raft_consensus.cc:2393] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 8: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:35.863634 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:35.864506 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:35.865264 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:35.865293 25221 raft_consensus.cc:2410] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:12:35.870285 25224 raft_consensus.cc:2468] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 14.
I20260709 13:12:35.870707 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:35.867043 30157 raft_consensus.cc:2749] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:35.879021 30030 raft_consensus.cc:515] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:35.882951 25229 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 10.
I20260709 13:12:35.882984 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
W20260709 13:12:35.887897 25345 leader_election.cc:336] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Timed out: RequestConsensusVote RPC to 127.23.140.65:39361 timed out after 2.248s (SENT)
I20260709 13:12:35.888531 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:35.891765 25222 raft_consensus.cc:1240] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 15. Current term is 16. Ops: [15.7-15.7]
I20260709 13:12:35.893709 25345 leader_election.cc:304] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:35.897034 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:35.904162 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:35.904320 25222 raft_consensus.cc:1240] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:35.904740 25903 raft_consensus.cc:3060] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:35.895915 30146 raft_consensus.cc:493] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.901014 30129 raft_consensus.cc:2749] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:35.906216 30146 raft_consensus.cc:515] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:35.907011 25345 leader_election.cc:304] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:35.908747 30146 leader_election.cc:290] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:35.910288 30003 leader_election.cc:290] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:35.910545 25222 raft_consensus.cc:1240] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 11. Current term is 12. Ops: []
W20260709 13:12:35.910960 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 67795.6us
I20260709 13:12:35.911970 25222 raft_consensus.cc:1275] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:12:35.914017 30137 raft_consensus.cc:2749] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:35.915776 25224 raft_consensus.cc:1275] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:12:35.916042 25223 raft_consensus.cc:1240] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 16. Current term is 17. Ops: []
I20260709 13:12:35.916733 25223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58418 (request call id 2224) took 1956 ms. Trace:
I20260709 13:12:35.917089 25223 rpcz_store.cc:276] 0709 13:12:33.960077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:33.971308 (+ 11231us) service_pool.cc:224] Handling call
0709 13:12:35.915822 (+1944514us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:35.916481 (+   659us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:35.916675 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:35.943847 25903 raft_consensus.cc:2468] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 15.
I20260709 13:12:35.945603 25344 leader_election.cc:304] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:35.942003 25345 leader_election.cc:304] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:35.902530 30030 leader_election.cc:290] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:35.950711 25230 raft_consensus.cc:2468] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 7.
W20260709 13:12:35.959165 30040 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:12:35.959303 25195 leader_election.cc:304] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:35.960098 30153 consensus_queue.cc:1048] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:12:35.968901 30153 raft_consensus.cc:2749] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:35.956269 30138 raft_consensus.cc:2804] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:12:35.977432 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 202906us
W20260709 13:12:35.980508 30162 log.cc:927] Time spent T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:12:35.953356 30137 consensus_queue.cc:1048] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:12:35.982187 25270 leader_election.cc:304] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:12:35.983319 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:35.983893 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:35.984150 30040 raft_consensus.cc:2749] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:35.985167 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:35.986356 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:35.986881 25372 raft_consensus.cc:3060] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:35.951272 30146 consensus_queue.cc:1048] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:12:35.969828 30156 consensus_queue.cc:1059] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
W20260709 13:12:35.990490 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:36.000089 25270 leader_election.cc:304] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:36.000401 25372 raft_consensus.cc:2468] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 11.
I20260709 13:12:36.024889 30142 raft_consensus.cc:2804] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:36.043514 30142 raft_consensus.cc:493] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.043985 30142 raft_consensus.cc:3060] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:35.988226 30139 leader_election.cc:290] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:36.045241 30010 consensus_queue.cc:1048] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
W20260709 13:12:36.047475 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 105601us
I20260709 13:12:35.989663 30003 raft_consensus.cc:2804] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:36.048684 25345 leader_election.cc:304] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:36.052471 25270 leader_election.cc:304] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:12:36.052050 25343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:36.054198 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:36.055377 25221 raft_consensus.cc:2410] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
W20260709 13:12:36.049853 25906 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.153s	user 0.060s	sys 0.063s
W20260709 13:12:36.055950 25906 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.159s	user 0.060s	sys 0.064s
I20260709 13:12:35.990008 30138 raft_consensus.cc:697] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 15 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:35.990257 30156 raft_consensus.cc:3055] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:12:36.054564 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:36.058200 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:36.059149 25221 raft_consensus.cc:2376] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 79d99c0e498349bda74127365219e468 in term 12. Re-sending same reply.
I20260709 13:12:36.060869 29832 raft_consensus.cc:2804] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:36.061415 29832 raft_consensus.cc:697] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 11 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:36.060442 30156 raft_consensus.cc:740] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:36.028280 30030 raft_consensus.cc:493] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.066968 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:36.067693 25906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50058 (request call id 886) took 2180 ms. Trace:
I20260709 13:12:36.049626 30143 raft_consensus.cc:2804] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:12:36.071218 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:36.072599 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:36.048898 30003 raft_consensus.cc:493] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.062427 29832 consensus_queue.cc:237] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:36.073452 30030 raft_consensus.cc:515] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:36.075209 25873 leader_election.cc:304] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:36.086221 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:36.088191 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 128980us
I20260709 13:12:36.089689 25372 raft_consensus.cc:1275] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:12:36.089578 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:36.090600 25230 raft_consensus.cc:2376] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 79d99c0e498349bda74127365219e468 in term 12. Re-sending same reply.
I20260709 13:12:36.070314 25906 rpcz_store.cc:276] 0709 13:12:33.879690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:33.881352 (+  1662us) service_pool.cc:224] Handling call
0709 13:12:33.894777 (+ 13425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:33.895446 (+   669us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:33.895496 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:33.896044 (+   548us) log.cc:844] Serialized 26 byte log entry
0709 13:12:35.569678 (+1673634us) spinlock_profiling.cc:243] Waited 2.35 ms on lock 0x7b4400022b4c. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72caa8c85 00007fd72caa96a2 00007fd72f81b1db 00007fd72f816aaf 00007fd72f80a86e 00007fd72f809bb6 00007fd72f8097d8 00007fd72f813221 00007fd72f8131d9 00007fd72f813169
0709 13:12:36.056249 (+486571us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:36.056278 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:36.056324 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:36.056353 (+    29us) raft_consensus.cc:1685] finished
0709 13:12:36.056359 (+     6us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:36.057931 (+  1572us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1397,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":134,"spinlock_wait_cycles":5394688,"thread_start_us":2159712,"threads_started":1,"wal-append.queue_time_us":1435770}
I20260709 13:12:36.093063 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:36.072075 30143 raft_consensus.cc:493] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.091286 30030 leader_election.cc:290] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:36.096793 25345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:36.100383 25903 raft_consensus.cc:2468] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 11.
I20260709 13:12:36.105108 25344 leader_election.cc:304] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:36.106142 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:36.088498 30003 raft_consensus.cc:3060] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:36.100322 30143 raft_consensus.cc:3060] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:12:36.111938 25345 leader_election.cc:336] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Timed out: RequestConsensusVote RPC to 127.23.140.65:39361 timed out after 3.282s (SENT)
I20260709 13:12:36.114629 25345 leader_election.cc:304] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:36.116706 25195 leader_election.cc:304] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:36.116916 30010 raft_consensus.cc:2955] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 12 LEADER]: Committing config change with OpId 8.8: config changed from index 2 to 8, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
W20260709 13:12:36.128125 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:36.109378 30040 raft_consensus.cc:2804] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:36.142721 30140 raft_consensus.cc:2749] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:36.103216 30156 consensus_queue.cc:260] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:36.136286 30040 raft_consensus.cc:493] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:36.154003 25345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:36.163255 25345 leader_election.cc:304] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:36.168715 30140 raft_consensus.cc:2804] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:36.169196 30140 raft_consensus.cc:493] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:36.169597 30140 raft_consensus.cc:3060] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:36.171628 25345 leader_election.cc:304] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:36.172780 30030 raft_consensus.cc:2804] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:36.173215 30030 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:36.173653 30030 raft_consensus.cc:3060] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:36.173444 25345 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:36.180778 30140 raft_consensus.cc:515] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:36.188014 30171 raft_consensus.cc:2749] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:36.191176 30175 raft_consensus.cc:2749] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:12:36.192970 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 76370.9us
I20260709 13:12:36.167532 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:36.164700 30040 raft_consensus.cc:3060] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:36.202240 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:36.222220 30182 raft_consensus.cc:2749] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:12:36.233909 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 2.2221e+06us
I20260709 13:12:36.242043 25195 leader_election.cc:304] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:36.240610 25224 raft_consensus.cc:2468] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 10.
I20260709 13:12:36.198614 30151 consensus_queue.cc:1048] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:12:36.146517 30138 consensus_queue.cc:237] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:36.257838 25376 raft_consensus.cc:2955] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 2 to 8, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:12:36.244143 30142 raft_consensus.cc:515] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:36.264004 30172 raft_consensus.cc:2749] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:36.264879 30142 leader_election.cc:290] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:36.280444 25873 leader_election.cc:304] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:36.288662 30003 raft_consensus.cc:515] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:36.296250 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 56790.8us
I20260709 13:12:36.300455 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:36.302122 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:36.304415 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:36.304713 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:36.305435 25300 raft_consensus.cc:1275] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:12:36.306809 25296 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 10.
I20260709 13:12:36.314592 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:36.315119 25374 raft_consensus.cc:3060] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:36.307226 25302 raft_consensus.cc:2393] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 11: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:36.309072 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:36.318607 25299 raft_consensus.cc:2410] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:12:36.310217 25303 raft_consensus.cc:1240] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 14 LEADER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:36.307493 25301 raft_consensus.cc:2468] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 14.
I20260709 13:12:36.306530 25373 raft_consensus.cc:2376] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 11. Re-sending same reply.
I20260709 13:12:36.306757 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:36.321108 25378 raft_consensus.cc:3060] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:36.308773 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:36.322964 25297 raft_consensus.cc:2410] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:12:36.324432 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:36.324712 30175 consensus_queue.cc:1048] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:12:36.309343 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:36.331115 25298 raft_consensus.cc:2410] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:12:36.312732 30003 leader_election.cc:290] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:36.338040 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:36.333598 25195 leader_election.cc:304] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:36.339794 30154 raft_consensus.cc:2749] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:36.341219 25195 leader_election.cc:304] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:36.349125 30030 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:36.349627 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:36.350229 25899 raft_consensus.cc:2468] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 15.
I20260709 13:12:36.351929 25344 leader_election.cc:304] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:36.351963 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:36.352722 25228 raft_consensus.cc:2468] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 11.
I20260709 13:12:36.352962 30187 raft_consensus.cc:2804] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:36.353463 30187 raft_consensus.cc:493] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:36.353857 30187 raft_consensus.cc:3060] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:36.354722 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:36.355545 25297 raft_consensus.cc:2410] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:12:36.356895 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:36.358315 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:36.360610 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:36.362082 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:36.363873 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:36.364871 25377 raft_consensus.cc:1275] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:12:36.365617 30040 raft_consensus.cc:515] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:36.361254 25128 catalog_manager.cc:5697] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 6 to 8, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 8 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:36.374495 25296 raft_consensus.cc:1240] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 11 LEADER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:36.374800 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:36.375003 25128 catalog_manager.cc:5697] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 9 to 12, leader changed from 79d99c0e498349bda74127365219e468 (127.23.140.67) to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 12 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } }
I20260709 13:12:36.377166 25378 raft_consensus.cc:2468] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 11.
I20260709 13:12:36.380468 25374 raft_consensus.cc:2468] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 14.
I20260709 13:12:36.376638 25128 catalog_manager.cc:5697] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 8 to 9, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 9 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
I20260709 13:12:36.330574 30140 leader_election.cc:290] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:36.383023 25270 leader_election.cc:304] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:36.306521 30185 raft_consensus.cc:2749] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:36.384259 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:36.385372 25270 leader_election.cc:304] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:36.388772 25128 catalog_manager.cc:5697] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 5 to 6, leader changed from 79d99c0e498349bda74127365219e468 (127.23.140.67) to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 6 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
I20260709 13:12:36.383845 30157 raft_consensus.cc:2749] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:12:36.399403 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 226106us
I20260709 13:12:36.403339 25128 catalog_manager.cc:5697] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 7 to 13, leader changed from 79d99c0e498349bda74127365219e468 (127.23.140.67) to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 13 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
I20260709 13:12:36.401988 25345 leader_election.cc:304] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:36.405516 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:36.410019 25303 raft_consensus.cc:2468] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 14.
W20260709 13:12:36.413703 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 72592.4us
I20260709 13:12:36.420239 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:36.420895 25303 raft_consensus.cc:2410] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:12:36.398765 30143 raft_consensus.cc:515] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:36.405182 30142 consensus_queue.cc:1048] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:12:36.412091 30178 raft_consensus.cc:2804] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:36.438127 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:36.438416 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
W20260709 13:12:36.427495 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:36.509989 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:36.461512 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 144892us
I20260709 13:12:36.438714 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:36.425586 25227 raft_consensus.cc:1275] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:12:36.421976 25128 catalog_manager.cc:5697] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 5 to 7, leader changed from 79d99c0e498349bda74127365219e468 (127.23.140.67) to 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68). New cstate: current_term: 7 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:12:36.418234 30151 raft_consensus.cc:2804] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:12:36.536914 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:36.550194 25227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58418 (request call id 2223) took 2583 ms. Trace:
I20260709 13:12:36.450795 30156 raft_consensus.cc:3060] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:36.550693 25227 rpcz_store.cc:276] 0709 13:12:33.959689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:33.959816 (+   127us) service_pool.cc:224] Handling call
0709 13:12:33.960253 (+   437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:36.531190 (+2570937us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:36.542560 (+ 11370us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:36.554786 25299 raft_consensus.cc:3060] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:36.543008 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:36.567595 25303 raft_consensus.cc:2468] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 10.
W20260709 13:12:36.568023 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:36.535735 25296 raft_consensus.cc:2468] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 16.
W20260709 13:12:36.571275 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:36.531605 30137 raft_consensus.cc:2804] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:36.560153 25128 catalog_manager.cc:5697] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 6 to 12. New cstate: current_term: 12 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
I20260709 13:12:36.534258 25195 leader_election.cc:304] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:36.578119 30157 raft_consensus.cc:2749] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:12:36.568694 30141 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.000s	sys 0.027s
W20260709 13:12:36.586416 30141 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.000s	sys 0.028s
W20260709 13:12:36.579311 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 155116us
I20260709 13:12:36.599669 25195 leader_election.cc:304] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:36.561614 30147 log.cc:927] Time spent T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
W20260709 13:12:36.562259 30150 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.004s	sys 0.027s
I20260709 13:12:36.573401 25873 leader_election.cc:304] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:36.573544 30185 raft_consensus.cc:493] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.439320 30187 raft_consensus.cc:515] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:36.614040 30150 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.004s	sys 0.028s
W20260709 13:12:36.622605 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 63027.1us
I20260709 13:12:36.626518 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:36.618212 30154 raft_consensus.cc:2749] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:36.628384 25128 catalog_manager.cc:5697] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 5 to 12, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68). New cstate: current_term: 12 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:12:36.635183 30185 raft_consensus.cc:515] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:36.672974 30186 log.cc:927] Time spent T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
W20260709 13:12:36.682806 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 45561.7us
I20260709 13:12:36.682770 25128 catalog_manager.cc:5697] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 5 to 9, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 9 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
I20260709 13:12:36.688931 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:36.691556 25128 catalog_manager.cc:5697] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
I20260709 13:12:36.681304 30178 raft_consensus.cc:697] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 11 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:36.698056 30178 consensus_queue.cc:237] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:36.691608 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 76391us
I20260709 13:12:36.721405 25195 leader_election.cc:304] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:36.721331 25128 catalog_manager.cc:5697] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 7 to 10, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 10 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
I20260709 13:12:36.726598 25299 raft_consensus.cc:2468] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 15.
W20260709 13:12:36.727458 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 105182us
I20260709 13:12:36.728921 25128 catalog_manager.cc:5697] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 4 to 10, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 10 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:36.723343 30154 raft_consensus.cc:2749] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:36.740103 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
W20260709 13:12:36.743646 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 117832us
I20260709 13:12:36.734833 30190 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.739481 30143 leader_election.cc:290] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 18 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:36.760468 25128 catalog_manager.cc:5697] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 7 to 10, leader changed from 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 10 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:12:36.818809 25304 raft_consensus.cc:1275] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:12:36.819391 30185 leader_election.cc:290] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:36.822947 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 64328.7us
I20260709 13:12:36.827605 25195 leader_election.cc:304] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:36.761277 30200 raft_consensus.cc:493] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
W20260709 13:12:36.823460 30192 log.cc:927] Time spent T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:12:36.820179 30143 consensus_queue.cc:1059] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:12:36.823222 25128 catalog_manager.cc:5697] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 6 to 9, leader changed from 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 9 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:36.822992 30195 log.cc:927] Time spent T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:12:36.749657 30190 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:36.848289 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 108147us
I20260709 13:12:36.853439 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:36.858114 25128 catalog_manager.cc:5697] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 6 to 7, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 7 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:36.833055 30205 raft_consensus.cc:2804] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:12:36.868477 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 130086us
I20260709 13:12:36.850227 30150 raft_consensus.cc:2749] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:12:36.872187 30193 log.cc:927] Time spent T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
I20260709 13:12:36.873760 30143 raft_consensus.cc:3055] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:36.874187 30143 raft_consensus.cc:740] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:36.874631 30215 raft_consensus.cc:493] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:36.875079 30143 consensus_queue.cc:260] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:36.875252 30215 raft_consensus.cc:515] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:36.875962 30190 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:36.876389 30143 raft_consensus.cc:3060] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:36.839893 30202 consensus_queue.cc:1048] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:12:36.873347 30217 consensus_queue.cc:1048] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:12:36.877501 30215 leader_election.cc:290] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:36.887228 25903 raft_consensus.cc:2468] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 15.
I20260709 13:12:36.892864 25344 leader_election.cc:304] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:36.832213 30200 raft_consensus.cc:515] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:36.896591 25128 catalog_manager.cc:5697] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 5 to 10. New cstate: current_term: 10 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:36.899905 25903 raft_consensus.cc:1275] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:12:36.904767 30213 consensus_queue.cc:1048] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:12:36.905622 30040 leader_election.cc:290] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:36.906342 30150 consensus_queue.cc:1048] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:36.889106 30185 raft_consensus.cc:493] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:36.907822 25128 catalog_manager.cc:5697] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 7 to 13, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 13 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
I20260709 13:12:36.916096 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:36.916285 25195 leader_election.cc:304] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:36.900456 30202 raft_consensus.cc:2804] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:36.918043 25271 leader_election.cc:304] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:12:36.918568 30202 raft_consensus.cc:697] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 15 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:36.919641 30202 consensus_queue.cc:237] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:36.921836 30188 log.cc:927] Time spent T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 13:12:36.923069 30206 raft_consensus.cc:2804] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:36.923691 30206 raft_consensus.cc:697] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 11 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:36.926469 25230 raft_consensus.cc:2468] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 13.
I20260709 13:12:36.929381 25223 raft_consensus.cc:1240] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:36.930042 30198 raft_consensus.cc:493] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:36.945587 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:36.945318 25128 catalog_manager.cc:5697] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:12:36.946903 25128 catalog_manager.cc:5697] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 6 to 12. New cstate: current_term: 12 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:12:36.945329 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:36.952740 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:36.957031 25128 catalog_manager.cc:5697] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:12:36.959188 25128 catalog_manager.cc:5697] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 6 to 10, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 10 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
I20260709 13:12:36.924925 30030 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:36.966379 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:36.964865 30217 raft_consensus.cc:993] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19: : Instructing follower 1f539ba21487460085b837e7529a78ce to start an election
I20260709 13:12:36.926043 30185 raft_consensus.cc:515] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:36.986948 25128 catalog_manager.cc:5697] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 2 to 9. New cstate: current_term: 9 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:36.990659 25195 leader_election.cc:304] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:36.991612 30154 raft_consensus.cc:2749] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:36.995430 30216 raft_consensus.cc:493] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:36.992638 25128 catalog_manager.cc:5697] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 7 to 8, leader changed from 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 8 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:36.996073 30216 raft_consensus.cc:515] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:36.965528 30150 raft_consensus.cc:2749] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:36.998104 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:36.998737 25907 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 8.
I20260709 13:12:37.002797 30215 raft_consensus.cc:1081] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 11 LEADER]: Signalling peer 1f539ba21487460085b837e7529a78ce to start an election
I20260709 13:12:37.004319 30218 raft_consensus.cc:493] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:36.967933 30205 raft_consensus.cc:697] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:37.006680 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:37.006680 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:37.007612 25225 raft_consensus.cc:2468] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 10.
I20260709 13:12:37.006757 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:37.010425 25226 raft_consensus.cc:1240] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:37.004922 30218 raft_consensus.cc:515] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:37.014540 25874 leader_election.cc:336] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Timed out: RequestConsensusVote RPC to 127.23.140.65:39361 timed out after 1.584s (SENT)
I20260709 13:12:37.015715 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:37.015823 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:37.015874 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:37.016512 25906 raft_consensus.cc:2468] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 16.
I20260709 13:12:36.970865 30219 consensus_queue.cc:1048] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:12:37.017102 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:37.017407 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:37.017843 30217 raft_consensus.cc:493] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:37.018603 30217 raft_consensus.cc:515] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:37.019556 30218 leader_election.cc:290] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:37.019941 30194 log.cc:927] Time spent T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 13:12:37.020246 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:37.020862 25907 raft_consensus.cc:2468] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 12.
I20260709 13:12:36.966303 30198 raft_consensus.cc:515] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:37.015113 25874 leader_election.cc:304] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:37.047717 25128 catalog_manager.cc:5697] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
W20260709 13:12:37.064862 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:37.021471 30217 leader_election.cc:290] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:37.059556 25128 catalog_manager.cc:5697] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
I20260709 13:12:37.070952 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:37.072432 25225 raft_consensus.cc:2410] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:12:37.070952 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:37.022107 30215 raft_consensus.cc:493] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:37.074440 25128 catalog_manager.cc:5697] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
I20260709 13:12:37.023200 30198 leader_election.cc:290] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:37.024250 30205 consensus_queue.cc:237] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:37.079289 25907 raft_consensus.cc:2468] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 11.
I20260709 13:12:37.079424 30223 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:37.073815 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:37.080582 25227 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 8.
I20260709 13:12:37.080200 30223 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:37.082676 30223 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:37.085937 30225 raft_consensus.cc:2749] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:37.086789 30221 raft_consensus.cc:493] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.087422 30221 raft_consensus.cc:515] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:37.088443 30200 leader_election.cc:290] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:12:37.087376 25872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:36.962456 30206 consensus_queue.cc:237] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:37.093446 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:37.094717 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:37.095747 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:37.096736 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:37.103114 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:37.103860 25908 raft_consensus.cc:3060] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:12:37.069845 30138 raft_consensus.cc:493] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
W20260709 13:12:37.092464 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 230779us
I20260709 13:12:37.112792 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:37.079301 30181 raft_consensus.cc:493] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:37.119975 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 109110us
I20260709 13:12:37.122887 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:37.125155 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:37.108355 30216 leader_election.cc:290] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:37.125777 25296 raft_consensus.cc:2468] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 13.
W20260709 13:12:37.130836 25874 leader_election.cc:336] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Timed out: RequestConsensusVote RPC to 127.23.140.65:39361 timed out after 1.644s (SENT)
I20260709 13:12:37.131305 25874 leader_election.cc:304] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:37.139664 30233 consensus_queue.cc:1048] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:37.141909 30199 raft_consensus.cc:493] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.142683 30199 raft_consensus.cc:515] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:37.143927 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:37.144610 25301 raft_consensus.cc:2468] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 13.
I20260709 13:12:37.144991 30199 leader_election.cc:290] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:37.146699 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:37.150228 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:37.152521 25908 raft_consensus.cc:2468] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 14.
I20260709 13:12:37.119534 29999 raft_consensus.cc:493] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.126289 30221 leader_election.cc:290] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:37.156002 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:37.118759 30215 raft_consensus.cc:515] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:37.157155 25345 leader_election.cc:304] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:37.164920 25303 raft_consensus.cc:1240] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:37.165787 25904 raft_consensus.cc:1240] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:37.157717 30185 leader_election.cc:290] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:37.159440 25226 raft_consensus.cc:1275] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:12:37.119786 30198 raft_consensus.cc:493] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.160756 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:12:37.149863 30151 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.009s	sys 0.010s
I20260709 13:12:37.168186 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:37.169389 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:37.170058 25227 raft_consensus.cc:2468] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 10.
I20260709 13:12:37.164229 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:37.175360 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:37.176102 25225 raft_consensus.cc:3060] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:37.176918 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:37.180507 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:37.182415 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:37.186270 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:37.119630 30138 raft_consensus.cc:515] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:37.189332 25303 raft_consensus.cc:2468] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 13.
W20260709 13:12:37.191572 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 67810.3us
I20260709 13:12:37.192859 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 17 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:37.193179 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:37.194041 25227 raft_consensus.cc:2468] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 11.
I20260709 13:12:37.195415 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:37.196837 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:37.174382 30218 raft_consensus.cc:2749] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:12:37.188472 25345 leader_election.cc:304] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:37.124615 30181 raft_consensus.cc:515] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:37.167766 30151 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.010s	sys 0.010s
W20260709 13:12:37.203387 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 72596.1us
I20260709 13:12:37.211059 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:37.212538 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:37.212553 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:37.215140 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:37.217341 25227 raft_consensus.cc:3060] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:37.220139 30210 raft_consensus.cc:2804] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:37.220788 30210 raft_consensus.cc:493] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:37.221226 30210 raft_consensus.cc:3060] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:37.164605 29999 raft_consensus.cc:515] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:37.222719 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:37.223332 25226 raft_consensus.cc:3060] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:37.223554 29999 leader_election.cc:290] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:37.227149 30138 leader_election.cc:290] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:37.183663 30198 raft_consensus.cc:515] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:37.229769 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:37.231123 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:37.232268 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:37.233412 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:37.234130 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:37.235898 25299 raft_consensus.cc:2468] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 15.
I20260709 13:12:37.237144 25228 raft_consensus.cc:2468] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 13.
W20260709 13:12:37.240530 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 52167.9us
I20260709 13:12:37.242851 25297 raft_consensus.cc:2393] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 15: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:37.243463 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:37.246934 25343 leader_election.cc:304] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:37.246732 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:37.214123 30213 raft_consensus.cc:2749] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:37.252475 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:37.253046 30215 leader_election.cc:290] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:37.254298 25221 raft_consensus.cc:1275] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:12:37.255131 30181 leader_election.cc:290] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:37.210590 30151 raft_consensus.cc:697] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 14 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:37.256809 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:37.258487 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:37.259192 25228 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 8.
I20260709 13:12:37.260161 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:12:37.264698 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 47050.5us
I20260709 13:12:37.266683 30151 consensus_queue.cc:237] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:37.274055 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:37.276032 25225 raft_consensus.cc:2468] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 11.
I20260709 13:12:37.278282 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:37.263767 25345 leader_election.cc:304] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:37.285467 25227 raft_consensus.cc:2468] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 14.
I20260709 13:12:37.288383 30241 consensus_queue.cc:1048] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:12:37.262234 30187 leader_election.cc:290] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:37.294888 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:37.294411 30213 raft_consensus.cc:2749] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:12:37.298347 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:37.298244 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:37.300868 25343 leader_election.cc:304] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:37.301271 25225 raft_consensus.cc:1240] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:37.303448 30241 consensus_queue.cc:1059] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:12:37.307772 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:37.311969 30241 raft_consensus.cc:3055] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:37.312595 30241 raft_consensus.cc:740] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:37.313350 25345 leader_election.cc:304] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:37.313540 30241 consensus_queue.cc:260] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:37.314947 30211 raft_consensus.cc:2749] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:37.315336 30241 raft_consensus.cc:3060] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:37.318359 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:37.319391 25224 raft_consensus.cc:2468] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 12.
I20260709 13:12:37.318650 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:37.303670 30202 raft_consensus.cc:2749] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:37.330264 25899 raft_consensus.cc:1275] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:12:37.333287 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:37.334025 25899 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 8.
I20260709 13:12:37.299772 25227 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87"
dest_uuid: "1f539ba21487460085b837e7529a78ce"
 from {username='slave'} at 127.0.0.1:58422
I20260709 13:12:37.338714 25227 raft_consensus.cc:493] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:37.338757 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:37.340150 25227 raft_consensus.cc:3060] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:37.347271 25899 raft_consensus.cc:1240] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:37.360450 25226 raft_consensus.cc:2468] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 11.
W20260709 13:12:37.362169 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 61383.6us
I20260709 13:12:37.362558 25305 raft_consensus.cc:1275] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:12:37.366657 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:37.368712 25305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57272 (request call id 2143) took 1065 ms. Trace:
I20260709 13:12:37.369172 25305 rpcz_store.cc:276] 0709 13:12:36.303537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:37.361842 (+1058305us) service_pool.cc:224] Handling call
0709 13:12:37.362185 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:37.366267 (+  4082us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:37.368649 (+  2382us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:37.383028 25305 raft_consensus.cc:1217] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 12 LEADER]: Deduplicated request from leader. Original: 10.5->[11.6-11.6]   Dedup: 11.6->[]
I20260709 13:12:37.383898 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:37.385375 25305 raft_consensus.cc:1240] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 12 LEADER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:12:37.387315 25343 leader_election.cc:304] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:12:37.388523 30241 raft_consensus.cc:2804] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:37.388816 25343 leader_election.cc:304] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:37.390000 30140 raft_consensus.cc:2749] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:37.390477 25296 raft_consensus.cc:1275] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:12:37.392489 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:37.392720 30198 leader_election.cc:290] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:37.393062 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:37.394284 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:37.394927 25377 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 8.
I20260709 13:12:37.395465 25375 raft_consensus.cc:1240] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:37.389072 30241 raft_consensus.cc:493] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:37.396212 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:12:37.396883 25929 debug-util.cc:398] Leaking SignalData structure 0x7b080033ee60 after lost signal to thread 24116
I20260709 13:12:37.395556 25374 raft_consensus.cc:1240] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:12:37.396387 30241 raft_consensus.cc:3060] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:37.383816 25227 raft_consensus.cc:515] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:37.362232 30202 raft_consensus.cc:3060] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:12:37.398097 25929 debug-util.cc:398] Leaking SignalData structure 0x7b0800307a20 after lost signal to thread 25162
I20260709 13:12:37.405130 25298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57272 (request call id 2155) took 1031 ms. Trace:
I20260709 13:12:37.414178 25228 raft_consensus.cc:1275] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:12:37.410863 25343 leader_election.cc:304] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:37.415374 25929 debug-util.cc:398] Leaking SignalData structure 0x7b0800213200 after lost signal to thread 25254
W20260709 13:12:37.415727 25929 debug-util.cc:398] Leaking SignalData structure 0x7b08002aa260 after lost signal to thread 25255
I20260709 13:12:37.421052 30221 consensus_queue.cc:1048] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:12:37.421350 25874 leader_election.cc:304] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:37.422130 25899 raft_consensus.cc:1275] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:12:37.414376 25298 rpcz_store.cc:276] 0709 13:12:36.373494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:36.375821 (+  2327us) service_pool.cc:224] Handling call
0709 13:12:36.376169 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:36.376420 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:12:36.377037 (+   617us) log.cc:844] Serialized 14 byte log entry
0709 13:12:36.776342 (+399305us) log.cc:844] Serialized 14 byte log entry
0709 13:12:37.136395 (+360053us) spinlock_profiling.cc:243] Waited 2.56 ms on lock 0x7b180034b100. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72cb82522 00007fd72cb847c1 00007fd72cb84779 00007fd72cb84709 00007fd72cb846d1 00007fd72cb839cd 000000000038f354 000000000038f199 00007fd72cb6583a
0709 13:12:37.313280 (+176885us) spinlock_profiling.cc:243] Waited 8.78 ms on lock 0x7b48000438d8. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd734b98aa1 00007fd734b8fb37 00007fd734b8f9ca 00007fd734c8726f 00007fd734c86f37 00007fd734c9b55c 00007fd734c9b508 00007fd734c9b488 00007fd734c9b443 00007fd734c9a6ec 00007fd733bc4a96
0709 13:12:37.404587 (+ 91307us) spinlock_profiling.cc:243] Waited 1.63 ms on lock 0x7b180034b100. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72f8174bc 00007fd72cb6548b 00007fd7359bfab9 00007fd72cb8169b 00007fd72cb7f93f 00007fd72cb7f455 00007fd72fc67060 00007fd72fc79716 00007fd72fc8a287
0709 13:12:37.404728 (+   141us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:37.404794 (+    66us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:12:37.404848 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:37.404926 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:37.405064 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44760,"prepare.queue_time_us":9222,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":69,"raft.queue_time_us":370466,"raft.run_cpu_time_us":3661,"raft.run_wall_time_us":447808,"spinlock_wait_cycles":29820160,"thread_start_us":416834,"threads_started":3,"wal-append.queue_time_us":243745}
I20260709 13:12:37.424700 25343 leader_election.cc:304] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:37.411106 25872 leader_election.cc:304] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:37.448954 25872 leader_election.cc:304] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:12:37.450806 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:37.451428 25226 raft_consensus.cc:3060] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:37.450834 30185 raft_consensus.cc:2804] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:37.452061 30185 raft_consensus.cc:493] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:37.452435 30185 raft_consensus.cc:3060] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:37.456854 30221 raft_consensus.cc:2804] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:37.457342 30221 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:37.457667 30221 raft_consensus.cc:3060] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:37.458639 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:37.459810 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:37.462373 30137 raft_consensus.cc:493] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:37.432926 30210 raft_consensus.cc:515] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:37.462941 30137 raft_consensus.cc:3060] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:37.463874 25223 raft_consensus.cc:1275] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:12:37.464378 30210 leader_election.cc:290] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:37.434370 25230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58418 (request call id 2275) took 1340 ms. Trace:
I20260709 13:12:37.464938 25230 rpcz_store.cc:276] 0709 13:12:36.093835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:36.094041 (+   206us) service_pool.cc:224] Handling call
0709 13:12:37.434186 (+1340145us) spinlock_profiling.cc:243] Waited 623 ms on lock 0x7b54003a5f54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:37.434307 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1433372416}
I20260709 13:12:37.465955 25374 raft_consensus.cc:1240] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:37.466509 30171 raft_consensus.cc:493] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:37.433792 25908 raft_consensus.cc:2955] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 2 to 8, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:12:37.467032 30171 raft_consensus.cc:515] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:37.469105 30171 leader_election.cc:290] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:37.436142 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:37.435497 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:37.470064 25300 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 8.
W20260709 13:12:37.470259 30010 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.145s	user 0.014s	sys 0.007s
W20260709 13:12:37.470664 30010 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.145s	user 0.014s	sys 0.007s
I20260709 13:12:37.439610 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:37.441001 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:37.471351 25229 raft_consensus.cc:3060] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:37.432928 30156 raft_consensus.cc:493] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:37.470616 25300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57272 (request call id 2146) took 1155 ms. Trace:
I20260709 13:12:37.424527 30240 raft_consensus.cc:3060] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:37.481312 25300 rpcz_store.cc:276] 0709 13:12:36.315019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:37.435813 (+1120794us) service_pool.cc:224] Handling call
0709 13:12:37.470555 (+ 34742us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:37.481477 25271 leader_election.cc:304] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:37.462543 25303 raft_consensus.cc:1240] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:37.472368 25222 raft_consensus.cc:3060] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:12:37.472419 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 47790.5us
W20260709 13:12:37.478492 25929 debug-util.cc:398] Leaking SignalData structure 0x7b08000d9980 after lost signal to thread 25329
I20260709 13:12:37.478925 25223 raft_consensus.cc:3055] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:37.448988 25874 leader_election.cc:304] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:12:37.482630 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:37.483069 25223 raft_consensus.cc:740] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:37.483465 25374 raft_consensus.cc:2368] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 13. Current term is 14.
I20260709 13:12:37.483561 25227 leader_election.cc:290] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:37.483187 25343 leader_election.cc:304] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:37.484603 25929 debug-util.cc:398] Leaking SignalData structure 0x7b0800321b80 after lost signal to thread 25330
W20260709 13:12:37.486255 25929 debug-util.cc:398] Leaking SignalData structure 0x7b08003fd640 after lost signal to thread 25403
W20260709 13:12:37.486647 25929 debug-util.cc:398] Leaking SignalData structure 0x7b08001e1b00 after lost signal to thread 25404
W20260709 13:12:37.487890 25929 debug-util.cc:398] Leaking SignalData structure 0x7b08003beb80 after lost signal to thread 25932
I20260709 13:12:37.488418 25271 leader_election.cc:304] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:37.490497 25270 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:12:37.494086 25929 debug-util.cc:398] Leaking SignalData structure 0x7b0800302ba0 after lost signal to thread 25933
I20260709 13:12:37.495556 25374 raft_consensus.cc:1240] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:37.496842 25343 leader_election.cc:304] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:37.498606 25343 leader_election.cc:304] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:37.498667 25226 raft_consensus.cc:2468] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 18.
I20260709 13:12:37.484205 25223 consensus_queue.cc:260] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:37.502522 25271 leader_election.cc:304] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
W20260709 13:12:37.503648 25929 debug-util.cc:398] Leaking SignalData structure 0x7b080038a860 after lost signal to thread 30074
W20260709 13:12:37.504134 25929 debug-util.cc:398] Leaking SignalData structure 0x7b08003e3c40 after lost signal to thread 30092
W20260709 13:12:37.504405 25929 debug-util.cc:398] Leaking SignalData structure 0x7b0800229540 after lost signal to thread 30093
W20260709 13:12:37.504632 25929 debug-util.cc:398] Leaking SignalData structure 0x7b0800105000 after lost signal to thread 30099
W20260709 13:12:37.505225 25929 debug-util.cc:398] Leaking SignalData structure 0x7b080037b880 after lost signal to thread 30114
W20260709 13:12:37.535997 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 45173.3us
I20260709 13:12:37.519996 25270 leader_election.cc:304] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:37.484251 30213 raft_consensus.cc:2749] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:37.547294 25270 leader_election.cc:304] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:37.545744 25873 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:37.557387 25270 leader_election.cc:304] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:12:37.489980 30218 raft_consensus.cc:2804] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:37.558089 25271 leader_election.cc:304] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:37.505041 29999 raft_consensus.cc:2749] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:37.570307 25270 leader_election.cc:304] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:37.505194 30182 raft_consensus.cc:2749] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:37.486697 30216 consensus_queue.cc:1059] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 13:12:37.584478 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:37.584950 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:37.542272 30233 raft_consensus.cc:2749] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:37.577046 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:12:37.603765 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 45780.6us
I20260709 13:12:37.583870 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:37.575732 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:37.531853 30156 raft_consensus.cc:515] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:37.608423 25270 leader_election.cc:304] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:37.608680 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:37.589730 30214 raft_consensus.cc:493] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:37.568222 29832 raft_consensus.cc:2749] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:37.499991 30157 consensus_queue.cc:1048] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.076s
I20260709 13:12:37.593879 30203 raft_consensus.cc:2804] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:37.594311 30201 raft_consensus.cc:2749] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:37.594614 30202 raft_consensus.cc:2749] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:12:37.595069 30247 log.cc:927] Time spent T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:12:37.595412 30249 log.cc:927] Time spent T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.214s	user 0.000s	sys 0.002s
I20260709 13:12:37.619246 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:37.585047 30205 raft_consensus.cc:2804] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:37.543813 30206 raft_consensus.cc:2804] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:37.551576 30129 consensus_queue.cc:1048] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:12:37.560715 30235 raft_consensus.cc:2749] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:37.610167 25270 leader_election.cc:304] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
W20260709 13:12:37.640105 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 147606us
I20260709 13:12:37.610704 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:37.612216 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:37.502586 30171 consensus_queue.cc:1048] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.080s
I20260709 13:12:37.589602 30239 raft_consensus.cc:2749] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:37.642508 25903 raft_consensus.cc:2468] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 11.
I20260709 13:12:37.613776 25229 raft_consensus.cc:2468] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 12.
I20260709 13:12:37.504501 30241 raft_consensus.cc:515] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:37.570827 30218 raft_consensus.cc:493] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:37.622998 25371 raft_consensus.cc:1240] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 12 LEADER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:37.626627 25377 raft_consensus.cc:2393] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 13: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:37.595651 30216 raft_consensus.cc:3055] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:37.585397 30204 raft_consensus.cc:2804] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:37.629206 25195 leader_election.cc:304] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:37.547492 30150 consensus_queue.cc:1059] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 13:12:37.605376 25271 leader_election.cc:304] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
W20260709 13:12:37.638033 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 186651us
I20260709 13:12:37.639007 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:37.639158 30220 raft_consensus.cc:2749] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:37.642817 25194 leader_election.cc:304] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:37.665441 25872 leader_election.cc:304] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:12:37.648581 25229 raft_consensus.cc:1240] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 18 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 17. Current term is 18. Ops: [15.12-17.13]
I20260709 13:12:37.620894 30203 raft_consensus.cc:493] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:37.607556 30141 consensus_queue.cc:1048] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:12:37.633689 30205 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:37.633927 30206 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:37.667936 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:37.607276 30200 consensus_queue.cc:1059] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:12:37.639042 30208 raft_consensus.cc:3060] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:37.681195 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:12:37.669966 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 64678.6us
I20260709 13:12:37.670956 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:37.673157 25872 leader_election.cc:304] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:12:37.670288 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:37.625594 30223 consensus_queue.cc:1059] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 13:12:37.681538 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:37.678841 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:37.678004 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:37.658406 30216 raft_consensus.cc:740] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:37.693138 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:37.631304 30214 raft_consensus.cc:515] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:37.658762 30215 raft_consensus.cc:2804] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:37.698868 25298 raft_consensus.cc:2468] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 12.
I20260709 13:12:37.658250 30204 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:37.699496 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:37.698680 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:37.658851 30218 raft_consensus.cc:3060] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:37.674823 30203 raft_consensus.cc:3060] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:37.680749 30206 raft_consensus.cc:3060] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:37.674324 30235 raft_consensus.cc:2749] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:37.712066 25271 leader_election.cc:304] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:37.677847 30205 raft_consensus.cc:3060] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:37.714228 25377 raft_consensus.cc:2393] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 11: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:37.687268 30150 consensus_queue.cc:1243] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Peer da445ce82dc4467f95f4fa52297eaa19 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 13:12:37.726050 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 96969.9us
I20260709 13:12:37.681381 30227 raft_consensus.cc:2804] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:37.717924 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:37.718241 25906 raft_consensus.cc:1275] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:12:37.722472 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:37.728906 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:37.709177 30215 raft_consensus.cc:493] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:37.715051 30204 raft_consensus.cc:3060] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:37.736486 25271 leader_election.cc:304] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:12:37.728771 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:37.731429 25195 leader_election.cc:304] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:37.732766 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:37.746768 25375 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 8.
I20260709 13:12:37.717485 30157 raft_consensus.cc:2804] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:37.762320 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:37.761590 25271 leader_election.cc:304] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
W20260709 13:12:37.793926 30252 log.cc:927] Time spent T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:12:37.756227 30227 raft_consensus.cc:697] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:37.795171 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:37.796813 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:12:37.797608 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 70526.8us
I20260709 13:12:37.802873 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:37.805330 25271 leader_election.cc:304] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:37.736502 30215 raft_consensus.cc:3060] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:37.731663 30150 raft_consensus.cc:2749] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:37.810173 30178 raft_consensus.cc:2804] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:12:37.813954 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 171285us
I20260709 13:12:37.762248 30220 raft_consensus.cc:2749] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:37.823730 25194 leader_election.cc:304] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:37.878386 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:37.760545 30144 raft_consensus.cc:2749] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:37.761593 30157 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:37.797235 30265 raft_consensus.cc:2804] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:37.890841 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
W20260709 13:12:37.893236 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 88016.2us
I20260709 13:12:37.903735 25370 raft_consensus.cc:2368] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 10. Current term is 12.
I20260709 13:12:37.812497 30240 raft_consensus.cc:2749] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:37.920795 25379 raft_consensus.cc:1240] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:12:37.926565 30214 leader_election.cc:290] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:37.903129 29999 raft_consensus.cc:2804] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:37.934142 29999 raft_consensus.cc:493] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:37.934455 30250 log.cc:927] Time spent T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.223s	user 0.000s	sys 0.000s
I20260709 13:12:37.934701 29999 raft_consensus.cc:3060] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:37.826525 30178 raft_consensus.cc:493] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:37.937160 30178 raft_consensus.cc:3060] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:37.822758 30129 raft_consensus.cc:493] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:37.938710 30181 consensus_queue.cc:1048] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:37.938901 30129 raft_consensus.cc:515] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:37.920173 30156 leader_election.cc:290] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:37.903439 30157 raft_consensus.cc:3060] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:37.941586 30156 raft_consensus.cc:2749] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:37.943656 30270 raft_consensus.cc:2804] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:37.944240 30270 raft_consensus.cc:493] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:37.944679 30270 raft_consensus.cc:3060] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:37.946754 30269 raft_consensus.cc:3055] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:12:37.947264 30142 consensus_queue.cc:1048] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:37.947872 30271 consensus_queue.cc:1059] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:12:37.948951 30253 log.cc:927] Time spent T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
I20260709 13:12:37.947273 30269 raft_consensus.cc:740] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:37.951087 30269 consensus_queue.cc:260] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:37.951642 30259 log.cc:927] Time spent T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 13:12:37.886353 30200 raft_consensus.cc:3055] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:37.954165 30200 raft_consensus.cc:740] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:37.955272 30200 consensus_queue.cc:260] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:37.957012 30200 raft_consensus.cc:3060] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:37.958344 30261 log.cc:927] Time spent T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 13:12:37.765278 30222 consensus_queue.cc:1059] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.281s
I20260709 13:12:37.959676 30227 consensus_queue.cc:237] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:37.970260 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 146597us
I20260709 13:12:37.884739 30239 raft_consensus.cc:2749] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:37.811982 30003 consensus_queue.cc:1048] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.113s
I20260709 13:12:37.983264 25376 raft_consensus.cc:1240] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:37.811444 30198 consensus_queue.cc:1059] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.113s
I20260709 13:12:37.906785 30265 raft_consensus.cc:493] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:38.003232 25223 raft_consensus.cc:3060] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:38.003937 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 330886us
I20260709 13:12:38.006930 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:38.004480 30265 raft_consensus.cc:3060] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:12:38.104558 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 496452us
I20260709 13:12:38.092628 25223 raft_consensus.cc:1275] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:12:38.027004 25379 raft_consensus.cc:1240] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 12. Current term is 13. Ops: [12.9-12.9]
W20260709 13:12:38.078922 25222 consensus_meta.cc:287] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 0.594s	user 0.006s	sys 0.006s
I20260709 13:12:38.108672 25222 raft_consensus.cc:1275] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:12:38.109915 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:38.110090 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:38.111541 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:38.112351 25899 raft_consensus.cc:2468] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 15.
W20260709 13:12:38.117369 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 138081us
I20260709 13:12:38.120325 25224 raft_consensus.cc:1240] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 11. Current term is 12. Ops: []
W20260709 13:12:38.052019 30185 consensus_meta.cc:287] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent flushing consensus metadata: real 0.599s	user 0.006s	sys 0.004s
I20260709 13:12:38.128539 25900 raft_consensus.cc:3060] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:12:38.057401 30137 consensus_meta.cc:287] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.594s	user 0.005s	sys 0.005s
I20260709 13:12:38.126622 25872 leader_election.cc:304] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:38.014778 30241 leader_election.cc:290] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:38.135396 25370 raft_consensus.cc:1240] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:38.136752 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:38.138082 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:38.138892 25904 raft_consensus.cc:2468] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 15.
I20260709 13:12:38.130725 25230 raft_consensus.cc:2955] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 2 to 8, 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:12:38.052323 30270 raft_consensus.cc:515] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:38.162243 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:38.165096 25873 leader_election.cc:400] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091) with higher term. Message: Invalid argument: T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 13. Current term is 14.
I20260709 13:12:38.167023 25873 leader_election.cc:403] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:38.165365 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: true dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:38.171450 25195 leader_election.cc:304] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:38.171587 25379 raft_consensus.cc:3060] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:38.204608 25301 raft_consensus.cc:3055] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:38.205933 25229 raft_consensus.cc:1240] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:38.204998 25301 raft_consensus.cc:740] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:38.166231 30220 raft_consensus.cc:493] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:38.154711 30171 consensus_queue.cc:1048] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.050s
I20260709 13:12:38.215329 25301 consensus_queue.cc:260] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:38.219118 25301 raft_consensus.cc:3060] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:38.219484 30171 raft_consensus.cc:2749] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:38.220279 30171 raft_consensus.cc:493] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.220757 30171 raft_consensus.cc:515] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:38.188679 30196 raft_consensus.cc:493] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:38.223506 30196 raft_consensus.cc:515] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:38.223785 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:12:38.224951 25871 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:38.199863 29832 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:38.226096 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:38.226358 29832 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:38.229728 30201 raft_consensus.cc:493] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:38.229849 30267 consensus_queue.cc:1059] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:38.230479 30201 raft_consensus.cc:515] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:38.231081 30267 raft_consensus.cc:493] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.231439 30270 leader_election.cc:290] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 14 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:38.231611 30267 raft_consensus.cc:515] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:38.232071 30270 raft_consensus.cc:2749] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:38.232933 30270 raft_consensus.cc:2749] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091) with higher term. Message: Invalid argument: T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 13. Current term is 14.
I20260709 13:12:38.140656 30185 raft_consensus.cc:515] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:38.233573 30270 raft_consensus.cc:3055] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:38.152487 30137 raft_consensus.cc:515] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:38.267879 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 96492.7us
I20260709 13:12:38.347143 25195 leader_election.cc:304] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:38.205168 30129 leader_election.cc:290] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:12:38.281451 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 133929us
I20260709 13:12:38.348286 30137 leader_election.cc:290] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:38.348438 25194 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:38.289322 30210 consensus_queue.cc:1048] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:12:38.295339 30198 consensus_queue.cc:1048] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:38.295385 30151 raft_consensus.cc:3055] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:38.349911 30151 raft_consensus.cc:740] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:38.351032 30151 consensus_queue.cc:260] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:12:38.352157 30151 raft_consensus.cc:3060] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:38.304797 30269 raft_consensus.cc:3060] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:38.174044 30264 consensus_queue.cc:1048] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.089s
W20260709 13:12:38.348455 30273 log.cc:927] Time spent T 00000000000000000000000000000000 P 5140a3161b944724a989995efdc4a818: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:12:38.355180 30185 leader_election.cc:290] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:38.356168 25195 leader_election.cc:304] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:38.357283 30272 raft_consensus.cc:2749] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:12:38.357550 25905 raft_consensus.cc:1240] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:38.357980 30272 raft_consensus.cc:2749] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:38.202361 30156 consensus_queue.cc:1059] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.075s
I20260709 13:12:38.361266 30222 raft_consensus.cc:2804] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:38.361660 30222 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:38.362120 30222 raft_consensus.cc:3060] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:38.361985 30216 consensus_queue.cc:260] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:38.363090 30216 raft_consensus.cc:3060] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:38.363912 25195 leader_election.cc:304] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:38.365204 25195 leader_election.cc:304] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:38.367337 30201 leader_election.cc:290] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:38.367866 25195 leader_election.cc:304] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:38.368077 30283 raft_consensus.cc:2749] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:38.368698 30172 raft_consensus.cc:2749] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:12:38.369170 30270 raft_consensus.cc:740] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:38.370257 30270 consensus_queue.cc:260] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:38.370607 25195 leader_election.cc:304] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:38.372154 25345 leader_election.cc:304] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:38.383584 25345 leader_election.cc:304] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:38.386204 25195 leader_election.cc:304] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:38.387290 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 392873us
I20260709 13:12:38.388334 25872 leader_election.cc:304] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:12:38.390008 25345 leader_election.cc:304] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:38.390337 25872 leader_election.cc:304] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:38.277295 30267 leader_election.cc:290] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:38.391680 25195 leader_election.cc:304] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
W20260709 13:12:38.392720 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 268526us
I20260709 13:12:38.407511 25379 raft_consensus.cc:2468] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 12.
I20260709 13:12:38.362242 30171 leader_election.cc:290] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:38.418066 25195 leader_election.cc:400] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 election: Vote denied by peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091) with higher term. Message: Invalid argument: T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 10. Current term is 12.
I20260709 13:12:38.418540 25195 leader_election.cc:403] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:12:38.377447 30264 raft_consensus.cc:2749] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:38.388187 30210 raft_consensus.cc:2749] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:38.399144 30137 raft_consensus.cc:2749] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:38.399258 30156 raft_consensus.cc:2749] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:12:38.434087 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 44174.6us
I20260709 13:12:38.391053 30280 raft_consensus.cc:2749] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:38.406347 30209 raft_consensus.cc:2749] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:38.438375 25345 leader_election.cc:304] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:38.443735 25900 raft_consensus.cc:1275] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:12:38.443611 25345 leader_election.cc:304] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
W20260709 13:12:38.421813 30221 consensus_meta.cc:287] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent flushing consensus metadata: real 0.963s	user 0.012s	sys 0.000s
I20260709 13:12:38.431813 30129 raft_consensus.cc:2804] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:38.446321 30267 raft_consensus.cc:2749] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:12:38.447494 30157 consensus_meta.cc:287] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 0.505s	user 0.008s	sys 0.004s
I20260709 13:12:38.458070 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:38.451754 25345 leader_election.cc:304] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:38.432906 30270 raft_consensus.cc:3060] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:38.436354 30171 raft_consensus.cc:2749] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:38.421228 30185 consensus_queue.cc:1059] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:12:38.448941 30138 raft_consensus.cc:2749] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:38.470242 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: true dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:38.455928 30240 raft_consensus.cc:2804] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:12:38.474483 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:38.453457 30151 consensus_queue.cc:1059] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:12:38.470295 30137 raft_consensus.cc:2804] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:38.476873 30137 raft_consensus.cc:697] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 12 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:38.477818 30137 consensus_queue.cc:237] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:38.457823 29832 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:38.481659 30150 raft_consensus.cc:3055] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:38.482218 30150 raft_consensus.cc:740] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:38.455399 30196 leader_election.cc:290] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:38.463805 30203 consensus_meta.cc:287] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.740s	user 0.011s	sys 0.000s
W20260709 13:12:38.491233 29999 consensus_meta.cc:287] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.556s	user 0.011s	sys 0.000s
I20260709 13:12:38.491852 29999 raft_consensus.cc:515] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:38.495024 25301 raft_consensus.cc:1240] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 12. Current term is 13. Ops: [10.8-12.9]
I20260709 13:12:38.473284 30129 raft_consensus.cc:697] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 13 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:38.464277 30157 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:38.454109 30221 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:38.464002 30285 raft_consensus.cc:2749] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091) with higher term. Message: Invalid argument: T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 10. Current term is 12.
I20260709 13:12:38.507176 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:12:38.507458 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:38.510576 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:38.489846 30240 raft_consensus.cc:697] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 18 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:38.540170 30240 consensus_queue.cc:237] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:38.524394 30277 raft_consensus.cc:2804] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:38.493455 30265 raft_consensus.cc:515] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:38.544231 30265 leader_election.cc:290] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:38.544966 25228 raft_consensus.cc:1240] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
W20260709 13:12:38.508790 30204 consensus_meta.cc:287] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.712s	user 0.012s	sys 0.000s
I20260709 13:12:38.242859 30220 raft_consensus.cc:515] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:38.552467 25901 raft_consensus.cc:1240] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:12:38.555920 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:38.557148 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:38.557466 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:38.558162 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:38.558702 25223 raft_consensus.cc:3060] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:38.560112 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:12:38.562238 30206 consensus_meta.cc:287] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.830s	user 0.010s	sys 0.001s
I20260709 13:12:38.562688 30206 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:38.563920 25303 raft_consensus.cc:2393] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 9: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:38.566150 25905 raft_consensus.cc:2468] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 12.
I20260709 13:12:38.559460 25270 leader_election.cc:304] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:38.567807 29832 raft_consensus.cc:2749] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:38.517845 30196 consensus_queue.cc:1059] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:12:38.565744 25908 raft_consensus.cc:1240] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:38.571007 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:38.571516 25270 leader_election.cc:304] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:38.572228 25222 raft_consensus.cc:1240] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:38.572523 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:38.574077 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:38.575160 25228 raft_consensus.cc:1275] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:12:38.587661 30200 consensus_meta.cc:287] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent flushing consensus metadata: real 0.611s	user 0.005s	sys 0.004s
I20260709 13:12:38.587920 29832 raft_consensus.cc:3060] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:38.595686 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:38.597836 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
W20260709 13:12:38.602681 30293 log.cc:927] Time spent T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:12:38.497113 30203 raft_consensus.cc:515] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:38.616328 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 131162us
I20260709 13:12:38.630611 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:38.595304 30268 raft_consensus.cc:493] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
W20260709 13:12:38.608620 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 190724us
I20260709 13:12:38.631428 25298 raft_consensus.cc:2468] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 15.
I20260709 13:12:38.635247 25195 leader_election.cc:304] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:38.631438 30208 consensus_meta.cc:287] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.923s	user 0.009s	sys 0.003s
I20260709 13:12:38.573418 30204 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:38.648429 25270 leader_election.cc:304] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:12:38.654426 25270 leader_election.cc:304] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:38.657140 25270 leader_election.cc:304] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:38.658447 25223 raft_consensus.cc:2468] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 15.
I20260709 13:12:38.636301 29999 leader_election.cc:290] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:38.660619 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
W20260709 13:12:38.652588 30215 consensus_meta.cc:287] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.749s	user 0.011s	sys 0.000s
I20260709 13:12:38.693075 25228 raft_consensus.cc:1240] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:38.660967 25270 leader_election.cc:304] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
W20260709 13:12:38.694540 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 83767.1us
I20260709 13:12:38.652168 30208 raft_consensus.cc:2749] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:12:38.669869 30218 consensus_meta.cc:287] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent flushing consensus metadata: real 0.948s	user 0.012s	sys 0.001s
W20260709 13:12:38.704608 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 86911.2us
I20260709 13:12:38.662863 30003 raft_consensus.cc:2749] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:38.659829 30199 raft_consensus.cc:2804] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:38.659565 30287 raft_consensus.cc:2749] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:38.636677 30129 consensus_queue.cc:237] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:38.656683 30201 consensus_queue.cc:1048] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:12:38.636691 30268 raft_consensus.cc:515] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:38.706354 29999 raft_consensus.cc:2804] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:12:38.710012 30288 log.cc:927] Time spent T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.244s	user 0.000s	sys 0.001s
I20260709 13:12:38.710289 30199 raft_consensus.cc:493] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:38.731510 30199 raft_consensus.cc:3060] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:38.708077 30218 raft_consensus.cc:515] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:38.716729 30220 leader_election.cc:290] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:38.719683 30268 leader_election.cc:290] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:38.720826 30206 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:38.697636 30215 raft_consensus.cc:515] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:38.734671 30218 leader_election.cc:290] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 14 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:38.736265 30215 leader_election.cc:290] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:38.715837 29999 raft_consensus.cc:493] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:38.737167 29999 raft_consensus.cc:3060] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:38.740912 30204 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 17 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:38.742398 30270 raft_consensus.cc:493] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:38.743242 30270 raft_consensus.cc:515] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:38.744498 30203 leader_election.cc:290] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:38.743234 30157 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:38.743306 30298 log.cc:927] Time spent T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:12:38.746929 25902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50056 (request call id 859) took 1149 ms. Trace:
I20260709 13:12:38.747263 25902 rpcz_store.cc:276] 0709 13:12:37.597806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:37.597925 (+   119us) service_pool.cc:224] Handling call
0709 13:12:37.598432 (+   507us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:37.626635 (+ 28203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:37.626687 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:37.638814 (+ 12127us) log.cc:844] Serialized 26 byte log entry
0709 13:12:38.506166 (+867352us) spinlock_profiling.cc:243] Waited 7.74 ms on lock 0x7b180011f740. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72cb64e07 00007fd7359bfab9 00007fd72cb8169b 00007fd72cb7f93f 00007fd72cb81c02 00007fd72f80920b 00007fd72f80ed23 00007fd72f80f0d1 00007fd72fc2aa0f
0709 13:12:38.524045 (+ 17879us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:38.524085 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:38.524164 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:38.746629 (+222465us) raft_consensus.cc:1685] finished
0709 13:12:38.746649 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:38.746865 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12901,"raft.queue_time_us":22734,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":10565,"spinlock_wait_cycles":17808640,"thread_start_us":17677,"threads_started":1,"wal-append.queue_time_us":937672}
I20260709 13:12:38.748592 30199 raft_consensus.cc:515] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:38.730120 30296 consensus_queue.cc:1059] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:12:38.730785 30138 consensus_queue.cc:1048] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:12:38.758870 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 61983.1us
W20260709 13:12:38.716183 30178 consensus_meta.cc:287] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.778s	user 0.012s	sys 0.000s
W20260709 13:12:38.724989 30205 consensus_meta.cc:287] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent flushing consensus metadata: real 0.989s	user 0.012s	sys 0.000s
I20260709 13:12:38.771917 29999 raft_consensus.cc:515] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:38.773782 25345 leader_election.cc:304] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
W20260709 13:12:38.771013 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 219704us
I20260709 13:12:38.772042 30205 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:38.777009 30277 raft_consensus.cc:493] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:38.777583 30277 raft_consensus.cc:3060] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:38.773797 30178 raft_consensus.cc:515] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:38.784158 30178 leader_election.cc:290] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:38.784858 25305 raft_consensus.cc:1240] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:38.771319 30204 consensus_queue.cc:1048] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:12:38.786496 30222 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:38.788216 30241 raft_consensus.cc:3055] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:38.788635 30241 raft_consensus.cc:740] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:38.789314 30222 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:38.771552 29832 raft_consensus.cc:2749] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:12:38.797577 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:38.805011 29999 leader_election.cc:290] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:38.815207 30286 raft_consensus.cc:3055] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:38.815902 30286 raft_consensus.cc:740] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:38.802134 30138 raft_consensus.cc:2749] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:38.789484 30241 consensus_queue.cc:260] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:38.829000 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 55342.1us
W20260709 13:12:38.863494 25345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:38.817106 30286 consensus_queue.cc:260] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:38.876240 25874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:38.827903 30270 leader_election.cc:290] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:38.890532 30205 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 9 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:38.890424 30241 raft_consensus.cc:3060] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:38.899623 30138 raft_consensus.cc:493] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.905153 30138 raft_consensus.cc:515] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:38.905699 25375 raft_consensus.cc:1240] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 12 LEADER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:38.907006 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:38.907364 30138 leader_election.cc:290] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:38.896041 30277 raft_consensus.cc:515] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:38.910465 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:38.911636 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:38.912406 30277 leader_election.cc:290] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:38.914328 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:38.896546 30199 leader_election.cc:290] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:38.896077 30221 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 17 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:38.919471 30285 raft_consensus.cc:493] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:38.920092 30285 raft_consensus.cc:515] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:38.920833 30264 raft_consensus.cc:493] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
W20260709 13:12:38.922215 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 287095us
I20260709 13:12:38.922418 30280 raft_consensus.cc:493] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.922986 30280 raft_consensus.cc:515] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:38.923826 25195 leader_election.cc:304] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:38.924945 30172 raft_consensus.cc:2749] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:38.925006 30283 consensus_queue.cc:1059] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:38.925642 30172 consensus_queue.cc:1059] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:38.926127 30283 raft_consensus.cc:2749] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:38.926352 30172 consensus_queue.cc:1243] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer 79d99c0e498349bda74127365219e468 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:12:38.926868 30283 raft_consensus.cc:3055] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:38.909303 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:38.927416 30283 raft_consensus.cc:740] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:38.927907 25379 raft_consensus.cc:2468] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 15.
I20260709 13:12:38.928336 30283 consensus_queue.cc:260] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:38.928906 30150 consensus_queue.cc:260] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:38.907718 25304 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514"
dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
mode: GRACEFUL
new_leader_uuid: "1f539ba21487460085b837e7529a78ce"
 from {username='slave'} at 127.0.0.1:35660
I20260709 13:12:38.931995 25304 raft_consensus.cc:606] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 12 LEADER]: Received request to transfer leadership to TS 1f539ba21487460085b837e7529a78ce
I20260709 13:12:38.934787 30150 raft_consensus.cc:3060] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:38.935367 25303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46556 (request call id 713) took 1284 ms. Trace:
I20260709 13:12:38.935585 25225 raft_consensus.cc:1240] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:38.935746 25303 rpcz_store.cc:276] 0709 13:12:37.650580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:37.651435 (+   855us) service_pool.cc:224] Handling call
0709 13:12:38.935179 (+1283744us) spinlock_profiling.cc:243] Waited 869 ms on lock 0x7b54001694d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:38.935288 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1999063296}
I20260709 13:12:38.925038 30280 leader_election.cc:290] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:38.938498 25194 leader_election.cc:304] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:38.939622 30196 raft_consensus.cc:3055] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:38.921476 30264 raft_consensus.cc:515] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:38.940003 25303 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7"
dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
mode: GRACEFUL
new_leader_uuid: "79d99c0e498349bda74127365219e468"
 from {username='slave'} at 127.0.0.1:35660
I20260709 13:12:38.922253 30285 leader_election.cc:290] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:38.943091 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:38.940833 30196 raft_consensus.cc:740] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:38.941442 25303 raft_consensus.cc:606] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 14 LEADER]: Received request to transfer leadership to TS 79d99c0e498349bda74127365219e468
I20260709 13:12:38.950387 25899 raft_consensus.cc:1240] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:38.926906 30172 raft_consensus.cc:3055] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:38.944978 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:38.945875 25221 raft_consensus.cc:1240] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:38.954602 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:38.947750 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:38.949185 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:38.955540 25223 raft_consensus.cc:2393] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 9: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:38.949262 25344 leader_election.cc:304] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:38.947679 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:38.950151 25901 raft_consensus.cc:2393] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 15: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:12:38.952553 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
W20260709 13:12:38.962971 25271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:38.966431 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:38.967082 25379 raft_consensus.cc:3060] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:38.971175 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:38.971573 25873 leader_election.cc:304] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:38.971832 25226 raft_consensus.cc:2468] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 11.
I20260709 13:12:38.952666 30171 raft_consensus.cc:2749] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:38.955667 30199 raft_consensus.cc:493] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.952113 30283 raft_consensus.cc:3060] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:38.979282 30235 consensus_queue.cc:1059] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:38.979645 29999 raft_consensus.cc:993] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19: : Instructing follower 1f539ba21487460085b837e7529a78ce to start an election
I20260709 13:12:38.980158 30204 raft_consensus.cc:3055] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:38.968773 30280 raft_consensus.cc:493] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:38.951210 30267 consensus_queue.cc:1059] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:12:38.982404 25300 raft_consensus.cc:3055] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:38.975665 30271 raft_consensus.cc:2804] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:39.008152 30235 raft_consensus.cc:1081] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 12 LEADER]: Signalling peer 1f539ba21487460085b837e7529a78ce to start an election
I20260709 13:12:39.011083 30206 consensus_queue.cc:1048] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:39.014895 30178 consensus_queue.cc:1059] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:12:39.015620 30215 consensus_queue.cc:1059] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:39.020431 25905 raft_consensus.cc:1240] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:39.021492 30264 leader_election.cc:290] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:39.022070 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:39.022794 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
W20260709 13:12:39.022907 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 45189us
W20260709 13:12:38.990034 30307 log.cc:927] Time spent T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.210s	user 0.000s	sys 0.002s
I20260709 13:12:39.025131 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:39.041549 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:39.025863 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:39.026506 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
W20260709 13:12:39.027503 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 78314.5us
I20260709 13:12:39.027122 25297 raft_consensus.cc:1240] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:12:39.022658 25270 leader_election.cc:304] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:39.029382 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:39.027621 30313 raft_consensus.cc:2804] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:39.030315 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:39.048450 25899 raft_consensus.cc:2393] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 9: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:12:39.030948 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
W20260709 13:12:39.032470 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 108704us
I20260709 13:12:39.048621 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:39.049278 25195 leader_election.cc:304] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:38.961601 30172 raft_consensus.cc:740] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:39.036799 25345 leader_election.cc:304] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:39.044808 25901 raft_consensus.cc:2376] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 14. Re-sending same reply.
I20260709 13:12:39.052701 25345 leader_election.cc:304] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:39.022294 30196 consensus_queue.cc:260] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:39.035312 25305 raft_consensus.cc:2468] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 11.
I20260709 13:12:39.055073 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:39.058082 25379 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 9.
I20260709 13:12:39.058975 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:39.038885 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:39.042465 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:39.060937 25301 raft_consensus.cc:2468] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 13.
I20260709 13:12:39.029942 25300 raft_consensus.cc:740] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:39.046787 25299 raft_consensus.cc:2393] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 9: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:39.049995 25303 raft_consensus.cc:2393] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 17: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:39.062719 25905 raft_consensus.cc:2393] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 17: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
W20260709 13:12:39.066654 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 44085.5us
I20260709 13:12:39.030362 30271 raft_consensus.cc:493] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:39.069097 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:39.062381 25194 leader_election.cc:304] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:39.070869 25900 raft_consensus.cc:1275] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:12:39.070963 25195 leader_election.cc:304] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:39.073287 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:39.085427 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:39.031807 30157 raft_consensus.cc:493] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:38.988436 30204 raft_consensus.cc:740] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:39.044984 29999 raft_consensus.cc:3055] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:39.041361 30267 consensus_queue.cc:1243] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer 79d99c0e498349bda74127365219e468 log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:12:38.980628 30199 raft_consensus.cc:515] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:39.089011 25872 leader_election.cc:304] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:39.082032 30141 raft_consensus.cc:2804] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:39.108772 25300 consensus_queue.cc:260] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:39.109526 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:39.110037 25300 raft_consensus.cc:3060] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:39.110409 30185 raft_consensus.cc:2749] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:12:39.110786 25330 heartbeater.cc:646] Failed to heartbeat to 127.23.140.126:37145 (2 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.23.140.126:37145 timed out after 15.000s (SENT)
I20260709 13:12:39.089710 30171 raft_consensus.cc:2804] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:39.111910 30171 raft_consensus.cc:493] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:39.112316 30171 raft_consensus.cc:3060] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:39.112358 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:39.113521 25299 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3"
dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
mode: GRACEFUL
new_leader_uuid: "1f539ba21487460085b837e7529a78ce"
 from {username='slave'} at 127.0.0.1:35660
I20260709 13:12:39.113616 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:39.114064 25299 raft_consensus.cc:606] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Received request to transfer leadership to TS 1f539ba21487460085b837e7529a78ce
I20260709 13:12:39.114435 25899 raft_consensus.cc:2393] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 9: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:12:39.114723 30315 raft_consensus.cc:2804] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:39.074877 30240 consensus_queue.cc:1059] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 13:12:39.117048 29999 raft_consensus.cc:740] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:39.118129 29999 consensus_queue.cc:260] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:39.119748 29999 raft_consensus.cc:3060] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:39.122037 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:39.110816 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:39.048167 30313 raft_consensus.cc:493] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:39.125533 30313 raft_consensus.cc:3060] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:39.107055 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:39.107133 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:39.114481 25299 raft_consensus.cc:614] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:39.006492 30280 raft_consensus.cc:515] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:39.123934 25221 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514"
dest_uuid: "1f539ba21487460085b837e7529a78ce"
 from {username='slave'} at 127.0.0.1:58422
I20260709 13:12:39.135651 25221 raft_consensus.cc:493] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:39.136065 25221 raft_consensus.cc:3060] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:12:39.136178 25270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:39.099568 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:39.137727 25301 raft_consensus.cc:1240] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:39.084233 30271 raft_consensus.cc:3060] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:39.090808 30150 raft_consensus.cc:2749] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:39.083940 29832 raft_consensus.cc:2749] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:12:39.204151 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:39.066182 30264 consensus_queue.cc:1059] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.069s
I20260709 13:12:39.092924 30303 raft_consensus.cc:2804] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:39.093091 30157 raft_consensus.cc:515] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:39.094870 25872 leader_election.cc:304] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:39.090689 30312 consensus_queue.cc:1059] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.142s
W20260709 13:12:39.244843 25873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:39.237088 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:39.229712 25298 raft_consensus.cc:1275] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:12:39.231985 25300 raft_consensus.cc:2468] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 12.
W20260709 13:12:39.276011 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 181227us
I20260709 13:12:39.288048 25299 raft_consensus.cc:1240] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 15. Current term is 16. Ops: []
W20260709 13:12:39.147147 30307 log.cc:927] Time spent T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:12:39.256609 30317 log.cc:927] Time spent T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 13:12:39.220518 30296 raft_consensus.cc:493] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:39.288025 25872 leader_election.cc:304] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:39.304802 25872 leader_election.cc:304] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:39.307143 25221 raft_consensus.cc:515] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:39.307597 25270 leader_election.cc:304] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:39.135098 30315 raft_consensus.cc:697] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 12 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:39.288990 30141 raft_consensus.cc:697] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 15 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
W20260709 13:12:39.308936 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 221618us
I20260709 13:12:39.316250 25270 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:39.217909 30280 leader_election.cc:290] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:39.210526 30222 raft_consensus.cc:493] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:39.329146 25221 leader_election.cc:290] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:39.275744 30303 raft_consensus.cc:493] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:39.237303 30156 raft_consensus.cc:493] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
W20260709 13:12:39.293879 30198 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:12:39.320935 30200 raft_consensus.cc:2749] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:12:39.336166 25114 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 8d0f43a786a846b49924a589e4a36f2f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 79d99c0e498349bda74127365219e468 (127.23.140.67:34091) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 79d99c0e498349bda74127365219e468 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:12:39.337213 30156 raft_consensus.cc:515] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:39.338176 30286 raft_consensus.cc:3060] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:39.288272 29832 raft_consensus.cc:493] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.329216 25270 leader_election.cc:304] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
W20260709 13:12:39.338567 25874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:39.339948 30156 leader_election.cc:290] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:39.283349 30185 raft_consensus.cc:2749] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:12:39.317780 30178 raft_consensus.cc:2749] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:39.322640 30267 raft_consensus.cc:2749] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:39.349530 30216 raft_consensus.cc:2749] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:39.354578 29832 raft_consensus.cc:515] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:39.365355 30255 consensus_queue.cc:1059] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.046s
W20260709 13:12:39.353871 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 214423us
I20260709 13:12:39.375528 25270 leader_election.cc:304] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:39.266275 30204 consensus_queue.cc:260] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:39.327026 30264 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:39.385543 25221 raft_consensus.cc:1275] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 18 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:12:39.333181 30303 raft_consensus.cc:3060] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:39.332839 30277 raft_consensus.cc:493] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.320698 30215 consensus_queue.cc:1059] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:12:39.393828 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:12:39.395309 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 249398us
I20260709 13:12:39.392408 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:39.397137 25304 raft_consensus.cc:3055] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:39.397531 25304 raft_consensus.cc:740] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:39.403553 25299 raft_consensus.cc:2393] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 11: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:39.404681 25195 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:39.465960 25270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:39.530725 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 132568us
W20260709 13:12:39.532845 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 128289us
I20260709 13:12:39.379788 30287 raft_consensus.cc:2749] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:12:39.557461 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:39.557538 25195 leader_election.cc:304] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:39.317444 30296 raft_consensus.cc:515] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:39.388540 30010 raft_consensus.cc:2749] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:12:39.598845 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 269084us
I20260709 13:12:39.350104 30222 raft_consensus.cc:515] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:39.295786 30172 consensus_queue.cc:260] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:39.615193 25375 raft_consensus.cc:2468] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 11.
I20260709 13:12:39.602476 25304 consensus_queue.cc:260] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:39.578846 30142 raft_consensus.cc:493] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.384949 30235 consensus_queue.cc:1048] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.216s
I20260709 13:12:39.394081 30264 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:39.399447 30277 raft_consensus.cc:515] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:39.581986 30204 raft_consensus.cc:3060] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:39.650502 25343 leader_election.cc:304] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:39.622386 30322 raft_consensus.cc:493] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.621160 30311 raft_consensus.cc:493] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:39.577962 30156 consensus_queue.cc:1059] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
W20260709 13:12:39.641855 30316 log.cc:927] Time spent T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.433s	user 0.001s	sys 0.001s
I20260709 13:12:39.642885 30142 raft_consensus.cc:515] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:39.662180 30324 consensus_queue.cc:1059] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.278s
I20260709 13:12:39.653642 30280 raft_consensus.cc:2749] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:39.671315 25343 leader_election.cc:304] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:39.696055 25343 leader_election.cc:304] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:39.696235 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 138813us
I20260709 13:12:39.708678 25195 leader_election.cc:304] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:39.784159 25874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:39.801488 30325 log.cc:927] Time spent T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
I20260709 13:12:39.619974 30315 consensus_queue.cc:237] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:39.854108 30327 raft_consensus.cc:2749] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:39.696382 30199 leader_election.cc:290] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:39.717681 30283 consensus_meta.cc:287] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 0.737s	user 0.011s	sys 0.000s
I20260709 13:12:39.810654 25228 raft_consensus.cc:1240] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:39.730449 30010 raft_consensus.cc:493] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:39.812546 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
W20260709 13:12:39.815128 25270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:39.715911 30280 raft_consensus.cc:2749] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:39.664403 30322 raft_consensus.cc:515] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:39.851239 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:39.889669 29832 leader_election.cc:290] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:39.693691 30311 raft_consensus.cc:515] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:39.810889 30267 raft_consensus.cc:493] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.728303 30241 consensus_queue.cc:1059] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.127s
W20260709 13:12:39.888715 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:39.890602 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:39.846107 30156 raft_consensus.cc:3055] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:39.896232 25229 raft_consensus.cc:1275] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 13:12:39.624155 30141 consensus_queue.cc:237] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:39.802551 25224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 2442) took 1238 ms. Trace:
I20260709 13:12:39.937423 25229 pending_rounds.cc:85] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce: Aborting all ops after (but not including) 10
I20260709 13:12:39.937799 25229 pending_rounds.cc:107] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:12:39.938337 25229 raft_consensus.cc:2889] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:39.937592 25224 rpcz_store.cc:276] 0709 13:12:38.564394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:38.599173 (+ 34779us) service_pool.cc:224] Handling call
0709 13:12:38.600324 (+  1151us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:38.930141 (+329817us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:38.930178 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:38.930674 (+   496us) log.cc:844] Serialized 26 byte log entry
0709 13:12:39.031058 (+100384us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:39.031101 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:39.031174 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:39.802317 (+771143us) raft_consensus.cc:1685] finished
0709 13:12:39.802339 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:39.802490 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":324529,"raft.queue_time_us":325602,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"spinlock_wait_cycles":1499520,"thread_start_us":100089,"threads_started":1,"wal-append.queue_time_us":161908}
W20260709 13:12:39.884188 30331 log.cc:927] Time spent T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
W20260709 13:12:39.916975 25223 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.006s	sys 0.057s
I20260709 13:12:39.879302 30142 leader_election.cc:290] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:39.887795 30175 raft_consensus.cc:3055] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:12:39.945796 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:39.920369 25345 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.025s	sys 0.072s
I20260709 13:12:39.852743 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:39.897025 30324 raft_consensus.cc:3055] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:12:39.934677 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 238721us
I20260709 13:12:39.914736 30137 raft_consensus.cc:2749] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:12:39.940822 25223 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.006s	sys 0.057s
W20260709 13:12:39.946559 25345 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.025s	sys 0.072s
I20260709 13:12:39.919559 30335 raft_consensus.cc:2749] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:39.954726 25374 raft_consensus.cc:1275] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:12:39.955233 25370 raft_consensus.cc:1275] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:12:39.956826 25227 raft_consensus.cc:2393] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 9: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:39.959187 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:39.960094 25374 raft_consensus.cc:2468] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 13.
I20260709 13:12:39.932108 30296 leader_election.cc:290] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:39.962339 25376 raft_consensus.cc:1275] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:12:39.964277 25379 raft_consensus.cc:1240] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 13. Current term is 14. Ops: []
W20260709 13:12:39.965901 25270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:39.941848 30156 raft_consensus.cc:740] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:39.968711 30137 raft_consensus.cc:493] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:39.946101 30175 raft_consensus.cc:740] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:39.982035 25371 raft_consensus.cc:1240] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:39.950544 30324 raft_consensus.cc:740] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:39.931491 30240 raft_consensus.cc:2749] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:39.974568 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:39.947376 30142 raft_consensus.cc:493] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:39.975181 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:39.973945 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:39.932471 30010 raft_consensus.cc:515] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:40.022055 25376 raft_consensus.cc:2393] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 9: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
W20260709 13:12:39.980499 30329 log.cc:927] Time spent T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:12:40.020112 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:40.031555 25906 raft_consensus.cc:2468] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 8.
I20260709 13:12:40.026857 25905 raft_consensus.cc:1240] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:40.028013 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:40.033406 25227 raft_consensus.cc:2468] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 7.
I20260709 13:12:40.031648 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:40.034794 25899 raft_consensus.cc:3060] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:39.971777 30335 raft_consensus.cc:493] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.021304 25270 leader_election.cc:304] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:12:40.029173 30142 raft_consensus.cc:515] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:40.030264 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:40.036674 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:39.941398 30267 raft_consensus.cc:515] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:39.978933 29999 consensus_meta.cc:287] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.859s	user 0.007s	sys 0.003s
I20260709 13:12:39.971980 30341 raft_consensus.cc:493] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.980757 30277 leader_election.cc:290] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:39.970510 30340 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:40.058846 25371 raft_consensus.cc:2468] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 11.
I20260709 13:12:40.059121 25370 raft_consensus.cc:3060] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:39.982739 30296 consensus_queue.cc:1059] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.067s
I20260709 13:12:40.061978 25195 leader_election.cc:304] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:12:40.029240 30222 leader_election.cc:290] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:40.037259 30337 raft_consensus.cc:493] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.973140 30137 raft_consensus.cc:515] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:40.074677 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:40.112143 25371 raft_consensus.cc:2468] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 14.
I20260709 13:12:40.113229 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:40.077896 30199 consensus_queue.cc:1048] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:12:40.093864 30340 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:40.095793 30267 leader_election.cc:290] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:40.097365 30142 leader_election.cc:290] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:40.097798 29999 consensus_queue.cc:1048] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:40.115768 30340 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:40.072319 30175 consensus_queue.cc:260] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:40.117230 30175 raft_consensus.cc:3060] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:12:40.117835 30285 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.138s	user 0.027s	sys 0.062s
W20260709 13:12:40.118368 30285 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.138s	user 0.027s	sys 0.062s
W20260709 13:12:40.099858 30171 consensus_meta.cc:287] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 0.987s	user 0.011s	sys 0.000s
I20260709 13:12:40.122278 30171 raft_consensus.cc:515] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:40.104544 30342 raft_consensus.cc:493] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:40.124845 30342 raft_consensus.cc:515] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:40.127707 30342 leader_election.cc:290] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:40.104792 30010 leader_election.cc:290] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:40.108996 30185 raft_consensus.cc:493] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.129421 30185 raft_consensus.cc:515] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:40.132169 30185 leader_election.cc:290] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:40.110813 25899 raft_consensus.cc:2468] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 13.
I20260709 13:12:40.111198 25374 raft_consensus.cc:1240] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 15 LEADER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:40.134439 30171 leader_election.cc:290] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:40.031299 29832 consensus_queue.cc:1048] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:12:40.056721 30338 raft_consensus.cc:493] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:40.073544 30151 raft_consensus.cc:2804] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:40.137807 30240 raft_consensus.cc:3055] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:12:40.162111 25298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46556 (request call id 728) took 1140 ms. Trace:
I20260709 13:12:40.054069 30335 raft_consensus.cc:515] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:40.162657 25298 rpcz_store.cc:276] 0709 13:12:39.021987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:39.026918 (+  4931us) service_pool.cc:224] Handling call
0709 13:12:39.027198 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:39.286613 (+259415us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:40.158579 (+871966us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b54002fb054. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:40.162008 (+  3429us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":464650112}
I20260709 13:12:40.150976 29832 consensus_queue.cc:1243] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer 79d99c0e498349bda74127365219e468 log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:12:40.152969 30151 raft_consensus.cc:493] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
W20260709 13:12:40.171146 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 116662us
W20260709 13:12:40.172493 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:40.065335 30156 consensus_queue.cc:260] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:40.161254 30240 raft_consensus.cc:740] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:40.073906 30341 raft_consensus.cc:515] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
W20260709 13:12:40.170907 30313 consensus_meta.cc:287] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 1.045s	user 0.012s	sys 0.000s
I20260709 13:12:40.200973 30313 raft_consensus.cc:515] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:40.202291 30341 leader_election.cc:290] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:40.203387 30313 leader_election.cc:290] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:40.204147 25373 raft_consensus.cc:1240] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:40.139256 30337 raft_consensus.cc:515] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:40.205936 30311 leader_election.cc:290] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:40.206472 30337 leader_election.cc:290] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:40.180116 30156 raft_consensus.cc:3060] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:40.186703 30137 leader_election.cc:290] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:40.175144 30151 raft_consensus.cc:3060] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:40.211349 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:40.211751 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:40.214120 30264 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:40.198103 30322 leader_election.cc:290] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:40.199791 30335 leader_election.cc:290] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:40.162899 30324 consensus_queue.cc:260] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:40.215528 25874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:40.226378 25370 raft_consensus.cc:2468] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 16.
W20260709 13:12:40.235131 30271 consensus_meta.cc:287] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent flushing consensus metadata: real 1.024s	user 0.010s	sys 0.001s
W20260709 13:12:40.235708 30351 log.cc:927] Time spent T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:12:40.235646 30271 raft_consensus.cc:515] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:40.236861 25901 raft_consensus.cc:2393] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 16: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:12:40.239470 30271 leader_election.cc:290] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 16 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:40.156965 30338 raft_consensus.cc:515] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:40.243322 30303 consensus_meta.cc:287] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.836s	user 0.011s	sys 0.000s
W20260709 13:12:40.244531 30204 consensus_meta.cc:287] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.589s	user 0.009s	sys 0.001s
W20260709 13:12:40.265344 30286 consensus_meta.cc:287] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent flushing consensus metadata: real 0.916s	user 0.012s	sys 0.000s
I20260709 13:12:40.279457 25899 raft_consensus.cc:1275] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 18 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 13:12:40.281694 25899 pending_rounds.cc:85] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6: Aborting all ops after (but not including) 12
I20260709 13:12:40.281801 30185 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.282011 25899 pending_rounds.cc:107] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 13:12:40.282464 25899 raft_consensus.cc:2889] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:40.282390 30185 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:40.282907 25903 raft_consensus.cc:1275] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 13:12:40.283252 25903 pending_rounds.cc:85] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6: Aborting all ops after (but not including) 10
I20260709 13:12:40.283491 25903 pending_rounds.cc:107] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:12:40.283703 25903 raft_consensus.cc:2889] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:40.284500 30349 consensus_queue.cc:1048] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:12:40.279940 30196 raft_consensus.cc:3060] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:40.266396 30151 raft_consensus.cc:515] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:40.290019 30151 leader_election.cc:290] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:40.291115 30310 raft_consensus.cc:3055] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:40.291615 30310 raft_consensus.cc:740] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:40.292524 30310 consensus_queue.cc:260] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:40.252599 30303 raft_consensus.cc:515] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:40.293853 30172 raft_consensus.cc:3060] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:40.295534 30303 leader_election.cc:290] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:40.296219 25378 raft_consensus.cc:1240] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 11. Current term is 12. Ops: []
W20260709 13:12:40.296479 30328 log.cc:927] Time spent T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.655s	user 0.003s	sys 0.006s
I20260709 13:12:40.297973 25908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50058 (request call id 920) took 1247 ms. Trace:
I20260709 13:12:40.299127 30178 raft_consensus.cc:3055] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:40.298350 25908 rpcz_store.cc:276] 0709 13:12:39.051001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:39.051144 (+   143us) service_pool.cc:224] Handling call
0709 13:12:39.051454 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:39.090182 (+ 38728us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:39.090212 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:39.124358 (+ 34146us) log.cc:844] Serialized 26 byte log entry
0709 13:12:39.346166 (+221808us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:12:39.370328 (+ 24162us) log.cc:844] Serialized 14 byte log entry
0709 13:12:39.371177 (+   849us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:39.371264 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:40.295797 (+924533us) spinlock_profiling.cc:243] Waited 2.64 ms on lock 0x7b4400022b4c. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72caa8c85 00007fd72caa96a2 00007fd72f81b1db 00007fd72f816aaf 00007fd72f80a86e 00007fd72f809bb6 00007fd72f8097d8 00007fd72f813221 00007fd72f8131d9 00007fd72f813169
0709 13:12:40.297657 (+  1860us) raft_consensus.cc:1685] finished
0709 13:12:40.297783 (+   126us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:40.297916 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":19545,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":39030,"raft.run_cpu_time_us":283,"raft.run_wall_time_us":41705,"spinlock_wait_cycles":6068992,"thread_start_us":121592,"threads_started":1,"wal-append.queue_time_us":493620}
I20260709 13:12:40.299540 30178 raft_consensus.cc:740] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:40.293529 30310 raft_consensus.cc:3060] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:12:40.306879 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:40.308871 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:40.310061 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:40.314008 25270 leader_election.cc:304] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:40.315548 30206 raft_consensus.cc:2749] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:40.316036 30178 consensus_queue.cc:260] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:40.318729 30129 consensus_queue.cc:1048] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:12:40.265375 30204 raft_consensus.cc:493] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.315207 25270 leader_election.cc:304] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:40.323117 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:40.317574 30178 raft_consensus.cc:3060] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:40.332916 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:40.333181 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:40.333604 25224 raft_consensus.cc:2468] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 14.
I20260709 13:12:40.333834 25226 raft_consensus.cc:2468] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 10.
I20260709 13:12:40.335424 25901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50058 (request call id 921) took 1280 ms. Trace:
I20260709 13:12:40.335806 25901 rpcz_store.cc:276] 0709 13:12:39.054617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:39.054782 (+   165us) service_pool.cc:224] Handling call
0709 13:12:40.335227 (+1280445us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54007102d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:40.335349 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2715555072}
I20260709 13:12:40.336654 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:40.337633 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:40.338238 25225 raft_consensus.cc:2468] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 15.
I20260709 13:12:40.339709 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:40.340243 25222 raft_consensus.cc:1240] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:40.339248 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:40.341377 25225 raft_consensus.cc:2468] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 7.
I20260709 13:12:40.312314 30334 raft_consensus.cc:493] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.347111 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:40.347633 30334 raft_consensus.cc:515] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:40.350131 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:40.350581 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:40.350889 25221 raft_consensus.cc:2393] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 15: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:40.351279 25299 raft_consensus.cc:2368] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 15. Current term is 16.
I20260709 13:12:40.322947 30206 raft_consensus.cc:2749] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:40.345901 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:40.352670 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:40.354482 30338 leader_election.cc:290] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:40.355386 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:40.357170 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:12:40.358069 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:40.323659 25270 leader_election.cc:304] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:40.346036 30198 raft_consensus.cc:493] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:40.346452 30010 raft_consensus.cc:493] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:40.343511 30342 raft_consensus.cc:493] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:40.363818 25305 pending_rounds.cc:85] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19: Aborting all ops after (but not including) 7
I20260709 13:12:40.361436 25270 leader_election.cc:304] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:40.371742 25305 pending_rounds.cc:107] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:12:40.372375 25305 raft_consensus.cc:2889] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:40.375630 25270 leader_election.cc:304] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:40.376586 25303 raft_consensus.cc:2468] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 15.
I20260709 13:12:40.405246 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:12:40.409019 25873 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 1.980s (SENT) [suppressed 24 similar messages]
I20260709 13:12:40.411248 25296 raft_consensus.cc:1275] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:12:40.322795 30204 raft_consensus.cc:515] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:40.372078 30216 raft_consensus.cc:2804] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:40.404762 29999 raft_consensus.cc:2804] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:40.421607 25303 raft_consensus.cc:1240] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:12:40.374866 30185 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:40.409919 30199 raft_consensus.cc:2804] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:12:40.438280 30199 raft_consensus.cc:697] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 16 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:40.439473 30199 consensus_queue.cc:237] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:40.421994 29999 raft_consensus.cc:493] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:40.442196 29999 raft_consensus.cc:3060] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:40.444947 30204 leader_election.cc:290] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:40.446424 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:40.378407 30010 raft_consensus.cc:515] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:40.448828 25372 raft_consensus.cc:2468] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 14.
I20260709 13:12:40.429283 30301 raft_consensus.cc:3055] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:40.449427 30010 leader_election.cc:290] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:40.449812 30301 raft_consensus.cc:740] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:40.419080 30216 raft_consensus.cc:493] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:40.375675 30198 raft_consensus.cc:515] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:40.425318 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:40.469358 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:40.470078 25303 raft_consensus.cc:2468] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 14.
I20260709 13:12:40.472034 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:40.473922 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:40.407465 30342 raft_consensus.cc:515] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:40.478940 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:40.476280 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:12:40.495814 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 147386us
I20260709 13:12:40.467458 30216 raft_consensus.cc:3060] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:40.510011 30150 raft_consensus.cc:3055] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:12:40.510542 30150 raft_consensus.cc:740] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:40.511404 30150 consensus_queue.cc:260] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:40.512609 30150 raft_consensus.cc:3060] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:40.518221 25299 raft_consensus.cc:1240] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 12. Current term is 13. Ops: [10.8-12.9]
W20260709 13:12:40.521181 25375 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56308 (request call id 834) took 1611 ms (client timeout 1980 ms). Trace:
W20260709 13:12:40.521620 25375 rpcz_store.cc:269] 0709 13:12:38.910117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:38.910236 (+   119us) service_pool.cc:224] Handling call
0709 13:12:40.520987 (+1610751us) spinlock_profiling.cc:243] Waited 415 ms on lock 0x7b540009d3d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:40.521091 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":955260288}
I20260709 13:12:40.522879 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:40.524070 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:40.527947 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:40.528694 25376 raft_consensus.cc:2468] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 8.
I20260709 13:12:40.529565 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:40.530674 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:40.530740 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
W20260709 13:12:40.532850 25872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:40.534583 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:40.535017 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:40.538359 25223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58418 (request call id 2305) took 1586 ms. Trace:
I20260709 13:12:40.544480 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:40.545362 25300 raft_consensus.cc:2410] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:12:40.538755 25223 rpcz_store.cc:276] 0709 13:12:38.951553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:38.958583 (+  7030us) service_pool.cc:224] Handling call
0709 13:12:38.958910 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:38.959150 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:12:38.974972 (+ 15822us) log.cc:844] Serialized 14 byte log entry
0709 13:12:39.374279 (+399307us) spinlock_profiling.cc:243] Waited 1.47 ms on lock 0x7b18002e6f60. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72cb64e07 00007fd7359bfab9 00007fd72cb8169b 00007fd72cb7f93f 00007fd72cb81c02 00007fd72f80920b 00007fd72f80ed23 00007fd72f80f23a 00007fd72fc79a2a
0709 13:12:39.951600 (+577321us) log.cc:844] Serialized 14 byte log entry
0709 13:12:40.537899 (+586299us) spinlock_profiling.cc:243] Waited 2.39 ms on lock 0x7b18002e6f60. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72cafcc0a 00007fd73623c219 00007fd72cb84a40 00007fd72cb7f4e4 00007fd72cb7f455 00007fd72fc67060 00007fd72fc79716 00007fd72fc8a287 00007fd72fc8a208
0709 13:12:40.538043 (+   144us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:40.538094 (+    51us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:40.538135 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:40.538197 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:40.538298 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5086,"prepare.queue_time_us":232638,"prepare.run_cpu_time_us":117,"prepare.run_wall_time_us":3749,"raft.queue_time_us":591386,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":22451,"spinlock_wait_cycles":8882304,"thread_start_us":576802,"threads_started":1,"wal-append.queue_time_us":1008638}
I20260709 13:12:40.514031 30361 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.548599 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:40.555001 30361 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:40.556574 30157 leader_election.cc:290] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:40.557241 30361 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:40.558074 30198 leader_election.cc:290] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:40.559059 30349 raft_consensus.cc:493] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:40.559695 30349 raft_consensus.cc:515] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:40.561721 30349 leader_election.cc:290] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:40.562785 30342 leader_election.cc:290] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:40.534608 30301 consensus_queue.cc:260] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:40.568534 30301 raft_consensus.cc:3060] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:40.570604 30221 raft_consensus.cc:493] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:40.571148 30221 raft_consensus.cc:515] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:40.571877 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:40.572564 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:40.572789 25872 leader_election.cc:304] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:12:40.572992 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:40.573282 30221 leader_election.cc:290] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:40.574061 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:40.575603 30240 consensus_queue.cc:260] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:40.576424 25376 raft_consensus.cc:2468] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 12.
I20260709 13:12:40.576757 30240 raft_consensus.cc:3060] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:40.578122 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:40.578781 25903 raft_consensus.cc:2393] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 14: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:12:40.578672 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:40.579591 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:40.579768 30338 raft_consensus.cc:493] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:40.580302 25375 raft_consensus.cc:2393] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 9: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:12:40.580638 30334 leader_election.cc:290] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:40.580338 30338 raft_consensus.cc:515] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:40.581159 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:40.565655 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:40.575955 30204 raft_consensus.cc:493] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:40.573602 25372 raft_consensus.cc:2468] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 14.
I20260709 13:12:40.581735 25375 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 10.
I20260709 13:12:40.583676 30204 raft_consensus.cc:515] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:40.583488 25271 leader_election.cc:304] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:40.586512 30272 raft_consensus.cc:2804] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:40.603770 30272 raft_consensus.cc:493] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:40.604144 30272 raft_consensus.cc:3060] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:40.604890 30204 leader_election.cc:290] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:40.584818 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 522893us
I20260709 13:12:40.588241 30315 raft_consensus.cc:493] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:40.588764 30265 raft_consensus.cc:493] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:40.606853 30315 raft_consensus.cc:515] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:40.607242 30265 raft_consensus.cc:515] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:40.609131 30315 leader_election.cc:290] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:40.591073 25194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:40.594910 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:40.611513 25372 raft_consensus.cc:3060] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:40.598902 25873 leader_election.cc:304] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:40.606071 25872 leader_election.cc:304] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:40.594343 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 43819.4us
I20260709 13:12:40.618454 25195 leader_election.cc:304] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:12:40.619957 25270 leader_election.cc:304] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:40.620539 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:40.622740 25903 raft_consensus.cc:2393] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 11: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
W20260709 13:12:40.610322 25874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:40.589480 25305 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c"
dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
mode: GRACEFUL
new_leader_uuid: "1f539ba21487460085b837e7529a78ce"
 from {username='slave'} at 127.0.0.1:35660
I20260709 13:12:40.583387 25373 raft_consensus.cc:2393] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 8: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:40.613605 25873 leader_election.cc:304] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:40.579797 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:40.614876 25271 leader_election.cc:304] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:12:40.626222 25376 raft_consensus.cc:2468] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 11.
W20260709 13:12:40.598287 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 44972.7us
I20260709 13:12:40.627381 25873 leader_election.cc:304] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:40.637666 25195 leader_election.cc:304] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:40.637946 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:40.641669 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:40.642501 25225 raft_consensus.cc:2468] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 14.
I20260709 13:12:40.644693 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:40.646667 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:40.648782 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:40.624322 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:40.651016 25195 leader_election.cc:304] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:40.583166 30338 leader_election.cc:290] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:40.609689 30265 leader_election.cc:290] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:40.589079 30324 raft_consensus.cc:3060] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:40.598420 30221 raft_consensus.cc:2804] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:40.589259 30156 raft_consensus.cc:493] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:40.589143 30222 raft_consensus.cc:493] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:40.611943 30264 raft_consensus.cc:493] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:40.667695 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:40.682247 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:40.659245 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:12:40.667253 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 52478.7us
I20260709 13:12:40.696007 25271 leader_election.cc:304] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:40.660490 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:40.688017 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:40.688802 25372 raft_consensus.cc:2468] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 14.
I20260709 13:12:40.589044 30255 raft_consensus.cc:493] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:40.634575 30361 raft_consensus.cc:493] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:40.651186 30287 raft_consensus.cc:2749] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:40.651201 30315 raft_consensus.cc:493] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:40.668836 30204 raft_consensus.cc:493] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.589418 30343 raft_consensus.cc:493] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:40.674074 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:40.609845 30241 raft_consensus.cc:493] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.668290 30280 raft_consensus.cc:2749] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:40.612396 30171 raft_consensus.cc:493] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:40.685127 25270 leader_election.cc:304] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:40.681360 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:40.697909 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:40.667975 30010 raft_consensus.cc:2804] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:40.698024 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:40.737695 25372 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 10.
I20260709 13:12:40.738742 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:40.699340 25379 raft_consensus.cc:2393] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 8: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:40.699331 25225 raft_consensus.cc:2410] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:12:40.700664 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:40.622895 30178 raft_consensus.cc:2804] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:40.635218 30267 consensus_queue.cc:1048] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.086s
I20260709 13:12:40.702270 29832 raft_consensus.cc:2749] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:40.638554 30271 raft_consensus.cc:2804] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:40.752483 30271 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:40.753031 30271 raft_consensus.cc:3060] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:40.753464 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:40.754855 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:40.755597 25378 raft_consensus.cc:2393] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 12: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:40.756596 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:40.634811 30200 raft_consensus.cc:2804] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:40.620812 30277 raft_consensus.cc:2749] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:12:40.757936 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:40.758435 30277 raft_consensus.cc:493] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:40.758637 25225 raft_consensus.cc:2468] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 11.
I20260709 13:12:40.759017 30277 raft_consensus.cc:515] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:40.648100 30285 raft_consensus.cc:2804] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:40.719830 25301 raft_consensus.cc:1240] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:12:40.588945 30172 raft_consensus.cc:493] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:40.720625 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:40.666805 30283 raft_consensus.cc:2749] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:12:40.718400 25302 raft_consensus.cc:1240] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:40.667018 30326 raft_consensus.cc:493] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:40.722723 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 95425.7us
I20260709 13:12:40.727625 25195 leader_election.cc:304] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:40.686807 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:40.720016 30361 raft_consensus.cc:515] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:40.698506 30156 raft_consensus.cc:515] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:40.654444 30332 raft_consensus.cc:493] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:40.729601 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:40.734752 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:40.611601 30199 consensus_queue.cc:1059] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.106s
I20260709 13:12:40.693225 30221 raft_consensus.cc:493] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
W20260709 13:12:40.736491 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 51463.5us
I20260709 13:12:40.598227 30286 raft_consensus.cc:493] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:40.635985 30157 raft_consensus.cc:493] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.674656 30339 consensus_queue.cc:1059] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.109s
I20260709 13:12:40.692853 30142 consensus_queue.cc:1059] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:12:40.746567 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:40.621289 30198 consensus_queue.cc:1059] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.100s
I20260709 13:12:40.717429 30185 raft_consensus.cc:2804] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:40.717832 30264 raft_consensus.cc:515] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:40.782984 25303 raft_consensus.cc:3060] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:40.783371 25222 raft_consensus.cc:2468] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 18.
I20260709 13:12:40.764084 25343 leader_election.cc:400] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 election: Vote denied by peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127) with higher term. Message: Invalid argument: T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 15. Current term is 16.
I20260709 13:12:40.784448 25343 leader_election.cc:403] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:12:40.759557 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:40.784946 25230 raft_consensus.cc:2468] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 11.
I20260709 13:12:40.785194 25908 raft_consensus.cc:1240] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:40.785447 25343 leader_election.cc:304] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:40.773185 25374 raft_consensus.cc:2410] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
W20260709 13:12:40.783649 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 56162.8us
I20260709 13:12:40.735869 30241 raft_consensus.cc:515] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:40.788553 30280 raft_consensus.cc:2804] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:40.789018 30280 raft_consensus.cc:493] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:40.729040 30204 raft_consensus.cc:515] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:40.789450 30280 raft_consensus.cc:3060] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:40.790097 30241 leader_election.cc:290] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:40.590890 30353 consensus_queue.cc:1048] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.104s
I20260709 13:12:40.782467 25370 raft_consensus.cc:2468] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 15.
I20260709 13:12:40.791945 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:40.792732 25370 raft_consensus.cc:2393] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 12: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:40.766928 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:40.745316 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:40.792013 25222 raft_consensus.cc:1275] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:12:40.825706 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:40.823676 25195 leader_election.cc:304] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:40.827646 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:40.804116 25270 leader_election.cc:304] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:12:40.795498 25376 raft_consensus.cc:2376] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 11. Re-sending same reply.
I20260709 13:12:40.765372 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:40.737241 30010 raft_consensus.cc:493] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:40.717604 30222 raft_consensus.cc:515] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:40.732609 30343 raft_consensus.cc:515] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:40.862013 30175 consensus_queue.cc:1048] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:12:40.863538 30222 leader_election.cc:290] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:40.850812 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:40.864117 30343 leader_election.cc:290] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:40.866179 25227 raft_consensus.cc:2468] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 16.
I20260709 13:12:40.867033 30277 leader_election.cc:290] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:40.868959 30156 leader_election.cc:290] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:40.848829 30142 consensus_queue.cc:1243] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer 79d99c0e498349bda74127365219e468 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:12:40.731426 30315 raft_consensus.cc:515] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:40.824209 30157 raft_consensus.cc:515] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:40.871281 25225 raft_consensus.cc:2410] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:12:40.871443 30315 leader_election.cc:290] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:40.850358 30339 raft_consensus.cc:3055] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:40.872268 30157 leader_election.cc:290] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:40.872309 30339 raft_consensus.cc:740] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:40.873694 30354 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.874006 30339 consensus_queue.cc:260] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:40.874264 30354 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:40.875466 30339 raft_consensus.cc:3060] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:12:40.876012 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:40.878479 25230 raft_consensus.cc:1240] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:40.856117 30265 raft_consensus.cc:493] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:40.882202 30265 raft_consensus.cc:515] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:40.883280 30264 leader_election.cc:290] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:40.883934 30264 raft_consensus.cc:493] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.884172 30265 leader_election.cc:290] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:40.884413 30264 raft_consensus.cc:515] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:40.767346 30314 raft_consensus.cc:493] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:40.855291 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 61714.8us
I20260709 13:12:40.855427 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:40.745026 30287 raft_consensus.cc:2804] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:40.886162 30314 raft_consensus.cc:515] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:40.844264 25370 raft_consensus.cc:1240] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 12 LEADER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:12:40.749540 30178 raft_consensus.cc:493] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:40.887653 30178 raft_consensus.cc:3060] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:40.888885 25343 leader_election.cc:304] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:40.718549 30255 raft_consensus.cc:515] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:40.890229 25226 raft_consensus.cc:2468] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 15.
I20260709 13:12:40.890365 30312 consensus_queue.cc:1048] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:40.858769 30267 raft_consensus.cc:493] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:40.891856 30267 raft_consensus.cc:515] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:40.799836 30286 raft_consensus.cc:515] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:40.892712 30312 raft_consensus.cc:2804] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:40.893128 30312 raft_consensus.cc:493] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:40.893469 30312 raft_consensus.cc:3060] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:40.859350 30185 raft_consensus.cc:493] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:40.893980 30185 raft_consensus.cc:3060] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:40.894074 30267 leader_election.cc:290] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:40.894321 30286 leader_election.cc:290] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:40.860348 30283 raft_consensus.cc:3060] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:40.824800 30241 raft_consensus.cc:2749] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:40.907424 25303 raft_consensus.cc:2468] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 14.
I20260709 13:12:40.826242 30220 raft_consensus.cc:3055] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:40.886524 30287 raft_consensus.cc:493] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
W20260709 13:12:40.915225 25195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:40.891343 30255 leader_election.cc:290] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:40.860049 30010 raft_consensus.cc:3060] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:40.895303 25343 leader_election.cc:304] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:40.895723 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:40.824353 30285 raft_consensus.cc:697] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 13 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:40.898458 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:40.899102 25371 raft_consensus.cc:2468] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 12.
I20260709 13:12:40.903108 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:40.906958 25378 raft_consensus.cc:2393] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 11: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:12:40.928076 25374 pending_rounds.cc:85] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468: Aborting all ops after (but not including) 9
I20260709 13:12:40.928452 25374 pending_rounds.cc:107] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:12:40.835152 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:40.757958 30200 raft_consensus.cc:493] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:40.860684 29999 raft_consensus.cc:515] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:40.911092 25377 raft_consensus.cc:1240] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 13. Current term is 14. Ops: []
W20260709 13:12:40.912745 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 212088us
W20260709 13:12:40.914023 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 110009us
I20260709 13:12:40.935124 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:40.918450 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:40.919442 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:40.937582 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:40.937706 25873 leader_election.cc:304] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:40.934957 25874 leader_election.cc:304] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:40.909109 30157 raft_consensus.cc:493] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:40.799291 30172 raft_consensus.cc:515] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:40.800977 30338 raft_consensus.cc:2749] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127) with higher term. Message: Invalid argument: T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 15. Current term is 16.
I20260709 13:12:40.833163 25221 raft_consensus.cc:1240] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:40.928684 25374 raft_consensus.cc:2889] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:40.928768 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:40.742522 30171 raft_consensus.cc:515] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:40.789707 30221 raft_consensus.cc:3060] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:40.861178 30271 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:40.953390 25345 leader_election.cc:304] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:40.824888 29832 raft_consensus.cc:493] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:40.969919 30267 raft_consensus.cc:2749] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:40.969798 29832 raft_consensus.cc:515] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:40.971333 25376 raft_consensus.cc:1240] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:12:40.769470 30272 raft_consensus.cc:515] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:40.800678 30326 raft_consensus.cc:515] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:12:40.981597 30283 raft_consensus.cc:2749] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:40.919317 30287 raft_consensus.cc:3060] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:40.913203 30220 raft_consensus.cc:740] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:40.919126 30199 raft_consensus.cc:2804] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:40.990823 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:40.954200 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:40.920281 25304 raft_consensus.cc:3060] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:40.957137 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:40.992751 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:40.993247 25379 raft_consensus.cc:2468] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 13.
I20260709 13:12:40.993913 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:40.799571 30332 raft_consensus.cc:515] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:40.932395 30200 raft_consensus.cc:3060] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:40.962047 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:40.963078 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:40.999958 25303 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 10.
I20260709 13:12:40.965941 25298 raft_consensus.cc:2393] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 15: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:40.929112 25373 raft_consensus.cc:2468] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 13.
I20260709 13:12:40.967929 25375 raft_consensus.cc:2393] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 16: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:40.968851 30172 leader_election.cc:290] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:40.969184 25874 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:41.004336 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:41.004741 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:40.940110 30280 raft_consensus.cc:515] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:40.914654 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:40.955847 30373 raft_consensus.cc:2804] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:40.972987 30264 leader_election.cc:290] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:40.973074 30171 leader_election.cc:290] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:40.973887 25223 raft_consensus.cc:3060] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:40.975369 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:41.012900 25377 raft_consensus.cc:2468] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 13.
I20260709 13:12:40.976012 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:40.977926 30324 raft_consensus.cc:2804] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:40.979236 30271 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:40.979539 25345 leader_election.cc:304] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:40.990500 30151 raft_consensus.cc:493] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:40.963857 30265 consensus_queue.cc:1059] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:12:40.980058 25903 raft_consensus.cc:2368] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 12. Current term is 13.
I20260709 13:12:41.019948 30285 consensus_queue.cc:237] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:41.025847 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:41.026903 30353 raft_consensus.cc:2749] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:40.986471 25228 raft_consensus.cc:1240] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:40.982708 25224 raft_consensus.cc:2468] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 14.
I20260709 13:12:40.996129 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:41.022847 25345 leader_election.cc:304] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:41.029284 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:40.921027 30216 raft_consensus.cc:515] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:40.994844 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:40.989243 30157 raft_consensus.cc:515] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:40.997959 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:40.932165 30334 raft_consensus.cc:2749] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:41.005816 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:41.006079 25874 leader_election.cc:304] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:41.046691 25303 raft_consensus.cc:2468] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 13.
I20260709 13:12:41.047348 25874 leader_election.cc:304] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:12:41.047139 25223 raft_consensus.cc:2468] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 14.
I20260709 13:12:40.971884 29832 leader_election.cc:290] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:41.007444 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:40.982280 30272 leader_election.cc:290] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:41.010360 25296 raft_consensus.cc:2393] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 12: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:41.016923 30172 raft_consensus.cc:493] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.999148 30343 raft_consensus.cc:493] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.011278 30375 raft_consensus.cc:2749] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:41.034729 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:41.186848 25226 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 9.
I20260709 13:12:41.187757 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:41.041985 25301 raft_consensus.cc:2393] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 13: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:41.040270 25345 leader_election.cc:304] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:41.044706 30353 raft_consensus.cc:2749] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:41.089383 25194 leader_election.cc:304] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:12:41.090165 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:41.011795 30199 raft_consensus.cc:697] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 14 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:41.019177 30324 raft_consensus.cc:493] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:41.092305 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:41.202396 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:41.202965 25228 raft_consensus.cc:2468] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 12.
I20260709 13:12:41.203712 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:41.204202 25228 raft_consensus.cc:3060] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:12:41.180721 25371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36254 (request call id 2461) took 1205 ms. Trace:
I20260709 13:12:41.184446 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:41.205003 25297 raft_consensus.cc:2468] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 12.
I20260709 13:12:41.032404 30373 raft_consensus.cc:697] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:41.204686 25371 rpcz_store.cc:276] 0709 13:12:39.975142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:40.112898 (+137756us) service_pool.cc:224] Handling call
0709 13:12:41.180537 (+1067639us) spinlock_profiling.cc:243] Waited 768 ms on lock 0x7b54003124d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:41.180642 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1765701376}
I20260709 13:12:41.212764 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:41.097280 30267 raft_consensus.cc:2804] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:12:41.070978 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:41.183530 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:41.195425 25370 raft_consensus.cc:1275] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:12:41.198274 25229 raft_consensus.cc:2468] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 12.
W20260709 13:12:41.198431 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 109174us
I20260709 13:12:41.083982 30277 raft_consensus.cc:2749] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:41.043987 30151 raft_consensus.cc:515] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:41.188920 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 148727us
I20260709 13:12:41.249945 25345 leader_election.cc:304] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:41.246879 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:41.258865 25194 leader_election.cc:304] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:41.199482 30334 raft_consensus.cc:2749] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:41.209337 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:41.269802 25223 raft_consensus.cc:2393] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 12: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:41.259946 25296 raft_consensus.cc:2393] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 12: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:41.260972 25901 raft_consensus.cc:2393] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 13: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:12:41.217032 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:41.212605 30324 raft_consensus.cc:3060] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:41.045821 30220 consensus_queue.cc:260] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:41.280817 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:41.280812 25345 leader_election.cc:304] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:41.214761 30272 raft_consensus.cc:2804] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:41.306241 25228 raft_consensus.cc:2468] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 13.
I20260709 13:12:41.275954 30375 raft_consensus.cc:493] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:41.286418 25345 leader_election.cc:304] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
W20260709 13:12:41.307530 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 48756.9us
I20260709 13:12:41.308490 25345 leader_election.cc:304] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:41.212920 30283 consensus_queue.cc:1059] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 13:12:41.310559 30310 raft_consensus.cc:2804] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:41.310978 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:41.311143 30310 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:41.311636 25904 raft_consensus.cc:2468] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 14.
I20260709 13:12:41.311702 30310 raft_consensus.cc:3060] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:41.312532 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:41.276741 30204 leader_election.cc:290] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:41.288985 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:41.289287 30199 consensus_queue.cc:237] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:41.290166 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:41.282958 30326 leader_election.cc:290] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:41.295284 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:41.257953 30267 raft_consensus.cc:493] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:41.361734 30267 raft_consensus.cc:3060] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:41.200693 30343 raft_consensus.cc:515] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:41.266947 30301 raft_consensus.cc:493] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.309441 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:41.276909 30265 raft_consensus.cc:2749] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:12:41.288841 30372 log.cc:927] Time spent T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.283s	user 0.001s	sys 0.000s
W20260709 13:12:41.285923 30374 log.cc:927] Time spent T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 13:12:41.314163 25345 leader_election.cc:304] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:41.438568 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 124493us
I20260709 13:12:41.324915 25378 raft_consensus.cc:1240] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:12:41.334844 25904 raft_consensus.cc:2393] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 14: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:12:41.297248 25874 leader_election.cc:304] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:41.200537 30172 raft_consensus.cc:515] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:41.299443 30221 raft_consensus.cc:515] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:41.283318 30141 raft_consensus.cc:2749] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:41.297442 30241 raft_consensus.cc:2749] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:41.397302 30301 raft_consensus.cc:515] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:41.401661 30332 leader_election.cc:290] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:41.300926 29999 leader_election.cc:290] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:41.313424 30216 leader_election.cc:290] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:41.357925 30272 raft_consensus.cc:697] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 14 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
W20260709 13:12:41.434091 25271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:41.359197 30373 consensus_queue.cc:237] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:41.365581 30349 raft_consensus.cc:2804] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:41.437027 25900 raft_consensus.cc:2468] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 8.
I20260709 13:12:41.463349 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:41.445695 30359 raft_consensus.cc:2749] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:41.308573 25194 leader_election.cc:304] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:41.443948 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 99394.2us
I20260709 13:12:41.443224 25345 leader_election.cc:304] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:41.317471 30129 consensus_queue.cc:1048] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.118s
I20260709 13:12:41.359925 30178 raft_consensus.cc:515] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:41.441411 29832 raft_consensus.cc:493] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.478492 29832 raft_consensus.cc:515] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:41.458427 25296 raft_consensus.cc:1275] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:12:41.364545 30375 raft_consensus.cc:515] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:41.464058 25297 raft_consensus.cc:2468] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 13.
W20260709 13:12:41.440871 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 143707us
I20260709 13:12:41.489265 25874 leader_election.cc:304] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:12:41.486793 25270 leader_election.cc:304] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:12:41.450163 30277 raft_consensus.cc:2804] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:12:41.467355 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 158859us
I20260709 13:12:41.502875 25194 leader_election.cc:304] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:41.468566 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:41.471536 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:41.474622 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
W20260709 13:12:41.475613 25195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:41.504071 25221 raft_consensus.cc:3060] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:41.504915 25195 leader_election.cc:304] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:41.505156 25270 leader_election.cc:304] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:41.505892 25195 leader_election.cc:304] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:41.507270 25195 leader_election.cc:304] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:41.476451 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:41.508457 25229 raft_consensus.cc:2468] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 14.
I20260709 13:12:41.457631 25902 raft_consensus.cc:1240] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:41.480697 25298 raft_consensus.cc:1240] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:12:41.482491 25873 leader_election.cc:304] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:41.452944 30280 leader_election.cc:290] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:41.511330 30285 raft_consensus.cc:2804] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:41.511740 30285 raft_consensus.cc:493] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:41.512061 30285 raft_consensus.cc:3060] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:41.513479 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:41.514096 25230 raft_consensus.cc:3060] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:41.460268 30382 raft_consensus.cc:493] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:41.487571 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:41.464802 30349 raft_consensus.cc:493] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:41.492470 30200 raft_consensus.cc:515] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:41.487172 30141 raft_consensus.cc:2804] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:41.531757 30310 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:41.495374 25304 consensus_meta.cc:287] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.503s	user 0.009s	sys 0.000s
I20260709 13:12:41.517266 25194 leader_election.cc:304] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:41.518745 25221 raft_consensus.cc:2468] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 15.
I20260709 13:12:41.519164 25270 leader_election.cc:304] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:41.521154 25305 raft_consensus.cc:606] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Received request to transfer leadership to TS 1f539ba21487460085b837e7529a78ce
I20260709 13:12:41.536687 25304 raft_consensus.cc:2468] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 13.
I20260709 13:12:41.537060 25305 raft_consensus.cc:614] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:41.538024 25299 raft_consensus.cc:1240] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:12:41.465245 30151 leader_election.cc:290] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:41.516219 25296 raft_consensus.cc:2468] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 14.
I20260709 13:12:41.480275 30286 raft_consensus.cc:493] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.479811 30332 raft_consensus.cc:2749] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:41.524750 25300 raft_consensus.cc:2468] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 12.
I20260709 13:12:41.527493 30314 leader_election.cc:290] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:41.527779 30157 leader_election.cc:290] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:41.528992 30361 leader_election.cc:290] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:41.529457 30272 consensus_queue.cc:237] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:41.530915 30343 leader_election.cc:290] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:41.531342 30200 leader_election.cc:290] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 9 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:41.531939 25899 raft_consensus.cc:2368] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 8. Current term is 9.
I20260709 13:12:41.532315 30141 raft_consensus.cc:493] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:41.447819 30138 consensus_queue.cc:1059] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:12:41.522843 30349 raft_consensus.cc:3060] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:41.513244 30265 raft_consensus.cc:2749] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:41.578927 25230 raft_consensus.cc:2468] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 12.
I20260709 13:12:41.519656 30326 raft_consensus.cc:2804] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:41.580886 30326 raft_consensus.cc:493] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:41.581331 30326 raft_consensus.cc:3060] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:12:41.583015 30287 consensus_meta.cc:287] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.581s	user 0.009s	sys 0.000s
I20260709 13:12:41.583554 30287 raft_consensus.cc:515] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:41.523172 30280 raft_consensus.cc:2749] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:12:41.541301 25304 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57272 (request call id 2182) took 2153 ms (client timeout 1941 ms). Trace:
I20260709 13:12:41.519891 30384 raft_consensus.cc:2804] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:41.585366 30384 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
W20260709 13:12:41.585217 25304 rpcz_store.cc:269] 0709 13:12:39.384049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:39.384234 (+   185us) service_pool.cc:224] Handling call
0709 13:12:40.352085 (+967851us) spinlock_profiling.cc:243] Waited 610 ms on lock 0x7b18002a5040. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fcaa646 00007fd72fbe458e 00007fd72fc65f9e 00007fd72fc677de 00007fd72fc7327c 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c
0709 13:12:40.800591 (+448506us) spinlock_profiling.cc:243] Waited 385 ms on lock 0x7b5800556dd0. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fbcb0aa 00007fd72fc4d447 00007fd72fc65fe7 00007fd72fc677de 00007fd72fc7327c 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c
0709 13:12:40.919920 (+119329us) spinlock_profiling.cc:243] Waited 97.6 ms on lock 0x7b54002da120. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fbe4a1d 00007fd72fbcb1a4 00007fd72fc4d447 00007fd72fc65fe7 00007fd72fc677de 00007fd72fc7327c 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591
0709 13:12:41.537205 (+617285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2512489088}
I20260709 13:12:41.586001 30384 raft_consensus.cc:3060] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:41.561476 30157 raft_consensus.cc:2749] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:41.514437 30385 raft_consensus.cc:493] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:41.588466 30129 raft_consensus.cc:493] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.588965 30220 raft_consensus.cc:3060] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:41.589510 30375 leader_election.cc:290] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:41.590082 30375 raft_consensus.cc:2749] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:12:41.588996 30129 raft_consensus.cc:515] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:41.591173 30326 raft_consensus.cc:515] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:41.591825 30301 leader_election.cc:290] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:41.592043 30129 leader_election.cc:290] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:41.592370 30172 leader_election.cc:290] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:41.593192 30326 leader_election.cc:290] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:41.593567 30324 raft_consensus.cc:515] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:41.594867 30312 consensus_meta.cc:287] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.682s	user 0.006s	sys 0.004s
I20260709 13:12:41.595269 30312 raft_consensus.cc:515] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:12:41.595636 30324 leader_election.cc:290] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:41.597223 30312 leader_election.cc:290] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:12:41.597337 30339 consensus_meta.cc:287] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 0.721s	user 0.006s	sys 0.005s
I20260709 13:12:41.598029 25226 raft_consensus.cc:2468] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 13.
I20260709 13:12:41.598693 30239 raft_consensus.cc:3055] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:41.599058 30239 raft_consensus.cc:740] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:41.599884 30239 consensus_queue.cc:260] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:41.600824 30239 raft_consensus.cc:3060] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:41.553745 30286 raft_consensus.cc:515] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:41.608628 25270 leader_election.cc:304] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:12:41.497548 30267 raft_consensus.cc:515] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:41.536763 30206 raft_consensus.cc:2749] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:12:41.539287 30010 consensus_meta.cc:287] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.607s	user 0.009s	sys 0.001s
I20260709 13:12:41.546026 29999 raft_consensus.cc:3060] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:41.535693 30382 raft_consensus.cc:515] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:41.572885 30138 raft_consensus.cc:3055] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:41.569675 30141 raft_consensus.cc:3060] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:41.587975 30178 leader_election.cc:290] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:41.572214 30200 raft_consensus.cc:2804] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:12:41.661098 25270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:41.661686 25374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36254 (request call id 2475) took 1146 ms. Trace:
I20260709 13:12:41.664054 25372 raft_consensus.cc:1275] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:12:41.662478 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:41.663061 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:41.694022 30310 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:41.667250 30138 raft_consensus.cc:740] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:41.704155 30332 consensus_queue.cc:1048] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:41.705212 25370 raft_consensus.cc:2468] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 14.
I20260709 13:12:41.665989 30378 raft_consensus.cc:2804] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:41.668780 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:41.721475 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:41.588503 30385 raft_consensus.cc:515] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:41.661291 30010 raft_consensus.cc:515] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:41.703527 25374 rpcz_store.cc:276] 0709 13:12:40.515622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:40.856099 (+340477us) service_pool.cc:224] Handling call
0709 13:12:40.856470 (+   371us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:40.987349 (+130879us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:40.987398 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:40.988211 (+   813us) log.cc:844] Serialized 52 byte log entry
0709 13:12:41.041726 (+ 53515us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:41.178797 (+137071us) log.cc:844] Serialized 14 byte log entry
0709 13:12:41.179014 (+   217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:41.610675 (+431661us) spinlock_profiling.cc:243] Waited 71.4 ms on lock 0x7b540033f754. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:41.610725 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:41.610770 (+    45us) raft_consensus.cc:1685] finished
0709 13:12:41.661472 (+ 50702us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:41.661622 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30466,"prepare.queue_time_us":136969,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":25273,"raft.queue_time_us":11028,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":25133,"spinlock_wait_cycles":164173696,"thread_start_us":29959,"threads_started":1,"wal-append.queue_time_us":313946}
I20260709 13:12:41.728901 25872 leader_election.cc:304] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:41.716876 25900 raft_consensus.cc:1275] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:12:41.717697 25906 raft_consensus.cc:1240] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 19 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 18. Current term is 19. Ops: []
I20260709 13:12:41.718546 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:41.718945 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:41.720522 25195 leader_election.cc:304] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:41.721765 25379 raft_consensus.cc:2393] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 15: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
W20260709 13:12:41.667775 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 178605us
I20260709 13:12:41.722963 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:41.733631 25378 raft_consensus.cc:2393] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 13: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:41.731070 25905 raft_consensus.cc:2468] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 11.
I20260709 13:12:41.726387 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:41.726948 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:41.728248 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:41.734539 25375 raft_consensus.cc:3060] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:41.734889 25907 raft_consensus.cc:2393] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 14: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:12:41.726990 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:41.729264 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:41.668286 30287 leader_election.cc:290] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:41.669351 30386 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.665043 30151 raft_consensus.cc:493] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.715732 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:41.770926 25373 raft_consensus.cc:2393] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 8: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:41.721297 30378 raft_consensus.cc:493] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:41.738498 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:41.738991 30286 leader_election.cc:290] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:41.736100 30339 raft_consensus.cc:2804] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:41.739784 30387 raft_consensus.cc:2804] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:41.740648 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:41.730142 30221 leader_election.cc:290] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 12 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:41.741544 30010 leader_election.cc:290] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:41.742084 25302 raft_consensus.cc:1240] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:41.744793 30385 leader_election.cc:290] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:41.746145 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:41.751302 30382 leader_election.cc:290] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:41.758468 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:41.709867 30200 raft_consensus.cc:493] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:41.759800 25872 leader_election.cc:304] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:41.734157 30185 consensus_meta.cc:287] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent flushing consensus metadata: real 0.840s	user 0.008s	sys 0.004s
I20260709 13:12:41.786659 25374 raft_consensus.cc:2468] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 14.
I20260709 13:12:41.793089 25375 raft_consensus.cc:2468] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 9.
I20260709 13:12:41.793522 25371 raft_consensus.cc:2468] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 16.
I20260709 13:12:41.781337 30378 raft_consensus.cc:3060] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:41.780918 30277 raft_consensus.cc:697] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:41.770493 30324 raft_consensus.cc:493] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:41.899808 25372 raft_consensus.cc:2393] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 13: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:41.778164 30386 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:41.786433 30387 raft_consensus.cc:493] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:41.873482 30010 raft_consensus.cc:493] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:41.916292 30349 raft_consensus.cc:515] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:41.770341 30138 consensus_queue.cc:260] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:41.901548 29999 raft_consensus.cc:2749] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:41.933924 30142 raft_consensus.cc:493] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:41.942143 25305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:35660 (request call id 25) took 1354 ms. Trace:
I20260709 13:12:41.877843 30185 raft_consensus.cc:515] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:41.790405 30198 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.878569 29832 leader_election.cc:290] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:41.787212 30339 raft_consensus.cc:493] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:41.994274 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:41.993080 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:12:41.960032 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:41.981541 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:41.990692 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:42.017922 25374 raft_consensus.cc:2393] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 15: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
W20260709 13:12:42.017035 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.018400 25224 raft_consensus.cc:3060] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:41.983081 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
W20260709 13:12:41.954234 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 194536us
I20260709 13:12:41.982160 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:42.022614 25375 raft_consensus.cc:3060] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:41.880199 30287 raft_consensus.cc:493] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:41.899518 30200 raft_consensus.cc:3060] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:12:42.011181 25271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.011926 25903 raft_consensus.cc:1240] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:41.770361 30151 raft_consensus.cc:515] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:42.013187 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:42.014464 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:42.018090 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:42.025108 25373 raft_consensus.cc:2393] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 14: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:42.025116 25227 raft_consensus.cc:2410] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:12:42.020607 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:42.021730 25376 raft_consensus.cc:2376] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 12. Re-sending same reply.
I20260709 13:12:42.025861 25374 raft_consensus.cc:2468] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 12.
I20260709 13:12:41.957443 30138 raft_consensus.cc:3060] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:42.023626 25872 leader_election.cc:304] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:42.028158 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:42.026880 25271 leader_election.cc:304] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:42.023646 25343 leader_election.cc:304] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:12:41.955717 30387 raft_consensus.cc:3060] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:42.006640 25305 rpcz_store.cc:276] 0709 13:12:40.587703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:40.589362 (+  1659us) service_pool.cc:224] Handling call
0709 13:12:41.941915 (+1352553us) spinlock_profiling.cc:243] Waited 897 ms on lock 0x7b54002fb054. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc69853 00007fd734c3760a 00007fd72e1bd7d4 00007fd72e1bd762 00007fd72e1bd691 00007fd72e1bd60c 00007fd72e1bc8c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:41.942045 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2062086912}
I20260709 13:12:42.030192 25271 leader_election.cc:304] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:41.959087 30267 leader_election.cc:290] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 19 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:42.038043 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:42.038323 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:42.038993 25908 raft_consensus.cc:2468] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 17.
W20260709 13:12:42.034580 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 517350us
I20260709 13:12:42.040144 25194 leader_election.cc:304] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:42.042295 25194 leader_election.cc:304] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:41.962452 30386 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:41.959331 30398 raft_consensus.cc:2749] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:42.045509 25194 leader_election.cc:304] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:42.055774 25375 raft_consensus.cc:2468] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 12.
I20260709 13:12:41.941497 30141 raft_consensus.cc:515] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:41.903791 30285 raft_consensus.cc:515] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:41.950340 30324 raft_consensus.cc:515] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:42.018069 30339 raft_consensus.cc:3060] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:42.060390 25194 leader_election.cc:304] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:41.968585 30010 raft_consensus.cc:515] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:42.066794 25372 raft_consensus.cc:1240] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 16. Current term is 17. Ops: []
I20260709 13:12:42.028823 30129 consensus_queue.cc:1048] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:12:42.030511 29999 raft_consensus.cc:493] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:42.041725 30396 raft_consensus.cc:2749] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:42.050209 30283 raft_consensus.cc:2749] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:42.043982 29832 raft_consensus.cc:2749] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:42.091418 25224 raft_consensus.cc:2468] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 16.
I20260709 13:12:42.013870 30142 raft_consensus.cc:515] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:41.958117 30277 consensus_queue.cc:237] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:42.102303 30349 leader_election.cc:290] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 17 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:12:42.103367 30239 consensus_meta.cc:287] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.502s	user 0.010s	sys 0.001s
I20260709 13:12:42.061409 30386 raft_consensus.cc:2749] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:42.104768 25375 raft_consensus.cc:1275] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:12:42.016997 30198 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:42.106145 30142 leader_election.cc:290] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:42.065337 30332 raft_consensus.cc:2749] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:42.107177 30324 leader_election.cc:290] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:42.012189 30384 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:42.110751 25374 raft_consensus.cc:1240] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:42.044916 30392 raft_consensus.cc:2804] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:42.061235 30171 raft_consensus.cc:3060] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:42.112620 25305 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211"
dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
mode: GRACEFUL
new_leader_uuid: "1f539ba21487460085b837e7529a78ce"
 from {username='slave'} at 127.0.0.1:35660
I20260709 13:12:42.124643 25305 raft_consensus.cc:606] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 7 LEADER]: Received request to transfer leadership to TS 1f539ba21487460085b837e7529a78ce
W20260709 13:12:42.125396 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 88586.5us
I20260709 13:12:42.034771 30287 raft_consensus.cc:515] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:42.120085 25224 raft_consensus.cc:1275] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:12:42.120287 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:42.130173 25223 raft_consensus.cc:2393] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 15: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:42.120329 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:42.121603 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:42.115550 25376 raft_consensus.cc:2468] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 14.
I20260709 13:12:42.126286 25270 leader_election.cc:304] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:42.134449 25222 raft_consensus.cc:3060] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:42.140798 25229 raft_consensus.cc:2393] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 13: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:12:42.141902 24113 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:12:42.060775 30181 consensus_queue.cc:1048] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.065s
I20260709 13:12:42.088397 30397 raft_consensus.cc:2764] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:12:42.143615 25270 leader_election.cc:304] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:42.147534 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:42.147881 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:42.148170 25305 raft_consensus.cc:2468] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 14.
I20260709 13:12:42.061060 30393 consensus_queue.cc:1059] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.084s
I20260709 13:12:42.148207 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:42.118391 30392 raft_consensus.cc:493] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:42.150518 25301 raft_consensus.cc:2468] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 13.
I20260709 13:12:42.158879 25222 raft_consensus.cc:2468] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 15.
I20260709 13:12:42.160283 25299 raft_consensus.cc:2393] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 16: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:42.164304 25270 leader_election.cc:304] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:12:42.192602 25300 raft_consensus.cc:1275] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:12:42.192067 30199 consensus_queue.cc:1048] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.009s
I20260709 13:12:42.154276 30156 raft_consensus.cc:493] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:42.200096 30156 raft_consensus.cc:515] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:42.201949 30239 raft_consensus.cc:2804] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:42.202726 30239 raft_consensus.cc:697] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 12 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:42.203773 30239 consensus_queue.cc:237] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:42.193679 25270 leader_election.cc:304] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:42.117676 29999 raft_consensus.cc:515] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:42.127568 30326 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.149288 29832 raft_consensus.cc:2804] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:42.153949 30204 raft_consensus.cc:2804] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:12:42.217836 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 187681us
I20260709 13:12:42.139591 30151 leader_election.cc:290] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:42.216183 25270 leader_election.cc:304] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:42.227408 25270 leader_election.cc:304] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:42.155762 30198 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:42.158079 30392 raft_consensus.cc:3060] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:42.217159 30386 raft_consensus.cc:2804] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:42.154493 30283 raft_consensus.cc:493] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:42.239627 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:42.224226 29832 raft_consensus.cc:493] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:42.240413 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:42.225464 30204 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:42.239930 25872 leader_election.cc:304] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:42.246766 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:42.246923 25907 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 9.
I20260709 13:12:42.245366 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:42.190539 30334 consensus_queue.cc:1048] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:12:42.247404 25872 leader_election.cc:304] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:42.236743 30206 raft_consensus.cc:2804] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:42.235638 30151 raft_consensus.cc:2804] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:42.242728 30386 raft_consensus.cc:493] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:42.225924 30326 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:42.256057 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:42.249305 29832 raft_consensus.cc:3060] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:42.253170 30277 raft_consensus.cc:2804] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:42.306591 30277 raft_consensus.cc:493] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:42.307092 30277 raft_consensus.cc:3060] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:42.308014 30326 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:42.275719 30151 raft_consensus.cc:697] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 12 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:42.309484 30151 consensus_queue.cc:237] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:42.310954 30399 log.cc:927] Time spent T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:12:42.316392 30384 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:42.317276 30384 raft_consensus.cc:493] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:42.317865 30384 raft_consensus.cc:515] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:42.320040 30287 leader_election.cc:290] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:42.271795 30206 raft_consensus.cc:697] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 14 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:42.322758 30206 consensus_queue.cc:237] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:42.329394 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 89229.1us
I20260709 13:12:42.273303 25375 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 9.
I20260709 13:12:42.246228 30198 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:42.249481 30204 raft_consensus.cc:3060] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:42.326223 30010 leader_election.cc:290] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:42.252103 30156 leader_election.cc:290] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:42.255542 30185 leader_election.cc:290] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 15 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:42.255860 30393 raft_consensus.cc:2804] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:42.272866 30386 raft_consensus.cc:3060] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:42.269604 30141 leader_election.cc:290] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 16 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:42.357570 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
W20260709 13:12:42.357028 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 111607us
I20260709 13:12:42.365409 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:42.367728 30185 raft_consensus.cc:493] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.368371 30185 raft_consensus.cc:515] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:42.370189 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:42.370357 30185 leader_election.cc:290] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:42.371105 30354 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:42.373306 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:42.375973 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:42.378293 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
W20260709 13:12:42.386176 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 153624us
I20260709 13:12:42.271520 30396 consensus_queue.cc:1048] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.086s
I20260709 13:12:42.354286 30157 raft_consensus.cc:493] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:42.391916 25270 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:12:42.390381 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 657406us
I20260709 13:12:42.399049 25195 leader_election.cc:304] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:42.400744 25195 leader_election.cc:304] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:12:42.249099 30283 raft_consensus.cc:515] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:42.393927 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 109916us
I20260709 13:12:42.409767 25224 raft_consensus.cc:1240] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
W20260709 13:12:42.411285 30383 log.cc:927] Time spent T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.970s	user 0.006s	sys 0.007s
I20260709 13:12:42.408540 30326 raft_consensus.cc:2804] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:42.418443 30326 raft_consensus.cc:697] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 8 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:42.392956 30201 raft_consensus.cc:493] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.419835 30384 leader_election.cc:290] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:42.420442 30384 consensus_queue.cc:1059] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 16.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:42.421416 30384 raft_consensus.cc:2804] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:42.424610 25271 leader_election.cc:304] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:12:42.425956 25271 leader_election.cc:304] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:12:42.427090 30326 consensus_queue.cc:237] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:42.428723 30277 raft_consensus.cc:515] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:42.434157 30387 raft_consensus.cc:515] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:42.434640 30199 raft_consensus.cc:3055] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:12:42.405589 30157 raft_consensus.cc:515] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:42.435271 30199 raft_consensus.cc:740] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:42.359053 30285 leader_election.cc:290] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:42.357097 30393 raft_consensus.cc:493] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:42.436456 30393 raft_consensus.cc:3060] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:42.436910 29999 leader_election.cc:290] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:42.438095 29999 raft_consensus.cc:2804] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:42.438447 29999 raft_consensus.cc:493] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:42.438791 29999 raft_consensus.cc:3060] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:42.354431 30198 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:42.406404 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:42.410192 30397 raft_consensus.cc:2804] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:42.442669 25222 raft_consensus.cc:3060] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:12:42.442971 30397 raft_consensus.cc:493] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:42.443408 30397 raft_consensus.cc:3060] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:42.435357 30264 raft_consensus.cc:3055] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:42.443943 30264 raft_consensus.cc:740] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:42.419893 30201 raft_consensus.cc:515] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:42.445218 30378 consensus_meta.cc:287] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.563s	user 0.004s	sys 0.006s
I20260709 13:12:42.443532 30404 raft_consensus.cc:2804] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:42.424642 25906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50060 (request call id 892) took 1132 ms. Trace:
I20260709 13:12:42.447330 25906 rpcz_store.cc:276] 0709 13:12:41.292158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.361917 (+ 69759us) service_pool.cc:224] Handling call
0709 13:12:41.362245 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:41.733466 (+371221us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:42.424409 (+690943us) spinlock_profiling.cc:243] Waited 355 ms on lock 0x7b54005f0354. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:42.424582 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":817051008}
I20260709 13:12:42.402598 25375 raft_consensus.cc:2468] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 15.
I20260709 13:12:42.450076 25195 leader_election.cc:400] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Vote denied by peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085) with higher term. Message: Invalid argument: T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 12. Current term is 13.
I20260709 13:12:42.456853 25195 leader_election.cc:403] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:12:42.460388 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 56957.6us
I20260709 13:12:42.461398 25270 leader_election.cc:304] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
W20260709 13:12:42.470445 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 62072.9us
I20260709 13:12:42.475390 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:42.482789 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:42.483834 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:42.485838 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:42.489924 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:42.492177 30277 leader_election.cc:290] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 15 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:42.493059 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:42.493883 25900 raft_consensus.cc:2393] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 13: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:12:42.494547 30198 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:42.477164 30285 raft_consensus.cc:2749] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085) with higher term. Message: Invalid argument: T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 12. Current term is 13.
I20260709 13:12:42.496390 30201 leader_election.cc:290] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:42.496527 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:42.497174 25227 raft_consensus.cc:3060] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:42.484501 25905 raft_consensus.cc:2468] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 15.
I20260709 13:12:42.476866 30354 raft_consensus.cc:493] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:42.498288 30354 raft_consensus.cc:515] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:42.500878 30354 leader_election.cc:290] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:42.502417 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:42.503988 25344 leader_election.cc:304] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:42.503026 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:42.486637 25901 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 9.
I20260709 13:12:42.503032 25906 raft_consensus.cc:2468] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 8.
I20260709 13:12:42.507799 25224 raft_consensus.cc:2393] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 12: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:42.508874 25227 raft_consensus.cc:2468] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 19.
I20260709 13:12:42.504438 25270 leader_election.cc:304] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:42.436467 30387 leader_election.cc:290] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 12 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:42.450042 30384 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:42.513522 30407 raft_consensus.cc:993] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19: : Instructing follower 1f539ba21487460085b837e7529a78ce to start an election
I20260709 13:12:42.514901 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:42.523689 25377 raft_consensus.cc:3060] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:42.515555 30409 raft_consensus.cc:2749] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:42.518864 25270 leader_election.cc:304] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:42.433248 30339 raft_consensus.cc:515] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:42.526485 30334 raft_consensus.cc:2749] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:42.456482 30378 raft_consensus.cc:515] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:42.506254 30396 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:42.531857 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:42.535681 25305 raft_consensus.cc:2468] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 13.
I20260709 13:12:42.521409 30201 raft_consensus.cc:2804] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:42.524549 30384 raft_consensus.cc:3060] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:42.470031 30392 raft_consensus.cc:515] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:42.544296 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:42.548345 30392 leader_election.cc:290] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:12:42.558660 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 132620us
I20260709 13:12:42.530405 30171 raft_consensus.cc:2749] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:42.560485 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:42.535187 30410 raft_consensus.cc:1081] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 7 LEADER]: Signalling peer 1f539ba21487460085b837e7529a78ce to start an election
I20260709 13:12:42.562800 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:42.563280 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:42.526762 30204 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:42.563970 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:42.564927 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:42.565363 30204 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 18 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:42.566068 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:42.568846 25377 raft_consensus.cc:2468] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 15.
I20260709 13:12:42.562708 25872 leader_election.cc:304] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:42.562474 25222 raft_consensus.cc:2468] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 9.
I20260709 13:12:42.540977 30407 raft_consensus.cc:2749] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:42.573184 25345 leader_election.cc:304] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:42.574822 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:42.576550 25906 raft_consensus.cc:3060] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:42.546540 30201 raft_consensus.cc:697] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 15 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:42.581056 25902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50060 (request call id 885) took 1298 ms. Trace:
I20260709 13:12:42.583053 25270 leader_election.cc:304] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:42.580370 25344 leader_election.cc:304] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:42.581524 25902 rpcz_store.cc:276] 0709 13:12:41.283056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.283199 (+   143us) service_pool.cc:224] Handling call
0709 13:12:41.285876 (+  2677us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:41.509430 (+223554us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:42.580820 (+1071390us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b5400490cd4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:42.580996 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":394391808}
I20260709 13:12:42.566938 30151 raft_consensus.cc:493] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:42.586930 25305 raft_consensus.cc:1240] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:12:42.540876 30396 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:42.590799 25344 leader_election.cc:304] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:42.525784 30199 consensus_queue.cc:260] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.7, Last appended by leader: 7, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:42.586741 25271 leader_election.cc:304] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:42.574299 30387 raft_consensus.cc:2804] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:12:42.593209 30200 consensus_meta.cc:287] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent flushing consensus metadata: real 0.551s	user 0.004s	sys 0.008s
I20260709 13:12:42.579299 30349 raft_consensus.cc:2804] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:42.600606 25344 leader_election.cc:304] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:42.592442 30407 raft_consensus.cc:2749] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:42.595019 30312 raft_consensus.cc:2749] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:42.608631 30392 raft_consensus.cc:2804] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:42.619200 30157 leader_election.cc:290] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:42.620261 25901 raft_consensus.cc:2468] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 14.
I20260709 13:12:42.644937 25378 raft_consensus.cc:1275] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:12:42.639159 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:42.646234 25374 raft_consensus.cc:3060] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:42.614576 25344 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:42.579260 30129 consensus_queue.cc:1059] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 13:12:42.622411 25906 raft_consensus.cc:2468] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 18.
I20260709 13:12:42.601657 30175 consensus_queue.cc:1059] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:12:42.600348 30151 raft_consensus.cc:515] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:42.665932 30407 consensus_queue.cc:1059] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:42.668071 30151 leader_election.cc:290] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:42.668680 30151 consensus_queue.cc:1048] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:42.635318 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:42.635561 30199 raft_consensus.cc:3060] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:12:42.628690 25226 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58422 (request call id 2483) took 1446 ms (client timeout 1522 ms). Trace:
W20260709 13:12:42.670553 25226 rpcz_store.cc:269] 0709 13:12:41.182663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.187546 (+  4883us) service_pool.cc:224] Handling call
0709 13:12:42.628524 (+1440978us) spinlock_profiling.cc:243] Waited 410 ms on lock 0x7b540025dfd4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:42.628632 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":942211840}
I20260709 13:12:42.637331 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:42.671943 25305 raft_consensus.cc:2468] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 14.
I20260709 13:12:42.601941 30387 raft_consensus.cc:493] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:42.654508 30157 raft_consensus.cc:493] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.673959 30387 raft_consensus.cc:3060] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:42.605566 30200 raft_consensus.cc:515] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:42.674146 30157 raft_consensus.cc:515] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:42.676362 30200 leader_election.cc:290] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 12 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:42.676802 30157 leader_election.cc:290] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:42.677039 25904 raft_consensus.cc:2468] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 12.
I20260709 13:12:42.631829 30386 raft_consensus.cc:515] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:42.679821 30386 leader_election.cc:290] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:42.631089 30378 leader_election.cc:290] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:42.635126 30334 raft_consensus.cc:2749] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:42.686754 29999 raft_consensus.cc:515] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:42.688932 29999 leader_election.cc:290] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:42.626144 30349 raft_consensus.cc:697] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 15 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:42.690451 30349 consensus_queue.cc:237] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:12:42.691004 30339 leader_election.cc:290] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:42.679834 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:42.648358 25344 leader_election.cc:304] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:12:42.698230 25873 leader_election.cc:304] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:42.704890 25222 raft_consensus.cc:1240] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 14 LEADER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:12:42.634016 30392 raft_consensus.cc:493] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:42.658720 25374 raft_consensus.cc:2468] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 14.
I20260709 13:12:42.693814 25270 leader_election.cc:304] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:12:42.631984 30411 log.cc:927] Time spent T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:12:42.633502 30396 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:42.661535 30204 raft_consensus.cc:2749] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:42.622556 30283 leader_election.cc:290] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:42.663915 30198 raft_consensus.cc:493] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.630316 30201 consensus_queue.cc:237] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:42.707291 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 59038.3us
W20260709 13:12:42.746081 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 159415us
I20260709 13:12:42.710527 25873 leader_election.cc:304] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:42.714613 30200 raft_consensus.cc:2749] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:12:42.715168 30415 log.cc:927] Time spent T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:12:42.716713 30397 raft_consensus.cc:515] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:42.769109 24113 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:42.727766 30392 raft_consensus.cc:3060] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:42.659750 30354 raft_consensus.cc:2804] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:42.730537 25270 leader_election.cc:304] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:42.730808 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
W20260709 13:12:42.787985 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 57575.1us
I20260709 13:12:42.788460 25379 raft_consensus.cc:2393] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 13: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:42.728987 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:42.736869 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:42.789927 25222 raft_consensus.cc:3060] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:42.735116 25872 leader_election.cc:304] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:42.790498 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
W20260709 13:12:42.790846 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 55845.3us
I20260709 13:12:42.744234 25226 raft_consensus.cc:2468] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 12.
I20260709 13:12:42.753067 25271 leader_election.cc:304] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:42.755076 25873 leader_election.cc:304] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:42.757814 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:42.793707 25372 raft_consensus.cc:2393] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 14: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:42.761145 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:42.684379 30384 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:42.762660 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:42.763626 25302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57256 (request call id 2347) took 1807 ms. Trace:
I20260709 13:12:42.764124 25224 raft_consensus.cc:1240] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 19 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 18. Current term is 19. Ops: []
I20260709 13:12:42.764698 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:42.766599 30382 raft_consensus.cc:3055] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:12:42.767292 25903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50058 (request call id 936) took 1053 ms. Trace:
I20260709 13:12:42.658260 30393 raft_consensus.cc:515] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:42.721457 29832 raft_consensus.cc:515] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:42.771265 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:42.734483 30129 raft_consensus.cc:2804] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:42.742213 30206 raft_consensus.cc:2804] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:12:42.785964 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:42.787205 25874 leader_election.cc:304] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:12:42.788000 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:42.840169 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:42.841192 25908 raft_consensus.cc:2393] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 18: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:42.794364 25230 raft_consensus.cc:2468] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 13.
I20260709 13:12:42.762419 30264 consensus_queue.cc:260] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:42.795395 25305 raft_consensus.cc:2393] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 12: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:42.787374 30354 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:42.810506 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 57517us
I20260709 13:12:42.823421 25903 rpcz_store.cc:276] 0709 13:12:41.714143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.714942 (+   799us) service_pool.cc:224] Handling call
0709 13:12:41.715235 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:42.024016 (+308781us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:42.767072 (+743056us) spinlock_profiling.cc:243] Waited 296 ms on lock 0x7b54003589d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:42.767236 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":681879936}
I20260709 13:12:42.834589 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:42.758991 30396 raft_consensus.cc:2804] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:42.721740 30387 raft_consensus.cc:515] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:42.758307 30198 raft_consensus.cc:515] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:12:42.848489 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:42.850172 25271 leader_election.cc:304] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:42.856599 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:42.809682 30204 raft_consensus.cc:2804] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:12:42.875933 25899 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50056 (request call id 871) took 2229 ms (client timeout 1619 ms). Trace:
I20260709 13:12:42.823309 30200 raft_consensus.cc:2804] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:42.805313 25222 raft_consensus.cc:2468] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 17.
W20260709 13:12:42.876411 25899 rpcz_store.cc:269] 0709 13:12:40.639049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:40.639394 (+   345us) service_pool.cc:224] Handling call
0709 13:12:42.868226 (+2228832us) spinlock_profiling.cc:243] Waited 809 ms on lock 0x7b54003570d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:42.868353 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1861301504}
W20260709 13:12:42.863588 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 76466us
I20260709 13:12:42.824030 30277 raft_consensus.cc:2804] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:42.833567 30339 raft_consensus.cc:493] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
W20260709 13:12:42.838136 30414 log.cc:927] Time spent T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:12:42.857537 30206 raft_consensus.cc:697] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 18 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:42.808334 25302 rpcz_store.cc:276] 0709 13:12:40.956513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:40.956623 (+   110us) service_pool.cc:224] Handling call
0709 13:12:40.956902 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:41.792031 (+835129us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:42.763381 (+971350us) spinlock_profiling.cc:243] Waited 785 ms on lock 0x7b54000a5854. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:42.763571 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1805312768}
I20260709 13:12:42.823323 30382 raft_consensus.cc:740] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:42.838222 30216 raft_consensus.cc:2804] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:12:42.837531 30129 raft_consensus.cc:493] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:42.912618 25296 raft_consensus.cc:1240] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:42.850142 25902 raft_consensus.cc:2468] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 15.
I20260709 13:12:42.871145 25270 leader_election.cc:304] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:42.858146 30271 consensus_queue.cc:1048] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:12:42.879761 30397 leader_election.cc:290] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:42.886381 30422 raft_consensus.cc:2804] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:42.858891 30354 raft_consensus.cc:3060] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:42.893136 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:42.955909 25228 raft_consensus.cc:2468] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 12.
I20260709 13:12:42.856596 30396 raft_consensus.cc:493] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:42.893693 25224 raft_consensus.cc:1240] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 16. Current term is 17. Ops: []
I20260709 13:12:42.893596 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:42.894496 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:42.975554 25226 raft_consensus.cc:2393] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 15: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:42.891535 30175 raft_consensus.cc:493] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:42.895449 25900 raft_consensus.cc:1240] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 13. Current term is 14. Ops: []
W20260709 13:12:42.944108 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.904954 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:42.897779 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:42.979924 25302 raft_consensus.cc:2468] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 14.
I20260709 13:12:42.980531 25303 raft_consensus.cc:2393] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 13: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:42.981132 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:42.939487 29832 leader_election.cc:290] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:42.874202 25905 raft_consensus.cc:2468] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 15.
I20260709 13:12:42.942421 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:42.984670 25230 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 9.
I20260709 13:12:42.914932 25298 raft_consensus.cc:1240] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 14 LEADER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:42.878038 30200 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
W20260709 13:12:42.898571 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 101246us
I20260709 13:12:42.902383 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:42.914080 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:42.901691 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:42.876642 30264 raft_consensus.cc:3060] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:42.893858 30185 raft_consensus.cc:2804] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:12:42.957429 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 86409.7us
W20260709 13:12:42.962252 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.962659 30326 consensus_queue.cc:1059] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:42.894542 30339 raft_consensus.cc:515] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:43.002878 30185 raft_consensus.cc:697] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:42.891638 30204 raft_consensus.cc:697] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 14 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:43.004093 30204 consensus_queue.cc:237] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:43.004735 30339 leader_election.cc:290] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:42.873625 30378 consensus_queue.cc:1059] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.075s
I20260709 13:12:43.006145 30326 raft_consensus.cc:3055] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:43.006559 30198 leader_election.cc:290] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361)
I20260709 13:12:42.869942 25300 raft_consensus.cc:2368] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 12. Current term is 13.
I20260709 13:12:42.980140 30397 raft_consensus.cc:493] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:43.000015 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:43.008476 25905 raft_consensus.cc:3060] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:42.975457 30420 raft_consensus.cc:2804] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:42.901433 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:42.982597 25194 leader_election.cc:304] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:12:42.952207 30129 raft_consensus.cc:3060] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:42.981901 25302 raft_consensus.cc:2468] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 14.
I20260709 13:12:42.965158 30392 raft_consensus.cc:515] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:42.998299 30200 raft_consensus.cc:3060] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:42.999853 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:43.018939 25303 raft_consensus.cc:3060] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:43.001833 30206 consensus_queue.cc:237] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:43.002308 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:43.002684 25271 leader_election.cc:304] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:42.950625 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:42.894860 30277 raft_consensus.cc:697] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:42.976102 30396 raft_consensus.cc:3060] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:43.010218 25873 leader_election.cc:304] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:43.010761 25301 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 9.
I20260709 13:12:43.009581 25304 raft_consensus.cc:2468] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 15.
I20260709 13:12:43.011431 25297 raft_consensus.cc:2393] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 8: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:43.014762 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:43.029606 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:42.974143 30216 raft_consensus.cc:697] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 16 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:42.955495 30422 raft_consensus.cc:493] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:43.020565 25230 raft_consensus.cc:3060] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:43.017859 25373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36254 (request call id 2499) took 1009 ms. Trace:
I20260709 13:12:43.022677 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:43.027102 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:43.030517 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:43.030555 25302 raft_consensus.cc:2393] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 13: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:43.037721 25373 rpcz_store.cc:276] 0709 13:12:42.008927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:42.029151 (+ 20224us) service_pool.cc:224] Handling call
0709 13:12:42.059316 (+ 30165us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:42.108879 (+ 49563us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:42.108912 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:42.108961 (+    49us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:42.108999 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:43.017590 (+908591us) spinlock_profiling.cc:243] Waited 49.3 ms on lock 0x7b540033f254. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:43.017648 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:43.017799 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":113454336}
I20260709 13:12:43.035706 25194 leader_election.cc:304] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:42.939105 30382 consensus_queue.cc:260] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:43.044281 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:42.983922 30386 raft_consensus.cc:493] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:43.050118 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:43.045802 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:43.006573 30326 raft_consensus.cc:740] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:43.015452 30420 raft_consensus.cc:493] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:43.051448 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:43.042131 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:43.054126 25304 raft_consensus.cc:2468] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 16.
I20260709 13:12:43.055397 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:43.055588 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:43.056454 25298 raft_consensus.cc:3060] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:43.048512 25303 raft_consensus.cc:2468] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 15.
I20260709 13:12:43.040761 25194 leader_election.cc:304] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:43.021502 30283 raft_consensus.cc:2764] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:12:43.033138 30181 raft_consensus.cc:3055] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:43.060503 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:43.061566 25297 raft_consensus.cc:2393] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 10: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:43.060027 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:43.061880 25194 leader_election.cc:304] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:43.031942 30157 raft_consensus.cc:493] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.983995 30175 raft_consensus.cc:515] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:43.099637 30157 raft_consensus.cc:515] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:43.101130 30175 leader_election.cc:290] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:43.064409 30271 consensus_queue.cc:1059] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:12:43.049604 30272 raft_consensus.cc:2804] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:43.104482 30272 raft_consensus.cc:493] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:43.105037 30272 raft_consensus.cc:3060] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:43.064025 25303 raft_consensus.cc:1275] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:12:43.075042 25230 raft_consensus.cc:2410] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:12:43.084944 30277 consensus_queue.cc:237] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:43.038982 30287 raft_consensus.cc:2749] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:43.200750 25302 raft_consensus.cc:1275] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:12:43.040724 30433 raft_consensus.cc:2749] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:12:43.039196 30378 raft_consensus.cc:493] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.006875 30185 consensus_queue.cc:237] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:43.039974 30422 raft_consensus.cc:3060] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:43.090215 30326 consensus_queue.cc:260] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:43.059217 30420 raft_consensus.cc:3060] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:43.063836 30181 raft_consensus.cc:740] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:43.093045 30283 raft_consensus.cc:2804] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:43.008401 30397 raft_consensus.cc:515] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:43.098562 30171 raft_consensus.cc:2804] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:43.122000 25905 raft_consensus.cc:2468] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 13.
I20260709 13:12:43.117233 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:43.159970 25298 raft_consensus.cc:2468] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 15.
I20260709 13:12:43.248473 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:43.177584 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:43.250733 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:43.249744 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:43.251984 25298 raft_consensus.cc:3060] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:43.088836 30393 leader_election.cc:290] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:43.222311 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:43.234624 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:43.178535 25296 raft_consensus.cc:2468] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 17.
I20260709 13:12:43.223016 30339 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.223709 30198 raft_consensus.cc:493] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.061223 30386 raft_consensus.cc:515] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:43.238690 30433 raft_consensus.cc:493] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:43.084998 30387 leader_election.cc:290] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 14 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:43.231750 30384 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:43.282868 30181 consensus_queue.cc:260] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:43.261246 30339 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:43.284442 30428 log.cc:927] Time spent T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:12:43.249884 30171 raft_consensus.cc:493] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:43.285298 30171 raft_consensus.cc:3060] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:43.285420 30339 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:43.262962 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:43.287345 25221 raft_consensus.cc:3060] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:43.259842 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:43.251825 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:43.288945 25905 raft_consensus.cc:3060] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:43.263851 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 202135us
I20260709 13:12:43.249166 30326 raft_consensus.cc:3060] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:43.267782 30386 leader_election.cc:290] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:43.268579 30425 log.cc:927] Time spent T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.194s	user 0.000s	sys 0.000s
I20260709 13:12:43.282161 30157 leader_election.cc:290] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:43.302526 25905 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 10.
I20260709 13:12:43.233089 30378 raft_consensus.cc:515] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:43.333061 25298 raft_consensus.cc:2468] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 14.
W20260709 13:12:43.355130 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 56024.5us
I20260709 13:12:43.245196 30216 consensus_queue.cc:237] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:43.366304 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:43.366992 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:43.375695 25228 raft_consensus.cc:2393] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 15: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:43.369453 25221 raft_consensus.cc:2468] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 13.
I20260709 13:12:43.262295 30198 raft_consensus.cc:515] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:43.376689 25304 raft_consensus.cc:2468] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 12.
W20260709 13:12:43.378125 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 344595us
I20260709 13:12:43.378696 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:43.379575 25222 raft_consensus.cc:3060] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:43.379621 25873 leader_election.cc:304] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:43.286437 30433 raft_consensus.cc:515] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:43.383379 30433 leader_election.cc:290] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:43.388321 30354 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:43.389644 30392 leader_election.cc:290] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 17 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:43.391561 30420 raft_consensus.cc:515] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:43.393234 30198 leader_election.cc:290] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:43.385556 30422 raft_consensus.cc:515] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:43.396627 30422 leader_election.cc:290] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:43.398154 30272 raft_consensus.cc:515] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:43.400537 30272 leader_election.cc:290] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:43.393652 30420 leader_election.cc:290] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:43.354529 30396 raft_consensus.cc:515] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:43.404104 30396 leader_election.cc:290] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 16 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:43.359673 30436 consensus_queue.cc:1048] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.080s
I20260709 13:12:43.408531 25227 raft_consensus.cc:1275] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:12:43.408344 30200 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:43.413604 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.379587 30157 consensus_queue.cc:1048] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:12:43.378867 25225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58418 (request call id 2344) took 1259 ms. Trace:
I20260709 13:12:43.418998 30378 leader_election.cc:290] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:43.418861 25225 rpcz_store.cc:276] 0709 13:12:42.119255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:42.119381 (+   126us) service_pool.cc:224] Handling call
0709 13:12:42.119727 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:42.127948 (+  8221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:42.127980 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:42.631401 (+503421us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b2c000014c8. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72e568a11 00007fd72e578372 00007fd72fcaaa01 00007fd72fc6f43a 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2
0709 13:12:42.631949 (+   548us) log.cc:844] Serialized 26 byte log entry
0709 13:12:42.784502 (+152553us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:42.784546 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:42.784616 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:43.374232 (+589616us) raft_consensus.cc:1685] finished
0709 13:12:43.374251 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:43.378801 (+  4550us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7853,"raft.queue_time_us":25321,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":45316,"spinlock_wait_cycles":23724800,"thread_start_us":152129,"threads_started":1,"wal-append.queue_time_us":383945}
I20260709 13:12:43.421211 30129 raft_consensus.cc:515] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:43.422060 25228 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211"
dest_uuid: "1f539ba21487460085b837e7529a78ce"
 from {username='slave'} at 127.0.0.1:58422
I20260709 13:12:43.422603 25228 raft_consensus.cc:493] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:43.422968 25228 raft_consensus.cc:3060] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:43.423251 30354 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:43.423779 30129 leader_election.cc:290] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:43.425072 25227 raft_consensus.cc:1240] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 14. Current term is 15. Ops: []
W20260709 13:12:43.428103 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 48573.6us
I20260709 13:12:43.428498 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:43.429278 25221 raft_consensus.cc:2393] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 14: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
W20260709 13:12:43.356411 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 461226us
W20260709 13:12:43.431914 30404 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.918s	user 0.024s	sys 0.032s
W20260709 13:12:43.432333 30404 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.919s	user 0.024s	sys 0.032s
I20260709 13:12:43.432665 30404 raft_consensus.cc:697] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 15 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:43.434799 25302 raft_consensus.cc:2468] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 13.
W20260709 13:12:43.435998 25871 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.442111 25874 leader_election.cc:304] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:12:43.456033 30175 raft_consensus.cc:493] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.457280 30175 raft_consensus.cc:515] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:43.459472 30435 raft_consensus.cc:2804] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:12:43.460330 30435 raft_consensus.cc:697] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 19 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:43.461520 30435 consensus_queue.cc:237] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:43.464742 30171 raft_consensus.cc:515] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:43.464952 30404 consensus_queue.cc:237] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:43.438220 30433 raft_consensus.cc:2804] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:43.466675 30433 raft_consensus.cc:697] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:43.467641 30433 consensus_queue.cc:237] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:43.483886 30171 leader_election.cc:290] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 16 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:43.488377 25229 raft_consensus.cc:2410] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 5.
I20260709 13:12:43.505455 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:43.506306 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:43.506392 25872 leader_election.cc:304] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:43.436014 25228 raft_consensus.cc:515] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:43.506629 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:43.575304 30326 raft_consensus.cc:493] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:43.583848 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:43.602029 25902 raft_consensus.cc:3060] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:43.602360 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:43.603422 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:12:43.593209 25195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.532380 30283 raft_consensus.cc:697] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 15 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
W20260709 13:12:43.517724 25270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.610332 25302 raft_consensus.cc:1275] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:12:43.598826 25899 raft_consensus.cc:2393] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 13: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:12:43.599617 30185 raft_consensus.cc:2804] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:43.584117 25222 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 10.
W20260709 13:12:43.599972 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 93645.8us
I20260709 13:12:43.600107 30312 raft_consensus.cc:3055] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:12:43.591650 25874 leader_election.cc:304] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:43.611217 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:43.611368 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:43.614634 25872 leader_election.cc:304] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:43.616637 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:43.617170 25302 raft_consensus.cc:3055] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:43.617465 25302 raft_consensus.cc:740] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:43.611788 30200 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 15 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:43.613263 25228 leader_election.cc:290] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:43.621872 30396 raft_consensus.cc:2804] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:43.624636 25195 leader_election.cc:304] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:43.626559 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:43.629112 25222 raft_consensus.cc:1275] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:12:43.632308 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:43.615768 30312 raft_consensus.cc:740] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:43.636744 30312 consensus_queue.cc:260] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:43.638024 30312 raft_consensus.cc:3060] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:43.642730 30283 consensus_queue.cc:237] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:43.644569 25270 leader_election.cc:304] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:43.646122 30178 raft_consensus.cc:2804] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:43.646648 30178 raft_consensus.cc:697] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 13 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:43.646929 30396 raft_consensus.cc:697] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:43.647512 30178 consensus_queue.cc:237] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:43.648237 30396 consensus_queue.cc:237] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:43.635242 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:43.654260 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:43.600994 30326 raft_consensus.cc:515] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:43.655342 25195 leader_election.cc:304] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:12:43.652165 30440 consensus_queue.cc:1048] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 13:12:43.645658 30439 raft_consensus.cc:2749] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:43.630191 25302 consensus_queue.cc:260] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:43.662914 25302 raft_consensus.cc:3060] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:43.664767 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:43.660265 25301 raft_consensus.cc:2393] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 16: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:43.660840 30387 raft_consensus.cc:493] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:43.629884 30185 raft_consensus.cc:697] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:43.666884 30387 raft_consensus.cc:515] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:43.661003 30157 raft_consensus.cc:2804] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:43.662319 30382 raft_consensus.cc:3060] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:43.665470 25297 raft_consensus.cc:2468] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 13.
W20260709 13:12:43.668737 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 922060us
I20260709 13:12:43.671175 25195 leader_election.cc:304] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:12:43.678220 30141 consensus_queue.cc:1059] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:12:43.683530 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:43.670859 25300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46556 (request call id 747) took 1135 ms. Trace:
I20260709 13:12:43.686651 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:43.686869 25300 rpcz_store.cc:276] 0709 13:12:42.535691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:42.536404 (+   713us) service_pool.cc:224] Handling call
0709 13:12:43.670685 (+1134281us) spinlock_profiling.cc:243] Waited 325 ms on lock 0x7b540018e2d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:43.670807 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":746855680}
W20260709 13:12:43.672173 25128 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40034 (request call id 263) took 18679 ms (client timeout 15000 ms). Trace:
I20260709 13:12:43.687345 25223 raft_consensus.cc:2468] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 13.
I20260709 13:12:43.672102 30157 raft_consensus.cc:493] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:43.634717 30171 raft_consensus.cc:493] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:43.730641 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
W20260709 13:12:43.719519 25345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.709295 25302 raft_consensus.cc:2468] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 8.
I20260709 13:12:43.738313 25904 raft_consensus.cc:1275] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:12:43.740432 25300 raft_consensus.cc:1240] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:12:43.684926 30436 raft_consensus.cc:2804] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:12:43.747922 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.667774 30185 consensus_queue.cc:237] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:43.685464 30141 raft_consensus.cc:3055] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:43.753153 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:43.757963 25908 raft_consensus.cc:2393] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 13: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:43.735330 30272 raft_consensus.cc:493] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.722892 30340 raft_consensus.cc:493] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.724581 30157 raft_consensus.cc:3060] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:43.770162 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:43.786314 25902 raft_consensus.cc:2468] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 13.
I20260709 13:12:43.788334 25270 leader_election.cc:304] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:43.789659 30206 raft_consensus.cc:2804] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:43.790308 30206 raft_consensus.cc:697] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 13 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:43.753373 30436 raft_consensus.cc:493] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:43.760114 30141 raft_consensus.cc:740] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:43.739821 30171 raft_consensus.cc:515] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:43.769397 30354 raft_consensus.cc:493] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.797502 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:43.771674 30277 raft_consensus.cc:493] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:43.794951 30436 raft_consensus.cc:3060] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:43.804343 30206 consensus_queue.cc:237] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:43.804932 30334 raft_consensus.cc:493] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.772943 30340 raft_consensus.cc:515] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:43.805785 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 70799.5us
W20260709 13:12:43.839193 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 105901us
W20260709 13:12:43.808624 30426 log.cc:927] Time spent T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.759s	user 0.004s	sys 0.000s
I20260709 13:12:43.809295 30392 raft_consensus.cc:493] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.810272 25901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50058 (request call id 948) took 1248 ms. Trace:
I20260709 13:12:43.839376 30334 raft_consensus.cc:515] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:43.841159 30392 raft_consensus.cc:515] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:43.843384 30392 leader_election.cc:290] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:43.810854 25903 raft_consensus.cc:1240] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:43.812006 30181 raft_consensus.cc:3060] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:12:43.815789 30446 log.cc:927] Time spent T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.203s	user 0.001s	sys 0.001s
I20260709 13:12:43.821156 30141 consensus_queue.cc:260] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:43.849299 30141 raft_consensus.cc:3060] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:43.850338 30397 leader_election.cc:290] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:43.822327 30387 leader_election.cc:290] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:43.853550 30340 leader_election.cc:290] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:43.770326 30272 raft_consensus.cc:515] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:43.854599 25345 leader_election.cc:304] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:43.824746 30171 leader_election.cc:290] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:43.858110 30272 leader_election.cc:290] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:43.791839 30301 consensus_queue.cc:1059] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:12:43.826464 30326 leader_election.cc:290] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:43.841220 25901 rpcz_store.cc:276] 0709 13:12:42.562087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:42.563007 (+   920us) service_pool.cc:224] Handling call
0709 13:12:43.810071 (+1247064us) spinlock_profiling.cc:243] Waited 56.2 ms on lock 0x7b540066f154. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:43.810208 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":129329408}
I20260709 13:12:43.810475 25371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36254 (request call id 2495) took 1825 ms. Trace:
I20260709 13:12:43.803094 30277 raft_consensus.cc:515] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:43.859040 25371 rpcz_store.cc:276] 0709 13:12:41.985313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.986328 (+  1015us) service_pool.cc:224] Handling call
0709 13:12:41.986692 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:41.986951 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:12:42.128111 (+141160us) log.cc:844] Serialized 14 byte log entry
0709 13:12:42.768643 (+640532us) spinlock_profiling.cc:243] Waited 5.12 ms on lock 0x7b18003faa80. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72f8174bc 00007fd72cb6548b 00007fd7359bfab9 00007fd72cb8169b 00007fd72cb7f93f 00007fd72cb81c02 00007fd72f80920b 00007fd72f80ed23 00007fd72f80f23a
0709 13:12:43.789361 (+1020718us) log.cc:844] Serialized 14 byte log entry
0709 13:12:43.810108 (+ 20747us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:43.810160 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:43.810205 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:43.810274 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:43.810388 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":956688,"prepare.queue_time_us":308067,"prepare.run_cpu_time_us":102,"prepare.run_wall_time_us":3128,"raft.queue_time_us":1010900,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":7151,"spinlock_wait_cycles":11775360,"thread_start_us":327352,"threads_started":5,"wal-append.queue_time_us":294055,"wal-append.run_cpu_time_us":1117,"wal-append.run_wall_time_us":1041036}
I20260709 13:12:43.861222 30277 leader_election.cc:290] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:43.862470 25900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50056 (request call id 880) took 1076 ms. Trace:
I20260709 13:12:43.795621 30437 raft_consensus.cc:2764] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
W20260709 13:12:43.848407 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 887355us
I20260709 13:12:43.856370 25345 leader_election.cc:304] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:43.857209 25874 leader_election.cc:304] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:12:43.862831 25900 rpcz_store.cc:276] 0709 13:12:42.785905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:42.786016 (+   111us) service_pool.cc:224] Handling call
0709 13:12:42.833477 (+ 47461us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:42.978725 (+145248us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:43.862265 (+883540us) spinlock_profiling.cc:243] Waited 61.8 ms on lock 0x7b5400511dd4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:43.862416 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":142097664}
I20260709 13:12:43.801420 30354 raft_consensus.cc:515] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:43.867630 30301 raft_consensus.cc:3055] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:43.872145 30301 raft_consensus.cc:740] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:43.843402 30334 leader_election.cc:290] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:43.867411 30354 leader_election.cc:290] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:43.873027 30301 consensus_queue.cc:260] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:43.874312 30342 raft_consensus.cc:3055] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:12:43.874457 30301 raft_consensus.cc:3060] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:43.874738 30342 raft_consensus.cc:740] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:43.853303 30436 raft_consensus.cc:515] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:43.878748 30418 log.cc:927] Time spent T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 1.209s	user 0.016s	sys 0.009s
I20260709 13:12:43.875674 30342 consensus_queue.cc:260] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:43.879828 30435 raft_consensus.cc:2804] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:43.876399 30465 raft_consensus.cc:2804] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:43.893633 30465 raft_consensus.cc:493] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:43.897289 30465 raft_consensus.cc:3060] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:12:43.688382 25128 rpcz_store.cc:269] 0709 13:12:24.992260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:25.009572 (+ 17312us) service_pool.cc:224] Handling call
0709 13:12:43.672073 (+18662501us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:37.370883 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:37.371592 (+   709us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:37.371644 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:12:37.371680 (+    36us) tablet.cc:662] Decoding operations
0709 13:12:37.382198 (+ 10518us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:37.382308 (+   110us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:37.382335 (+    27us) tablet.cc:685] Acquiring locks for 27 operations
0709 13:12:37.391998 (+  9663us) tablet.cc:701] Row locks acquired
0709 13:12:37.392087 (+    89us) write_op.cc:260] PREPARE: finished
0709 13:12:37.392273 (+   186us) write_op.cc:270] Start()
0709 13:12:37.392421 (+   148us) write_op.cc:276] Timestamp: P: 1783602757392212 usec, L: 0
0709 13:12:37.396693 (+  4272us) op_driver.cc:348] REPLICATION: starting
0709 13:12:37.602773 (+206080us) log.cc:844] Serialized 10702 byte log entry
0709 13:12:38.512669 (+909896us) op_driver.cc:464] REPLICATION: finished
0709 13:12:38.707339 (+194670us) write_op.cc:301] APPLY: starting
0709 13:12:38.712954 (+  5615us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:39.082173 (+369219us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:39.123803 (+ 41630us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:40.204580 (+1080777us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:40.205023 (+   443us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=54,key_file_lookups=54,delta_file_lookups=54,mrs_lookups=0
0709 13:12:40.205106 (+    83us) write_op.cc:312] APPLY: finished
0709 13:12:40.205687 (+   581us) log.cc:844] Serialized 236 byte log entry
0709 13:12:40.309256 (+103569us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:40.342878 (+ 33622us) write_op.cc:454] Released schema lock
0709 13:12:40.368438 (+ 25560us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:40.428000 (+ 59562us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:40.453635 (+ 25635us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":791,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":148114,"apply.run_cpu_time_us":56745,"apply.run_wall_time_us":1722143,"cfile_cache_hit":106,"cfile_cache_hit_bytes":110823,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6218,"cfile_init":2,"lbm_read_time_us":54518,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":11,"num_ops":27,"prepare.queue_time_us":119476,"prepare.run_cpu_time_us":70487,"prepare.run_wall_time_us":635618,"raft.queue_time_us":155903,"raft.run_cpu_time_us":4846,"raft.run_wall_time_us":81465,"replication_time_us":1115770,"thread_start_us":628689,"threads_started":5,"wal-append.queue_time_us":657323,"wal-append.run_cpu_time_us":22201,"wal-append.run_wall_time_us":2355761}]]}
W20260709 13:12:43.931493 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.939478 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:43.933252 25299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46556 (request call id 746) took 1399 ms. Trace:
I20260709 13:12:43.942130 25299 rpcz_store.cc:276] 0709 13:12:42.533499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:42.533696 (+   197us) service_pool.cc:224] Handling call
0709 13:12:42.534083 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:42.538425 (+  4342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:42.538468 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:42.542209 (+  3741us) log.cc:844] Serialized 26 byte log entry
0709 13:12:42.624505 (+ 82296us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:42.624568 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:42.624662 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:43.847267 (+1222605us) spinlock_profiling.cc:243] Waited 27.8 ms on lock 0x7b2400430b08. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72ca089c4 00007fd72ca06acb 00007fd72cbc1dc9 00007fd72cbc1a55 00007fd72cbc109d 00007fd72f7f310e 00007fd72f80a88c 00007fd72f809bb6 00007fd72f8097d8 00007fd72f813221
0709 13:12:43.932342 (+ 85075us) raft_consensus.cc:1685] finished
0709 13:12:43.932390 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:43.932948 (+   558us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3906,"raft.queue_time_us":4456,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":552,"spinlock_wait_cycles":64022784,"thread_start_us":75219,"threads_started":1,"wal-append.queue_time_us":109356}
W20260709 13:12:43.949787 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 93598.6us
I20260709 13:12:43.951470 25874 leader_election.cc:304] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:43.958365 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:43.861629 30157 raft_consensus.cc:515] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:43.962212 30157 leader_election.cc:290] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 16 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:43.962476 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:43.963122 30157 raft_consensus.cc:493] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:43.963642 25300 raft_consensus.cc:2393] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 10: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:43.964113 30157 raft_consensus.cc:515] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:43.964725 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:43.964979 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:43.965574 25300 raft_consensus.cc:2468] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 13.
I20260709 13:12:43.966179 25222 raft_consensus.cc:2393] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 10: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:43.966919 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:43.967267 30171 raft_consensus.cc:493] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:43.968648 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:43.968878 30175 leader_election.cc:290] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:43.970288 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:43.970922 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:43.973798 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:12:43.974565 25345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.976409 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:43.978610 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:43.980489 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:43.984928 30342 raft_consensus.cc:3060] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:43.999768 25299 raft_consensus.cc:3060] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:43.893448 30435 raft_consensus.cc:493] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:43.982581 25230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58422 (request call id 2516) took 1003 ms. Trace:
I20260709 13:12:44.002442 30435 raft_consensus.cc:3060] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:44.002348 25230 rpcz_store.cc:276] 0709 13:12:42.979111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:43.116916 (+137805us) service_pool.cc:224] Handling call
0709 13:12:43.982045 (+865129us) spinlock_profiling.cc:243] Waited 507 ms on lock 0x7b54002701d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:43.982329 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1165450496}
I20260709 13:12:43.971175 25270 leader_election.cc:304] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:44.005260 30198 raft_consensus.cc:2804] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:44.005733 30198 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:44.006347 30198 raft_consensus.cc:3060] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:43.991608 30310 raft_consensus.cc:493] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:44.005576 25300 raft_consensus.cc:2393] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 15: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
W20260709 13:12:44.007302 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 69678.6us
I20260709 13:12:44.014055 30310 raft_consensus.cc:515] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:44.016157 30272 raft_consensus.cc:493] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.017251 30272 raft_consensus.cc:515] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:44.020249 30272 leader_election.cc:290] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:44.017200 30310 leader_election.cc:290] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:44.020699 30171 raft_consensus.cc:515] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:44.032665 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:44.032828 30387 raft_consensus.cc:2749] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:12:44.033492 25908 raft_consensus.cc:3060] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:43.966919 30157 leader_election.cc:290] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:44.044152 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:44.046036 30324 raft_consensus.cc:2804] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:12:44.046845 30324 raft_consensus.cc:697] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 17 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:44.059660 30338 raft_consensus.cc:493] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.060586 30338 raft_consensus.cc:515] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:44.070781 25305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57256 (request call id 2360) took 1131 ms. Trace:
I20260709 13:12:44.071581 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:44.070621 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:44.073390 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:44.071241 25305 rpcz_store.cc:276] 0709 13:12:42.939413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:43.022407 (+ 82994us) service_pool.cc:224] Handling call
0709 13:12:44.050030 (+1027623us) spinlock_profiling.cc:243] Waited 518 ms on lock 0x7b54001699d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:44.070571 (+ 20541us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1192489856}
I20260709 13:12:44.075259 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:44.073055 25901 raft_consensus.cc:3060] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:44.078696 25900 raft_consensus.cc:2393] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 10: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:44.079404 30392 raft_consensus.cc:493] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.080582 30392 raft_consensus.cc:515] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:44.083400 25226 raft_consensus.cc:2410] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:12:44.084688 30354 raft_consensus.cc:493] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.085470 30354 raft_consensus.cc:515] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:44.086069 30396 raft_consensus.cc:493] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:44.087093 30396 raft_consensus.cc:515] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:44.088356 30354 leader_election.cc:290] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:12:44.090605 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.091203 30171 leader_election.cc:290] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:44.092325 30171 raft_consensus.cc:493] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.882704 30463 consensus_queue.cc:1048] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.178s
I20260709 13:12:44.076655 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:44.093204 30171 raft_consensus.cc:515] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:44.116503 25195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.108052 25901 raft_consensus.cc:2468] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 9.
I20260709 13:12:44.116488 25298 raft_consensus.cc:2468] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 16.
I20260709 13:12:44.112967 25903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50056 (request call id 884) took 1325 ms. Trace:
I20260709 13:12:44.122249 25903 rpcz_store.cc:276] 0709 13:12:42.786933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:42.868855 (+ 81922us) service_pool.cc:224] Handling call
0709 13:12:43.810582 (+941727us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:43.844304 (+ 33722us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:44.112506 (+268202us) spinlock_profiling.cc:243] Waited 941 ms on lock 0x7b540066f150. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6e8ad 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:44.112758 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2164983552}
I20260709 13:12:44.116358 25303 raft_consensus.cc:1275] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:12:44.056941 30324 consensus_queue.cc:237] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:44.128188 25222 raft_consensus.cc:2468] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 13.
I20260709 13:12:44.111770 30338 leader_election.cc:290] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:44.139529 25226 raft_consensus.cc:1275] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:12:44.115751 30392 leader_election.cc:290] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:44.145223 30396 leader_election.cc:290] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:44.142100 30310 raft_consensus.cc:493] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:44.127249 30198 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:44.148025 30436 leader_election.cc:290] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 16 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:44.149794 30338 raft_consensus.cc:493] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:44.160136 30157 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.170809 30424 raft_consensus.cc:493] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.171041 25908 raft_consensus.cc:2468] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 17.
I20260709 13:12:44.171686 30157 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:44.171860 30424 raft_consensus.cc:515] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:44.174279 30424 leader_election.cc:290] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:44.174088 30338 raft_consensus.cc:515] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:44.176136 30338 leader_election.cc:290] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:44.160415 30354 raft_consensus.cc:493] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:44.181543 30129 raft_consensus.cc:493] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.182813 30129 raft_consensus.cc:515] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:44.187894 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:44.190080 25303 raft_consensus.cc:3055] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:44.190519 25303 raft_consensus.cc:740] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:44.191897 25872 leader_election.cc:400] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 12 election: Vote denied by peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127) with higher term. Message: Invalid argument: T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 12. Current term is 13.
I20260709 13:12:44.192461 25872 leader_election.cc:403] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:12:44.191606 25303 consensus_queue.cc:260] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:44.193794 30463 raft_consensus.cc:2749] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127) with higher term. Message: Invalid argument: T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 12. Current term is 13.
I20260709 13:12:44.194192 30338 raft_consensus.cc:493] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:44.195315 30338 raft_consensus.cc:515] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:44.198413 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:44.199107 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:44.198504 30338 leader_election.cc:290] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:44.198392 30129 leader_election.cc:290] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:44.205482 30338 raft_consensus.cc:493] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:44.208526 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:44.209600 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:44.210573 25373 raft_consensus.cc:2393] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 10: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:44.210417 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:44.211227 25343 leader_election.cc:304] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:44.211424 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:44.211915 25372 raft_consensus.cc:2468] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 12.
I20260709 13:12:44.212455 30424 raft_consensus.cc:2749] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:44.212563 30354 raft_consensus.cc:515] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:44.212414 25374 raft_consensus.cc:2410] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:12:44.213853 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:44.214171 25377 raft_consensus.cc:1275] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:12:44.208527 25378 raft_consensus.cc:1275] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:12:44.215416 30354 leader_election.cc:290] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:44.216221 25376 raft_consensus.cc:1275] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:12:44.206761 25371 raft_consensus.cc:1240] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:44.212061 30338 raft_consensus.cc:515] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:44.219107 30198 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:44.170053 30310 raft_consensus.cc:515] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:44.222137 30338 leader_election.cc:290] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:44.222875 30310 leader_election.cc:290] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:44.223901 30157 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:44.224608 30171 leader_election.cc:290] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:44.226303 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:44.226392 30171 consensus_queue.cc:1048] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:44.227080 25195 leader_election.cc:304] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
W20260709 13:12:44.228971 30468 log.cc:927] Time spent T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.155s	user 0.000s	sys 0.003s
I20260709 13:12:44.227564 25222 raft_consensus.cc:2393] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 15: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:44.236712 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:44.238027 25371 raft_consensus.cc:2393] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 13: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:44.245239 25124 catalog_manager.cc:5697] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 9 to 11, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 11 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:12:44.253000 25344 leader_election.cc:304] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:44.264303 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:44.264595 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:44.265139 25228 raft_consensus.cc:3060] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:44.266621 25344 leader_election.cc:304] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:44.257005 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:44.269157 25303 raft_consensus.cc:3060] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:44.267961 25344 leader_election.cc:304] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:44.257004 25901 raft_consensus.cc:1275] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 18 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:12:44.259050 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:44.259815 25226 raft_consensus.cc:1240] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:44.261690 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:44.262960 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:44.271627 25223 raft_consensus.cc:2468] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 12.
I20260709 13:12:44.274024 30439 raft_consensus.cc:493] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:44.274791 30439 raft_consensus.cc:515] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:44.276017 25221 raft_consensus.cc:1275] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:12:44.276934 30171 raft_consensus.cc:2749] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:44.281301 25228 raft_consensus.cc:2468] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 13.
I20260709 13:12:44.278685 25222 raft_consensus.cc:2468] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 13.
I20260709 13:12:44.294497 25299 raft_consensus.cc:2468] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 17.
I20260709 13:12:44.298482 25905 raft_consensus.cc:1240] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 LEADER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:44.300194 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:44.289951 30354 raft_consensus.cc:2749] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:44.291982 30338 raft_consensus.cc:2804] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:44.303241 30338 raft_consensus.cc:697] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 9 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:44.295424 25229 raft_consensus.cc:2468] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 13.
I20260709 13:12:44.304572 25124 catalog_manager.cc:5697] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 6 to 10, leader changed from 79d99c0e498349bda74127365219e468 (127.23.140.67) to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 10 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
I20260709 13:12:44.304695 30338 consensus_queue.cc:237] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:44.311115 30435 raft_consensus.cc:515] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:44.312021 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:44.292352 30310 raft_consensus.cc:2749] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:44.319495 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:44.323043 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:44.324704 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:44.317591 30439 leader_election.cc:290] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:44.326025 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:44.328025 25902 raft_consensus.cc:1275] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 13:12:44.328437 25902 pending_rounds.cc:85] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6: Aborting all ops after (but not including) 10
I20260709 13:12:44.328682 25902 pending_rounds.cc:107] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 13:12:44.328936 25902 raft_consensus.cc:2889] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:44.333416 25907 raft_consensus.cc:1275] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:12:44.336373 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:44.336854 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:44.337694 25378 raft_consensus.cc:2368] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 16. Current term is 17.
I20260709 13:12:44.338201 25906 raft_consensus.cc:2393] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 15: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:12:44.336905 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:44.337730 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:44.341557 25194 leader_election.cc:304] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:44.342473 30435 leader_election.cc:290] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 14 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:12:44.343163 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 64058.5us
I20260709 13:12:44.343266 30439 raft_consensus.cc:2749] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:12:44.347505 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:44.348764 25908 raft_consensus.cc:2393] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 15: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:12:44.353866 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:44.356189 25371 raft_consensus.cc:1275] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:12:44.359292 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 148385us
W20260709 13:12:44.368271 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 46000.3us
W20260709 13:12:44.373224 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 146283us
I20260709 13:12:44.376529 25344 leader_election.cc:304] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:44.381588 30388 consensus_queue.cc:1048] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:12:44.385962 30171 raft_consensus.cc:493] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.386655 30171 raft_consensus.cc:515] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:44.391916 25371 raft_consensus.cc:1275] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:12:44.394398 25343 leader_election.cc:304] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:44.371690 30439 raft_consensus.cc:493] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.388808 30171 leader_election.cc:290] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:44.374154 25124 catalog_manager.cc:5697] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
W20260709 13:12:44.404775 30465 consensus_meta.cc:287] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.507s	user 0.009s	sys 0.004s
I20260709 13:12:44.405079 30436 raft_consensus.cc:493] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:44.407127 30324 raft_consensus.cc:2804] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:12:44.412253 30354 raft_consensus.cc:2749] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:44.431739 25194 leader_election.cc:304] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:44.412351 30171 raft_consensus.cc:493] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:44.440321 30416 consensus_queue.cc:1048] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:12:44.421105 30157 consensus_queue.cc:1059] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:12:44.439406 25195 leader_election.cc:304] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:44.432929 30324 raft_consensus.cc:697] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 17 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:44.446146 30326 raft_consensus.cc:3055] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:44.423094 30198 consensus_queue.cc:1048] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:12:44.451122 30326 raft_consensus.cc:740] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
W20260709 13:12:44.454766 25270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.423346 30465 raft_consensus.cc:515] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:44.447867 30157 raft_consensus.cc:2749] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:44.446273 30387 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.422485 30436 raft_consensus.cc:515] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:44.462831 25874 leader_election.cc:304] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:44.465444 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 94918.8us
I20260709 13:12:44.439092 30439 raft_consensus.cc:515] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:44.468828 25298 raft_consensus.cc:1275] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:12:44.464442 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:44.463502 25371 raft_consensus.cc:1275] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 19 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:12:44.468341 30157 raft_consensus.cc:2749] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:44.468781 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:44.460480 30334 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:44.475709 30476 log.cc:927] Time spent T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:12:44.441521 30272 consensus_queue.cc:1059] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:12:44.480468 25298 pending_rounds.cc:85] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19: Aborting all ops after (but not including) 12
I20260709 13:12:44.482126 25298 pending_rounds.cc:107] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260709 13:12:44.482415 25298 raft_consensus.cc:2889] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:44.484946 25302 raft_consensus.cc:3060] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:44.486706 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:44.476707 30181 raft_consensus.cc:493] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.493381 25906 raft_consensus.cc:1275] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:12:44.508025 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:44.509253 25371 raft_consensus.cc:2368] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 11. Current term is 12.
W20260709 13:12:44.516485 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.483737 30463 raft_consensus.cc:3060] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:12:44.520330 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 60645.8us
I20260709 13:12:44.521613 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:44.471505 30334 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:44.472483 30387 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:44.517012 25124 catalog_manager.cc:5697] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 9 to 10, leader changed from 79d99c0e498349bda74127365219e468 (127.23.140.67) to 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68). New cstate: current_term: 10 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:12:44.532516 25906 raft_consensus.cc:2468] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 16.
I20260709 13:12:44.476832 30171 raft_consensus.cc:515] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:44.526201 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:44.530613 25229 raft_consensus.cc:1275] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:12:44.476193 30435 consensus_queue.cc:1048] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:12:44.536758 30342 consensus_queue.cc:1048] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:12:44.537366 25901 raft_consensus.cc:1240] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:12:44.544564 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:44.514813 30181 raft_consensus.cc:515] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:44.544608 30465 leader_election.cc:290] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:44.582382 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:12:44.584662 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 114319us
I20260709 13:12:44.557945 30439 leader_election.cc:290] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:44.587843 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.547201 30324 consensus_queue.cc:237] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:44.592607 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
W20260709 13:12:44.595849 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 170650us
I20260709 13:12:44.540338 30326 consensus_queue.cc:260] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:44.617614 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 130010us
I20260709 13:12:44.606173 25124 catalog_manager.cc:5697] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:12:44.627372 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:44.627699 25378 raft_consensus.cc:1240] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:12:44.613931 30439 raft_consensus.cc:493] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.631304 25228 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 9.
W20260709 13:12:44.635715 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.638674 25222 raft_consensus.cc:1275] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:12:44.640086 30471 log.cc:927] Time spent T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.268s	user 0.004s	sys 0.000s
I20260709 13:12:44.642639 30334 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:44.671341 25298 raft_consensus.cc:1275] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:12:44.673127 25124 catalog_manager.cc:5697] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 6 to 10, leader changed from 79d99c0e498349bda74127365219e468 (127.23.140.67) to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 10 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
I20260709 13:12:44.677450 25124 catalog_manager.cc:5697] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 8 to 9, leader changed from 79d99c0e498349bda74127365219e468 (127.23.140.67) to 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68). New cstate: current_term: 9 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:12:44.686705 30181 leader_election.cc:290] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:44.687929 30171 leader_election.cc:290] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:44.701354 25377 raft_consensus.cc:2468] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 13.
I20260709 13:12:44.707796 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:44.708518 25377 raft_consensus.cc:2468] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 8.
I20260709 13:12:44.718209 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:44.718935 25903 raft_consensus.cc:2468] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 15.
I20260709 13:12:44.720492 25270 leader_election.cc:304] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:44.722218 30342 raft_consensus.cc:2804] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:44.722640 30342 raft_consensus.cc:493] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:44.710996 25124 catalog_manager.cc:5697] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 7 to 10, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68). New cstate: current_term: 10 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:12:44.724231 25124 catalog_manager.cc:5697] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:12:44.725396 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:44.725992 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:44.726553 25374 raft_consensus.cc:2468] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 12.
I20260709 13:12:44.726600 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:44.727277 25370 raft_consensus.cc:2468] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 12.
I20260709 13:12:44.727437 25379 raft_consensus.cc:1275] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 13:12:44.727945 25379 pending_rounds.cc:85] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468: Aborting all ops after (but not including) 9
I20260709 13:12:44.727319 25124 catalog_manager.cc:5697] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 9 to 12, leader changed from 79d99c0e498349bda74127365219e468 (127.23.140.67) to 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68). New cstate: current_term: 12 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:12:44.728786 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:44.730105 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:44.729475 25124 catalog_manager.cc:5697] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
I20260709 13:12:44.730665 25376 raft_consensus.cc:3060] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:44.731206 30181 raft_consensus.cc:493] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:44.731859 30181 raft_consensus.cc:515] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:44.735108 30181 leader_election.cc:290] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:44.735869 30436 leader_election.cc:290] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:44.736533 30436 raft_consensus.cc:493] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.736188 25124 catalog_manager.cc:5697] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
I20260709 13:12:44.737032 30436 raft_consensus.cc:515] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:44.730253 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:44.731288 25222 raft_consensus.cc:1275] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:12:44.728223 25379 pending_rounds.cc:107] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:12:44.740087 25379 raft_consensus.cc:2889] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:44.723029 30342 raft_consensus.cc:3060] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:44.740922 30457 consensus_queue.cc:1048] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:12:44.743276 25378 raft_consensus.cc:1240] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:44.743781 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:44.746066 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:44.746641 25228 raft_consensus.cc:1275] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:12:44.748852 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 146510us
I20260709 13:12:44.749707 25343 leader_election.cc:304] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:44.750644 30338 raft_consensus.cc:2749] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:12:44.754123 30387 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:44.755246 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:44.756076 25375 raft_consensus.cc:2468] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 8.
I20260709 13:12:44.774163 25302 raft_consensus.cc:2468] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 14.
I20260709 13:12:44.775946 25376 raft_consensus.cc:2468] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 15.
I20260709 13:12:44.699352 30171 raft_consensus.cc:493] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:44.738214 25194 leader_election.cc:304] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:44.709394 30157 raft_consensus.cc:3055] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:44.701403 30439 raft_consensus.cc:515] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:44.793632 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:44.794569 25228 raft_consensus.cc:1275] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:12:44.797609 25226 raft_consensus.cc:1275] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:12:44.798568 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 60433.1us
I20260709 13:12:44.792706 25124 catalog_manager.cc:5697] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 6 to 11, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 11 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:44.801440 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:44.804590 25377 raft_consensus.cc:2393] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 14: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:44.809654 30171 raft_consensus.cc:515] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:44.811362 30326 raft_consensus.cc:3060] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:44.811961 30171 leader_election.cc:290] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:44.816118 30392 raft_consensus.cc:493] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.819116 30479 raft_consensus.cc:2804] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:44.819753 30479 raft_consensus.cc:697] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 8 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:44.820961 30324 raft_consensus.cc:493] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:44.820811 30479 consensus_queue.cc:237] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:44.821856 30324 raft_consensus.cc:515] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:44.823565 30181 raft_consensus.cc:493] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.824087 30181 raft_consensus.cc:515] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:44.830024 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 19 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:44.831020 25379 raft_consensus.cc:1240] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 9 LEADER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:44.831753 25221 raft_consensus.cc:1275] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:12:44.787115 30157 raft_consensus.cc:740] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:44.833442 30157 consensus_queue.cc:260] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:44.834832 30157 raft_consensus.cc:3060] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:44.791231 30198 raft_consensus.cc:493] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:44.843900 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:44.844758 25221 raft_consensus.cc:3060] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:44.851656 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:44.855247 25194 leader_election.cc:304] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:44.857733 25194 leader_election.cc:304] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:44.858459 30491 raft_consensus.cc:2804] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:44.858495 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:44.887492 30491 raft_consensus.cc:493] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:44.887921 30491 raft_consensus.cc:3060] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:44.889128 25221 raft_consensus.cc:2468] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 14.
W20260709 13:12:44.859790 25271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:44.890470 25271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.864846 30198 raft_consensus.cc:515] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:44.864733 30392 raft_consensus.cc:515] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:44.867224 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:44.874581 30433 raft_consensus.cc:493] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.875629 30436 leader_election.cc:290] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:44.895818 25379 raft_consensus.cc:2468] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 15.
I20260709 13:12:44.876645 30416 raft_consensus.cc:493] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:44.861063 25124 catalog_manager.cc:5697] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 6 to 9, leader changed from 79d99c0e498349bda74127365219e468 (127.23.140.67) to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 9 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:44.878477 30324 leader_election.cc:290] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:44.879495 30181 leader_election.cc:290] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:44.880002 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:44.911182 25376 raft_consensus.cc:3060] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:44.880415 25223 raft_consensus.cc:1275] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 19 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:12:44.880316 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:44.881541 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:44.891955 25872 leader_election.cc:304] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:12:44.876325 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 85593.3us
W20260709 13:12:44.902876 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 45236.1us
W20260709 13:12:44.912813 25195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.915019 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:44.925112 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 19 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:44.925158 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:44.927085 25378 raft_consensus.cc:2393] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 16: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:44.933038 25379 raft_consensus.cc:2410] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:12:44.938570 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:44.907174 30171 raft_consensus.cc:2804] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:44.952673 25900 raft_consensus.cc:1240] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:44.906335 30435 consensus_queue.cc:1048] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:12:44.960736 25228 raft_consensus.cc:2410] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for term 19 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:12:44.957515 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:44.972961 25376 raft_consensus.cc:2468] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 8.
I20260709 13:12:44.983487 25124 catalog_manager.cc:5697] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:44.910426 30416 raft_consensus.cc:515] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:44.950650 30171 raft_consensus.cc:493] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:44.990923 25124 catalog_manager.cc:5697] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:44.993793 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:44.960268 30436 raft_consensus.cc:493] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:44.982203 30439 leader_election.cc:290] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:44.967047 30492 raft_consensus.cc:493] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:44.958701 30387 consensus_queue.cc:1048] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:12:44.928347 30433 raft_consensus.cc:515] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:44.996438 25195 leader_election.cc:336] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 1.680s (SENT)
I20260709 13:12:44.995560 25378 raft_consensus.cc:2468] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 12.
I20260709 13:12:44.990190 30277 raft_consensus.cc:2804] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:45.005985 25908 raft_consensus.cc:1275] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:12:45.001170 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:44.992830 30171 raft_consensus.cc:3060] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:45.004951 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:45.007714 25195 leader_election.cc:304] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:45.017359 25195 leader_election.cc:336] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 1.683s (SENT)
I20260709 13:12:45.020552 25195 leader_election.cc:304] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:12:44.992170 30342 raft_consensus.cc:515] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:45.028422 30492 raft_consensus.cc:515] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:45.050791 30479 consensus_queue.cc:1059] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:12:45.051818 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:45.052296 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:45.055428 30491 raft_consensus.cc:515] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:45.056361 30463 consensus_meta.cc:287] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent flushing consensus metadata: real 0.517s	user 0.011s	sys 0.000s
I20260709 13:12:45.056802 30463 raft_consensus.cc:2749] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:45.027474 30487 raft_consensus.cc:2749] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:45.033244 30439 raft_consensus.cc:2804] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:45.061870 30492 leader_election.cc:290] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:45.062218 30439 raft_consensus.cc:493] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:45.062646 30439 raft_consensus.cc:3060] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:45.064814 30416 leader_election.cc:290] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:45.065693 30491 leader_election.cc:290] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:45.066758 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:45.067411 25379 raft_consensus.cc:2468] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 13.
I20260709 13:12:45.068194 25903 raft_consensus.cc:1240] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:45.068751 30198 leader_election.cc:290] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:45.070806 30342 leader_election.cc:290] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:45.013299 30436 raft_consensus.cc:515] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:45.011410 30277 raft_consensus.cc:697] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:45.073237 30277 consensus_queue.cc:237] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:45.076707 30392 leader_election.cc:290] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:45.078329 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:45.109797 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:45.110460 25377 raft_consensus.cc:2468] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 12.
I20260709 13:12:45.112588 25377 raft_consensus.cc:1275] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:12:45.113615 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:12:45.114143 30484 log.cc:927] Time spent T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 13:12:45.115214 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:45.113540 25343 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:45.116788 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:12:45.116930 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 55225.7us
I20260709 13:12:45.117558 25343 leader_election.cc:304] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:45.118218 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:45.118924 25379 raft_consensus.cc:2393] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 14: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:45.119604 30334 consensus_queue.cc:1048] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:45.120360 30465 raft_consensus.cc:2749] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:45.120095 25343 leader_election.cc:304] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:45.120508 30392 raft_consensus.cc:2804] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:45.151546 30392 raft_consensus.cc:493] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:45.151928 30392 raft_consensus.cc:3060] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:45.154027 30465 raft_consensus.cc:2749] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:12:45.122676 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:45.155997 25377 raft_consensus.cc:2393] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 14: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:45.124432 25229 raft_consensus.cc:1240] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:45.124732 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:45.145008 25223 raft_consensus.cc:1240] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:45.158943 25229 raft_consensus.cc:1240] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:45.145426 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:45.160212 25221 raft_consensus.cc:2468] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 11.
I20260709 13:12:45.149420 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:45.161607 25224 raft_consensus.cc:2468] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 12.
I20260709 13:12:45.124624 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:45.163205 25376 raft_consensus.cc:2468] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 15.
I20260709 13:12:45.124967 25222 raft_consensus.cc:1275] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:12:45.127209 30433 leader_election.cc:290] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:45.169185 25221 raft_consensus.cc:1275] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 13:12:45.170683 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 215818us
I20260709 13:12:45.132081 30436 leader_election.cc:290] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:45.165441 25222 pending_rounds.cc:85] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce: Aborting all ops after (but not including) 10
I20260709 13:12:45.171485 25222 pending_rounds.cc:107] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:12:45.171316 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:45.171844 25222 raft_consensus.cc:2889] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:45.172149 25229 raft_consensus.cc:2468] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 12.
I20260709 13:12:45.172701 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:12:45.166919 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 46905.4us
I20260709 13:12:45.167826 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:45.174355 25224 raft_consensus.cc:2468] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 9.
I20260709 13:12:45.174517 30465 consensus_queue.cc:1048] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:45.175618 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:12:45.129500 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 77344.3us
I20260709 13:12:45.177464 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:45.178906 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:45.179677 25222 raft_consensus.cc:2468] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 11.
I20260709 13:12:45.180958 25874 leader_election.cc:304] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:45.170293 30171 raft_consensus.cc:515] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:45.182191 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:45.181805 30435 consensus_queue.cc:1048] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:12:45.183874 30435 raft_consensus.cc:2749] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:12:45.183970 30171 leader_election.cc:290] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 16 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:45.187850 30503 consensus_queue.cc:1059] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:12:45.189177 30388 raft_consensus.cc:3055] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:45.189563 30388 raft_consensus.cc:740] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:45.190245 30392 raft_consensus.cc:515] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:45.190459 30388 consensus_queue.cc:260] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:45.192147 30388 raft_consensus.cc:3060] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:45.196908 30392 leader_election.cc:290] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:45.197489 30433 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.208503 30433 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:45.210127 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:45.210765 25296 raft_consensus.cc:2468] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 17.
W20260709 13:12:45.211318 25193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:45.201740 30439 raft_consensus.cc:515] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:45.203605 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:45.203938 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:45.235726 25298 raft_consensus.cc:2468] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 13.
I20260709 13:12:45.205265 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:45.206773 25302 raft_consensus.cc:1275] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:12:45.207885 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:45.200726 30463 consensus_queue.cc:1048] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:12:45.208940 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:45.238903 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:45.214262 25873 leader_election.cc:304] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:45.239835 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:45.241338 25873 leader_election.cc:304] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:45.239678 25901 raft_consensus.cc:3060] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:45.223774 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:45.225191 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:45.214398 30487 raft_consensus.cc:3055] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:45.241976 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:45.244710 30487 raft_consensus.cc:740] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:45.244982 25224 raft_consensus.cc:2468] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 15.
I20260709 13:12:45.242321 25296 raft_consensus.cc:2468] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 10.
I20260709 13:12:45.245683 30487 consensus_queue.cc:260] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:45.247354 30487 raft_consensus.cc:3060] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:45.244104 30439 leader_election.cc:290] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 17 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:45.248117 30392 raft_consensus.cc:493] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.248704 30392 raft_consensus.cc:515] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:45.249841 30463 raft_consensus.cc:2749] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:45.251631 30392 leader_election.cc:290] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:45.252519 30504 raft_consensus.cc:493] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.253141 30504 raft_consensus.cc:515] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:45.254760 25908 raft_consensus.cc:1275] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:12:45.256225 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:45.256814 25908 raft_consensus.cc:2468] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 12.
W20260709 13:12:45.258692 25270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:45.263238 25901 raft_consensus.cc:2468] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 16.
I20260709 13:12:45.274614 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:45.275235 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:12:45.287161 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 45935.2us
I20260709 13:12:45.288120 25873 leader_election.cc:304] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:45.288175 30504 leader_election.cc:290] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:45.289929 25873 leader_election.cc:400] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 16 election: Vote denied by peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091) with higher term. Message: Invalid argument: T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 16. Current term is 17.
I20260709 13:12:45.290309 25873 leader_election.cc:403] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:12:45.291021 30488 raft_consensus.cc:2749] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:45.291801 30488 raft_consensus.cc:2749] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091) with higher term. Message: Invalid argument: T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 16. Current term is 17.
I20260709 13:12:45.293841 30488 consensus_queue.cc:1048] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:12:45.257076 30334 consensus_queue.cc:1048] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:12:45.313429 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:45.314137 25302 raft_consensus.cc:2468] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 13.
I20260709 13:12:45.296175 30387 raft_consensus.cc:2749] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:45.325220 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:45.329196 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:45.332278 25296 raft_consensus.cc:3060] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:45.332522 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:45.334666 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:45.336143 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:45.336436 25873 leader_election.cc:304] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:45.337095 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:45.337997 25228 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 10.
W20260709 13:12:45.339740 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 80108.6us
I20260709 13:12:45.299327 30488 consensus_queue.cc:1048] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:12:45.347222 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:45.349296 25302 raft_consensus.cc:2468] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 16.
I20260709 13:12:45.346484 30439 raft_consensus.cc:493] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.341032 30433 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:45.358871 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:45.360797 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:45.363793 30171 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.364300 30171 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:45.366379 25226 raft_consensus.cc:1275] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:12:45.366510 30171 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:45.366760 25226 pending_rounds.cc:85] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce: Aborting all ops after (but not including) 8
I20260709 13:12:45.367502 25226 pending_rounds.cc:107] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:12:45.367749 25226 raft_consensus.cc:2889] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:45.357612 25271 leader_election.cc:304] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:45.343281 30457 consensus_queue.cc:1048] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.014s
I20260709 13:12:45.350579 30387 raft_consensus.cc:2749] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:45.398908 25345 leader_election.cc:304] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:45.400300 30503 raft_consensus.cc:2749] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:45.389935 30439 raft_consensus.cc:515] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:12:45.403748 30439 leader_election.cc:290] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:12:45.406247 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 69881.7us
W20260709 13:12:45.453799 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 62028.1us
W20260709 13:12:45.454568 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 55860.7us
I20260709 13:12:45.459801 25379 raft_consensus.cc:1275] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:12:45.462257 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:12:45.460507 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 104390us
I20260709 13:12:45.463873 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:45.465133 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:45.465812 25373 raft_consensus.cc:2468] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 8.
I20260709 13:12:45.466513 30503 consensus_queue.cc:1048] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:45.474061 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:45.474869 25302 raft_consensus.cc:2468] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 11.
W20260709 13:12:45.486586 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 138027us
I20260709 13:12:45.456981 30338 raft_consensus.cc:493] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.490409 25373 raft_consensus.cc:1240] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:45.466946 30388 consensus_queue.cc:1048] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:12:45.498689 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:45.501595 25373 raft_consensus.cc:1275] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:12:45.502925 25302 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 10.
I20260709 13:12:45.507045 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:45.515775 30502 consensus_queue.cc:1048] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:12:45.516100 30499 raft_consensus.cc:493] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.516848 30499 raft_consensus.cc:515] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:45.519636 30499 leader_election.cc:290] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:45.520478 30516 raft_consensus.cc:2749] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:45.491623 30338 raft_consensus.cc:515] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:45.536988 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 59632.6us
I20260709 13:12:45.538666 25345 leader_election.cc:304] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:45.545938 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:45.521536 30516 consensus_queue.cc:1059] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:12:45.553799 25270 leader_election.cc:304] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:45.531677 30502 raft_consensus.cc:493] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:45.567417 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:45.571889 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
W20260709 13:12:45.581969 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 80560us
I20260709 13:12:45.546895 30439 consensus_queue.cc:1048] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:12:45.558785 30181 raft_consensus.cc:2804] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:12:45.589624 25872 leader_election.cc:304] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:45.558303 30416 raft_consensus.cc:493] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:45.599459 30338 leader_election.cc:290] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:45.578657 30465 consensus_queue.cc:1059] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:12:45.602182 30465 raft_consensus.cc:3055] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:12:45.602584 30465 raft_consensus.cc:740] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:45.603385 30465 consensus_queue.cc:260] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:45.604687 30465 raft_consensus.cc:3060] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:45.578403 30513 consensus_queue.cc:1059] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:12:45.606334 30513 raft_consensus.cc:3055] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:12:45.606686 30513 raft_consensus.cc:740] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:45.607609 30513 consensus_queue.cc:260] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:45.608810 30513 raft_consensus.cc:3060] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:12:45.589618 30509 log.cc:927] Time spent T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.182s	user 0.003s	sys 0.003s
I20260709 13:12:45.611759 25195 leader_election.cc:304] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:45.612685 30504 raft_consensus.cc:2804] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:45.613035 30504 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:45.613346 30504 raft_consensus.cc:3060] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:12:45.614456 30518 log.cc:927] Time spent T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:12:45.619007 25195 leader_election.cc:304] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:45.620052 30479 raft_consensus.cc:2749] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:45.621846 25195 leader_election.cc:304] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:45.630007 30515 raft_consensus.cc:2804] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:45.630638 30515 raft_consensus.cc:493] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:45.631070 30515 raft_consensus.cc:3060] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:45.633942 30392 raft_consensus.cc:2804] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:45.634495 30392 raft_consensus.cc:493] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:45.634966 30392 raft_consensus.cc:3060] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:12:45.637938 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 99380.2us
I20260709 13:12:45.638468 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:45.638686 25345 leader_election.cc:304] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:45.639086 25377 raft_consensus.cc:2468] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 12.
I20260709 13:12:45.643873 25296 raft_consensus.cc:2468] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 13.
I20260709 13:12:45.651124 25345 leader_election.cc:304] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
W20260709 13:12:45.651702 30519 log.cc:927] Time spent T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:12:45.652383 25345 leader_election.cc:304] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:45.654516 30324 raft_consensus.cc:2804] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:12:45.655130 30521 log.cc:927] Time spent T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:12:45.638136 30181 raft_consensus.cc:697] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 16 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:45.659497 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:45.658855 25271 leader_election.cc:304] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
W20260709 13:12:45.663058 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 68364us
I20260709 13:12:45.655128 30324 raft_consensus.cc:493] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:45.658169 30479 raft_consensus.cc:2749] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:12:45.667871 25345 leader_election.cc:304] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:45.566587 30502 raft_consensus.cc:515] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:45.672488 25195 leader_election.cc:304] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:45.701007 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:45.706310 25345 leader_election.cc:304] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:45.710098 30421 raft_consensus.cc:2749] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:12:45.711324 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 116830us
I20260709 13:12:45.712849 25271 leader_election.cc:304] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:45.670179 30324 raft_consensus.cc:3060] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:45.656841 30416 raft_consensus.cc:515] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:45.726212 25297 raft_consensus.cc:1275] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:12:45.727190 25344 leader_election.cc:304] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:45.728166 30421 raft_consensus.cc:2749] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:45.730232 30526 raft_consensus.cc:2804] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:45.730708 30526 raft_consensus.cc:493] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:45.731101 30526 raft_consensus.cc:3060] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:45.731887 30416 leader_election.cc:290] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:45.732375 25270 leader_election.cc:304] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:12:45.733534 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 61141.4us
I20260709 13:12:45.733426 25270 leader_election.cc:304] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:45.721122 30532 raft_consensus.cc:2804] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:45.725672 30516 raft_consensus.cc:2749] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:45.736622 30421 raft_consensus.cc:2804] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:45.725016 30503 consensus_queue.cc:1048] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:12:45.722018 30504 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:45.739074 30272 raft_consensus.cc:2749] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:45.740965 30502 leader_election.cc:290] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:45.740620 30532 raft_consensus.cc:493] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:45.776196 25345 leader_election.cc:304] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:45.745191 30421 raft_consensus.cc:493] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:45.783183 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:12:45.783339 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 52557.4us
I20260709 13:12:45.787614 25195 leader_election.cc:304] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:45.752579 30534 raft_consensus.cc:2804] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:45.792415 25195 leader_election.cc:304] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:45.795059 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 43734.8us
I20260709 13:12:45.795221 25195 leader_election.cc:304] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:45.733639 30181 consensus_queue.cc:237] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:45.797170 30522 consensus_queue.cc:1048] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.128s
I20260709 13:12:45.784699 30421 raft_consensus.cc:3060] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:45.786520 30532 raft_consensus.cc:3060] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:12:45.807983 25194 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.140.66:33127 timed out after 1.668s (SENT) [suppressed 21 similar messages]
I20260709 13:12:45.809916 25195 leader_election.cc:304] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:45.798940 25270 leader_election.cc:304] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:45.814062 25195 leader_election.cc:304] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:45.793988 30534 raft_consensus.cc:493] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:45.795405 30439 raft_consensus.cc:2804] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:45.805423 30528 raft_consensus.cc:2804] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:45.806705 30479 raft_consensus.cc:2749] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:12:45.819258 30534 raft_consensus.cc:3060] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:45.820779 25270 leader_election.cc:304] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:45.788523 30502 consensus_queue.cc:1059] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:12:45.823360 30403 raft_consensus.cc:2749] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:45.822459 30528 raft_consensus.cc:493] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:45.824254 30504 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 16 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:45.828317 30338 raft_consensus.cc:3055] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:45.815434 30487 raft_consensus.cc:2804] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:45.832592 30392 raft_consensus.cc:515] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:45.819067 30439 raft_consensus.cc:493] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:45.815505 30499 consensus_queue.cc:1048] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:12:45.834167 30479 consensus_queue.cc:1048] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:45.792914 30342 consensus_queue.cc:1048] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:12:45.817160 30171 raft_consensus.cc:2804] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:45.874862 30171 raft_consensus.cc:493] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:45.875331 30171 raft_consensus.cc:3060] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:45.818584 30272 raft_consensus.cc:2749] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:12:45.851750 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:45.849594 30528 raft_consensus.cc:3060] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:45.881862 30479 consensus_queue.cc:1243] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer 79d99c0e498349bda74127365219e468 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:12:45.883683 30516 raft_consensus.cc:493] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:45.884473 30516 raft_consensus.cc:515] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:45.818861 30522 raft_consensus.cc:493] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:45.855635 25271 leader_election.cc:304] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:45.864553 30324 raft_consensus.cc:515] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:45.865788 30439 raft_consensus.cc:3060] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:12:45.867141 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 46435.1us
I20260709 13:12:45.868131 30403 raft_consensus.cc:2749] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:45.850358 30338 raft_consensus.cc:740] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:45.851070 30487 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:45.898923 30526 raft_consensus.cc:515] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:45.900334 30338 consensus_queue.cc:260] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:45.901896 30338 raft_consensus.cc:3060] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:45.848026 30541 raft_consensus.cc:2764] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:12:45.881924 30503 raft_consensus.cc:3055] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:12:45.903213 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 95270us
W20260709 13:12:45.909462 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 133339us
W20260709 13:12:45.924566 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 69031.9us
I20260709 13:12:45.902733 30487 raft_consensus.cc:3060] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:45.930685 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:45.938009 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:45.904033 30392 leader_election.cc:290] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:45.941123 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:45.941712 25375 raft_consensus.cc:1275] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:12:45.942239 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:45.942364 25379 raft_consensus.cc:1240] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:45.942842 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:45.946033 30277 consensus_queue.cc:1048] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 13:12:45.941188 25371 raft_consensus.cc:1275] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:12:45.923302 30503 raft_consensus.cc:740] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:45.922791 30488 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.951459 25376 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 10.
I20260709 13:12:45.924302 30198 raft_consensus.cc:2749] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:45.958434 25222 raft_consensus.cc:1240] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:45.957209 25379 raft_consensus.cc:1240] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:12:45.960546 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:45.961198 25229 raft_consensus.cc:3060] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:45.946679 30272 raft_consensus.cc:493] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.893833 30522 raft_consensus.cc:515] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:45.964102 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:45.964327 30542 raft_consensus.cc:493] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:45.965232 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:45.966197 25379 raft_consensus.cc:1240] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:12:45.966127 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:45.968461 25271 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:12:45.974025 25230 raft_consensus.cc:3060] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:12:45.971194 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 155619us
I20260709 13:12:45.937173 30540 consensus_queue.cc:1048] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:12:45.986537 25195 leader_election.cc:304] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:45.974274 30488 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:45.990047 30532 raft_consensus.cc:515] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:45.991997 30532 leader_election.cc:290] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:45.993572 25378 raft_consensus.cc:1240] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:12:45.992002 30488 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:45.995450 30324 leader_election.cc:290] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:46.007606 30522 leader_election.cc:290] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:46.008354 30538 raft_consensus.cc:2804] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:46.009509 30526 leader_election.cc:290] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:46.018937 25230 raft_consensus.cc:2468] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 12.
I20260709 13:12:46.023254 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:46.034564 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:45.988219 30198 raft_consensus.cc:2804] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:45.975960 30272 raft_consensus.cc:515] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:46.015779 30504 raft_consensus.cc:2749] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:12:46.047520 25270 leader_election.cc:304] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
W20260709 13:12:46.052080 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 73228us
I20260709 13:12:46.053153 25195 leader_election.cc:304] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:46.056468 25195 leader_election.cc:304] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:45.983937 30515 raft_consensus.cc:515] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:46.060840 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 100962us
I20260709 13:12:46.063120 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:46.067428 25229 raft_consensus.cc:2468] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 14.
I20260709 13:12:45.976785 30542 raft_consensus.cc:515] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:46.030150 30421 raft_consensus.cc:515] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:46.054327 30198 raft_consensus.cc:697] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 10 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:46.073081 25874 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:46.063566 30342 raft_consensus.cc:2749] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:46.079567 30515 leader_election.cc:290] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:46.057489 30516 leader_election.cc:290] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:46.083918 30542 leader_election.cc:290] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:46.054342 30534 raft_consensus.cc:515] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:46.108134 30534 leader_election.cc:290] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:46.069052 30504 raft_consensus.cc:2804] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:46.109594 25372 raft_consensus.cc:1240] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:46.081535 30171 raft_consensus.cc:515] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:46.090840 30487 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:46.091431 30272 leader_election.cc:290] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:46.093017 30528 raft_consensus.cc:515] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:46.093293 30421 leader_election.cc:290] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:46.096882 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:46.015130 30503 consensus_queue.cc:260] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:46.098104 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:46.128221 25373 raft_consensus.cc:3060] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:46.060639 30549 raft_consensus.cc:2749] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:46.100986 25228 raft_consensus.cc:1275] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:12:46.103618 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:46.130095 25221 raft_consensus.cc:2468] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 15.
I20260709 13:12:46.130221 25226 raft_consensus.cc:1240] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:46.104137 30529 raft_consensus.cc:2804] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:46.105846 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:46.069258 30403 consensus_queue.cc:1059] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:12:46.066599 30439 raft_consensus.cc:515] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:46.119374 30171 leader_election.cc:290] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:46.120443 25271 leader_election.cc:304] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:46.061489 30499 consensus_queue.cc:1059] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:12:46.124387 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:46.147457 25900 raft_consensus.cc:2468] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 15.
I20260709 13:12:46.112787 30504 raft_consensus.cc:493] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:46.137689 30488 consensus_queue.cc:1048] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:12:46.152065 25374 raft_consensus.cc:2393] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 13: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:46.140235 25874 leader_election.cc:304] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:12:46.153466 30488 raft_consensus.cc:2804] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:46.153945 30488 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:46.154276 30488 raft_consensus.cc:3060] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:46.143816 30198 consensus_queue.cc:237] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:46.162621 30488 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:46.163465 30538 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:46.164136 30538 raft_consensus.cc:3060] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:46.164966 30488 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 16 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:46.138566 30529 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:46.177069 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 56729.1us
I20260709 13:12:46.176012 30529 raft_consensus.cc:3060] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:46.179628 30503 raft_consensus.cc:3060] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:46.179482 30181 raft_consensus.cc:2749] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:12:46.176658 30539 raft_consensus.cc:3055] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:46.186535 30181 raft_consensus.cc:3055] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:46.186971 30181 raft_consensus.cc:740] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
W20260709 13:12:46.187705 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:46.186546 30539 raft_consensus.cc:740] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:46.189117 30539 consensus_queue.cc:260] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:46.190460 30539 raft_consensus.cc:3060] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:46.192679 30421 consensus_queue.cc:1048] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:46.192797 25271 leader_election.cc:304] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:46.194864 30528 leader_election.cc:290] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:46.187752 30181 consensus_queue.cc:260] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:46.168725 30504 raft_consensus.cc:3060] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:46.196717 30487 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:46.197046 30342 raft_consensus.cc:2749] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:46.180737 30439 leader_election.cc:290] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:46.200941 25271 leader_election.cc:304] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:12:46.202394 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:46.202644 30421 raft_consensus.cc:2804] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:46.203105 30421 raft_consensus.cc:493] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:46.203459 30421 raft_consensus.cc:3060] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:46.203922 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:46.204658 25900 raft_consensus.cc:2393] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 13: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:12:46.205032 30529 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:46.201553 30342 consensus_queue.cc:1048] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:46.215106 30504 raft_consensus.cc:515] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:46.207958 25271 leader_election.cc:304] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:46.211678 30181 raft_consensus.cc:3060] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:46.239466 25271 leader_election.cc:304] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:46.226418 30342 raft_consensus.cc:2764] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 13:12:46.242280 30342 raft_consensus.cc:2749] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:46.241977 30416 consensus_queue.cc:1048] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:46.250347 25373 raft_consensus.cc:2468] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 9.
I20260709 13:12:46.229828 30559 raft_consensus.cc:493] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:46.256672 25270 leader_election.cc:304] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:46.260561 30528 raft_consensus.cc:493] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:46.269191 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:46.266038 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:46.270063 25373 raft_consensus.cc:3060] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:46.260915 30396 consensus_queue.cc:1059] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:12:46.270133 25376 raft_consensus.cc:2468] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 13.
I20260709 13:12:46.269034 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:46.266919 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:46.270740 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:46.272553 25271 leader_election.cc:304] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:46.272698 25372 raft_consensus.cc:2468] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 15.
I20260709 13:12:46.273466 25379 raft_consensus.cc:2368] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 8. Current term is 9.
I20260709 13:12:46.274631 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:46.275226 25378 raft_consensus.cc:2393] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 12: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:46.275741 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:46.278692 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:46.279538 25379 raft_consensus.cc:2368] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 11. Current term is 13.
I20260709 13:12:46.281672 30529 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:46.271988 30198 raft_consensus.cc:2804] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:46.281834 30499 consensus_queue.cc:1059] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:46.276182 25374 raft_consensus.cc:2376] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 15. Re-sending same reply.
I20260709 13:12:46.284906 30503 raft_consensus.cc:2749] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:12:46.285578 30503 consensus_queue.cc:1048] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:46.287621 30198 raft_consensus.cc:697] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 9 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:46.294951 30198 consensus_queue.cc:237] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:46.285732 25270 leader_election.cc:304] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:46.299815 30387 raft_consensus.cc:3055] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:46.300302 30387 raft_consensus.cc:740] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:46.301134 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:46.246290 30416 consensus_queue.cc:1048] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:12:46.301834 25305 raft_consensus.cc:3060] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:12:46.301436 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:46.304742 25194 leader_election.cc:304] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:12:46.305644 25296 raft_consensus.cc:3060] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:46.307618 25373 raft_consensus.cc:2468] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 13.
I20260709 13:12:46.309451 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:46.310297 25229 raft_consensus.cc:1240] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 16. Current term is 17. Ops: []
I20260709 13:12:46.310786 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:46.326726 25221 raft_consensus.cc:2393] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 15: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:46.312340 25194 leader_election.cc:304] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:46.329444 30272 raft_consensus.cc:2749] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:46.330435 30272 consensus_queue.cc:1048] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:46.312911 30439 raft_consensus.cc:2804] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:46.332814 30439 raft_consensus.cc:493] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:46.333317 30439 raft_consensus.cc:3060] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:46.277253 30559 raft_consensus.cc:515] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:46.314406 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:46.344784 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:46.346148 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:46.347420 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:46.316910 25296 raft_consensus.cc:2468] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 16.
I20260709 13:12:46.320183 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:46.349193 25301 raft_consensus.cc:2410] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:12:46.349710 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:46.352077 30559 leader_election.cc:290] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:46.353327 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:46.355250 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:46.353636 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:46.356389 25302 raft_consensus.cc:3060] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:46.370736 30439 raft_consensus.cc:515] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:46.374244 25194 leader_election.cc:304] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:12:46.378037 25194 leader_election.cc:304] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:46.379334 30487 raft_consensus.cc:2804] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:46.379873 30487 raft_consensus.cc:493] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:46.380321 30487 raft_consensus.cc:3060] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:46.386000 30529 raft_consensus.cc:493] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:46.386826 30529 raft_consensus.cc:515] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:46.390303 30529 leader_election.cc:290] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:46.390991 30529 raft_consensus.cc:493] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:46.391660 30529 raft_consensus.cc:515] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:46.396478 30559 raft_consensus.cc:3060] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:46.401892 30529 leader_election.cc:290] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:46.403417 25194 leader_election.cc:304] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:46.404922 30555 raft_consensus.cc:2804] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:46.405514 30555 raft_consensus.cc:493] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:46.405546 25194 leader_election.cc:304] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:46.406160 30555 raft_consensus.cc:3060] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:46.406906 25194 leader_election.cc:304] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:46.422389 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:46.425511 25302 raft_consensus.cc:2468] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 14.
I20260709 13:12:46.426561 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:46.427598 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:46.423964 25194 leader_election.cc:304] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:46.426687 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:46.429128 25374 raft_consensus.cc:2393] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 12: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:46.273016 30388 consensus_queue.cc:1048] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:12:46.430725 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:46.432338 25226 raft_consensus.cc:2468] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 7.
I20260709 13:12:46.422655 30439 leader_election.cc:290] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 18 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:46.439128 25229 raft_consensus.cc:1275] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 18 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 13:12:46.439718 25229 pending_rounds.cc:85] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce: Aborting all ops after (but not including) 12
I20260709 13:12:46.440109 25229 pending_rounds.cc:107] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 13:12:46.439496 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:46.440442 25229 raft_consensus.cc:2889] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:46.272437 30528 raft_consensus.cc:515] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:46.435104 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:46.443396 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:46.443646 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:46.443935 25303 raft_consensus.cc:2393] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 13: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:46.276794 30539 consensus_queue.cc:1059] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.149s
I20260709 13:12:46.442152 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:46.325610 30503 raft_consensus.cc:2749] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:46.452479 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:46.452824 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:46.454891 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:46.426280 30549 raft_consensus.cc:2804] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:12:46.459045 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:46.434038 30171 raft_consensus.cc:2749] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:12:46.461655 25195 leader_election.cc:304] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:12:46.438449 30504 leader_election.cc:290] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 16 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:46.468040 25373 raft_consensus.cc:2393] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 16: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:46.468703 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:46.471300 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:46.474676 25303 raft_consensus.cc:1275] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 16 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:12:46.468469 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:46.488181 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:46.488893 25222 raft_consensus.cc:3060] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:46.488621 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:46.489976 25226 raft_consensus.cc:3060] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:12:46.301137 30387 consensus_queue.cc:260] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:46.492435 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
W20260709 13:12:46.471154 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 145953us
I20260709 13:12:46.493463 25379 raft_consensus.cc:2368] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 13. Current term is 14.
I20260709 13:12:46.505095 25302 raft_consensus.cc:2468] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 14.
I20260709 13:12:46.462725 30439 raft_consensus.cc:2804] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:46.514434 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:46.523535 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
W20260709 13:12:46.528205 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:46.506299 30504 raft_consensus.cc:2804] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:46.456429 30538 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:46.541116 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:46.548926 25371 raft_consensus.cc:2410] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:12:46.542788 25375 raft_consensus.cc:1275] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:12:46.544878 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:46.545835 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:46.551386 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:46.466899 30555 raft_consensus.cc:515] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:46.557273 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:46.561259 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:46.558090 25223 raft_consensus.cc:2468] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 12.
I20260709 13:12:46.564442 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:46.565008 25223 raft_consensus.cc:3060] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:46.522104 30439 raft_consensus.cc:697] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 13 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:46.528748 30387 raft_consensus.cc:3060] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:46.540561 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:46.556046 25872 leader_election.cc:304] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:46.547907 30504 raft_consensus.cc:493] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:46.578423 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:46.578423 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:46.571712 25378 raft_consensus.cc:2468] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 16.
I20260709 13:12:46.581324 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:46.519968 30421 raft_consensus.cc:515] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:46.592859 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:46.589219 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:46.540437 30277 consensus_queue.cc:1048] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 13:12:46.597436 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:46.598227 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:46.601207 25376 raft_consensus.cc:2393] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 13: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:46.553543 30396 consensus_queue.cc:1048] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.039s
W20260709 13:12:46.602981 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 179442us
I20260709 13:12:46.575654 30559 raft_consensus.cc:2749] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:46.608044 25345 leader_election.cc:304] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:46.604308 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:46.582711 30504 raft_consensus.cc:3060] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:46.614156 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:46.615527 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:46.616542 25302 raft_consensus.cc:2410] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:12:46.617012 25375 raft_consensus.cc:2393] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 13: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:46.609992 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:46.617791 25378 raft_consensus.cc:3060] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:46.621848 25371 pending_rounds.cc:85] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468: Aborting all ops after (but not including) 6
I20260709 13:12:46.622355 25371 pending_rounds.cc:107] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:12:46.623950 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:46.613588 25345 leader_election.cc:304] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:46.625576 25371 raft_consensus.cc:2889] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:12:46.632161 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 67103.9us
I20260709 13:12:46.626611 25345 leader_election.cc:304] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:46.632982 25195 leader_election.cc:304] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:46.637650 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:46.644274 25305 raft_consensus.cc:2468] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 13.
I20260709 13:12:46.611961 30549 raft_consensus.cc:697] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 16 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:46.709152 25872 leader_election.cc:304] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:46.601861 30534 consensus_queue.cc:1059] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 13:12:46.614727 30522 raft_consensus.cc:2749] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:12:46.618849 30488 raft_consensus.cc:2804] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:12:46.631608 30338 raft_consensus.cc:2804] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:46.719635 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:12:46.686510 30524 log.cc:927] Time spent T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 13:12:46.710289 30519 log.cc:927] Time spent T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:12:46.707968 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:46.741256 30580 raft_consensus.cc:2749] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:12:46.741843 30568 log.cc:927] Time spent T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
W20260709 13:12:46.742965 30567 log.cc:927] Time spent T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 13:12:46.752692 25227 raft_consensus.cc:1240] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:12:46.754308 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:46.755707 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:46.756531 25227 raft_consensus.cc:2393] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 13: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:46.722697 30537 raft_consensus.cc:2804] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:46.757447 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
W20260709 13:12:46.769129 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 136202us
I20260709 13:12:46.770879 25227 raft_consensus.cc:3060] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:46.771499 25195 leader_election.cc:304] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:46.774335 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
W20260709 13:12:46.776208 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 149545us
I20260709 13:12:46.780061 25222 raft_consensus.cc:2468] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 16.
I20260709 13:12:46.784044 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:46.788306 25302 raft_consensus.cc:2393] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 13: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:12:46.736500 30528 leader_election.cc:290] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:46.739717 30338 raft_consensus.cc:697] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 12 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
W20260709 13:12:46.797098 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 88024.9us
I20260709 13:12:46.799388 25305 raft_consensus.cc:1240] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:46.737463 30517 consensus_queue.cc:1059] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.240s
I20260709 13:12:46.710714 30439 consensus_queue.cc:237] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:46.789403 30580 raft_consensus.cc:493] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:46.828168 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:46.820483 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:46.790442 30537 raft_consensus.cc:697] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 14 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:46.838675 25195 leader_election.cc:400] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Vote denied by peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091) with higher term. Message: Invalid argument: T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 8. Current term is 9.
I20260709 13:12:46.839329 25195 leader_election.cc:403] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:46.841022 25195 leader_election.cc:400] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 election: Vote denied by peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091) with higher term. Message: Invalid argument: T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 11. Current term is 13.
I20260709 13:12:46.841414 25195 leader_election.cc:403] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:12:46.850842 25195 leader_election.cc:304] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:46.852375 25195 leader_election.cc:304] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:46.804087 30433 raft_consensus.cc:2804] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:46.867105 25302 raft_consensus.cc:1275] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 13:12:46.871016 30181 consensus_meta.cc:287] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.643s	user 0.009s	sys 0.000s
I20260709 13:12:46.873508 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:46.874974 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:46.875756 25222 raft_consensus.cc:2393] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 16: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:46.876750 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:46.877346 30516 raft_consensus.cc:3055] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:12:46.877805 30516 raft_consensus.cc:740] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:46.878726 30516 consensus_queue.cc:260] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:46.863785 30580 raft_consensus.cc:515] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:46.880084 30516 raft_consensus.cc:3060] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:46.880930 25226 raft_consensus.cc:2468] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 9.
I20260709 13:12:46.881361 30580 leader_election.cc:290] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:46.884917 30416 raft_consensus.cc:3055] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:46.887764 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:46.888116 25345 leader_election.cc:304] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:46.892455 25345 leader_election.cc:304] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:46.898849 25223 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 11.
I20260709 13:12:46.901028 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:46.902465 25374 raft_consensus.cc:2468] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 15.
I20260709 13:12:46.887374 25298 raft_consensus.cc:2468] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 12.
I20260709 13:12:46.908641 25345 leader_election.cc:304] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:46.885401 30416 raft_consensus.cc:740] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:46.817117 30577 raft_consensus.cc:2749] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:46.817492 30555 leader_election.cc:290] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:46.860711 30421 leader_election.cc:290] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:46.832161 30538 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 16 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:12:46.915795 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 93040.9us
W20260709 13:12:46.905890 30541 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.017s	sys 0.036s
I20260709 13:12:46.887091 30479 raft_consensus.cc:2749] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091) with higher term. Message: Invalid argument: T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 8. Current term is 9.
I20260709 13:12:46.935582 25302 raft_consensus.cc:1275] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:12:46.935746 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 83462.3us
I20260709 13:12:46.939325 25195 leader_election.cc:400] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 election: Vote denied by peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091) with higher term. Message: Invalid argument: T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 13. Current term is 14.
I20260709 13:12:46.939730 25195 leader_election.cc:403] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:12:46.906720 30534 raft_consensus.cc:2749] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:46.905463 30566 raft_consensus.cc:493] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:46.911206 30522 raft_consensus.cc:2749] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:46.910744 30433 raft_consensus.cc:697] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:46.914077 30580 raft_consensus.cc:2749] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:12:46.933815 30541 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.017s	sys 0.037s
I20260709 13:12:46.951853 30584 raft_consensus.cc:2749] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:46.958154 30537 consensus_queue.cc:237] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:46.960028 30433 consensus_queue.cc:237] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:46.823184 30549 consensus_queue.cc:237] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:46.967178 30416 consensus_queue.cc:260] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:46.968308 30416 raft_consensus.cc:3060] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:46.974021 30566 raft_consensus.cc:515] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:46.974875 30593 raft_consensus.cc:493] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:46.975382 30593 raft_consensus.cc:515] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:46.976228 30566 leader_election.cc:290] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:46.957494 30487 consensus_meta.cc:287] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 0.576s	user 0.008s	sys 0.003s
W20260709 13:12:46.994715 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 222711us
I20260709 13:12:46.999984 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:47.001968 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:47.009370 25373 raft_consensus.cc:3060] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:12:47.020226 25373 raft_consensus.cc:1275] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:12:46.977367 30338 consensus_queue.cc:237] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:47.039723 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:12:47.040906 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 101831us
I20260709 13:12:47.041862 25195 leader_election.cc:304] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:46.993942 30580 raft_consensus.cc:2749] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091) with higher term. Message: Invalid argument: T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 13. Current term is 14.
I20260709 13:12:46.999397 30487 raft_consensus.cc:515] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:47.056491 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 495903us
I20260709 13:12:47.058583 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:47.043563 30198 raft_consensus.cc:493] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:47.058640 25873 leader_election.cc:304] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:47.062392 25873 leader_election.cc:304] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:47.057473 30549 raft_consensus.cc:2749] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:47.059298 25302 raft_consensus.cc:2468] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 15.
I20260709 13:12:47.067971 30589 consensus_queue.cc:1048] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:12:47.070232 30586 raft_consensus.cc:2749] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:47.079471 25378 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 11.
I20260709 13:12:47.085255 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:47.064154 30576 raft_consensus.cc:3060] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:47.087909 25301 raft_consensus.cc:2410] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
W20260709 13:12:47.098376 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 56609.9us
W20260709 13:12:47.082952 30552 log.cc:927] Time spent T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.974s	user 0.000s	sys 0.013s
I20260709 13:12:47.067579 30593 leader_election.cc:290] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:47.111274 30533 raft_consensus.cc:493] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:47.112121 30603 raft_consensus.cc:2749] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:12:47.115696 30575 log.cc:927] Time spent T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.372s	user 0.000s	sys 0.002s
I20260709 13:12:47.109990 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:47.066211 30198 raft_consensus.cc:515] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:47.134703 25301 raft_consensus.cc:2393] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 14: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:47.148929 30198 leader_election.cc:290] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:47.160442 25195 leader_election.cc:304] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:47.167529 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:47.142654 30396 raft_consensus.cc:493] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:47.177539 25227 raft_consensus.cc:2468] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 12.
I20260709 13:12:47.165668 30549 raft_consensus.cc:2749] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:12:47.176726 30457 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.065s	user 0.012s	sys 0.021s
I20260709 13:12:47.185590 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:47.186043 25376 raft_consensus.cc:1240] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:12:47.186491 25345 leader_election.cc:304] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:47.134466 30533 raft_consensus.cc:515] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:47.188267 30457 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.083s	user 0.013s	sys 0.021s
I20260709 13:12:47.194125 30579 raft_consensus.cc:2749] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:47.200443 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:12:47.199098 30387 consensus_meta.cc:287] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent flushing consensus metadata: real 0.619s	user 0.013s	sys 0.000s
I20260709 13:12:47.179383 30396 raft_consensus.cc:515] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:47.194980 30538 raft_consensus.cc:2804] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:47.210966 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:47.211752 25301 raft_consensus.cc:3060] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:47.215536 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:47.215396 30604 consensus_queue.cc:1048] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:12:47.216238 25300 raft_consensus.cc:3060] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:12:47.217800 30548 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 1.060s	user 0.010s	sys 0.013s
W20260709 13:12:47.218214 30548 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.112s	user 0.010s	sys 0.013s
W20260709 13:12:47.221340 30606 log.cc:927] Time spent T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:12:47.225607 25300 raft_consensus.cc:2468] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 14.
I20260709 13:12:47.229786 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:12:47.234402 30605 log.cc:927] Time spent T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.127s	user 0.002s	sys 0.000s
W20260709 13:12:47.235209 30573 log.cc:927] Time spent T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.548s	user 0.003s	sys 0.000s
I20260709 13:12:47.228667 30538 raft_consensus.cc:697] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 12 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:47.210038 30487 leader_election.cc:290] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:47.265822 25194 leader_election.cc:304] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:47.278775 30538 consensus_queue.cc:237] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:47.319057 30171 raft_consensus.cc:2749] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:12:47.319255 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 53579.1us
I20260709 13:12:47.279448 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:47.289842 30487 raft_consensus.cc:493] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:47.323918 30487 raft_consensus.cc:515] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:47.327081 30487 leader_election.cc:290] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:47.303999 30396 leader_election.cc:290] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:47.305279 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:47.329013 25371 raft_consensus.cc:2468] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 16.
I20260709 13:12:47.267647 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:47.269133 30533 leader_election.cc:290] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:47.357048 25228 raft_consensus.cc:1240] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:47.359201 25228 raft_consensus.cc:1240] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:12:47.359808 25343 leader_election.cc:304] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:47.356349 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:12:47.360855 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 153514us
I20260709 13:12:47.361368 25229 raft_consensus.cc:2393] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 18: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:47.362164 25195 leader_election.cc:304] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:47.364817 25224 raft_consensus.cc:1275] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:12:47.370435 25343 leader_election.cc:304] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:47.359814 25194 leader_election.cc:304] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:47.405995 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 46264.8us
W20260709 13:12:47.407577 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 44431.4us
I20260709 13:12:47.408661 25343 leader_election.cc:304] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:47.409190 25194 leader_election.cc:304] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:47.414147 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:47.418853 25195 leader_election.cc:304] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:47.420501 25194 leader_election.cc:304] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:47.421038 25343 leader_election.cc:304] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:47.316835 30504 consensus_meta.cc:287] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce: Time spent flushing consensus metadata: real 0.692s	user 0.013s	sys 0.000s
I20260709 13:12:47.423504 25271 leader_election.cc:304] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:47.424453 30583 raft_consensus.cc:2749] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:47.424924 25343 leader_election.cc:304] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:12:47.426568 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:47.431169 25194 leader_election.cc:304] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:47.431212 25271 leader_election.cc:304] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:47.431648 25195 leader_election.cc:304] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:47.435855 25194 leader_election.cc:304] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:47.436959 25271 leader_election.cc:304] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:47.407704 30533 raft_consensus.cc:2749] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:47.437304 25343 leader_election.cc:304] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:47.407505 30479 raft_consensus.cc:2749] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:12:47.440881 25194 leader_election.cc:304] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:47.418366 30604 raft_consensus.cc:2749] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:47.422456 30522 raft_consensus.cc:2749] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:47.425987 30549 raft_consensus.cc:2749] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:47.419337 30534 raft_consensus.cc:2749] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:47.425807 30583 raft_consensus.cc:2804] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:47.448143 25301 raft_consensus.cc:2468] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 18.
I20260709 13:12:47.404172 30487 consensus_queue.cc:1048] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:12:47.458034 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:47.438633 30171 raft_consensus.cc:2804] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:47.458323 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:47.438808 30589 raft_consensus.cc:2749] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:47.458766 25301 raft_consensus.cc:2468] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 16.
I20260709 13:12:47.460157 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:47.441666 30577 raft_consensus.cc:2749] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:47.441532 30580 raft_consensus.cc:2749] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:12:47.442003 30342 raft_consensus.cc:3060] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:47.460728 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:47.441442 30555 raft_consensus.cc:2749] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:12:47.462998 25302 raft_consensus.cc:2410] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:12:47.464805 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:47.471837 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:47.469023 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:47.426133 30584 consensus_queue.cc:1048] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:12:47.472097 25301 raft_consensus.cc:2410] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:12:47.429304 30504 raft_consensus.cc:515] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:47.475721 25297 raft_consensus.cc:2393] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 13: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:47.442046 30403 consensus_queue.cc:1059] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:12:47.459497 30533 raft_consensus.cc:493] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:47.457674 30479 raft_consensus.cc:2749] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:47.478235 30599 raft_consensus.cc:3060] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:47.468703 30534 raft_consensus.cc:2749] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:47.478734 30570 consensus_queue.cc:1048] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 13:12:47.479527 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:47.480351 30591 consensus_queue.cc:1059] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:12:47.481029 30587 consensus_queue.cc:1059] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:12:47.481617 30595 raft_consensus.cc:2749] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:47.477391 30171 raft_consensus.cc:697] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 15 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:47.498270 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:12:47.499428 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 58605us
I20260709 13:12:47.499267 30171 consensus_queue.cc:237] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:47.499562 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:47.500152 25194 leader_election.cc:304] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:47.483948 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:47.462399 30387 raft_consensus.cc:493] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:47.486826 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:47.458348 30421 consensus_queue.cc:1059] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:12:47.509377 25221 raft_consensus.cc:2393] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 16: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:47.504706 25194 leader_election.cc:304] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:12:47.507761 25302 raft_consensus.cc:2410] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:12:47.465834 30583 raft_consensus.cc:697] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 14 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:47.521545 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:47.522104 25903 raft_consensus.cc:1240] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:47.522620 30583 consensus_queue.cc:237] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:47.525915 30595 raft_consensus.cc:3055] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:12:47.526379 30595 raft_consensus.cc:740] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:47.527186 30595 consensus_queue.cc:260] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:47.528395 30595 raft_consensus.cc:3060] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:47.530115 30572 consensus_queue.cc:1048] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 13:12:47.530436 30272 raft_consensus.cc:2804] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:12:47.531808 30272 raft_consensus.cc:697] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 18 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:47.532786 30272 consensus_queue.cc:237] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.7, Last appended by leader: 7, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:47.502177 30576 raft_consensus.cc:2749] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091) with higher term. Message: Invalid argument: T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 11. Current term is 13.
I20260709 13:12:47.548382 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:47.558544 25903 raft_consensus.cc:2468] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 15.
W20260709 13:12:47.549433 30622 log.cc:927] Time spent T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:12:47.551141 30504 leader_election.cc:290] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 16 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:47.508628 30577 raft_consensus.cc:2804] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:47.491621 30533 raft_consensus.cc:515] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:47.575038 25903 raft_consensus.cc:1275] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 13:12:47.576599 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 139364us
W20260709 13:12:47.579254 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:47.591024 25343 leader_election.cc:304] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:47.594178 30584 raft_consensus.cc:2749] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:47.518096 30387 raft_consensus.cc:515] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:47.596998 30387 leader_election.cc:290] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:47.602667 25375 raft_consensus.cc:1275] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:12:47.566334 30580 raft_consensus.cc:493] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:47.574994 30577 raft_consensus.cc:697] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 14 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:47.607260 25343 leader_election.cc:304] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:47.619889 30533 leader_election.cc:290] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:47.627820 25343 leader_election.cc:304] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:47.629604 30536 raft_consensus.cc:2749] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:47.627638 30593 raft_consensus.cc:493] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:47.630697 30593 raft_consensus.cc:515] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:47.631410 30627 consensus_queue.cc:1059] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:47.632705 30627 raft_consensus.cc:3055] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:47.632788 30593 leader_election.cc:290] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:47.626349 30537 raft_consensus.cc:2749] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:12:47.631022 30588 log.cc:927] Time spent T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.571s	user 0.010s	sys 0.018s
I20260709 13:12:47.635330 30589 raft_consensus.cc:3055] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:12:47.635723 30589 raft_consensus.cc:740] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:47.636575 30589 consensus_queue.cc:260] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:47.606456 30580 raft_consensus.cc:515] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:47.647555 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:47.648247 25224 raft_consensus.cc:2468] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 16.
I20260709 13:12:47.633163 30627 raft_consensus.cc:740] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:47.652354 25873 leader_election.cc:304] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:47.652438 30277 consensus_queue.cc:1059] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:47.653959 25223 raft_consensus.cc:1240] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:47.653472 30580 leader_election.cc:290] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:47.654023 30537 consensus_queue.cc:1048] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:12:47.625403 30515 raft_consensus.cc:3055] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:47.654888 30515 raft_consensus.cc:740] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:47.655733 30515 consensus_queue.cc:260] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:47.656656 30586 raft_consensus.cc:2804] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:47.656962 30515 raft_consensus.cc:3060] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:47.657231 30586 raft_consensus.cc:493] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:47.658281 25343 leader_election.cc:304] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:47.625667 30342 raft_consensus.cc:2749] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:47.659548 30632 raft_consensus.cc:2749] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:12:47.662070 25343 leader_election.cc:304] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:12:47.662011 30627 consensus_queue.cc:260] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:47.662895 30632 raft_consensus.cc:2804] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:47.663266 30632 raft_consensus.cc:493] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:47.663453 30627 raft_consensus.cc:3060] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:47.663579 30632 raft_consensus.cc:3060] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:12:47.664193 25871 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:47.666052 30577 consensus_queue.cc:237] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:47.667346 25299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57256 (request call id 2393) took 1343 ms. Trace:
I20260709 13:12:47.667716 25299 rpcz_store.cc:276] 0709 13:12:46.323840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:46.472754 (+148914us) service_pool.cc:224] Handling call
0709 13:12:46.494294 (+ 21540us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:46.494561 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:12:46.511013 (+ 16452us) log.cc:844] Serialized 14 byte log entry
0709 13:12:47.630365 (+1119352us) spinlock_profiling.cc:243] Waited 2.05 ms on lock 0x7b4400022b4c. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72caa8c85 00007fd72caa96a2 00007fd72f81b1db 00007fd72f816aaf 00007fd72f80a86e 00007fd72f809bb6 00007fd72f8097d8 00007fd72f813221 00007fd72f8131d9 00007fd72f813169
0709 13:12:47.666807 (+ 36442us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b18004681c0. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72f8174bc 00007fd72cb6548b 00007fd7359bfab9 00007fd72cb8169b 00007fd72cb7f93f 00007fd72cb7f455 00007fd72fc67060 00007fd72fc79716 00007fd72fc8a287
0709 13:12:47.666987 (+   180us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:47.667035 (+    48us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:12:47.667079 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:47.667155 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:47.667294 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":19790,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":122272,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":41191,"spinlock_wait_cycles":37699712,"thread_start_us":435652,"threads_started":2,"wal-append.queue_time_us":505928}
I20260709 13:12:47.668929 25343 leader_election.cc:304] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:47.671041 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:47.677690 30387 consensus_queue.cc:1048] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:12:47.683131 25373 raft_consensus.cc:1240] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:47.651062 30542 raft_consensus.cc:493] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:47.684525 30542 raft_consensus.cc:515] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:47.686223 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:47.686667 30542 leader_election.cc:290] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:47.688302 30537 raft_consensus.cc:2749] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:47.690407 25371 raft_consensus.cc:1240] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:12:47.693701 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:47.694383 25226 raft_consensus.cc:2468] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 13.
I20260709 13:12:47.699201 25301 raft_consensus.cc:1275] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:12:47.675895 25345 leader_election.cc:304] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:47.706434 30129 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:47.707077 30129 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:47.707443 25375 raft_consensus.cc:1275] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:12:47.706223 30536 consensus_queue.cc:1059] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:47.708863 30536 raft_consensus.cc:3055] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:47.709193 30129 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:47.709954 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:47.704828 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:47.704090 30529 raft_consensus.cc:493] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:47.714026 30529 raft_consensus.cc:515] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:47.716233 30529 leader_election.cc:290] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:47.716328 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 275461us
I20260709 13:12:47.717784 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:47.718274 25271 leader_election.cc:304] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:47.718612 25900 raft_consensus.cc:2468] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 14.
I20260709 13:12:47.718539 25223 raft_consensus.cc:1240] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:47.721238 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:47.722311 25226 raft_consensus.cc:2393] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 16: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:47.722134 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:47.722961 25227 raft_consensus.cc:2393] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 16: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:47.723487 25299 raft_consensus.cc:1275] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:12:47.723416 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:47.724192 25297 raft_consensus.cc:3060] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:47.724599 25223 raft_consensus.cc:1240] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:47.726024 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:47.726383 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:47.726605 25372 raft_consensus.cc:3060] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:47.727873 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:47.724820 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:47.729184 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:47.728955 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:47.730165 25874 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:47.657698 30586 raft_consensus.cc:3060] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:47.734119 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:47.726538 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:12:47.767900 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 45148.1us
I20260709 13:12:47.772954 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:47.773463 25195 leader_election.cc:304] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:47.735711 25194 leader_election.cc:304] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:47.773624 25379 raft_consensus.cc:2468] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 16.
I20260709 13:12:47.735038 25223 raft_consensus.cc:2393] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 14: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:47.773525 25874 leader_election.cc:304] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:47.735276 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:47.728541 30572 raft_consensus.cc:3055] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:12:47.802727 25344 leader_election.cc:304] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:47.803645 25228 raft_consensus.cc:1240] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 18 LEADER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 17. Current term is 18. Ops: []
I20260709 13:12:47.720273 30537 raft_consensus.cc:2804] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:47.709223 30536 raft_consensus.cc:740] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
W20260709 13:12:47.807024 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 71429.1us
I20260709 13:12:47.808229 25375 raft_consensus.cc:1275] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:12:47.805253 25270 leader_election.cc:304] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:47.767900 30564 raft_consensus.cc:493] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:47.802441 30277 raft_consensus.cc:2749] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:47.841557 25304 raft_consensus.cc:1240] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 18 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 17. Current term is 18. Ops: [17.8-17.8]
I20260709 13:12:47.842734 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:47.845628 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:47.735018 30388 raft_consensus.cc:2804] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:47.805409 30572 raft_consensus.cc:740] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:47.807992 30537 raft_consensus.cc:493] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:47.783178 30342 consensus_queue.cc:1059] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:12:47.813625 30538 raft_consensus.cc:2804] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:47.811049 30576 raft_consensus.cc:2749] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:12:47.832055 30488 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.054s	user 0.015s	sys 0.027s
I20260709 13:12:47.783519 30566 consensus_queue.cc:1059] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:12:47.805019 30587 consensus_queue.cc:1059] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:12:47.831633 30579 raft_consensus.cc:2749] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:47.848903 30388 raft_consensus.cc:493] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:47.863298 30488 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.104s	user 0.016s	sys 0.031s
I20260709 13:12:47.852659 30537 raft_consensus.cc:3060] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:47.888753 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:47.889993 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:47.823876 30272 consensus_queue.cc:1048] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:12:47.912801 30632 raft_consensus.cc:515] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:47.877652 30516 raft_consensus.cc:493] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:47.914999 30516 raft_consensus.cc:515] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:47.916296 25377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36264 (request call id 2141) took 1399 ms. Trace:
I20260709 13:12:47.863231 30538 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:47.917907 30538 raft_consensus.cc:3060] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:47.920356 30403 raft_consensus.cc:3055] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:47.920779 30403 raft_consensus.cc:740] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:47.921442 30572 consensus_queue.cc:260] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:47.834808 30564 raft_consensus.cc:515] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:47.892753 30171 raft_consensus.cc:493] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:47.894810 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:47.901418 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:47.927274 25908 raft_consensus.cc:3060] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:47.927477 25372 raft_consensus.cc:2468] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 14.
I20260709 13:12:47.927373 25374 raft_consensus.cc:2468] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 13.
I20260709 13:12:47.907006 30625 raft_consensus.cc:2804] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:47.907529 30574 consensus_queue.cc:1048] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.076s
I20260709 13:12:47.890899 30388 raft_consensus.cc:3060] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:47.916693 25377 rpcz_store.cc:276] 0709 13:12:46.517137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:46.517931 (+   794us) service_pool.cc:224] Handling call
0709 13:12:46.518366 (+   435us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:46.529257 (+ 10891us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:46.529304 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:46.529920 (+   616us) log.cc:844] Serialized 26 byte log entry
0709 13:12:46.706406 (+176486us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:46.738137 (+ 31731us) log.cc:844] Serialized 14 byte log entry
0709 13:12:46.739845 (+  1708us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:46.739931 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:47.913009 (+1173078us) spinlock_profiling.cc:243] Waited 6.18 ms on lock 0x7b18004614a0. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72cb823f3 00007fd72cb847c1 00007fd72cb84779 00007fd72cb84709 00007fd72cb846d1 00007fd72cb839cd 000000000038f354 000000000038f199 00007fd72cb6583a
0709 13:12:47.915970 (+  2961us) raft_consensus.cc:1685] finished
0709 13:12:47.916072 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:47.916203 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19532,"prepare.queue_time_us":31752,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":5677,"raft.queue_time_us":47912,"raft.run_cpu_time_us":333,"raft.run_wall_time_us":30278,"spinlock_wait_cycles":14218112,"thread_start_us":127827,"threads_started":1,"wal-append.queue_time_us":236401}
I20260709 13:12:47.891484 25195 leader_election.cc:304] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:47.934978 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 43584us
I20260709 13:12:47.937827 25343 leader_election.cc:304] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:47.939478 25375 raft_consensus.cc:1240] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 16. Current term is 17. Ops: []
I20260709 13:12:47.939211 25297 raft_consensus.cc:2468] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 16.
I20260709 13:12:47.943327 30457 raft_consensus.cc:493] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:47.891788 30488 raft_consensus.cc:697] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:47.946045 25374 raft_consensus.cc:1240] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:47.943923 30457 raft_consensus.cc:515] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:47.949501 25377 raft_consensus.cc:1240] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 12 LEADER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 11. Current term is 12. Ops: []
W20260709 13:12:47.967011 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:47.968588 25373 raft_consensus.cc:2468] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 14.
I20260709 13:12:47.939231 30580 raft_consensus.cc:2749] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:47.971452 25343 leader_election.cc:304] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:47.972868 25872 leader_election.cc:304] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:47.945411 30591 raft_consensus.cc:2764] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:12:47.938290 30625 raft_consensus.cc:697] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:47.978619 30625 consensus_queue.cc:237] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:47.977259 30636 raft_consensus.cc:2749] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:47.985217 30338 raft_consensus.cc:2749] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:47.986147 30488 consensus_queue.cc:237] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:47.986619 25343 leader_election.cc:304] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:47.974952 30640 consensus_queue.cc:1048] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:12:47.876394 30536 consensus_queue.cc:260] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:47.973640 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 122272us
I20260709 13:12:47.933328 30171 raft_consensus.cc:515] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:47.990736 30338 raft_consensus.cc:2749] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:47.992457 30576 raft_consensus.cc:493] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:47.992998 30576 raft_consensus.cc:515] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:47.995630 30570 raft_consensus.cc:493] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:47.996209 30570 raft_consensus.cc:515] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:47.998512 30570 leader_election.cc:290] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:47.999332 30632 leader_election.cc:290] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 17 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:48.000739 30522 consensus_queue.cc:1059] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 16.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:48.002408 30632 raft_consensus.cc:3055] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:12:48.002875 30632 raft_consensus.cc:740] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:48.003868 30632 consensus_queue.cc:260] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:48.005573 30632 raft_consensus.cc:3060] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:48.006880 30457 leader_election.cc:290] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:47.969980 30599 raft_consensus.cc:2749] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:48.009052 25343 leader_election.cc:304] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:48.009938 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:48.010305 25270 leader_election.cc:304] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:48.010882 25229 raft_consensus.cc:2393] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 16: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:47.921665 30403 consensus_queue.cc:260] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:48.011847 30403 raft_consensus.cc:3060] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:48.015048 30565 raft_consensus.cc:3055] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:48.015518 30565 raft_consensus.cc:740] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:48.016294 30565 consensus_queue.cc:260] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:48.017243 30565 raft_consensus.cc:3060] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:47.973201 30646 raft_consensus.cc:2749] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:48.020846 30594 consensus_queue.cc:1048] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:48.023029 30576 leader_election.cc:290] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:48.027716 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:48.028344 30499 raft_consensus.cc:493] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:48.029062 30499 raft_consensus.cc:515] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:48.032066 25908 raft_consensus.cc:2468] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 16.
I20260709 13:12:48.033464 30457 raft_consensus.cc:493] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.034013 30457 raft_consensus.cc:515] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:48.034379 30499 leader_election.cc:290] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:48.035171 30570 raft_consensus.cc:493] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.035359 30538 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:48.035729 30570 raft_consensus.cc:515] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:48.035948 25270 leader_election.cc:304] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:48.036953 30499 raft_consensus.cc:2749] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:48.037686 30570 leader_election.cc:290] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:48.040127 25195 leader_election.cc:304] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:12:48.037679 30538 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:48.005573 30586 raft_consensus.cc:515] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:48.044919 30457 leader_election.cc:290] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:48.044996 25901 raft_consensus.cc:2468] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 16.
I20260709 13:12:48.046593 30576 raft_consensus.cc:2804] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:12:48.047125 30586 leader_election.cc:290] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 16 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:48.047138 30576 raft_consensus.cc:697] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 16 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:48.048621 30576 consensus_queue.cc:237] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:48.050489 30564 leader_election.cc:290] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:48.053295 25903 raft_consensus.cc:2468] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 10.
I20260709 13:12:48.054206 30171 leader_election.cc:290] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:48.057580 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:48.058945 25195 leader_election.cc:304] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:12:48.062072 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:48.062888 25377 raft_consensus.cc:2468] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 13.
I20260709 13:12:48.066901 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:48.066884 30171 raft_consensus.cc:2804] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:48.070003 30171 raft_consensus.cc:493] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:48.070999 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:48.075309 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:12:48.076138 25271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:48.076282 25228 raft_consensus.cc:2393] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 16: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:48.070377 30171 raft_consensus.cc:3060] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:48.091869 25227 raft_consensus.cc:1240] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:12:48.065730 30564 raft_consensus.cc:493] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:48.095387 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:48.096625 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:48.100116 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:48.099110 25270 leader_election.cc:304] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:48.100872 25223 raft_consensus.cc:2393] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 16: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:48.104238 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:48.130293 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:48.129639 30416 raft_consensus.cc:2804] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:48.125218 30564 raft_consensus.cc:515] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:48.141119 30129 raft_consensus.cc:2749] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:48.141247 30416 raft_consensus.cc:493] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:48.163107 30534 raft_consensus.cc:493] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:48.138778 30537 raft_consensus.cc:515] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:48.164667 30580 raft_consensus.cc:493] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:48.177321 30416 raft_consensus.cc:3060] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:48.188454 25376 raft_consensus.cc:2368] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for earlier term 16. Current term is 17.
I20260709 13:12:48.191278 25908 raft_consensus.cc:1240] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 LEADER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:12:48.203414 30564 leader_election.cc:290] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:48.205331 30537 leader_election.cc:290] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 17 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:48.207499 30388 raft_consensus.cc:515] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:48.183969 30580 raft_consensus.cc:515] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:48.211764 30580 leader_election.cc:290] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:48.213146 30421 raft_consensus.cc:493] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.215322 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:48.198280 25271 leader_election.cc:304] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:48.221958 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:48.222597 25374 raft_consensus.cc:3060] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:48.182061 30534 raft_consensus.cc:515] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:48.213729 30421 raft_consensus.cc:515] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:48.233806 25374 raft_consensus.cc:2468] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 14.
I20260709 13:12:48.239923 30643 raft_consensus.cc:2749] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:48.240281 25271 leader_election.cc:304] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:48.241189 30643 raft_consensus.cc:2749] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:48.237129 25270 leader_election.cc:304] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:48.214753 30388 leader_election.cc:290] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:48.256366 25298 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57256 (request call id 2379) took 1933 ms (client timeout 1571 ms). Trace:
W20260709 13:12:48.256877 25298 rpcz_store.cc:269] 0709 13:12:46.319503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:46.319609 (+   106us) service_pool.cc:224] Handling call
0709 13:12:48.252686 (+1933077us) spinlock_profiling.cc:243] Waited 459 ms on lock 0x7b54001f18d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:48.252788 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1056145280}
I20260709 13:12:48.280664 30421 leader_election.cc:290] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:48.282375 30416 raft_consensus.cc:515] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:48.284514 30416 leader_election.cc:290] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:48.291546 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:48.297714 25304 raft_consensus.cc:1275] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:12:48.299418 25299 raft_consensus.cc:1275] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:12:48.278160 30587 raft_consensus.cc:2804] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:48.305382 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:48.301707 25195 leader_election.cc:304] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:12:48.312158 25378 raft_consensus.cc:2468] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 13.
I20260709 13:12:48.307103 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:48.310016 30171 raft_consensus.cc:515] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:48.313390 30624 raft_consensus.cc:2804] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:48.313820 30624 raft_consensus.cc:493] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:48.314184 30624 raft_consensus.cc:3060] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:48.314030 25270 leader_election.cc:304] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:48.313133 25374 raft_consensus.cc:3060] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:48.315251 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:48.317632 25299 raft_consensus.cc:1275] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:12:48.319056 30388 raft_consensus.cc:493] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:48.319577 30388 raft_consensus.cc:515] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:48.322367 30587 raft_consensus.cc:697] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 14 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:48.323294 30587 consensus_queue.cc:237] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:48.326632 30571 raft_consensus.cc:2804] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:48.327076 30571 raft_consensus.cc:493] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:48.327404 30571 raft_consensus.cc:3060] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:48.325496 25374 raft_consensus.cc:2468] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 14.
I20260709 13:12:48.335016 25195 leader_election.cc:304] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:48.337298 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:48.335057 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:48.340294 25296 raft_consensus.cc:3060] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:12:48.345139 25221 raft_consensus.cc:1275] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:12:48.346657 25270 leader_election.cc:304] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:48.348640 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:48.351971 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:48.352633 25224 raft_consensus.cc:3060] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:48.355007 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:48.355960 25227 raft_consensus.cc:2468] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 13.
I20260709 13:12:48.362597 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
W20260709 13:12:48.366460 25345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:48.370039 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:48.370779 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:48.373919 25299 raft_consensus.cc:1275] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 18 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 16 index: 7. Preceding OpId from leader: term: 18 index: 8. (index mismatch)
I20260709 13:12:48.361258 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:48.338905 30574 raft_consensus.cc:2749] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:48.338608 30529 raft_consensus.cc:493] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:48.389508 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:48.388587 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:48.321640 30388 leader_election.cc:290] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:48.392885 25230 raft_consensus.cc:2393] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 11: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:48.407055 25372 raft_consensus.cc:2468] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 16.
I20260709 13:12:48.408614 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:48.409649 25297 raft_consensus.cc:1275] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:12:48.360718 30538 raft_consensus.cc:493] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.413159 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:48.413625 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:48.362269 30504 raft_consensus.cc:2749] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:48.420181 25227 raft_consensus.cc:2393] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 14: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:48.373453 30594 raft_consensus.cc:2804] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:48.372741 30416 raft_consensus.cc:493] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:48.425081 25228 raft_consensus.cc:1275] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:12:48.365051 30632 consensus_queue.cc:1048] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:12:48.420642 30538 raft_consensus.cc:515] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:48.372514 30537 consensus_queue.cc:1048] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:12:48.364593 30576 consensus_queue.cc:1048] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:12:48.375480 30627 consensus_queue.cc:1048] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:12:48.448815 30576 consensus_queue.cc:1243] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer 79d99c0e498349bda74127365219e468 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:12:48.440142 30594 raft_consensus.cc:697] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 14 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:48.450037 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:48.450500 30538 leader_election.cc:290] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:48.450682 25378 raft_consensus.cc:2468] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 16.
I20260709 13:12:48.450817 30594 consensus_queue.cc:237] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:48.451707 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:48.452231 25378 raft_consensus.cc:2468] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 16.
I20260709 13:12:48.455809 30171 leader_election.cc:290] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:48.456529 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:48.457702 30416 raft_consensus.cc:515] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:48.459204 30342 raft_consensus.cc:3055] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:48.459609 30342 raft_consensus.cc:740] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:48.460492 30342 consensus_queue.cc:260] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:48.398181 30529 raft_consensus.cc:515] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:48.464270 30529 leader_election.cc:290] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:48.466688 25873 leader_election.cc:304] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:48.411605 25296 raft_consensus.cc:2468] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 17.
I20260709 13:12:48.469259 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:48.460923 30416 leader_election.cc:290] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:48.474110 25372 raft_consensus.cc:2393] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 10: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:48.486013 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:48.493665 25228 raft_consensus.cc:2393] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 17: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:48.479813 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:48.495623 25227 raft_consensus.cc:3060] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:48.499065 25195 leader_election.cc:304] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:48.470292 30479 raft_consensus.cc:493] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:48.481016 30387 raft_consensus.cc:2804] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:12:48.513124 25345 leader_election.cc:304] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:48.519920 25345 leader_election.cc:304] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:48.506515 30342 raft_consensus.cc:3060] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:48.512400 30598 raft_consensus.cc:2804] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:48.513514 30403 raft_consensus.cc:493] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.522410 30537 raft_consensus.cc:2749] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:12:48.535319 25227 raft_consensus.cc:2468] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 17.
I20260709 13:12:48.512544 30542 consensus_queue.cc:1048] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:12:48.535586 30598 raft_consensus.cc:493] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:48.520443 30479 raft_consensus.cc:515] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:48.535441 30580 raft_consensus.cc:493] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.536132 30387 raft_consensus.cc:697] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:48.543440 30651 raft_consensus.cc:493] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.559398 30651 raft_consensus.cc:515] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:48.541216 30403 raft_consensus.cc:515] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:48.535799 30171 consensus_queue.cc:1048] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:12:48.536600 30583 consensus_queue.cc:1048] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:12:48.561650 30651 leader_election.cc:290] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:48.562705 30387 consensus_queue.cc:237] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:48.546505 30598 raft_consensus.cc:3060] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:48.546936 30576 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.594099 30576 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:48.561826 30659 log.cc:927] Time spent T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 13:12:48.596678 30647 log.cc:927] Time spent T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.376s	user 0.003s	sys 0.000s
I20260709 13:12:48.596999 30576 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:48.564335 30479 leader_election.cc:290] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:48.614158 25224 raft_consensus.cc:2468] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 14.
I20260709 13:12:48.623278 30342 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.623927 30342 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:48.626065 30663 raft_consensus.cc:2749] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:48.533638 30624 raft_consensus.cc:515] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:48.627089 30342 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:48.629025 30624 leader_election.cc:290] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 17 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:48.614080 30580 raft_consensus.cc:515] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:48.599679 30403 leader_election.cc:290] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:48.593614 30598 raft_consensus.cc:515] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:48.632721 30580 leader_election.cc:290] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:48.634239 30598 leader_election.cc:290] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 17 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:48.635246 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:12:48.636164 30653 log.cc:927] Time spent T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.415s	user 0.001s	sys 0.001s
I20260709 13:12:48.637728 30571 raft_consensus.cc:515] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:48.653182 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 119903us
I20260709 13:12:48.657164 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:48.658100 25224 raft_consensus.cc:2393] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 17: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:48.661106 25227 raft_consensus.cc:1275] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:12:48.661598 25304 raft_consensus.cc:1240] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 14 LEADER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 13. Current term is 14. Ops: []
W20260709 13:12:48.666666 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 145124us
I20260709 13:12:48.660985 30598 consensus_queue.cc:1048] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:12:48.706954 30571 leader_election.cc:290] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:48.713497 25345 leader_election.cc:304] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:48.717355 30129 raft_consensus.cc:2804] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:12:48.717430 30542 consensus_queue.cc:1048] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:48.718046 30129 raft_consensus.cc:697] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 17 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:48.718931 30129 consensus_queue.cc:237] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:48.719559 30516 leader_election.cc:290] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:47.912472 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:48.734424 25375 raft_consensus.cc:1275] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:12:48.731333 30580 consensus_queue.cc:1059] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:48.735325 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:48.745615 25370 raft_consensus.cc:2393] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 10: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:48.744643 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:48.735507 25378 raft_consensus.cc:1240] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 13. Current term is 14. Ops: [11.6-13.7]
I20260709 13:12:48.739246 25377 raft_consensus.cc:1275] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:12:48.740885 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:48.741919 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:48.748539 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:48.749142 25372 raft_consensus.cc:3060] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:48.753244 25270 leader_election.cc:304] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:48.748490 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:48.754854 25375 raft_consensus.cc:3060] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:48.763031 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:48.763700 25370 raft_consensus.cc:3060] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:48.772910 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:48.776542 25299 raft_consensus.cc:1275] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:12:48.775218 30648 raft_consensus.cc:2749] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:48.791273 30630 consensus_queue.cc:1048] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:12:48.778124 30671 consensus_queue.cc:1048] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:12:48.803364 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:48.804157 25373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36254 (request call id 2582) took 1119 ms. Trace:
I20260709 13:12:48.804543 25373 rpcz_store.cc:276] 0709 13:12:47.685188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:47.685982 (+   794us) service_pool.cc:224] Handling call
0709 13:12:48.803976 (+1117994us) spinlock_profiling.cc:243] Waited 261 ms on lock 0x7b54000bac54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:48.804075 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":600163072}
I20260709 13:12:48.810540 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:48.811743 30589 raft_consensus.cc:3060] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:48.823908 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:48.746964 30171 consensus_queue.cc:1048] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:12:48.825254 25372 raft_consensus.cc:2468] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 17.
I20260709 13:12:48.832350 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:48.778887 30580 consensus_queue.cc:1059] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:12:48.863031 25370 raft_consensus.cc:2468] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 17.
W20260709 13:12:48.863873 25271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:48.848819 25372 raft_consensus.cc:1275] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 18 index: 8. (term mismatch)
I20260709 13:12:48.866142 25372 pending_rounds.cc:85] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468: Aborting all ops after (but not including) 7
I20260709 13:12:48.866770 25372 pending_rounds.cc:107] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468: Aborting uncommitted NO_OP operation due to leader change: 17.8
I20260709 13:12:48.841399 25375 raft_consensus.cc:2468] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 14.
I20260709 13:12:48.867900 25372 raft_consensus.cc:2889] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:12:48.878053 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:48.844058 30580 consensus_queue.cc:1243] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer 79d99c0e498349bda74127365219e468 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:12:48.843276 30171 raft_consensus.cc:493] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.879659 30171 raft_consensus.cc:515] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:48.882128 25225 raft_consensus.cc:1275] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:12:48.886696 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:48.887668 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:48.888669 25221 raft_consensus.cc:2410] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 15 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:12:48.891676 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:48.892248 25227 raft_consensus.cc:2468] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 16.
I20260709 13:12:48.894444 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:48.895007 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:48.895552 25227 raft_consensus.cc:3060] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:48.901539 25229 raft_consensus.cc:1240] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:12:48.903698 25221 raft_consensus.cc:1275] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:12:48.909016 25271 leader_election.cc:304] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:48.897668 30171 leader_election.cc:290] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:48.900456 30580 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.938262 30580 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:48.939618 30534 leader_election.cc:290] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:48.941098 30580 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:48.943136 30644 raft_consensus.cc:2749] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:48.933094 25270 leader_election.cc:400] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091) with higher term. Message: Invalid argument: T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for earlier term 16. Current term is 17.
I20260709 13:12:48.934149 30585 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.944325 30585 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:48.946465 30585 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:48.946892 25270 leader_election.cc:403] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:48.947248 30572 raft_consensus.cc:3060] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:48.950441 30536 raft_consensus.cc:3060] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:48.954373 25271 leader_election.cc:304] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:48.931840 30646 raft_consensus.cc:493] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.954875 25227 raft_consensus.cc:2468] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 14.
I20260709 13:12:48.967361 30646 raft_consensus.cc:515] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:48.968320 30571 raft_consensus.cc:2749] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:48.955855 25270 leader_election.cc:304] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:48.969623 30646 leader_election.cc:290] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:48.970604 30646 raft_consensus.cc:493] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:48.971118 30515 raft_consensus.cc:493] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:48.971328 25224 raft_consensus.cc:1275] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:12:48.971254 30646 raft_consensus.cc:515] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:48.973282 25221 raft_consensus.cc:1275] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:12:48.974558 30646 leader_election.cc:290] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:48.977214 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:48.978295 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:48.954823 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:48.979347 25377 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 11.
I20260709 13:12:48.980598 25900 raft_consensus.cc:1275] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:12:48.979773 25271 leader_election.cc:304] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:48.981599 25195 leader_election.cc:304] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:48.982111 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:48.982515 25195 leader_election.cc:304] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:48.984308 25873 leader_election.cc:304] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:48.985100 25270 leader_election.cc:304] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:12:48.985823 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:48.986778 30488 raft_consensus.cc:493] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:48.986892 30577 raft_consensus.cc:2804] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:12:48.987548 30577 raft_consensus.cc:697] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 17 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:48.987391 30488 raft_consensus.cc:515] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:48.988591 30577 consensus_queue.cc:237] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:48.991648 30657 log.cc:927] Time spent T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.770s	user 0.003s	sys 0.002s
I20260709 13:12:48.993059 25903 raft_consensus.cc:2468] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 10.
I20260709 13:12:48.993243 25296 raft_consensus.cc:2468] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 17.
I20260709 13:12:48.994177 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:48.994777 25908 raft_consensus.cc:2468] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 15.
I20260709 13:12:48.994706 25873 leader_election.cc:304] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:48.996933 25371 raft_consensus.cc:1275] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:12:48.989508 30488 leader_election.cc:290] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:48.998023 30625 raft_consensus.cc:2749] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:48.999087 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:49.001183 25302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57256 (request call id 2427) took 1161 ms. Trace:
I20260709 13:12:48.956960 30342 raft_consensus.cc:2749] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091) with higher term. Message: Invalid argument: T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for earlier term 16. Current term is 17.
I20260709 13:12:49.004045 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:49.006059 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 18 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:49.003134 25302 rpcz_store.cc:276] 0709 13:12:47.839577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:47.843715 (+  4138us) service_pool.cc:224] Handling call
0709 13:12:47.844038 (+   323us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:48.072964 (+228926us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:48.073010 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:48.099149 (+ 26139us) log.cc:844] Serialized 52 byte log entry
0709 13:12:48.183528 (+ 84379us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:12:48.316251 (+132723us) log.cc:844] Serialized 14 byte log entry
0709 13:12:48.336024 (+ 19773us) log.cc:844] Serialized 14 byte log entry
0709 13:12:48.336263 (+   239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:48.336364 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:48.991040 (+654676us) spinlock_profiling.cc:243] Waited 8.12 ms on lock 0x7b4400022b4c. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72caa8c85 00007fd72caa96a2 00007fd72f81b1db 00007fd72f816aaf 00007fd72f80a86e 00007fd72f809bb6 00007fd72f8097d8 00007fd72f813221 00007fd72f8131d9 00007fd72f813169
0709 13:12:49.000997 (+  9957us) raft_consensus.cc:1685] finished
0709 13:12:49.001023 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:49.001137 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40793,"prepare.queue_time_us":53520,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":5948,"raft.queue_time_us":60107,"raft.run_cpu_time_us":328,"raft.run_wall_time_us":31292,"spinlock_wait_cycles":18686208,"thread_start_us":361771,"threads_started":3,"wal-append.queue_time_us":95647}
I20260709 13:12:48.984524 30559 raft_consensus.cc:2804] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:12:49.000717 30277 raft_consensus.cc:2804] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:49.010249 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:49.002924 30565 raft_consensus.cc:2749] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:48.983506 30515 raft_consensus.cc:515] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:49.013643 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:48.994705 30171 consensus_queue.cc:1048] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:12:49.018113 25271 leader_election.cc:304] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:49.004889 30503 raft_consensus.cc:2804] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:49.006669 30571 consensus_queue.cc:1048] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 13:12:49.036631 25195 leader_election.cc:304] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:49.012988 30277 raft_consensus.cc:493] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:49.037956 25195 leader_election.cc:304] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:49.038071 30277 raft_consensus.cc:3060] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:49.026273 30396 consensus_queue.cc:1048] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:12:49.020659 30503 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:49.022886 30589 raft_consensus.cc:2804] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:49.032127 30598 raft_consensus.cc:3055] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:49.033722 30515 leader_election.cc:290] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:49.039947 25195 leader_election.cc:304] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:12:49.015444 30559 raft_consensus.cc:697] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 17 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:49.047716 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:49.010928 30488 consensus_queue.cc:1048] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:12:49.041252 30503 raft_consensus.cc:3060] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:49.053886 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:49.053886 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:49.055586 25899 raft_consensus.cc:2410] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:12:49.056248 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:49.059918 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:49.061506 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:49.038710 30171 raft_consensus.cc:2749] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:49.053782 30589 raft_consensus.cc:697] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 14 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:49.073947 30580 raft_consensus.cc:493] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.041561 30439 raft_consensus.cc:2749] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:49.079389 25301 raft_consensus.cc:1275] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 13:12:49.079813 25301 pending_rounds.cc:85] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19: Aborting all ops after (but not including) 7
I20260709 13:12:49.080040 25301 pending_rounds.cc:107] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:12:49.080271 25301 raft_consensus.cc:2889] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:49.041574 30598 raft_consensus.cc:740] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:49.044595 30624 consensus_queue.cc:1048] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
W20260709 13:12:49.091073 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 73072.7us
I20260709 13:12:49.093220 30439 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.093415 25301 raft_consensus.cc:1275] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:12:49.093142 30559 consensus_queue.cc:237] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:49.093916 30439 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:49.095146 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:49.096244 30439 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:49.096490 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 18 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:49.097366 25304 raft_consensus.cc:2410] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:12:49.089802 30580 raft_consensus.cc:515] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:49.099910 30580 leader_election.cc:290] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:49.100706 25297 raft_consensus.cc:1275] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:12:49.101138 30589 consensus_queue.cc:237] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:49.103368 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:49.104012 25303 raft_consensus.cc:2468] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 14.
I20260709 13:12:49.113355 25902 raft_consensus.cc:2468] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 14.
I20260709 13:12:49.114554 25344 leader_election.cc:304] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:49.079640 30576 raft_consensus.cc:2804] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:49.114485 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:49.139297 25300 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 11.
I20260709 13:12:49.116362 25344 leader_election.cc:304] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:49.156450 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:49.106637 30648 raft_consensus.cc:2804] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:49.154486 25344 leader_election.cc:304] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:12:49.160399 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:49.169198 30648 raft_consensus.cc:697] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 14 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
W20260709 13:12:49.176972 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:49.090142 30640 consensus_queue.cc:1048] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 13:12:49.181265 25305 raft_consensus.cc:1275] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:12:49.117187 30666 raft_consensus.cc:2749] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:49.182646 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:49.190069 25345 leader_election.cc:304] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:49.149698 30528 raft_consensus.cc:2749] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:49.192080 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:12:49.190924 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 151156us
I20260709 13:12:49.202739 25228 raft_consensus.cc:2468] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 16.
I20260709 13:12:49.171533 30576 raft_consensus.cc:697] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 10 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:49.210526 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:49.184248 30338 raft_consensus.cc:2804] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:49.215502 25298 raft_consensus.cc:2468] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 16.
I20260709 13:12:49.217046 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:49.205957 30129 raft_consensus.cc:2749] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:49.181113 30598 consensus_queue.cc:260] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:49.184535 30277 raft_consensus.cc:515] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:49.191527 30516 consensus_queue.cc:1048] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:12:49.254117 30479 raft_consensus.cc:3055] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:12:49.254684 30479 raft_consensus.cc:740] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:49.255846 25271 leader_election.cc:304] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:49.255744 30479 consensus_queue.cc:260] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:49.266105 25872 leader_election.cc:304] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:12:49.280144 25908 raft_consensus.cc:3060] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:49.241418 30338 raft_consensus.cc:697] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 14 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
W20260709 13:12:49.315102 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 49098.7us
I20260709 13:12:49.318912 25908 raft_consensus.cc:2468] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 17.
W20260709 13:12:49.315845 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:49.275525 30661 log.cc:927] Time spent T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:12:49.318010 25298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57256 (request call id 2429) took 1031 ms. Trace:
W20260709 13:12:49.318286 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 49123.6us
I20260709 13:12:49.320410 25298 rpcz_store.cc:276] 0709 13:12:48.286665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:48.286838 (+   173us) service_pool.cc:224] Handling call
0709 13:12:49.317822 (+1030984us) spinlock_profiling.cc:243] Waited 923 ms on lock 0x7b54001699d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:49.317946 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2123071872}
W20260709 13:12:49.323941 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 133948us
I20260709 13:12:49.277280 30574 raft_consensus.cc:2804] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:49.239934 30171 consensus_queue.cc:1059] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 13:12:49.344020 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:49.347978 25298 raft_consensus.cc:2468] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 12.
I20260709 13:12:49.348142 25374 raft_consensus.cc:2468] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 11.
I20260709 13:12:49.311090 30479 raft_consensus.cc:3060] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:49.262183 30688 consensus_queue.cc:1048] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.097s
I20260709 13:12:49.332072 30603 raft_consensus.cc:2804] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:49.356591 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:49.228185 30648 consensus_queue.cc:237] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:49.338035 30574 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:49.368937 25872 leader_election.cc:304] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:49.372754 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 180096us
I20260709 13:12:49.362352 30171 consensus_queue.cc:1243] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Peer da445ce82dc4467f95f4fa52297eaa19 log is divergent from this leader: its last log entry 14.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:12:49.339437 30636 consensus_queue.cc:1048] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:12:49.361248 30603 raft_consensus.cc:493] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:49.376693 30574 raft_consensus.cc:3060] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:49.391764 25373 raft_consensus.cc:1275] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:12:49.387955 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 54525.6us
I20260709 13:12:49.402360 25377 raft_consensus.cc:1240] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 13. Current term is 14. Ops: [11.6-13.7]
I20260709 13:12:49.404286 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:12:49.388244 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 55106.4us
I20260709 13:12:49.336229 30576 consensus_queue.cc:237] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:49.385825 30129 raft_consensus.cc:493] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:49.384085 30640 raft_consensus.cc:2749] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:49.413234 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:12:49.414844 30687 log.cc:927] Time spent T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 13:12:49.415055 30129 raft_consensus.cc:515] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:49.390432 30603 raft_consensus.cc:3060] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:49.418448 25371 raft_consensus.cc:1240] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:12:49.422065 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:49.390219 30338 consensus_queue.cc:237] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:49.444412 25378 raft_consensus.cc:2410] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:12:49.448215 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:49.455688 30516 consensus_queue.cc:1048] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:12:49.462077 30277 leader_election.cc:290] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 16 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:49.467072 25371 raft_consensus.cc:1240] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:12:49.457049 25872 leader_election.cc:304] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:12:49.482033 25343 leader_election.cc:304] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:12:49.508248 25300 raft_consensus.cc:1275] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:12:49.484182 30636 raft_consensus.cc:2804] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:49.498435 30646 raft_consensus.cc:2804] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:49.520999 25373 raft_consensus.cc:1275] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:12:49.498032 30129 leader_election.cc:290] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:49.468921 30574 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:49.540591 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:49.541546 25299 raft_consensus.cc:2468] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 13.
I20260709 13:12:49.546609 30181 raft_consensus.cc:493] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.546705 30503 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:49.547354 30181 raft_consensus.cc:515] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:49.549244 30503 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 17 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:49.549405 30181 leader_election.cc:290] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:49.558202 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:49.561538 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:49.562938 25301 raft_consensus.cc:2393] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 17: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:49.517887 30636 raft_consensus.cc:493] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:49.570999 25374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36254 (request call id 2608) took 1231 ms. Trace:
I20260709 13:12:49.571610 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:49.574241 25298 raft_consensus.cc:2393] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 17: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:49.575647 30574 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 17 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:49.576686 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:49.518296 30572 consensus_queue.cc:1048] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:12:49.577405 25228 raft_consensus.cc:3060] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:49.531391 30646 raft_consensus.cc:493] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:49.571584 25374 rpcz_store.cc:276] 0709 13:12:48.339801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:48.339944 (+   143us) service_pool.cc:224] Handling call
0709 13:12:49.570785 (+1230841us) spinlock_profiling.cc:243] Waited 973 ms on lock 0x7b5400311fd4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:49.570924 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2236887808}
I20260709 13:12:49.581123 25270 leader_election.cc:304] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:49.527778 30697 consensus_queue.cc:1048] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:12:49.567871 30636 raft_consensus.cc:3060] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:49.602119 25194 leader_election.cc:304] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:49.616503 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 397909us
I20260709 13:12:49.623369 25194 leader_election.cc:304] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:12:49.598062 30704 raft_consensus.cc:493] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:49.632650 25379 raft_consensus.cc:1275] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:12:49.635787 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:49.636538 25374 raft_consensus.cc:3060] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:49.638181 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:49.586639 30646 raft_consensus.cc:3060] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:49.631654 25343 leader_election.cc:304] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:49.591931 30416 raft_consensus.cc:2749] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:12:49.576862 30644 consensus_queue.cc:1048] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:12:49.663661 25270 leader_election.cc:304] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:12:49.666049 25270 leader_election.cc:304] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:49.590178 30439 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.674700 30705 raft_consensus.cc:2804] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:49.674585 30565 consensus_queue.cc:1048] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:49.675348 30705 raft_consensus.cc:493] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:49.675791 30705 raft_consensus.cc:3060] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:49.639366 30504 consensus_queue.cc:1048] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:12:49.683823 30516 raft_consensus.cc:2804] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:49.684276 30516 raft_consensus.cc:493] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:49.684662 30516 raft_consensus.cc:3060] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:49.627480 30624 raft_consensus.cc:2749] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:49.635273 30688 raft_consensus.cc:2804] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:12:49.707929 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:49.785905 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 94684us
I20260709 13:12:49.650015 30580 raft_consensus.cc:493] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.658622 30644 consensus_queue.cc:1243] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer 79d99c0e498349bda74127365219e468 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:12:49.817528 25374 raft_consensus.cc:2468] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 17.
I20260709 13:12:49.819480 25270 leader_election.cc:304] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:49.820537 30572 raft_consensus.cc:2804] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:12:49.823470 30572 raft_consensus.cc:697] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 17 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:49.824406 30705 raft_consensus.cc:515] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:49.824677 30572 consensus_queue.cc:237] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:49.826864 30705 leader_election.cc:290] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:49.820609 25228 raft_consensus.cc:2468] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 17.
I20260709 13:12:49.688169 30565 raft_consensus.cc:2749] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:49.780469 30688 raft_consensus.cc:493] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:49.832093 30688 raft_consensus.cc:3060] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:49.626529 30704 raft_consensus.cc:515] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:49.835362 30704 leader_election.cc:290] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:49.839402 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:49.840567 25230 raft_consensus.cc:1275] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:12:49.841233 25374 pending_rounds.cc:85] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468: Aborting all ops after (but not including) 5
I20260709 13:12:49.841547 25374 pending_rounds.cc:107] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:12:49.841804 25374 raft_consensus.cc:2889] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:49.842110 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:49.840545 25228 raft_consensus.cc:2393] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 11: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:49.628170 30603 raft_consensus.cc:515] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:49.841259 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:49.857721 30565 consensus_queue.cc:1048] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:49.859068 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:49.767043 30439 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:49.843528 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 212548us
I20260709 13:12:49.868191 25194 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:49.871959 25270 leader_election.cc:304] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:49.853065 30516 raft_consensus.cc:515] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:49.878266 25194 leader_election.cc:304] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:49.885434 25375 raft_consensus.cc:1275] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 13:12:49.918774 25194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:49.919155 25379 raft_consensus.cc:2468] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 11.
I20260709 13:12:49.821449 30580 raft_consensus.cc:515] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:49.873081 30577 raft_consensus.cc:2804] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:49.922633 25270 leader_election.cc:304] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:12:49.892810 30704 raft_consensus.cc:2749] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:49.923834 30624 raft_consensus.cc:2749] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:49.927225 30577 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:49.942687 30598 raft_consensus.cc:3060] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:49.936663 30439 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:49.922911 30515 consensus_queue.cc:1059] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:12:49.966023 30571 raft_consensus.cc:2804] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:49.958227 30718 raft_consensus.cc:493] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:49.963181 30542 raft_consensus.cc:493] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:49.969772 30577 raft_consensus.cc:3060] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:49.954649 30646 raft_consensus.cc:515] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:50.027367 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 104857us
I20260709 13:12:50.002023 30663 raft_consensus.cc:493] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:50.015555 30671 raft_consensus.cc:493] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:50.028820 30571 raft_consensus.cc:697] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 11 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:50.083107 30571 consensus_queue.cc:237] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:50.055109 30559 raft_consensus.cc:493] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:50.057168 30671 raft_consensus.cc:515] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:50.060268 30516 leader_election.cc:290] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:50.061708 25908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50056 (request call id 915) took 1052 ms. Trace:
W20260709 13:12:50.070305 30717 log.cc:927] Time spent T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:12:50.095117 25908 rpcz_store.cc:276] 0709 13:12:49.009762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:49.010011 (+   249us) service_pool.cc:224] Handling call
0709 13:12:50.061512 (+1051501us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b5400710f54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:50.061617 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":616386304}
I20260709 13:12:50.024482 30542 raft_consensus.cc:515] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:50.017776 30718 raft_consensus.cc:515] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:50.043748 30663 raft_consensus.cc:515] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:50.158514 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:50.159111 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:50.161201 25224 raft_consensus.cc:2393] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 13: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:50.163502 25227 raft_consensus.cc:1275] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:12:50.142807 30603 leader_election.cc:290] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 17 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:50.167810 25222 raft_consensus.cc:1275] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260709 13:12:50.171248 30723 log.cc:927] Time spent T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 13:12:50.099489 30559 raft_consensus.cc:515] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:50.156795 30504 raft_consensus.cc:493] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.155526 30689 raft_consensus.cc:493] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.128465 30636 raft_consensus.cc:515] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:50.221797 30559 leader_election.cc:290] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:50.223206 30646 leader_election.cc:290] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 16 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:50.225147 30671 leader_election.cc:290] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:50.226403 30724 log.cc:927] Time spent T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:12:50.228163 30688 raft_consensus.cc:515] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:50.221820 30636 leader_election.cc:290] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:50.231218 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:50.233006 30688 leader_election.cc:290] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:50.233347 25230 raft_consensus.cc:1240] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:12:50.175792 30580 leader_election.cc:290] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:50.217324 30687 log.cc:927] Time spent T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:12:50.225648 25297 raft_consensus.cc:2468] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 17.
I20260709 13:12:50.320024 25872 leader_election.cc:304] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:50.219619 30504 raft_consensus.cc:515] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:50.323840 30277 raft_consensus.cc:2804] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:12:50.323807 30540 raft_consensus.cc:493] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:50.239866 30689 raft_consensus.cc:515] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:50.336777 30504 leader_election.cc:290] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:50.338733 30540 raft_consensus.cc:515] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:50.345928 30728 log.cc:927] Time spent T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
W20260709 13:12:50.348220 30733 log.cc:927] Time spent T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 13:12:50.353329 25298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57272 (request call id 2292) took 1121 ms. Trace:
I20260709 13:12:50.353781 25298 rpcz_store.cc:276] 0709 13:12:49.232484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:49.349259 (+116775us) service_pool.cc:224] Handling call
0709 13:12:50.353126 (+1003867us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b5400168fd4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:50.353268 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":477851008}
I20260709 13:12:50.339345 30277 raft_consensus.cc:697] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:50.359110 30277 consensus_queue.cc:237] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:50.363134 30689 leader_election.cc:290] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:50.366072 30540 leader_election.cc:290] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:50.375689 25225 raft_consensus.cc:1275] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
I20260709 13:12:50.376108 25225 pending_rounds.cc:85] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce: Aborting all ops after (but not including) 6
I20260709 13:12:50.376343 25225 pending_rounds.cc:107] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 13:12:50.376561 25225 raft_consensus.cc:2889] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:50.382889 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:50.383615 25222 raft_consensus.cc:2393] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 17: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:50.385087 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:50.466197 30598 raft_consensus.cc:493] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.508108 30542 leader_election.cc:290] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:50.563977 30577 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:50.580112 30598 raft_consensus.cc:515] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:50.582340 25221 raft_consensus.cc:1240] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:12:50.595575 30387 raft_consensus.cc:493] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:50.595851 30537 raft_consensus.cc:493] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:50.596189 30387 raft_consensus.cc:515] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:50.596562 30537 raft_consensus.cc:515] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:50.599196 30537 leader_election.cc:290] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:50.602767 30639 raft_consensus.cc:493] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:50.605937 30639 raft_consensus.cc:515] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:50.608209 30639 leader_election.cc:290] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:50.608695 30457 raft_consensus.cc:493] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:50.609236 30457 raft_consensus.cc:515] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:50.611809 30457 leader_election.cc:290] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:50.593298 30542 raft_consensus.cc:493] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:50.647081 30457 raft_consensus.cc:493] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:50.647691 30457 raft_consensus.cc:515] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:50.651010 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 47268.6us
I20260709 13:12:50.660310 30457 leader_election.cc:290] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:50.614486 30542 raft_consensus.cc:515] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:50.671797 30536 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.987s	user 0.016s	sys 0.021s
I20260709 13:12:50.670531 30688 raft_consensus.cc:493] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.665936 30689 raft_consensus.cc:493] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:50.665565 30504 raft_consensus.cc:493] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:50.652699 30718 leader_election.cc:290] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:50.682073 30536 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.997s	user 0.016s	sys 0.022s
I20260709 13:12:50.676714 30747 raft_consensus.cc:493] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:50.684513 30387 leader_election.cc:290] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:50.680262 30571 raft_consensus.cc:493] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:50.680099 30729 raft_consensus.cc:493] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:50.696465 25900 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489"
dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
mode: GRACEFUL
new_leader_uuid: "79d99c0e498349bda74127365219e468"
 from {username='slave'} at 127.0.0.1:56530
I20260709 13:12:50.730095 25900 raft_consensus.cc:606] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 LEADER]: Received request to transfer leadership to TS 79d99c0e498349bda74127365219e468
I20260709 13:12:50.695088 30689 raft_consensus.cc:515] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:50.693449 30688 raft_consensus.cc:515] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:50.704386 30537 raft_consensus.cc:493] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.709949 30580 raft_consensus.cc:493] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
W20260709 13:12:50.723152 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 136270us
I20260709 13:12:50.679571 30743 raft_consensus.cc:493] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:50.695245 30576 raft_consensus.cc:493] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:50.724699 30542 leader_election.cc:290] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:50.743988 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 76543.9us
I20260709 13:12:50.742064 30537 raft_consensus.cc:515] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:50.729732 30598 leader_election.cc:290] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:50.731793 30387 raft_consensus.cc:493] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.735040 30648 raft_consensus.cc:493] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:50.755124 25302 raft_consensus.cc:1240] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
W20260709 13:12:50.754220 25301 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57272 (request call id 2281) took 1659 ms (client timeout 1833 ms). Trace:
I20260709 13:12:50.733814 30729 raft_consensus.cc:515] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:50.756176 25301 rpcz_store.cc:269] 0709 13:12:49.094793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:49.094902 (+   109us) service_pool.cc:224] Handling call
0709 13:12:50.753966 (+1659064us) spinlock_profiling.cc:243] Waited 463 ms on lock 0x7b54002ca954. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:50.754140 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1064496512}
I20260709 13:12:50.761538 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:50.766122 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:50.767257 30537 leader_election.cc:290] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:50.768512 30688 leader_election.cc:290] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:50.726984 30504 raft_consensus.cc:515] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:50.773916 30746 log.cc:927] Time spent T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 13:12:50.730063 30747 raft_consensus.cc:515] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:50.775738 25301 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e"
dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
mode: GRACEFUL
new_leader_uuid: "79d99c0e498349bda74127365219e468"
 from {username='slave'} at 127.0.0.1:35660
I20260709 13:12:50.782150 25301 raft_consensus.cc:606] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 18 FOLLOWER]: Received request to transfer leadership to TS 79d99c0e498349bda74127365219e468
I20260709 13:12:50.782644 25301 raft_consensus.cc:614] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:50.733258 30571 raft_consensus.cc:515] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:50.746531 30580 raft_consensus.cc:515] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:50.758864 30577 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:50.749473 30576 raft_consensus.cc:515] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:50.749334 30743 raft_consensus.cc:515] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:50.806808 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 45446.1us
I20260709 13:12:50.757344 30387 raft_consensus.cc:515] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:50.764591 30648 raft_consensus.cc:515] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:12:50.817279 25301 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc"
dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
mode: GRACEFUL
new_leader_uuid: "1f539ba21487460085b837e7529a78ce"
 from {username='slave'} at 127.0.0.1:35660
I20260709 13:12:50.819267 25301 raft_consensus.cc:606] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Received request to transfer leadership to TS 1f539ba21487460085b837e7529a78ce
I20260709 13:12:50.819628 25301 raft_consensus.cc:614] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:50.813963 30747 leader_election.cc:290] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:50.826510 30729 leader_election.cc:290] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:50.829416 30750 log.cc:927] Time spent T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 13:12:50.820490 30748 log.cc:927] Time spent T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 13:12:50.835703 25900 raft_consensus.cc:1240] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:50.838667 25908 raft_consensus.cc:1275] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:12:50.841265 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:50.841950 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:50.842137 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:50.842553 25903 raft_consensus.cc:2468] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 17.
I20260709 13:12:50.844549 25225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 2604) took 1661 ms. Trace:
I20260709 13:12:50.845332 25230 raft_consensus.cc:1240] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 17 LEADER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:12:50.845628 25225 rpcz_store.cc:276] 0709 13:12:49.183187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:49.183373 (+   186us) service_pool.cc:224] Handling call
0709 13:12:49.194865 (+ 11492us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:50.376932 (+1182067us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:50.844300 (+467368us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54000eabd4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:50.844465 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2714768384}
W20260709 13:12:50.834908 30673 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.151s	user 0.004s	sys 0.021s
I20260709 13:12:50.831651 30387 leader_election.cc:290] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:50.851203 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:50.853471 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:50.855836 25230 raft_consensus.cc:2468] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 12.
I20260709 13:12:50.856280 25900 raft_consensus.cc:1275] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:12:50.843650 30537 raft_consensus.cc:493] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:50.858870 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:50.859946 25903 raft_consensus.cc:3055] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:12:50.860246 25222 raft_consensus.cc:2468] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 9.
I20260709 13:12:50.860407 25903 raft_consensus.cc:740] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:50.859421 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:50.861268 25900 raft_consensus.cc:2468] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 14.
I20260709 13:12:50.861864 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:12:50.855494 30673 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.172s	user 0.004s	sys 0.022s
I20260709 13:12:50.863198 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:51.004647 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:12:51.011703 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 100512us
I20260709 13:12:50.992755 30577 raft_consensus.cc:493] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:51.015328 30577 raft_consensus.cc:515] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:51.015837 25905 raft_consensus.cc:1275] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:12:51.017364 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:51.018575 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
W20260709 13:12:51.019529 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 107835us
I20260709 13:12:51.019891 30571 leader_election.cc:290] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:50.992298 30747 raft_consensus.cc:493] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:51.020695 25874 leader_election.cc:304] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:12:51.020979 30747 raft_consensus.cc:515] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:50.992491 30645 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:51.022684 30755 raft_consensus.cc:2804] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:51.022643 30645 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:50.864082 25903 consensus_queue.cc:260] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:51.023805 25903 raft_consensus.cc:3060] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:12:51.025812 30625 consensus_queue.cc:1175] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "1f539ba21487460085b837e7529a78ce" responder_term: 17 status { last_received { term: 17 index: 12 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 16. Current term is 17. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:12:50.862568 30537 raft_consensus.cc:515] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:51.023178 30755 raft_consensus.cc:493] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:51.051983 25903 raft_consensus.cc:1275] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 12. (term mismatch)
I20260709 13:12:51.052640 25903 pending_rounds.cc:85] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6: Aborting all ops after (but not including) 11
I20260709 13:12:51.052960 25903 pending_rounds.cc:107] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260709 13:12:51.053295 25903 raft_consensus.cc:2889] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:51.055624 25899 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1"
dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
mode: GRACEFUL
new_leader_uuid: "79d99c0e498349bda74127365219e468"
 from {username='slave'} at 127.0.0.1:56530
I20260709 13:12:51.058976 25899 raft_consensus.cc:606] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Received request to transfer leadership to TS 79d99c0e498349bda74127365219e468
I20260709 13:12:51.059293 25899 raft_consensus.cc:614] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:51.055974 30755 raft_consensus.cc:3060] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:51.055603 30624 raft_consensus.cc:493] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:51.075856 30537 leader_election.cc:290] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:51.057641 30598 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 18 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:51.079137 30718 raft_consensus.cc:493] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:51.100481 30718 raft_consensus.cc:515] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:51.102036 30598 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:51.102743 30718 leader_election.cc:290] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:51.103273 30718 raft_consensus.cc:493] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:51.055950 30688 raft_consensus.cc:493] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:51.104254 30598 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:51.104779 30598 raft_consensus.cc:493] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:51.104698 30688 raft_consensus.cc:515] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:51.106894 30688 leader_election.cc:290] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:51.058045 30671 consensus_queue.cc:1048] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 13:12:51.103760 30718 raft_consensus.cc:515] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:51.110024 30718 leader_election.cc:290] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:51.113188 30645 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:51.099610 30624 raft_consensus.cc:515] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:51.118465 30648 leader_election.cc:290] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361)
I20260709 13:12:51.119944 30129 raft_consensus.cc:493] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:51.120805 25303 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc7fda8ece3144099df1f442c8012dfd"
dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
mode: GRACEFUL
new_leader_uuid: "79d99c0e498349bda74127365219e468"
 from {username='slave'} at 127.0.0.1:35660
I20260709 13:12:51.121506 30342 raft_consensus.cc:493] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:51.126382 30181 consensus_queue.cc:1048] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:51.127720 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:51.129459 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:51.130316 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:51.160480 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:51.131810 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c29bb25d6947ddaa43c22713738514" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:51.105297 30598 raft_consensus.cc:515] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:51.145889 25303 raft_consensus.cc:606] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Received request to transfer leadership to TS 79d99c0e498349bda74127365219e468
I20260709 13:12:51.164987 30342 raft_consensus.cc:515] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:51.181313 30743 leader_election.cc:290] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:51.187718 30580 leader_election.cc:290] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:51.188252 30576 leader_election.cc:290] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:51.188575 30648 raft_consensus.cc:493] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:51.159500 30129 raft_consensus.cc:515] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:51.192193 30755 raft_consensus.cc:515] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:51.194205 30640 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 17 current term: 17 is higher.
I20260709 13:12:51.195453 25195 leader_election.cc:304] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:12:51.196564 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:51.210704 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:51.195192 30756 raft_consensus.cc:493] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:51.211730 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:51.197582 25303 raft_consensus.cc:614] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:51.214838 25228 raft_consensus.cc:1275] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:12:51.198467 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 339024us
I20260709 13:12:51.201002 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:51.216656 25221 raft_consensus.cc:1275] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:12:51.230793 25296 raft_consensus.cc:2468] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 16.
I20260709 13:12:51.242516 25300 raft_consensus.cc:2393] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 17: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:51.216861 25301 raft_consensus.cc:2468] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 16.
I20260709 13:12:51.244863 25221 raft_consensus.cc:1275] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:12:51.245633 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:51.244889 25344 leader_election.cc:304] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:51.249065 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:51.249948 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:12:51.251804 25874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:51.252561 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:51.255143 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:51.262080 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:51.262794 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:51.263983 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:51.264434 30696 raft_consensus.cc:2804] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:51.282855 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:51.284039 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:51.264987 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:51.265295 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:51.211328 30576 raft_consensus.cc:2804] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:51.286574 30576 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:51.266713 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:51.286923 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:51.287019 30576 raft_consensus.cc:3060] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:51.287880 25221 raft_consensus.cc:2468] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 17.
I20260709 13:12:51.291011 30387 consensus_queue.cc:1048] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:12:51.248955 30718 consensus_queue.cc:1048] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 13:12:51.295890 30129 leader_election.cc:290] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:51.296548 30129 consensus_queue.cc:1059] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:51.217937 30671 consensus_queue.cc:1048] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:12:51.300843 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:51.303148 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:51.304073 25194 leader_election.cc:304] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:51.222792 30580 raft_consensus.cc:493] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:51.308321 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:51.309178 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:51.358007 25300 raft_consensus.cc:3060] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:51.309955 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:51.208750 30648 raft_consensus.cc:515] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:51.324348 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:51.282558 30696 raft_consensus.cc:493] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:51.244349 30756 raft_consensus.cc:515] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:51.336403 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:51.342540 30342 leader_election.cc:290] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:51.254421 30537 consensus_queue.cc:1048] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.079s
I20260709 13:12:51.302726 30764 raft_consensus.cc:493] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.348691 25304 raft_consensus.cc:2468] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 13.
I20260709 13:12:51.354545 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:51.372762 25303 raft_consensus.cc:2410] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:12:51.250802 30639 consensus_queue.cc:1059] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 13:12:51.380232 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:12:51.359194 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 55165.4us
I20260709 13:12:51.361925 25221 raft_consensus.cc:2393] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 12: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
W20260709 13:12:51.383481 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 127287us
I20260709 13:12:51.375542 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:51.378808 25377 raft_consensus.cc:1240] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:12:51.369552 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:51.362941 30540 raft_consensus.cc:493] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:51.384183 25194 leader_election.cc:304] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:51.387802 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:51.388011 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:51.359596 30577 leader_election.cc:290] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:51.384227 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:51.410038 25299 raft_consensus.cc:3060] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:51.361326 30718 raft_consensus.cc:2749] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:51.362394 30668 raft_consensus.cc:493] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:51.368630 30696 raft_consensus.cc:3060] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:51.411245 25194 leader_election.cc:304] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:51.429718 25296 raft_consensus.cc:1275] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:12:51.430400 25194 leader_election.cc:304] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:51.431521 25194 leader_election.cc:304] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:51.363804 30181 raft_consensus.cc:493] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:51.426646 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:51.368345 30572 raft_consensus.cc:493] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:51.444862 25300 raft_consensus.cc:2410] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
W20260709 13:12:51.491323 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 60292.4us
I20260709 13:12:51.574324 25304 raft_consensus.cc:1240] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:51.401489 30697 raft_consensus.cc:493] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:51.365540 30580 raft_consensus.cc:515] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:51.420286 30342 raft_consensus.cc:493] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:51.427359 30577 raft_consensus.cc:2749] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:51.428648 30594 raft_consensus.cc:493] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:51.392908 30576 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:51.420287 30540 raft_consensus.cc:515] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:51.385637 30764 raft_consensus.cc:515] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:51.496402 30769 raft_consensus.cc:493] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:51.529201 30718 raft_consensus.cc:2804] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:51.439749 30668 raft_consensus.cc:515] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:51.587174 25299 raft_consensus.cc:2410] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:12:51.546043 30598 leader_election.cc:290] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:51.614804 30663 leader_election.cc:290] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:51.495056 30181 raft_consensus.cc:515] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:51.501963 30572 raft_consensus.cc:515] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:51.632625 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:51.628036 30773 raft_consensus.cc:2749] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:12:51.639715 30780 raft_consensus.cc:493] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:51.642716 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:51.643349 25372 raft_consensus.cc:2468] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 13.
I20260709 13:12:51.643392 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:51.644340 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:51.644603 25372 raft_consensus.cc:1275] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:12:51.644685 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:51.645357 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:51.645558 25370 raft_consensus.cc:2410] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:12:51.641548 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:51.645637 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:51.646318 25372 raft_consensus.cc:2468] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 17.
I20260709 13:12:51.646453 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:51.646680 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:51.643473 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56909a48cf841eb99365741e9e29e93" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:51.647092 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:51.647609 25379 raft_consensus.cc:2468] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 10.
I20260709 13:12:51.647769 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:51.640316 30780 raft_consensus.cc:515] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:51.649158 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:51.649885 25374 raft_consensus.cc:2468] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 11.
I20260709 13:12:51.608479 30537 raft_consensus.cc:493] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:51.613824 30771 raft_consensus.cc:493] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.654793 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:12:51.657133 30767 log.cc:927] Time spent T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:12:51.657359 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:51.657994 25379 raft_consensus.cc:2468] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 14.
W20260709 13:12:51.658475 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 83448.3us
I20260709 13:12:51.660785 25376 raft_consensus.cc:2410] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 15 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:12:51.661855 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:51.666320 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:51.666949 25379 raft_consensus.cc:2468] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 12.
I20260709 13:12:51.627240 30718 raft_consensus.cc:493] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:51.609483 30342 raft_consensus.cc:515] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:51.630227 30755 leader_election.cc:290] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:51.632220 30776 raft_consensus.cc:493] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:51.613137 30594 raft_consensus.cc:515] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:51.650278 30780 leader_election.cc:290] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:51.605203 30697 raft_consensus.cc:515] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:51.689056 30770 log.cc:927] Time spent T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:12:51.690805 30697 leader_election.cc:290] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:51.654083 30663 raft_consensus.cc:493] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:51.691586 30663 raft_consensus.cc:515] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:51.694453 30663 leader_election.cc:290] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:51.619692 30479 raft_consensus.cc:3060] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:51.682693 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:51.695276 25226 raft_consensus.cc:3060] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:51.704106 30576 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:51.704846 30576 raft_consensus.cc:493] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:51.705924 25378 raft_consensus.cc:2468] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 9.
I20260709 13:12:51.708304 25226 raft_consensus.cc:2468] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 13.
W20260709 13:12:51.710671 30772 log.cc:927] Time spent T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:12:51.712572 30776 raft_consensus.cc:515] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:51.715252 30776 leader_election.cc:290] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:51.718384 30479 raft_consensus.cc:2749] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:51.663856 30598 raft_consensus.cc:493] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:51.664816 30773 raft_consensus.cc:493] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:51.728240 30780 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.728838 30780 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:51.731393 30780 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:51.732115 30773 raft_consensus.cc:515] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } }
I20260709 13:12:51.734606 30580 leader_election.cc:290] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:51.734586 30773 leader_election.cc:290] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:51.736416 30342 leader_election.cc:290] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:51.630759 30769 raft_consensus.cc:515] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:51.739216 30769 leader_election.cc:290] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:51.664168 30771 raft_consensus.cc:515] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:51.742290 30540 leader_election.cc:290] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:51.743672 30181 leader_election.cc:290] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:51.668275 30537 raft_consensus.cc:515] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:51.745147 25370 raft_consensus.cc:2468] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 14.
I20260709 13:12:51.685742 30577 raft_consensus.cc:493] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:51.746465 30537 leader_election.cc:290] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:51.746279 30577 raft_consensus.cc:515] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:51.748854 30577 leader_election.cc:290] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:51.674487 30718 raft_consensus.cc:3060] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:51.675463 30396 consensus_queue.cc:1048] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.075s
I20260709 13:12:51.752962 30771 leader_election.cc:290] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:51.705391 30576 raft_consensus.cc:515] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:51.753844 30648 leader_election.cc:290] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:51.755481 30764 leader_election.cc:290] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:51.756186 30576 leader_election.cc:290] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:51.756443 30598 raft_consensus.cc:515] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:51.759021 30572 leader_election.cc:290] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:51.760814 30668 leader_election.cc:290] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:51.764010 30594 leader_election.cc:290] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:51.773996 30598 leader_election.cc:290] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:51.801738 30696 raft_consensus.cc:515] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:51.803252 25375 raft_consensus.cc:2368] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 16. Current term is 18.
I20260709 13:12:51.812527 30574 raft_consensus.cc:493] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.813324 30574 raft_consensus.cc:515] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:51.816121 30574 leader_election.cc:290] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:51.817162 25298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46556 (request call id 847) took 1070 ms. Trace:
I20260709 13:12:51.817618 25298 rpcz_store.cc:276] 0709 13:12:50.748611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:50.748735 (+   124us) service_pool.cc:224] Handling call
0709 13:12:50.758721 (+  9986us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:50.799685 (+ 40964us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:50.799729 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:50.799792 (+    63us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:12:50.799838 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:51.816924 (+1017086us) spinlock_profiling.cc:243] Waited 40.7 ms on lock 0x7b54004001d4. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:51.816971 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:51.817100 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":93554432}
I20260709 13:12:51.823848 30747 leader_election.cc:290] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:51.829864 30624 leader_election.cc:290] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:51.830880 30504 leader_election.cc:290] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:51.837385 30756 leader_election.cc:290] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:51.838801 30761 raft_consensus.cc:3055] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:51.839372 30761 raft_consensus.cc:740] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:51.840384 30761 consensus_queue.cc:260] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:51.842527 30761 raft_consensus.cc:3060] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:51.824066 30696 leader_election.cc:290] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 18 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:51.852010 25302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46556 (request call id 829) took 2703 ms. Trace:
I20260709 13:12:51.852927 25302 rpcz_store.cc:276] 0709 13:12:49.149038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:49.423669 (+274631us) service_pool.cc:224] Handling call
0709 13:12:50.754795 (+1331126us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:50.757940 (+  3145us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:51.851752 (+1093812us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b54002ca950. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6e8ad 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:51.851917 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3060145408}
W20260709 13:12:51.856335 30762 log.cc:927] Time spent T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.554s	user 0.000s	sys 0.004s
I20260709 13:12:51.860636 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:51.862798 25873 leader_election.cc:304] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:51.863694 25874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:51.864617 30479 consensus_queue.cc:1048] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.138s
I20260709 13:12:51.852100 30718 raft_consensus.cc:515] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:51.867554 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 242698us
I20260709 13:12:51.870118 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:12:51.880215 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 448725us
I20260709 13:12:51.883941 25908 raft_consensus.cc:1240] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:51.884546 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:51.886958 25903 raft_consensus.cc:2468] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 16.
I20260709 13:12:51.888976 25344 leader_election.cc:304] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:51.893873 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:51.893172 30771 consensus_queue.cc:1059] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:12:51.883198 30536 raft_consensus.cc:493] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:51.885618 30668 raft_consensus.cc:2749] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:51.905503 25226 raft_consensus.cc:1240] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:51.909168 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:51.882328 30479 raft_consensus.cc:493] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:51.919484 25221 raft_consensus.cc:2393] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 13: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:51.892125 30522 raft_consensus.cc:2804] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:51.920557 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:51.924093 25225 raft_consensus.cc:2393] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 16: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:51.904784 30537 raft_consensus.cc:3055] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:51.916584 30671 raft_consensus.cc:493] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.916744 30504 raft_consensus.cc:493] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:51.923717 30522 raft_consensus.cc:493] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:51.944631 25900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50056 (request call id 923) took 1082 ms. Trace:
I20260709 13:12:51.948657 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fb9a2520c542d38f72828988ddc804" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:12:51.952272 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 276009us
I20260709 13:12:51.957118 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:12:51.956688 25873 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.140.67:34091 timed out after 1.577s (SENT) [suppressed 13 similar messages]
I20260709 13:12:51.935422 30537 raft_consensus.cc:740] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:51.920995 30536 raft_consensus.cc:515] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:51.945108 25900 rpcz_store.cc:276] 0709 13:12:50.862146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:50.862277 (+   131us) service_pool.cc:224] Handling call
0709 13:12:50.878129 (+ 15852us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:50.878455 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:12:51.136021 (+257566us) log.cc:844] Serialized 14 byte log entry
0709 13:12:51.938140 (+802119us) spinlock_profiling.cc:243] Waited 3.73 ms on lock 0x7b1800459ca0. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72f8174bc 00007fd72cb6548b 00007fd7359bfab9 00007fd72cb8169b 00007fd72cb7f93f 00007fd72cb81c02 00007fd72f80920b 00007fd72f80ed23 00007fd72f80f23a
0709 13:12:51.944202 (+  6062us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:51.944279 (+    77us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:12:51.944347 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:51.944439 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:51.944577 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5752,"prepare.queue_time_us":328936,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":3945,"spinlock_wait_cycles":26811136,"thread_start_us":193753,"threads_started":2,"wal-append.queue_time_us":115000}
I20260709 13:12:51.965658 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:51.926292 30479 raft_consensus.cc:515] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:51.949570 30522 raft_consensus.cc:3060] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:51.968528 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:12:51.969105 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 286235us
I20260709 13:12:51.970350 30718 leader_election.cc:290] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 18 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:51.972836 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cae37d53acd4bcdbe2fa0bd91b36cc4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:51.973606 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:51.937656 30671 raft_consensus.cc:515] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:51.975860 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:51.949117 30504 raft_consensus.cc:515] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:51.977209 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:51.977329 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:51.977929 25874 leader_election.cc:304] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
W20260709 13:12:51.979310 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 321273us
I20260709 13:12:51.982825 25345 leader_election.cc:304] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
W20260709 13:12:51.974746 30688 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.003s	sys 0.016s
I20260709 13:12:51.994942 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:51.980576 30517 raft_consensus.cc:2804] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:12:51.990381 30688 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.003s	sys 0.016s
I20260709 13:12:51.997915 30396 consensus_queue.cc:1059] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:12:51.999372 30780 consensus_queue.cc:1059] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:12:52.001065 30784 consensus_queue.cc:1048] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 13:12:51.998204 30696 consensus_queue.cc:1048] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.006s
W20260709 13:12:52.001142 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:52.002749 30780 raft_consensus.cc:3055] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:52.004580 30780 raft_consensus.cc:740] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:52.005400 30780 consensus_queue.cc:260] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:52.005862 30640 consensus_queue.cc:1059] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:12:52.006096 30479 leader_election.cc:290] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:51.991928 30516 raft_consensus.cc:2749] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:52.006565 30780 raft_consensus.cc:3060] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:52.007619 30504 leader_election.cc:290] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:52.008176 30517 raft_consensus.cc:697] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:52.009620 30671 leader_election.cc:290] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:52.007673 30536 leader_election.cc:290] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:52.011703 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:12:52.013119 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 56466.8us
I20260709 13:12:52.015210 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:52.023381 25377 raft_consensus.cc:1240] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 17. Current term is 18. Ops: []
I20260709 13:12:52.035741 30515 raft_consensus.cc:3055] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:52.036238 30515 raft_consensus.cc:740] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:52.038533 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:52.043795 25223 raft_consensus.cc:1240] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:12:51.981957 30537 consensus_queue.cc:260] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:52.045408 30689 leader_election.cc:290] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:52.063328 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 65612.6us
I20260709 13:12:52.064266 30129 consensus_queue.cc:1059] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:12:52.065320 25221 raft_consensus.cc:1240] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:12:52.009148 30517 consensus_queue.cc:237] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:52.074918 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:52.074980 25345 leader_election.cc:304] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:52.076504 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:52.088025 30783 raft_consensus.cc:493] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:52.088615 30640 consensus_queue.cc:1059] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:12:52.088748 30783 raft_consensus.cc:515] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:52.091100 30783 leader_election.cc:290] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:52.037251 30515 consensus_queue.cc:260] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:52.097529 30668 raft_consensus.cc:3055] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:12:52.100131 30668 raft_consensus.cc:740] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:52.101500 30668 consensus_queue.cc:260] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:52.103454 30668 raft_consensus.cc:3060] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:52.104491 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:52.097551 30129 raft_consensus.cc:2749] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:52.110077 25345 leader_election.cc:304] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:52.110976 25195 leader_election.cc:304] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:52.111199 25194 leader_election.cc:304] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:52.114333 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:52.118131 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:52.118920 30589 raft_consensus.cc:493] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:52.119480 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:52.119449 30589 raft_consensus.cc:515] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:52.120168 25230 raft_consensus.cc:2468] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 12.
I20260709 13:12:52.121214 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:52.121803 25227 raft_consensus.cc:2468] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 17.
I20260709 13:12:52.122291 30589 leader_election.cc:290] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:52.122807 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:52.123492 25224 raft_consensus.cc:2468] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 14.
I20260709 13:12:52.125917 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:52.126646 25228 raft_consensus.cc:2393] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 15: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:52.128530 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:52.136989 25345 leader_election.cc:304] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
W20260709 13:12:52.138422 25872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:52.147174 25194 leader_election.cc:304] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:52.154079 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:52.154800 25302 raft_consensus.cc:2468] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 15.
I20260709 13:12:52.156497 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:52.157668 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:52.158744 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:52.159773 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:52.160362 25300 raft_consensus.cc:2468] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 12.
I20260709 13:12:52.153313 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:52.174429 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:52.175740 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:52.176445 25299 raft_consensus.cc:3060] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:12:52.178427 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:52.180119 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:52.182639 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74320a7302d4cd8b705dce5d385079a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:52.184221 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:52.181502 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:52.191745 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:52.161430 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:52.199313 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:52.200850 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff15b40224dcaa2c76d2c4fd3b27b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:52.202375 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:52.203557 25300 raft_consensus.cc:2410] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 18 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:12:52.204634 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:52.193457 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:52.155754 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:52.211009 25304 raft_consensus.cc:1240] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:52.215266 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:52.228842 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:52.231868 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:52.234109 30744 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.234135 30388 raft_consensus.cc:493] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:52.301184 30744 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:52.301263 30388 raft_consensus.cc:515] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:52.235410 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:52.142057 30689 raft_consensus.cc:2749] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:12:52.237286 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 79326.8us
W20260709 13:12:52.237380 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 90282.7us
I20260709 13:12:52.144570 30761 raft_consensus.cc:493] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:52.144918 30129 raft_consensus.cc:2749] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:52.142493 30769 raft_consensus.cc:493] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:52.236872 24113 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:12:52.144397 30696 raft_consensus.cc:493] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
W20260709 13:12:52.210355 30709 log.cc:927] Time spent T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:12:52.144524 30784 raft_consensus.cc:493] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:52.311369 25194 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:52.206868 30743 raft_consensus.cc:493] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
W20260709 13:12:52.235284 30796 log.cc:927] Time spent T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:12:52.143301 30782 consensus_queue.cc:1059] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.107s
W20260709 13:12:52.248124 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 101018us
W20260709 13:12:52.244365 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 107487us
I20260709 13:12:52.231153 30598 raft_consensus.cc:2749] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:52.257038 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:52.259430 25271 leader_election.cc:304] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:52.244390 30576 raft_consensus.cc:2749] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:52.243665 30780 raft_consensus.cc:2749] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:52.254186 30416 consensus_queue.cc:1048] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:12:52.334233 25343 leader_election.cc:304] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:12:52.288954 30522 raft_consensus.cc:515] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:52.260720 30648 consensus_queue.cc:1048] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:12:52.306658 25301 raft_consensus.cc:2468] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 14.
I20260709 13:12:52.146739 30571 raft_consensus.cc:493] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:52.326196 25873 leader_election.cc:304] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:52.346984 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 87644.4us
I20260709 13:12:52.375218 25343 leader_election.cc:304] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:12:52.376154 25271 leader_election.cc:304] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:52.377187 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:52.378003 25271 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
W20260709 13:12:52.379985 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 53943.1us
I20260709 13:12:52.380617 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:52.381227 25378 raft_consensus.cc:2468] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 10.
I20260709 13:12:52.382061 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:52.384820 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:52.385553 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:52.386250 25370 raft_consensus.cc:2368] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 16. Current term is 18.
I20260709 13:12:52.386561 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:52.387321 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:52.387908 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:52.382764 25271 leader_election.cc:304] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:52.315769 30790 raft_consensus.cc:2749] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:52.390261 25271 leader_election.cc:304] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:52.389231 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:52.392570 25271 leader_election.cc:304] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:52.394155 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:52.353672 30779 raft_consensus.cc:2749] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:52.311318 30761 raft_consensus.cc:515] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:52.395690 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca881f8516e046c99da202e9d9ea00a1" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:52.393554 30572 raft_consensus.cc:2804] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:12:52.409976 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 105296us
I20260709 13:12:52.412055 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:52.344071 30696 raft_consensus.cc:515] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:52.389366 25299 raft_consensus.cc:2468] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 18.
I20260709 13:12:52.393776 30396 raft_consensus.cc:2749] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:52.425861 30388 leader_election.cc:290] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:52.343745 30784 raft_consensus.cc:515] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:52.346481 30743 raft_consensus.cc:515] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:52.391641 30643 raft_consensus.cc:2749] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:52.390247 30571 raft_consensus.cc:515] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:52.407573 30781 raft_consensus.cc:2804] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:52.428184 25271 leader_election.cc:304] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:52.411257 30572 raft_consensus.cc:493] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
W20260709 13:12:52.432301 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:52.432396 30648 raft_consensus.cc:2804] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:52.316262 30769 raft_consensus.cc:515] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:52.443712 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:52.444706 25379 raft_consensus.cc:2393] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 17: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:52.391984 30802 raft_consensus.cc:493] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.395008 30768 raft_consensus.cc:2804] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:12:52.449910 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:52.406409 30587 raft_consensus.cc:2804] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:52.445604 30749 raft_consensus.cc:2764] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:12:52.505129 25905 raft_consensus.cc:2410] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:12:52.453655 30515 raft_consensus.cc:3060] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:52.477980 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:52.479007 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:52.467995 25195 leader_election.cc:304] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:52.470073 25271 leader_election.cc:304] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:52.467613 30696 leader_election.cc:290] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:12:52.450780 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 133992us
I20260709 13:12:52.493194 30572 raft_consensus.cc:3060] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:52.466668 25374 raft_consensus.cc:2468] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 8.
I20260709 13:12:52.462750 30784 leader_election.cc:290] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:12:52.462805 25873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:52.515214 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:52.515328 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:52.518914 25873 leader_election.cc:304] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:12:52.519641 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:52.503234 30768 raft_consensus.cc:697] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 16 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:52.462879 30744 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:52.466455 30571 leader_election.cc:290] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:52.493373 30648 raft_consensus.cc:493] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:52.494834 30643 raft_consensus.cc:2749] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:52.526320 25343 leader_election.cc:304] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
W20260709 13:12:52.513134 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 45252.4us
I20260709 13:12:52.513242 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:52.500402 30781 raft_consensus.cc:697] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 13 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:52.532636 25195 leader_election.cc:304] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:52.520406 25227 raft_consensus.cc:2468] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 17.
I20260709 13:12:52.512477 30704 raft_consensus.cc:2749] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:52.521231 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:52.522564 25873 leader_election.cc:304] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:52.538686 25873 leader_election.cc:400] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 16 election: Vote denied by peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091) with higher term. Message: Invalid argument: T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 16. Current term is 18.
I20260709 13:12:52.539043 25873 leader_election.cc:403] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:12:52.504943 30587 raft_consensus.cc:493] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:52.539784 30587 raft_consensus.cc:3060] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:52.547060 30517 raft_consensus.cc:3060] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:52.516793 30624 raft_consensus.cc:2804] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:52.529299 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:52.525032 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:52.525795 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:52.503114 30802 raft_consensus.cc:515] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:52.566725 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:52.464389 30743 leader_election.cc:290] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:52.525501 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:52.524621 30755 raft_consensus.cc:2804] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:52.526074 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:52.538530 30625 raft_consensus.cc:2749] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:52.529101 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:52.523818 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:52.559340 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:52.530189 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:52.561632 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:12:52.569401 25872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:52.569514 25195 leader_election.cc:304] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:52.533797 25343 leader_election.cc:304] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:52.522128 30784 raft_consensus.cc:493] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:52.571707 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:52.581182 30761 leader_election.cc:290] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:52.577875 30755 raft_consensus.cc:493] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:52.531885 30696 raft_consensus.cc:493] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:52.535696 30648 raft_consensus.cc:3060] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:52.590945 25224 raft_consensus.cc:1240] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:12:52.606125 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:52.556449 30129 raft_consensus.cc:2804] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:52.593734 25229 raft_consensus.cc:2410] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:12:52.557381 30624 raft_consensus.cc:493] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:52.597357 25195 leader_election.cc:304] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:52.572302 30785 raft_consensus.cc:2749] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:12:52.600085 30689 raft_consensus.cc:2749] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:52.613523 25194 leader_election.cc:304] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:52.616178 25195 leader_election.cc:304] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:52.617551 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:52.617710 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:52.578491 30718 consensus_queue.cc:1048] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.031s
W20260709 13:12:52.629823 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 91255us
I20260709 13:12:52.630834 25377 raft_consensus.cc:3060] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:52.602695 30755 raft_consensus.cc:3060] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:52.633266 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:52.606725 30663 raft_consensus.cc:2749] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:52.636969 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:52.634753 25873 leader_election.cc:304] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:52.640017 25194 leader_election.cc:304] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:52.609519 30129 raft_consensus.cc:493] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:52.643590 25195 leader_election.cc:304] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:52.638876 30522 leader_election.cc:290] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 17 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:52.650298 30804 log.cc:927] Time spent T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.196s	user 0.000s	sys 0.001s
I20260709 13:12:52.609473 30696 raft_consensus.cc:515] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:52.652285 30387 raft_consensus.cc:2749] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:52.666579 30802 leader_election.cc:290] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:52.635558 30768 consensus_queue.cc:237] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:52.668262 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:52.660903 30572 raft_consensus.cc:515] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:52.676787 30479 raft_consensus.cc:2804] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:52.706565 30479 raft_consensus.cc:493] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:52.707008 30479 raft_consensus.cc:3060] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:52.678162 30781 consensus_queue.cc:237] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:52.680439 30689 raft_consensus.cc:2749] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:52.681305 25194 leader_election.cc:304] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:52.681905 30576 raft_consensus.cc:2749] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:52.618315 30624 raft_consensus.cc:3060] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:12:52.687769 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 44246.2us
I20260709 13:12:52.686704 25377 raft_consensus.cc:2468] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 18.
I20260709 13:12:52.713593 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87095494ab7d40b7a42f4b05732acbf5" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:52.714406 25195 leader_election.cc:304] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:52.714597 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:52.714731 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:52.715698 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:52.716537 30572 leader_election.cc:290] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:52.716897 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:52.717160 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:52.599205 30784 raft_consensus.cc:515] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:52.689592 30129 raft_consensus.cc:3060] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:52.717855 25376 raft_consensus.cc:2368] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for earlier term 17. Current term is 18.
I20260709 13:12:52.718619 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:52.718905 25194 leader_election.cc:304] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:52.719132 25376 raft_consensus.cc:2468] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 14.
I20260709 13:12:52.620482 30807 raft_consensus.cc:2749] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:52.720082 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:52.720726 25194 leader_election.cc:304] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:52.721125 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:52.695569 30696 leader_election.cc:290] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:52.719224 30784 leader_election.cc:290] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:52.690659 30688 raft_consensus.cc:2804] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:52.721730 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0cf1df707d42a3834bac46dc045119" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:52.721863 30785 raft_consensus.cc:2749] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:52.722958 30769 leader_election.cc:290] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:52.720032 30807 raft_consensus.cc:2749] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:52.723217 25194 leader_election.cc:304] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:52.724083 30807 raft_consensus.cc:2804] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:12:52.723275 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:52.724737 30807 raft_consensus.cc:697] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 18 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:52.725241 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:52.726203 30807 consensus_queue.cc:237] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:52.727854 25377 raft_consensus.cc:2468] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 15.
I20260709 13:12:52.728679 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff04ee47fb3f40b2b2354a8d4f665483" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:52.729059 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:52.729606 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:52.715749 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:52.731557 25375 raft_consensus.cc:2468] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 18.
I20260709 13:12:52.732553 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:52.722201 30688 raft_consensus.cc:493] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:52.734088 30688 raft_consensus.cc:3060] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:52.735438 25376 raft_consensus.cc:1275] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:12:52.736102 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:52.737536 25375 raft_consensus.cc:2468] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 14.
I20260709 13:12:52.743160 25375 raft_consensus.cc:1275] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:12:52.732720 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:52.746204 25345 leader_election.cc:304] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:52.754364 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:52.755491 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:52.757340 25377 raft_consensus.cc:1275] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:12:52.761802 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 47570.7us
I20260709 13:12:52.762753 25195 leader_election.cc:304] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:52.764972 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 231243us
I20260709 13:12:52.765733 25343 leader_election.cc:304] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:52.766372 25345 leader_election.cc:304] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:52.767647 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:52.769474 25195 leader_election.cc:304] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:52.712428 30648 raft_consensus.cc:515] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:52.777983 25305 raft_consensus.cc:1240] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:52.785838 25345 leader_election.cc:304] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:52.788386 30648 leader_election.cc:290] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:52.796324 25343 leader_election.cc:304] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:52.798564 25195 leader_election.cc:304] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:52.801285 25343 leader_election.cc:304] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:52.803349 25345 leader_election.cc:304] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:52.795258 30784 raft_consensus.cc:2749] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:52.797339 30576 raft_consensus.cc:2749] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:52.804674 30580 raft_consensus.cc:2804] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:52.805176 30580 raft_consensus.cc:493] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:52.805626 30580 raft_consensus.cc:3060] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:52.813510 25345 leader_election.cc:304] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:52.754060 30704 raft_consensus.cc:493] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.681677 30587 raft_consensus.cc:515] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:52.816846 25373 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.020s	sys 0.017s
W20260709 13:12:52.818384 25373 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.020s	sys 0.017s
I20260709 13:12:52.795710 30689 raft_consensus.cc:2804] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:52.796680 30785 raft_consensus.cc:493] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:52.798110 30769 raft_consensus.cc:2804] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:52.809978 30776 raft_consensus.cc:2749] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:52.827554 25300 raft_consensus.cc:1240] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 18 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 17. Current term is 18. Ops: []
I20260709 13:12:52.811626 30761 raft_consensus.cc:2749] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:12:52.836653 25373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56308 (request call id 930) took 1473 ms. Trace:
I20260709 13:12:52.825631 30689 raft_consensus.cc:493] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:52.825278 30817 raft_consensus.cc:2749] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:52.837258 30785 raft_consensus.cc:515] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:52.851646 30785 leader_election.cc:290] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:52.852368 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:52.852913 30755 raft_consensus.cc:515] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:52.864923 24113 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:52.880533 25378 raft_consensus.cc:1240] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 16. Current term is 17. Ops: []
I20260709 13:12:52.813002 30696 raft_consensus.cc:2749] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:52.885061 30688 raft_consensus.cc:515] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:52.837347 25373 rpcz_store.cc:276] 0709 13:12:51.363284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:51.365251 (+  1967us) service_pool.cc:224] Handling call
0709 13:12:51.365551 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:51.365914 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:51.365957 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:51.370777 (+  4820us) log.cc:844] Serialized 26 byte log entry
0709 13:12:52.106901 (+736124us) spinlock_profiling.cc:243] Waited 4.75 ms on lock 0x7b180040cba0. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72cb64e07 00007fd7359bfab9 00007fd72cb8169b 00007fd72cb7f93f 00007fd72cb81c02 00007fd72f80920b 00007fd72f80ed23 00007fd72f80f0d1 00007fd72fc2aa0f
0709 13:12:52.818906 (+712005us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:52.818965 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:52.819061 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:52.819120 (+    59us) raft_consensus.cc:1685] finished
0709 13:12:52.819138 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:52.836540 (+ 17402us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":21117,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":37739,"spinlock_wait_cycles":10936064,"thread_start_us":711770,"threads_started":1,"wal-append.queue_time_us":1208568}
W20260709 13:12:52.955410 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 131497us
I20260709 13:12:52.960214 25345 leader_election.cc:304] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
W20260709 13:12:52.908587 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 95127.6us
I20260709 13:12:52.827371 30802 raft_consensus.cc:2749] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:52.828027 30769 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:52.840452 30587 leader_election.cc:290] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 18 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:52.907945 30129 raft_consensus.cc:515] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:52.991546 30129 leader_election.cc:290] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 16 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:52.847853 30517 raft_consensus.cc:2749] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 18 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091) with higher term. Message: Invalid argument: T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 16. Current term is 18.
I20260709 13:12:52.910663 30504 raft_consensus.cc:493] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:52.989632 30688 leader_election.cc:290] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:52.997854 30504 raft_consensus.cc:515] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:52.839551 30790 raft_consensus.cc:2804] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:52.839474 30689 raft_consensus.cc:3060] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:52.902009 30342 raft_consensus.cc:493] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:52.919373 30749 raft_consensus.cc:493] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:52.837785 30771 raft_consensus.cc:2749] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:52.929458 30643 raft_consensus.cc:493] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:52.922013 30388 raft_consensus.cc:493] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:52.861186 30624 raft_consensus.cc:515] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:52.935076 30479 raft_consensus.cc:515] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:52.936380 30580 raft_consensus.cc:515] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:52.827800 30704 raft_consensus.cc:515] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:52.821833 25343 leader_election.cc:304] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:52.970227 25195 leader_election.cc:304] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:52.969485 30769 raft_consensus.cc:3060] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:52.962329 30542 consensus_queue.cc:1059] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:12:52.988637 30786 raft_consensus.cc:493] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.000267 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:53.016795 25873 leader_election.cc:304] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:53.030019 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:53.010440 30790 raft_consensus.cc:493] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
W20260709 13:12:53.033870 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 212178us
W20260709 13:12:53.034611 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 64472.4us
I20260709 13:12:53.047972 25343 leader_election.cc:304] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:53.050522 25195 leader_election.cc:304] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:53.052717 25223 raft_consensus.cc:1240] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:53.059913 25343 leader_election.cc:304] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:53.061888 25195 leader_election.cc:304] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
W20260709 13:12:53.064239 25124 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40026 (request call id 243) took 29214 ms (client timeout 15000 ms). Trace:
I20260709 13:12:53.092901 25195 leader_election.cc:304] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:53.024005 30749 raft_consensus.cc:515] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:53.014266 30342 raft_consensus.cc:515] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:53.037561 30781 raft_consensus.cc:2749] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:53.099984 25343 leader_election.cc:304] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:53.037940 30807 raft_consensus.cc:2804] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:53.026990 30643 raft_consensus.cc:515] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:53.056129 30515 raft_consensus.cc:3060] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:53.030498 30388 raft_consensus.cc:515] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:53.051900 30129 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:53.064981 30802 raft_consensus.cc:2749] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:53.100898 30780 raft_consensus.cc:2749] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:53.129053 25343 leader_election.cc:304] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:53.096426 30718 raft_consensus.cc:2804] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:53.095794 30823 raft_consensus.cc:2749] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:53.054301 30790 raft_consensus.cc:3060] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:53.098737 30542 raft_consensus.cc:2749] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:53.056828 30688 consensus_queue.cc:1059] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.054s
W20260709 13:12:53.197500 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 68548.1us
I20260709 13:12:53.219208 25343 leader_election.cc:304] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:53.202606 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 110717us
I20260709 13:12:53.103852 30807 raft_consensus.cc:493] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:53.108618 30671 raft_consensus.cc:2749] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:12:53.058676 30786 raft_consensus.cc:515] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:53.223390 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:12:53.245044 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:53.245088 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:53.246213 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:53.248588 25270 leader_election.cc:304] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:53.189821 30768 raft_consensus.cc:2749] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:53.191708 30783 raft_consensus.cc:2749] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:12:53.260437 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 167576us
I20260709 13:12:53.261266 25195 leader_election.cc:304] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:53.263875 25195 leader_election.cc:304] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:53.265717 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:53.265923 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:53.202286 30781 raft_consensus.cc:2749] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:53.266394 25302 raft_consensus.cc:2468] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 14.
W20260709 13:12:53.064697 25124 rpcz_store.cc:269] 0709 13:12:23.824124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:23.825335 (+  1211us) service_pool.cc:224] Handling call
0709 13:12:53.038169 (+29212834us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:45.311817 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:45.312526 (+   709us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:45.325951 (+ 13425us) write_op.cc:435] Acquired schema lock
0709 13:12:45.330427 (+  4476us) tablet.cc:662] Decoding operations
0709 13:12:45.592792 (+262365us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:45.597848 (+  5056us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:45.597878 (+    30us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:12:45.599192 (+  1314us) tablet.cc:701] Row locks acquired
0709 13:12:45.599244 (+    52us) write_op.cc:260] PREPARE: finished
0709 13:12:45.599411 (+   167us) write_op.cc:270] Start()
0709 13:12:45.599559 (+   148us) write_op.cc:276] Timestamp: P: 1783602765599346 usec, L: 0
0709 13:12:45.599597 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 13:12:45.600425 (+   828us) log.cc:844] Serialized 6376 byte log entry
0709 13:12:46.105851 (+505426us) op_driver.cc:464] REPLICATION: finished
0709 13:12:47.111420 (+1005569us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b4400022b4c. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72caa8c85 00007fd72caa96a2 00007fd72f81b1db 00007fd72f816aaf 00007fd72cb650ac 00007fd7359bfab9 00007fd72cb8169b 00007fd72cb7f93f 00007fd72cb81c02 00007fd7336a5ef0
0709 13:12:47.208466 (+ 97046us) write_op.cc:301] APPLY: starting
0709 13:12:47.208582 (+   116us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:47.597961 (+389379us) spinlock_profiling.cc:243] Waited 5.04 ms on lock 0x7b540034ec54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6c32a 00007fd72fbf1f14 00007fd72fbf1ec3 00007fd72fbf1e38 00007fd72fbf1df3 00007fd72fbf10dc 00007fd72fc1ae16 00007fd72fc02cbb 00007fd72fbed39d 00007fd72fbf0d75
0709 13:12:47.605792 (+  7831us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:47.609334 (+  3542us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:47.660425 (+ 51091us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:47.660802 (+   377us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=32,mrs_lookups=0
0709 13:12:47.660863 (+    61us) write_op.cc:312] APPLY: finished
0709 13:12:47.661305 (+   442us) log.cc:844] Serialized 148 byte log entry
0709 13:12:47.869533 (+208228us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:47.869713 (+   180us) write_op.cc:454] Released schema lock
0709 13:12:47.869873 (+   160us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:47.870368 (+   495us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:47.870399 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":176362,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":1094444,"apply.run_cpu_time_us":65605,"apply.run_wall_time_us":661925,"cfile_cache_hit":66,"cfile_cache_hit_bytes":71039,"num_ops":16,"prepare.queue_time_us":246169,"prepare.run_cpu_time_us":9601,"prepare.run_wall_time_us":358232,"raft.queue_time_us":213460,"raft.run_cpu_time_us":48718,"raft.run_wall_time_us":1541150,"replication_time_us":470810,"spinlock_wait_cycles":49347584,"thread_start_us":1771737,"threads_started":5,"wal-append.queue_time_us":348590,"wal-append.run_cpu_time_us":11987,"wal-append.run_wall_time_us":2276507}]]}
I20260709 13:12:53.272302 25270 leader_election.cc:400] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091) with higher term. Message: Invalid argument: T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for earlier term 17. Current term is 18.
I20260709 13:12:53.267189 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:53.277449 25302 raft_consensus.cc:1240] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:53.278800 25270 leader_election.cc:304] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:12:53.274091 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:53.285184 25298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57272 (request call id 2325) took 1125 ms. Trace:
I20260709 13:12:53.285763 25298 rpcz_store.cc:276] 0709 13:12:52.159974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:52.295256 (+135282us) service_pool.cc:224] Handling call
0709 13:12:52.295505 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:52.307694 (+ 12189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:52.307740 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:52.307795 (+    55us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:52.307839 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:53.283858 (+976019us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b54001ea354. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:53.283916 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:53.285114 (+  1198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27471232}
I20260709 13:12:53.264911 30807 raft_consensus.cc:3060] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:53.301462 30755 leader_election.cc:290] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:53.273906 30587 raft_consensus.cc:2749] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:12:53.304005 30792 log.cc:927] Time spent T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 1.037s	user 0.002s	sys 0.012s
I20260709 13:12:53.307999 30786 leader_election.cc:290] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:53.310240 25303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46556 (request call id 858) took 1310 ms. Trace:
I20260709 13:12:53.310514 30342 leader_election.cc:290] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:53.311949 30624 leader_election.cc:290] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:53.312354 30826 raft_consensus.cc:2749] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:53.312564 30624 raft_consensus.cc:2804] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:53.312989 30624 raft_consensus.cc:493] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:53.313349 30624 raft_consensus.cc:3060] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:53.314783 30704 leader_election.cc:290] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:53.316200 30643 leader_election.cc:290] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:53.317762 30749 leader_election.cc:290] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:53.319169 30648 raft_consensus.cc:2804] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:53.319602 30648 raft_consensus.cc:493] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:53.319962 30648 raft_consensus.cc:3060] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:53.310802 25303 rpcz_store.cc:276] 0709 13:12:51.999642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:51.999770 (+   128us) service_pool.cc:224] Handling call
0709 13:12:52.000090 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:52.001328 (+  1238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:52.001358 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:52.001870 (+   512us) log.cc:844] Serialized 26 byte log entry
0709 13:12:52.135983 (+134113us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:12:52.136633 (+   650us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:52.136720 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:53.303403 (+1166683us) spinlock_profiling.cc:243] Waited 19.1 ms on lock 0x7b4400022b4c. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72caa8c85 00007fd72caa96a2 00007fd72f81b1db 00007fd72f816aaf 00007fd72f80a86e 00007fd72f809bb6 00007fd72f8097d8 00007fd72f813221 00007fd72f8131d9 00007fd72f813169
0709 13:12:53.309838 (+  6435us) raft_consensus.cc:1685] finished
0709 13:12:53.309870 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:53.310144 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":842,"raft.queue_time_us":1962,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":82,"spinlock_wait_cycles":43863936,"thread_start_us":133748,"threads_started":1,"wal-append.queue_time_us":241888}
I20260709 13:12:53.317592 30388 leader_election.cc:290] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:53.331389 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:53.335377 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:53.336076 25302 raft_consensus.cc:3060] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:53.339623 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:53.340399 25303 raft_consensus.cc:3060] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:53.246285 30516 raft_consensus.cc:2749] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:53.348395 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:53.349061 25370 raft_consensus.cc:3060] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:53.352531 25270 leader_election.cc:304] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:53.352769 25224 raft_consensus.cc:1240] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:53.354997 25224 raft_consensus.cc:1275] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:12:53.359880 30749 raft_consensus.cc:2749] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:53.359951 25302 raft_consensus.cc:2468] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 13.
I20260709 13:12:53.361371 25270 leader_election.cc:304] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:53.366856 30749 raft_consensus.cc:2749] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:53.368733 25270 leader_election.cc:304] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:12:53.321671 30479 leader_election.cc:290] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:53.377727 30827 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:53.379252 30824 log.cc:927] Time spent T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:12:53.199714 30129 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:53.383518 30504 leader_election.cc:290] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:53.390985 25303 raft_consensus.cc:2468] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 14.
I20260709 13:12:53.394096 25370 raft_consensus.cc:2468] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 11.
W20260709 13:12:53.397961 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 47614.9us
I20260709 13:12:53.406553 25270 leader_election.cc:304] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:53.435894 25873 leader_election.cc:304] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:53.442194 30572 raft_consensus.cc:2749] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:53.410835 30643 raft_consensus.cc:2764] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
W20260709 13:12:53.441252 30828 log.cc:927] Time spent T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:12:53.447777 25270 leader_election.cc:304] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:53.411343 30827 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:53.451539 25270 leader_election.cc:304] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:53.455699 25270 leader_election.cc:304] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:53.413370 30689 raft_consensus.cc:515] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:53.458859 30689 leader_election.cc:290] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:53.456372 30643 raft_consensus.cc:2749] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:53.459601 30838 raft_consensus.cc:2804] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:53.460294 30342 raft_consensus.cc:2749] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:53.460556 30838 raft_consensus.cc:697] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:53.465386 25304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57272 (request call id 2333) took 1300 ms. Trace:
I20260709 13:12:53.465974 25304 rpcz_store.cc:276] 0709 13:12:52.164891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:52.296186 (+131295us) service_pool.cc:224] Handling call
0709 13:12:52.296438 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:52.464508 (+168070us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:12:52.576978 (+112470us) log.cc:844] Serialized 14 byte log entry
0709 13:12:52.703771 (+126793us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:52.703825 (+    54us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:12:52.756302 (+ 52477us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:53.465059 (+708757us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b54001e9454. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:53.465123 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:53.465304 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":138964,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":2312,"raft.queue_time_us":76,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"spinlock_wait_cycles":386004352,"thread_start_us":237241,"threads_started":2,"wal-append.queue_time_us":304307}
I20260709 13:12:53.459813 25376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36264 (request call id 2216) took 1024 ms. Trace:
I20260709 13:12:53.470587 25376 rpcz_store.cc:276] 0709 13:12:52.435591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:52.739860 (+304269us) service_pool.cc:224] Handling call
0709 13:12:52.740191 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:52.740624 (+   433us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:52.740663 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:52.741179 (+   516us) log.cc:844] Serialized 26 byte log entry
0709 13:12:53.058411 (+317232us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:12:53.058456 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:53.058529 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:53.459608 (+401079us) raft_consensus.cc:1685] finished
0709 13:12:53.459629 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:53.459757 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":500,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":15747,"thread_start_us":249638,"threads_started":1,"wal-append.queue_time_us":405317}
I20260709 13:12:53.475541 30129 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:53.478863 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:53.479687 25908 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 12.
I20260709 13:12:53.441551 30807 raft_consensus.cc:515] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:53.480862 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 217044us
I20260709 13:12:53.443876 30769 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:53.457239 30572 raft_consensus.cc:2804] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:12:53.448454 30648 raft_consensus.cc:515] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:53.486476 25195 leader_election.cc:304] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:53.493803 25195 leader_election.cc:304] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:53.482542 30388 consensus_queue.cc:1048] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 13:12:53.484771 30571 consensus_queue.cc:1048] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:12:53.505566 25378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36254 (request call id 2643) took 1105 ms. Trace:
I20260709 13:12:53.495734 30844 raft_consensus.cc:2749] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:53.509043 30827 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:53.510030 30537 raft_consensus.cc:3060] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:53.526085 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:53.511801 25221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 2644) took 1399 ms. Trace:
I20260709 13:12:53.512143 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:53.511124 30624 raft_consensus.cc:515] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:53.515054 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:53.527294 25222 raft_consensus.cc:1240] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:53.515698 30648 leader_election.cc:290] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:53.487879 30572 raft_consensus.cc:493] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:53.542225 30572 raft_consensus.cc:3060] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:53.543175 30580 leader_election.cc:290] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:53.521260 25271 leader_election.cc:304] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:53.543175 30515 raft_consensus.cc:2749] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:53.545970 25271 leader_election.cc:304] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:53.519876 25378 rpcz_store.cc:276] 0709 13:12:52.400543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:52.402851 (+  2308us) service_pool.cc:224] Handling call
0709 13:12:52.880356 (+477505us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:52.945284 (+ 64928us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:53.505385 (+560101us) spinlock_profiling.cc:243] Waited 477 ms on lock 0x7b540033f750. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6e8ad 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:53.505506 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1097295616}
I20260709 13:12:53.487582 30749 consensus_queue.cc:1048] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:12:53.524899 25224 raft_consensus.cc:1240] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:53.525537 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:53.503566 30843 raft_consensus.cc:2804] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:53.551827 30843 raft_consensus.cc:493] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:53.552239 30843 raft_consensus.cc:3060] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:53.554308 30516 consensus_queue.cc:1059] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:53.555097 30776 consensus_queue.cc:1048] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:53.531944 30807 leader_election.cc:290] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:53.533201 30624 leader_election.cc:290] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:53.534193 25908 raft_consensus.cc:2393] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 13: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:12:53.538457 30769 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 18 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:53.526657 25221 rpcz_store.cc:276] 0709 13:12:52.112634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:52.112785 (+   151us) service_pool.cc:224] Handling call
0709 13:12:52.113063 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:52.224698 (+111635us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:12:52.887334 (+662636us) spinlock_profiling.cc:243] Waited 2.54 ms on lock 0x7b18003ebba0. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735a4ade1 00007fd735a575b1 00007fd72cb64e07 00007fd7359bfab9 00007fd72cb8169b 00007fd72cb7f93f 00007fd72cb7f455 00007fd7336673c7 00007fd72fc799a7 00007fd72fc890bf 00007fd72fc89038
0709 13:12:53.011646 (+124312us) log.cc:844] Serialized 14 byte log entry
0709 13:12:53.199714 (+188068us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:53.200179 (+   465us) log.cc:844] Serialized 26 byte log entry
0709 13:12:53.200303 (+   124us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:53.200541 (+   238us) log.cc:844] Serialized 14 byte log entry
0709 13:12:53.447032 (+246491us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:53.447099 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:53.511581 (+ 64482us) raft_consensus.cc:1685] finished
0709 13:12:53.511602 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:53.511744 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":92602,"prepare.queue_time_us":41143,"prepare.run_cpu_time_us":3670,"prepare.run_wall_time_us":29842,"raft.queue_time_us":325384,"raft.run_cpu_time_us":278,"raft.run_wall_time_us":10331,"spinlock_wait_cycles":5835520,"thread_start_us":558166,"threads_started":3,"wal-append.queue_time_us":434253}
I20260709 13:12:53.481069 30838 consensus_queue.cc:237] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:53.550081 30587 raft_consensus.cc:2749] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:53.550658 30704 raft_consensus.cc:2749] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:53.556937 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:53.567968 30540 raft_consensus.cc:3055] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:53.562700 25194 leader_election.cc:304] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:53.568928 30516 raft_consensus.cc:3055] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:53.569326 30516 raft_consensus.cc:740] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:53.569928 30790 raft_consensus.cc:515] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:53.570174 30516 consensus_queue.cc:260] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:53.571249 30516 raft_consensus.cc:3060] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:53.572065 30790 leader_election.cc:290] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:53.573844 25221 raft_consensus.cc:1240] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:53.558751 25302 raft_consensus.cc:1275] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 18 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:12:53.574817 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:53.559659 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:53.575889 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:53.574827 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:53.560461 25298 raft_consensus.cc:1240] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:53.578366 25221 raft_consensus.cc:2393] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 14: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:53.558761 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:53.578866 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:53.579474 25227 raft_consensus.cc:1240] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:53.560989 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:53.581921 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:53.582338 25379 raft_consensus.cc:1240] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 10. Current term is 11. Ops: [9.8-10.9]
I20260709 13:12:53.561584 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:53.584117 30769 raft_consensus.cc:493] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.563297 25899 raft_consensus.cc:1240] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 16. Current term is 17. Ops: []
I20260709 13:12:53.557611 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:53.585997 25229 raft_consensus.cc:2393] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 12: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:53.586150 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1eeb9f9696c44b9b744d926cf3312ff" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:53.577929 30718 raft_consensus.cc:493] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:53.587338 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:53.587291 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:53.601365 25378 raft_consensus.cc:3060] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:53.588042 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:53.588662 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:53.601807 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:53.603045 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:53.604429 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:53.604864 30515 raft_consensus.cc:493] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.605499 30515 raft_consensus.cc:515] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:53.607889 30515 leader_election.cc:290] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:53.608532 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 43909.9us
I20260709 13:12:53.590586 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:53.596827 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:53.599020 25375 raft_consensus.cc:1275] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:12:53.605592 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:53.619191 25376 raft_consensus.cc:3060] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:53.568424 30540 raft_consensus.cc:740] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:53.626573 30540 consensus_queue.cc:260] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:53.628008 30540 raft_consensus.cc:3060] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:12:53.628213 30832 log.cc:927] Time spent T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.442s	user 0.000s	sys 0.003s
I20260709 13:12:53.630178 25223 raft_consensus.cc:1240] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 14. Current term is 15. Ops: []
W20260709 13:12:53.632894 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 70296.8us
I20260709 13:12:53.634573 30842 raft_consensus.cc:2804] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:53.634873 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec256e9cce1249a995955c75b0c977cc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:53.635169 30842 raft_consensus.cc:697] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 13 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:53.636373 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:53.637125 25900 raft_consensus.cc:2468] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 17.
I20260709 13:12:53.632938 30718 raft_consensus.cc:3060] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:53.584689 30769 raft_consensus.cc:515] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:53.644891 30769 leader_election.cc:290] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:53.634622 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:53.646456 25304 raft_consensus.cc:2468] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 17.
I20260709 13:12:53.649121 30823 raft_consensus.cc:493] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:53.649677 30823 raft_consensus.cc:515] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:53.652029 30837 raft_consensus.cc:3055] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:12:53.652426 30837 raft_consensus.cc:740] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:53.653149 30823 leader_election.cc:290] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:53.653194 30837 consensus_queue.cc:260] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:53.654827 30837 raft_consensus.cc:3060] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:53.655753 25194 leader_election.cc:304] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:53.656164 30839 raft_consensus.cc:493] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:53.656646 30839 raft_consensus.cc:515] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:53.658985 30624 raft_consensus.cc:2804] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:53.659564 30624 raft_consensus.cc:697] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 14 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:53.660517 30624 consensus_queue.cc:237] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:53.655896 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:53.636145 30842 consensus_queue.cc:237] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:53.662423 25908 raft_consensus.cc:2468] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 13.
I20260709 13:12:53.660441 25128 catalog_manager.cc:5697] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 6 to 13. New cstate: current_term: 13 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:53.668063 25128 catalog_manager.cc:5697] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 9 to 10, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 10 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
W20260709 13:12:53.663098 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 62083.1us
I20260709 13:12:53.670269 25378 raft_consensus.cc:2468] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 12.
W20260709 13:12:53.671932 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 155239us
I20260709 13:12:53.676046 25899 raft_consensus.cc:1240] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 LEADER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:53.676625 25344 leader_election.cc:304] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:53.679566 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:53.679879 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:53.681210 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:53.681576 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:53.682015 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682caa57052f4e698c0ad75fb393ae75" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:53.684026 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:53.685452 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:53.686483 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:53.649426 30843 raft_consensus.cc:515] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:53.690331 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:53.692427 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:53.692579 25343 leader_election.cc:304] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:53.693218 25373 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 11.
I20260709 13:12:53.693336 30775 raft_consensus.cc:2749] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:12:53.694948 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:53.694831 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:53.701915 25304 raft_consensus.cc:2468] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 12.
I20260709 13:12:53.670265 25128 catalog_manager.cc:5697] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 8 to 11, leader changed from 79d99c0e498349bda74127365219e468 (127.23.140.67) to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 11 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
I20260709 13:12:53.703807 25227 raft_consensus.cc:1275] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:12:53.705641 25378 raft_consensus.cc:1240] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:12:53.702994 25128 catalog_manager.cc:5697] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 12 to 15, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 15 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:53.695961 25343 leader_election.cc:304] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:53.707458 25128 catalog_manager.cc:5697] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
I20260709 13:12:53.708550 25343 leader_election.cc:304] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:53.708911 25128 catalog_manager.cc:5697] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 9 to 16, leader changed from 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 16 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:12:53.717694 25376 raft_consensus.cc:2468] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 15.
I20260709 13:12:53.718989 25373 raft_consensus.cc:1240] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:12:53.722808 25343 leader_election.cc:304] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:12:53.723908 25378 raft_consensus.cc:1240] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 14. Current term is 15. Ops: [12.8-14.9]
I20260709 13:12:53.717552 25128 catalog_manager.cc:5697] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 11 to 13, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 13 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:53.727807 25128 catalog_manager.cc:5697] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 11 to 14, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 14 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:53.741333 25343 leader_election.cc:304] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:53.687781 30787 raft_consensus.cc:2804] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:53.743728 25225 raft_consensus.cc:1240] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:53.744478 25374 raft_consensus.cc:2468] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 13.
W20260709 13:12:53.746022 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 75146.5us
I20260709 13:12:53.747659 25343 leader_election.cc:304] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:53.748791 30768 raft_consensus.cc:2749] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:53.753371 25372 raft_consensus.cc:2468] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 13.
I20260709 13:12:53.731865 25128 catalog_manager.cc:5697] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 10 to 11, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 11 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:53.755136 30542 raft_consensus.cc:2749] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:12:53.756279 30768 consensus_queue.cc:1059] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:53.757476 30775 raft_consensus.cc:3055] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:53.757843 30775 raft_consensus.cc:740] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:53.758069 30587 consensus_queue.cc:1059] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:12:53.758594 30775 consensus_queue.cc:260] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:53.760216 30775 raft_consensus.cc:3060] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:53.760066 30587 consensus_queue.cc:1059] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:12:53.682791 30823 consensus_queue.cc:1048] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 13:12:53.683748 30807 consensus_queue.cc:1059] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:12:53.720144 30537 raft_consensus.cc:2749] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:53.719733 30781 raft_consensus.cc:2749] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:12:53.676133 30572 raft_consensus.cc:515] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:53.762328 25128 catalog_manager.cc:5697] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 8 to 15, leader changed from 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 15 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:53.770044 25128 catalog_manager.cc:5697] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 8 to 11, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68). New cstate: current_term: 11 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:12:53.747388 30787 raft_consensus.cc:493] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:53.748013 30780 raft_consensus.cc:2804] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:53.772423 25128 catalog_manager.cc:5697] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
I20260709 13:12:53.774523 25128 catalog_manager.cc:5697] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:53.760628 30853 consensus_queue.cc:1059] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:12:53.777148 30342 raft_consensus.cc:3055] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:53.753949 30817 raft_consensus.cc:493] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.780076 25370 raft_consensus.cc:2410] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:12:53.781154 25128 catalog_manager.cc:5697] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 13 to 17, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 17 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:53.782997 25128 catalog_manager.cc:5697] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 12 to 14, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68). New cstate: current_term: 14 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:12:53.777522 30342 raft_consensus.cc:740] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
W20260709 13:12:53.792212 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 44552.8us
I20260709 13:12:53.775615 30787 raft_consensus.cc:3060] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:53.778625 30744 raft_consensus.cc:3055] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:12:53.795378 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88997763405742ee8b8e6b43d7392c1f" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:53.775429 30780 raft_consensus.cc:493] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:53.774650 30648 raft_consensus.cc:3055] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:53.800964 30648 raft_consensus.cc:740] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:53.801823 30648 consensus_queue.cc:260] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:53.803211 30648 raft_consensus.cc:3060] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:53.769281 30542 consensus_queue.cc:1059] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:12:53.769090 30673 consensus_queue.cc:1059] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:12:53.799233 30744 raft_consensus.cc:740] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:53.784318 25128 catalog_manager.cc:5697] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 reported cstate change: config changed from index 2 to 8, term changed from 7 to 12, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 1f539ba21487460085b837e7529a78ce (127.23.140.65), VOTER da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66), VOTER 79d99c0e498349bda74127365219e468 (127.23.140.67), VOTER 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68). New cstate: current_term: 12 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:12:53.823014 25128 catalog_manager.cc:5697] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 7 to 9, leader changed from 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 9 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:53.828055 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d3131e75284c0eb555c937d1c619cb" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:12:53.832530 25372 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56308 (request call id 945) took 1452 ms (client timeout 1685 ms). Trace:
W20260709 13:12:53.833123 25372 rpcz_store.cc:269] 0709 13:12:52.379679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:52.381830 (+  2151us) service_pool.cc:224] Handling call
0709 13:12:53.832325 (+1450495us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b540024d454. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc732fa 00007fd734c34b17 00007fd72e1af6d4 00007fd72e1af662 00007fd72e1af591 00007fd72e1af50c 00007fd72e1ae7c2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:53.832457 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3019183360}
I20260709 13:12:53.833974 30342 consensus_queue.cc:260] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:53.835052 30342 raft_consensus.cc:3060] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:53.844228 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:53.847307 25195 leader_election.cc:304] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
W20260709 13:12:53.848418 30849 log.cc:927] Time spent T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:12:53.850355 30542 raft_consensus.cc:3055] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:53.850739 30542 raft_consensus.cc:740] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:53.851532 30542 consensus_queue.cc:260] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:53.852742 30542 raft_consensus.cc:3060] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:12:53.854434 30850 log.cc:927] Time spent T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:12:53.809621 30744 consensus_queue.cc:260] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:53.855607 30673 raft_consensus.cc:3055] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:12:53.856010 30673 raft_consensus.cc:740] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:53.856753 30673 consensus_queue.cc:260] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:53.860332 30516 consensus_queue.cc:1059] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:53.862828 30572 leader_election.cc:290] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 19 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:53.866796 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:53.870966 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:53.871687 25128 catalog_manager.cc:5697] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 10 to 14, leader changed from 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 14 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:12:53.877683 25128 catalog_manager.cc:5697] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 9 to 12, leader changed from 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 12 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:53.881557 25128 catalog_manager.cc:5697] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
I20260709 13:12:53.882761 25128 catalog_manager.cc:5697] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 7 to 10, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68). New cstate: current_term: 10 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:12:53.812250 30780 raft_consensus.cc:3060] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:53.863247 30537 raft_consensus.cc:3055] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:53.895867 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:53.791051 30817 raft_consensus.cc:515] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:53.873304 30515 raft_consensus.cc:493] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
W20260709 13:12:53.895361 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 46901.5us
I20260709 13:12:53.886480 25128 catalog_manager.cc:5697] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 8 to 15, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 15 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:53.910773 25128 catalog_manager.cc:5697] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 8 to 15, leader changed from 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 15 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:12:53.913950 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 89423us
I20260709 13:12:53.894042 30673 raft_consensus.cc:3060] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:53.901841 30537 raft_consensus.cc:740] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:53.942648 30537 consensus_queue.cc:260] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:53.943899 30537 raft_consensus.cc:3060] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:53.946223 30843 leader_election.cc:290] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:53.915257 30515 raft_consensus.cc:515] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:53.952160 25377 raft_consensus.cc:1275] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:12:53.954166 25377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56308 (request call id 955) took 1213 ms. Trace:
I20260709 13:12:53.954586 25377 rpcz_store.cc:276] 0709 13:12:52.740735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:52.762978 (+ 22243us) service_pool.cc:224] Handling call
0709 13:12:53.865349 (+1102371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:53.952548 (+ 87199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:53.953468 (+   920us) spinlock_profiling.cc:243] Waited 86.5 ms on lock 0x7b540024d454. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6fe01 00007fd72fc6e83e 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:12:53.953981 (+   513us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b540024d450. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6e8ad 00007fd734c33419 00007fd72e1aabd4 00007fd72e1aab62 00007fd72e1aaa91 00007fd72e1aaa0c 00007fd72e1a9cc2 00007fd72dfaa48c 00007fd72dfa98c6 00007fd72dfa926f
0709 13:12:53.954110 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2733579520}
I20260709 13:12:53.962591 30648 consensus_queue.cc:1059] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:53.913554 25128 catalog_manager.cc:5697] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 9 to 12, leader changed from 79d99c0e498349bda74127365219e468 (127.23.140.67) to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 12 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
I20260709 13:12:53.919792 30839 leader_election.cc:290] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:53.921366 30688 raft_consensus.cc:3055] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:12:53.925876 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:53.903174 30837 raft_consensus.cc:2804] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:53.904271 30598 consensus_queue.cc:1059] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:12:53.963126 30515 leader_election.cc:290] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:12:54.032733 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 135946us
I20260709 13:12:53.976614 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:54.057456 25230 raft_consensus.cc:2468] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 13.
I20260709 13:12:53.982920 25195 leader_election.cc:304] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:54.059028 25345 leader_election.cc:304] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
W20260709 13:12:54.072202 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 169470us
I20260709 13:12:53.968966 30853 raft_consensus.cc:3055] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:53.972805 25128 catalog_manager.cc:5697] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 9 to 12, leader changed from 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 12 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:12:54.075891 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 380423us
I20260709 13:12:54.093222 25128 catalog_manager.cc:5697] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
I20260709 13:12:54.096721 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:54.096812 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
W20260709 13:12:54.112082 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 151152us
I20260709 13:12:54.096834 25872 leader_election.cc:304] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:54.115769 25270 leader_election.cc:304] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:54.111901 30515 consensus_queue.cc:1048] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 13:12:54.063500 30837 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:54.008352 30817 leader_election.cc:290] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:54.121486 25270 leader_election.cc:304] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:54.074342 30516 raft_consensus.cc:2804] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:54.126763 25270 leader_election.cc:304] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
W20260709 13:12:54.122391 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 205645us
I20260709 13:12:54.060712 30688 raft_consensus.cc:740] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:54.124636 30843 raft_consensus.cc:2749] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:54.128173 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:54.128037 25195 leader_election.cc:304] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:54.068090 30704 consensus_queue.cc:1059] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:12:54.091845 30853 raft_consensus.cc:740] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:54.131384 25270 leader_election.cc:304] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
W20260709 13:12:54.135061 25271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:54.018501 30718 raft_consensus.cc:515] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:54.140551 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:54.176831 25195 leader_election.cc:304] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:54.135515 30416 raft_consensus.cc:2749] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:12:54.123382 30598 consensus_queue.cc:1243] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer 6c4b021f3f9e41adb75e870a08ad88b6 log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:12:54.193565 25223 raft_consensus.cc:1240] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:54.196210 25195 leader_election.cc:304] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:54.197917 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:54.130072 30516 raft_consensus.cc:493] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:54.125306 30837 raft_consensus.cc:3060] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:54.125631 30778 raft_consensus.cc:2804] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:54.208066 25224 raft_consensus.cc:1240] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:54.209115 25195 leader_election.cc:304] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:54.132143 30571 raft_consensus.cc:2749] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:54.175853 30572 raft_consensus.cc:493] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.177927 30783 raft_consensus.cc:2749] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:12:54.123086 30780 raft_consensus.cc:515] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:54.129285 30387 consensus_queue.cc:1048] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.077s
I20260709 13:12:54.125492 30852 raft_consensus.cc:2749] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:12:54.125396 30749 consensus_queue.cc:1059] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.082s
I20260709 13:12:54.204926 30843 raft_consensus.cc:2749] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:54.210439 30516 raft_consensus.cc:3060] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:54.131204 30786 consensus_queue.cc:1059] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 13:12:54.215107 30587 raft_consensus.cc:2749] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:54.223987 30479 raft_consensus.cc:3055] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:54.125655 30855 consensus_queue.cc:1059] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.084s
I20260709 13:12:54.206919 30416 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.212559 30778 raft_consensus.cc:493] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:54.204052 30624 consensus_queue.cc:1059] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
W20260709 13:12:54.269784 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:54.207964 30787 raft_consensus.cc:515] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:54.234884 30783 raft_consensus.cc:2749] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:54.238210 30763 raft_consensus.cc:2749] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:12:54.273872 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 153302us
I20260709 13:12:54.238387 30479 raft_consensus.cc:740] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:54.225639 30572 raft_consensus.cc:515] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:54.252483 30778 raft_consensus.cc:3060] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:54.291378 25378 raft_consensus.cc:2393] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 14: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:54.293300 25303 raft_consensus.cc:1240] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:54.293079 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:54.294651 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
W20260709 13:12:54.288229 25343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:54.286422 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 77423.3us
I20260709 13:12:54.295043 25305 raft_consensus.cc:1240] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:54.298413 25195 leader_election.cc:304] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:54.298621 25375 raft_consensus.cc:1275] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:12:54.302661 25304 raft_consensus.cc:1275] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:12:54.303079 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 171758us
I20260709 13:12:54.304040 25270 leader_election.cc:304] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:54.305042 25270 leader_election.cc:304] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:54.218948 30688 consensus_queue.cc:260] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:54.308182 25270 leader_election.cc:304] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:54.308640 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:54.282307 30522 raft_consensus.cc:493] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:54.307119 25195 leader_election.cc:304] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:54.307694 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:54.295100 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:54.312894 25304 raft_consensus.cc:1240] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 19 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 18. Current term is 19. Ops: []
I20260709 13:12:54.314484 25298 raft_consensus.cc:2468] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 12.
W20260709 13:12:54.314920 30790 consensus_queue.cc:1175] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "79d99c0e498349bda74127365219e468" responder_term: 14 status { last_received { term: 14 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 14 index: 7 } }
I20260709 13:12:54.313411 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:54.254212 30416 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:54.318034 25270 leader_election.cc:304] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:54.319352 25300 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 12.
I20260709 13:12:54.308864 30571 raft_consensus.cc:2749] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:54.318692 25195 leader_election.cc:304] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:54.321508 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:54.320801 25270 leader_election.cc:304] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:54.317503 30842 raft_consensus.cc:2749] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:54.311857 30598 raft_consensus.cc:2749] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:12:54.317589 30688 raft_consensus.cc:3060] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:54.335831 25296 raft_consensus.cc:1240] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:54.318405 30855 raft_consensus.cc:2749] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:54.312522 30859 raft_consensus.cc:2749] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:54.338846 30853 consensus_queue.cc:260] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:54.340893 30744 raft_consensus.cc:3060] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:54.312013 30763 consensus_queue.cc:1048] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:12:54.341977 30718 leader_election.cc:290] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:54.342607 30864 raft_consensus.cc:3055] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:54.365458 30853 raft_consensus.cc:3060] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:54.366254 30572 leader_election.cc:290] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:54.343335 30342 raft_consensus.cc:3055] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:54.325014 30786 consensus_queue.cc:1059] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:12:54.319520 30388 raft_consensus.cc:2749] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:54.347267 30787 leader_election.cc:290] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:54.313187 30838 consensus_queue.cc:1048] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:12:54.370864 30416 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:54.322435 30479 consensus_queue.cc:260] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:54.365554 30864 raft_consensus.cc:740] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:54.353991 30643 raft_consensus.cc:2749] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:12:54.315536 30522 raft_consensus.cc:515] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:54.368960 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:54.371932 30479 raft_consensus.cc:3060] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:54.344055 30852 raft_consensus.cc:3055] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:54.367877 30342 raft_consensus.cc:740] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:54.375648 30852 raft_consensus.cc:740] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:54.372799 30864 consensus_queue.cc:260] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:54.378120 30388 raft_consensus.cc:3055] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:12:54.382117 30388 raft_consensus.cc:740] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:54.383781 30342 consensus_queue.cc:260] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:54.383977 30388 consensus_queue.cc:260] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:54.382326 30864 raft_consensus.cc:3060] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:54.387403 30852 consensus_queue.cc:260] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:54.389400 30780 leader_election.cc:290] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:54.389808 30852 raft_consensus.cc:3060] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:54.384546 30522 leader_election.cc:290] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:54.395119 30516 raft_consensus.cc:515] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:54.396701 30516 leader_election.cc:290] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:54.398658 30778 raft_consensus.cc:515] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:54.399511 30837 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:54.400952 30778 leader_election.cc:290] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 14 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:54.401456 30837 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 18 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:54.432145 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 113425us
I20260709 13:12:54.434382 25195 leader_election.cc:304] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:54.435982 25196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:54.436718 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 100027us
W20260709 13:12:54.441738 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:54.464161 25194 leader_election.cc:304] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:54.466558 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:54.468940 25377 raft_consensus.cc:1240] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:12:54.356849 25300 raft_consensus.cc:1275] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:12:54.470940 25908 raft_consensus.cc:2393] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 14: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:12:54.489502 25874 leader_election.cc:304] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:54.478695 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:54.479379 25343 leader_election.cc:304] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:54.459211 25224 raft_consensus.cc:1240] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:54.486037 25378 raft_consensus.cc:1240] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:54.489099 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:54.490883 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:54.387593 30342 raft_consensus.cc:3060] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:54.522091 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:54.523451 25375 raft_consensus.cc:2393] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 14: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:54.526055 30763 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.527211 30763 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:54.535614 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 46636.6us
W20260709 13:12:54.537622 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 74085.3us
I20260709 13:12:54.539357 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:54.539786 30842 raft_consensus.cc:2804] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:54.540498 30842 raft_consensus.cc:697] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 15 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:54.540786 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:54.542021 30842 consensus_queue.cc:237] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:54.543417 30718 raft_consensus.cc:2749] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:54.545066 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:54.550011 30790 consensus_queue.cc:1059] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 18.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:54.551636 30718 raft_consensus.cc:3055] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:12:54.552213 30718 raft_consensus.cc:740] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:54.498430 30624 raft_consensus.cc:2804] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:54.554095 30624 raft_consensus.cc:697] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 12 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:54.554356 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:54.555190 25221 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 12.
I20260709 13:12:54.555516 30624 consensus_queue.cc:237] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:54.557940 30763 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:54.496984 30416 consensus_queue.cc:1059] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:12:54.516119 25302 raft_consensus.cc:2393] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 15: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:54.552017 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:54.562079 25304 raft_consensus.cc:3060] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:54.565039 30522 raft_consensus.cc:2749] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:12:54.565580 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 100042us
I20260709 13:12:54.553676 30718 consensus_queue.cc:260] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.8, Last appended by leader: 8, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:54.566895 30515 raft_consensus.cc:2749] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:54.495734 30388 raft_consensus.cc:3060] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:54.501488 25270 leader_election.cc:304] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:54.596089 25227 raft_consensus.cc:3060] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:54.609951 30853 raft_consensus.cc:3055] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:54.610656 30853 raft_consensus.cc:740] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:54.620198 30864 consensus_queue.cc:1059] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:12:54.597090 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:54.637403 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:54.641968 30416 raft_consensus.cc:2804] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:54.642683 30416 raft_consensus.cc:493] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:54.643304 30416 raft_consensus.cc:3060] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:54.652401 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:54.657223 30515 consensus_queue.cc:1059] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:12:54.592538 30624 raft_consensus.cc:493] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.662904 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:54.664582 25899 raft_consensus.cc:3060] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:54.670361 30853 consensus_queue.cc:260] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:54.673153 25269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:54.676287 30838 raft_consensus.cc:3055] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:54.659718 30718 raft_consensus.cc:3060] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:54.679575 30838 raft_consensus.cc:740] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:54.685706 30838 consensus_queue.cc:260] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:54.687644 30838 raft_consensus.cc:3060] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:54.700819 25224 raft_consensus.cc:1275] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:12:54.707023 25372 raft_consensus.cc:2468] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 15.
W20260709 13:12:54.707687 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 62060.1us
I20260709 13:12:54.712025 30853 raft_consensus.cc:3060] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:54.715857 25195 leader_election.cc:304] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:54.709211 30780 consensus_queue.cc:1048] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:12:54.700179 25227 raft_consensus.cc:2468] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 14.
I20260709 13:12:54.713644 25343 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:12:54.723290 25226 raft_consensus.cc:1240] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Rejecting Update request from peer 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:12:54.729136 25304 raft_consensus.cc:2468] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 18.
I20260709 13:12:54.690490 30624 raft_consensus.cc:515] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:54.724561 30763 raft_consensus.cc:2749] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:12:54.735543 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 234410us
I20260709 13:12:54.744561 25230 raft_consensus.cc:2468] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 15.
I20260709 13:12:54.748814 25899 raft_consensus.cc:2468] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 18.
I20260709 13:12:54.752332 30516 raft_consensus.cc:2804] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:54.752879 30516 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:54.753495 30516 raft_consensus.cc:3060] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:54.771667 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:54.774819 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:54.775785 25302 raft_consensus.cc:2393] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 15: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:54.778290 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:54.783874 30416 raft_consensus.cc:515] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:54.784889 25304 raft_consensus.cc:3060] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:54.785336 25194 leader_election.cc:304] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:54.788036 30807 consensus_queue.cc:1048] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:54.791631 30763 raft_consensus.cc:2804] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:12:54.793018 30522 raft_consensus.cc:493] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.792361 30763 raft_consensus.cc:697] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 18 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:54.794023 30522 raft_consensus.cc:515] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:54.795282 30763 consensus_queue.cc:237] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:54.795933 25304 raft_consensus.cc:2468] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 14.
I20260709 13:12:54.796824 30522 leader_election.cc:290] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:54.820902 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:54.822510 25270 leader_election.cc:304] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
W20260709 13:12:54.839829 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 89151.5us
I20260709 13:12:54.840027 30704 raft_consensus.cc:2749] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:54.828909 30853 raft_consensus.cc:493] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:54.842319 30853 raft_consensus.cc:515] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:54.844643 30853 leader_election.cc:290] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:54.838320 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:54.850700 25899 raft_consensus.cc:2410] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:12:54.846338 25195 leader_election.cc:304] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:54.862022 30688 consensus_queue.cc:1059] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:12:54.865810 25345 leader_election.cc:304] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:54.866282 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:54.865891 25302 raft_consensus.cc:2410] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:12:54.868323 25345 leader_election.cc:304] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:54.878152 30416 leader_election.cc:290] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:54.878757 30624 leader_election.cc:290] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:54.870913 30780 raft_consensus.cc:2749] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:54.886770 30537 raft_consensus.cc:2804] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:54.887565 30537 raft_consensus.cc:697] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 14 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:54.888703 30537 consensus_queue.cc:237] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:54.894848 25270 leader_election.cc:304] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:54.906140 25345 leader_election.cc:304] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:54.923903 30388 raft_consensus.cc:2749] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:12:54.904228 30842 raft_consensus.cc:2749] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:12:54.927161 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 213691us
I20260709 13:12:54.897909 30516 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:54.934823 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 99633.8us
I20260709 13:12:54.930984 30775 raft_consensus.cc:2804] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:54.950142 30696 raft_consensus.cc:493] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.952885 30696 raft_consensus.cc:515] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:54.950297 30515 consensus_queue.cc:1048] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
W20260709 13:12:54.984004 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 97473.8us
I20260709 13:12:54.986084 25375 raft_consensus.cc:1275] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:12:54.994729 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:54.995707 30807 raft_consensus.cc:3055] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:12:54.996177 30807 raft_consensus.cc:740] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:54.995765 25304 raft_consensus.cc:2410] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:12:54.987272 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:55.003685 25370 raft_consensus.cc:2410] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:12:54.997143 30807 consensus_queue.cc:260] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:55.012949 25195 leader_election.cc:304] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:55.027987 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:55.009178 30775 raft_consensus.cc:697] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 15 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:55.032298 25378 raft_consensus.cc:2410] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:12:55.038002 30860 raft_consensus.cc:493] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:55.040284 30880 log.cc:927] Time spent T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:12:55.040550 30837 raft_consensus.cc:2804] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:55.041183 30837 raft_consensus.cc:697] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 15 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:55.041656 30744 raft_consensus.cc:493] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:55.042464 30744 raft_consensus.cc:515] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:55.047950 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:55.049077 25223 raft_consensus.cc:2410] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:12:55.049346 30807 raft_consensus.cc:3060] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:12:55.053591 30887 log.cc:927] Time spent T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:12:55.055500 30388 raft_consensus.cc:493] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:55.056258 30388 raft_consensus.cc:515] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:55.059022 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:55.060010 25899 raft_consensus.cc:2410] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
W20260709 13:12:55.061543 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 51536.7us
I20260709 13:12:55.063251 25343 leader_election.cc:304] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:55.042347 30837 consensus_queue.cc:237] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:55.053721 30516 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:55.068602 30744 leader_election.cc:290] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:55.038654 30860 raft_consensus.cc:515] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:55.109625 25375 raft_consensus.cc:1275] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
W20260709 13:12:55.111714 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 98842us
I20260709 13:12:55.110086 25375 pending_rounds.cc:85] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468: Aborting all ops after (but not including) 6
W20260709 13:12:55.117194 30883 log.cc:927] Time spent T 00000000000000000000000000000000 P 5140a3161b944724a989995efdc4a818: Append to log took a long time: real 0.195s	user 0.003s	sys 0.000s
I20260709 13:12:55.118197 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:55.086535 30891 raft_consensus.cc:2804] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:55.120018 30388 leader_election.cc:290] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:55.124922 30516 raft_consensus.cc:493] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:55.125653 30516 raft_consensus.cc:515] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:55.127828 30516 leader_election.cc:290] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:55.090123 30853 raft_consensus.cc:493] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6c4b021f3f9e41adb75e870a08ad88b6)
I20260709 13:12:55.128345 30891 raft_consensus.cc:697] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 14 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:55.128554 30853 raft_consensus.cc:515] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:55.129429 30891 consensus_queue.cc:237] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:55.130337 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:55.130864 30853 leader_election.cc:290] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:55.132931 30860 leader_election.cc:290] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:55.133740 30790 raft_consensus.cc:493] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:55.134465 30790 raft_consensus.cc:515] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:55.138796 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:55.139681 25297 raft_consensus.cc:2393] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 14: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:55.140705 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:55.146209 30780 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.147084 30780 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:55.151134 30755 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:55.151747 30755 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:55.154016 30696 leader_election.cc:290] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:55.116199 25375 pending_rounds.cc:107] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 13:12:55.163273 25375 raft_consensus.cc:2889] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:55.167210 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:55.191918 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:55.195035 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:55.196655 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:12:55.191836 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 134491us
I20260709 13:12:55.194926 25905 raft_consensus.cc:2468] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 14.
I20260709 13:12:55.200811 30790 leader_election.cc:290] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:55.202530 30873 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:55.203323 30873 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:55.207619 30884 log.cc:927] Time spent T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:12:55.208827 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:55.209508 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:55.210265 25377 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 12.
I20260709 13:12:55.210355 25304 raft_consensus.cc:2468] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 15.
I20260709 13:12:55.211009 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:55.211246 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:55.211436 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:55.211792 25299 raft_consensus.cc:2468] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 15.
I20260709 13:12:55.213068 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:55.213163 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:55.215896 25226 raft_consensus.cc:2393] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 15: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:55.216353 30696 raft_consensus.cc:493] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:55.189275 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:55.234264 30696 raft_consensus.cc:515] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:55.234997 25224 raft_consensus.cc:2393] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 12: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:55.218402 30388 raft_consensus.cc:493] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.236253 30388 raft_consensus.cc:515] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:55.236862 30696 leader_election.cc:290] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:55.239238 30388 leader_election.cc:290] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:55.219983 25270 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:55.241401 25301 raft_consensus.cc:1275] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:12:55.242436 25270 leader_election.cc:304] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:55.222050 30890 raft_consensus.cc:493] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:55.223143 25344 leader_election.cc:304] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:55.224632 30873 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:55.227248 30775 consensus_queue.cc:237] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:55.228775 30755 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:55.229923 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:55.165802 30780 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:55.197412 25223 raft_consensus.cc:2468] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 15.
I20260709 13:12:55.251544 25899 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 12.
I20260709 13:12:55.189193 30516 raft_consensus.cc:493] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.256879 25303 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 12.
W20260709 13:12:55.278740 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 71279.6us
I20260709 13:12:55.277361 25343 leader_election.cc:304] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:55.288758 25297 raft_consensus.cc:2393] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 13: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:55.293272 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:55.253108 30416 raft_consensus.cc:2749] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:12:55.301093 25303 raft_consensus.cc:2468] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 18.
I20260709 13:12:55.276691 30515 raft_consensus.cc:493] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:55.276480 30537 raft_consensus.cc:2804] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:55.308641 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:55.309110 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:55.312574 25297 raft_consensus.cc:1275] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 18 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:12:55.315712 25194 leader_election.cc:304] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:55.283819 30388 raft_consensus.cc:2804] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:55.323412 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:55.321213 25304 raft_consensus.cc:2468] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 10.
I20260709 13:12:55.324285 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:55.309334 30842 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.284452 30807 consensus_queue.cc:1048] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:12:55.331965 25224 raft_consensus.cc:2468] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 18.
I20260709 13:12:55.321547 30522 raft_consensus.cc:2804] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:55.318348 30537 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:55.339586 25375 raft_consensus.cc:2468] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 17.
I20260709 13:12:55.330587 30624 raft_consensus.cc:2804] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:55.347716 25379 raft_consensus.cc:1275] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:12:55.308679 30890 raft_consensus.cc:515] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:55.343297 30522 raft_consensus.cc:493] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:55.321486 30516 raft_consensus.cc:515] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:55.343291 30537 raft_consensus.cc:3060] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:55.352680 25872 leader_election.cc:304] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:55.346513 30624 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:55.345105 30515 raft_consensus.cc:515] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:55.373350 30388 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:55.373878 30388 raft_consensus.cc:3060] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:55.374944 30515 leader_election.cc:290] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:55.357344 30842 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:55.379168 30842 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:55.380766 25227 raft_consensus.cc:2393] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 15: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:55.368546 30837 consensus_queue.cc:1048] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:12:55.388808 25374 raft_consensus.cc:1275] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:12:55.361889 30522 raft_consensus.cc:3060] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:12:55.405532 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 58582.8us
I20260709 13:12:55.370046 30624 raft_consensus.cc:3060] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:12:55.411015 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 81429.1us
I20260709 13:12:55.394989 30866 raft_consensus.cc:2749] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:12:55.415294 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 74813.7us
W20260709 13:12:55.417021 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 74272.7us
I20260709 13:12:55.414481 25345 leader_election.cc:304] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:55.418138 25195 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:55.418673 30890 leader_election.cc:290] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:55.419153 25872 leader_election.cc:304] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:55.420724 30516 leader_election.cc:290] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:55.421723 30479 consensus_queue.cc:1048] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:55.425231 30838 raft_consensus.cc:493] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.437927 25195 leader_election.cc:304] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:55.433569 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 140051us
I20260709 13:12:55.440609 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:55.444278 25227 raft_consensus.cc:2468] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 15.
I20260709 13:12:55.447196 25874 leader_election.cc:304] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:12:55.452521 30889 raft_consensus.cc:493] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:55.454885 30517 raft_consensus.cc:2804] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:12:55.455365 30517 raft_consensus.cc:493] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:55.455713 30517 raft_consensus.cc:3060] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:55.444682 30696 raft_consensus.cc:2749] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:12:55.458034 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:55.452538 25229 raft_consensus.cc:1275] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:12:55.458901 25224 raft_consensus.cc:2393] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 10: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:55.452569 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:55.459985 25905 raft_consensus.cc:2410] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for term 16 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 13:12:55.462165 30908 raft_consensus.cc:2749] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:55.462978 30522 raft_consensus.cc:515] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:55.463498 30897 log.cc:927] Time spent T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:12:55.463866 30624 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:55.464488 30899 log.cc:927] Time spent T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:12:55.466696 30522 leader_election.cc:290] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 16 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:55.444270 25343 leader_election.cc:304] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:12:55.484905 30780 raft_consensus.cc:493] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:55.485698 30780 raft_consensus.cc:515] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:55.488066 30780 leader_election.cc:290] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:55.489380 30479 raft_consensus.cc:493] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:55.490108 30479 raft_consensus.cc:515] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:55.447741 30763 raft_consensus.cc:2749] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:55.453292 30889 raft_consensus.cc:515] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:55.447906 30866 raft_consensus.cc:2749] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:55.521445 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:55.523029 25304 raft_consensus.cc:1275] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:12:55.525166 30696 raft_consensus.cc:493] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.526053 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:12:55.531165 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 117684us
I20260709 13:12:55.531445 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:55.527299 30780 raft_consensus.cc:493] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.533923 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:55.527683 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:55.530157 25221 raft_consensus.cc:2468] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 12.
I20260709 13:12:55.526916 30891 raft_consensus.cc:493] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.539512 25372 raft_consensus.cc:2468] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 18.
W20260709 13:12:55.542322 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 98128.4us
I20260709 13:12:55.543291 25343 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:12:55.543448 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:12:55.528213 30892 log.cc:927] Time spent T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:12:55.553366 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:55.554183 25298 raft_consensus.cc:2393] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 18: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:55.555223 30908 consensus_queue.cc:1048] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:55.555765 30780 raft_consensus.cc:515] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:55.556833 30903 raft_consensus.cc:493] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.557346 30903 raft_consensus.cc:515] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:55.557981 25224 raft_consensus.cc:2393] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 13: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:55.562203 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:55.564442 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:55.565163 25899 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 12.
I20260709 13:12:55.565719 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f78697097cd14345b6a749c7aad4f696" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:55.566176 30479 leader_election.cc:290] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:55.566324 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5abc7f78c6412885cf5a12e2a9ee6c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:55.567164 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a9fdb76a7d494e81629b861acc1489" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:55.567793 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:55.568584 25908 raft_consensus.cc:2368] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for earlier term 13. Current term is 14.
I20260709 13:12:55.506373 30838 raft_consensus.cc:515] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:55.570258 30688 consensus_queue.cc:1048] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:55.570574 30838 leader_election.cc:290] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:55.541708 30696 raft_consensus.cc:515] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:55.571323 25343 leader_election.cc:304] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:55.562218 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:55.574595 25224 raft_consensus.cc:3060] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:55.525276 30517 raft_consensus.cc:515] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:55.549726 30522 raft_consensus.cc:2804] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:55.547449 30624 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 18 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:55.577832 30416 raft_consensus.cc:493] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.582863 30416 raft_consensus.cc:515] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:55.585041 30416 leader_election.cc:290] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:55.585340 30516 raft_consensus.cc:2804] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:55.586032 30516 raft_consensus.cc:493] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:55.586529 30516 raft_consensus.cc:3060] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:55.586650 30696 leader_election.cc:290] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:55.592355 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:55.552907 30763 consensus_queue.cc:1048] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:12:55.576138 30890 raft_consensus.cc:2804] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:55.598284 30890 raft_consensus.cc:697] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 12 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:55.599468 30890 consensus_queue.cc:237] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:55.587970 30517 leader_election.cc:290] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 19 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:55.581331 30522 raft_consensus.cc:493] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:55.613695 30522 raft_consensus.cc:3060] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:55.613811 30891 raft_consensus.cc:515] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:55.612854 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9115771e334c95a7dec25c698514dc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:55.616282 30891 leader_election.cc:290] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:55.622529 30388 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:55.630015 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 51332.8us
I20260709 13:12:55.631359 30866 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:55.634061 30517 raft_consensus.cc:493] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:55.635888 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:55.637835 30838 raft_consensus.cc:493] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:55.653586 30838 raft_consensus.cc:515] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:55.654902 30780 leader_election.cc:290] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:55.655718 30838 leader_election.cc:290] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:55.656559 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:55.656381 30866 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:55.657289 25229 raft_consensus.cc:3060] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:55.658613 30866 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:55.659149 25221 raft_consensus.cc:2468] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 9.
I20260709 13:12:55.642064 25908 raft_consensus.cc:1275] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 18 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:12:55.661275 30516 raft_consensus.cc:515] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:55.663632 30516 leader_election.cc:290] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:12:55.643505 30914 log.cc:927] Time spent T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.060s	user 0.004s	sys 0.000s
I20260709 13:12:55.647046 25224 raft_consensus.cc:2468] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 16.
I20260709 13:12:55.673542 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:55.674216 25270 leader_election.cc:304] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:55.648043 25300 raft_consensus.cc:2468] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 18.
I20260709 13:12:55.651322 30517 raft_consensus.cc:515] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:55.674989 30416 raft_consensus.cc:2749] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:55.652037 30903 leader_election.cc:290] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:55.659426 25345 leader_election.cc:304] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:55.679490 25345 leader_election.cc:304] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:55.660806 30917 consensus_queue.cc:1048] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:12:55.683611 30917 raft_consensus.cc:2804] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:12:55.683881 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:55.684176 30917 raft_consensus.cc:697] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 16 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:55.684659 25270 leader_election.cc:304] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:55.685576 30905 raft_consensus.cc:2749] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:55.685894 25270 leader_election.cc:304] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:55.686710 30905 raft_consensus.cc:2749] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:55.687258 25270 leader_election.cc:400] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 election: Vote denied by peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085) with higher term. Message: Invalid argument: T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for earlier term 13. Current term is 14.
I20260709 13:12:55.687688 25270 leader_election.cc:403] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:12:55.688287 30853 raft_consensus.cc:2749] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085) with higher term. Message: Invalid argument: T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for earlier term 13. Current term is 14.
I20260709 13:12:55.685210 30917 consensus_queue.cc:237] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:55.638748 30889 leader_election.cc:290] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:55.665409 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c9116c92454e2ab270a148a8c5c4ea" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:55.667253 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:55.677613 30517 leader_election.cc:290] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:55.675001 30763 consensus_queue.cc:1048] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.006s
I20260709 13:12:55.681423 30903 raft_consensus.cc:2804] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:55.643014 30790 consensus_queue.cc:1048] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:55.697228 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:55.691174 25905 raft_consensus.cc:2468] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 17.
I20260709 13:12:55.691861 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:55.694114 25270 leader_election.cc:304] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:12:55.702553 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:55.696735 30903 raft_consensus.cc:493] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:55.707564 30903 raft_consensus.cc:3060] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:55.710732 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:55.712023 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:55.712679 25374 raft_consensus.cc:1275] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:12:55.715247 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:55.715973 25371 raft_consensus.cc:2468] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 18.
I20260709 13:12:55.718613 30905 raft_consensus.cc:2749] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:55.720824 25379 raft_consensus.cc:2393] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 18: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:12:55.724371 25873 leader_election.cc:304] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:55.727629 30755 raft_consensus.cc:2749] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:55.727736 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:55.729372 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:55.730263 25195 leader_election.cc:304] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:55.731567 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:55.732225 25227 raft_consensus.cc:2468] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 19.
I20260709 13:12:55.734058 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:55.734650 25227 raft_consensus.cc:2468] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 17.
I20260709 13:12:55.737377 25195 leader_election.cc:304] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:55.737149 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:55.738570 25227 raft_consensus.cc:2393] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 10: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:55.739770 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11892dffe99a496ebf3d98773631357c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:55.740310 25270 leader_election.cc:304] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:55.740398 25370 raft_consensus.cc:3060] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:55.742529 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:55.743232 25223 raft_consensus.cc:2468] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 16.
I20260709 13:12:55.747479 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:55.755576 25374 raft_consensus.cc:2468] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 17.
I20260709 13:12:55.757133 25345 leader_election.cc:304] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:55.760118 25345 leader_election.cc:304] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:55.760370 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:55.763876 25345 leader_election.cc:304] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:55.746928 30744 raft_consensus.cc:2804] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:55.768571 30744 raft_consensus.cc:493] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:55.768947 30744 raft_consensus.cc:3060] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:55.748191 30688 raft_consensus.cc:2749] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:55.768007 30775 raft_consensus.cc:493] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:55.781713 25370 raft_consensus.cc:2468] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 19.
W20260709 13:12:55.788983 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 217721us
I20260709 13:12:55.790751 30891 raft_consensus.cc:2804] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:55.791255 30891 raft_consensus.cc:493] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:55.791599 25873 leader_election.cc:304] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:55.792708 25873 leader_election.cc:304] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:55.794278 30866 raft_consensus.cc:2804] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:55.794723 30866 raft_consensus.cc:493] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:55.791625 30891 raft_consensus.cc:3060] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:55.795161 30866 raft_consensus.cc:3060] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:55.744419 30718 consensus_queue.cc:1048] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:12:55.805814 25271 leader_election.cc:304] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:12:55.806788 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 138885us
I20260709 13:12:55.809922 30905 raft_consensus.cc:2804] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:55.810369 30905 raft_consensus.cc:493] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:55.810858 30905 raft_consensus.cc:3060] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:55.814082 30853 raft_consensus.cc:493] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.766077 30910 raft_consensus.cc:2804] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:12:55.813915 30902 raft_consensus.cc:2804] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:55.825863 30696 raft_consensus.cc:493] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:55.826495 30696 raft_consensus.cc:515] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:55.826927 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c279dfc4b0d248a4a884e78a33fd437c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:55.828773 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:55.829461 25223 raft_consensus.cc:3060] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:55.823923 30902 raft_consensus.cc:493] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:55.830534 30902 raft_consensus.cc:3060] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:55.837422 25900 raft_consensus.cc:1275] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 13:12:55.837905 25900 pending_rounds.cc:85] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6: Aborting all ops after (but not including) 11
I20260709 13:12:55.838176 25900 pending_rounds.cc:107] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 13:12:55.838436 25900 raft_consensus.cc:2889] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:55.846172 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e0218933774b319104f23505937179" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:55.848701 25872 leader_election.cc:304] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:55.745085 30537 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:55.765592 30889 raft_consensus.cc:2804] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:12:55.823276 25908 raft_consensus.cc:1275] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:12:55.871697 25229 raft_consensus.cc:2468] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 19.
I20260709 13:12:55.852900 25194 leader_election.cc:304] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:12:55.818449 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:55.814842 30853 raft_consensus.cc:515] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:55.814836 30517 raft_consensus.cc:2804] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:12:55.879421 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:55.877647 25304 raft_consensus.cc:2468] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 13.
I20260709 13:12:55.882805 25298 raft_consensus.cc:3060] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:55.822409 30910 raft_consensus.cc:493] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:55.883808 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:55.884328 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:55.886132 25378 raft_consensus.cc:2368] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 15. Current term is 16.
I20260709 13:12:55.870277 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e85321bc6774ed28bf79ebfd5eae6e0" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:55.893560 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:55.894439 25296 raft_consensus.cc:2468] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 18.
I20260709 13:12:55.875710 30522 raft_consensus.cc:515] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:55.895323 25302 raft_consensus.cc:2468] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 13.
I20260709 13:12:55.896754 30522 leader_election.cc:290] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:55.875509 30516 consensus_queue.cc:1048] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:12:55.896764 30780 consensus_queue.cc:1048] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:12:55.900504 30696 leader_election.cc:290] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:12:55.903559 25114 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 8d0f43a786a846b49924a589e4a36f2f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 6c4b021f3f9e41adb75e870a08ad88b6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:12:55.880123 30515 raft_consensus.cc:2749] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:12:55.909883 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:55.906903 30891 raft_consensus.cc:515] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:55.913367 30891 leader_election.cc:290] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 17 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:55.914089 30537 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 16 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:55.874341 30889 raft_consensus.cc:493] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:55.817922 30775 raft_consensus.cc:515] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:55.937448 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:55.886107 30910 raft_consensus.cc:3060] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:55.945969 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:55.946604 25903 raft_consensus.cc:3060] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:12:55.891206 30873 raft_consensus.cc:2804] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:12:55.957984 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:55.960647 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:55.929502 30889 raft_consensus.cc:3060] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:55.988508 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:55.992995 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:55.993990 25301 raft_consensus.cc:2393] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 19: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:55.993927 25374 raft_consensus.cc:2468] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 8.
I20260709 13:12:56.006140 30517 raft_consensus.cc:697] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 19 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:55.963238 30891 raft_consensus.cc:493] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:55.997840 30873 raft_consensus.cc:697] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 18 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:56.060029 30517 consensus_queue.cc:237] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:56.063966 30873 consensus_queue.cc:237] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:56.066847 30909 raft_consensus.cc:493] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.067461 30909 raft_consensus.cc:515] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:55.999326 30522 raft_consensus.cc:493] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:56.082459 25303 raft_consensus.cc:2468] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 10.
I20260709 13:12:56.074734 25903 raft_consensus.cc:2468] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 16.
W20260709 13:12:56.084278 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 207443us
I20260709 13:12:56.091339 25223 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 13.
W20260709 13:12:56.098186 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 241631us
W20260709 13:12:56.107895 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 68891.9us
I20260709 13:12:56.121101 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:56.122359 25297 raft_consensus.cc:2468] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 15.
I20260709 13:12:56.127059 25298 raft_consensus.cc:2468] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 16.
I20260709 13:12:56.127959 25296 raft_consensus.cc:1275] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:12:56.128892 30853 leader_election.cc:290] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:56.116670 25872 leader_election.cc:304] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:56.179988 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:56.193392 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:56.194025 25223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:56.106572 30903 raft_consensus.cc:515] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:56.194864 25223 raft_consensus.cc:2393] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 15: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:56.194950 25226 raft_consensus.cc:2468] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 15.
I20260709 13:12:56.199394 30903 leader_election.cc:290] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:56.200073 25372 raft_consensus.cc:2368] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 13. Current term is 14.
I20260709 13:12:56.200944 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:56.127116 30902 raft_consensus.cc:515] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:56.208341 30902 leader_election.cc:290] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 18 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:56.211090 30932 raft_consensus.cc:2749] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:12:56.213039 30925 log.cc:927] Time spent T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:12:56.215160 30744 raft_consensus.cc:515] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:56.218057 25300 raft_consensus.cc:2393] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 18: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:56.143675 30522 raft_consensus.cc:515] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:56.220914 30522 leader_election.cc:290] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:56.193579 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:56.226661 25224 raft_consensus.cc:3060] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:56.201625 25230 raft_consensus.cc:3060] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:56.194306 25221 raft_consensus.cc:2393] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 9: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
W20260709 13:12:56.231884 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 90744.8us
W20260709 13:12:56.234985 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 101120us
I20260709 13:12:56.236522 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:56.217549 30744 leader_election.cc:290] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 18 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:56.260985 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:56.250988 25271 leader_election.cc:304] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:56.256301 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:56.261868 25297 raft_consensus.cc:2393] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce in current term 18: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:56.262069 25305 raft_consensus.cc:1275] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 13:12:56.295006 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 178401us
I20260709 13:12:56.295833 25872 leader_election.cc:304] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:56.299163 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:56.115335 30891 raft_consensus.cc:515] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:56.304271 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:56.309538 25230 raft_consensus.cc:2468] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 16.
I20260709 13:12:56.321069 30744 raft_consensus.cc:2804] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:56.321573 30744 raft_consensus.cc:493] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:56.321971 30744 raft_consensus.cc:3060] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:56.331911 30891 leader_election.cc:290] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:12:56.338171 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 155878us
I20260709 13:12:56.342022 25224 raft_consensus.cc:2468] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 17.
I20260709 13:12:56.344868 25873 leader_election.cc:400] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091) with higher term. Message: Invalid argument: T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 15. Current term is 16.
I20260709 13:12:56.348080 25873 leader_election.cc:403] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:12:56.363103 30924 log.cc:927] Time spent T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:12:56.372463 30908 raft_consensus.cc:493] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.373070 30908 raft_consensus.cc:515] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:56.318487 30904 raft_consensus.cc:2749] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:56.375715 25343 leader_election.cc:304] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
W20260709 13:12:56.381176 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 267130us
W20260709 13:12:56.383720 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 44850.3us
I20260709 13:12:56.384567 30934 raft_consensus.cc:2749] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091) with higher term. Message: Invalid argument: T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 for earlier term 15. Current term is 16.
W20260709 13:12:56.385377 30905 consensus_meta.cc:287] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.574s	user 0.007s	sys 0.003s
I20260709 13:12:56.400580 25343 leader_election.cc:304] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:56.402909 30903 raft_consensus.cc:2804] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:56.406729 30903 raft_consensus.cc:493] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting leader election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:56.407117 30903 raft_consensus.cc:3060] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:56.407641 30516 raft_consensus.cc:2749] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:56.410676 25343 leader_election.cc:304] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:56.411446 30696 raft_consensus.cc:2749] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:56.411902 25343 leader_election.cc:304] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:56.412623 30696 raft_consensus.cc:2749] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:56.413802 25343 leader_election.cc:304] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:12:56.415199 30696 raft_consensus.cc:2804] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:12:56.391085 30866 consensus_meta.cc:287] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6: Time spent flushing consensus metadata: real 0.595s	user 0.005s	sys 0.007s
I20260709 13:12:56.415666 30696 raft_consensus.cc:697] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 10 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:56.416095 30866 raft_consensus.cc:515] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:56.417078 30516 consensus_queue.cc:1048] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:56.418179 30775 leader_election.cc:290] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:56.418550 30866 leader_election.cc:290] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 18 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:56.416792 30696 consensus_queue.cc:237] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:56.397495 30889 raft_consensus.cc:515] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:56.426542 30903 raft_consensus.cc:515] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:56.428131 30889 leader_election.cc:290] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 19 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:56.429019 30903 leader_election.cc:290] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:56.431160 30908 leader_election.cc:290] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:56.433820 30388 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:56.446368 30946 raft_consensus.cc:493] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:56.447134 30946 raft_consensus.cc:515] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:56.397200 30853 raft_consensus.cc:493] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.453472 30853 raft_consensus.cc:515] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:56.456257 30853 leader_election.cc:290] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:56.461952 25195 leader_election.cc:400] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 pre-election: Vote denied by peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091) with higher term. Message: Invalid argument: T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 13. Current term is 14.
I20260709 13:12:56.463265 25195 leader_election.cc:403] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:56.466917 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
W20260709 13:12:56.466851 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 120026us
W20260709 13:12:56.521871 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 60162.2us
I20260709 13:12:56.385835 30905 raft_consensus.cc:515] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:56.525362 25906 raft_consensus.cc:1275] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:12:56.466173 30479 raft_consensus.cc:3060] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:12:56.522907 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:56.449600 30946 leader_election.cc:290] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:56.530923 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:56.534387 25194 leader_election.cc:304] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:56.549168 25230 raft_consensus.cc:2368] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for earlier term 16. Current term is 17.
I20260709 13:12:56.544998 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
W20260709 13:12:56.528610 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 143860us
I20260709 13:12:56.549783 25224 raft_consensus.cc:2468] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 15.
I20260709 13:12:56.553431 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:56.553740 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:56.554141 25305 raft_consensus.cc:3060] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:56.559473 25299 raft_consensus.cc:1275] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:12:56.560073 25301 raft_consensus.cc:1240] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:56.565774 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:56.566501 25344 leader_election.cc:304] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:56.565677 25296 raft_consensus.cc:2468] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 15.
I20260709 13:12:56.570874 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:56.573529 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:56.574312 25377 raft_consensus.cc:3060] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:56.574421 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:56.581272 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:56.582139 25299 raft_consensus.cc:2393] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 19: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:56.582763 30744 raft_consensus.cc:515] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:56.585255 30744 leader_election.cc:290] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:56.587563 25298 raft_consensus.cc:2368] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 9. Current term is 10.
I20260709 13:12:56.573568 25300 raft_consensus.cc:1275] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:12:56.588817 25271 leader_election.cc:400] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361) with higher term. Message: Invalid argument: T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for earlier term 16. Current term is 17.
I20260709 13:12:56.589279 25271 leader_election.cc:403] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:56.594560 25297 raft_consensus.cc:2368] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 15. Current term is 16.
I20260709 13:12:56.598850 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:56.599480 25230 raft_consensus.cc:3060] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:56.600255 25343 leader_election.cc:304] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:12:56.603302 25344 leader_election.cc:304] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:56.605988 25271 leader_election.cc:304] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:12:56.617590 30940 log.cc:927] Time spent T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:12:56.594750 30917 raft_consensus.cc:2804] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:12:56.620180 30905 leader_election.cc:290] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:56.617590 25377 raft_consensus.cc:2468] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 18.
I20260709 13:12:56.353902 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:56.624181 25230 raft_consensus.cc:2468] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 16.
I20260709 13:12:56.626113 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:56.626724 25227 raft_consensus.cc:3060] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:56.594280 30790 raft_consensus.cc:2804] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:56.628134 25271 leader_election.cc:304] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:56.609859 30516 raft_consensus.cc:2804] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:56.632211 25305 raft_consensus.cc:2468] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 14.
I20260709 13:12:56.627348 30479 raft_consensus.cc:2749] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091) with higher term. Message: Invalid argument: T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 13. Current term is 14.
I20260709 13:12:56.607259 30775 consensus_queue.cc:1048] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:12:56.599087 30946 raft_consensus.cc:3060] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:12:56.636276 25296 raft_consensus.cc:2468] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 13.
W20260709 13:12:56.637388 30910 consensus_meta.cc:287] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468: Time spent flushing consensus metadata: real 0.650s	user 0.011s	sys 0.000s
I20260709 13:12:56.639391 30889 raft_consensus.cc:2749] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:56.639530 30952 raft_consensus.cc:493] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.623196 30744 raft_consensus.cc:2804] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:56.644966 30909 leader_election.cc:290] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:56.648353 25873 leader_election.cc:304] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:56.649515 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:56.657397 25343 leader_election.cc:400] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Vote denied by peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127) with higher term. Message: Invalid argument: T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 9. Current term is 10.
W20260709 13:12:56.666561 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 71910.5us
I20260709 13:12:56.675567 25343 leader_election.cc:403] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:56.650794 30790 raft_consensus.cc:493] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:56.675585 25298 raft_consensus.cc:2393] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c4b021f3f9e41adb75e870a08ad88b6 in current term 18: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:12:56.658169 30905 raft_consensus.cc:2804] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:12:56.609997 30903 consensus_queue.cc:1059] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:12:56.682287 25343 leader_election.cc:304] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:56.709584 25227 raft_consensus.cc:2468] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 10.
I20260709 13:12:56.711284 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:56.715160 25271 leader_election.cc:304] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:56.674528 30917 raft_consensus.cc:697] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 16 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:56.683781 30790 raft_consensus.cc:3060] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:56.682116 30744 raft_consensus.cc:493] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:56.685626 30838 raft_consensus.cc:2804] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:12:56.673451 30910 raft_consensus.cc:515] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:56.738075 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 48648us
I20260709 13:12:56.738762 30912 raft_consensus.cc:2804] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:56.707697 30516 raft_consensus.cc:697] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 15 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:56.709342 30905 raft_consensus.cc:697] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 16 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:56.720203 30906 raft_consensus.cc:2804] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:56.763950 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:56.764747 25899 raft_consensus.cc:3060] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:56.718189 30780 raft_consensus.cc:3060] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:12:56.721442 30744 raft_consensus.cc:3060] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:56.758572 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:56.774889 25370 raft_consensus.cc:2368] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 18. Current term is 19.
W20260709 13:12:56.775588 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 145453us
I20260709 13:12:56.738677 25378 raft_consensus.cc:1275] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 19 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 13:12:56.780056 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 185832us
I20260709 13:12:56.758983 30838 raft_consensus.cc:697] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 18 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:12:56.763705 30912 raft_consensus.cc:697] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 14 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:56.711447 30952 raft_consensus.cc:515] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:56.744632 30935 consensus_queue.cc:1048] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:12:56.794948 30921 consensus_queue.cc:1048] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.125s
I20260709 13:12:56.795490 30718 consensus_queue.cc:1048] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:12:56.803298 30936 log.cc:927] Time spent T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.470s	user 0.004s	sys 0.000s
I20260709 13:12:56.807166 30910 leader_election.cc:290] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 19 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:12:56.815088 30947 log.cc:927] Time spent T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:12:56.776032 30906 raft_consensus.cc:697] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 10 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:56.825670 30516 consensus_queue.cc:237] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:56.842622 30906 consensus_queue.cc:237] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:56.828179 30838 consensus_queue.cc:237] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:56.846663 30952 leader_election.cc:290] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:56.830130 25230 raft_consensus.cc:1275] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 19 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:12:56.848939 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:56.830328 30912 consensus_queue.cc:237] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:56.832105 30917 consensus_queue.cc:237] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:56.837769 30954 log.cc:927] Time spent T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:12:56.851811 25195 leader_election.cc:400] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 18 election: Vote denied by peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091) with higher term. Message: Invalid argument: T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 18. Current term is 19.
I20260709 13:12:56.854561 25195 leader_election.cc:403] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
W20260709 13:12:56.855994 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 173777us
I20260709 13:12:56.856830 25343 leader_election.cc:400] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Vote denied by peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127) with higher term. Message: Invalid argument: T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 15. Current term is 16.
I20260709 13:12:56.857261 25343 leader_election.cc:403] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:56.789403 30944 raft_consensus.cc:493] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:56.854802 30866 consensus_queue.cc:1048] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.010s
W20260709 13:12:56.864101 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 104548us
I20260709 13:12:56.869714 25899 raft_consensus.cc:2468] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 13.
I20260709 13:12:56.868358 25343 leader_election.cc:304] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:12:56.872650 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 116595us
I20260709 13:12:56.880075 25270 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
W20260709 13:12:56.881966 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 96443.8us
I20260709 13:12:56.885514 30959 raft_consensus.cc:3060] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:56.888098 30952 raft_consensus.cc:2804] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:56.888844 30952 raft_consensus.cc:697] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 13 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:56.898166 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:56.889881 30952 consensus_queue.cc:237] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:56.906782 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:56.856186 30905 consensus_queue.cc:237] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:56.910728 25298 raft_consensus.cc:3060] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:56.924113 30960 raft_consensus.cc:3060] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:12:56.924191 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:56.925920 25298 raft_consensus.cc:2468] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 19.
I20260709 13:12:56.932063 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f43a786a846b49924a589e4a36f2f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:56.874087 30944 raft_consensus.cc:515] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:56.921132 30910 raft_consensus.cc:2804] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:56.948810 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd182e135fd4b4db8700ed3173fd000" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:56.960150 25378 raft_consensus.cc:2393] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 18: Already voted for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in this term.
I20260709 13:12:56.962358 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:56.963958 25379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:56.965934 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:56.966892 25372 raft_consensus.cc:2368] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for earlier term 16. Current term is 17.
I20260709 13:12:56.967296 30780 raft_consensus.cc:2749] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127) with higher term. Message: Invalid argument: T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 9. Current term is 10.
I20260709 13:12:56.986340 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57009a57e25248a39037d8922bf47bf2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:56.987636 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:56.986410 30763 raft_consensus.cc:493] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.989192 30763 raft_consensus.cc:515] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:57.002866 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b49f61c49ae486392588c88e34a32d0" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:56.952453 30837 raft_consensus.cc:493] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:57.019446 25345 leader_election.cc:304] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:57.040293 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2ea64fbf1c4f6db8eda01c8d9ac433" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:56.990623 30910 raft_consensus.cc:697] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 13 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:57.048609 25221 raft_consensus.cc:1240] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:57.021335 30718 raft_consensus.cc:493] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.984108 30790 raft_consensus.cc:515] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:57.028908 30906 raft_consensus.cc:493] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:57.096241 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 53747.7us
I20260709 13:12:57.114310 25905 raft_consensus.cc:1240] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
W20260709 13:12:57.105618 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 54766.7us
I20260709 13:12:57.114368 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a4e5911cd2414daf6cc0bc2a692a69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:57.118981 25227 raft_consensus.cc:1275] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:12:57.125104 25224 raft_consensus.cc:2468] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 14.
I20260709 13:12:57.128756 25221 raft_consensus.cc:2368] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 15. Current term is 16.
W20260709 13:12:57.139967 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 110656us
I20260709 13:12:57.076856 30837 raft_consensus.cc:515] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:57.165387 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:57.094319 30963 consensus_queue.cc:1048] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.260s
I20260709 13:12:57.129009 30744 raft_consensus.cc:515] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:57.106765 30718 raft_consensus.cc:515] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:57.165194 25343 leader_election.cc:304] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:57.133117 30906 raft_consensus.cc:515] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:57.215827 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 50770.6us
W20260709 13:12:57.231658 30965 log.cc:927] Time spent T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260709 13:12:57.232143 30982 raft_consensus.cc:2804] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:12:57.232986 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:57.233283 25224 raft_consensus.cc:1275] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:12:57.234383 25345 leader_election.cc:304] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:57.238675 25194 leader_election.cc:304] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:57.214867 30969 log.cc:927] Time spent T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 13:12:57.175992 30921 consensus_queue.cc:1059] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:12:57.213397 30696 raft_consensus.cc:3055] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:57.242468 30837 leader_election.cc:290] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:57.257226 30837 raft_consensus.cc:2749] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:57.228734 30920 raft_consensus.cc:2804] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:12:57.260233 30982 raft_consensus.cc:697] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 19 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:57.261293 30982 consensus_queue.cc:237] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:57.262346 30920 raft_consensus.cc:697] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 17 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:57.263415 30920 consensus_queue.cc:237] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:57.266574 30917 raft_consensus.cc:493] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:57.267138 30917 raft_consensus.cc:515] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:57.269798 30917 leader_election.cc:290] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:57.269851 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:57.286902 25225 raft_consensus.cc:2393] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 13: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:57.242435 30935 raft_consensus.cc:493] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:57.270015 30927 raft_consensus.cc:2749] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:57.194170 30910 consensus_queue.cc:237] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:57.252122 30696 raft_consensus.cc:740] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:57.278852 30763 leader_election.cc:290] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:57.314560 25221 raft_consensus.cc:2468] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 19.
I20260709 13:12:57.303774 30959 raft_consensus.cc:2749] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091) with higher term. Message: Invalid argument: T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f539ba21487460085b837e7529a78ce for earlier term 18. Current term is 19.
I20260709 13:12:57.306227 30935 raft_consensus.cc:515] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:57.321846 30790 leader_election.cc:290] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 16 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:57.349582 30983 log.cc:927] Time spent T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:12:57.330471 30696 consensus_queue.cc:260] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:57.356158 30906 leader_election.cc:290] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:57.357903 30974 log.cc:927] Time spent T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 13:12:57.353953 30744 leader_election.cc:290] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:57.364607 30935 leader_election.cc:290] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:57.369717 30960 raft_consensus.cc:2749] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127) with higher term. Message: Invalid argument: T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 15. Current term is 16.
I20260709 13:12:57.371892 25371 raft_consensus.cc:2468] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 16.
W20260709 13:12:57.372457 30946 consensus_meta.cc:287] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19: Time spent flushing consensus metadata: real 0.699s	user 0.006s	sys 0.002s
I20260709 13:12:57.372962 30946 raft_consensus.cc:2749] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361) with higher term. Message: Invalid argument: T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for earlier term 16. Current term is 17.
I20260709 13:12:57.381309 25228 raft_consensus.cc:2468] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 19.
I20260709 13:12:57.382562 25125 catalog_manager.cc:5697] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 5 to 10, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68). New cstate: current_term: 10 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:57.388028 30718 leader_election.cc:290] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:57.385064 25125 catalog_manager.cc:5697] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 8 to 11, leader changed from 79d99c0e498349bda74127365219e468 (127.23.140.67) to 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68). New cstate: current_term: 11 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:12:57.355634 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 234605us
W20260709 13:12:57.398208 30976 log.cc:927] Time spent T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.164s	user 0.000s	sys 0.003s
W20260709 13:12:57.394842 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 160552us
I20260709 13:12:57.412350 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:57.413250 25305 raft_consensus.cc:2468] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 10.
I20260709 13:12:57.416528 25298 raft_consensus.cc:1240] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:57.419241 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:57.421192 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:57.425420 25221 raft_consensus.cc:1275] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:12:57.426677 25305 raft_consensus.cc:1275] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:12:57.463613 25345 leader_election.cc:400] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361) with higher term. Message: Invalid argument: T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 for earlier term 15. Current term is 16.
W20260709 13:12:57.466483 25345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:57.467078 25376 raft_consensus.cc:2468] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 10.
I20260709 13:12:57.469734 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:57.470574 25229 raft_consensus.cc:2468] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 19.
I20260709 13:12:57.468873 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:57.472301 25225 raft_consensus.cc:3060] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:12:57.479383 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 233051us
I20260709 13:12:57.486543 25194 leader_election.cc:304] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:57.429997 30516 consensus_queue.cc:1059] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:12:57.477710 30935 consensus_queue.cc:1059] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:12:57.495497 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:57.495718 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:57.508455 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:57.510167 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:57.512980 25222 raft_consensus.cc:1275] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:12:57.513005 25224 raft_consensus.cc:1275] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:12:57.493327 30842 raft_consensus.cc:2804] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:57.518187 30842 raft_consensus.cc:493] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:57.518576 30842 raft_consensus.cc:3060] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:57.520259 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:57.491894 30917 consensus_queue.cc:1048] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:12:57.482710 30982 consensus_queue.cc:1048] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:12:57.535243 25225 raft_consensus.cc:2468] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 16.
I20260709 13:12:57.540359 30944 leader_election.cc:290] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:57.570823 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:57.571502 25370 raft_consensus.cc:2468] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 19.
I20260709 13:12:57.570150 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb167d72a441418dc3c55148746e87" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:57.572940 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:57.578496 25125 catalog_manager.cc:5697] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:12:57.581125 30969 log.cc:927] Time spent T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.241s	user 0.000s	sys 0.002s
W20260709 13:12:57.586773 30925 log.cc:927] Time spent T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.519s	user 0.002s	sys 0.000s
I20260709 13:12:57.591357 25899 raft_consensus.cc:1275] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:12:57.601935 30416 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.602537 30416 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:57.592396 30973 log.cc:927] Time spent T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.360s	user 0.000s	sys 0.002s
I20260709 13:12:57.604903 30416 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:57.609632 25270 leader_election.cc:304] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:57.617031 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:57.617625 25305 raft_consensus.cc:3060] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:57.617223 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:57.619835 25298 raft_consensus.cc:2468] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 13.
I20260709 13:12:57.620191 25296 raft_consensus.cc:1240] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 13 LEADER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:12:57.620808 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:57.616405 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8da265131524ca9bbf94bd69438fc22" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:57.624471 25270 leader_election.cc:400] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091) with higher term. Message: Invalid argument: T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for earlier term 16. Current term is 17.
I20260709 13:12:57.628193 30952 raft_consensus.cc:2749] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:57.629154 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:57.631572 30696 raft_consensus.cc:3060] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:57.643054 25305 raft_consensus.cc:2468] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 16.
I20260709 13:12:57.644356 25302 raft_consensus.cc:1240] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:57.657956 25270 leader_election.cc:304] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:57.624404 30917 consensus_queue.cc:1048] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.038s
I20260709 13:12:57.616441 30842 raft_consensus.cc:515] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:57.664832 25229 raft_consensus.cc:1240] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:57.666040 30842 leader_election.cc:290] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:57.667811 30984 log.cc:927] Time spent T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.434s	user 0.000s	sys 0.002s
I20260709 13:12:57.679260 30920 consensus_queue.cc:1048] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:57.685076 25345 leader_election.cc:304] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:57.687024 25345 leader_election.cc:304] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:57.687067 25378 raft_consensus.cc:1275] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:12:57.687944 30927 consensus_queue.cc:1048] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:12:57.688611 25345 leader_election.cc:304] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:57.689488 30981 raft_consensus.cc:2749] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:57.690392 30522 consensus_queue.cc:1048] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:57.692159 30995 raft_consensus.cc:3055] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:12:57.692564 30995 raft_consensus.cc:740] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:57.693104 30744 raft_consensus.cc:2804] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:12:57.693600 30744 raft_consensus.cc:493] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:57.693368 30995 consensus_queue.cc:260] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:57.694059 30744 raft_consensus.cc:3060] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:57.694504 30995 raft_consensus.cc:3060] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:57.696177 30522 raft_consensus.cc:2749] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:57.699448 25225 raft_consensus.cc:1240] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:12:57.699515 30949 consensus_queue.cc:1048] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:57.704018 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:57.704674 25378 raft_consensus.cc:2468] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 18.
I20260709 13:12:57.706138 30890 raft_consensus.cc:2804] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:12:57.706703 30890 raft_consensus.cc:697] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 19 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:57.710352 25229 raft_consensus.cc:1240] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:57.711540 25271 leader_election.cc:304] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:12:57.725940 25377 raft_consensus.cc:1275] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:12:57.736369 25270 leader_election.cc:304] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
I20260709 13:12:57.743736 25271 leader_election.cc:304] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:57.709568 30890 consensus_queue.cc:237] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.8, Last appended by leader: 8, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:57.748512 30906 raft_consensus.cc:2804] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:12:57.750710 30388 raft_consensus.cc:2749] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:12:57.739233 30944 consensus_queue.cc:1048] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:12:57.790467 30949 raft_consensus.cc:2749] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:57.804373 30906 raft_consensus.cc:697] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 16 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
W20260709 13:12:57.840830 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 97168.1us
I20260709 13:12:57.876673 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:57.877172 25377 raft_consensus.cc:1275] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 13:12:57.887622 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 47847.2us
I20260709 13:12:57.905076 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
W20260709 13:12:57.911892 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 160913us
I20260709 13:12:57.917510 25270 leader_election.cc:304] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:12:57.921135 25303 raft_consensus.cc:1275] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 18 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:12:57.924299 31007 raft_consensus.cc:2804] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:12:57.924749 31007 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:57.925134 31007 raft_consensus.cc:3060] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:57.928341 30906 consensus_queue.cc:237] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:57.943066 25377 raft_consensus.cc:1275] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 13:12:57.944140 25377 pending_rounds.cc:85] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468: Aborting all ops after (but not including) 8
I20260709 13:12:57.944347 25377 pending_rounds.cc:107] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 13:12:57.944548 25377 raft_consensus.cc:2889] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:57.943066 30875 consensus_queue.cc:1048] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 13:12:57.973145 25125 catalog_manager.cc:5697] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:57.976521 25125 catalog_manager.cc:5697] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 7 to 12, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68). New cstate: current_term: 12 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:57.978497 30929 consensus_queue.cc:1048] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:12:57.993245 25230 raft_consensus.cc:1275] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:12:57.996152 25296 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a"
dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
mode: GRACEFUL
new_leader_uuid: "79d99c0e498349bda74127365219e468"
 from {username='slave'} at 127.0.0.1:35660
I20260709 13:12:57.998579 25296 raft_consensus.cc:606] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 16 LEADER]: Received request to transfer leadership to TS 79d99c0e498349bda74127365219e468
I20260709 13:12:58.002373 30744 raft_consensus.cc:515] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:58.014477 30989 consensus_queue.cc:1048] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.006s
W20260709 13:12:58.058141 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:58.010653 30944 consensus_queue.cc:1048] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:12:58.025097 30889 consensus_queue.cc:1059] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:12:58.060138 30744 leader_election.cc:290] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 20 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:58.067962 30903 consensus_queue.cc:1059] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:12:58.069388 30917 raft_consensus.cc:3055] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:12:58.069890 30917 raft_consensus.cc:740] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:58.070928 30917 consensus_queue.cc:260] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:58.073467 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 52018.7us
I20260709 13:12:58.072968 30889 raft_consensus.cc:3055] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:58.079962 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:58.086551 30889 raft_consensus.cc:740] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:58.087482 30889 consensus_queue.cc:260] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:58.088713 30889 raft_consensus.cc:3060] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:58.090757 31011 raft_consensus.cc:993] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19: : Instructing follower 79d99c0e498349bda74127365219e468 to start an election
I20260709 13:12:58.091869 31011 raft_consensus.cc:1081] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 16 LEADER]: Signalling peer 79d99c0e498349bda74127365219e468 to start an election
I20260709 13:12:58.094206 25377 raft_consensus.cc:1275] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:12:58.089238 30917 raft_consensus.cc:3060] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:58.123752 25227 raft_consensus.cc:1275] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:12:58.095839 25378 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a"
dest_uuid: "79d99c0e498349bda74127365219e468"
 from {username='slave'} at 127.0.0.1:36254
I20260709 13:12:58.126199 25378 raft_consensus.cc:493] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:58.126613 25378 raft_consensus.cc:3060] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:58.126895 25194 leader_election.cc:304] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
W20260709 13:12:58.136934 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:58.138314 25194 leader_election.cc:304] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:58.141463 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad01a612dc964dd3ae0b3f179ac0ad9e" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:58.144820 25305 raft_consensus.cc:1275] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:12:58.146555 25227 raft_consensus.cc:3060] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:58.143996 25303 raft_consensus.cc:1240] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 16 LEADER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:58.151255 25303 raft_consensus.cc:1275] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:12:58.154181 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:58.161887 25223 raft_consensus.cc:1275] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:12:58.161975 25300 raft_consensus.cc:1275] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 19 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:12:58.115211 31007 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:58.168978 25296 raft_consensus.cc:1275] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:12:58.137507 30688 raft_consensus.cc:493] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.158049 30842 raft_consensus.cc:2804] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:58.126377 30522 consensus_queue.cc:1048] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:12:58.179885 30977 raft_consensus.cc:2749] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:58.178654 30842 raft_consensus.cc:493] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:58.189066 31008 consensus_queue.cc:1048] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:12:58.220285 25906 raft_consensus.cc:1275] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:12:58.225256 25342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:58.205519 30842 raft_consensus.cc:3060] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:58.181862 30688 raft_consensus.cc:515] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:12:58.249188 31016 log.cc:927] Time spent T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:12:58.252152 31007 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 19 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:58.260609 25378 raft_consensus.cc:515] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:58.271055 30842 raft_consensus.cc:515] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:58.273452 30842 leader_election.cc:290] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:58.283509 30688 leader_election.cc:290] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:12:58.295569 25128 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40034 (request call id 264) took 12964 ms (client timeout 15000 ms). Trace:
W20260709 13:12:58.312866 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 52779.8us
I20260709 13:12:58.316201 25378 leader_election.cc:290] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 17 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:58.316442 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: true dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:58.317018 25906 raft_consensus.cc:3060] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:58.323781 31007 consensus_queue.cc:1048] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:58.324533 25906 raft_consensus.cc:2468] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 17.
I20260709 13:12:58.327658 25906 raft_consensus.cc:1240] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 FOLLOWER]: Rejecting Update request from peer da445ce82dc4467f95f4fa52297eaa19 for earlier term 16. Current term is 17. Ops: []
I20260709 13:12:58.331074 25344 leader_election.cc:304] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:12:58.332325 30982 raft_consensus.cc:2804] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:12:58.332991 30982 raft_consensus.cc:697] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 17 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:58.334198 30982 consensus_queue.cc:237] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:12:58.298517 25128 rpcz_store.cc:269] 0709 13:12:45.358478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:45.360389 (+  1911us) service_pool.cc:224] Handling call
0709 13:12:58.295306 (+12934917us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:54.673591 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:54.674654 (+  1063us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:54.674865 (+   211us) write_op.cc:435] Acquired schema lock
0709 13:12:54.674932 (+    67us) tablet.cc:662] Decoding operations
0709 13:12:54.677541 (+  2609us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:54.679211 (+  1670us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:54.683960 (+  4749us) tablet.cc:685] Acquiring locks for 26 operations
0709 13:12:54.784357 (+100397us) tablet.cc:701] Row locks acquired
0709 13:12:54.784410 (+    53us) write_op.cc:260] PREPARE: finished
0709 13:12:54.784576 (+   166us) write_op.cc:270] Start()
0709 13:12:54.784753 (+   177us) write_op.cc:276] Timestamp: P: 1783602774784508 usec, L: 0
0709 13:12:54.784804 (+    51us) op_driver.cc:348] REPLICATION: starting
0709 13:12:54.789018 (+  4214us) log.cc:844] Serialized 10237 byte log entry
0709 13:12:55.368001 (+578983us) op_driver.cc:464] REPLICATION: finished
0709 13:12:55.499232 (+131231us) write_op.cc:301] APPLY: starting
0709 13:12:55.499376 (+   144us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:55.655904 (+156528us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:55.656056 (+   152us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:56.066431 (+410375us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:56.066861 (+   430us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=52,key_file_lookups=52,delta_file_lookups=52,mrs_lookups=0
0709 13:12:56.066920 (+    59us) write_op.cc:312] APPLY: finished
0709 13:12:56.067487 (+   567us) log.cc:844] Serialized 228 byte log entry
0709 13:12:56.067683 (+   196us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:56.067886 (+   203us) write_op.cc:454] Released schema lock
0709 13:12:56.067969 (+    83us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:56.068426 (+   457us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:56.068451 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":13240,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":122742,"apply.run_cpu_time_us":38965,"apply.run_wall_time_us":569200,"cfile_cache_hit":106,"cfile_cache_hit_bytes":112859,"num_ops":26,"prepare.queue_time_us":227412,"prepare.run_cpu_time_us":19613,"prepare.run_wall_time_us":176944,"raft.queue_time_us":219338,"raft.run_cpu_time_us":10073,"raft.run_wall_time_us":98773,"replication_time_us":566769,"thread_start_us":378736,"threads_started":4,"wal-append.queue_time_us":109872,"wal-append.run_cpu_time_us":13117,"wal-append.run_wall_time_us":2172423}]]}
I20260709 13:12:58.400359 30775 consensus_queue.cc:1048] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:12:58.415895 31007 consensus_queue.cc:1048] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:12:58.430397 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 85094.2us
I20260709 13:12:58.436450 30912 consensus_queue.cc:1048] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:58.437848 30775 consensus_queue.cc:1048] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:12:58.473582 25227 raft_consensus.cc:2468] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 20.
I20260709 13:12:58.475390 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:58.476617 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:58.480398 30906 consensus_queue.cc:1059] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:12:58.481812 30906 raft_consensus.cc:3055] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:12:58.482170 30906 raft_consensus.cc:740] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:58.482949 30906 consensus_queue.cc:260] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:58.484045 25379 raft_consensus.cc:1275] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:12:58.484179 30906 raft_consensus.cc:3060] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:58.487900 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ae6d72e4154149b3d1721e2214570a" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: true dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:58.462257 30889 consensus_queue.cc:1048] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:12:58.491077 30889 raft_consensus.cc:493] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:12:58.491547 30889 raft_consensus.cc:515] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:58.494621 25299 raft_consensus.cc:1240] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 20 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 19. Current term is 20. Ops: []
I20260709 13:12:58.498226 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:58.500813 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
W20260709 13:12:58.517628 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 379384us
I20260709 13:12:58.495944 30889 leader_election.cc:290] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:58.505507 30775 consensus_queue.cc:1059] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:12:58.541307 30982 raft_consensus.cc:3055] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:12:58.541762 30982 raft_consensus.cc:740] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
W20260709 13:12:58.542361 25268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:58.542640 30982 consensus_queue.cc:260] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 19.9, Last appended by leader: 9, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:58.544127 30982 raft_consensus.cc:3060] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:58.554054 25194 leader_election.cc:304] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:12:58.559178 25271 leader_election.cc:304] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 79d99c0e498349bda74127365219e468
I20260709 13:12:58.580988 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:12:58.581828 25194 leader_election.cc:304] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:58.575911 30688 raft_consensus.cc:2804] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:12:58.571056 30837 raft_consensus.cc:493] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:58.529242 30744 consensus_queue.cc:1048] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:12:58.593876 30342 raft_consensus.cc:2804] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:12:58.594482 25225 raft_consensus.cc:1275] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:12:58.600694 30837 raft_consensus.cc:515] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } attrs { replace: true } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:58.586966 30908 raft_consensus.cc:2749] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:58.608032 30688 raft_consensus.cc:697] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 16 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:58.649385 25270 leader_election.cc:304] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:58.647819 30342 raft_consensus.cc:697] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 20 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:58.659512 30837 leader_election.cc:290] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:58.654670 30755 raft_consensus.cc:493] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:58.660549 30755 raft_consensus.cc:515] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:58.662830 30755 leader_election.cc:290] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:58.657528 30342 consensus_queue.cc:237] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.8, Last appended by leader: 8, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:58.670099 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:58.671512 25303 raft_consensus.cc:2468] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 17.
I20260709 13:12:58.672133 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:12:58.683193 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 84835us
I20260709 13:12:58.685496 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:58.690616 25305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:58.691975 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:58.680128 31008 raft_consensus.cc:2749] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:12:58.701629 25300 raft_consensus.cc:1240] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 19 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:12:58.700148 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:12:58.698379 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275226661cc840559134f8c9e5b15719" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:58.705385 25228 raft_consensus.cc:1240] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:58.655392 30952 consensus_queue.cc:1048] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:12:58.708364 25228 raft_consensus.cc:1275] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 19 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:12:58.724202 30906 consensus_queue.cc:1048] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:12:58.716679 30688 consensus_queue.cc:237] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:58.750324 25874 leader_election.cc:304] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:58.768865 25226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0945649a5d1348c6b17e9dd0b67766c9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:58.778003 30889 consensus_queue.cc:1059] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:12:58.779105 31024 log.cc:927] Time spent T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.164s	user 0.004s	sys 0.000s
I20260709 13:12:58.779125 30960 consensus_queue.cc:1048] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:12:58.762049 30755 raft_consensus.cc:2749] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:12:58.831557 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 79018us
W20260709 13:12:58.833174 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 68901.3us
W20260709 13:12:58.818524 31006 log.cc:927] Time spent T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:12:58.828328 31030 log.cc:927] Time spent T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 13:12:58.857036 31033 log.cc:927] Time spent T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:12:58.853967 31035 log.cc:927] Time spent T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
W20260709 13:12:58.911960 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 184548us
I20260709 13:12:58.914523 25195 leader_election.cc:304] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468
W20260709 13:12:58.926182 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 54759.5us
W20260709 13:12:58.875046 31032 log.cc:927] Time spent T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
W20260709 13:12:58.934950 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 53182.7us
I20260709 13:12:58.940186 25345 leader_election.cc:304] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:12:58.942132 31031 log.cc:927] Time spent T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
W20260709 13:12:58.960906 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 46471.5us
W20260709 13:12:58.960013 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 96056.3us
W20260709 13:12:58.973687 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 156804us
I20260709 13:12:58.969192 31022 raft_consensus.cc:2749] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:58.996790 25194 leader_election.cc:304] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:58.975631 30982 raft_consensus.cc:2749] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:12:59.024973 31028 log.cc:927] Time spent T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.320s	user 0.000s	sys 0.006s
I20260709 13:12:59.029357 25194 leader_election.cc:304] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:59.033975 31022 raft_consensus.cc:2749] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:12:59.039812 30986 consensus_queue.cc:1059] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:12:59.041350 30977 raft_consensus.cc:3055] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:12:59.041882 30977 raft_consensus.cc:740] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:12:59.042946 30977 consensus_queue.cc:260] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:59.050587 30775 raft_consensus.cc:3055] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:59.051124 30775 raft_consensus.cc:740] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:59.052217 30775 consensus_queue.cc:260] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:59.066722 25378 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6"
dest_uuid: "79d99c0e498349bda74127365219e468"
mode: GRACEFUL
new_leader_uuid: "1f539ba21487460085b837e7529a78ce"
 from {username='slave'} at 127.0.0.1:37886
I20260709 13:12:59.091080 25378 raft_consensus.cc:606] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 16 LEADER]: Received request to transfer leadership to TS 1f539ba21487460085b837e7529a78ce
W20260709 13:12:59.067402 31040 log.cc:927] Time spent T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
W20260709 13:12:59.068634 31029 log.cc:927] Time spent T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.291s	user 0.001s	sys 0.000s
I20260709 13:12:59.053742 30775 raft_consensus.cc:3060] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:12:59.077482 31036 log.cc:927] Time spent T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.157s	user 0.002s	sys 0.000s
I20260709 13:12:59.076858 25302 raft_consensus.cc:1275] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:12:59.097963 25378 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017"
dest_uuid: "79d99c0e498349bda74127365219e468"
mode: GRACEFUL
new_leader_uuid: "1f539ba21487460085b837e7529a78ce"
 from {username='slave'} at 127.0.0.1:37886
I20260709 13:12:59.101398 25378 raft_consensus.cc:606] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Received request to transfer leadership to TS 1f539ba21487460085b837e7529a78ce
I20260709 13:12:59.101765 25378 raft_consensus.cc:614] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:59.105707 25373 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07"
dest_uuid: "79d99c0e498349bda74127365219e468"
mode: GRACEFUL
new_leader_uuid: "da445ce82dc4467f95f4fa52297eaa19"
 from {username='slave'} at 127.0.0.1:37886
I20260709 13:12:59.106330 25373 raft_consensus.cc:606] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 14 LEADER]: Received request to transfer leadership to TS da445ce82dc4467f95f4fa52297eaa19
I20260709 13:12:59.110123 25378 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92f679df8187472794ba8595642f63f9"
dest_uuid: "79d99c0e498349bda74127365219e468"
mode: GRACEFUL
new_leader_uuid: "1f539ba21487460085b837e7529a78ce"
 from {username='slave'} at 127.0.0.1:37886
I20260709 13:12:59.118873 30997 raft_consensus.cc:2749] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:59.120350 25377 raft_consensus.cc:1275] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 20 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 20 index: 9. (term mismatch)
I20260709 13:12:59.120738 25377 pending_rounds.cc:85] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468: Aborting all ops after (but not including) 8
I20260709 13:12:59.120968 25377 pending_rounds.cc:107] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468: Aborting uncommitted NO_OP operation due to leader change: 19.9
I20260709 13:12:59.121266 25377 raft_consensus.cc:2889] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:12:59.123823 25194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 84261.6us
I20260709 13:12:59.132561 25903 raft_consensus.cc:1275] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:12:59.130007 30342 consensus_queue.cc:1048] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
W20260709 13:12:59.132215 25194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:59.212023 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 81868.4us
W20260709 13:12:59.261641 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 126141us
W20260709 13:12:59.265879 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 135359us
I20260709 13:12:59.274125 31056 consensus_queue.cc:1048] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:12:59.283259 25378 raft_consensus.cc:606] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 17 LEADER]: Received request to transfer leadership to TS 1f539ba21487460085b837e7529a78ce
I20260709 13:12:59.287068 30944 raft_consensus.cc:493] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:12:59.287690 30944 raft_consensus.cc:515] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:59.290858 31038 raft_consensus.cc:493] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:12:59.291447 31038 raft_consensus.cc:515] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:59.291816 30944 leader_election.cc:290] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:59.293509 31008 raft_consensus.cc:493] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.296867 30977 raft_consensus.cc:3060] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:59.297194 31008 raft_consensus.cc:515] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:59.304636 30910 raft_consensus.cc:993] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468: : Instructing follower 1f539ba21487460085b837e7529a78ce to start an election
I20260709 13:12:59.305195 30910 raft_consensus.cc:1081] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 16 LEADER]: Signalling peer 1f539ba21487460085b837e7529a78ce to start an election
I20260709 13:12:59.293483 31038 leader_election.cc:290] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:59.305359 31008 leader_election.cc:290] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:12:59.317150 31057 consensus_queue.cc:1048] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:12:59.317541 25378 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a"
dest_uuid: "79d99c0e498349bda74127365219e468"
mode: GRACEFUL
new_leader_uuid: "1f539ba21487460085b837e7529a78ce"
 from {username='slave'} at 127.0.0.1:37886
I20260709 13:12:59.318207 25378 raft_consensus.cc:606] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 14 LEADER]: Received request to transfer leadership to TS 1f539ba21487460085b837e7529a78ce
I20260709 13:12:59.319308 24113 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
W20260709 13:12:59.320370 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 50255.6us
I20260709 13:12:59.321130 24113 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:59.359390 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:59.368451 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:59.373989 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:59.374931 25227 raft_consensus.cc:2393] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 11: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:12:59.385808 25221 raft_consensus.cc:1275] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 20 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 18 index: 8. Preceding OpId from leader: term: 20 index: 9. (index mismatch)
I20260709 13:12:59.395581 25224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:59.415174 31011 consensus_queue.cc:1048] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:12:59.484675 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 52891us
I20260709 13:12:59.486686 25376 raft_consensus.cc:1275] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 13:12:59.487190 25376 pending_rounds.cc:85] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468: Aborting all ops after (but not including) 10
I20260709 13:12:59.487469 25376 pending_rounds.cc:107] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 13:12:59.487763 25376 raft_consensus.cc:2889] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:12:59.493919 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 61638.7us
W20260709 13:12:59.495963 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 57216us
I20260709 13:12:59.497231 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:12:59.498222 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:12:59.495569 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 69631.2us
I20260709 13:12:59.498929 25376 raft_consensus.cc:2468] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 16.
I20260709 13:12:59.465505 30912 raft_consensus.cc:493] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.516548 25224 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6"
dest_uuid: "1f539ba21487460085b837e7529a78ce"
 from {username='slave'} at 127.0.0.1:58418
I20260709 13:12:59.517237 25224 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:59.517606 25224 raft_consensus.cc:3060] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:59.525949 25270 leader_election.cc:304] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:12:59.534273 25270 leader_election.cc:304] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:12:59.596189 30917 raft_consensus.cc:993] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468: : Instructing follower da445ce82dc4467f95f4fa52297eaa19 to start an election
I20260709 13:12:59.596815 30917 raft_consensus.cc:1081] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 14 LEADER]: Signalling peer da445ce82dc4467f95f4fa52297eaa19 to start an election
I20260709 13:12:59.501200 31025 consensus_queue.cc:1048] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:12:59.603976 25296 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07"
dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
 from {username='slave'} at 127.0.0.1:57256
I20260709 13:12:59.604691 25296 raft_consensus.cc:493] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:59.605123 25296 raft_consensus.cc:3060] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:59.515625 30912 raft_consensus.cc:515] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:59.612108 30912 leader_election.cc:290] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:59.613085 30912 raft_consensus.cc:993] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468: : Instructing follower 1f539ba21487460085b837e7529a78ce to start an election
I20260709 13:12:59.613534 31054 raft_consensus.cc:1081] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 14 LEADER]: Signalling peer 1f539ba21487460085b837e7529a78ce to start an election
I20260709 13:12:59.613662 25378 raft_consensus.cc:2468] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 11.
I20260709 13:12:59.614308 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:12:59.614926 25300 raft_consensus.cc:2468] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 10.
I20260709 13:12:59.623720 25343 leader_election.cc:304] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:59.559559 30944 raft_consensus.cc:2804] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:59.626677 30944 raft_consensus.cc:493] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:59.626806 31054 raft_consensus.cc:2804] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:59.627099 30944 raft_consensus.cc:3060] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:59.545266 31007 raft_consensus.cc:2749] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:59.653445 25228 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a"
dest_uuid: "1f539ba21487460085b837e7529a78ce"
 from {username='slave'} at 127.0.0.1:58418
I20260709 13:12:59.660527 25228 raft_consensus.cc:493] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:59.660952 25228 raft_consensus.cc:3060] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:59.639225 25296 raft_consensus.cc:515] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:59.627326 31054 raft_consensus.cc:493] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:59.668576 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:12:59.677031 25222 raft_consensus.cc:2468] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 11.
I20260709 13:12:59.694345 25224 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:59.705318 25228 raft_consensus.cc:515] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:59.715844 25224 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 17 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:59.716902 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:12:59.717717 25377 raft_consensus.cc:3055] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:59.676359 31054 raft_consensus.cc:3060] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:59.726295 25296 leader_election.cc:290] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:12:59.718122 25377 raft_consensus.cc:740] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:12:59.737208 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f74f1604ed4390892e271c77fd0f07" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:12:59.737851 25905 raft_consensus.cc:3060] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:59.742867 25228 leader_election.cc:290] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:12:59.741734 31061 log.cc:927] Time spent T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:12:59.738921 25377 consensus_queue.cc:260] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:59.767230 25377 raft_consensus.cc:3060] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:12:59.772832 31065 log.cc:927] Time spent T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
W20260709 13:12:59.840077 31068 log.cc:927] Time spent T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:12:59.843647 25377 raft_consensus.cc:2468] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 15.
I20260709 13:12:59.850414 25270 leader_election.cc:304] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:12:59.852129 31011 raft_consensus.cc:2804] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:59.852797 31011 raft_consensus.cc:697] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 15 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:12:59.853968 31011 consensus_queue.cc:237] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:12:59.896487 25905 raft_consensus.cc:2468] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 15.
I20260709 13:12:59.912981 31054 raft_consensus.cc:515] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:59.925360 31054 leader_election.cc:290] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:12:59.926644 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:12:59.951330 25296 raft_consensus.cc:3060] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:12:59.937144 30944 raft_consensus.cc:515] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:12:59.943730 30910 raft_consensus.cc:993] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468: : Instructing follower 1f539ba21487460085b837e7529a78ce to start an election
W20260709 13:12:59.969148 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 280312us
I20260709 13:12:59.967000 31054 raft_consensus.cc:1081] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 17 LEADER]: Signalling peer 1f539ba21487460085b837e7529a78ce to start an election
I20260709 13:12:59.983870 25270 leader_election.cc:304] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:13:00.024866 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: true dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:13:00.025736 25903 raft_consensus.cc:3060] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:59.968807 30775 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:13:00.056203 30775 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:13:00.058394 30775 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:13:00.037647 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:13:00.059093 25902 raft_consensus.cc:3060] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:00.072925 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:13:00.075353 25300 raft_consensus.cc:2393] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 19: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:13:00.078919 25296 raft_consensus.cc:2468] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 12.
I20260709 13:13:00.082724 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: true dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:13:00.083338 25376 raft_consensus.cc:3055] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:13:00.083652 25376 raft_consensus.cc:740] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:13:00.089497 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:13:00.090335 25378 raft_consensus.cc:3055] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:00.084407 25376 consensus_queue.cc:260] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:13:00.087500 25343 leader_election.cc:304] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:13:00.091627 25376 raft_consensus.cc:3060] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:00.090694 25378 raft_consensus.cc:740] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:13:00.094863 25903 raft_consensus.cc:2468] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 17.
I20260709 13:13:00.095593 25905 raft_consensus.cc:1240] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 16. Current term is 17. Ops: []
I20260709 13:13:00.094571 25378 consensus_queue.cc:260] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:13:00.124930 25378 raft_consensus.cc:3060] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:00.080647 30946 raft_consensus.cc:2764] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:13:00.126700 25195 leader_election.cc:304] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:13:00.140911 30997 raft_consensus.cc:2804] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:13:00.101212 30995 raft_consensus.cc:2804] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:00.159457 30997 raft_consensus.cc:697] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 17 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:13:00.163981 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:13:00.165477 25376 raft_consensus.cc:2468] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 17.
I20260709 13:13:00.169847 30995 raft_consensus.cc:697] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 12 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:13:00.170841 30995 consensus_queue.cc:237] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:13:00.171900 30997 consensus_queue.cc:237] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:13:00.174863 30944 leader_election.cc:290] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 17 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:13:00.176344 25902 raft_consensus.cc:2468] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 15.
I20260709 13:13:00.178095 25906 raft_consensus.cc:1240] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 14. Current term is 15. Ops: []
W20260709 13:13:00.181876 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:00.188692 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef45c031fc345b2917194ea453a14e3" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:13:00.189412 25227 raft_consensus.cc:3060] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:13:00.190515 25344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:00.190795 25228 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "92f679df8187472794ba8595642f63f9"
dest_uuid: "1f539ba21487460085b837e7529a78ce"
 from {username='slave'} at 127.0.0.1:58418
I20260709 13:13:00.192853 25221 raft_consensus.cc:1240] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:00.195340 25228 raft_consensus.cc:493] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:00.195793 25228 raft_consensus.cc:3060] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:00.202039 25296 raft_consensus.cc:1240] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Rejecting Update request from peer 1f539ba21487460085b837e7529a78ce for earlier term 16. Current term is 17. Ops: []
I20260709 13:13:00.214716 30944 raft_consensus.cc:493] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:13:00.220777 30944 raft_consensus.cc:515] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:13:00.223331 30944 leader_election.cc:290] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:13:00.233731 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:13:00.240360 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:13:00.280493 25228 raft_consensus.cc:515] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:13:00.282477 25378 raft_consensus.cc:2468] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 15.
I20260709 13:13:00.284720 25227 raft_consensus.cc:2468] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 12.
I20260709 13:13:00.294087 25195 leader_election.cc:304] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 
I20260709 13:13:00.303728 25271 leader_election.cc:304] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:13:00.307650 30342 raft_consensus.cc:2749] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:13:00.311301 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:13:00.311853 25227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:13:00.312449 25227 raft_consensus.cc:2468] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 19.
I20260709 13:13:00.318749 25271 leader_election.cc:304] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:13:00.305713 31025 raft_consensus.cc:2804] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:13:00.326188 30744 raft_consensus.cc:2749] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:00.335254 31025 raft_consensus.cc:697] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 15 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:13:00.354000 31025 consensus_queue.cc:237] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:13:00.362851 30906 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.363564 30906 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:13:00.367733 30906 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:13:00.372920 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 237807us
I20260709 13:13:00.384773 25345 leader_election.cc:304] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:13:00.392514 25222 raft_consensus.cc:1240] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 17 LEADER]: Rejecting Update request from peer 79d99c0e498349bda74127365219e468 for earlier term 16. Current term is 17. Ops: []
I20260709 13:13:00.390480 30960 raft_consensus.cc:2804] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:13:00.401304 30960 raft_consensus.cc:493] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:13:00.401691 30960 raft_consensus.cc:3060] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:00.334046 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:00.427970 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:13:00.464277 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 144417us
I20260709 13:13:00.469094 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:13:00.470005 25225 raft_consensus.cc:2410] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 20 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:13:00.485921 25906 raft_consensus.cc:1275] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:13:00.460738 30957 consensus_queue.cc:1059] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:13:00.487047 30957 raft_consensus.cc:3055] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:13:00.487411 30957 raft_consensus.cc:740] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:13:00.487500 30744 consensus_queue.cc:1048] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:13:00.488329 30957 consensus_queue.cc:260] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:13:00.491192 31074 log.cc:927] Time spent T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468: Append to log took a long time: real 0.172s	user 0.004s	sys 0.000s
I20260709 13:13:00.496093 30889 raft_consensus.cc:493] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.496691 30889 raft_consensus.cc:515] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:13:00.503904 30889 leader_election.cc:290] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:13:00.510912 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:13:00.511638 25221 raft_consensus.cc:2468] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 14.
I20260709 13:13:00.511274 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:13:00.515688 25345 leader_election.cc:304] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:13:00.516505 30775 raft_consensus.cc:2804] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:00.489686 30957 raft_consensus.cc:3060] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:00.525025 25228 leader_election.cc:290] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 18 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:13:00.516872 30775 raft_consensus.cc:493] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:00.526975 30775 raft_consensus.cc:3060] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:00.530865 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:13:00.531514 25378 raft_consensus.cc:3055] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:13:00.531800 25378 raft_consensus.cc:740] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:13:00.532503 25378 consensus_queue.cc:260] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:13:00.533569 25378 raft_consensus.cc:3060] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:00.539074 30960 raft_consensus.cc:515] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:13:00.540406 25376 raft_consensus.cc:2410] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 20 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:13:00.541378 30960 leader_election.cc:290] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 19 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:13:00.543987 25374 raft_consensus.cc:1275] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:13:00.550817 25221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:13:00.546821 25270 leader_election.cc:304] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
W20260709 13:13:00.547494 25125 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33566 (request call id 179) took 35860 ms (client timeout 15000 ms). Trace:
I20260709 13:13:00.551882 25378 raft_consensus.cc:2468] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 18.
I20260709 13:13:00.554404 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a83f35ff124418bd9c19dca631e017" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:13:00.559077 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:13:00.559698 25296 raft_consensus.cc:3060] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:00.556751 25195 leader_election.cc:304] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:13:00.560611 25302 raft_consensus.cc:2393] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 19: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:13:00.565845 31078 raft_consensus.cc:2804] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:13:00.566419 31078 raft_consensus.cc:697] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 18 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:13:00.564124 30944 raft_consensus.cc:2749] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:13:00.567251 31078 consensus_queue.cc:237] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:13:00.563603 31083 consensus_queue.cc:1048] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:13:00.576071 25296 raft_consensus.cc:2468] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 18.
I20260709 13:13:00.578343 31083 raft_consensus.cc:493] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:13:00.578896 31083 raft_consensus.cc:515] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:13:00.552095 25125 rpcz_store.cc:269] 0709 13:12:24.687498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:24.704266 (+ 16768us) service_pool.cc:224] Handling call
0709 13:12:24.778658 (+ 74392us) spinlock_profiling.cc:243] Waited 33.4 ms on lock 0x7b54002e0090. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72cb4ab71 00007fd72cb4b0b2 00007fd735ac4a89 00007fd735a5cda6 00007fd735a2e088 00007fd735b2c37e 00007fd733fed2a4 00007fd733fed232 00007fd733fed161 00007fd733fed0dc
0709 13:13:00.547389 (+35768731us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:58.604592 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:58.605199 (+   607us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:58.605240 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:12:58.605259 (+    19us) tablet.cc:662] Decoding operations
0709 13:12:58.656454 (+ 51195us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:58.671392 (+ 14938us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:58.671731 (+   339us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:12:58.737979 (+ 66248us) tablet.cc:701] Row locks acquired
0709 13:12:58.737998 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:12:58.738167 (+   169us) write_op.cc:270] Start()
0709 13:12:58.738303 (+   136us) write_op.cc:276] Timestamp: P: 1783602778738114 usec, L: 0
0709 13:12:58.738328 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:12:58.739004 (+   676us) log.cc:844] Serialized 2069 byte log entry
0709 13:12:59.046300 (+307296us) op_driver.cc:464] REPLICATION: finished
0709 13:12:59.106195 (+ 59895us) write_op.cc:301] APPLY: starting
0709 13:12:59.106277 (+    82us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:59.109193 (+  2916us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:59.109310 (+   117us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:59.329106 (+219796us) spinlock_profiling.cc:243] Waited 4.72 ms on lock 0x7b5c0021978c. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd735e61331 00007fd735e61221 00007fd735e5bf6c 00007fd7335bc30b 00007fd7335bbfd3 00007fd7336bae34 00007fd7336a697c 00007fd7336aad61 00007fd7336aad19 00007fd7336aaca9 00007fd7336aac71
0709 13:12:59.398164 (+ 69058us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:59.417946 (+ 19782us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 13:12:59.418001 (+    55us) write_op.cc:312] APPLY: finished
0709 13:12:59.418246 (+   245us) log.cc:844] Serialized 57 byte log entry
0709 13:12:59.419011 (+   765us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:59.419115 (+   104us) write_op.cc:454] Released schema lock
0709 13:12:59.419169 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:59.513838 (+ 94669us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:59.517199 (+  3361us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1073426,"reported_tablets":31,"spinlock_wait_cycles":76880768,"child_traces":[["op",{"apply.queue_time_us":59631,"apply.run_cpu_time_us":17981,"apply.run_wall_time_us":389900,"cfile_cache_hit":22,"cfile_cache_hit_bytes":25037,"num_ops":5,"prepare.queue_time_us":306257,"prepare.run_cpu_time_us":29228,"prepare.run_wall_time_us":235463,"raft.queue_time_us":128827,"raft.run_cpu_time_us":3800,"raft.run_wall_time_us":131897,"replication_time_us":257329,"spinlock_wait_cycles":10853120,"thread_start_us":297457,"threads_started":4,"wal-append.queue_time_us":100930,"wal-append.run_cpu_time_us":21797,"wal-append.run_wall_time_us":1584871}]]}
I20260709 13:13:00.585453 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:13:00.589140 31083 leader_election.cc:290] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:13:00.590472 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:13:00.591269 25228 raft_consensus.cc:2393] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 14: Already voted for candidate 1f539ba21487460085b837e7529a78ce in this term.
I20260709 13:13:00.602526 25221 raft_consensus.cc:2468] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 19.
I20260709 13:13:00.607506 25345 leader_election.cc:304] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
W20260709 13:13:00.611709 31087 log.cc:927] Time spent T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce: Append to log took a long time: real 0.091s	user 0.003s	sys 0.000s
I20260709 13:13:00.620919 30960 raft_consensus.cc:2804] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:13:00.621500 30960 raft_consensus.cc:697] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 19 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:13:00.622511 30960 consensus_queue.cc:237] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:13:00.639041 31088 log.cc:927] Time spent T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:13:00.640832 31034 raft_consensus.cc:493] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 79d99c0e498349bda74127365219e468)
I20260709 13:13:00.641369 31034 raft_consensus.cc:515] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:13:00.656862 31034 leader_election.cc:290] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:13:00.657006 25905 raft_consensus.cc:1275] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:13:00.658588 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:13:00.660385 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477bcdc75e8c43318d410716549fefd7" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:13:00.662539 25195 leader_election.cc:304] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f539ba21487460085b837e7529a78ce; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:13:00.661602 31034 consensus_queue.cc:1048] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.005s
I20260709 13:13:00.664721 30977 raft_consensus.cc:2749] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:13:00.695219 30775 raft_consensus.cc:515] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:13:00.698074 25378 raft_consensus.cc:2368] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for earlier term 14. Current term is 15.
I20260709 13:13:00.706110 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:13:00.706779 25228 raft_consensus.cc:3060] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:00.712944 25121 catalog_manager.cc:5697] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 11 to 14, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68). New cstate: current_term: 14 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:13:00.716461 25121 catalog_manager.cc:5697] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 7 to 8, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 8 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:00.711768 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0adcdb50fe9647b0abfa936e9cb73727" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:13:00.720466 25270 leader_election.cc:400] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091) with higher term. Message: Invalid argument: T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for earlier term 14. Current term is 15.
I20260709 13:13:00.721941 25270 leader_election.cc:403] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:00.697584 30775 leader_election.cc:290] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:13:00.723307 31084 raft_consensus.cc:3060] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:13:00.728905 25377 raft_consensus.cc:1275] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:13:00.729499 25121 catalog_manager.cc:5697] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:00.731190 30977 consensus_queue.cc:1048] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:13:00.732064 25121 catalog_manager.cc:5697] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 11 to 15, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 15 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:00.737363 31084 raft_consensus.cc:2749] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091) with higher term. Message: Invalid argument: T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for earlier term 14. Current term is 15.
I20260709 13:13:00.733453 25228 raft_consensus.cc:2468] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 15.
I20260709 13:13:00.746487 25345 leader_election.cc:304] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:13:00.759774 25906 raft_consensus.cc:1275] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:13:00.760984 30537 raft_consensus.cc:2804] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:13:00.761721 30537 raft_consensus.cc:697] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 15 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:13:00.741662 25121 catalog_manager.cc:5697] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:13:00.768828 30977 consensus_queue.cc:1048] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:13:00.770401 25302 raft_consensus.cc:2468] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 15.
I20260709 13:13:00.770877 25121 catalog_manager.cc:5697] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:13:00.771612 25376 raft_consensus.cc:1275] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:13:00.772994 30537 consensus_queue.cc:237] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:13:00.780864 31034 consensus_queue.cc:1048] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 13:13:00.781859 25121 catalog_manager.cc:5697] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:13:00.798235 25121 catalog_manager.cc:5697] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:13:00.845991 25300 raft_consensus.cc:1275] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:13:00.879973 30537 consensus_queue.cc:1048] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:13:00.926679 25228 raft_consensus.cc:1275] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:13:00.933133 30960 consensus_queue.cc:1048] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:13:01.148743 25303 raft_consensus.cc:1275] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 18 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:13:01.151268 30997 consensus_queue.cc:1048] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:13:01.154940 25296 raft_consensus.cc:1275] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 19 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:13:01.156615 30917 consensus_queue.cc:1048] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:13:01.160564 25377 raft_consensus.cc:1275] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:13:01.162451 30997 consensus_queue.cc:1048] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:13:01.205309 25228 raft_consensus.cc:1275] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 19 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:13:01.215938 25128 catalog_manager.cc:5697] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 9 to 13, leader changed from 79d99c0e498349bda74127365219e468 (127.23.140.67) to 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68). New cstate: current_term: 13 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:13:01.218147 25128 catalog_manager.cc:5697] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 5 to 16, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 16 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:01.220009 25128 catalog_manager.cc:5697] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 9 to 15. New cstate: current_term: 15 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
I20260709 13:13:01.226284 30982 consensus_queue.cc:1048] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:13:01.221315 25128 catalog_manager.cc:5697] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 13 to 18, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 18 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
I20260709 13:13:01.231460 25128 catalog_manager.cc:5697] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 7 to 13, leader changed from 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 13 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:13:01.233460 25128 catalog_manager.cc:5697] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 16 to 17, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 17 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:01.243361 25296 raft_consensus.cc:1275] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:13:01.245604 30995 consensus_queue.cc:1048] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:13:01.249012 25221 raft_consensus.cc:1275] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:13:01.254441 30995 consensus_queue.cc:1048] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:13:01.269713 25128 catalog_manager.cc:5697] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 13 to 14, leader changed from 79d99c0e498349bda74127365219e468 (127.23.140.67) to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 14 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
I20260709 13:13:01.271448 25128 catalog_manager.cc:5697] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 10 to 12, leader changed from 79d99c0e498349bda74127365219e468 (127.23.140.67) to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 12 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
I20260709 13:13:01.273135 25128 catalog_manager.cc:5697] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 11 to 13, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 13 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
I20260709 13:13:01.292308 25128 catalog_manager.cc:5697] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:13:01.293905 25128 catalog_manager.cc:5697] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 10 to 15, leader changed from 79d99c0e498349bda74127365219e468 (127.23.140.67) to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 15 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
I20260709 13:13:01.295346 25128 catalog_manager.cc:5697] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 11 to 14, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 14 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:01.297698 25128 catalog_manager.cc:5697] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
I20260709 13:13:01.300832 25128 catalog_manager.cc:5697] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 15 to 17, leader changed from 79d99c0e498349bda74127365219e468 (127.23.140.67) to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 17 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:13:01.305591 25128 catalog_manager.cc:5697] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:13:01.306927 25128 catalog_manager.cc:5697] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 14 to 18, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68). New cstate: current_term: 18 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:13:01.309269 25128 catalog_manager.cc:5697] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:01.311013 25128 catalog_manager.cc:5697] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 12 to 17, leader changed from 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 17 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:01.312485 25128 catalog_manager.cc:5697] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 10 to 13, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68). New cstate: current_term: 13 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:13:01.313843 25128 catalog_manager.cc:5697] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 11 to 16, leader changed from 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 16 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:01.315337 25128 catalog_manager.cc:5697] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:01.316723 25128 catalog_manager.cc:5697] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 11 to 16. New cstate: current_term: 16 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
I20260709 13:13:01.317876 25128 catalog_manager.cc:5697] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 11 to 16, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 16 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:01.319296 25128 catalog_manager.cc:5697] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 9 to 14. New cstate: current_term: 14 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
I20260709 13:13:01.320571 25128 catalog_manager.cc:5697] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 12 to 18, leader changed from 79d99c0e498349bda74127365219e468 (127.23.140.67) to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 18 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
I20260709 13:13:01.326352 25128 catalog_manager.cc:5697] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 14 to 17. New cstate: current_term: 17 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:01.327886 25128 catalog_manager.cc:5697] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 10 to 14, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 14 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
I20260709 13:13:01.329200 25128 catalog_manager.cc:5697] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 15 to 19, leader changed from 79d99c0e498349bda74127365219e468 (127.23.140.67) to 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68). New cstate: current_term: 19 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:13:01.330510 25128 catalog_manager.cc:5697] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 12 to 14, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 14 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
I20260709 13:13:01.331981 25128 catalog_manager.cc:5697] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:01.333525 25128 catalog_manager.cc:5697] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
W20260709 13:13:01.375530 25121 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40020 (request call id 267) took 14166 ms (client timeout 15000 ms). Trace:
W20260709 13:13:01.375985 25121 rpcz_store.cc:269] 0709 13:12:47.208733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:47.209033 (+   300us) service_pool.cc:224] Handling call
0709 13:13:01.375462 (+14166429us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:01.029777 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:01.037900 (+  8123us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:01.037941 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:13:01.037963 (+    22us) tablet.cc:662] Decoding operations
0709 13:13:01.046136 (+  8173us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:01.046211 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:01.046246 (+    35us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:13:01.046884 (+   638us) tablet.cc:701] Row locks acquired
0709 13:13:01.046903 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:13:01.047043 (+   140us) write_op.cc:270] Start()
0709 13:13:01.047171 (+   128us) write_op.cc:276] Timestamp: P: 1783602781047001 usec, L: 0
0709 13:13:01.047199 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:13:01.076992 (+ 29793us) log.cc:844] Serialized 3233 byte log entry
0709 13:13:01.091752 (+ 14760us) spinlock_profiling.cc:243] Waited 2.02 ms on lock 0x7b540034ec54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd8571 00007fd72fc6ae28 00007fd7336a5581 00007fd7336a4d58 00007fd7336a99f1 00007fd7336a99a9 00007fd7336a9939 00007fd7336a9901 00007fd7336a8b2d 000000000038f354 000000000038f199
0709 13:13:01.093010 (+  1258us) op_driver.cc:464] REPLICATION: finished
0709 13:13:01.094638 (+  1628us) write_op.cc:301] APPLY: starting
0709 13:13:01.094739 (+   101us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:01.106576 (+ 11837us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:01.106607 (+    31us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:01.127656 (+ 21049us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:01.127897 (+   241us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 13:13:01.127949 (+    52us) write_op.cc:312] APPLY: finished
0709 13:13:01.128228 (+   279us) log.cc:844] Serialized 81 byte log entry
0709 13:13:01.129024 (+   796us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:01.129154 (+   130us) write_op.cc:454] Released schema lock
0709 13:13:01.129204 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:01.129699 (+   495us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:01.129774 (+    75us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":82895,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":1184,"apply.run_cpu_time_us":11249,"apply.run_wall_time_us":35212,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37583,"num_ops":8,"prepare.queue_time_us":57843,"prepare.run_cpu_time_us":6489,"prepare.run_wall_time_us":62180,"raft.queue_time_us":13018,"raft.run_cpu_time_us":3404,"raft.run_wall_time_us":12465,"replication_time_us":45647,"spinlock_wait_cycles":7031040,"thread_start_us":64637,"threads_started":4,"wal-append.queue_time_us":930}]]}
I20260709 13:13:01.534930 25128 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40034 (request call id 265) took 1954 ms. Trace:
I20260709 13:13:01.535462 25128 rpcz_store.cc:276] 0709 13:12:59.580858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:59.581019 (+   161us) service_pool.cc:224] Handling call
0709 13:13:01.534839 (+1953820us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:01.364900 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:01.365423 (+   523us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:01.365455 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:13:01.365472 (+    17us) tablet.cc:662] Decoding operations
0709 13:13:01.367900 (+  2428us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:01.367951 (+    51us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:01.367982 (+    31us) tablet.cc:685] Acquiring locks for 31 operations
0709 13:13:01.371988 (+  4006us) tablet.cc:701] Row locks acquired
0709 13:13:01.372007 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:13:01.372152 (+   145us) write_op.cc:270] Start()
0709 13:13:01.372279 (+   127us) write_op.cc:276] Timestamp: P: 1783602781372109 usec, L: 0
0709 13:13:01.372302 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:13:01.372987 (+   685us) log.cc:844] Serialized 12180 byte log entry
0709 13:13:01.383368 (+ 10381us) op_driver.cc:464] REPLICATION: finished
0709 13:13:01.384113 (+   745us) write_op.cc:301] APPLY: starting
0709 13:13:01.384211 (+    98us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:01.430098 (+ 45887us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:01.430250 (+   152us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:01.505914 (+ 75664us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:01.506234 (+   320us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=62,key_file_lookups=62,delta_file_lookups=62,mrs_lookups=0
0709 13:13:01.506278 (+    44us) write_op.cc:312] APPLY: finished
0709 13:13:01.506756 (+   478us) log.cc:844] Serialized 268 byte log entry
0709 13:13:01.506935 (+   179us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:01.507158 (+   223us) write_op.cc:454] Released schema lock
0709 13:13:01.511467 (+  4309us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":446005,"reported_tablets":42,"child_traces":[["op",{"apply.queue_time_us":121,"apply.run_cpu_time_us":34571,"apply.run_wall_time_us":134381,"cfile_cache_hit":124,"cfile_cache_hit_bytes":129642,"num_ops":31,"prepare.queue_time_us":96,"prepare.run_cpu_time_us":6374,"prepare.run_wall_time_us":17568,"replication_time_us":10938}]]}
I20260709 13:13:01.565989 25122 catalog_manager.cc:5697] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 9 to 13, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 13 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:01.571352 25122 catalog_manager.cc:5697] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 12 to 14, leader changed from 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 14 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:01.583678 25122 catalog_manager.cc:5697] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 14 to 18, leader changed from 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 18 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:01.594352 25122 catalog_manager.cc:5697] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 10 to 12, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 12 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:01.615480 25122 catalog_manager.cc:5697] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 12 to 16, leader changed from 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 16 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:01.618150 25122 catalog_manager.cc:5697] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 7 to 13. New cstate: current_term: 13 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:01.711752 25126 catalog_manager.cc:5697] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 9 to 14, leader changed from 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68) to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 14 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:13:01.720054 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:13:01.759603 25122 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40026 (request call id 244) took 15450 ms (client timeout 15000 ms). Trace:
I20260709 13:13:01.781960 30917 raft_consensus.cc:493] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:13:01.782624 30917 raft_consensus.cc:515] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:13:01.784888 30917 leader_election.cc:290] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:13:01.768358 25122 rpcz_store.cc:269] 0709 13:12:46.309612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:46.310170 (+   558us) service_pool.cc:224] Handling call
0709 13:12:47.664977 (+1354807us) spinlock_profiling.cc:243] Waited 460 ms on lock 0x7b540034ec54. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72fbd9090 00007fd72fc77f3a 00007fd735a2e1cc 00007fd735b2c37e 00007fd733fed2a4 00007fd733fed232 00007fd733fed161 00007fd733fed0dc 00007fd733fec392 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:13:01.759522 (+14094545us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:01.640077 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:01.640746 (+   669us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:01.640781 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:13:01.640796 (+    15us) tablet.cc:662] Decoding operations
0709 13:13:01.641604 (+   808us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:01.641665 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:01.641696 (+    31us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:13:01.642296 (+   600us) tablet.cc:701] Row locks acquired
0709 13:13:01.642311 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:13:01.642460 (+   149us) write_op.cc:270] Start()
0709 13:13:01.642560 (+   100us) write_op.cc:276] Timestamp: P: 1783602781642416 usec, L: 0
0709 13:13:01.642578 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:13:01.643239 (+   661us) log.cc:844] Serialized 2457 byte log entry
0709 13:13:01.648208 (+  4969us) op_driver.cc:464] REPLICATION: finished
0709 13:13:01.649387 (+  1179us) write_op.cc:301] APPLY: starting
0709 13:13:01.649480 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:01.653030 (+  3550us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:01.653138 (+   108us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:01.656784 (+  3646us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:01.661039 (+  4255us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 13:13:01.661102 (+    63us) write_op.cc:312] APPLY: finished
0709 13:13:01.661358 (+   256us) log.cc:844] Serialized 65 byte log entry
0709 13:13:01.661525 (+   167us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:01.661642 (+   117us) write_op.cc:454] Released schema lock
0709 13:13:01.661690 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:01.662111 (+   421us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:01.662143 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":832772,"reported_tablets":50,"spinlock_wait_cycles":1059141888,"child_traces":[["op",{"apply.queue_time_us":926,"apply.run_cpu_time_us":8649,"apply.run_wall_time_us":12671,"cfile_cache_hit":24,"cfile_cache_hit_bytes":25092,"num_ops":6,"prepare.queue_time_us":238,"prepare.run_cpu_time_us":3572,"prepare.run_wall_time_us":7972,"replication_time_us":5434}]]}
I20260709 13:13:01.801101 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:13:01.801821 25228 raft_consensus.cc:2468] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 17.
I20260709 13:13:01.806001 25128 catalog_manager.cc:5697] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 18 to 19, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 19 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:01.807916 25128 catalog_manager.cc:5697] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 12 to 16, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 16 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
I20260709 13:13:01.809576 25128 catalog_manager.cc:5697] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 17 to 18, leader changed from 79d99c0e498349bda74127365219e468 (127.23.140.67) to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 18 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
I20260709 13:13:01.810916 25128 catalog_manager.cc:5697] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 7 to 12. New cstate: current_term: 12 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:01.812500 25128 catalog_manager.cc:5697] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 17 to 20, leader changed from 79d99c0e498349bda74127365219e468 (127.23.140.67) to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 20 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } }
I20260709 13:13:01.821105 25128 catalog_manager.cc:5697] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 14 to 15, leader changed from 79d99c0e498349bda74127365219e468 (127.23.140.67) to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 15 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:13:01.826831 25128 catalog_manager.cc:5697] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 12 to 15, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 15 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:01.838675 25128 catalog_manager.cc:5697] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 16 to 17, leader changed from 79d99c0e498349bda74127365219e468 (127.23.140.67) to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 17 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:13:01.833982 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:13:01.840315 25296 raft_consensus.cc:2393] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 17: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
W20260709 13:13:01.816412 25126 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33566 (request call id 180) took 19302 ms (client timeout 15000 ms). Trace:
W20260709 13:13:01.845269 25126 rpcz_store.cc:269] 0709 13:12:42.513949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:42.514166 (+   217us) service_pool.cc:224] Handling call
0709 13:13:01.816201 (+19302035us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:01.749271 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:01.749844 (+   573us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:01.749882 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:13:01.749899 (+    17us) tablet.cc:662] Decoding operations
0709 13:13:01.750239 (+   340us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:01.750290 (+    51us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:01.750320 (+    30us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:13:01.750535 (+   215us) tablet.cc:701] Row locks acquired
0709 13:13:01.750551 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:13:01.750673 (+   122us) write_op.cc:270] Start()
0709 13:13:01.750774 (+   101us) write_op.cc:276] Timestamp: P: 1783602781750635 usec, L: 0
0709 13:13:01.750793 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:13:01.751406 (+   613us) log.cc:844] Serialized 536 byte log entry
0709 13:13:01.766814 (+ 15408us) op_driver.cc:464] REPLICATION: finished
0709 13:13:01.767902 (+  1088us) write_op.cc:301] APPLY: starting
0709 13:13:01.767983 (+    81us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:01.768818 (+   835us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:01.768903 (+    85us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:01.769610 (+   707us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:01.769816 (+   206us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:13:01.769863 (+    47us) write_op.cc:312] APPLY: finished
0709 13:13:01.770053 (+   190us) log.cc:844] Serialized 25 byte log entry
0709 13:13:01.770239 (+   186us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:01.770326 (+    87us) write_op.cc:454] Released schema lock
0709 13:13:01.770367 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:01.770705 (+   338us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:01.770732 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":268539,"reported_tablets":31,"spinlock_wait_cycles":847488,"child_traces":[["op",{"apply.queue_time_us":895,"apply.run_cpu_time_us":2755,"apply.run_wall_time_us":2755,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4182,"num_ops":1,"prepare.queue_time_us":267,"prepare.run_cpu_time_us":2416,"prepare.run_wall_time_us":4246,"replication_time_us":15904}]]}
I20260709 13:13:01.841445 25128 catalog_manager.cc:5697] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 14 to 15, leader changed from 79d99c0e498349bda74127365219e468 (127.23.140.67) to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 15 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:13:01.863459 25345 leader_election.cc:304] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: da445ce82dc4467f95f4fa52297eaa19
I20260709 13:13:01.874445 30960 raft_consensus.cc:2804] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:01.875802 30960 raft_consensus.cc:493] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:13:01.876232 30960 raft_consensus.cc:3060] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:01.936908 30944 raft_consensus.cc:493] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:01.937578 30944 raft_consensus.cc:515] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:13:01.941613 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:13:01.942405 30944 leader_election.cc:290] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:13:01.947532 30960 raft_consensus.cc:515] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:13:01.948967 25377 raft_consensus.cc:2410] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:13:01.956176 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:13:01.971824 25222 raft_consensus.cc:2468] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 17.
I20260709 13:13:01.974527 25345 leader_election.cc:304] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:13:01.977842 25222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1f539ba21487460085b837e7529a78ce" is_pre_election: true
I20260709 13:13:01.979046 25222 raft_consensus.cc:2410] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:13:01.980923 30995 raft_consensus.cc:2804] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:13:01.981683 30995 raft_consensus.cc:697] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 17 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:13:01.982906 30995 consensus_queue.cc:237] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:13:01.985525 25377 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92f679df8187472794ba8595642f63f9"
dest_uuid: "79d99c0e498349bda74127365219e468"
mode: GRACEFUL
new_leader_uuid: "1f539ba21487460085b837e7529a78ce"
 from {username='slave'} at 127.0.0.1:37886
I20260709 13:13:01.986259 25377 raft_consensus.cc:606] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Received request to transfer leadership to TS 1f539ba21487460085b837e7529a78ce
I20260709 13:13:01.986627 25377 raft_consensus.cc:614] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:01.988992 25271 leader_election.cc:304] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:13:01.990870 31083 raft_consensus.cc:2749] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:01.994159 25377 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc"
dest_uuid: "79d99c0e498349bda74127365219e468"
mode: GRACEFUL
new_leader_uuid: "1f539ba21487460085b837e7529a78ce"
 from {username='slave'} at 127.0.0.1:37886
I20260709 13:13:01.994856 25377 raft_consensus.cc:606] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 16 LEADER]: Received request to transfer leadership to TS 1f539ba21487460085b837e7529a78ce
I20260709 13:13:01.999759 24113 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:13:02.002578 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fad5b7d561432b9e669ef42e8b145b" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:13:02.003350 25302 raft_consensus.cc:2393] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 17: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:13:02.005425 24113 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:01.991838 30960 leader_election.cc:290] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 17 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:13:02.097853 25128 catalog_manager.cc:5697] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 16 to 17, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 17 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:02.129288 25124 catalog_manager.cc:5697] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 14 to 16, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 16 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:13:02.140244 25124 catalog_manager.cc:5697] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:13:02.161556 25124 catalog_manager.cc:5697] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 16 to 17, leader changed from da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) to 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68). New cstate: current_term: 17 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:13:02.178731 25123 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40020 (request call id 266) took 32109 ms (client timeout 15000 ms). Trace:
W20260709 13:13:02.179436 25123 rpcz_store.cc:269] 0709 13:12:30.069088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:30.069273 (+   185us) service_pool.cc:224] Handling call
0709 13:12:30.206236 (+136963us) spinlock_profiling.cc:243] Waited 1.67 ms on lock 0x7b54002e0090. stack: 00007fd72cb50343 00007fd72cb50240 00007fd72c4df1d4 00007fd73621d304 00007fd73621d299 00007fd72ca0adb1 00007fd72cb4b640 00007fd735a22b76 00007fd735b2cc3e 00007fd733fed2a4 00007fd733fed232 00007fd733fed161 00007fd733fed0dc 00007fd733fec392 00007fd72dfaa48c 00007fd72dfa98c6
0709 13:13:02.178609 (+31972373us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2750175,"reported_tablets":50,"spinlock_wait_cycles":3849472}
W20260709 13:13:02.210088 25127 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40020 (request call id 265) took 60392 ms (client timeout 15000 ms). Trace:
W20260709 13:13:02.210635 25127 rpcz_store.cc:269] 0709 13:12:01.889885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:01.901997 (+ 12112us) service_pool.cc:224] Handling call
0709 13:13:02.203983 (+60301986us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39576,"reported_tablets":50,"spinlock_wait_cycles":3584}
I20260709 13:13:02.245715 25124 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33566 (request call id 181) took 4353 ms. Trace:
I20260709 13:13:02.246850 25124 rpcz_store.cc:276] 0709 13:12:57.892663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:57.896647 (+  3984us) service_pool.cc:224] Handling call
0709 13:13:02.245618 (+4348971us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:02.171892 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:02.172495 (+   603us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:02.172538 (+    43us) write_op.cc:435] Acquired schema lock
0709 13:13:02.172554 (+    16us) tablet.cc:662] Decoding operations
0709 13:13:02.173202 (+   648us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:02.173269 (+    67us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:02.173299 (+    30us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:13:02.173659 (+   360us) tablet.cc:701] Row locks acquired
0709 13:13:02.173677 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:13:02.173855 (+   178us) write_op.cc:270] Start()
0709 13:13:02.173981 (+   126us) write_op.cc:276] Timestamp: P: 1783602782173805 usec, L: 0
0709 13:13:02.174002 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:13:02.177999 (+  3997us) log.cc:844] Serialized 1302 byte log entry
0709 13:13:02.180281 (+  2282us) op_driver.cc:464] REPLICATION: finished
0709 13:13:02.180763 (+   482us) write_op.cc:301] APPLY: starting
0709 13:13:02.180840 (+    77us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:02.182914 (+  2074us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:02.183009 (+    95us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:02.192297 (+  9288us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:02.194167 (+  1870us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:13:02.194218 (+    51us) write_op.cc:312] APPLY: finished
0709 13:13:02.196719 (+  2501us) log.cc:844] Serialized 41 byte log entry
0709 13:13:02.205167 (+  8448us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:02.207374 (+  2207us) write_op.cc:454] Released schema lock
0709 13:13:02.207426 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:02.217548 (+ 10122us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:02.217586 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":150138,"reported_tablets":31,"child_traces":[["op",{"apply.queue_time_us":275,"apply.run_cpu_time_us":5769,"apply.run_wall_time_us":35381,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12546,"num_ops":3,"prepare.queue_time_us":601,"prepare.run_cpu_time_us":3217,"prepare.run_wall_time_us":15401,"replication_time_us":6153}]]}
I20260709 13:13:02.258922 30960 raft_consensus.cc:993] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468: : Instructing follower 1f539ba21487460085b837e7529a78ce to start an election
I20260709 13:13:02.259498 30960 raft_consensus.cc:1081] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 16 LEADER]: Signalling peer 1f539ba21487460085b837e7529a78ce to start an election
I20260709 13:13:02.268764 25222 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc"
dest_uuid: "1f539ba21487460085b837e7529a78ce"
 from {username='slave'} at 127.0.0.1:58418
I20260709 13:13:02.269465 25222 raft_consensus.cc:493] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:02.269883 25222 raft_consensus.cc:3060] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:02.351851 25222 raft_consensus.cc:515] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:13:02.360471 25125 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40026 (request call id 245) took 1018 ms. Trace:
I20260709 13:13:02.365550 25125 rpcz_store.cc:276] 0709 13:13:01.342014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:01.343057 (+  1043us) service_pool.cc:224] Handling call
0709 13:13:02.360378 (+1017321us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":50}
I20260709 13:13:02.374330 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:13:02.374995 25302 raft_consensus.cc:3060] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:02.375484 25222 leader_election.cc:290] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 17 election: Requested vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:13:02.376530 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:13:02.377177 25377 raft_consensus.cc:3055] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:13:02.377478 25377 raft_consensus.cc:740] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:13:02.378293 25377 consensus_queue.cc:260] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:13:02.379405 25377 raft_consensus.cc:3060] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:02.382813 25302 raft_consensus.cc:2468] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 17.
I20260709 13:13:02.385322 25194 leader_election.cc:304] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:13:02.386298 31110 raft_consensus.cc:2804] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:13:02.387079 31110 raft_consensus.cc:697] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 17 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:13:02.388182 31110 consensus_queue.cc:237] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:13:02.405861 25221 raft_consensus.cc:1275] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:13:02.408740 31111 consensus_queue.cc:1048] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:13:02.439842 25377 raft_consensus.cc:2468] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 17.
I20260709 13:13:02.439339 25121 catalog_manager.cc:5697] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 16 to 17, leader changed from 79d99c0e498349bda74127365219e468 (127.23.140.67) to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 17 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:02.480542 25296 raft_consensus.cc:1275] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:13:02.485968 31111 consensus_queue.cc:1048] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:13:02.833037 25296 raft_consensus.cc:1275] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:13:02.835085 31078 consensus_queue.cc:1048] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:13:02.880594 25374 raft_consensus.cc:1275] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:13:02.882951 30957 consensus_queue.cc:1048] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:13:03.006713 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:13:03.521303 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 68626.5us
W20260709 13:13:03.578406 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 45647us
W20260709 13:13:03.634536 25344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:34085, user_credentials={real_user=slave}} blocked reactor thread for 129581us
W20260709 13:13:03.641417 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 128182us
W20260709 13:13:03.660956 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 152479us
W20260709 13:13:04.301389 25326 debug-util.cc:398] Leaking SignalData structure 0x7b08002b0f80 after lost signal to thread 24116
W20260709 13:13:04.302605 25326 debug-util.cc:398] Leaking SignalData structure 0x7b08000af360 after lost signal to thread 25162
W20260709 13:13:04.303860 25326 debug-util.cc:398] Leaking SignalData structure 0x7b08000d9b20 after lost signal to thread 25254
W20260709 13:13:04.304925 25326 debug-util.cc:398] Leaking SignalData structure 0x7b08000dd8a0 after lost signal to thread 25329
W20260709 13:13:04.314268 25326 debug-util.cc:398] Leaking SignalData structure 0x7b080038df00 after lost signal to thread 25403
W20260709 13:13:04.315649 25326 debug-util.cc:398] Leaking SignalData structure 0x7b08002d6f20 after lost signal to thread 25932
I20260709 13:13:04.328989 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:04.579214 25228 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6"
dest_uuid: "1f539ba21487460085b837e7529a78ce"
mode: GRACEFUL
new_leader_uuid: "79d99c0e498349bda74127365219e468"
 from {username='slave'} at 127.0.0.1:45014
I20260709 13:13:04.579866 25228 raft_consensus.cc:606] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 17 LEADER]: Received request to transfer leadership to TS 79d99c0e498349bda74127365219e468
I20260709 13:13:04.581243 24113 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:13:04.582922 24113 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:13:04.778990 25195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 65793.7us
I20260709 13:13:04.928915 31146 raft_consensus.cc:993] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce: : Instructing follower 79d99c0e498349bda74127365219e468 to start an election
I20260709 13:13:04.929641 31146 raft_consensus.cc:1081] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 17 LEADER]: Signalling peer 79d99c0e498349bda74127365219e468 to start an election
I20260709 13:13:04.934226 25378 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6"
dest_uuid: "79d99c0e498349bda74127365219e468"
 from {username='slave'} at 127.0.0.1:36264
I20260709 13:13:04.935362 25378 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:04.935913 25378 raft_consensus.cc:3060] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:13:04.960273 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 63023.2us
I20260709 13:13:04.979352 25378 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:13:05.024520 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: true dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:13:05.025385 25905 raft_consensus.cc:3060] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:05.032128 25225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: true dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:13:05.032840 25225 raft_consensus.cc:3055] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:13:05.033152 25225 raft_consensus.cc:740] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:13:05.035455 25225 consensus_queue.cc:260] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:13:05.036906 25225 raft_consensus.cc:3060] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:05.045482 25378 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 18 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:13:05.053993 25905 raft_consensus.cc:2468] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 18.
I20260709 13:13:05.055459 25344 leader_election.cc:304] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:13:05.056448 31149 raft_consensus.cc:2804] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:13:05.056955 31149 raft_consensus.cc:697] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 18 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:13:05.057979 31149 consensus_queue.cc:237] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:13:05.103039 25225 raft_consensus.cc:2468] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 18.
I20260709 13:13:05.104583 25125 catalog_manager.cc:5697] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 17 to 18, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 18 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:13:05.502267 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 46571.8us
I20260709 13:13:05.522490 25228 raft_consensus.cc:1275] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 18 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:13:05.527486 31141 consensus_queue.cc:1048] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:13:05.550817 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 128757us
W20260709 13:13:05.553854 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 127893us
I20260709 13:13:05.585009 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:05.626758 25905 raft_consensus.cc:1275] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 18 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:13:05.648854 31148 consensus_queue.cc:1048] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:13:06.867774 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:07.051704 25377 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6"
dest_uuid: "79d99c0e498349bda74127365219e468"
mode: GRACEFUL
new_leader_uuid: "1f539ba21487460085b837e7529a78ce"
 from {username='slave'} at 127.0.0.1:37886
I20260709 13:13:07.052484 25377 raft_consensus.cc:606] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 18 LEADER]: Received request to transfer leadership to TS 1f539ba21487460085b837e7529a78ce
I20260709 13:13:07.054549 24113 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:13:07.056378 24113 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:07.165686 31164 raft_consensus.cc:993] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468: : Instructing follower 1f539ba21487460085b837e7529a78ce to start an election
I20260709 13:13:07.166342 31164 raft_consensus.cc:1081] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 18 LEADER]: Signalling peer 1f539ba21487460085b837e7529a78ce to start an election
I20260709 13:13:07.168435 25228 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6"
dest_uuid: "1f539ba21487460085b837e7529a78ce"
 from {username='slave'} at 127.0.0.1:58418
I20260709 13:13:07.169026 25228 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:07.169394 25228 raft_consensus.cc:3060] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:07.211234 25228 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:13:07.285475 25378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: true dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:13:07.286074 25378 raft_consensus.cc:3055] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:13:07.286377 25378 raft_consensus.cc:740] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:13:07.287094 25378 consensus_queue.cc:260] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:13:07.288118 25378 raft_consensus.cc:3060] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:07.295241 25378 raft_consensus.cc:2468] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 19.
I20260709 13:13:07.296748 25195 leader_election.cc:304] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468; no voters: 
I20260709 13:13:07.297660 31163 raft_consensus.cc:2804] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:13:07.298259 31163 raft_consensus.cc:697] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 19 LEADER]: Becoming Leader. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:13:07.297505 25228 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [CANDIDATE]: Term 19 election: Requested vote from peers 79d99c0e498349bda74127365219e468 (127.23.140.67:34091), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:13:07.299140 31163 consensus_queue.cc:237] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:13:07.307458 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "1f539ba21487460085b837e7529a78ce" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: true dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:13:07.308122 25905 raft_consensus.cc:3060] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:07.333894 25905 raft_consensus.cc:2468] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f539ba21487460085b837e7529a78ce in term 19.
I20260709 13:13:07.397493 25121 catalog_manager.cc:5697] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce reported cstate change: term changed from 18 to 19, leader changed from 79d99c0e498349bda74127365219e468 (127.23.140.67) to 1f539ba21487460085b837e7529a78ce (127.23.140.65). New cstate: current_term: 19 leader_uuid: "1f539ba21487460085b837e7529a78ce" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:07.739848 25378 raft_consensus.cc:1275] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 19 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 13:13:07.741473 31163 consensus_queue.cc:1048] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:13:07.783304 25905 raft_consensus.cc:1275] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 19 FOLLOWER]: Refusing update from remote peer 1f539ba21487460085b837e7529a78ce: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 13:13:07.786986 31163 consensus_queue.cc:1048] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:13:08.063910 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:09.265235 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:09.384168 25228 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05"
dest_uuid: "1f539ba21487460085b837e7529a78ce"
mode: GRACEFUL
new_leader_uuid: "da445ce82dc4467f95f4fa52297eaa19"
 from {username='slave'} at 127.0.0.1:45014
I20260709 13:13:09.384778 25228 raft_consensus.cc:606] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 14 LEADER]: Received request to transfer leadership to TS da445ce82dc4467f95f4fa52297eaa19
I20260709 13:13:09.393970 24113 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:13:09.400931 24113 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:13:09.407164 25159 debug-util.cc:398] Leaking SignalData structure 0x7b0800328e20 after lost signal to thread 24116
W20260709 13:13:09.408479 25159 debug-util.cc:398] Leaking SignalData structure 0x7b08003185a0 after lost signal to thread 25162
W20260709 13:13:09.409924 25159 debug-util.cc:398] Leaking SignalData structure 0x7b08000ef2c0 after lost signal to thread 25254
W20260709 13:13:09.411160 25159 debug-util.cc:398] Leaking SignalData structure 0x7b080014a540 after lost signal to thread 25329
W20260709 13:13:09.412358 25159 debug-util.cc:398] Leaking SignalData structure 0x7b0800354340 after lost signal to thread 25403
W20260709 13:13:09.413666 25159 debug-util.cc:398] Leaking SignalData structure 0x7b08003926a0 after lost signal to thread 25932
W20260709 13:13:09.789350 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 51505.6us
I20260709 13:13:09.798514 31163 raft_consensus.cc:993] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce: : Instructing follower da445ce82dc4467f95f4fa52297eaa19 to start an election
I20260709 13:13:09.799010 31163 raft_consensus.cc:1081] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 14 LEADER]: Signalling peer da445ce82dc4467f95f4fa52297eaa19 to start an election
I20260709 13:13:09.812466 25299 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05"
dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
 from {username='slave'} at 127.0.0.1:57272
I20260709 13:13:09.813066 25299 raft_consensus.cc:493] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:09.813416 25299 raft_consensus.cc:3060] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:09.821130 25299 raft_consensus.cc:515] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:13:09.828305 25299 leader_election.cc:290] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:13:09.830889 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:13:09.831480 25376 raft_consensus.cc:3060] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:09.830997 25228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf070d83a5904025bb0d390a39ebae05" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "1f539ba21487460085b837e7529a78ce"
I20260709 13:13:09.834112 25228 raft_consensus.cc:3055] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:09.834424 25228 raft_consensus.cc:740] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1f539ba21487460085b837e7529a78ce, State: Running, Role: LEADER
I20260709 13:13:09.835187 25228 consensus_queue.cc:260] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:13:09.836526 25228 raft_consensus.cc:3060] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:09.842780 25376 raft_consensus.cc:2468] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 15.
I20260709 13:13:09.853526 25270 leader_election.cc:304] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:13:09.854821 31188 raft_consensus.cc:2804] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:13:09.855345 31188 raft_consensus.cc:697] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 15 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:13:09.856259 31188 consensus_queue.cc:237] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:13:09.851112 25228 raft_consensus.cc:2468] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 15.
I20260709 13:13:09.906945 25121 catalog_manager.cc:5697] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 14 to 15, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 15 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:10.278877 25375 raft_consensus.cc:1275] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:13:10.280840 31186 consensus_queue.cc:1048] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:13:10.335923 25228 raft_consensus.cc:1275] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:13:10.340613 31188 consensus_queue.cc:1048] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:13:10.406315 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:10.580936 24113 tablet_server.cc:179] TabletServer@127.23.140.65:0 shutting down...
W20260709 13:13:10.585995 25345 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 6 similar messages]
W20260709 13:13:10.629980 25345 consensus_peers.cc:597] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:10.642351 25345 consensus_peers.cc:597] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:10.658694 25345 consensus_peers.cc:597] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:10.683152 25345 consensus_peers.cc:597] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:10.704617 25271 consensus_peers.cc:597] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:10.710990 25271 consensus_peers.cc:597] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:10.747671 25271 consensus_peers.cc:597] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:10.750790 25271 consensus_peers.cc:597] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:10.753332 25271 consensus_peers.cc:597] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:10.766101 25345 consensus_peers.cc:597] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:10.792868 25874 consensus_peers.cc:597] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:10.793530 25874 consensus_peers.cc:597] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:10.815564 25874 consensus_peers.cc:597] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:10.845248 25271 consensus_peers.cc:597] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:10.853435 25345 consensus_peers.cc:597] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:10.850433 24113 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:10.862563 24113 tablet_replica.cc:333] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce: stopping tablet replica
I20260709 13:13:10.863610 24113 raft_consensus.cc:2243] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:10.864454 24113 raft_consensus.cc:2272] T ec256e9cce1249a995955c75b0c977cc P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:10.867745 24113 tablet_replica.cc:333] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce: stopping tablet replica
I20260709 13:13:10.868643 24113 raft_consensus.cc:2243] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Raft consensus shutting down.
W20260709 13:13:10.869215 25345 consensus_peers.cc:597] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:10.872958 25874 consensus_peers.cc:597] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:10.869329 24113 raft_consensus.cc:2272] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:10.876463 24113 tablet_replica.cc:333] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce: stopping tablet replica
I20260709 13:13:10.877408 24113 raft_consensus.cc:2243] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Raft consensus shutting down.
W20260709 13:13:10.883342 25271 consensus_peers.cc:597] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:10.886540 24113 raft_consensus.cc:2272] T 0adcdb50fe9647b0abfa936e9cb73727 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:10.894631 25271 consensus_peers.cc:597] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:10.899575 25271 consensus_peers.cc:597] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:10.901371 24113 tablet_replica.cc:333] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce: stopping tablet replica
I20260709 13:13:10.902388 24113 raft_consensus.cc:2243] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:10.903179 24113 raft_consensus.cc:2272] T 11892dffe99a496ebf3d98773631357c P 1f539ba21487460085b837e7529a78ce [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:10.906142 25345 consensus_peers.cc:597] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:10.910081 25271 consensus_peers.cc:597] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:10.913873 25874 consensus_peers.cc:597] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:10.916558 25345 consensus_peers.cc:597] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:10.919703 25345 consensus_peers.cc:597] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:10.920166 25271 consensus_peers.cc:597] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:10.923012 25874 consensus_peers.cc:597] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:10.925552 25874 consensus_peers.cc:597] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:10.906176 24113 tablet_replica.cc:333] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce: stopping tablet replica
I20260709 13:13:10.936257 24113 raft_consensus.cc:2243] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:10.936861 24113 raft_consensus.cc:2272] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:10.944998 24113 tablet_replica.cc:333] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce: stopping tablet replica
I20260709 13:13:10.945853 24113 raft_consensus.cc:2243] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:13:10.959918 24113 raft_consensus.cc:2272] T 135bcb58ad5b4506a12d94ef2b0d824c P 1f539ba21487460085b837e7529a78ce [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:10.962803 24113 tablet_replica.cc:333] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce: stopping tablet replica
I20260709 13:13:10.963742 24113 raft_consensus.cc:2243] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:10.964359 24113 raft_consensus.cc:2272] T 67fb9a2520c542d38f72828988ddc804 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:10.995034 25874 consensus_peers.cc:597] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:11.025642 25271 consensus_peers.cc:597] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:11.036011 24113 tablet_replica.cc:333] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce: stopping tablet replica
I20260709 13:13:11.037063 24113 raft_consensus.cc:2243] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 19 FOLLOWER]: Raft consensus shutting down.
W20260709 13:13:11.037513 25345 consensus_peers.cc:597] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:11.038121 24113 raft_consensus.cc:2272] T a1eeb9f9696c44b9b744d926cf3312ff P 1f539ba21487460085b837e7529a78ce [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:11.040946 24113 tablet_replica.cc:333] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce: stopping tablet replica
W20260709 13:13:11.042914 25874 consensus_peers.cc:597] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:11.062063 25271 consensus_peers.cc:597] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:11.069924 24113 raft_consensus.cc:2243] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:11.070856 24113 raft_consensus.cc:2272] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:11.071247 25345 consensus_peers.cc:597] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:11.074051 24113 tablet_replica.cc:333] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce: stopping tablet replica
I20260709 13:13:11.075054 24113 raft_consensus.cc:2243] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:11.075752 24113 raft_consensus.cc:2272] T d56909a48cf841eb99365741e9e29e93 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:11.093911 24113 tablet_replica.cc:333] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce: stopping tablet replica
I20260709 13:13:11.094849 24113 raft_consensus.cc:2243] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:11.095588 24113 raft_consensus.cc:2272] T 7ef45c031fc345b2917194ea453a14e3 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:11.123978 24113 tablet_replica.cc:333] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce: stopping tablet replica
I20260709 13:13:11.124969 24113 raft_consensus.cc:2243] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:11.125681 24113 raft_consensus.cc:2272] T c279dfc4b0d248a4a884e78a33fd437c P 1f539ba21487460085b837e7529a78ce [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:11.128661 24113 tablet_replica.cc:333] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce: stopping tablet replica
I20260709 13:13:11.129302 24113 raft_consensus.cc:2243] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:11.130415 24113 raft_consensus.cc:2272] T ea5abc7f78c6412885cf5a12e2a9ee6c P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:11.133287 24113 tablet_replica.cc:333] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce: stopping tablet replica
I20260709 13:13:11.134215 24113 raft_consensus.cc:2243] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:13:11.135376 24113 raft_consensus.cc:2272] T 92f679df8187472794ba8595642f63f9 P 1f539ba21487460085b837e7529a78ce [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:11.138334 24113 tablet_replica.cc:333] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce: stopping tablet replica
I20260709 13:13:11.139150 24113 raft_consensus.cc:2243] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:11.139882 24113 raft_consensus.cc:2272] T 87fad5b7d561432b9e669ef42e8b145b P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:11.142724 24113 tablet_replica.cc:333] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce: stopping tablet replica
I20260709 13:13:11.143538 24113 raft_consensus.cc:2243] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:11.144258 24113 raft_consensus.cc:2272] T 08c29bb25d6947ddaa43c22713738514 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:11.147351 24113 tablet_replica.cc:333] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce: stopping tablet replica
I20260709 13:13:11.148268 24113 raft_consensus.cc:2243] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:11.148967 24113 raft_consensus.cc:2272] T 275226661cc840559134f8c9e5b15719 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:11.151640 24113 tablet_replica.cc:333] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce: stopping tablet replica
I20260709 13:13:11.152478 24113 raft_consensus.cc:2243] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:13:11.153462 24113 raft_consensus.cc:2272] T 4e23aac97b6742dab615f0d6e9087e8f P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:11.155696 25874 consensus_peers.cc:597] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:11.157323 24113 tablet_replica.cc:333] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce: stopping tablet replica
I20260709 13:13:11.158293 24113 raft_consensus.cc:2243] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:11.161127 24113 raft_consensus.cc:2272] T 88997763405742ee8b8e6b43d7392c1f P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:11.163863 24113 tablet_replica.cc:333] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce: stopping tablet replica
I20260709 13:13:11.164710 24113 raft_consensus.cc:2243] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:11.165582 24113 raft_consensus.cc:2272] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:11.168408 24113 tablet_replica.cc:333] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce: stopping tablet replica
I20260709 13:13:11.169369 24113 raft_consensus.cc:2243] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:11.170135 24113 raft_consensus.cc:2272] T 0945649a5d1348c6b17e9dd0b67766c9 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:11.172958 24113 tablet_replica.cc:333] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce: stopping tablet replica
I20260709 13:13:11.173725 24113 raft_consensus.cc:2243] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:13:11.174683 24113 raft_consensus.cc:2272] T 47228487a74240e9bc9bcd2e1d966ed6 P 1f539ba21487460085b837e7529a78ce [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:11.177498 24113 tablet_replica.cc:333] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce: stopping tablet replica
I20260709 13:13:11.178280 24113 raft_consensus.cc:2243] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:11.179003 24113 raft_consensus.cc:2272] T 57009a57e25248a39037d8922bf47bf2 P 1f539ba21487460085b837e7529a78ce [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:11.181501 24113 tablet_replica.cc:333] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce: stopping tablet replica
I20260709 13:13:11.182299 24113 raft_consensus.cc:2243] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:13:11.183322 24113 raft_consensus.cc:2272] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 1f539ba21487460085b837e7529a78ce [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:11.185842 24113 tablet_replica.cc:333] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce: stopping tablet replica
I20260709 13:13:11.186605 24113 raft_consensus.cc:2243] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:13:11.187644 24113 raft_consensus.cc:2272] T e7b1f3db9d83491b8ef3a82b77afbae2 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:11.190603 24113 tablet_replica.cc:333] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce: stopping tablet replica
I20260709 13:13:11.191393 24113 raft_consensus.cc:2243] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:11.192099 24113 raft_consensus.cc:2272] T 682caa57052f4e698c0ad75fb393ae75 P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:11.194794 24113 tablet_replica.cc:333] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce: stopping tablet replica
I20260709 13:13:11.195498 24113 raft_consensus.cc:2243] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:11.196121 24113 raft_consensus.cc:2272] T af9115771e334c95a7dec25c698514dc P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:11.198876 24113 tablet_replica.cc:333] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce: stopping tablet replica
I20260709 13:13:11.199878 24113 raft_consensus.cc:2243] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:11.211974 24113 raft_consensus.cc:2272] T 5e0cf1df707d42a3834bac46dc045119 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:11.214924 24113 tablet_replica.cc:333] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce: stopping tablet replica
I20260709 13:13:11.215721 24113 raft_consensus.cc:2243] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:13:11.216776 24113 raft_consensus.cc:2272] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:11.219444 24113 tablet_replica.cc:333] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce: stopping tablet replica
I20260709 13:13:11.220299 24113 raft_consensus.cc:2243] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:13:11.221441 24113 raft_consensus.cc:2272] T 80b4c44a28264d36a06c367b324ac4b4 P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:11.223953 24113 tablet_replica.cc:333] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce: stopping tablet replica
I20260709 13:13:11.224807 24113 raft_consensus.cc:2243] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:13:11.226042 24113 raft_consensus.cc:2272] T f616a884a8284b1f8fd7c51549e8a211 P 1f539ba21487460085b837e7529a78ce [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:11.228919 24113 tablet_replica.cc:333] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce: stopping tablet replica
I20260709 13:13:11.229708 24113 raft_consensus.cc:2243] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:13:11.230840 24113 raft_consensus.cc:2272] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:11.233686 24113 tablet_replica.cc:333] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce: stopping tablet replica
I20260709 13:13:11.234441 24113 raft_consensus.cc:2243] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:11.235726 24113 raft_consensus.cc:2272] T f5c9116c92454e2ab270a148a8c5c4ea P 1f539ba21487460085b837e7529a78ce [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:11.239234 24113 tablet_replica.cc:333] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce: stopping tablet replica
I20260709 13:13:11.240082 24113 raft_consensus.cc:2243] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:13:11.241312 24113 raft_consensus.cc:2272] T 0eaedd90995b476890a2ea23d7089759 P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:11.269009 24113 tablet_replica.cc:333] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce: stopping tablet replica
I20260709 13:13:11.289207 24113 raft_consensus.cc:2243] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:11.289799 24113 raft_consensus.cc:2272] T cf070d83a5904025bb0d390a39ebae05 P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:11.300385 24113 tablet_replica.cc:333] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce: stopping tablet replica
I20260709 13:13:11.306840 24113 raft_consensus.cc:2243] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:11.314589 24113 raft_consensus.cc:2272] T 9b49f61c49ae486392588c88e34a32d0 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:11.318295 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 46604.5us
I20260709 13:13:11.327250 24113 tablet_replica.cc:333] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce: stopping tablet replica
I20260709 13:13:11.328444 24113 raft_consensus.cc:2243] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:13:11.352461 24113 raft_consensus.cc:2272] T c8f924da5ba24241866fed885eb63eff P 1f539ba21487460085b837e7529a78ce [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:11.355589 24113 tablet_replica.cc:333] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce: stopping tablet replica
I20260709 13:13:11.365777 24113 raft_consensus.cc:2243] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:11.366895 24113 raft_consensus.cc:2272] T 8d0f43a786a846b49924a589e4a36f2f P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:11.386071 24113 tablet_replica.cc:333] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce: stopping tablet replica
I20260709 13:13:11.386946 24113 raft_consensus.cc:2243] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:11.387727 24113 raft_consensus.cc:2272] T ad01a612dc964dd3ae0b3f179ac0ad9e P 1f539ba21487460085b837e7529a78ce [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:11.411491 24113 tablet_replica.cc:333] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce: stopping tablet replica
I20260709 13:13:11.412352 24113 raft_consensus.cc:2243] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:13:11.413582 24113 raft_consensus.cc:2272] T 0cf595e68eca43728a4957ce8c8f5b69 P 1f539ba21487460085b837e7529a78ce [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:11.439112 24113 tablet_replica.cc:333] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce: stopping tablet replica
I20260709 13:13:11.439956 24113 raft_consensus.cc:2243] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:11.440651 24113 raft_consensus.cc:2272] T ca881f8516e046c99da202e9d9ea00a1 P 1f539ba21487460085b837e7529a78ce [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:11.443674 24113 tablet_replica.cc:333] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce: stopping tablet replica
I20260709 13:13:11.444432 24113 raft_consensus.cc:2243] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:11.445024 24113 raft_consensus.cc:2272] T ff04ee47fb3f40b2b2354a8d4f665483 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:11.480450 24113 tablet_replica.cc:333] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce: stopping tablet replica
I20260709 13:13:11.481429 24113 raft_consensus.cc:2243] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:11.482410 24113 raft_consensus.cc:2272] T 52a83f35ff124418bd9c19dca631e017 P 1f539ba21487460085b837e7529a78ce [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:11.500662 24113 tablet_replica.cc:333] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce: stopping tablet replica
I20260709 13:13:11.506228 24113 raft_consensus.cc:2243] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:11.506949 24113 raft_consensus.cc:2272] T a5a4e5911cd2414daf6cc0bc2a692a69 P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:11.526147 24113 tablet_replica.cc:333] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce: stopping tablet replica
I20260709 13:13:11.526968 24113 raft_consensus.cc:2243] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:11.527567 24113 raft_consensus.cc:2272] T 25e0218933774b319104f23505937179 P 1f539ba21487460085b837e7529a78ce [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:11.563257 24113 tablet_replica.cc:333] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce: stopping tablet replica
I20260709 13:13:11.578500 24113 raft_consensus.cc:2243] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:11.579375 24113 raft_consensus.cc:2272] T e8da265131524ca9bbf94bd69438fc22 P 1f539ba21487460085b837e7529a78ce [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:11.582907 24113 tablet_replica.cc:333] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce: stopping tablet replica
I20260709 13:13:11.586856 24113 raft_consensus.cc:2243] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:13:11.588091 24113 raft_consensus.cc:2272] T 51ecc4484385405c857b3bee1077c36a P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:11.601183 24113 tablet_replica.cc:333] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce: stopping tablet replica
I20260709 13:13:11.614456 24113 raft_consensus.cc:2243] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:11.615262 24113 raft_consensus.cc:2272] T 477bcdc75e8c43318d410716549fefd7 P 1f539ba21487460085b837e7529a78ce [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:11.618386 24113 tablet_replica.cc:333] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce: stopping tablet replica
I20260709 13:13:11.622279 24113 raft_consensus.cc:2243] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:13:11.623431 24113 raft_consensus.cc:2272] T ca662cfcc5084384a1da94266546eabc P 1f539ba21487460085b837e7529a78ce [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:11.642191 24113 tablet_replica.cc:333] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce: stopping tablet replica
I20260709 13:13:11.649937 24113 raft_consensus.cc:2243] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:11.650776 24113 raft_consensus.cc:2272] T d7fb167d72a441418dc3c55148746e87 P 1f539ba21487460085b837e7529a78ce [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:11.963203 31185 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:13:11.963850 31185 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:13:11.971236 25874 leader_election.cc:336] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:11.972334 31185 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:13:11.974498 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:13:11.976673 25872 leader_election.cc:304] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:13:11.979092 31185 raft_consensus.cc:2749] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:13:12.006543 25345 connection.cc:769] client connection to 127.23.140.65:39361 send error: Network error: sendmsg error: Connection reset by peer (error 104)
I20260709 13:13:12.148057 31193 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:13:12.148676 31193 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:13:12.152729 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:13:12.153381 25905 raft_consensus.cc:2468] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 18.
I20260709 13:13:12.154711 25270 leader_election.cc:304] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:13:12.155699 31192 raft_consensus.cc:2804] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:13:12.156147 31192 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:13:12.156564 31192 raft_consensus.cc:3060] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:12.164798 31193 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
W20260709 13:13:12.169670 25271 leader_election.cc:336] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111)
I20260709 13:13:12.174873 31192 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:13:12.189013 25271 leader_election.cc:336] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111)
I20260709 13:13:12.200660 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135bcb58ad5b4506a12d94ef2b0d824c" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6"
I20260709 13:13:12.201244 25905 raft_consensus.cc:3060] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:12.201907 31192 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 19 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:13:12.207991 25905 raft_consensus.cc:2468] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 19.
I20260709 13:13:12.209435 25270 leader_election.cc:304] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:13:12.211028 31192 raft_consensus.cc:2804] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:13:12.211552 31192 raft_consensus.cc:697] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 19 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:13:12.212491 31192 consensus_queue.cc:237] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:13:12.216297 31193 raft_consensus.cc:493] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:13:12.216888 31193 raft_consensus.cc:515] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:13:12.219220 31193 leader_election.cc:290] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:13:12.228020 25271 leader_election.cc:336] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111)
I20260709 13:13:12.230882 31193 raft_consensus.cc:493] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:13:12.231493 31193 raft_consensus.cc:515] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:13:12.228353 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:13:12.235211 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:13:12.237214 25270 leader_election.cc:304] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:13:12.238117 31186 raft_consensus.cc:2749] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:12.240096 31186 raft_consensus.cc:493] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:13:12.240587 31186 raft_consensus.cc:515] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:13:12.242718 31186 leader_election.cc:290] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:13:12.245074 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
W20260709 13:13:12.249917 25271 leader_election.cc:336] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111)
I20260709 13:13:12.250969 25271 leader_election.cc:304] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:13:12.250448 31193 leader_election.cc:290] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:13:12.251900 31186 raft_consensus.cc:2749] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:12.264302 31192 raft_consensus.cc:493] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:13:12.265239 31192 raft_consensus.cc:515] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:13:12.267628 31192 leader_election.cc:290] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:13:12.272153 31204 raft_consensus.cc:493] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:13:12.272847 31204 raft_consensus.cc:515] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:13:12.275373 25271 leader_election.cc:336] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111)
W20260709 13:13:12.281301 25345 leader_election.cc:336] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111)
I20260709 13:13:12.282395 25271 leader_election.cc:304] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:13:12.283342 31204 leader_election.cc:290] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:13:12.288329 31186 raft_consensus.cc:2749] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:12.291150 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:13:12.291869 25299 raft_consensus.cc:2468] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 15.
I20260709 13:13:12.292784 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:13:12.296029 25343 leader_election.cc:304] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
W20260709 13:13:12.297454 25271 leader_election.cc:336] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111)
I20260709 13:13:12.298592 31212 raft_consensus.cc:2804] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:12.299041 31212 raft_consensus.cc:493] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:13:12.299410 31212 raft_consensus.cc:3060] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:12.301698 31219 raft_consensus.cc:493] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:13:12.302299 31219 raft_consensus.cc:515] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:13:12.302632 25121 catalog_manager.cc:5697] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 18 to 19, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 19 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:13:12.309813 25271 leader_election.cc:336] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111)
I20260709 13:13:12.311061 31219 leader_election.cc:290] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:13:12.316166 31204 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:13:12.317008 31204 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:13:12.324620 25345 leader_election.cc:336] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111)
I20260709 13:13:12.339217 31204 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:13:12.340994 25270 leader_election.cc:304] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:13:12.347119 31224 raft_consensus.cc:2749] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:12.349519 31204 raft_consensus.cc:493] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:13:12.350165 31204 raft_consensus.cc:515] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:13:12.351646 31212 raft_consensus.cc:515] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:13:12.356519 31224 raft_consensus.cc:493] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:13:12.357144 31224 raft_consensus.cc:515] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:13:12.359931 31224 leader_election.cc:290] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:13:12.369068 31204 leader_election.cc:290] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:13:12.376775 25271 leader_election.cc:336] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111)
I20260709 13:13:12.377429 31204 raft_consensus.cc:493] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:13:12.379220 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:13:12.379138 31204 raft_consensus.cc:515] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:13:12.382428 31204 leader_election.cc:290] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:13:12.382577 31224 raft_consensus.cc:493] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
W20260709 13:13:12.384104 25345 leader_election.cc:336] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111)
W20260709 13:13:12.385380 25345 leader_election.cc:336] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111)
I20260709 13:13:12.384771 31224 raft_consensus.cc:515] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:13:12.387440 31224 leader_election.cc:290] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:13:12.384094 31212 leader_election.cc:290] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 16 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:13:12.389539 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:13:12.390046 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:13:12.390379 25299 raft_consensus.cc:2468] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 13.
I20260709 13:13:12.392773 25270 leader_election.cc:304] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:13:12.394021 31219 raft_consensus.cc:2749] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:12.394167 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:13:12.395960 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:13:12.397336 25270 leader_election.cc:304] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:13:12.398406 25344 leader_election.cc:304] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:13:12.400225 31219 raft_consensus.cc:2749] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:12.401816 31222 raft_consensus.cc:2749] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:13:12.402745 31212 raft_consensus.cc:493] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:13:12.403401 31212 raft_consensus.cc:515] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:13:12.407783 31212 leader_election.cc:290] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:13:12.412675 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:13:12.422390 25299 raft_consensus.cc:3060] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:12.425400 25343 leader_election.cc:304] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:13:12.426863 31221 raft_consensus.cc:2804] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:12.427259 31221 raft_consensus.cc:493] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:13:12.427600 31221 raft_consensus.cc:3060] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:12.419093 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:13:12.430167 25375 raft_consensus.cc:2468] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 12.
I20260709 13:13:12.429646 25299 raft_consensus.cc:2468] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 16.
W20260709 13:13:12.421689 25271 leader_election.cc:336] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111)
I20260709 13:13:12.434849 31221 raft_consensus.cc:515] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:13:12.435369 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:13:12.437016 25299 raft_consensus.cc:2468] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 12.
I20260709 13:13:12.437242 31221 leader_election.cc:290] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:13:12.436223 25270 leader_election.cc:304] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:13:12.438169 25343 leader_election.cc:304] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
W20260709 13:13:12.438792 25345 leader_election.cc:336] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111)
I20260709 13:13:12.439666 31219 raft_consensus.cc:2804] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:12.440093 31219 raft_consensus.cc:493] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:13:12.440501 31219 raft_consensus.cc:3060] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:12.442653 31212 raft_consensus.cc:2804] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:12.443220 31212 raft_consensus.cc:697] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 16 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:13:12.445116 31212 consensus_queue.cc:237] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:13:12.444034 31204 raft_consensus.cc:493] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:13:12.439172 25345 leader_election.cc:304] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
I20260709 13:13:12.441962 25343 leader_election.cc:304] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:13:12.448565 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39a4f04fbfc4fb3a4b2057ad9cb8c88" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:13:12.450328 25299 raft_consensus.cc:3060] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:12.452669 31221 raft_consensus.cc:2749] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:12.453436 31204 raft_consensus.cc:515] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:13:12.455673 31204 leader_election.cc:290] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:13:12.458343 25345 leader_election.cc:336] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111)
I20260709 13:13:12.460592 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:13:12.461309 25301 raft_consensus.cc:2468] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 18.
I20260709 13:13:12.463145 25299 raft_consensus.cc:2468] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 14.
I20260709 13:13:12.465590 31204 raft_consensus.cc:2804] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:12.466027 31204 raft_consensus.cc:493] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:13:12.466364 31204 raft_consensus.cc:3060] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:13:12.474496 25345 leader_election.cc:336] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111)
I20260709 13:13:12.475638 25343 leader_election.cc:304] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:13:12.477620 25343 leader_election.cc:304] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:13:12.477898 31221 raft_consensus.cc:2804] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:13:12.479990 31221 raft_consensus.cc:493] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:13:12.480435 31221 raft_consensus.cc:3060] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:12.486475 31222 raft_consensus.cc:2804] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:12.487092 31222 raft_consensus.cc:697] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 14 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:13:12.488284 31222 consensus_queue.cc:237] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:13:12.477274 31219 raft_consensus.cc:515] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:13:12.492962 25345 leader_election.cc:336] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111)
I20260709 13:13:12.495126 31219 leader_election.cc:290] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:13:12.500073 25271 leader_election.cc:336] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111)
I20260709 13:13:12.502152 31221 raft_consensus.cc:515] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:13:12.528061 31204 raft_consensus.cc:515] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:13:12.530857 31204 leader_election.cc:290] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:13:12.531418 31222 raft_consensus.cc:493] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:13:12.531997 31222 raft_consensus.cc:515] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:13:12.534264 31222 leader_election.cc:290] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:13:12.531461 31204 raft_consensus.cc:493] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:13:12.535176 31204 raft_consensus.cc:515] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:13:12.537155 31204 leader_election.cc:290] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:13:12.538683 31226 raft_consensus.cc:493] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:13:12.539297 31226 raft_consensus.cc:515] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:13:12.543040 31185 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:13:12.543587 31185 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:13:12.537719 31221 leader_election.cc:290] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 19 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:13:12.548215 31185 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:13:12.549983 31226 leader_election.cc:290] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:13:12.557303 25874 leader_election.cc:336] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111)
W20260709 13:13:12.558566 25874 leader_election.cc:336] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111)
W20260709 13:13:12.561215 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 83702.5us
I20260709 13:13:12.563386 31221 raft_consensus.cc:493] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:13:12.563877 31221 raft_consensus.cc:515] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:13:12.564294 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f679df8187472794ba8595642f63f9" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:13:12.564862 25299 raft_consensus.cc:3060] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:12.565881 31221 leader_election.cc:290] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:13:12.570441 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:13:12.571201 25301 raft_consensus.cc:2393] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 79d99c0e498349bda74127365219e468 in current term 13: Already voted for candidate da445ce82dc4467f95f4fa52297eaa19 in this term.
I20260709 13:13:12.572364 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:13:12.573871 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:13:12.574436 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:13:12.574440 25301 raft_consensus.cc:2468] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 8.
I20260709 13:13:12.575186 25375 raft_consensus.cc:2393] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate da445ce82dc4467f95f4fa52297eaa19 in current term 13: Already voted for candidate 79d99c0e498349bda74127365219e468 in this term.
I20260709 13:13:12.578003 25299 raft_consensus.cc:2468] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 19.
I20260709 13:13:12.585294 25301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:13:12.585958 25301 raft_consensus.cc:2468] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 15.
I20260709 13:13:12.588248 25343 leader_election.cc:304] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:13:12.587325 25270 leader_election.cc:304] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
I20260709 13:13:12.587291 25121 catalog_manager.cc:5697] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 15 to 16, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 16 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:12.597656 25343 leader_election.cc:304] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:13:12.599515 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:13:12.598793 25343 leader_election.cc:304] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:13:12.600546 25376 raft_consensus.cc:2468] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 19.
I20260709 13:13:12.603490 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:13:12.605865 25375 raft_consensus.cc:2468] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 15.
I20260709 13:13:12.599735 31219 raft_consensus.cc:2749] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:13:12.612490 25873 leader_election.cc:304] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:13:12.643800 31219 raft_consensus.cc:493] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:13:12.647317 31234 raft_consensus.cc:2804] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:13:12.645394 31226 raft_consensus.cc:493] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:13:12.665155 31231 raft_consensus.cc:2804] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:12.666474 31223 raft_consensus.cc:2804] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:13:12.685855 31231 raft_consensus.cc:493] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
W20260709 13:13:12.677163 25271 consensus_peers.cc:597] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:12.686508 31231 raft_consensus.cc:3060] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:12.683492 31221 raft_consensus.cc:2804] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:12.688740 31221 raft_consensus.cc:493] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:13:12.689280 31221 raft_consensus.cc:3060] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:12.646080 31219 raft_consensus.cc:515] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:13:12.685950 31223 raft_consensus.cc:493] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:13:12.693159 31223 raft_consensus.cc:3060] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:12.694780 31219 leader_election.cc:290] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:13:12.671476 31226 raft_consensus.cc:515] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:13:12.699285 31226 leader_election.cc:290] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:13:12.703750 25271 leader_election.cc:336] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111)
W20260709 13:13:12.704011 25874 leader_election.cc:336] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111)
I20260709 13:13:12.704629 31223 raft_consensus.cc:515] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:13:12.706815 31223 leader_election.cc:290] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 20 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:13:12.712211 25874 leader_election.cc:336] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111)
I20260709 13:13:12.716078 31231 raft_consensus.cc:515] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:13:12.724357 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 125639us
W20260709 13:13:12.724762 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 112380us
I20260709 13:13:12.725798 25873 leader_election.cc:304] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:13:12.728168 31206 raft_consensus.cc:2804] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:12.728560 31206 raft_consensus.cc:493] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:13:12.728900 31206 raft_consensus.cc:3060] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:12.729732 31222 raft_consensus.cc:493] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:13:12.730278 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:13:12.730340 31222 raft_consensus.cc:515] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:13:12.731065 25376 raft_consensus.cc:2468] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 14.
I20260709 13:13:12.732795 31222 leader_election.cc:290] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:13:12.739921 25905 raft_consensus.cc:1275] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 19 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:13:12.742640 31224 consensus_queue.cc:1048] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:13:12.723001 25345 leader_election.cc:336] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111)
I20260709 13:13:12.745615 31234 raft_consensus.cc:697] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 19 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
W20260709 13:13:12.745972 25345 leader_election.cc:336] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111)
I20260709 13:13:12.746459 25345 leader_election.cc:304] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:13:12.746628 31234 consensus_queue.cc:237] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:13:12.747423 25345 leader_election.cc:336] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111)
I20260709 13:13:12.747826 25345 leader_election.cc:304] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:13:12.748730 25345 leader_election.cc:336] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111)
W20260709 13:13:12.749372 25345 leader_election.cc:336] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111)
I20260709 13:13:12.744817 31206 raft_consensus.cc:515] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:13:12.749927 31240 raft_consensus.cc:2749] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:13:12.750819 31240 raft_consensus.cc:2749] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:12.752629 31206 leader_election.cc:290] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 16 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:13:12.755752 31224 raft_consensus.cc:493] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
W20260709 13:13:12.756172 25874 leader_election.cc:336] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111)
I20260709 13:13:12.756417 31224 raft_consensus.cc:515] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:13:12.758878 31224 leader_election.cc:290] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085)
I20260709 13:13:12.762502 25270 leader_election.cc:304] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:13:12.763252 31224 raft_consensus.cc:2804] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:12.763746 31224 raft_consensus.cc:493] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:13:12.764111 31224 raft_consensus.cc:3060] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:12.767655 31204 raft_consensus.cc:493] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:13:12.768185 31204 raft_consensus.cc:515] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:13:12.770293 31204 leader_election.cc:290] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:13:12.771188 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" is_pre_election: true
I20260709 13:13:12.783885 31224 raft_consensus.cc:515] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:13:12.787438 31224 leader_election.cc:290] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:13:12.792356 25375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf595e68eca43728a4957ce8c8f5b69" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:13:12.793030 25375 raft_consensus.cc:3060] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:12.797180 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:13:12.797883 25302 raft_consensus.cc:2468] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 18.
I20260709 13:13:12.799880 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:13:12.802718 25375 raft_consensus.cc:2468] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 15.
I20260709 13:13:12.712905 31221 raft_consensus.cc:515] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:13:12.807325 31221 leader_election.cc:290] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 16 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:13:12.810285 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:13:12.810933 25376 raft_consensus.cc:2468] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 17.
I20260709 13:13:12.811033 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47228487a74240e9bc9bcd2e1d966ed6" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:13:12.811578 25377 raft_consensus.cc:3060] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:12.812052 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dbd9bfdb4f4ed582b5d84e9cc7602a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:13:12.812613 25376 raft_consensus.cc:3060] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:12.818809 25376 raft_consensus.cc:2468] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 16.
I20260709 13:13:12.821123 31224 raft_consensus.cc:493] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:13:12.820974 25121 catalog_manager.cc:5697] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 13 to 14, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 14 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:12.821630 31224 raft_consensus.cc:515] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:13:12.821933 25377 raft_consensus.cc:2468] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 20.
I20260709 13:13:12.822705 25121 catalog_manager.cc:5697] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 18 to 19, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 19 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:12.824278 31224 leader_election.cc:290] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:13:12.828404 25270 leader_election.cc:304] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:13:12.829677 31231 leader_election.cc:290] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:13:12.833551 31236 raft_consensus.cc:2804] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:13:12.834175 31236 raft_consensus.cc:697] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 15 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:13:12.835064 31236 consensus_queue.cc:237] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:13:12.835379 25343 leader_election.cc:304] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:13:12.835439 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:13:12.838917 31241 raft_consensus.cc:2804] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:13:12.839375 31241 raft_consensus.cc:493] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:13:12.839759 31241 raft_consensus.cc:3060] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:12.841898 25873 leader_election.cc:304] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:13:12.843837 25873 leader_election.cc:304] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce
W20260709 13:13:12.844857 25345 leader_election.cc:336] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111)
W20260709 13:13:12.845978 25345 leader_election.cc:336] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111)
I20260709 13:13:12.846454 25345 leader_election.cc:304] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:13:12.846657 31185 raft_consensus.cc:2804] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:12.847218 31185 raft_consensus.cc:697] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:13:12.847286 31239 raft_consensus.cc:2749] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:12.848078 31185 consensus_queue.cc:237] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:13:12.851799 25873 leader_election.cc:304] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:13:12.845069 31225 raft_consensus.cc:2804] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:12.852833 31225 raft_consensus.cc:493] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
W20260709 13:13:12.853099 25345 leader_election.cc:336] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111)
I20260709 13:13:12.852962 31241 raft_consensus.cc:515] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:13:12.853343 31226 raft_consensus.cc:2804] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:13:12.853636 25345 leader_election.cc:336] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111)
I20260709 13:13:12.853988 31226 raft_consensus.cc:697] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 20 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:13:12.855041 31225 raft_consensus.cc:3060] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:12.854861 31226 consensus_queue.cc:237] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 19.17, Last appended by leader: 17, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
W20260709 13:13:12.865340 25874 consensus_peers.cc:597] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:12.865478 25345 leader_election.cc:336] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111)
I20260709 13:13:12.868289 31241 leader_election.cc:290] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 19 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:13:12.876021 31225 raft_consensus.cc:515] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:13:12.880802 25377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaedd90995b476890a2ea23d7089759" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:13:12.881394 25377 raft_consensus.cc:3060] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:13:12.883628 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 61088.8us
W20260709 13:13:12.885085 25271 leader_election.cc:336] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111)
I20260709 13:13:12.887537 25271 leader_election.cc:304] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 6c4b021f3f9e41adb75e870a08ad88b6
W20260709 13:13:12.888614 25874 leader_election.cc:336] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111)
I20260709 13:13:12.893106 31238 raft_consensus.cc:2749] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:12.898679 25377 raft_consensus.cc:2468] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 18.
I20260709 13:13:12.901659 25873 leader_election.cc:304] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, 79d99c0e498349bda74127365219e468; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:13:12.903050 31242 raft_consensus.cc:2804] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:13:12.903604 31242 raft_consensus.cc:697] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 18 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:13:12.904474 31242 consensus_queue.cc:237] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:13:12.925321 25121 catalog_manager.cc:5697] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 15 to 16, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68). New cstate: current_term: 16 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:12.926803 25300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e23aac97b6742dab615f0d6e9087e8f" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:13:12.927398 25300 raft_consensus.cc:3060] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:12.928512 25121 catalog_manager.cc:5697] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 19 to 20, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68). New cstate: current_term: 20 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:12.930033 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f616a884a8284b1f8fd7c51549e8a211" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:13:12.930603 25299 raft_consensus.cc:3060] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:12.930757 31225 leader_election.cc:290] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 18 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:13:12.943061 25300 raft_consensus.cc:2468] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 16.
I20260709 13:13:12.943951 25302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6da6f96d4a4409be6b8e2b09c861c4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:13:12.947317 25302 raft_consensus.cc:3060] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:12.945124 25296 raft_consensus.cc:1275] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:13:12.944010 25301 raft_consensus.cc:1275] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:13:12.956176 25302 raft_consensus.cc:2468] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 19.
I20260709 13:13:12.946744 25299 raft_consensus.cc:2468] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 9.
I20260709 13:13:12.958431 31239 raft_consensus.cc:493] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:13:12.959075 31239 raft_consensus.cc:515] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:13:12.961427 31239 leader_election.cc:290] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:13:12.965129 25121 catalog_manager.cc:5697] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 17 to 18, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68). New cstate: current_term: 18 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:13:12.967993 25345 leader_election.cc:336] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111)
I20260709 13:13:12.969372 31238 raft_consensus.cc:493] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:13:12.970230 31238 raft_consensus.cc:515] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:13:12.972327 31238 leader_election.cc:290] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:13:12.973861 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468" is_pre_election: true
I20260709 13:13:12.974510 25376 raft_consensus.cc:2468] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 15.
I20260709 13:13:12.979701 25270 leader_election.cc:304] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:13:12.980445 31238 raft_consensus.cc:2804] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:12.980839 31238 raft_consensus.cc:493] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:13:12.981178 31238 raft_consensus.cc:3060] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:13:12.982741 25874 consensus_peers.cc:597] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:12.986014 25345 consensus_peers.cc:597] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:13.021557 25271 leader_election.cc:336] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111)
W20260709 13:13:13.027516 24113 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 25251)
I20260709 13:13:13.038980 31226 raft_consensus.cc:493] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:13:13.039597 31226 raft_consensus.cc:515] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:13:13.047245 31226 leader_election.cc:290] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:13:13.047883 25874 leader_election.cc:336] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111)
I20260709 13:13:13.067341 31234 consensus_queue.cc:1048] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:13:13.070509 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:13:13.071110 25299 raft_consensus.cc:2468] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 16.
I20260709 13:13:13.072119 31234 consensus_queue.cc:1048] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:13:13.074298 25343 leader_election.cc:304] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:13:13.075316 31234 raft_consensus.cc:2804] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:13:13.075798 31234 raft_consensus.cc:697] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 19 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:13:13.077260 31234 consensus_queue.cc:237] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:13:13.081262 25343 leader_election.cc:304] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:13:13.082157 31239 raft_consensus.cc:2804] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:13.082620 25343 leader_election.cc:304] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:13:13.082680 31239 raft_consensus.cc:697] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 9 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:13:13.084441 31239 consensus_queue.cc:237] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:13:13.085716 31241 raft_consensus.cc:2804] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:13.086431 31241 raft_consensus.cc:697] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 16 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:13:13.087342 31241 consensus_queue.cc:237] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:13:13.097867 25345 consensus_peers.cc:597] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:12.998116 31238 raft_consensus.cc:515] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:13:13.106242 25872 leader_election.cc:304] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:13:13.107328 25121 catalog_manager.cc:5697] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 18 to 19, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 19 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:13.108999 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:13:13.110806 31226 raft_consensus.cc:2804] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:13.111317 31226 raft_consensus.cc:493] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:13:13.111358 25299 raft_consensus.cc:2468] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 17.
I20260709 13:13:13.111851 31226 raft_consensus.cc:3060] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:13.118556 31238 leader_election.cc:290] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:13:13.124902 25376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f924da5ba24241866fed885eb63eff" candidate_uuid: "da445ce82dc4467f95f4fa52297eaa19" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "79d99c0e498349bda74127365219e468"
I20260709 13:13:13.125530 25376 raft_consensus.cc:3060] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:13:13.129611 25345 consensus_peers.cc:597] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:13.141105 31226 raft_consensus.cc:515] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:13:13.153268 31226 leader_election.cc:290] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 17 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:13:13.157830 25345 consensus_peers.cc:597] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:13.159821 25874 leader_election.cc:336] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111)
I20260709 13:13:13.162925 25121 catalog_manager.cc:5697] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 8 to 9, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 9 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:13.164513 25121 catalog_manager.cc:5697] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 15 to 16, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 16 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:13.171964 25301 raft_consensus.cc:1275] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 19 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:13:13.172724 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ecc4484385405c857b3bee1077c36a" candidate_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:13:13.173298 25297 raft_consensus.cc:3060] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:13:13.174199 25345 consensus_peers.cc:597] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:13.183730 25297 raft_consensus.cc:2468] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c4b021f3f9e41adb75e870a08ad88b6 in term 17.
I20260709 13:13:13.189021 25872 leader_election.cc:304] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:13:13.192256 31226 raft_consensus.cc:2804] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:13:13.192893 31226 raft_consensus.cc:697] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 LEADER]: Becoming Leader. State: Replica: 6c4b021f3f9e41adb75e870a08ad88b6, State: Running, Role: LEADER
I20260709 13:13:13.194252 31226 consensus_queue.cc:237] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:13:13.202811 25376 raft_consensus.cc:2468] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da445ce82dc4467f95f4fa52297eaa19 in term 16.
W20260709 13:13:13.207060 25271 leader_election.cc:336] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111)
I20260709 13:13:13.207688 25271 leader_election.cc:304] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
W20260709 13:13:13.215276 25874 consensus_peers.cc:597] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:13.216763 31238 raft_consensus.cc:2749] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:13.233150 25270 leader_election.cc:304] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 
I20260709 13:13:13.234295 31238 raft_consensus.cc:2804] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:13.234817 31238 raft_consensus.cc:697] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 16 LEADER]: Becoming Leader. State: Replica: da445ce82dc4467f95f4fa52297eaa19, State: Running, Role: LEADER
I20260709 13:13:13.235689 31238 consensus_queue.cc:237] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:13:13.243884 25345 consensus_peers.cc:597] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:13.244957 25874 consensus_peers.cc:597] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:13.246222 25343 leader_election.cc:304] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:13:13.257032 25121 catalog_manager.cc:5697] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 14 to 15, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 15 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:13.258525 31239 raft_consensus.cc:2804] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:13.258983 31239 raft_consensus.cc:493] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1f539ba21487460085b837e7529a78ce)
I20260709 13:13:13.259352 31239 raft_consensus.cc:3060] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:13.260694 31234 consensus_queue.cc:1048] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:13:13.270367 25874 consensus_peers.cc:597] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:13.275379 25271 leader_election.cc:336] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111)
I20260709 13:13:13.286964 31239 raft_consensus.cc:515] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:13:13.307415 31239 leader_election.cc:290] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 18 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:13:13.310216 25271 consensus_peers.cc:597] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:13.312882 25874 consensus_peers.cc:597] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:13.314477 25345 leader_election.cc:336] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111)
I20260709 13:13:13.316805 25121 catalog_manager.cc:5697] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: term changed from 16 to 17, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68). New cstate: current_term: 17 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:13.325847 25376 raft_consensus.cc:1275] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:13:13.329607 31238 consensus_queue.cc:1048] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:13:13.330785 25345 consensus_peers.cc:597] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:13.374861 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca662cfcc5084384a1da94266546eabc" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:13:13.375442 25299 raft_consensus.cc:3060] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:13:13.395872 25271 leader_election.cc:336] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111)
W20260709 13:13:13.397276 25271 consensus_peers.cc:597] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:13.421990 25377 raft_consensus.cc:1275] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
W20260709 13:13:13.423729 25345 consensus_peers.cc:597] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:13.428117 31226 consensus_queue.cc:1048] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:13:13.432583 25345 consensus_peers.cc:597] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:13.442353 25373 raft_consensus.cc:1275] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 20 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 19 index: 17. Preceding OpId from leader: term: 20 index: 18. (index mismatch)
I20260709 13:13:13.443868 25299 raft_consensus.cc:2468] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 18.
I20260709 13:13:13.443822 31206 consensus_queue.cc:1048] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
W20260709 13:13:13.447403 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 50153.1us
W20260709 13:13:13.433216 25874 consensus_peers.cc:597] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:13.447976 25271 consensus_peers.cc:597] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:13.475746 25874 consensus_peers.cc:597] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:13.479537 25343 leader_election.cc:304] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:13:13.480752 31240 raft_consensus.cc:2804] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:13:13.481503 31240 raft_consensus.cc:697] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 18 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:13:13.482496 31240 consensus_queue.cc:237] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
W20260709 13:13:13.484969 25874 consensus_peers.cc:597] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:13.488860 25271 consensus_peers.cc:597] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:13.523089 25271 consensus_peers.cc:597] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:13.537524 25121 catalog_manager.cc:5697] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 reported cstate change: term changed from 15 to 16, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66). New cstate: current_term: 16 leader_uuid: "da445ce82dc4467f95f4fa52297eaa19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:13.538995 25299 raft_consensus.cc:1275] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:13:13.540419 25271 consensus_peers.cc:597] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:13.540879 25271 consensus_peers.cc:597] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:13.548626 31222 consensus_queue.cc:1048] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:13:13.552994 25271 consensus_peers.cc:597] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:13.553555 25271 consensus_peers.cc:597] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:13.539016 25345 consensus_peers.cc:597] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:13.559993 25299 raft_consensus.cc:1275] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:13:13.540839 25874 consensus_peers.cc:597] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:13.580724 31240 consensus_queue.cc:1048] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:13:13.593811 25377 raft_consensus.cc:1275] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:13:13.596848 31225 consensus_queue.cc:1048] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:13:13.601975 25125 catalog_manager.cc:5697] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 17 to 18, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 18 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
W20260709 13:13:13.637822 25874 consensus_peers.cc:597] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:13.642943 25271 consensus_peers.cc:597] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:13.651027 25345 consensus_peers.cc:597] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:13.657279 25874 consensus_peers.cc:597] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:13.664433 25296 raft_consensus.cc:1275] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 19 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:13:13.672607 31222 consensus_queue.cc:1048] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:13:13.693048 25271 consensus_peers.cc:597] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:13.699635 25874 consensus_peers.cc:597] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:13.712725 25345 consensus_peers.cc:597] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:13.715617 25345 consensus_peers.cc:597] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:13.700979 25271 consensus_peers.cc:597] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:13.717700 25271 consensus_peers.cc:597] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:13.730887 25345 consensus_peers.cc:597] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:13.747368 25345 consensus_peers.cc:597] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:13.750345 25345 consensus_peers.cc:597] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:13.760934 25376 raft_consensus.cc:1275] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Refusing update from remote peer da445ce82dc4467f95f4fa52297eaa19: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:13:13.762392 31219 consensus_queue.cc:1048] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:13:13.776665 25874 consensus_peers.cc:597] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:13.796535 25299 raft_consensus.cc:1275] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:13:13.801528 31225 consensus_queue.cc:1048] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:13:13.818769 25271 consensus_peers.cc:597] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:13.868098 25345 consensus_peers.cc:597] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:13.875656 25345 consensus_peers.cc:597] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:13.909212 25299 raft_consensus.cc:1275] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 18 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:13:13.918653 31234 consensus_queue.cc:1048] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:13:13.934877 25345 consensus_peers.cc:597] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:13.936653 25271 consensus_peers.cc:597] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:14.028038 24113 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 25251)
I20260709 13:13:14.293165 31241 raft_consensus.cc:493] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.293818 31241 raft_consensus.cc:515] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:13:14.296146 31241 leader_election.cc:290] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:13:14.317795 25345 leader_election.cc:336] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111)
I20260709 13:13:14.319342 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19" is_pre_election: true
I20260709 13:13:14.320145 25296 raft_consensus.cc:2468] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 13.
I20260709 13:13:14.326660 25343 leader_election.cc:304] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:13:14.328792 31245 raft_consensus.cc:2804] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:14.329396 31245 raft_consensus.cc:493] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:14.330170 31245 raft_consensus.cc:3060] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:14.375628 31245 raft_consensus.cc:515] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:13:14.392256 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b4c44a28264d36a06c367b324ac4b4" candidate_uuid: "79d99c0e498349bda74127365219e468" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "da445ce82dc4467f95f4fa52297eaa19"
I20260709 13:13:14.393023 25296 raft_consensus.cc:3060] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:14.411324 25296 raft_consensus.cc:2468] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d99c0e498349bda74127365219e468 in term 14.
I20260709 13:13:14.412380 31245 leader_election.cc:290] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 election: Requested vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:13:14.414193 25345 leader_election.cc:336] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111)
I20260709 13:13:14.428521 25343 leader_election.cc:304] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19; no voters: 1f539ba21487460085b837e7529a78ce
I20260709 13:13:14.431032 31241 raft_consensus.cc:2804] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:14.431595 31241 raft_consensus.cc:697] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 14 LEADER]: Becoming Leader. State: Replica: 79d99c0e498349bda74127365219e468, State: Running, Role: LEADER
I20260709 13:13:14.432512 31241 consensus_queue.cc:237] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } }
I20260709 13:13:14.464334 25125 catalog_manager.cc:5697] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 reported cstate change: term changed from 12 to 14, leader changed from 1f539ba21487460085b837e7529a78ce (127.23.140.65) to 79d99c0e498349bda74127365219e468 (127.23.140.67). New cstate: current_term: 14 leader_uuid: "79d99c0e498349bda74127365219e468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:14.879848 25300 raft_consensus.cc:1275] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Refusing update from remote peer 79d99c0e498349bda74127365219e468: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:13:14.906023 31286 consensus_queue.cc:1048] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:13:14.926033 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 76179.5us
W20260709 13:13:14.930955 25345 consensus_peers.cc:597] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:15.029248 24113 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 25251)
W20260709 13:13:15.032569 25874 consensus_peers.cc:597] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:15.289793 25271 consensus_peers.cc:597] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:15.333246 25874 consensus_peers.cc:597] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:15.363782 25345 consensus_peers.cc:597] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:15.394778 25271 consensus_peers.cc:597] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:15.591454 25345 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111) [suppressed 451 similar messages]
W20260709 13:13:15.600790 25345 consensus_peers.cc:597] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:15.635304 25345 consensus_peers.cc:597] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:15.646005 25271 consensus_peers.cc:597] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:15.671211 25271 consensus_peers.cc:597] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:15.688098 25874 consensus_peers.cc:597] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:15.768440 25345 consensus_peers.cc:597] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:15.797143 25874 consensus_peers.cc:597] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:15.829785 25874 consensus_peers.cc:597] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:15.845518 25874 consensus_peers.cc:597] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:15.848163 25345 consensus_peers.cc:597] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:15.854673 25271 consensus_peers.cc:597] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:15.860327 25271 consensus_peers.cc:597] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:15.860857 25271 consensus_peers.cc:597] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:15.862236 25345 consensus_peers.cc:597] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:15.984781 25874 consensus_peers.cc:597] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:15.996920 25874 consensus_peers.cc:597] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:16.029739 24113 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 25251)
W20260709 13:13:16.036367 25271 consensus_peers.cc:597] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:16.038105 25874 consensus_peers.cc:597] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:16.077684 25345 consensus_peers.cc:597] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:16.091140 25345 consensus_peers.cc:597] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:16.109988 25874 consensus_peers.cc:597] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:16.119901 25271 consensus_peers.cc:597] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:16.123114 25271 consensus_peers.cc:597] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:16.204030 25874 consensus_peers.cc:597] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:16.259594 25874 consensus_peers.cc:597] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:16.262414 25271 consensus_peers.cc:597] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:16.318812 25345 consensus_peers.cc:597] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:16.326045 25345 consensus_peers.cc:597] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:16.332104 25345 consensus_peers.cc:597] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:16.337677 25345 consensus_peers.cc:597] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:16.340145 25271 consensus_peers.cc:597] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:16.357211 25345 consensus_peers.cc:597] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:16.381342 25271 consensus_peers.cc:597] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:16.389889 25271 consensus_peers.cc:597] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:16.391975 25874 consensus_peers.cc:597] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:16.413409 25345 consensus_peers.cc:597] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:16.481597 25271 consensus_peers.cc:597] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:16.494657 25271 consensus_peers.cc:597] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:16.517604 25345 consensus_peers.cc:597] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:16.542366 25345 consensus_peers.cc:597] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:16.608814 25345 consensus_peers.cc:597] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:16.644752 25345 consensus_peers.cc:597] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:16.688184 25874 consensus_peers.cc:597] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:16.830616 25345 consensus_peers.cc:597] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:17.030275 24113 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 25251)
W20260709 13:13:17.957314 25345 consensus_peers.cc:597] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:17.976209 25271 consensus_peers.cc:597] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:17.987919 25270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:34091, user_credentials={real_user=slave}} blocked reactor thread for 46006.4us
W20260709 13:13:18.005275 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 70577.9us
W20260709 13:13:18.012038 25874 consensus_peers.cc:597] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:18.030263 25874 consensus_peers.cc:597] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:18.031548 24113 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 25251)
W20260709 13:13:18.093458 25345 consensus_peers.cc:597] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:18.208818 25345 consensus_peers.cc:597] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:18.227118 25345 consensus_peers.cc:597] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:18.363404 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 48497.8us
W20260709 13:13:18.402701 25874 consensus_peers.cc:597] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:18.457955 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 55309.4us
W20260709 13:13:18.453296 25271 consensus_peers.cc:597] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:18.523126 25874 consensus_peers.cc:597] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:18.524032 25874 consensus_peers.cc:597] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:18.532631 25874 consensus_peers.cc:597] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:18.553643 25874 consensus_peers.cc:597] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:18.594909 25874 consensus_peers.cc:597] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:18.610889 25345 consensus_peers.cc:597] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:18.635944 25271 consensus_peers.cc:597] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:18.638868 25271 consensus_peers.cc:597] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:18.644150 25271 consensus_peers.cc:597] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:18.658504 25345 consensus_peers.cc:597] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:18.674527 25271 consensus_peers.cc:597] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:18.676887 25345 consensus_peers.cc:597] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:18.686250 25271 consensus_peers.cc:597] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:18.710078 25874 consensus_peers.cc:597] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:18.713200 25271 consensus_peers.cc:597] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:18.727030 25271 consensus_peers.cc:597] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:18.748502 25271 consensus_peers.cc:597] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:18.866565 25345 consensus_peers.cc:597] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:18.888132 25874 consensus_peers.cc:597] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:18.892323 25929 debug-util.cc:398] Leaking SignalData structure 0x7b08003fd580 after lost signal to thread 24116
W20260709 13:13:18.896304 25929 debug-util.cc:398] Leaking SignalData structure 0x7b08002fe700 after lost signal to thread 25162
W20260709 13:13:18.898236 25929 debug-util.cc:398] Leaking SignalData structure 0x7b080025fd00 after lost signal to thread 25329
W20260709 13:13:18.901605 25929 debug-util.cc:398] Leaking SignalData structure 0x7b080012f6a0 after lost signal to thread 25403
W20260709 13:13:18.907234 25929 debug-util.cc:398] Leaking SignalData structure 0x7b0800304fc0 after lost signal to thread 25932
W20260709 13:13:18.990670 25345 consensus_peers.cc:597] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:18.996577 25271 consensus_peers.cc:597] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:19.000247 25271 consensus_peers.cc:597] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:19.029136 25271 consensus_peers.cc:597] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:19.031978 24113 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 25251)
W20260709 13:13:19.086556 25874 consensus_peers.cc:597] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:19.127804 25874 consensus_peers.cc:597] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:19.131134 25271 consensus_peers.cc:597] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:19.135298 25271 consensus_peers.cc:597] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:19.198558 25345 consensus_peers.cc:597] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:19.261322 25345 consensus_peers.cc:597] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:19.272976 25345 consensus_peers.cc:597] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:19.318121 25345 consensus_peers.cc:597] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:19.318758 25345 consensus_peers.cc:597] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:19.330096 25345 consensus_peers.cc:597] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:19.359717 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 45098.9us
W20260709 13:13:19.383184 25874 consensus_peers.cc:597] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:19.457558 25345 consensus_peers.cc:597] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:19.491009 25345 consensus_peers.cc:597] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:19.497578 25874 consensus_peers.cc:597] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:19.665056 25345 consensus_peers.cc:597] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:19.695161 25345 consensus_peers.cc:597] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:19.757026 25345 consensus_peers.cc:597] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:20.035296 24113 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 25251)
W20260709 13:13:20.186776 25271 consensus_peers.cc:597] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:20.277105 25345 consensus_peers.cc:597] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:20.312762 25271 consensus_peers.cc:597] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:20.360548 25271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 47822.9us
W20260709 13:13:20.544689 25874 consensus_peers.cc:597] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:20.597512 25874 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111) [suppressed 454 similar messages]
W20260709 13:13:20.612298 25345 consensus_peers.cc:597] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:20.614591 25345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:39361, user_credentials={real_user=slave}} blocked reactor thread for 49603.4us
W20260709 13:13:20.656812 25874 consensus_peers.cc:597] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:20.675554 25345 consensus_peers.cc:597] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:20.758113 25345 consensus_peers.cc:597] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:20.788655 25345 consensus_peers.cc:597] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:20.805776 25874 consensus_peers.cc:597] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:20.844635 25271 consensus_peers.cc:597] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:20.862689 25874 consensus_peers.cc:597] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:20.880355 25271 consensus_peers.cc:597] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:20.910745 25271 consensus_peers.cc:597] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:20.924124 25874 consensus_peers.cc:597] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:20.940841 25271 consensus_peers.cc:597] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:20.969425 25874 consensus_peers.cc:597] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:21.002910 25874 consensus_peers.cc:597] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:21.028054 25345 consensus_peers.cc:597] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:21.035825 24113 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 25251)
W20260709 13:13:21.067993 25271 consensus_peers.cc:597] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:21.069100 25345 consensus_peers.cc:597] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:21.132081 25874 consensus_peers.cc:597] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:21.135753 25271 consensus_peers.cc:597] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:21.179358 25271 consensus_peers.cc:597] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:21.285477 25345 consensus_peers.cc:597] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:21.334637 25271 consensus_peers.cc:597] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:21.338994 25271 consensus_peers.cc:597] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:21.394939 25874 consensus_peers.cc:597] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:21.399014 25874 consensus_peers.cc:597] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:21.422313 25271 consensus_peers.cc:597] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:21.489060 25271 consensus_peers.cc:597] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:21.510373 25345 consensus_peers.cc:597] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:21.573608 25271 consensus_peers.cc:597] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:21.612908 25874 consensus_peers.cc:597] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:21.677942 25345 consensus_peers.cc:597] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:21.701640 25271 consensus_peers.cc:597] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:21.735178 25345 consensus_peers.cc:597] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:21.762280 25345 consensus_peers.cc:597] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:21.782655 25271 consensus_peers.cc:597] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:21.810983 25345 consensus_peers.cc:597] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:21.822706 25874 consensus_peers.cc:597] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:22.009775 25345 consensus_peers.cc:597] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:22.017386 25874 consensus_peers.cc:597] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:22.037262 24113 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 25251)
W20260709 13:13:22.125430 25345 consensus_peers.cc:597] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:22.152323 25874 consensus_peers.cc:597] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:22.155582 25345 consensus_peers.cc:597] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:22.183902 25345 consensus_peers.cc:597] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:22.218992 25345 consensus_peers.cc:597] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:22.282876 25345 consensus_peers.cc:597] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:22.374138 25343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:33127, user_credentials={real_user=slave}} blocked reactor thread for 44782.6us
W20260709 13:13:22.392688 25345 consensus_peers.cc:597] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:22.393374 25345 consensus_peers.cc:597] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:22.543300 25271 consensus_peers.cc:597] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:22.606895 25271 consensus_peers.cc:597] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:22.821177 25345 consensus_peers.cc:597] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:23.033942 25874 consensus_peers.cc:597] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:23.039409 24113 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 25251)
W20260709 13:13:23.067864 25271 consensus_peers.cc:597] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:23.105513 25874 consensus_peers.cc:597] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:23.119016 25345 consensus_peers.cc:597] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:23.152823 25345 consensus_peers.cc:597] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:23.222831 25874 consensus_peers.cc:597] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:23.242966 25271 consensus_peers.cc:597] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:23.246583 25874 consensus_peers.cc:597] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:23.261018 25271 consensus_peers.cc:597] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:23.339103 25271 consensus_peers.cc:597] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:23.367744 25874 consensus_peers.cc:597] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:23.395923 25874 consensus_peers.cc:597] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:23.395519 25345 consensus_peers.cc:597] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:23.444631 25345 consensus_peers.cc:597] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:23.452772 25345 consensus_peers.cc:597] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:23.475951 25874 consensus_peers.cc:597] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:23.514158 25271 consensus_peers.cc:597] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:23.517448 25271 consensus_peers.cc:597] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:23.587002 25271 consensus_peers.cc:597] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:23.631791 25271 consensus_peers.cc:597] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:23.652158 25271 consensus_peers.cc:597] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:23.734584 25271 consensus_peers.cc:597] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:23.763381 25874 consensus_peers.cc:597] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:23.822839 25271 consensus_peers.cc:597] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:23.863057 25874 consensus_peers.cc:597] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:23.893702 25345 consensus_peers.cc:597] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:23.977927 25271 consensus_peers.cc:597] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:24.016863 25345 consensus_peers.cc:597] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:24.086634 25271 consensus_peers.cc:597] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:24.132910 25874 consensus_peers.cc:597] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:24.157379 25874 consensus_peers.cc:597] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:13:24.191329 25902 consensus_queue.cc:237] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:13:24.205920 25373 raft_consensus.cc:1275] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Refusing update from remote peer 6c4b021f3f9e41adb75e870a08ad88b6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:13:24.207347 31312 consensus_queue.cc:1048] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:13:24.218668 25874 consensus_peers.cc:597] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:24.230789 25874 consensus_peers.cc:597] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:24.240145 25345 consensus_peers.cc:597] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:13:24.260479 31312 raft_consensus.cc:2955] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 LEADER]: Committing config change with OpId 10.8: config changed from index 4 to 8, VOTER da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
I20260709 13:13:24.269558 25373 raft_consensus.cc:2955] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 4 to 8, VOTER da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } } }
W20260709 13:13:24.286348 25345 consensus_peers.cc:597] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:13:24.332667 25114 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d56909a48cf841eb99365741e9e29e93 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 14)
I20260709 13:13:24.348419 25124 catalog_manager.cc:5697] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 reported cstate change: config changed from index 4 to 8, VOTER da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66) evicted. New cstate: current_term: 10 leader_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:13:24.385556 25345 consensus_peers.cc:597] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:24.402649 25271 consensus_peers.cc:597] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:24.412361 25345 consensus_peers.cc:597] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:24.515142 25345 consensus_peers.cc:597] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:13:24.524679 25294 tablet_service.cc:1558] Processing DeleteTablet for tablet d56909a48cf841eb99365741e9e29e93 with delete_type TABLET_DATA_TOMBSTONED (TS da445ce82dc4467f95f4fa52297eaa19 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:60574
I20260709 13:13:24.528963 31329 tablet_replica.cc:333] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19: stopping tablet replica
I20260709 13:13:24.530185 31329 raft_consensus.cc:2243] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:24.531200 31329 raft_consensus.cc:2272] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.534049 31329 ts_tablet_manager.cc:1916] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:13:24.552232 25345 consensus_peers.cc:597] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:24.562789 25345 consensus_peers.cc:597] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:24.564929 25345 consensus_peers.cc:597] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:13:24.564741 31329 ts_tablet_manager.cc:1929] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 10.7
I20260709 13:13:24.567181 31329 log.cc:1199] T d56909a48cf841eb99365741e9e29e93 P da445ce82dc4467f95f4fa52297eaa19: Deleting WAL directory at /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602598684750-24113-0/minicluster-data/ts-1-root/wals/d56909a48cf841eb99365741e9e29e93
W20260709 13:13:24.572197 25345 consensus_peers.cc:597] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:13:24.573920 25113 catalog_manager.cc:5028] TS da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): tablet d56909a48cf841eb99365741e9e29e93 (table test-workload [id=69ca5a4c7f3b417fb4b42c24baec3811]) successfully deleted
W20260709 13:13:24.618703 25345 consensus_peers.cc:597] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:24.652837 25874 consensus_peers.cc:597] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:24.668511 25874 consensus_peers.cc:597] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:13:24.687137 24113 tablet_server.cc:196] TabletServer@127.23.140.65:0 shutdown complete.
W20260709 13:13:24.732663 25345 consensus_peers.cc:597] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:13:24.975939 24113 tablet_server.cc:179] TabletServer@127.23.140.66:0 shutting down...
W20260709 13:13:24.991891 25271 consensus_peers.cc:597] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:24.994045 25343 consensus_peers.cc:597] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 -> Peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Couldn't send request to peer da445ce82dc4467f95f4fa52297eaa19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:25.022682 25343 consensus_peers.cc:597] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 -> Peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Couldn't send request to peer da445ce82dc4467f95f4fa52297eaa19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:25.042502 25872 consensus_peers.cc:597] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Couldn't send request to peer da445ce82dc4467f95f4fa52297eaa19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:25.045120 25343 consensus_peers.cc:597] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 -> Peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Couldn't send request to peer da445ce82dc4467f95f4fa52297eaa19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:25.055112 25872 consensus_peers.cc:597] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Couldn't send request to peer da445ce82dc4467f95f4fa52297eaa19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:25.061700 25345 consensus_peers.cc:597] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:25.062639 25271 consensus_peers.cc:597] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:25.066053 25872 consensus_peers.cc:597] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Couldn't send request to peer da445ce82dc4467f95f4fa52297eaa19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:25.073617 25343 consensus_peers.cc:597] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 -> Peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Couldn't send request to peer da445ce82dc4467f95f4fa52297eaa19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:25.087024 25343 consensus_peers.cc:597] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 -> Peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Couldn't send request to peer da445ce82dc4467f95f4fa52297eaa19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:25.090325 25343 consensus_peers.cc:597] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 -> Peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Couldn't send request to peer da445ce82dc4467f95f4fa52297eaa19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:25.101297 24113 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:13:25.101913 25343 consensus_peers.cc:597] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 -> Peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Couldn't send request to peer da445ce82dc4467f95f4fa52297eaa19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:25.103489 24113 tablet_replica.cc:333] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19: stopping tablet replica
I20260709 13:13:25.104924 24113 raft_consensus.cc:2243] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:13:25.106739 24113 raft_consensus.cc:2272] T ec256e9cce1249a995955c75b0c977cc P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:25.107858 25343 consensus_peers.cc:597] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 -> Peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Couldn't send request to peer da445ce82dc4467f95f4fa52297eaa19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:25.109844 24113 tablet_replica.cc:333] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19: stopping tablet replica
I20260709 13:13:25.110924 24113 raft_consensus.cc:2243] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:13:25.112084 24113 raft_consensus.cc:2272] T 60f74f1604ed4390892e271c77fd0f07 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.115579 24113 tablet_replica.cc:333] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19: stopping tablet replica
I20260709 13:13:25.116729 24113 raft_consensus.cc:2243] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.117666 24113 raft_consensus.cc:2272] T 0adcdb50fe9647b0abfa936e9cb73727 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:25.117674 25872 consensus_peers.cc:597] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Couldn't send request to peer da445ce82dc4467f95f4fa52297eaa19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:25.120888 24113 tablet_replica.cc:333] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19: stopping tablet replica
I20260709 13:13:25.121984 24113 raft_consensus.cc:2243] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:13:25.124197 24113 raft_consensus.cc:2272] T 7e85321bc6774ed28bf79ebfd5eae6e0 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.127554 24113 tablet_replica.cc:333] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19: stopping tablet replica
I20260709 13:13:25.128396 24113 raft_consensus.cc:2243] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.130045 24113 raft_consensus.cc:2272] T 0bcff15b40224dcaa2c76d2c4fd3b27b P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.132884 24113 tablet_replica.cc:333] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19: stopping tablet replica
I20260709 13:13:25.133795 24113 raft_consensus.cc:2243] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.134907 24113 raft_consensus.cc:2272] T ea5abc7f78c6412885cf5a12e2a9ee6c P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.138209 24113 tablet_replica.cc:333] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19: stopping tablet replica
I20260709 13:13:25.139266 24113 raft_consensus.cc:2243] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 19 LEADER]: Raft consensus shutting down.
W20260709 13:13:25.140051 25343 consensus_peers.cc:597] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 -> Peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Couldn't send request to peer da445ce82dc4467f95f4fa52297eaa19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:25.143390 24113 raft_consensus.cc:2272] T 135bcb58ad5b4506a12d94ef2b0d824c P da445ce82dc4467f95f4fa52297eaa19 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:25.143937 25343 consensus_peers.cc:597] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 -> Peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Couldn't send request to peer da445ce82dc4467f95f4fa52297eaa19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:25.148204 24113 tablet_replica.cc:333] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19: stopping tablet replica
I20260709 13:13:25.149204 24113 raft_consensus.cc:2243] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.150068 24113 raft_consensus.cc:2272] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:25.151168 25872 consensus_peers.cc:597] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Couldn't send request to peer da445ce82dc4467f95f4fa52297eaa19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:25.154278 24113 tablet_replica.cc:333] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19: stopping tablet replica
W20260709 13:13:25.154178 25343 consensus_peers.cc:597] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 -> Peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Couldn't send request to peer da445ce82dc4467f95f4fa52297eaa19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:25.155675 24113 raft_consensus.cc:2243] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.156618 24113 raft_consensus.cc:2272] T 92f679df8187472794ba8595642f63f9 P da445ce82dc4467f95f4fa52297eaa19 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.159829 24113 tablet_replica.cc:333] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19: stopping tablet replica
I20260709 13:13:25.160499 24113 raft_consensus.cc:2243] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.161142 24113 raft_consensus.cc:2272] T 87fad5b7d561432b9e669ef42e8b145b P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.165740 24113 tablet_replica.cc:333] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19: stopping tablet replica
I20260709 13:13:25.166726 24113 raft_consensus.cc:2243] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:13:25.168669 24113 raft_consensus.cc:2272] T c279dfc4b0d248a4a884e78a33fd437c P da445ce82dc4467f95f4fa52297eaa19 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.171840 24113 tablet_replica.cc:333] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19: stopping tablet replica
I20260709 13:13:25.172878 24113 raft_consensus.cc:2243] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.173534 24113 raft_consensus.cc:2272] T 08c29bb25d6947ddaa43c22713738514 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.176652 24113 tablet_replica.cc:333] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19: stopping tablet replica
I20260709 13:13:25.178879 24113 raft_consensus.cc:2243] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.179807 24113 raft_consensus.cc:2272] T 7ef45c031fc345b2917194ea453a14e3 P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.183931 24113 tablet_replica.cc:333] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19: stopping tablet replica
I20260709 13:13:25.184979 24113 raft_consensus.cc:2243] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.186240 24113 raft_consensus.cc:2272] T 4e23aac97b6742dab615f0d6e9087e8f P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.190696 24113 tablet_replica.cc:333] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19: stopping tablet replica
I20260709 13:13:25.191677 24113 raft_consensus.cc:2243] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:13:25.193141 24113 raft_consensus.cc:2272] T a5a4e5911cd2414daf6cc0bc2a692a69 P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.196486 24113 tablet_replica.cc:333] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19: stopping tablet replica
I20260709 13:13:25.197206 24113 raft_consensus.cc:2243] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:13:25.198393 24113 raft_consensus.cc:2272] T 57009a57e25248a39037d8922bf47bf2 P da445ce82dc4467f95f4fa52297eaa19 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.200388 24113 tablet_replica.cc:333] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19: stopping tablet replica
I20260709 13:13:25.201009 24113 raft_consensus.cc:2243] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.201611 24113 raft_consensus.cc:2272] T 3e6da6f96d4a4409be6b8e2b09c861c4 P da445ce82dc4467f95f4fa52297eaa19 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.203859 24113 tablet_replica.cc:333] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19: stopping tablet replica
I20260709 13:13:25.204430 24113 raft_consensus.cc:2243] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:13:25.205803 24113 raft_consensus.cc:2272] T 0945649a5d1348c6b17e9dd0b67766c9 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.208055 24113 tablet_replica.cc:333] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19: stopping tablet replica
I20260709 13:13:25.209061 24113 raft_consensus.cc:2243] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.210019 24113 raft_consensus.cc:2272] T 87095494ab7d40b7a42f4b05732acbf5 P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.212325 24113 tablet_replica.cc:333] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19: stopping tablet replica
I20260709 13:13:25.212927 24113 raft_consensus.cc:2243] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.213500 24113 raft_consensus.cc:2272] T 7fd182e135fd4b4db8700ed3173fd000 P da445ce82dc4467f95f4fa52297eaa19 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.216240 24113 tablet_replica.cc:333] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19: stopping tablet replica
I20260709 13:13:25.217094 24113 raft_consensus.cc:2243] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.218226 24113 raft_consensus.cc:2272] T 477bcdc75e8c43318d410716549fefd7 P da445ce82dc4467f95f4fa52297eaa19 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.221226 24113 tablet_replica.cc:333] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19: stopping tablet replica
I20260709 13:13:25.222071 24113 raft_consensus.cc:2243] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:13:25.223778 24113 raft_consensus.cc:2272] T d7fb167d72a441418dc3c55148746e87 P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.226840 24113 tablet_replica.cc:333] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19: stopping tablet replica
I20260709 13:13:25.227430 24113 raft_consensus.cc:2243] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.228137 24113 raft_consensus.cc:2272] T ca662cfcc5084384a1da94266546eabc P da445ce82dc4467f95f4fa52297eaa19 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.230132 24113 tablet_replica.cc:333] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19: stopping tablet replica
I20260709 13:13:25.230742 24113 raft_consensus.cc:2243] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.231552 24113 raft_consensus.cc:2272] T e7b1f3db9d83491b8ef3a82b77afbae2 P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.233732 24113 tablet_replica.cc:333] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19: stopping tablet replica
I20260709 13:13:25.234310 24113 raft_consensus.cc:2243] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.234905 24113 raft_consensus.cc:2272] T 682caa57052f4e698c0ad75fb393ae75 P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.237010 24113 tablet_replica.cc:333] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19: stopping tablet replica
I20260709 13:13:25.237666 24113 raft_consensus.cc:2243] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.238638 24113 raft_consensus.cc:2272] T 275226661cc840559134f8c9e5b15719 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.241540 24113 tablet_replica.cc:333] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19: stopping tablet replica
I20260709 13:13:25.242153 24113 raft_consensus.cc:2243] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.242861 24113 raft_consensus.cc:2272] T af9115771e334c95a7dec25c698514dc P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.245114 24113 tablet_replica.cc:333] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19: stopping tablet replica
I20260709 13:13:25.245801 24113 raft_consensus.cc:2243] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.246364 24113 raft_consensus.cc:2272] T f78697097cd14345b6a749c7aad4f696 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.249241 24113 tablet_replica.cc:333] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19: stopping tablet replica
I20260709 13:13:25.250099 24113 raft_consensus.cc:2243] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:13:25.251452 24113 raft_consensus.cc:2272] T 9b49f61c49ae486392588c88e34a32d0 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.254622 24113 tablet_replica.cc:333] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19: stopping tablet replica
I20260709 13:13:25.255471 24113 raft_consensus.cc:2243] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:13:25.257189 24113 raft_consensus.cc:2272] T c8f924da5ba24241866fed885eb63eff P da445ce82dc4467f95f4fa52297eaa19 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.259794 24113 tablet_replica.cc:333] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19: stopping tablet replica
W20260709 13:13:25.260211 25872 consensus_peers.cc:597] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Couldn't send request to peer da445ce82dc4467f95f4fa52297eaa19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:25.260556 24113 raft_consensus.cc:2243] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:13:25.262558 24113 raft_consensus.cc:2272] T 8d0f43a786a846b49924a589e4a36f2f P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.265267 24113 tablet_replica.cc:333] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19: stopping tablet replica
W20260709 13:13:25.265492 25872 consensus_peers.cc:597] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Couldn't send request to peer da445ce82dc4467f95f4fa52297eaa19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:25.266093 24113 raft_consensus.cc:2243] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:13:25.267799 24113 raft_consensus.cc:2272] T f5c9116c92454e2ab270a148a8c5c4ea P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.270751 24113 tablet_replica.cc:333] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19: stopping tablet replica
I20260709 13:13:25.271302 24113 raft_consensus.cc:2243] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.272090 24113 raft_consensus.cc:2272] T cc7fda8ece3144099df1f442c8012dfd P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.274855 24113 tablet_replica.cc:333] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19: stopping tablet replica
I20260709 13:13:25.275631 24113 raft_consensus.cc:2243] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.276275 24113 raft_consensus.cc:2272] T 5e0cf1df707d42a3834bac46dc045119 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.278898 24113 tablet_replica.cc:333] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19: stopping tablet replica
I20260709 13:13:25.279480 24113 raft_consensus.cc:2243] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.280223 24113 raft_consensus.cc:2272] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.282806 24113 tablet_replica.cc:333] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19: stopping tablet replica
I20260709 13:13:25.283468 24113 raft_consensus.cc:2243] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.284006 24113 raft_consensus.cc:2272] T 80b4c44a28264d36a06c367b324ac4b4 P da445ce82dc4467f95f4fa52297eaa19 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.286767 24113 tablet_replica.cc:333] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19: stopping tablet replica
I20260709 13:13:25.287437 24113 raft_consensus.cc:2243] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.288149 24113 raft_consensus.cc:2272] T f616a884a8284b1f8fd7c51549e8a211 P da445ce82dc4467f95f4fa52297eaa19 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.290928 24113 tablet_replica.cc:333] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19: stopping tablet replica
I20260709 13:13:25.291644 24113 raft_consensus.cc:2243] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.292444 24113 raft_consensus.cc:2272] T 56a9fdb76a7d494e81629b861acc1489 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.294420 24113 tablet_replica.cc:333] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19: stopping tablet replica
I20260709 13:13:25.294958 24113 raft_consensus.cc:2243] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:13:25.296329 24113 raft_consensus.cc:2272] T ad01a612dc964dd3ae0b3f179ac0ad9e P da445ce82dc4467f95f4fa52297eaa19 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.298870 24113 tablet_replica.cc:333] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19: stopping tablet replica
I20260709 13:13:25.299419 24113 raft_consensus.cc:2243] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.300050 24113 raft_consensus.cc:2272] T c6d3131e75284c0eb555c937d1c619cb P da445ce82dc4467f95f4fa52297eaa19 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.302488 24113 tablet_replica.cc:333] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19: stopping tablet replica
I20260709 13:13:25.303258 24113 raft_consensus.cc:2243] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.304256 24113 raft_consensus.cc:2272] T 52a83f35ff124418bd9c19dca631e017 P da445ce82dc4467f95f4fa52297eaa19 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:25.304664 25872 consensus_peers.cc:597] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Couldn't send request to peer da445ce82dc4467f95f4fa52297eaa19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:25.307318 24113 tablet_replica.cc:333] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19: stopping tablet replica
I20260709 13:13:25.308233 24113 raft_consensus.cc:2243] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.308986 24113 raft_consensus.cc:2272] T ff04ee47fb3f40b2b2354a8d4f665483 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.312122 24113 tablet_replica.cc:333] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19: stopping tablet replica
I20260709 13:13:25.312970 24113 raft_consensus.cc:2243] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:13:25.314265 24113 raft_consensus.cc:2272] T 0cf595e68eca43728a4957ce8c8f5b69 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.317358 24113 tablet_replica.cc:333] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19: stopping tablet replica
W20260709 13:13:25.318001 25345 consensus_peers.cc:597] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:13:25.318090 24113 raft_consensus.cc:2243] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:13:25.320289 24113 raft_consensus.cc:2272] T cf070d83a5904025bb0d390a39ebae05 P da445ce82dc4467f95f4fa52297eaa19 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.323318 24113 tablet_replica.cc:333] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19: stopping tablet replica
I20260709 13:13:25.324106 24113 raft_consensus.cc:2243] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.324847 24113 raft_consensus.cc:2272] T 35ae6d72e4154149b3d1721e2214570a P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.328053 24113 tablet_replica.cc:333] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19: stopping tablet replica
I20260709 13:13:25.328845 24113 raft_consensus.cc:2243] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.329603 24113 raft_consensus.cc:2272] T e74320a7302d4cd8b705dce5d385079a P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.332355 24113 tablet_replica.cc:333] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19: stopping tablet replica
I20260709 13:13:25.333007 24113 raft_consensus.cc:2243] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.333786 24113 raft_consensus.cc:2272] T 51ecc4484385405c857b3bee1077c36a P da445ce82dc4467f95f4fa52297eaa19 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.336557 24113 tablet_replica.cc:333] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19: stopping tablet replica
I20260709 13:13:25.337186 24113 raft_consensus.cc:2243] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.338007 24113 raft_consensus.cc:2272] T e8da265131524ca9bbf94bd69438fc22 P da445ce82dc4467f95f4fa52297eaa19 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.340739 24113 tablet_replica.cc:333] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19: stopping tablet replica
I20260709 13:13:25.341316 24113 raft_consensus.cc:2243] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:13:25.342535 24113 raft_consensus.cc:2272] T 25e0218933774b319104f23505937179 P da445ce82dc4467f95f4fa52297eaa19 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:25.352001 25343 consensus_peers.cc:597] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 -> Peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Couldn't send request to peer da445ce82dc4467f95f4fa52297eaa19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:25.355325 25343 consensus_peers.cc:597] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 -> Peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Couldn't send request to peer da445ce82dc4467f95f4fa52297eaa19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:25.373023 25872 consensus_peers.cc:597] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Couldn't send request to peer da445ce82dc4467f95f4fa52297eaa19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:25.381052 25343 consensus_peers.cc:597] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 -> Peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Couldn't send request to peer da445ce82dc4467f95f4fa52297eaa19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:25.383832 25343 consensus_peers.cc:597] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 -> Peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Couldn't send request to peer da445ce82dc4467f95f4fa52297eaa19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:25.386368 25343 consensus_peers.cc:597] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 -> Peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Couldn't send request to peer da445ce82dc4467f95f4fa52297eaa19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:25.391788 25343 consensus_peers.cc:597] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 -> Peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Couldn't send request to peer da445ce82dc4467f95f4fa52297eaa19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:25.402045 25872 consensus_peers.cc:597] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Couldn't send request to peer da445ce82dc4467f95f4fa52297eaa19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:25.404265 25343 consensus_peers.cc:597] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 -> Peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Couldn't send request to peer da445ce82dc4467f95f4fa52297eaa19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:25.414448 25343 consensus_peers.cc:597] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 -> Peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Couldn't send request to peer da445ce82dc4467f95f4fa52297eaa19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:25.439738 25343 consensus_peers.cc:597] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 -> Peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Couldn't send request to peer da445ce82dc4467f95f4fa52297eaa19. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.66:33127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:25.448453 25343 consensus_peers.cc:597] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 -> Peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Couldn't send request to peer da445ce82dc4467f95f4fa52297eaa19. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.66:33127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:25.501773 25345 consensus_peers.cc:597] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:25.509645 25874 consensus_peers.cc:597] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:25.558310 25343 consensus_peers.cc:597] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 -> Peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Couldn't send request to peer da445ce82dc4467f95f4fa52297eaa19. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.66:33127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:25.559955 25874 consensus_peers.cc:597] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:25.599120 25343 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.140.66:33127: connect: Connection refused (error 111) [suppressed 544 similar messages]
W20260709 13:13:25.599450 25345 consensus_peers.cc:597] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:25.605446 25175 auto_rebalancer.cc:629] Failed to schedule move for tablet ec256e9cce1249a995955c75b0c977cc: Network error: Client connection negotiation failed: client connection to 127.23.140.66:33127: connect: Connection refused (error 111)
I20260709 13:13:25.635283 25373 consensus_queue.cc:237] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } }
W20260709 13:13:25.644251 25344 consensus_peers.cc:597] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 -> Peer 6c4b021f3f9e41adb75e870a08ad88b6 (127.23.140.68:34085): Couldn't send request to peer 6c4b021f3f9e41adb75e870a08ad88b6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e7b1f3db9d83491b8ef3a82b77afbae2. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:25.644732 25343 consensus_peers.cc:597] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 -> Peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Couldn't send request to peer da445ce82dc4467f95f4fa52297eaa19. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.66:33127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:25.646404 25345 consensus_peers.cc:597] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:25.724913 25345 consensus_peers.cc:597] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:25.855101 25874 consensus_peers.cc:597] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:13:25.912714 24113 tablet_server.cc:196] TabletServer@127.23.140.66:0 shutdown complete.
W20260709 13:13:25.977142 25874 consensus_peers.cc:597] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:26.009313 25874 consensus_peers.cc:597] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:13:26.025915 24113 tablet_server.cc:179] TabletServer@127.23.140.67:0 shutting down...
W20260709 13:13:26.054538 25345 consensus_peers.cc:597] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:26.057294 25873 consensus_peers.cc:597] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Couldn't send request to peer 79d99c0e498349bda74127365219e468. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:26.068590 31341 ts_tablet_manager.cc:933] T e7b1f3db9d83491b8ef3a82b77afbae2 P 6c4b021f3f9e41adb75e870a08ad88b6: Initiating tablet copy from peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:13:26.079020 25873 consensus_peers.cc:597] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Couldn't send request to peer 79d99c0e498349bda74127365219e468. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:26.084179 25874 consensus_peers.cc:597] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:13:26.095625 31341 tablet_copy_client.cc:323] T e7b1f3db9d83491b8ef3a82b77afbae2 P 6c4b021f3f9e41adb75e870a08ad88b6: tablet copy: Beginning tablet copy session from remote peer at address 127.23.140.67:34091
I20260709 13:13:26.100665 24113 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:26.102682 24113 tablet_replica.cc:333] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468: stopping tablet replica
I20260709 13:13:26.103669 24113 raft_consensus.cc:2243] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:26.104292 24113 raft_consensus.cc:2272] T ec256e9cce1249a995955c75b0c977cc P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:26.108199 24113 tablet_replica.cc:333] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468: stopping tablet replica
W20260709 13:13:26.108244 25873 consensus_peers.cc:597] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Couldn't send request to peer 79d99c0e498349bda74127365219e468. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:26.109162 24113 raft_consensus.cc:2243] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 15 LEADER]: Raft consensus shutting down.
W20260709 13:13:26.109469 25345 consensus_peers.cc:597] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:13:26.110275 24113 raft_consensus.cc:2272] T 0adcdb50fe9647b0abfa936e9cb73727 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:26.111691 25873 consensus_peers.cc:597] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Couldn't send request to peer 79d99c0e498349bda74127365219e468. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:26.112972 24113 tablet_replica.cc:333] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468: stopping tablet replica
I20260709 13:13:26.113947 24113 raft_consensus.cc:2243] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:26.114487 24113 raft_consensus.cc:2272] T 67fb9a2520c542d38f72828988ddc804 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:26.116832 24113 tablet_replica.cc:333] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468: stopping tablet replica
I20260709 13:13:26.117633 24113 raft_consensus.cc:2243] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:26.118232 24113 raft_consensus.cc:2272] T 60f74f1604ed4390892e271c77fd0f07 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:26.120996 24113 tablet_replica.cc:333] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468: stopping tablet replica
I20260709 13:13:26.121843 24113 raft_consensus.cc:2243] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:26.122467 24113 raft_consensus.cc:2272] T a1eeb9f9696c44b9b744d926cf3312ff P 79d99c0e498349bda74127365219e468 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:26.125094 24113 tablet_replica.cc:333] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468: stopping tablet replica
I20260709 13:13:26.125857 24113 raft_consensus.cc:2243] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:13:26.126900 24113 raft_consensus.cc:2272] T 6e2ea64fbf1c4f6db8eda01c8d9ac433 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:26.128672 24113 tablet_replica.cc:333] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468: stopping tablet replica
I20260709 13:13:26.129235 24113 raft_consensus.cc:2243] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:26.129913 24113 raft_consensus.cc:2272] T d56909a48cf841eb99365741e9e29e93 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:26.131688 24113 tablet_replica.cc:333] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468: stopping tablet replica
I20260709 13:13:26.132248 24113 raft_consensus.cc:2243] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:13:26.133194 24113 raft_consensus.cc:2272] T 7ef45c031fc345b2917194ea453a14e3 P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:26.136368 24113 tablet_replica.cc:333] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468: stopping tablet replica
I20260709 13:13:26.137156 24113 raft_consensus.cc:2243] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:13:26.138494 24113 raft_consensus.cc:2272] T 275226661cc840559134f8c9e5b15719 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:26.140702 24113 tablet_replica.cc:333] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468: stopping tablet replica
I20260709 13:13:26.141436 24113 raft_consensus.cc:2243] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:26.142125 24113 raft_consensus.cc:2272] T 88997763405742ee8b8e6b43d7392c1f P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:26.144771 24113 tablet_replica.cc:333] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468: stopping tablet replica
I20260709 13:13:26.145550 24113 raft_consensus.cc:2243] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:26.146432 24113 raft_consensus.cc:2272] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:26.148175 24113 tablet_replica.cc:333] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468: stopping tablet replica
I20260709 13:13:26.148787 24113 raft_consensus.cc:2243] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:26.149449 24113 raft_consensus.cc:2272] T 0945649a5d1348c6b17e9dd0b67766c9 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:26.151690 24113 tablet_replica.cc:333] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468: stopping tablet replica
I20260709 13:13:26.152294 24113 raft_consensus.cc:2243] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:26.152942 24113 raft_consensus.cc:2272] T a5a4e5911cd2414daf6cc0bc2a692a69 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:26.154764 24113 tablet_replica.cc:333] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468: stopping tablet replica
I20260709 13:13:26.155292 24113 raft_consensus.cc:2243] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:13:26.156337 24113 raft_consensus.cc:2272] T 4e23aac97b6742dab615f0d6e9087e8f P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:26.158561 24113 tablet_replica.cc:333] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468: stopping tablet replica
I20260709 13:13:26.159364 24113 raft_consensus.cc:2243] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:26.160006 24113 raft_consensus.cc:2272] T 57009a57e25248a39037d8922bf47bf2 P 79d99c0e498349bda74127365219e468 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:26.162554 24113 tablet_replica.cc:333] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468: stopping tablet replica
I20260709 13:13:26.163349 24113 raft_consensus.cc:2243] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:13:26.164547 24113 raft_consensus.cc:2272] T 3e6da6f96d4a4409be6b8e2b09c861c4 P 79d99c0e498349bda74127365219e468 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:26.165841 25345 consensus_peers.cc:597] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:13:26.166993 24113 tablet_replica.cc:333] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468: stopping tablet replica
I20260709 13:13:26.167536 24113 raft_consensus.cc:2243] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:13:26.168241 24113 pending_rounds.cc:70] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468: Trying to abort 1 pending ops.
I20260709 13:13:26.168406 24113 pending_rounds.cc:77] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468: Aborting op as it isn't in flight: id { term: 16 index: 13 } timestamp: 7305637091878227968 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "e7b1f3db9d83491b8ef3a82b77afbae2" old_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } } new_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: NON_VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: true } } } }
I20260709 13:13:26.169632 24113 raft_consensus.cc:2917] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 16 LEADER]: Aborting config change with OpId 16.13: Aborted: Op aborted
I20260709 13:13:26.170027 24113 raft_consensus.cc:2889] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 16 LEADER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:13:26.170876 24113 raft_consensus.cc:2272] T e7b1f3db9d83491b8ef3a82b77afbae2 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:26.171937 25175 auto_rebalancer.cc:629] Failed to schedule move for tablet e7b1f3db9d83491b8ef3a82b77afbae2: Aborted: Op aborted
W20260709 13:13:26.172950 25873 consensus_peers.cc:597] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Couldn't send request to peer 79d99c0e498349bda74127365219e468. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:26.173370 24113 tablet_replica.cc:333] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468: stopping tablet replica
I20260709 13:13:26.173835 31294 raft_consensus.cc:493] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:13:26.174225 24113 raft_consensus.cc:2243] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:13:26.174264 31294 raft_consensus.cc:515] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:13:26.175436 24113 raft_consensus.cc:2272] T 682caa57052f4e698c0ad75fb393ae75 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:26.176717 25175 auto_rebalancer.cc:629] Failed to schedule move for tablet a5a4e5911cd2414daf6cc0bc2a692a69: Network error: Client connection negotiation failed: client connection to 127.23.140.66:33127: connect: Connection refused (error 111)
I20260709 13:13:26.178165 24113 tablet_replica.cc:333] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468: stopping tablet replica
I20260709 13:13:26.179026 24113 raft_consensus.cc:2243] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:13:26.178177 31294 leader_election.cc:290] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:13:26.179786 25874 leader_election.cc:336] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111)
I20260709 13:13:26.180089 24113 raft_consensus.cc:2272] T 477bcdc75e8c43318d410716549fefd7 P 79d99c0e498349bda74127365219e468 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:26.180507 25175 auto_rebalancer.cc:629] Failed to schedule move for tablet 9b49f61c49ae486392588c88e34a32d0: Network error: Client connection negotiation failed: client connection to 127.23.140.66:33127: connect: Connection refused (error 111)
I20260709 13:13:26.182618 24113 tablet_replica.cc:333] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468: stopping tablet replica
I20260709 13:13:26.183243 24113 raft_consensus.cc:2243] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Raft consensus shutting down.
W20260709 13:13:26.183503 25872 leader_election.cc:336] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Network error: Client connection negotiation failed: client connection to 127.23.140.66:33127: connect: Connection refused (error 111)
I20260709 13:13:26.183915 25872 leader_election.cc:304] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:13:26.183970 24113 raft_consensus.cc:2272] T d7fb167d72a441418dc3c55148746e87 P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:26.184536 31294 raft_consensus.cc:2749] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:26.186275 24113 tablet_replica.cc:333] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468: stopping tablet replica
I20260709 13:13:26.186870 24113 raft_consensus.cc:2243] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:13:26.187654 24113 raft_consensus.cc:2272] T ca662cfcc5084384a1da94266546eabc P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:26.189494 24113 tablet_replica.cc:333] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468: stopping tablet replica
I20260709 13:13:26.190126 24113 raft_consensus.cc:2243] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:26.190649 24113 raft_consensus.cc:2272] T 9b49f61c49ae486392588c88e34a32d0 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:26.192946 24113 tablet_replica.cc:333] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468: stopping tablet replica
I20260709 13:13:26.193598 24113 raft_consensus.cc:2243] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:26.194324 24113 raft_consensus.cc:2272] T c8f924da5ba24241866fed885eb63eff P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:26.195358 25873 consensus_peers.cc:597] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Couldn't send request to peer 79d99c0e498349bda74127365219e468. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:26.196467 24113 tablet_replica.cc:333] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468: stopping tablet replica
I20260709 13:13:26.197000 24113 raft_consensus.cc:2243] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:26.197410 24113 raft_consensus.cc:2272] T 8d0f43a786a846b49924a589e4a36f2f P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:26.199186 24113 tablet_replica.cc:333] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468: stopping tablet replica
I20260709 13:13:26.199695 24113 raft_consensus.cc:2243] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:26.200228 24113 raft_consensus.cc:2272] T 7fd182e135fd4b4db8700ed3173fd000 P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:26.201972 24113 tablet_replica.cc:333] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468: stopping tablet replica
I20260709 13:13:26.202478 24113 raft_consensus.cc:2243] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:13:26.203338 24113 raft_consensus.cc:2272] T 87095494ab7d40b7a42f4b05732acbf5 P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:26.205536 24113 tablet_replica.cc:333] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468: stopping tablet replica
I20260709 13:13:26.206277 24113 raft_consensus.cc:2243] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Raft consensus shutting down.
W20260709 13:13:26.207163 25873 consensus_peers.cc:597] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Couldn't send request to peer 79d99c0e498349bda74127365219e468. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:26.207290 24113 raft_consensus.cc:2272] T f78697097cd14345b6a749c7aad4f696 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:26.209373 24113 tablet_replica.cc:333] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468: stopping tablet replica
I20260709 13:13:26.209945 24113 raft_consensus.cc:2243] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:26.210494 24113 raft_consensus.cc:2272] T 11892dffe99a496ebf3d98773631357c P 79d99c0e498349bda74127365219e468 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:26.212420 24113 tablet_replica.cc:333] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468: stopping tablet replica
I20260709 13:13:26.212996 24113 raft_consensus.cc:2243] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:26.213562 24113 raft_consensus.cc:2272] T 0cf595e68eca43728a4957ce8c8f5b69 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:26.213826 25873 consensus_peers.cc:597] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Couldn't send request to peer 79d99c0e498349bda74127365219e468. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:26.215613 24113 tablet_replica.cc:333] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468: stopping tablet replica
I20260709 13:13:26.216369 24113 raft_consensus.cc:2243] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:26.217118 24113 raft_consensus.cc:2272] T ad01a612dc964dd3ae0b3f179ac0ad9e P 79d99c0e498349bda74127365219e468 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:26.218575 25873 consensus_peers.cc:597] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Couldn't send request to peer 79d99c0e498349bda74127365219e468. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:26.219601 24113 tablet_replica.cc:333] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468: stopping tablet replica
I20260709 13:13:26.220424 24113 raft_consensus.cc:2243] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:13:26.221549 24113 raft_consensus.cc:2272] T c6d3131e75284c0eb555c937d1c619cb P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:26.221643 25873 consensus_peers.cc:597] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Couldn't send request to peer 79d99c0e498349bda74127365219e468. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:26.223594 24113 tablet_replica.cc:333] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468: stopping tablet replica
I20260709 13:13:26.224179 24113 raft_consensus.cc:2243] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:26.224638 24113 raft_consensus.cc:2272] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 79d99c0e498349bda74127365219e468 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:26.226547 24113 tablet_replica.cc:333] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468: stopping tablet replica
I20260709 13:13:26.227104 24113 raft_consensus.cc:2243] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:26.227669 24113 raft_consensus.cc:2272] T f5c9116c92454e2ab270a148a8c5c4ea P 79d99c0e498349bda74127365219e468 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:26.229516 24113 tablet_replica.cc:333] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468: stopping tablet replica
I20260709 13:13:26.230118 24113 raft_consensus.cc:2243] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:26.230556 24113 raft_consensus.cc:2272] T cc7fda8ece3144099df1f442c8012dfd P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:26.232748 24113 tablet_replica.cc:333] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468: stopping tablet replica
I20260709 13:13:26.233264 24113 raft_consensus.cc:2243] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:26.233800 24113 raft_consensus.cc:2272] T 0eaedd90995b476890a2ea23d7089759 P 79d99c0e498349bda74127365219e468 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:26.235577 24113 tablet_replica.cc:333] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468: stopping tablet replica
I20260709 13:13:26.236085 24113 raft_consensus.cc:2243] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:13:26.236847 24113 raft_consensus.cc:2272] T 5e0cf1df707d42a3834bac46dc045119 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:26.238610 24113 tablet_replica.cc:333] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468: stopping tablet replica
I20260709 13:13:26.239099 24113 raft_consensus.cc:2243] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:13:26.239843 24113 raft_consensus.cc:2272] T e39a4f04fbfc4fb3a4b2057ad9cb8c88 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:26.241427 24113 tablet_replica.cc:333] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468: stopping tablet replica
I20260709 13:13:26.241972 24113 raft_consensus.cc:2243] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:13:26.242712 24113 raft_consensus.cc:2272] T 80b4c44a28264d36a06c367b324ac4b4 P 79d99c0e498349bda74127365219e468 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:26.244347 24113 tablet_replica.cc:333] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468: stopping tablet replica
I20260709 13:13:26.244865 24113 raft_consensus.cc:2243] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:13:26.245702 24113 raft_consensus.cc:2272] T f616a884a8284b1f8fd7c51549e8a211 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:26.247475 24113 tablet_replica.cc:333] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468: stopping tablet replica
I20260709 13:13:26.247959 24113 raft_consensus.cc:2243] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:26.248406 24113 raft_consensus.cc:2272] T 56a9fdb76a7d494e81629b861acc1489 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:26.249257 31294 raft_consensus.cc:493] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:13:26.249876 31294 raft_consensus.cc:515] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:13:26.250725 24113 tablet_replica.cc:333] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468: stopping tablet replica
I20260709 13:13:26.251297 24113 raft_consensus.cc:2243] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:26.251754 31294 leader_election.cc:290] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
I20260709 13:13:26.251817 24113 raft_consensus.cc:2272] T 47228487a74240e9bc9bcd2e1d966ed6 P 79d99c0e498349bda74127365219e468 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:26.254642 24113 tablet_replica.cc:333] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468: stopping tablet replica
I20260709 13:13:26.255175 24113 raft_consensus.cc:2243] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Raft consensus shutting down.
W20260709 13:13:26.255365 25874 leader_election.cc:336] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111)
I20260709 13:13:26.255615 24113 raft_consensus.cc:2272] T e74320a7302d4cd8b705dce5d385079a P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:26.256856 25872 leader_election.cc:336] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Network error: Client connection negotiation failed: client connection to 127.23.140.66:33127: connect: Connection refused (error 111)
I20260709 13:13:26.257256 25872 leader_election.cc:304] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:13:26.257864 31294 raft_consensus.cc:2749] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:13:26.258013 24113 tablet_replica.cc:333] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468: stopping tablet replica
I20260709 13:13:26.258782 24113 raft_consensus.cc:2243] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:13:26.259534 24113 raft_consensus.cc:2272] T 87fad5b7d561432b9e669ef42e8b145b P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:26.261272 24113 tablet_replica.cc:333] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468: stopping tablet replica
I20260709 13:13:26.261808 24113 raft_consensus.cc:2243] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:13:26.262604 24113 raft_consensus.cc:2272] T 92f679df8187472794ba8595642f63f9 P 79d99c0e498349bda74127365219e468 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:26.264186 24113 tablet_replica.cc:333] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468: stopping tablet replica
I20260709 13:13:26.264683 24113 raft_consensus.cc:2243] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:13:26.265450 24113 raft_consensus.cc:2272] T ff04ee47fb3f40b2b2354a8d4f665483 P 79d99c0e498349bda74127365219e468 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:26.267586 24113 tablet_replica.cc:333] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468: stopping tablet replica
I20260709 13:13:26.268210 24113 raft_consensus.cc:2243] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:13:26.269193 24113 raft_consensus.cc:2272] T 52a83f35ff124418bd9c19dca631e017 P 79d99c0e498349bda74127365219e468 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:26.271103 24113 tablet_replica.cc:333] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468: stopping tablet replica
I20260709 13:13:26.271674 24113 raft_consensus.cc:2243] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:13:26.272219 31294 raft_consensus.cc:493] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:13:26.272449 24113 raft_consensus.cc:2272] T ca881f8516e046c99da202e9d9ea00a1 P 79d99c0e498349bda74127365219e468 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:26.272792 31294 raft_consensus.cc:515] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } attrs { replace: true } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:13:26.274690 24113 tablet_replica.cc:333] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468: stopping tablet replica
I20260709 13:13:26.275424 24113 raft_consensus.cc:2243] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:13:26.276038 31294 leader_election.cc:290] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
I20260709 13:13:26.276444 24113 raft_consensus.cc:2272] T e8da265131524ca9bbf94bd69438fc22 P 79d99c0e498349bda74127365219e468 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:26.278950 24113 tablet_replica.cc:333] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468: stopping tablet replica
I20260709 13:13:26.279597 24113 raft_consensus.cc:2243] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 17 LEADER]: Raft consensus shutting down.
W20260709 13:13:26.279536 25872 leader_election.cc:336] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Network error: Client connection negotiation failed: client connection to 127.23.140.66:33127: connect: Connection refused (error 111)
W20260709 13:13:26.280354 25873 leader_election.cc:336] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:26.280857 24113 raft_consensus.cc:2272] T 35ae6d72e4154149b3d1721e2214570a P 79d99c0e498349bda74127365219e468 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:26.280782 25873 leader_election.cc:304] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
W20260709 13:13:26.281350 25874 leader_election.cc:336] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111)
I20260709 13:13:26.281646 31294 raft_consensus.cc:2749] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:26.283227 24113 tablet_replica.cc:333] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468: stopping tablet replica
I20260709 13:13:26.283728 24113 raft_consensus.cc:2243] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:26.284226 24113 raft_consensus.cc:2272] T cf070d83a5904025bb0d390a39ebae05 P 79d99c0e498349bda74127365219e468 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:26.295609 25873 consensus_peers.cc:597] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Couldn't send request to peer 79d99c0e498349bda74127365219e468. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:26.316087 31294 raft_consensus.cc:493] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:13:26.316648 31294 raft_consensus.cc:515] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:13:26.318781 31294 leader_election.cc:290] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:13:26.322619 25874 leader_election.cc:336] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111)
W20260709 13:13:26.323987 25872 leader_election.cc:336] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Network error: Client connection negotiation failed: client connection to 127.23.140.66:33127: connect: Connection refused (error 111)
I20260709 13:13:26.324375 25872 leader_election.cc:304] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:13:26.325022 31294 raft_consensus.cc:2749] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:13:26.326553 25873 consensus_peers.cc:597] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Couldn't send request to peer 79d99c0e498349bda74127365219e468. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:26.360991 25874 consensus_peers.cc:597] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:26.390123 25874 connection.cc:466] server connection from 127.0.0.1:50060 torn down before Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:50060 (request call id 1345) could send its response
W20260709 13:13:26.400090 25873 consensus_peers.cc:597] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Couldn't send request to peer 79d99c0e498349bda74127365219e468. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.67:34091: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:26.441586 25873 consensus_peers.cc:597] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Couldn't send request to peer 79d99c0e498349bda74127365219e468. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.67:34091: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:26.451041 31312 raft_consensus.cc:493] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:13:26.451557 31312 raft_consensus.cc:515] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:13:26.453390 31312 leader_election.cc:290] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:13:26.457409 25873 leader_election.cc:336] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Network error: Client connection negotiation failed: client connection to 127.23.140.67:34091: connect: Connection refused (error 111)
W20260709 13:13:26.457422 25874 consensus_peers.cc:597] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:26.458743 25872 leader_election.cc:336] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Network error: Client connection negotiation failed: client connection to 127.23.140.66:33127: connect: Connection refused (error 111)
I20260709 13:13:26.459151 25872 leader_election.cc:304] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 79d99c0e498349bda74127365219e468, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:13:26.459817 31312 raft_consensus.cc:2749] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:13:26.599967 25874 consensus_peers.cc:597] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:26.613109 25874 consensus_peers.cc:597] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:13:26.639880 31312 raft_consensus.cc:493] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:13:26.640460 31312 raft_consensus.cc:515] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } attrs { replace: true } } peers { permanent_uuid: "79d99c0e498349bda74127365219e468" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 34091 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:13:26.643292 31312 leader_election.cc:290] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127), 79d99c0e498349bda74127365219e468 (127.23.140.67:34091)
W20260709 13:13:26.647909 25874 leader_election.cc:336] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111)
W20260709 13:13:26.649290 25873 leader_election.cc:336] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): Network error: Client connection negotiation failed: client connection to 127.23.140.67:34091: connect: Connection refused (error 111)
I20260709 13:13:26.649730 25873 leader_election.cc:304] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, 79d99c0e498349bda74127365219e468
W20260709 13:13:26.651486 25872 leader_election.cc:336] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Network error: Client connection negotiation failed: client connection to 127.23.140.66:33127: connect: Connection refused (error 111)
I20260709 13:13:26.654150 31312 raft_consensus.cc:2749] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:13:26.655092 25874 consensus_peers.cc:597] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:13:26.681818 31312 raft_consensus.cc:493] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader da445ce82dc4467f95f4fa52297eaa19)
I20260709 13:13:26.682367 31312 raft_consensus.cc:515] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1f539ba21487460085b837e7529a78ce" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 39361 } } peers { permanent_uuid: "da445ce82dc4467f95f4fa52297eaa19" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 33127 } } peers { permanent_uuid: "6c4b021f3f9e41adb75e870a08ad88b6" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 34085 } attrs { promote: false } }
I20260709 13:13:26.684592 31312 leader_election.cc:290] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361), da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127)
W20260709 13:13:26.689347 25874 leader_election.cc:336] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111)
W20260709 13:13:26.690284 25872 leader_election.cc:336] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): Network error: Client connection negotiation failed: client connection to 127.23.140.66:33127: connect: Connection refused (error 111)
I20260709 13:13:26.690681 25872 leader_election.cc:304] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4b021f3f9e41adb75e870a08ad88b6; no voters: 1f539ba21487460085b837e7529a78ce, da445ce82dc4467f95f4fa52297eaa19
I20260709 13:13:26.691800 31345 raft_consensus.cc:2749] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:13:26.809212 25874 consensus_peers.cc:597] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 -> Peer 1f539ba21487460085b837e7529a78ce (127.23.140.65:39361): Couldn't send request to peer 1f539ba21487460085b837e7529a78ce. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:39361: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:13:26.978843 24113 tablet_server.cc:196] TabletServer@127.23.140.67:0 shutdown complete.
I20260709 13:13:27.069078 24113 tablet_server.cc:179] TabletServer@127.23.140.68:0 shutting down...
I20260709 13:13:27.111647 24113 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:27.112603 24113 tablet_replica.cc:333] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6: stopping tablet replica
I20260709 13:13:27.113622 24113 raft_consensus.cc:2243] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:27.114634 24113 raft_consensus.cc:2272] T 8d0f43a786a846b49924a589e4a36f2f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:27.117292 24113 tablet_replica.cc:333] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6: stopping tablet replica
I20260709 13:13:27.118144 24113 raft_consensus.cc:2243] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:27.118925 24113 raft_consensus.cc:2272] T 275226661cc840559134f8c9e5b15719 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:27.121626 24113 tablet_replica.cc:333] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6: stopping tablet replica
I20260709 13:13:27.122568 24113 raft_consensus.cc:2243] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:13:27.123498 24113 raft_consensus.cc:2272] T d56909a48cf841eb99365741e9e29e93 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:27.125353 24113 tablet_replica.cc:333] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6: stopping tablet replica
I20260709 13:13:27.125936 24113 raft_consensus.cc:2243] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:27.126595 24113 raft_consensus.cc:2272] T 35ae6d72e4154149b3d1721e2214570a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:27.128738 24113 tablet_replica.cc:333] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6: stopping tablet replica
I20260709 13:13:27.129285 24113 raft_consensus.cc:2243] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:27.129968 24113 raft_consensus.cc:2272] T 25e0218933774b319104f23505937179 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:27.131999 24113 tablet_replica.cc:333] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6: stopping tablet replica
I20260709 13:13:27.132527 24113 raft_consensus.cc:2243] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:13:27.133524 24113 raft_consensus.cc:2272] T cc7fda8ece3144099df1f442c8012dfd P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:27.135947 24113 tablet_replica.cc:333] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6: stopping tablet replica
I20260709 13:13:27.136492 24113 raft_consensus.cc:2243] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:13:27.137230 24113 raft_consensus.cc:2272] T af9115771e334c95a7dec25c698514dc P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:27.139282 24113 tablet_replica.cc:333] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6: stopping tablet replica
I20260709 13:13:27.139812 24113 raft_consensus.cc:2243] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:27.140372 24113 raft_consensus.cc:2272] T 87095494ab7d40b7a42f4b05732acbf5 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:27.143153 24113 tablet_replica.cc:333] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6: stopping tablet replica
I20260709 13:13:27.143726 24113 raft_consensus.cc:2243] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:13:27.144464 24113 raft_consensus.cc:2272] T f78697097cd14345b6a749c7aad4f696 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:27.146431 24113 tablet_replica.cc:333] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6: stopping tablet replica
I20260709 13:13:27.146934 24113 raft_consensus.cc:2243] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:13:27.147645 24113 raft_consensus.cc:2272] T 67fb9a2520c542d38f72828988ddc804 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:27.149458 24113 tablet_replica.cc:333] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6: stopping tablet replica
I20260709 13:13:27.150064 24113 raft_consensus.cc:2243] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:27.150507 24113 raft_consensus.cc:2272] T 135bcb58ad5b4506a12d94ef2b0d824c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:27.152304 24113 tablet_replica.cc:333] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6: stopping tablet replica
I20260709 13:13:27.152853 24113 raft_consensus.cc:2243] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:13:27.153653 24113 raft_consensus.cc:2272] T 51ecc4484385405c857b3bee1077c36a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:27.155484 24113 tablet_replica.cc:333] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6: stopping tablet replica
I20260709 13:13:27.156036 24113 raft_consensus.cc:2243] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:13:27.156873 24113 raft_consensus.cc:2272] T 47228487a74240e9bc9bcd2e1d966ed6 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:27.158998 24113 tablet_replica.cc:333] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6: stopping tablet replica
I20260709 13:13:27.159530 24113 raft_consensus.cc:2243] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:13:27.160426 24113 raft_consensus.cc:2272] T e74320a7302d4cd8b705dce5d385079a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:27.162649 24113 tablet_replica.cc:333] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6: stopping tablet replica
I20260709 13:13:27.163275 24113 raft_consensus.cc:2243] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:27.163884 24113 raft_consensus.cc:2272] T c6d3131e75284c0eb555c937d1c619cb P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:27.166074 24113 tablet_replica.cc:333] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6: stopping tablet replica
I20260709 13:13:27.166610 24113 raft_consensus.cc:2243] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:13:27.167311 24113 raft_consensus.cc:2272] T 0bcff15b40224dcaa2c76d2c4fd3b27b P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:27.169072 24113 tablet_replica.cc:333] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6: stopping tablet replica
I20260709 13:13:27.169574 24113 raft_consensus.cc:2243] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:13:27.170367 24113 raft_consensus.cc:2272] T 08c29bb25d6947ddaa43c22713738514 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:27.172246 24113 tablet_replica.cc:333] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6: stopping tablet replica
I20260709 13:13:27.172773 24113 raft_consensus.cc:2243] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:13:27.173492 24113 raft_consensus.cc:2272] T 56a9fdb76a7d494e81629b861acc1489 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:27.175326 24113 tablet_replica.cc:333] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6: stopping tablet replica
I20260709 13:13:27.175868 24113 raft_consensus.cc:2243] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:27.176442 24113 raft_consensus.cc:2272] T f5c9116c92454e2ab270a148a8c5c4ea P 6c4b021f3f9e41adb75e870a08ad88b6 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:27.178354 24113 tablet_replica.cc:333] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6: stopping tablet replica
I20260709 13:13:27.178843 24113 raft_consensus.cc:2243] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:13:27.179625 24113 raft_consensus.cc:2272] T 0eaedd90995b476890a2ea23d7089759 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:27.181432 24113 tablet_replica.cc:333] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6: stopping tablet replica
I20260709 13:13:27.181972 24113 raft_consensus.cc:2243] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:27.182380 24113 raft_consensus.cc:2272] T ca881f8516e046c99da202e9d9ea00a1 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:27.184100 24113 tablet_replica.cc:333] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6: stopping tablet replica
I20260709 13:13:27.184636 24113 raft_consensus.cc:2243] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:13:27.185655 24113 raft_consensus.cc:2272] T 88997763405742ee8b8e6b43d7392c1f P 6c4b021f3f9e41adb75e870a08ad88b6 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:27.187575 24113 tablet_replica.cc:333] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6: stopping tablet replica
I20260709 13:13:27.188098 24113 raft_consensus.cc:2243] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:13:27.188862 24113 raft_consensus.cc:2272] T 7fd182e135fd4b4db8700ed3173fd000 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:27.190933 24113 tablet_replica.cc:333] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6: stopping tablet replica
I20260709 13:13:27.191759 24113 raft_consensus.cc:2243] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:13:27.192960 24113 raft_consensus.cc:2272] T b1dbd9bfdb4f4ed582b5d84e9cc7602a P 6c4b021f3f9e41adb75e870a08ad88b6 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:27.194991 24113 tablet_replica.cc:333] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6: stopping tablet replica
I20260709 13:13:27.195454 24113 raft_consensus.cc:2243] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:13:27.196233 24113 raft_consensus.cc:2272] T a1eeb9f9696c44b9b744d926cf3312ff P 6c4b021f3f9e41adb75e870a08ad88b6 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:27.198071 24113 tablet_replica.cc:333] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6: stopping tablet replica
I20260709 13:13:27.198547 24113 raft_consensus.cc:2243] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:13:27.199281 24113 raft_consensus.cc:2272] T 9cae37d53acd4bcdbe2fa0bd91b36cc4 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:27.201020 24113 tablet_replica.cc:333] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6: stopping tablet replica
I20260709 13:13:27.201471 24113 raft_consensus.cc:2243] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:13:27.202291 24113 raft_consensus.cc:2272] T ea5abc7f78c6412885cf5a12e2a9ee6c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:27.204172 24113 tablet_replica.cc:333] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6: stopping tablet replica
I20260709 13:13:27.204641 24113 raft_consensus.cc:2243] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:13:27.205381 24113 raft_consensus.cc:2272] T 11892dffe99a496ebf3d98773631357c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:27.207249 24113 tablet_replica.cc:333] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6: stopping tablet replica
I20260709 13:13:27.207707 24113 raft_consensus.cc:2243] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:27.208205 24113 raft_consensus.cc:2272] T 60f74f1604ed4390892e271c77fd0f07 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:27.210214 24113 tablet_replica.cc:333] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6: stopping tablet replica
I20260709 13:13:27.210670 24113 raft_consensus.cc:2243] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:27.211206 24113 raft_consensus.cc:2272] T 7e85321bc6774ed28bf79ebfd5eae6e0 P 6c4b021f3f9e41adb75e870a08ad88b6 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:27.213086 24113 tablet_replica.cc:333] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6: stopping tablet replica
I20260709 13:13:27.213497 24113 raft_consensus.cc:2243] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:27.213976 24113 raft_consensus.cc:2272] T c279dfc4b0d248a4a884e78a33fd437c P 6c4b021f3f9e41adb75e870a08ad88b6 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:27.242260 25175 auto_rebalancer.cc:629] Failed to schedule move for tablet 3e6da6f96d4a4409be6b8e2b09c861c4: Network error: Client connection negotiation failed: client connection to 127.23.140.67:34091: connect: Connection refused (error 111)
W20260709 13:13:27.245702 25175 auto_rebalancer.cc:629] Failed to schedule move for tablet cf070d83a5904025bb0d390a39ebae05: Network error: Client connection negotiation failed: client connection to 127.23.140.66:33127: connect: Connection refused (error 111)
W20260709 13:13:27.249974 25175 auto_rebalancer.cc:629] Failed to schedule move for tablet 6e2ea64fbf1c4f6db8eda01c8d9ac433: Network error: Client connection negotiation failed: client connection to 127.23.140.67:34091: connect: Connection refused (error 111)
W20260709 13:13:27.255882 25175 auto_rebalancer.cc:629] Failed to schedule move for tablet d7fb167d72a441418dc3c55148746e87: Network error: Client connection negotiation failed: client connection to 127.23.140.66:33127: connect: Connection refused (error 111)
I20260709 13:13:27.514098 24113 tablet_server.cc:196] TabletServer@127.23.140.68:0 shutdown complete.
I20260709 13:13:27.563306 24113 master.cc:562] Master@127.23.140.126:37145 shutting down...
W20260709 13:13:28.699762 25113 catalog_manager.cc:4755] TS da445ce82dc4467f95f4fa52297eaa19 (127.23.140.66:33127): ChangeConfig:REMOVE_PEER RPC failed for tablet 8d0f43a786a846b49924a589e4a36f2f: Network error: Client connection negotiation failed: client connection to 127.23.140.66:33127: connect: Connection refused (error 111)
W20260709 13:13:31.099603 25114 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.140.67:34091: connect: Connection refused (error 111) [suppressed 182 similar messages]
W20260709 13:13:31.102802 25114 catalog_manager.cc:4755] TS 79d99c0e498349bda74127365219e468 (127.23.140.67:34091): ChangeConfig:REMOVE_PEER RPC failed for tablet 275226661cc840559134f8c9e5b15719: Network error: Client connection negotiation failed: client connection to 127.23.140.67:34091: connect: Connection refused (error 111)
I20260709 13:13:31.186679 24113 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 5140a3161b944724a989995efdc4a818 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:31.187392 24113 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 5140a3161b944724a989995efdc4a818 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:31.187738 24113 tablet_replica.cc:333] T 00000000000000000000000000000000 P 5140a3161b944724a989995efdc4a818: stopping tablet replica
I20260709 13:13:31.386991 24113 master.cc:584] Master@127.23.140.126:37145 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (189519 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:13:31.483166 24113 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.23.140.126:37181
I20260709 13:13:31.484352 24113 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:31.490306 31354 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:31.490777 31356 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:31.490960 31353 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:31.492169 24113 server_base.cc:1061] running on GCE node
I20260709 13:13:31.494768 24113 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:31.494946 24113 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:31.495137 24113 hybrid_clock.cc:648] HybridClock initialized: now 1783602811495103 us; error 0 us; skew 500 ppm
I20260709 13:13:31.495676 24113 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:31.498514 24113 webserver.cc:533] Webserver started at http://127.23.140.126:34021/ using document root <none> and password file <none>
I20260709 13:13:31.499022 24113 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:31.499215 24113 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:31.499506 24113 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:31.500725 24113 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602598684750-24113-0/minicluster-data/master-0-root/instance:
uuid: "e22434eebf05497a894dca04ce76caaa"
format_stamp: "Formatted at 2026-07-09 13:13:31 on dist-test-slave-1rs3"
I20260709 13:13:31.505002 24113 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:13:31.508338 31361 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:31.509034 24113 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:13:31.509318 24113 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602598684750-24113-0/minicluster-data/master-0-root
uuid: "e22434eebf05497a894dca04ce76caaa"
format_stamp: "Formatted at 2026-07-09 13:13:31 on dist-test-slave-1rs3"
I20260709 13:13:31.509589 24113 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602598684750-24113-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602598684750-24113-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602598684750-24113-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:31.523651 24113 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:31.524887 24113 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:31.563119 24113 rpc_server.cc:307] RPC server started. Bound to: 127.23.140.126:37181
I20260709 13:13:31.563225 31412 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.140.126:37181 every 8 connection(s)
I20260709 13:13:31.567080 31413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:31.576907 31413 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e22434eebf05497a894dca04ce76caaa: Bootstrap starting.
I20260709 13:13:31.581543 31413 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e22434eebf05497a894dca04ce76caaa: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:31.585633 31413 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e22434eebf05497a894dca04ce76caaa: No bootstrap required, opened a new log
I20260709 13:13:31.587702 31413 raft_consensus.cc:359] T 00000000000000000000000000000000 P e22434eebf05497a894dca04ce76caaa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e22434eebf05497a894dca04ce76caaa" member_type: VOTER }
I20260709 13:13:31.588055 31413 raft_consensus.cc:385] T 00000000000000000000000000000000 P e22434eebf05497a894dca04ce76caaa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:31.588235 31413 raft_consensus.cc:740] T 00000000000000000000000000000000 P e22434eebf05497a894dca04ce76caaa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e22434eebf05497a894dca04ce76caaa, State: Initialized, Role: FOLLOWER
I20260709 13:13:31.588819 31413 consensus_queue.cc:260] T 00000000000000000000000000000000 P e22434eebf05497a894dca04ce76caaa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e22434eebf05497a894dca04ce76caaa" member_type: VOTER }
I20260709 13:13:31.589231 31413 raft_consensus.cc:399] T 00000000000000000000000000000000 P e22434eebf05497a894dca04ce76caaa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:13:31.589419 31413 raft_consensus.cc:493] T 00000000000000000000000000000000 P e22434eebf05497a894dca04ce76caaa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:13:31.589619 31413 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e22434eebf05497a894dca04ce76caaa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:31.593906 31413 raft_consensus.cc:515] T 00000000000000000000000000000000 P e22434eebf05497a894dca04ce76caaa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e22434eebf05497a894dca04ce76caaa" member_type: VOTER }
I20260709 13:13:31.594359 31413 leader_election.cc:304] T 00000000000000000000000000000000 P e22434eebf05497a894dca04ce76caaa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e22434eebf05497a894dca04ce76caaa; no voters: 
I20260709 13:13:31.595480 31413 leader_election.cc:290] T 00000000000000000000000000000000 P e22434eebf05497a894dca04ce76caaa [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:13:31.595816 31416 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e22434eebf05497a894dca04ce76caaa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:31.597254 31416 raft_consensus.cc:697] T 00000000000000000000000000000000 P e22434eebf05497a894dca04ce76caaa [term 1 LEADER]: Becoming Leader. State: Replica: e22434eebf05497a894dca04ce76caaa, State: Running, Role: LEADER
I20260709 13:13:31.597925 31416 consensus_queue.cc:237] T 00000000000000000000000000000000 P e22434eebf05497a894dca04ce76caaa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e22434eebf05497a894dca04ce76caaa" member_type: VOTER }
I20260709 13:13:31.598582 31413 sys_catalog.cc:565] T 00000000000000000000000000000000 P e22434eebf05497a894dca04ce76caaa [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:13:31.604550 31417 sys_catalog.cc:455] T 00000000000000000000000000000000 P e22434eebf05497a894dca04ce76caaa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e22434eebf05497a894dca04ce76caaa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e22434eebf05497a894dca04ce76caaa" member_type: VOTER } }
I20260709 13:13:31.604224 31418 sys_catalog.cc:455] T 00000000000000000000000000000000 P e22434eebf05497a894dca04ce76caaa [sys.catalog]: SysCatalogTable state changed. Reason: New leader e22434eebf05497a894dca04ce76caaa. Latest consensus state: current_term: 1 leader_uuid: "e22434eebf05497a894dca04ce76caaa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e22434eebf05497a894dca04ce76caaa" member_type: VOTER } }
I20260709 13:13:31.605026 31417 sys_catalog.cc:458] T 00000000000000000000000000000000 P e22434eebf05497a894dca04ce76caaa [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:31.605218 31418 sys_catalog.cc:458] T 00000000000000000000000000000000 P e22434eebf05497a894dca04ce76caaa [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:31.607021 31424 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:13:31.615082 31424 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:13:31.616092 24113 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:13:31.624045 31424 catalog_manager.cc:1383] Generated new cluster ID: 9486f32a211245a393e79feb2edb4bd6
I20260709 13:13:31.624361 31424 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:13:31.645891 31424 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:13:31.647157 31424 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:13:31.664261 31424 catalog_manager.cc:6070] T 00000000000000000000000000000000 P e22434eebf05497a894dca04ce76caaa: Generated new TSK 0
I20260709 13:13:31.664897 31424 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:13:31.682703 24113 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:31.688683 31434 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:31.689975 31435 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:31.691700 31437 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:31.692046 24113 server_base.cc:1061] running on GCE node
I20260709 13:13:31.694108 24113 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:31.694293 24113 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:31.694494 24113 hybrid_clock.cc:648] HybridClock initialized: now 1783602811694460 us; error 0 us; skew 500 ppm
I20260709 13:13:31.695130 24113 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:31.697541 24113 webserver.cc:533] Webserver started at http://127.23.140.65:34313/ using document root <none> and password file <none>
I20260709 13:13:31.698122 24113 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:31.698323 24113 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:31.698627 24113 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:31.699821 24113 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602598684750-24113-0/minicluster-data/ts-0-root/instance:
uuid: "458d610e8abf4f2ea831ab7bf3576da6"
format_stamp: "Formatted at 2026-07-09 13:13:31 on dist-test-slave-1rs3"
I20260709 13:13:31.704174 24113 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:13:31.707587 31442 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:31.708366 24113 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:13:31.708693 24113 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602598684750-24113-0/minicluster-data/ts-0-root
uuid: "458d610e8abf4f2ea831ab7bf3576da6"
format_stamp: "Formatted at 2026-07-09 13:13:31 on dist-test-slave-1rs3"
I20260709 13:13:31.708945 24113 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602598684750-24113-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602598684750-24113-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602598684750-24113-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:31.726155 24113 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:31.727309 24113 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:31.728754 24113 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:31.731042 24113 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:31.731271 24113 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:31.731520 24113 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:31.731719 24113 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:31.773211 24113 rpc_server.cc:307] RPC server started. Bound to: 127.23.140.65:37919
I20260709 13:13:31.773341 31504 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.140.65:37919 every 8 connection(s)
I20260709 13:13:31.778542 24113 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:31.787324 31509 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:31.788554 31510 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:31.791986 24113 server_base.cc:1061] running on GCE node
W20260709 13:13:31.792848 31512 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:31.794627 24113 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:31.794824 24113 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:31.794952 24113 hybrid_clock.cc:648] HybridClock initialized: now 1783602811794941 us; error 0 us; skew 500 ppm
I20260709 13:13:31.795416 24113 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:31.798288 24113 webserver.cc:533] Webserver started at http://127.23.140.66:36763/ using document root <none> and password file <none>
I20260709 13:13:31.798770 24113 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:31.799001 24113 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:31.799320 24113 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:31.799716 31505 heartbeater.cc:344] Connected to a master server at 127.23.140.126:37181
I20260709 13:13:31.800148 31505 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:31.800664 24113 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602598684750-24113-0/minicluster-data/ts-1-root/instance:
uuid: "196d972917fe4f85985e3862d40b7596"
format_stamp: "Formatted at 2026-07-09 13:13:31 on dist-test-slave-1rs3"
I20260709 13:13:31.800997 31505 heartbeater.cc:507] Master 127.23.140.126:37181 requested a full tablet report, sending...
I20260709 13:13:31.803249 31378 ts_manager.cc:194] Registered new tserver with Master: 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:31.805707 31378 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49956
I20260709 13:13:31.806183 24113 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.007s
I20260709 13:13:31.809821 31517 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:31.810600 24113 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:13:31.810845 24113 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602598684750-24113-0/minicluster-data/ts-1-root
uuid: "196d972917fe4f85985e3862d40b7596"
format_stamp: "Formatted at 2026-07-09 13:13:31 on dist-test-slave-1rs3"
I20260709 13:13:31.811141 24113 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602598684750-24113-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602598684750-24113-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602598684750-24113-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:31.827384 24113 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:31.828512 24113 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:31.829964 24113 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:31.832146 24113 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:31.832317 24113 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:31.832652 24113 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:31.832816 24113 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:31.873569 24113 rpc_server.cc:307] RPC server started. Bound to: 127.23.140.66:37431
I20260709 13:13:31.873688 31579 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.140.66:37431 every 8 connection(s)
I20260709 13:13:31.878559 24113 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:31.886106 31583 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:31.889101 31584 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:31.890072 31586 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:31.890981 31580 heartbeater.cc:344] Connected to a master server at 127.23.140.126:37181
I20260709 13:13:31.891466 24113 server_base.cc:1061] running on GCE node
I20260709 13:13:31.891476 31580 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:31.892488 24113 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:31.892767 24113 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:31.892618 31580 heartbeater.cc:507] Master 127.23.140.126:37181 requested a full tablet report, sending...
I20260709 13:13:31.893034 24113 hybrid_clock.cc:648] HybridClock initialized: now 1783602811893021 us; error 0 us; skew 500 ppm
I20260709 13:13:31.893731 24113 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:31.895072 31378 ts_manager.cc:194] Registered new tserver with Master: 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:31.896591 24113 webserver.cc:533] Webserver started at http://127.23.140.67:38941/ using document root <none> and password file <none>
I20260709 13:13:31.896744 31378 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49968
I20260709 13:13:31.897166 24113 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:31.897413 24113 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:31.897708 24113 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:31.899008 24113 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602598684750-24113-0/minicluster-data/ts-2-root/instance:
uuid: "c74453754ee34bea9b231ae318a55a31"
format_stamp: "Formatted at 2026-07-09 13:13:31 on dist-test-slave-1rs3"
I20260709 13:13:31.903589 24113 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:13:31.906890 31591 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:31.907734 24113 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:13:31.908043 24113 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602598684750-24113-0/minicluster-data/ts-2-root
uuid: "c74453754ee34bea9b231ae318a55a31"
format_stamp: "Formatted at 2026-07-09 13:13:31 on dist-test-slave-1rs3"
I20260709 13:13:31.908294 24113 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602598684750-24113-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602598684750-24113-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602598684750-24113-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:31.940657 24113 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:31.942021 24113 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:31.943491 24113 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:31.945640 24113 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:31.945897 24113 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:31.946139 24113 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:31.946309 24113 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:31.986445 24113 rpc_server.cc:307] RPC server started. Bound to: 127.23.140.67:35791
I20260709 13:13:31.986625 31653 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.140.67:35791 every 8 connection(s)
I20260709 13:13:31.991451 24113 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:31.999002 31657 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:32.000593 31658 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:32.005661 31654 heartbeater.cc:344] Connected to a master server at 127.23.140.126:37181
I20260709 13:13:32.006299 31654 heartbeater.cc:461] Registering TS with master...
W20260709 13:13:32.006611 31661 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:32.006654 24113 server_base.cc:1061] running on GCE node
I20260709 13:13:32.007339 31654 heartbeater.cc:507] Master 127.23.140.126:37181 requested a full tablet report, sending...
I20260709 13:13:32.008055 24113 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:32.008327 24113 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:32.008541 24113 hybrid_clock.cc:648] HybridClock initialized: now 1783602812008522 us; error 0 us; skew 500 ppm
I20260709 13:13:32.009250 24113 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:32.009713 31378 ts_manager.cc:194] Registered new tserver with Master: c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:32.011562 31378 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49978
I20260709 13:13:32.012102 24113 webserver.cc:533] Webserver started at http://127.23.140.68:43323/ using document root <none> and password file <none>
I20260709 13:13:32.012785 24113 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:32.013085 24113 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:32.013368 24113 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:32.014477 24113 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602598684750-24113-0/minicluster-data/ts-3-root/instance:
uuid: "76fb155ade354ee1ba78673e73b28aca"
format_stamp: "Formatted at 2026-07-09 13:13:32 on dist-test-slave-1rs3"
I20260709 13:13:32.018594 24113 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:13:32.021850 31665 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:32.022627 24113 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:13:32.022928 24113 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602598684750-24113-0/minicluster-data/ts-3-root
uuid: "76fb155ade354ee1ba78673e73b28aca"
format_stamp: "Formatted at 2026-07-09 13:13:32 on dist-test-slave-1rs3"
I20260709 13:13:32.023231 24113 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602598684750-24113-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602598684750-24113-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602598684750-24113-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:32.049181 24113 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:32.050534 24113 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:32.052034 24113 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:32.054338 24113 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:32.054575 24113 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:32.054823 24113 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:32.055001 24113 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:32.099548 24113 rpc_server.cc:307] RPC server started. Bound to: 127.23.140.68:45715
I20260709 13:13:32.099710 31727 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.140.68:45715 every 8 connection(s)
I20260709 13:13:32.115172 31728 heartbeater.cc:344] Connected to a master server at 127.23.140.126:37181
I20260709 13:13:32.115597 31728 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:32.116356 31728 heartbeater.cc:507] Master 127.23.140.126:37181 requested a full tablet report, sending...
I20260709 13:13:32.118531 31378 ts_manager.cc:194] Registered new tserver with Master: 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715)
I20260709 13:13:32.119053 24113 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.016175824s
I20260709 13:13:32.120000 31378 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49992
I20260709 13:13:32.144904 31378 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50006:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:13:32.389885 31693 tablet_service.cc:1511] Processing CreateTablet for tablet 4fe725ada8f142d1bb9a35a30f865c10 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:13:32.391450 31693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fe725ada8f142d1bb9a35a30f865c10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.400964 31619 tablet_service.cc:1511] Processing CreateTablet for tablet 4fe725ada8f142d1bb9a35a30f865c10 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:13:32.402426 31619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fe725ada8f142d1bb9a35a30f865c10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.403018 31692 tablet_service.cc:1511] Processing CreateTablet for tablet bd1c90f0a848434cb7df23dbeae35ddf (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:13:32.404410 31692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd1c90f0a848434cb7df23dbeae35ddf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.407760 31469 tablet_service.cc:1511] Processing CreateTablet for tablet 11617136d6c14faea3cee24e00514101 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:13:32.409152 31469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11617136d6c14faea3cee24e00514101. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.414994 31468 tablet_service.cc:1511] Processing CreateTablet for tablet bd1c90f0a848434cb7df23dbeae35ddf (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:13:32.416419 31545 tablet_service.cc:1511] Processing CreateTablet for tablet 11617136d6c14faea3cee24e00514101 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:13:32.417178 31470 tablet_service.cc:1511] Processing CreateTablet for tablet 4fe725ada8f142d1bb9a35a30f865c10 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:13:32.417804 31545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11617136d6c14faea3cee24e00514101. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.421180 31691 tablet_service.cc:1511] Processing CreateTablet for tablet 42f4b6d5299848c89ceb268c1fd088af (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:13:32.421335 31543 tablet_service.cc:1511] Processing CreateTablet for tablet 42f4b6d5299848c89ceb268c1fd088af (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:13:32.422524 31691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42f4b6d5299848c89ceb268c1fd088af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.422813 31543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42f4b6d5299848c89ceb268c1fd088af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.416435 31468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd1c90f0a848434cb7df23dbeae35ddf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.418541 31618 tablet_service.cc:1511] Processing CreateTablet for tablet 11617136d6c14faea3cee24e00514101 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:13:32.425251 31618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11617136d6c14faea3cee24e00514101. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.419098 31544 tablet_service.cc:1511] Processing CreateTablet for tablet bd1c90f0a848434cb7df23dbeae35ddf (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:13:32.425946 31467 tablet_service.cc:1511] Processing CreateTablet for tablet 2568dda6664d4363abc4fd891fa48370 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:13:32.426749 31544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd1c90f0a848434cb7df23dbeae35ddf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.427294 31467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2568dda6664d4363abc4fd891fa48370. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.429339 31690 tablet_service.cc:1511] Processing CreateTablet for tablet eb560d89d58246e5856a763e3be6f086 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:13:32.430747 31690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb560d89d58246e5856a763e3be6f086. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.430974 31616 tablet_service.cc:1511] Processing CreateTablet for tablet 2568dda6664d4363abc4fd891fa48370 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:13:32.432308 31616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2568dda6664d4363abc4fd891fa48370. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.420269 31617 tablet_service.cc:1511] Processing CreateTablet for tablet 42f4b6d5299848c89ceb268c1fd088af (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:13:32.434682 31617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42f4b6d5299848c89ceb268c1fd088af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.434993 31466 tablet_service.cc:1511] Processing CreateTablet for tablet eb560d89d58246e5856a763e3be6f086 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:13:32.435319 31541 tablet_service.cc:1511] Processing CreateTablet for tablet eb560d89d58246e5856a763e3be6f086 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:13:32.436337 31466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb560d89d58246e5856a763e3be6f086. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.436661 31541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb560d89d58246e5856a763e3be6f086. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.438993 31542 tablet_service.cc:1511] Processing CreateTablet for tablet 2568dda6664d4363abc4fd891fa48370 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:13:32.440387 31542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2568dda6664d4363abc4fd891fa48370. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.442987 31614 tablet_service.cc:1511] Processing CreateTablet for tablet bec9a61b8e3c4bc0ba232063b38c8563 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:13:32.444514 31614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bec9a61b8e3c4bc0ba232063b38c8563. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.444926 31465 tablet_service.cc:1511] Processing CreateTablet for tablet 364efc87879c4e6db82a829c76ef0045 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:13:32.445248 31540 tablet_service.cc:1511] Processing CreateTablet for tablet bec9a61b8e3c4bc0ba232063b38c8563 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:13:32.438997 31615 tablet_service.cc:1511] Processing CreateTablet for tablet 364efc87879c4e6db82a829c76ef0045 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:13:32.447094 31540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bec9a61b8e3c4bc0ba232063b38c8563. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.448045 31615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 364efc87879c4e6db82a829c76ef0045. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.442979 31689 tablet_service.cc:1511] Processing CreateTablet for tablet 364efc87879c4e6db82a829c76ef0045 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:13:32.450021 31689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 364efc87879c4e6db82a829c76ef0045. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.439487 31470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fe725ada8f142d1bb9a35a30f865c10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.452369 31465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 364efc87879c4e6db82a829c76ef0045. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.458101 31688 tablet_service.cc:1511] Processing CreateTablet for tablet bec9a61b8e3c4bc0ba232063b38c8563 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:13:32.459518 31688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bec9a61b8e3c4bc0ba232063b38c8563. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.461374 31539 tablet_service.cc:1511] Processing CreateTablet for tablet c8185106c7a94c3ebaace350d2363217 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:13:32.462721 31539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8185106c7a94c3ebaace350d2363217. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.462930 31464 tablet_service.cc:1511] Processing CreateTablet for tablet c8185106c7a94c3ebaace350d2363217 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:13:32.464203 31464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8185106c7a94c3ebaace350d2363217. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.530499 31613 tablet_service.cc:1511] Processing CreateTablet for tablet c8185106c7a94c3ebaace350d2363217 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:13:32.531888 31613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8185106c7a94c3ebaace350d2363217. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.565889 31687 tablet_service.cc:1511] Processing CreateTablet for tablet e698d6d2e2e74eca91e222e9bfdf8f13 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:13:32.567466 31687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e698d6d2e2e74eca91e222e9bfdf8f13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.575174 31747 tablet_bootstrap.cc:492] T 42f4b6d5299848c89ceb268c1fd088af P 196d972917fe4f85985e3862d40b7596: Bootstrap starting.
I20260709 13:13:32.577638 31540 tablet_service.cc:1511] Processing CreateTablet for tablet e698d6d2e2e74eca91e222e9bfdf8f13 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:13:32.573657 31463 tablet_service.cc:1511] Processing CreateTablet for tablet e698d6d2e2e74eca91e222e9bfdf8f13 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:13:32.583432 31540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e698d6d2e2e74eca91e222e9bfdf8f13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.583869 31463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e698d6d2e2e74eca91e222e9bfdf8f13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.586481 31612 tablet_service.cc:1511] Processing CreateTablet for tablet 4d146b574e8d4e21bd8d81cb29b4267a (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:13:32.587997 31612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d146b574e8d4e21bd8d81cb29b4267a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.589917 31462 tablet_service.cc:1511] Processing CreateTablet for tablet 4d146b574e8d4e21bd8d81cb29b4267a (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:13:32.591259 31462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d146b574e8d4e21bd8d81cb29b4267a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.594776 31693 tablet_service.cc:1511] Processing CreateTablet for tablet 4d146b574e8d4e21bd8d81cb29b4267a (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:13:32.596194 31693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d146b574e8d4e21bd8d81cb29b4267a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:13:32.610461 31426 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:32.618184 31748 tablet_bootstrap.cc:492] T 4fe725ada8f142d1bb9a35a30f865c10 P c74453754ee34bea9b231ae318a55a31: Bootstrap starting.
I20260709 13:13:32.619530 31539 tablet_service.cc:1511] Processing CreateTablet for tablet 3e09c2945641463e91365b4826cc47e3 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:13:32.625206 31619 tablet_service.cc:1511] Processing CreateTablet for tablet 3e09c2945641463e91365b4826cc47e3 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:13:32.627681 31619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e09c2945641463e91365b4826cc47e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.630117 31539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e09c2945641463e91365b4826cc47e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.645635 31750 tablet_bootstrap.cc:492] T bd1c90f0a848434cb7df23dbeae35ddf P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:32.647112 31468 tablet_service.cc:1511] Processing CreateTablet for tablet 81f4d53616e74e2ea71e52fdb3e8fc76 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:13:32.648634 31468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81f4d53616e74e2ea71e52fdb3e8fc76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.645610 31749 tablet_bootstrap.cc:492] T 4fe725ada8f142d1bb9a35a30f865c10 P 76fb155ade354ee1ba78673e73b28aca: Bootstrap starting.
I20260709 13:13:32.654773 31691 tablet_service.cc:1511] Processing CreateTablet for tablet 3e09c2945641463e91365b4826cc47e3 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:13:32.656221 31691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e09c2945641463e91365b4826cc47e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.657806 31748 tablet_bootstrap.cc:654] T 4fe725ada8f142d1bb9a35a30f865c10 P c74453754ee34bea9b231ae318a55a31: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:32.657934 31747 tablet_bootstrap.cc:654] T 42f4b6d5299848c89ceb268c1fd088af P 196d972917fe4f85985e3862d40b7596: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:32.661929 31750 tablet_bootstrap.cc:654] T bd1c90f0a848434cb7df23dbeae35ddf P 458d610e8abf4f2ea831ab7bf3576da6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:32.693478 31541 tablet_service.cc:1511] Processing CreateTablet for tablet 81f4d53616e74e2ea71e52fdb3e8fc76 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:13:32.699755 31748 tablet_bootstrap.cc:492] T 4fe725ada8f142d1bb9a35a30f865c10 P c74453754ee34bea9b231ae318a55a31: No bootstrap required, opened a new log
I20260709 13:13:32.700881 31748 ts_tablet_manager.cc:1403] T 4fe725ada8f142d1bb9a35a30f865c10 P c74453754ee34bea9b231ae318a55a31: Time spent bootstrapping tablet: real 0.084s	user 0.009s	sys 0.005s
I20260709 13:13:32.700163 31541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81f4d53616e74e2ea71e52fdb3e8fc76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.714071 31749 tablet_bootstrap.cc:654] T 4fe725ada8f142d1bb9a35a30f865c10 P 76fb155ade354ee1ba78673e73b28aca: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:32.719714 31612 tablet_service.cc:1511] Processing CreateTablet for tablet 81f4d53616e74e2ea71e52fdb3e8fc76 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:13:32.721213 31612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81f4d53616e74e2ea71e52fdb3e8fc76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.726140 31687 tablet_service.cc:1511] Processing CreateTablet for tablet 40ab5d7d13ee4460933b5799482e3f87 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:13:32.727455 31687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40ab5d7d13ee4460933b5799482e3f87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.731516 31747 tablet_bootstrap.cc:492] T 42f4b6d5299848c89ceb268c1fd088af P 196d972917fe4f85985e3862d40b7596: No bootstrap required, opened a new log
I20260709 13:13:32.732034 31747 ts_tablet_manager.cc:1403] T 42f4b6d5299848c89ceb268c1fd088af P 196d972917fe4f85985e3862d40b7596: Time spent bootstrapping tablet: real 0.157s	user 0.019s	sys 0.004s
I20260709 13:13:32.733611 31748 raft_consensus.cc:359] T 4fe725ada8f142d1bb9a35a30f865c10 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:32.737353 31747 raft_consensus.cc:359] T 42f4b6d5299848c89ceb268c1fd088af P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:32.738181 31747 raft_consensus.cc:385] T 42f4b6d5299848c89ceb268c1fd088af P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:32.738382 31750 tablet_bootstrap.cc:492] T bd1c90f0a848434cb7df23dbeae35ddf P 458d610e8abf4f2ea831ab7bf3576da6: No bootstrap required, opened a new log
I20260709 13:13:32.738538 31747 raft_consensus.cc:740] T 42f4b6d5299848c89ceb268c1fd088af P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 196d972917fe4f85985e3862d40b7596, State: Initialized, Role: FOLLOWER
I20260709 13:13:32.739024 31750 ts_tablet_manager.cc:1403] T bd1c90f0a848434cb7df23dbeae35ddf P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.094s	user 0.015s	sys 0.009s
I20260709 13:13:32.739375 31747 consensus_queue.cc:260] T 42f4b6d5299848c89ceb268c1fd088af P 196d972917fe4f85985e3862d40b7596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:32.735071 31748 raft_consensus.cc:385] T 4fe725ada8f142d1bb9a35a30f865c10 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:32.746300 31540 tablet_service.cc:1511] Processing CreateTablet for tablet 40ab5d7d13ee4460933b5799482e3f87 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:13:32.750737 31693 tablet_service.cc:1511] Processing CreateTablet for tablet d78bdf917ee94331b91cb3fb308ef2a1 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:13:32.751188 31540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40ab5d7d13ee4460933b5799482e3f87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.752121 31693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d78bdf917ee94331b91cb3fb308ef2a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.753043 31464 tablet_service.cc:1511] Processing CreateTablet for tablet d78bdf917ee94331b91cb3fb308ef2a1 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:13:32.748386 31616 tablet_service.cc:1511] Processing CreateTablet for tablet d78bdf917ee94331b91cb3fb308ef2a1 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:13:32.749445 31748 raft_consensus.cc:740] T 4fe725ada8f142d1bb9a35a30f865c10 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Initialized, Role: FOLLOWER
I20260709 13:13:32.754318 31464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d78bdf917ee94331b91cb3fb308ef2a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.754936 31470 tablet_service.cc:1511] Processing CreateTablet for tablet 40ab5d7d13ee4460933b5799482e3f87 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:13:32.755164 31748 consensus_queue.cc:260] T 4fe725ada8f142d1bb9a35a30f865c10 P c74453754ee34bea9b231ae318a55a31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:32.756187 31470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40ab5d7d13ee4460933b5799482e3f87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.759279 31750 raft_consensus.cc:359] T bd1c90f0a848434cb7df23dbeae35ddf P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:32.759994 31750 raft_consensus.cc:385] T bd1c90f0a848434cb7df23dbeae35ddf P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:32.762851 31750 raft_consensus.cc:740] T bd1c90f0a848434cb7df23dbeae35ddf P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:32.763813 31750 consensus_queue.cc:260] T bd1c90f0a848434cb7df23dbeae35ddf P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:32.766492 31616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d78bdf917ee94331b91cb3fb308ef2a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.766991 31539 tablet_service.cc:1511] Processing CreateTablet for tablet de27ea68aab2485bb532389bb5c82433 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:13:32.768273 31539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de27ea68aab2485bb532389bb5c82433. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.774272 31580 heartbeater.cc:499] Master 127.23.140.126:37181 was elected leader, sending a full tablet report...
I20260709 13:13:32.775148 31747 ts_tablet_manager.cc:1434] T 42f4b6d5299848c89ceb268c1fd088af P 196d972917fe4f85985e3862d40b7596: Time spent starting tablet: real 0.043s	user 0.010s	sys 0.003s
I20260709 13:13:32.795589 31505 heartbeater.cc:499] Master 127.23.140.126:37181 was elected leader, sending a full tablet report...
I20260709 13:13:32.795565 31757 raft_consensus.cc:493] T bd1c90f0a848434cb7df23dbeae35ddf P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.798983 31691 tablet_service.cc:1511] Processing CreateTablet for tablet de27ea68aab2485bb532389bb5c82433 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:13:32.799588 31757 raft_consensus.cc:515] T bd1c90f0a848434cb7df23dbeae35ddf P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:32.801083 31691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de27ea68aab2485bb532389bb5c82433. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.807251 31747 tablet_bootstrap.cc:492] T bec9a61b8e3c4bc0ba232063b38c8563 P 196d972917fe4f85985e3862d40b7596: Bootstrap starting.
I20260709 13:13:32.808611 31749 tablet_bootstrap.cc:492] T 4fe725ada8f142d1bb9a35a30f865c10 P 76fb155ade354ee1ba78673e73b28aca: No bootstrap required, opened a new log
I20260709 13:13:32.809320 31749 ts_tablet_manager.cc:1403] T 4fe725ada8f142d1bb9a35a30f865c10 P 76fb155ade354ee1ba78673e73b28aca: Time spent bootstrapping tablet: real 0.164s	user 0.005s	sys 0.014s
I20260709 13:13:32.821383 31749 raft_consensus.cc:359] T 4fe725ada8f142d1bb9a35a30f865c10 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:32.825840 31749 raft_consensus.cc:385] T 4fe725ada8f142d1bb9a35a30f865c10 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:32.826273 31749 raft_consensus.cc:740] T 4fe725ada8f142d1bb9a35a30f865c10 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Initialized, Role: FOLLOWER
I20260709 13:13:32.822492 31619 tablet_service.cc:1511] Processing CreateTablet for tablet de27ea68aab2485bb532389bb5c82433 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:13:32.826655 31463 tablet_service.cc:1511] Processing CreateTablet for tablet 98a7e38754ed4644bf90b39aff07c70f (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:13:32.827765 31755 raft_consensus.cc:493] T 42f4b6d5299848c89ceb268c1fd088af P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.828034 31463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98a7e38754ed4644bf90b39aff07c70f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.828377 31755 raft_consensus.cc:515] T 42f4b6d5299848c89ceb268c1fd088af P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:32.827926 31619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de27ea68aab2485bb532389bb5c82433. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.828497 31749 consensus_queue.cc:260] T 4fe725ada8f142d1bb9a35a30f865c10 P 76fb155ade354ee1ba78673e73b28aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:32.837718 31615 tablet_service.cc:1511] Processing CreateTablet for tablet 98a7e38754ed4644bf90b39aff07c70f (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:13:32.852643 31465 tablet_service.cc:1511] Processing CreateTablet for tablet dbd8bd53d8d845b2b35de45d6d2f61a1 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:13:32.856491 31687 tablet_service.cc:1511] Processing CreateTablet for tablet dbd8bd53d8d845b2b35de45d6d2f61a1 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:13:32.857916 31748 ts_tablet_manager.cc:1434] T 4fe725ada8f142d1bb9a35a30f865c10 P c74453754ee34bea9b231ae318a55a31: Time spent starting tablet: real 0.157s	user 0.001s	sys 0.011s
I20260709 13:13:32.858711 31654 heartbeater.cc:499] Master 127.23.140.126:37181 was elected leader, sending a full tablet report...
I20260709 13:13:32.859027 31748 tablet_bootstrap.cc:492] T 42f4b6d5299848c89ceb268c1fd088af P c74453754ee34bea9b231ae318a55a31: Bootstrap starting.
I20260709 13:13:32.859733 31687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbd8bd53d8d845b2b35de45d6d2f61a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.861685 31545 tablet_service.cc:1511] Processing CreateTablet for tablet 98a7e38754ed4644bf90b39aff07c70f (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:13:32.862368 31465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbd8bd53d8d845b2b35de45d6d2f61a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.862969 31545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98a7e38754ed4644bf90b39aff07c70f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.848089 31757 leader_election.cc:290] T bd1c90f0a848434cb7df23dbeae35ddf P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431), 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715)
I20260709 13:13:32.848850 31615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98a7e38754ed4644bf90b39aff07c70f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.867187 31747 tablet_bootstrap.cc:654] T bec9a61b8e3c4bc0ba232063b38c8563 P 196d972917fe4f85985e3862d40b7596: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:32.875034 31540 tablet_service.cc:1511] Processing CreateTablet for tablet dbd8bd53d8d845b2b35de45d6d2f61a1 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:13:32.876168 31755 leader_election.cc:290] T 42f4b6d5299848c89ceb268c1fd088af P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715)
W20260709 13:13:32.888732 31581 tablet.cc:2406] T 42f4b6d5299848c89ceb268c1fd088af P 196d972917fe4f85985e3862d40b7596: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:13:32.890287 31540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbd8bd53d8d845b2b35de45d6d2f61a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.909706 31689 tablet_service.cc:1511] Processing CreateTablet for tablet b3705de0af7a48f69f751aab333fdf3d (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:13:32.914244 31748 tablet_bootstrap.cc:654] T 42f4b6d5299848c89ceb268c1fd088af P c74453754ee34bea9b231ae318a55a31: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:32.938699 31689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3705de0af7a48f69f751aab333fdf3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.941016 31750 ts_tablet_manager.cc:1434] T bd1c90f0a848434cb7df23dbeae35ddf P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.202s	user 0.020s	sys 0.045s
I20260709 13:13:32.922657 31612 tablet_service.cc:1511] Processing CreateTablet for tablet b3705de0af7a48f69f751aab333fdf3d (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:13:32.944799 31750 tablet_bootstrap.cc:492] T 11617136d6c14faea3cee24e00514101 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:32.958855 31749 ts_tablet_manager.cc:1434] T 4fe725ada8f142d1bb9a35a30f865c10 P 76fb155ade354ee1ba78673e73b28aca: Time spent starting tablet: real 0.149s	user 0.009s	sys 0.013s
I20260709 13:13:32.959901 31728 heartbeater.cc:499] Master 127.23.140.126:37181 was elected leader, sending a full tablet report...
I20260709 13:13:32.960080 31749 tablet_bootstrap.cc:492] T bd1c90f0a848434cb7df23dbeae35ddf P 76fb155ade354ee1ba78673e73b28aca: Bootstrap starting.
I20260709 13:13:32.967171 31470 tablet_service.cc:1511] Processing CreateTablet for tablet b3705de0af7a48f69f751aab333fdf3d (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:13:32.967391 31688 tablet_service.cc:1511] Processing CreateTablet for tablet e3516a073925457498018b87cdbaa85f (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:13:32.969048 31688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3516a073925457498018b87cdbaa85f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.968956 31618 tablet_service.cc:1511] Processing CreateTablet for tablet 5ea74721b8824d00b63c524b25ff23df (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:13:32.960043 31614 tablet_service.cc:1511] Processing CreateTablet for tablet e3516a073925457498018b87cdbaa85f (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:13:32.971537 31690 tablet_service.cc:1511] Processing CreateTablet for tablet 216111c5962f4b82ae52414985988860 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:13:32.972885 31690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 216111c5962f4b82ae52414985988860. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.974959 31470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3705de0af7a48f69f751aab333fdf3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.979614 31617 tablet_service.cc:1511] Processing CreateTablet for tablet 5b669b8d34ee4de5b002d30fbcf02dd7 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:13:32.981901 31612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3705de0af7a48f69f751aab333fdf3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.983525 31613 tablet_service.cc:1511] Processing CreateTablet for tablet 1e727ab6847b4fbab9a94b63842c6b9c (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:13:32.984869 31613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e727ab6847b4fbab9a94b63842c6b9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.998297 31693 tablet_service.cc:1511] Processing CreateTablet for tablet 5b669b8d34ee4de5b002d30fbcf02dd7 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:13:32.999640 31693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b669b8d34ee4de5b002d30fbcf02dd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.007624 31555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c90f0a848434cb7df23dbeae35ddf" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:33.008489 31464 tablet_service.cc:1511] Processing CreateTablet for tablet 5ea74721b8824d00b63c524b25ff23df (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
W20260709 13:13:33.009473 31443 leader_election.cc:343] T bd1c90f0a848434cb7df23dbeae35ddf P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:33.020026 31748 tablet_bootstrap.cc:492] T 42f4b6d5299848c89ceb268c1fd088af P c74453754ee34bea9b231ae318a55a31: No bootstrap required, opened a new log
I20260709 13:13:33.020798 31748 ts_tablet_manager.cc:1403] T 42f4b6d5299848c89ceb268c1fd088af P c74453754ee34bea9b231ae318a55a31: Time spent bootstrapping tablet: real 0.162s	user 0.011s	sys 0.010s
I20260709 13:13:33.026469 31618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ea74721b8824d00b63c524b25ff23df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.030049 31617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b669b8d34ee4de5b002d30fbcf02dd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.035509 31614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3516a073925457498018b87cdbaa85f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.036029 31747 tablet_bootstrap.cc:492] T bec9a61b8e3c4bc0ba232063b38c8563 P 196d972917fe4f85985e3862d40b7596: No bootstrap required, opened a new log
I20260709 13:13:33.043305 31747 ts_tablet_manager.cc:1403] T bec9a61b8e3c4bc0ba232063b38c8563 P 196d972917fe4f85985e3862d40b7596: Time spent bootstrapping tablet: real 0.236s	user 0.013s	sys 0.018s
I20260709 13:13:33.045142 31616 tablet_service.cc:1511] Processing CreateTablet for tablet f66580482b2d470bacbfec917042485b (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:13:33.046499 31616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f66580482b2d470bacbfec917042485b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.038998 31539 tablet_service.cc:1511] Processing CreateTablet for tablet 5ea74721b8824d00b63c524b25ff23df (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:13:33.040499 31545 tablet_service.cc:1511] Processing CreateTablet for tablet 216111c5962f4b82ae52414985988860 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:13:33.041417 31615 tablet_service.cc:1511] Processing CreateTablet for tablet ac45af43771c45fd8e57204c190c322b (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:13:33.041800 31687 tablet_service.cc:1511] Processing CreateTablet for tablet 1e727ab6847b4fbab9a94b63842c6b9c (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:13:33.038759 31540 tablet_service.cc:1511] Processing CreateTablet for tablet e3516a073925457498018b87cdbaa85f (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:13:33.046919 31747 raft_consensus.cc:359] T bec9a61b8e3c4bc0ba232063b38c8563 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:33.034162 31464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ea74721b8824d00b63c524b25ff23df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.066715 31539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ea74721b8824d00b63c524b25ff23df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.068423 31748 raft_consensus.cc:359] T 42f4b6d5299848c89ceb268c1fd088af P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:33.062824 31462 tablet_service.cc:1511] Processing CreateTablet for tablet ac45af43771c45fd8e57204c190c322b (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:13:33.072536 31465 tablet_service.cc:1511] Processing CreateTablet for tablet 216111c5962f4b82ae52414985988860 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:13:33.057631 31692 tablet_service.cc:1511] Processing CreateTablet for tablet f66580482b2d470bacbfec917042485b (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:13:33.073933 31692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f66580482b2d470bacbfec917042485b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.074200 31462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac45af43771c45fd8e57204c190c322b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.056159 31467 tablet_service.cc:1511] Processing CreateTablet for tablet 5b669b8d34ee4de5b002d30fbcf02dd7 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:13:33.075667 31467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b669b8d34ee4de5b002d30fbcf02dd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.057631 31468 tablet_service.cc:1511] Processing CreateTablet for tablet 075b9562a2b547c8aad80c2bae413556 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:13:33.077919 31703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c90f0a848434cb7df23dbeae35ddf" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:33.078645 31687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e727ab6847b4fbab9a94b63842c6b9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.078897 31542 tablet_service.cc:1511] Processing CreateTablet for tablet ac45af43771c45fd8e57204c190c322b (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
W20260709 13:13:33.079655 31446 leader_election.cc:343] T bd1c90f0a848434cb7df23dbeae35ddf P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:33.077226 31541 tablet_service.cc:1511] Processing CreateTablet for tablet 1e727ab6847b4fbab9a94b63842c6b9c (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:13:33.080120 31446 leader_election.cc:304] T bd1c90f0a848434cb7df23dbeae35ddf P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6; no voters: 196d972917fe4f85985e3862d40b7596, 76fb155ade354ee1ba78673e73b28aca
I20260709 13:13:33.081480 31756 raft_consensus.cc:2749] T bd1c90f0a848434cb7df23dbeae35ddf P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:33.077158 31465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 216111c5962f4b82ae52414985988860. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.082706 31468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 075b9562a2b547c8aad80c2bae413556. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.086120 31615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac45af43771c45fd8e57204c190c322b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.086776 31544 tablet_service.cc:1511] Processing CreateTablet for tablet 075b9562a2b547c8aad80c2bae413556 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:13:33.071374 31545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 216111c5962f4b82ae52414985988860. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.098366 31544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 075b9562a2b547c8aad80c2bae413556. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.099380 31749 tablet_bootstrap.cc:654] T bd1c90f0a848434cb7df23dbeae35ddf P 76fb155ade354ee1ba78673e73b28aca: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:33.100401 31540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3516a073925457498018b87cdbaa85f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.101450 31748 raft_consensus.cc:385] T 42f4b6d5299848c89ceb268c1fd088af P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:33.102053 31542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac45af43771c45fd8e57204c190c322b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.104647 31541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e727ab6847b4fbab9a94b63842c6b9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.112622 31748 raft_consensus.cc:740] T 42f4b6d5299848c89ceb268c1fd088af P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Initialized, Role: FOLLOWER
I20260709 13:13:33.118378 31748 consensus_queue.cc:260] T 42f4b6d5299848c89ceb268c1fd088af P c74453754ee34bea9b231ae318a55a31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:33.126609 31750 tablet_bootstrap.cc:654] T 11617136d6c14faea3cee24e00514101 P 458d610e8abf4f2ea831ab7bf3576da6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:33.129392 31747 raft_consensus.cc:385] T bec9a61b8e3c4bc0ba232063b38c8563 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:33.135303 31465 tablet_service.cc:1511] Processing CreateTablet for tablet f66580482b2d470bacbfec917042485b (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:13:33.158958 31747 raft_consensus.cc:740] T bec9a61b8e3c4bc0ba232063b38c8563 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 196d972917fe4f85985e3862d40b7596, State: Initialized, Role: FOLLOWER
I20260709 13:13:33.159198 31465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f66580482b2d470bacbfec917042485b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.159821 31747 consensus_queue.cc:260] T bec9a61b8e3c4bc0ba232063b38c8563 P 196d972917fe4f85985e3862d40b7596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:33.142596 31690 tablet_service.cc:1511] Processing CreateTablet for tablet 075b9562a2b547c8aad80c2bae413556 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:13:33.142843 31748 ts_tablet_manager.cc:1434] T 42f4b6d5299848c89ceb268c1fd088af P c74453754ee34bea9b231ae318a55a31: Time spent starting tablet: real 0.122s	user 0.002s	sys 0.009s
I20260709 13:13:33.151206 31703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f4b6d5299848c89ceb268c1fd088af" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:33.152822 31629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f4b6d5299848c89ceb268c1fd088af" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:33.163391 31629 raft_consensus.cc:2468] T 42f4b6d5299848c89ceb268c1fd088af P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 196d972917fe4f85985e3862d40b7596 in term 0.
I20260709 13:13:33.164865 31521 leader_election.cc:304] T 42f4b6d5299848c89ceb268c1fd088af P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, c74453754ee34bea9b231ae318a55a31; no voters: 
I20260709 13:13:33.165470 31690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 075b9562a2b547c8aad80c2bae413556. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.165719 31755 raft_consensus.cc:2804] T 42f4b6d5299848c89ceb268c1fd088af P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:33.166155 31755 raft_consensus.cc:493] T 42f4b6d5299848c89ceb268c1fd088af P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:33.166477 31755 raft_consensus.cc:3060] T 42f4b6d5299848c89ceb268c1fd088af P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:33.169672 31749 tablet_bootstrap.cc:492] T bd1c90f0a848434cb7df23dbeae35ddf P 76fb155ade354ee1ba78673e73b28aca: No bootstrap required, opened a new log
I20260709 13:13:33.170224 31749 ts_tablet_manager.cc:1403] T bd1c90f0a848434cb7df23dbeae35ddf P 76fb155ade354ee1ba78673e73b28aca: Time spent bootstrapping tablet: real 0.210s	user 0.029s	sys 0.010s
I20260709 13:13:33.174522 31748 tablet_bootstrap.cc:492] T c8185106c7a94c3ebaace350d2363217 P c74453754ee34bea9b231ae318a55a31: Bootstrap starting.
I20260709 13:13:33.173291 31749 raft_consensus.cc:359] T bd1c90f0a848434cb7df23dbeae35ddf P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:33.176750 31749 raft_consensus.cc:385] T bd1c90f0a848434cb7df23dbeae35ddf P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:33.177076 31749 raft_consensus.cc:740] T bd1c90f0a848434cb7df23dbeae35ddf P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Initialized, Role: FOLLOWER
W20260709 13:13:33.177980 31521 leader_election.cc:343] T 42f4b6d5299848c89ceb268c1fd088af P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:33.177896 31749 consensus_queue.cc:260] T bd1c90f0a848434cb7df23dbeae35ddf P 76fb155ade354ee1ba78673e73b28aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:33.179276 31755 raft_consensus.cc:515] T 42f4b6d5299848c89ceb268c1fd088af P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:33.180138 31749 ts_tablet_manager.cc:1434] T bd1c90f0a848434cb7df23dbeae35ddf P 76fb155ade354ee1ba78673e73b28aca: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:13:33.181089 31749 tablet_bootstrap.cc:492] T 42f4b6d5299848c89ceb268c1fd088af P 76fb155ade354ee1ba78673e73b28aca: Bootstrap starting.
I20260709 13:13:33.184834 31629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f4b6d5299848c89ceb268c1fd088af" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31"
I20260709 13:13:33.185424 31629 raft_consensus.cc:3060] T 42f4b6d5299848c89ceb268c1fd088af P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:33.187439 31749 tablet_bootstrap.cc:654] T 42f4b6d5299848c89ceb268c1fd088af P 76fb155ade354ee1ba78673e73b28aca: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:33.188035 31747 ts_tablet_manager.cc:1434] T bec9a61b8e3c4bc0ba232063b38c8563 P 196d972917fe4f85985e3862d40b7596: Time spent starting tablet: real 0.144s	user 0.005s	sys 0.002s
I20260709 13:13:33.189124 31747 tablet_bootstrap.cc:492] T c8185106c7a94c3ebaace350d2363217 P 196d972917fe4f85985e3862d40b7596: Bootstrap starting.
I20260709 13:13:33.195883 31629 raft_consensus.cc:2468] T 42f4b6d5299848c89ceb268c1fd088af P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 196d972917fe4f85985e3862d40b7596 in term 1.
I20260709 13:13:33.197549 31521 leader_election.cc:304] T 42f4b6d5299848c89ceb268c1fd088af P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, c74453754ee34bea9b231ae318a55a31; no voters: 
I20260709 13:13:33.198583 31758 raft_consensus.cc:2804] T 42f4b6d5299848c89ceb268c1fd088af P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:33.200541 31748 tablet_bootstrap.cc:654] T c8185106c7a94c3ebaace350d2363217 P c74453754ee34bea9b231ae318a55a31: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:33.199834 31755 leader_election.cc:290] T 42f4b6d5299848c89ceb268c1fd088af P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 election: Requested vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715)
I20260709 13:13:33.202411 31703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f4b6d5299848c89ceb268c1fd088af" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca"
I20260709 13:13:33.202329 31544 tablet_service.cc:1511] Processing CreateTablet for tablet 256a5c9a935246e0a6c36b5b654fbbfb (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
W20260709 13:13:33.204099 31521 leader_election.cc:343] T 42f4b6d5299848c89ceb268c1fd088af P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:33.204278 31544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 256a5c9a935246e0a6c36b5b654fbbfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.224918 31618 tablet_service.cc:1511] Processing CreateTablet for tablet 256a5c9a935246e0a6c36b5b654fbbfb (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:13:33.226387 31763 raft_consensus.cc:493] T bd1c90f0a848434cb7df23dbeae35ddf P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.226953 31763 raft_consensus.cc:515] T bd1c90f0a848434cb7df23dbeae35ddf P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:33.229135 31763 leader_election.cc:290] T bd1c90f0a848434cb7df23dbeae35ddf P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:33.226548 31618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 256a5c9a935246e0a6c36b5b654fbbfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.243008 31750 tablet_bootstrap.cc:492] T 11617136d6c14faea3cee24e00514101 P 458d610e8abf4f2ea831ab7bf3576da6: No bootstrap required, opened a new log
I20260709 13:13:33.246142 31750 ts_tablet_manager.cc:1403] T 11617136d6c14faea3cee24e00514101 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.304s	user 0.019s	sys 0.007s
I20260709 13:13:33.249790 31750 raft_consensus.cc:359] T 11617136d6c14faea3cee24e00514101 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:33.245055 31468 tablet_service.cc:1511] Processing CreateTablet for tablet fc35ae8230cf4ab792d0e15bcaf8b653 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:13:33.252863 31468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc35ae8230cf4ab792d0e15bcaf8b653. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.252532 31615 tablet_service.cc:1511] Processing CreateTablet for tablet fc35ae8230cf4ab792d0e15bcaf8b653 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:13:33.254014 31615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc35ae8230cf4ab792d0e15bcaf8b653. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.254495 31539 tablet_service.cc:1511] Processing CreateTablet for tablet a35171dce2e34beeafe34f3e80f18a41 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:13:33.255739 31539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a35171dce2e34beeafe34f3e80f18a41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.258253 31759 raft_consensus.cc:493] T 4fe725ada8f142d1bb9a35a30f865c10 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.258785 31759 raft_consensus.cc:515] T 4fe725ada8f142d1bb9a35a30f865c10 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:33.265329 31749 tablet_bootstrap.cc:492] T 42f4b6d5299848c89ceb268c1fd088af P 76fb155ade354ee1ba78673e73b28aca: No bootstrap required, opened a new log
I20260709 13:13:33.265903 31749 ts_tablet_manager.cc:1403] T 42f4b6d5299848c89ceb268c1fd088af P 76fb155ade354ee1ba78673e73b28aca: Time spent bootstrapping tablet: real 0.085s	user 0.030s	sys 0.022s
I20260709 13:13:33.266294 31614 tablet_service.cc:1511] Processing CreateTablet for tablet 85d4a24725c749199c1b35d959b1b2b5 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:13:33.267627 31614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85d4a24725c749199c1b35d959b1b2b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.237186 31758 raft_consensus.cc:697] T 42f4b6d5299848c89ceb268c1fd088af P 196d972917fe4f85985e3862d40b7596 [term 1 LEADER]: Becoming Leader. State: Replica: 196d972917fe4f85985e3862d40b7596, State: Running, Role: LEADER
I20260709 13:13:33.276197 31759 leader_election.cc:290] T 4fe725ada8f142d1bb9a35a30f865c10 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:33.251917 31750 raft_consensus.cc:385] T 11617136d6c14faea3cee24e00514101 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:33.287707 31467 tablet_service.cc:1511] Processing CreateTablet for tablet a35171dce2e34beeafe34f3e80f18a41 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:13:33.279860 31750 raft_consensus.cc:740] T 11617136d6c14faea3cee24e00514101 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:33.293825 31750 consensus_queue.cc:260] T 11617136d6c14faea3cee24e00514101 P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:33.295667 31467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a35171dce2e34beeafe34f3e80f18a41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.299520 31750 ts_tablet_manager.cc:1434] T 11617136d6c14faea3cee24e00514101 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.053s	user 0.007s	sys 0.000s
I20260709 13:13:33.300649 31750 tablet_bootstrap.cc:492] T eb560d89d58246e5856a763e3be6f086 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:33.301283 31542 tablet_service.cc:1511] Processing CreateTablet for tablet fc35ae8230cf4ab792d0e15bcaf8b653 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:13:33.303534 31541 tablet_service.cc:1511] Processing CreateTablet for tablet 8c4f880f34664227ac8bd46378c9995f (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:13:33.304936 31541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c4f880f34664227ac8bd46378c9995f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.304805 31555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c90f0a848434cb7df23dbeae35ddf" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:33.306409 31542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc35ae8230cf4ab792d0e15bcaf8b653. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:13:33.306718 31666 leader_election.cc:343] T bd1c90f0a848434cb7df23dbeae35ddf P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:33.319383 31750 tablet_bootstrap.cc:654] T eb560d89d58246e5856a763e3be6f086 P 458d610e8abf4f2ea831ab7bf3576da6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:33.319770 31616 tablet_service.cc:1511] Processing CreateTablet for tablet 8c4f880f34664227ac8bd46378c9995f (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:13:33.320052 31688 tablet_service.cc:1511] Processing CreateTablet for tablet 256a5c9a935246e0a6c36b5b654fbbfb (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:13:33.321254 31616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c4f880f34664227ac8bd46378c9995f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.321408 31688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 256a5c9a935246e0a6c36b5b654fbbfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.339951 31748 tablet_bootstrap.cc:492] T c8185106c7a94c3ebaace350d2363217 P c74453754ee34bea9b231ae318a55a31: No bootstrap required, opened a new log
I20260709 13:13:33.340555 31748 ts_tablet_manager.cc:1403] T c8185106c7a94c3ebaace350d2363217 P c74453754ee34bea9b231ae318a55a31: Time spent bootstrapping tablet: real 0.166s	user 0.006s	sys 0.018s
I20260709 13:13:33.334194 31747 tablet_bootstrap.cc:654] T c8185106c7a94c3ebaace350d2363217 P 196d972917fe4f85985e3862d40b7596: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:33.344137 31748 raft_consensus.cc:359] T c8185106c7a94c3ebaace350d2363217 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:33.332207 31758 consensus_queue.cc:237] T 42f4b6d5299848c89ceb268c1fd088af P 196d972917fe4f85985e3862d40b7596 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:33.318424 31749 raft_consensus.cc:359] T 42f4b6d5299848c89ceb268c1fd088af P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:33.348980 31749 raft_consensus.cc:385] T 42f4b6d5299848c89ceb268c1fd088af P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:33.349378 31749 raft_consensus.cc:740] T 42f4b6d5299848c89ceb268c1fd088af P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Initialized, Role: FOLLOWER
I20260709 13:13:33.352702 31703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe725ada8f142d1bb9a35a30f865c10" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:33.353616 31703 raft_consensus.cc:2468] T 4fe725ada8f142d1bb9a35a30f865c10 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 0.
I20260709 13:13:33.355422 31595 leader_election.cc:304] T 4fe725ada8f142d1bb9a35a30f865c10 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca, c74453754ee34bea9b231ae318a55a31; no voters: 
I20260709 13:13:33.356509 31759 raft_consensus.cc:2804] T 4fe725ada8f142d1bb9a35a30f865c10 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:33.344940 31748 raft_consensus.cc:385] T c8185106c7a94c3ebaace350d2363217 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:33.356999 31759 raft_consensus.cc:493] T 4fe725ada8f142d1bb9a35a30f865c10 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:33.360745 31545 tablet_service.cc:1511] Processing CreateTablet for tablet 53c18818aa9c44c8987bb675a05026a4 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:13:33.361145 31612 tablet_service.cc:1511] Processing CreateTablet for tablet 53c18818aa9c44c8987bb675a05026a4 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:13:33.361968 31749 consensus_queue.cc:260] T 42f4b6d5299848c89ceb268c1fd088af P 76fb155ade354ee1ba78673e73b28aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:33.366514 31759 raft_consensus.cc:3060] T 4fe725ada8f142d1bb9a35a30f865c10 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:33.367061 31612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53c18818aa9c44c8987bb675a05026a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.367074 31464 tablet_service.cc:1511] Processing CreateTablet for tablet 85d4a24725c749199c1b35d959b1b2b5 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:13:33.370136 31464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85d4a24725c749199c1b35d959b1b2b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.364225 31465 tablet_service.cc:1511] Processing CreateTablet for tablet 53c18818aa9c44c8987bb675a05026a4 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:13:33.371155 31465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53c18818aa9c44c8987bb675a05026a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.373126 31771 raft_consensus.cc:493] T bec9a61b8e3c4bc0ba232063b38c8563 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.373661 31771 raft_consensus.cc:515] T bec9a61b8e3c4bc0ba232063b38c8563 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:33.376683 31756 raft_consensus.cc:493] T 11617136d6c14faea3cee24e00514101 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.379431 31756 raft_consensus.cc:515] T 11617136d6c14faea3cee24e00514101 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:33.379467 31692 tablet_service.cc:1511] Processing CreateTablet for tablet a35171dce2e34beeafe34f3e80f18a41 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:13:33.380877 31692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a35171dce2e34beeafe34f3e80f18a41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.381389 31629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec9a61b8e3c4bc0ba232063b38c8563" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:33.383821 31545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53c18818aa9c44c8987bb675a05026a4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:13:33.384980 31521 leader_election.cc:343] T bec9a61b8e3c4bc0ba232063b38c8563 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:33.383647 31555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11617136d6c14faea3cee24e00514101" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
W20260709 13:13:33.386682 31443 leader_election.cc:343] T 11617136d6c14faea3cee24e00514101 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:33.387490 31756 leader_election.cc:290] T 11617136d6c14faea3cee24e00514101 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:33.393080 31771 leader_election.cc:290] T bec9a61b8e3c4bc0ba232063b38c8563 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715)
I20260709 13:13:33.393874 31687 tablet_service.cc:1511] Processing CreateTablet for tablet 85d4a24725c749199c1b35d959b1b2b5 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:13:33.394523 31703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec9a61b8e3c4bc0ba232063b38c8563" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:33.395037 31687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85d4a24725c749199c1b35d959b1b2b5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:13:33.395771 31521 leader_election.cc:343] T bec9a61b8e3c4bc0ba232063b38c8563 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:33.396239 31521 leader_election.cc:304] T bec9a61b8e3c4bc0ba232063b38c8563 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 196d972917fe4f85985e3862d40b7596; no voters: 76fb155ade354ee1ba78673e73b28aca, c74453754ee34bea9b231ae318a55a31
I20260709 13:13:33.397360 31771 raft_consensus.cc:2749] T bec9a61b8e3c4bc0ba232063b38c8563 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:33.402329 31629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11617136d6c14faea3cee24e00514101" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:33.403182 31689 tablet_service.cc:1511] Processing CreateTablet for tablet 8c4f880f34664227ac8bd46378c9995f (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
W20260709 13:13:33.403752 31446 leader_election.cc:343] T 11617136d6c14faea3cee24e00514101 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:33.404299 31446 leader_election.cc:304] T 11617136d6c14faea3cee24e00514101 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6; no voters: 196d972917fe4f85985e3862d40b7596, c74453754ee34bea9b231ae318a55a31
I20260709 13:13:33.404525 31689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c4f880f34664227ac8bd46378c9995f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.403934 31750 tablet_bootstrap.cc:492] T eb560d89d58246e5856a763e3be6f086 P 458d610e8abf4f2ea831ab7bf3576da6: No bootstrap required, opened a new log
I20260709 13:13:33.405478 31756 raft_consensus.cc:2749] T 11617136d6c14faea3cee24e00514101 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:33.405642 31750 ts_tablet_manager.cc:1403] T eb560d89d58246e5856a763e3be6f086 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.105s	user 0.031s	sys 0.011s
I20260709 13:13:33.408730 31750 raft_consensus.cc:359] T eb560d89d58246e5856a763e3be6f086 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:33.409499 31750 raft_consensus.cc:385] T eb560d89d58246e5856a763e3be6f086 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:33.409840 31750 raft_consensus.cc:740] T eb560d89d58246e5856a763e3be6f086 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:33.410945 31750 consensus_queue.cc:260] T eb560d89d58246e5856a763e3be6f086 P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:33.413283 31750 ts_tablet_manager.cc:1434] T eb560d89d58246e5856a763e3be6f086 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:13:33.404703 31759 raft_consensus.cc:515] T 4fe725ada8f142d1bb9a35a30f865c10 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:33.413462 31691 tablet_service.cc:1511] Processing CreateTablet for tablet 36bf73ed3df141c889c046ad6902e304 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:13:33.414798 31691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36bf73ed3df141c889c046ad6902e304. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.415705 31703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe725ada8f142d1bb9a35a30f865c10" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca"
I20260709 13:13:33.416328 31703 raft_consensus.cc:3060] T 4fe725ada8f142d1bb9a35a30f865c10 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:33.420956 31749 ts_tablet_manager.cc:1434] T 42f4b6d5299848c89ceb268c1fd088af P 76fb155ade354ee1ba78673e73b28aca: Time spent starting tablet: real 0.155s	user 0.007s	sys 0.000s
I20260709 13:13:33.422094 31749 tablet_bootstrap.cc:492] T bec9a61b8e3c4bc0ba232063b38c8563 P 76fb155ade354ee1ba78673e73b28aca: Bootstrap starting.
I20260709 13:13:33.429956 31462 tablet_service.cc:1511] Processing CreateTablet for tablet 36bf73ed3df141c889c046ad6902e304 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:13:33.434756 31615 tablet_service.cc:1511] Processing CreateTablet for tablet ee6c632286174388ab5e7bfb2ae40078 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:13:33.436106 31615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee6c632286174388ab5e7bfb2ae40078. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.364987 31748 raft_consensus.cc:740] T c8185106c7a94c3ebaace350d2363217 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Initialized, Role: FOLLOWER
I20260709 13:13:33.437021 31748 consensus_queue.cc:260] T c8185106c7a94c3ebaace350d2363217 P c74453754ee34bea9b231ae318a55a31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:33.438859 31703 raft_consensus.cc:2468] T 4fe725ada8f142d1bb9a35a30f865c10 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 1.
I20260709 13:13:33.438755 31542 tablet_service.cc:1511] Processing CreateTablet for tablet 36bf73ed3df141c889c046ad6902e304 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:13:33.440186 31542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36bf73ed3df141c889c046ad6902e304. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.440066 31595 leader_election.cc:304] T 4fe725ada8f142d1bb9a35a30f865c10 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca, c74453754ee34bea9b231ae318a55a31; no voters: 
I20260709 13:13:33.449046 31759 leader_election.cc:290] T 4fe725ada8f142d1bb9a35a30f865c10 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 election: Requested vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:33.449877 31759 raft_consensus.cc:2804] T 4fe725ada8f142d1bb9a35a30f865c10 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:33.450321 31759 raft_consensus.cc:697] T 4fe725ada8f142d1bb9a35a30f865c10 P c74453754ee34bea9b231ae318a55a31 [term 1 LEADER]: Becoming Leader. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Running, Role: LEADER
I20260709 13:13:33.451109 31759 consensus_queue.cc:237] T 4fe725ada8f142d1bb9a35a30f865c10 P c74453754ee34bea9b231ae318a55a31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:33.462332 31750 tablet_bootstrap.cc:492] T 4d146b574e8d4e21bd8d81cb29b4267a P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:33.464298 31749 tablet_bootstrap.cc:654] T bec9a61b8e3c4bc0ba232063b38c8563 P 76fb155ade354ee1ba78673e73b28aca: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:33.468549 31748 ts_tablet_manager.cc:1434] T c8185106c7a94c3ebaace350d2363217 P c74453754ee34bea9b231ae318a55a31: Time spent starting tablet: real 0.128s	user 0.012s	sys 0.002s
I20260709 13:13:33.469159 31480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe725ada8f142d1bb9a35a30f865c10" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:33.480372 31748 tablet_bootstrap.cc:492] T 11617136d6c14faea3cee24e00514101 P c74453754ee34bea9b231ae318a55a31: Bootstrap starting.
W20260709 13:13:33.484829 31594 leader_election.cc:343] T 4fe725ada8f142d1bb9a35a30f865c10 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:33.485411 31462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36bf73ed3df141c889c046ad6902e304. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.484894 31479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe725ada8f142d1bb9a35a30f865c10" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
W20260709 13:13:33.487150 31594 leader_election.cc:343] T 4fe725ada8f142d1bb9a35a30f865c10 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:33.488940 31480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c90f0a848434cb7df23dbeae35ddf" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:33.489735 31480 raft_consensus.cc:2468] T bd1c90f0a848434cb7df23dbeae35ddf P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 0.
I20260709 13:13:33.490139 31748 tablet_bootstrap.cc:654] T 11617136d6c14faea3cee24e00514101 P c74453754ee34bea9b231ae318a55a31: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:33.495641 31468 tablet_service.cc:1511] Processing CreateTablet for tablet ee6c632286174388ab5e7bfb2ae40078 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:13:33.498751 31468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee6c632286174388ab5e7bfb2ae40078. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.499096 31668 leader_election.cc:304] T bd1c90f0a848434cb7df23dbeae35ddf P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca; no voters: 196d972917fe4f85985e3862d40b7596
I20260709 13:13:33.500062 31763 raft_consensus.cc:2804] T bd1c90f0a848434cb7df23dbeae35ddf P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:33.500473 31763 raft_consensus.cc:493] T bd1c90f0a848434cb7df23dbeae35ddf P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:33.500840 31763 raft_consensus.cc:3060] T bd1c90f0a848434cb7df23dbeae35ddf P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:33.501578 31541 tablet_service.cc:1511] Processing CreateTablet for tablet 680d6e1f38f4469ebe14094aa66fdfac (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:13:33.503095 31541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 680d6e1f38f4469ebe14094aa66fdfac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.497102 31376 catalog_manager.cc:5697] T 42f4b6d5299848c89ceb268c1fd088af P 196d972917fe4f85985e3862d40b7596 reported cstate change: term changed from 0 to 1, leader changed from <none> to 196d972917fe4f85985e3862d40b7596 (127.23.140.66). New cstate: current_term: 1 leader_uuid: "196d972917fe4f85985e3862d40b7596" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:33.511212 31747 tablet_bootstrap.cc:492] T c8185106c7a94c3ebaace350d2363217 P 196d972917fe4f85985e3862d40b7596: No bootstrap required, opened a new log
I20260709 13:13:33.511756 31747 ts_tablet_manager.cc:1403] T c8185106c7a94c3ebaace350d2363217 P 196d972917fe4f85985e3862d40b7596: Time spent bootstrapping tablet: real 0.323s	user 0.009s	sys 0.012s
I20260709 13:13:33.512487 31689 tablet_service.cc:1511] Processing CreateTablet for tablet ee6c632286174388ab5e7bfb2ae40078 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:13:33.519636 31689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee6c632286174388ab5e7bfb2ae40078. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.533169 31618 tablet_service.cc:1511] Processing CreateTablet for tablet 680d6e1f38f4469ebe14094aa66fdfac (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:13:33.535419 31618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 680d6e1f38f4469ebe14094aa66fdfac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.540650 31747 raft_consensus.cc:359] T c8185106c7a94c3ebaace350d2363217 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:33.541529 31747 raft_consensus.cc:385] T c8185106c7a94c3ebaace350d2363217 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:33.543740 31747 raft_consensus.cc:740] T c8185106c7a94c3ebaace350d2363217 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 196d972917fe4f85985e3862d40b7596, State: Initialized, Role: FOLLOWER
I20260709 13:13:33.544328 31750 tablet_bootstrap.cc:654] T 4d146b574e8d4e21bd8d81cb29b4267a P 458d610e8abf4f2ea831ab7bf3576da6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:33.550591 31763 raft_consensus.cc:515] T bd1c90f0a848434cb7df23dbeae35ddf P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:33.554037 31555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c90f0a848434cb7df23dbeae35ddf" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596"
I20260709 13:13:33.554735 31480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c90f0a848434cb7df23dbeae35ddf" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
W20260709 13:13:33.555512 31666 leader_election.cc:343] T bd1c90f0a848434cb7df23dbeae35ddf P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:33.555585 31480 raft_consensus.cc:3060] T bd1c90f0a848434cb7df23dbeae35ddf P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:33.544574 31747 consensus_queue.cc:260] T c8185106c7a94c3ebaace350d2363217 P 196d972917fe4f85985e3862d40b7596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:33.568964 31747 ts_tablet_manager.cc:1434] T c8185106c7a94c3ebaace350d2363217 P 196d972917fe4f85985e3862d40b7596: Time spent starting tablet: real 0.057s	user 0.007s	sys 0.000s
I20260709 13:13:33.570427 31747 tablet_bootstrap.cc:492] T bd1c90f0a848434cb7df23dbeae35ddf P 196d972917fe4f85985e3862d40b7596: Bootstrap starting.
I20260709 13:13:33.570518 31763 leader_election.cc:290] T bd1c90f0a848434cb7df23dbeae35ddf P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 election: Requested vote from peers 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:33.579141 31692 tablet_service.cc:1511] Processing CreateTablet for tablet 680d6e1f38f4469ebe14094aa66fdfac (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:13:33.580099 31542 tablet_service.cc:1511] Processing CreateTablet for tablet 497217e9b47244fcb425c66935cb8a20 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:13:33.581147 31692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 680d6e1f38f4469ebe14094aa66fdfac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.581880 31542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 497217e9b47244fcb425c66935cb8a20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.590240 31480 raft_consensus.cc:2468] T bd1c90f0a848434cb7df23dbeae35ddf P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 1.
I20260709 13:13:33.592857 31668 leader_election.cc:304] T bd1c90f0a848434cb7df23dbeae35ddf P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca; no voters: 196d972917fe4f85985e3862d40b7596
I20260709 13:13:33.593808 31747 tablet_bootstrap.cc:654] T bd1c90f0a848434cb7df23dbeae35ddf P 196d972917fe4f85985e3862d40b7596: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:33.594080 31763 raft_consensus.cc:2804] T bd1c90f0a848434cb7df23dbeae35ddf P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:33.591876 31468 tablet_service.cc:1511] Processing CreateTablet for tablet 497217e9b47244fcb425c66935cb8a20 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:13:33.600356 31468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 497217e9b47244fcb425c66935cb8a20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.600179 31615 tablet_service.cc:1511] Processing CreateTablet for tablet 497217e9b47244fcb425c66935cb8a20 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:13:33.601450 31615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 497217e9b47244fcb425c66935cb8a20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.598281 31377 catalog_manager.cc:5697] T 4fe725ada8f142d1bb9a35a30f865c10 P c74453754ee34bea9b231ae318a55a31 reported cstate change: term changed from 0 to 1, leader changed from <none> to c74453754ee34bea9b231ae318a55a31 (127.23.140.67). New cstate: current_term: 1 leader_uuid: "c74453754ee34bea9b231ae318a55a31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:33.612555 31749 tablet_bootstrap.cc:492] T bec9a61b8e3c4bc0ba232063b38c8563 P 76fb155ade354ee1ba78673e73b28aca: No bootstrap required, opened a new log
I20260709 13:13:33.613085 31749 ts_tablet_manager.cc:1403] T bec9a61b8e3c4bc0ba232063b38c8563 P 76fb155ade354ee1ba78673e73b28aca: Time spent bootstrapping tablet: real 0.191s	user 0.010s	sys 0.015s
I20260709 13:13:33.613930 31691 tablet_service.cc:1511] Processing CreateTablet for tablet fb4f7292ed2f489e922ca5fb1c6e47bf (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:13:33.615186 31691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb4f7292ed2f489e922ca5fb1c6e47bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.616003 31749 raft_consensus.cc:359] T bec9a61b8e3c4bc0ba232063b38c8563 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:33.616760 31749 raft_consensus.cc:385] T bec9a61b8e3c4bc0ba232063b38c8563 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:33.617048 31749 raft_consensus.cc:740] T bec9a61b8e3c4bc0ba232063b38c8563 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Initialized, Role: FOLLOWER
W20260709 13:13:33.619796 31426 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:33.620013 31465 tablet_service.cc:1511] Processing CreateTablet for tablet fb4f7292ed2f489e922ca5fb1c6e47bf (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:13:33.621264 31465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb4f7292ed2f489e922ca5fb1c6e47bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.621469 31614 tablet_service.cc:1511] Processing CreateTablet for tablet 47cb0ae4817d4c19ac11b42143d00039 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:13:33.626174 31614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47cb0ae4817d4c19ac11b42143d00039. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.623392 31763 raft_consensus.cc:697] T bd1c90f0a848434cb7df23dbeae35ddf P 76fb155ade354ee1ba78673e73b28aca [term 1 LEADER]: Becoming Leader. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Running, Role: LEADER
I20260709 13:13:33.635476 31687 tablet_service.cc:1511] Processing CreateTablet for tablet 47cb0ae4817d4c19ac11b42143d00039 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:13:33.636842 31687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47cb0ae4817d4c19ac11b42143d00039. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.638738 31748 tablet_bootstrap.cc:492] T 11617136d6c14faea3cee24e00514101 P c74453754ee34bea9b231ae318a55a31: No bootstrap required, opened a new log
I20260709 13:13:33.639278 31748 ts_tablet_manager.cc:1403] T 11617136d6c14faea3cee24e00514101 P c74453754ee34bea9b231ae318a55a31: Time spent bootstrapping tablet: real 0.159s	user 0.022s	sys 0.040s
I20260709 13:13:33.645985 31539 tablet_service.cc:1511] Processing CreateTablet for tablet fb4f7292ed2f489e922ca5fb1c6e47bf (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:13:33.648543 31539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb4f7292ed2f489e922ca5fb1c6e47bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.649497 31541 tablet_service.cc:1511] Processing CreateTablet for tablet 0ee7f4cbe2594c5793b2cb27e1dd4b34 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:13:33.650781 31612 tablet_service.cc:1511] Processing CreateTablet for tablet 0ee7f4cbe2594c5793b2cb27e1dd4b34 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:13:33.652776 31612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ee7f4cbe2594c5793b2cb27e1dd4b34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.652400 31763 consensus_queue.cc:237] T bd1c90f0a848434cb7df23dbeae35ddf P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:33.642267 31748 raft_consensus.cc:359] T 11617136d6c14faea3cee24e00514101 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:33.651867 31541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ee7f4cbe2594c5793b2cb27e1dd4b34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.623600 31749 consensus_queue.cc:260] T bec9a61b8e3c4bc0ba232063b38c8563 P 76fb155ade354ee1ba78673e73b28aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:33.649410 31462 tablet_service.cc:1511] Processing CreateTablet for tablet 47cb0ae4817d4c19ac11b42143d00039 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:13:33.655637 31462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47cb0ae4817d4c19ac11b42143d00039. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.656488 31749 ts_tablet_manager.cc:1434] T bec9a61b8e3c4bc0ba232063b38c8563 P 76fb155ade354ee1ba78673e73b28aca: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.000s
I20260709 13:13:33.657469 31749 tablet_bootstrap.cc:492] T eb560d89d58246e5856a763e3be6f086 P 76fb155ade354ee1ba78673e73b28aca: Bootstrap starting.
I20260709 13:13:33.654070 31748 raft_consensus.cc:385] T 11617136d6c14faea3cee24e00514101 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:33.672835 31689 tablet_service.cc:1511] Processing CreateTablet for tablet 0ee7f4cbe2594c5793b2cb27e1dd4b34 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:13:33.673151 31467 tablet_service.cc:1511] Processing CreateTablet for tablet 6038006ca0e344af86fe5febd517c62a (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:13:33.670763 31748 raft_consensus.cc:740] T 11617136d6c14faea3cee24e00514101 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Initialized, Role: FOLLOWER
I20260709 13:13:33.674341 31467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6038006ca0e344af86fe5febd517c62a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.676846 31748 consensus_queue.cc:260] T 11617136d6c14faea3cee24e00514101 P c74453754ee34bea9b231ae318a55a31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:33.677901 31758 raft_consensus.cc:493] T c8185106c7a94c3ebaace350d2363217 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.678452 31758 raft_consensus.cc:515] T c8185106c7a94c3ebaace350d2363217 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:33.680977 31748 ts_tablet_manager.cc:1434] T 11617136d6c14faea3cee24e00514101 P c74453754ee34bea9b231ae318a55a31: Time spent starting tablet: real 0.041s	user 0.009s	sys 0.000s
I20260709 13:13:33.681427 31747 tablet_bootstrap.cc:492] T bd1c90f0a848434cb7df23dbeae35ddf P 196d972917fe4f85985e3862d40b7596: No bootstrap required, opened a new log
I20260709 13:13:33.681985 31747 ts_tablet_manager.cc:1403] T bd1c90f0a848434cb7df23dbeae35ddf P 196d972917fe4f85985e3862d40b7596: Time spent bootstrapping tablet: real 0.112s	user 0.017s	sys 0.003s
I20260709 13:13:33.674351 31689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ee7f4cbe2594c5793b2cb27e1dd4b34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.692675 31545 tablet_service.cc:1511] Processing CreateTablet for tablet 6038006ca0e344af86fe5febd517c62a (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:13:33.694383 31545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6038006ca0e344af86fe5febd517c62a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.733446 31748 tablet_bootstrap.cc:492] T bec9a61b8e3c4bc0ba232063b38c8563 P c74453754ee34bea9b231ae318a55a31: Bootstrap starting.
I20260709 13:13:33.742919 31614 tablet_service.cc:1511] Processing CreateTablet for tablet 6038006ca0e344af86fe5febd517c62a (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:13:33.744447 31614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6038006ca0e344af86fe5febd517c62a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.749207 31750 tablet_bootstrap.cc:492] T 4d146b574e8d4e21bd8d81cb29b4267a P 458d610e8abf4f2ea831ab7bf3576da6: No bootstrap required, opened a new log
I20260709 13:13:33.749773 31750 ts_tablet_manager.cc:1403] T 4d146b574e8d4e21bd8d81cb29b4267a P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.288s	user 0.021s	sys 0.022s
I20260709 13:13:33.749976 31464 tablet_service.cc:1511] Processing CreateTablet for tablet bdf0c159a4f34a2abd10a0f7c60b5fbf (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:13:33.751309 31464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdf0c159a4f34a2abd10a0f7c60b5fbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.753401 31378 catalog_manager.cc:5697] T bd1c90f0a848434cb7df23dbeae35ddf P 76fb155ade354ee1ba78673e73b28aca reported cstate change: term changed from 0 to 1, leader changed from <none> to 76fb155ade354ee1ba78673e73b28aca (127.23.140.68). New cstate: current_term: 1 leader_uuid: "76fb155ade354ee1ba78673e73b28aca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:33.757774 31748 tablet_bootstrap.cc:654] T bec9a61b8e3c4bc0ba232063b38c8563 P c74453754ee34bea9b231ae318a55a31: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:33.758116 31758 leader_election.cc:290] T c8185106c7a94c3ebaace350d2363217 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:33.759464 31747 raft_consensus.cc:359] T bd1c90f0a848434cb7df23dbeae35ddf P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:33.761883 31629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8185106c7a94c3ebaace350d2363217" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:33.764637 31544 tablet_service.cc:1511] Processing CreateTablet for tablet bdf0c159a4f34a2abd10a0f7c60b5fbf (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:13:33.774365 31544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdf0c159a4f34a2abd10a0f7c60b5fbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.772858 31747 raft_consensus.cc:385] T bd1c90f0a848434cb7df23dbeae35ddf P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:33.776403 31747 raft_consensus.cc:740] T bd1c90f0a848434cb7df23dbeae35ddf P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 196d972917fe4f85985e3862d40b7596, State: Initialized, Role: FOLLOWER
I20260709 13:13:33.777212 31747 consensus_queue.cc:260] T bd1c90f0a848434cb7df23dbeae35ddf P 196d972917fe4f85985e3862d40b7596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:33.779560 31747 ts_tablet_manager.cc:1434] T bd1c90f0a848434cb7df23dbeae35ddf P 196d972917fe4f85985e3862d40b7596: Time spent starting tablet: real 0.097s	user 0.007s	sys 0.005s
I20260709 13:13:33.780547 31756 raft_consensus.cc:493] T eb560d89d58246e5856a763e3be6f086 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.781080 31756 raft_consensus.cc:515] T eb560d89d58246e5856a763e3be6f086 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:33.783191 31756 leader_election.cc:290] T eb560d89d58246e5856a763e3be6f086 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:33.780726 31747 tablet_bootstrap.cc:492] T 2568dda6664d4363abc4fd891fa48370 P 196d972917fe4f85985e3862d40b7596: Bootstrap starting.
I20260709 13:13:33.785130 31703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb560d89d58246e5856a763e3be6f086" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:33.768471 31615 tablet_service.cc:1511] Processing CreateTablet for tablet b262a50e82034c57a4bfb7da683ff5d1 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:13:33.769253 31692 tablet_service.cc:1511] Processing CreateTablet for tablet bdf0c159a4f34a2abd10a0f7c60b5fbf (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:13:33.787446 31692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdf0c159a4f34a2abd10a0f7c60b5fbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.773296 31629 raft_consensus.cc:2468] T c8185106c7a94c3ebaace350d2363217 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 196d972917fe4f85985e3862d40b7596 in term 0.
W20260709 13:13:33.786403 31446 leader_election.cc:343] T eb560d89d58246e5856a763e3be6f086 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:33.794749 31521 leader_election.cc:304] T c8185106c7a94c3ebaace350d2363217 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, c74453754ee34bea9b231ae318a55a31; no voters: 
I20260709 13:13:33.795056 31691 tablet_service.cc:1511] Processing CreateTablet for tablet b262a50e82034c57a4bfb7da683ff5d1 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:13:33.796413 31691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b262a50e82034c57a4bfb7da683ff5d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.798658 31758 raft_consensus.cc:2804] T c8185106c7a94c3ebaace350d2363217 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:33.799077 31758 raft_consensus.cc:493] T c8185106c7a94c3ebaace350d2363217 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:33.799437 31758 raft_consensus.cc:3060] T c8185106c7a94c3ebaace350d2363217 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:33.809551 31462 tablet_service.cc:1511] Processing CreateTablet for tablet b262a50e82034c57a4bfb7da683ff5d1 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:13:33.813805 31462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b262a50e82034c57a4bfb7da683ff5d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.814860 31771 consensus_queue.cc:1048] T 42f4b6d5299848c89ceb268c1fd088af P 196d972917fe4f85985e3862d40b7596 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:33.815915 31747 tablet_bootstrap.cc:654] T 2568dda6664d4363abc4fd891fa48370 P 196d972917fe4f85985e3862d40b7596: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:33.818966 31555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb560d89d58246e5856a763e3be6f086" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
W20260709 13:13:33.820643 31443 leader_election.cc:343] T eb560d89d58246e5856a763e3be6f086 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:33.821367 31443 leader_election.cc:304] T eb560d89d58246e5856a763e3be6f086 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6; no voters: 196d972917fe4f85985e3862d40b7596, 76fb155ade354ee1ba78673e73b28aca
I20260709 13:13:33.821076 31758 raft_consensus.cc:515] T c8185106c7a94c3ebaace350d2363217 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:33.825912 31756 raft_consensus.cc:2749] T eb560d89d58246e5856a763e3be6f086 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:33.833693 31688 tablet_service.cc:1511] Processing CreateTablet for tablet 0550046442d4469c96ad37cbbb191915 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:13:33.835223 31688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0550046442d4469c96ad37cbbb191915. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.839254 31749 tablet_bootstrap.cc:654] T eb560d89d58246e5856a763e3be6f086 P 76fb155ade354ee1ba78673e73b28aca: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:33.842172 31763 raft_consensus.cc:493] T 42f4b6d5299848c89ceb268c1fd088af P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.829736 31615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b262a50e82034c57a4bfb7da683ff5d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.842698 31763 raft_consensus.cc:515] T 42f4b6d5299848c89ceb268c1fd088af P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:33.845106 31464 tablet_service.cc:1511] Processing CreateTablet for tablet 88b0a29c38284391bdaea82edf99c771 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:13:33.846604 31464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88b0a29c38284391bdaea82edf99c771. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.846437 31555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f4b6d5299848c89ceb268c1fd088af" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:33.848629 31763 leader_election.cc:290] T 42f4b6d5299848c89ceb268c1fd088af P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:33.855723 31628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8185106c7a94c3ebaace350d2363217" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31"
I20260709 13:13:33.856606 31628 raft_consensus.cc:3060] T c8185106c7a94c3ebaace350d2363217 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:33.839869 31612 tablet_service.cc:1511] Processing CreateTablet for tablet 0550046442d4469c96ad37cbbb191915 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:13:33.812295 31750 raft_consensus.cc:359] T 4d146b574e8d4e21bd8d81cb29b4267a P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:33.869971 31540 tablet_service.cc:1511] Processing CreateTablet for tablet 88b0a29c38284391bdaea82edf99c771 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:13:33.857885 31758 leader_election.cc:290] T c8185106c7a94c3ebaace350d2363217 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 election: Requested vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:33.890085 31612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0550046442d4469c96ad37cbbb191915. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.890285 31540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88b0a29c38284391bdaea82edf99c771. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.889869 31629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f4b6d5299848c89ceb268c1fd088af" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:33.892848 31669 leader_election.cc:304] T 42f4b6d5299848c89ceb268c1fd088af P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca; no voters: 196d972917fe4f85985e3862d40b7596, c74453754ee34bea9b231ae318a55a31
I20260709 13:13:33.894620 31763 raft_consensus.cc:2749] T 42f4b6d5299848c89ceb268c1fd088af P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:33.831904 31541 tablet_service.cc:1511] Processing CreateTablet for tablet 0550046442d4469c96ad37cbbb191915 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:13:33.903035 31541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0550046442d4469c96ad37cbbb191915. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.886433 31750 raft_consensus.cc:385] T 4d146b574e8d4e21bd8d81cb29b4267a P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:33.910043 31750 raft_consensus.cc:740] T 4d146b574e8d4e21bd8d81cb29b4267a P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:33.911185 31750 consensus_queue.cc:260] T 4d146b574e8d4e21bd8d81cb29b4267a P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:33.916754 31480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8185106c7a94c3ebaace350d2363217" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:33.917937 31748 tablet_bootstrap.cc:492] T bec9a61b8e3c4bc0ba232063b38c8563 P c74453754ee34bea9b231ae318a55a31: No bootstrap required, opened a new log
I20260709 13:13:33.918502 31748 ts_tablet_manager.cc:1403] T bec9a61b8e3c4bc0ba232063b38c8563 P c74453754ee34bea9b231ae318a55a31: Time spent bootstrapping tablet: real 0.237s	user 0.024s	sys 0.016s
I20260709 13:13:33.920708 31628 raft_consensus.cc:2468] T c8185106c7a94c3ebaace350d2363217 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 196d972917fe4f85985e3862d40b7596 in term 1.
I20260709 13:13:33.921815 31479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8185106c7a94c3ebaace350d2363217" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
I20260709 13:13:33.922101 31521 leader_election.cc:304] T c8185106c7a94c3ebaace350d2363217 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, c74453754ee34bea9b231ae318a55a31; no voters: 
I20260709 13:13:33.922868 31748 raft_consensus.cc:359] T bec9a61b8e3c4bc0ba232063b38c8563 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:33.923588 31748 raft_consensus.cc:385] T bec9a61b8e3c4bc0ba232063b38c8563 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:33.923867 31748 raft_consensus.cc:740] T bec9a61b8e3c4bc0ba232063b38c8563 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Initialized, Role: FOLLOWER
W20260709 13:13:33.926934 31520 leader_election.cc:343] T c8185106c7a94c3ebaace350d2363217 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:33.927933 31520 leader_election.cc:343] T c8185106c7a94c3ebaace350d2363217 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:33.930495 31612 tablet_service.cc:1511] Processing CreateTablet for tablet 88b0a29c38284391bdaea82edf99c771 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:13:33.931774 31612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88b0a29c38284391bdaea82edf99c771. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:13:33.932220 31594 consensus_peers.cc:597] T 4fe725ada8f142d1bb9a35a30f865c10 P c74453754ee34bea9b231ae318a55a31 -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:33.935154 31462 tablet_service.cc:1511] Processing CreateTablet for tablet d2a6746f9b2f4b1ab287b9e8f4c51106 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:13:33.935967 31747 tablet_bootstrap.cc:492] T 2568dda6664d4363abc4fd891fa48370 P 196d972917fe4f85985e3862d40b7596: No bootstrap required, opened a new log
I20260709 13:13:33.936499 31747 ts_tablet_manager.cc:1403] T 2568dda6664d4363abc4fd891fa48370 P 196d972917fe4f85985e3862d40b7596: Time spent bootstrapping tablet: real 0.156s	user 0.012s	sys 0.018s
I20260709 13:13:33.936714 31462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2a6746f9b2f4b1ab287b9e8f4c51106. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.940784 31747 raft_consensus.cc:359] T 2568dda6664d4363abc4fd891fa48370 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:33.941571 31747 raft_consensus.cc:385] T 2568dda6664d4363abc4fd891fa48370 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:33.941902 31747 raft_consensus.cc:740] T 2568dda6664d4363abc4fd891fa48370 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 196d972917fe4f85985e3862d40b7596, State: Initialized, Role: FOLLOWER
I20260709 13:13:33.942623 31747 consensus_queue.cc:260] T 2568dda6664d4363abc4fd891fa48370 P 196d972917fe4f85985e3862d40b7596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:33.944299 31800 raft_consensus.cc:2804] T c8185106c7a94c3ebaace350d2363217 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:33.948787 31749 tablet_bootstrap.cc:492] T eb560d89d58246e5856a763e3be6f086 P 76fb155ade354ee1ba78673e73b28aca: No bootstrap required, opened a new log
I20260709 13:13:33.949301 31749 ts_tablet_manager.cc:1403] T eb560d89d58246e5856a763e3be6f086 P 76fb155ade354ee1ba78673e73b28aca: Time spent bootstrapping tablet: real 0.292s	user 0.016s	sys 0.015s
I20260709 13:13:33.950011 31748 consensus_queue.cc:260] T bec9a61b8e3c4bc0ba232063b38c8563 P c74453754ee34bea9b231ae318a55a31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:33.953541 31748 ts_tablet_manager.cc:1434] T bec9a61b8e3c4bc0ba232063b38c8563 P c74453754ee34bea9b231ae318a55a31: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.005s
I20260709 13:13:33.956321 31540 tablet_service.cc:1511] Processing CreateTablet for tablet d2a6746f9b2f4b1ab287b9e8f4c51106 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:13:33.957721 31540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2a6746f9b2f4b1ab287b9e8f4c51106. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.958119 31692 tablet_service.cc:1511] Processing CreateTablet for tablet d2a6746f9b2f4b1ab287b9e8f4c51106 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:13:33.958969 31703 raft_consensus.cc:3060] T 42f4b6d5299848c89ceb268c1fd088af P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:33.961983 31688 tablet_service.cc:1511] Processing CreateTablet for tablet 22ba83039f2d4e2c9089947b949a1790 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:13:33.962074 31614 tablet_service.cc:1511] Processing CreateTablet for tablet 22ba83039f2d4e2c9089947b949a1790 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:13:33.962894 31747 ts_tablet_manager.cc:1434] T 2568dda6664d4363abc4fd891fa48370 P 196d972917fe4f85985e3862d40b7596: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.001s
I20260709 13:13:33.963454 31614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22ba83039f2d4e2c9089947b949a1790. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.963984 31747 tablet_bootstrap.cc:492] T 11617136d6c14faea3cee24e00514101 P 196d972917fe4f85985e3862d40b7596: Bootstrap starting.
I20260709 13:13:33.970858 31804 raft_consensus.cc:493] T bd1c90f0a848434cb7df23dbeae35ddf P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.971388 31804 raft_consensus.cc:515] T bd1c90f0a848434cb7df23dbeae35ddf P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:33.959977 31750 ts_tablet_manager.cc:1434] T 4d146b574e8d4e21bd8d81cb29b4267a P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.210s	user 0.009s	sys 0.000s
I20260709 13:13:33.973130 31692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2a6746f9b2f4b1ab287b9e8f4c51106. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.960175 31800 raft_consensus.cc:697] T c8185106c7a94c3ebaace350d2363217 P 196d972917fe4f85985e3862d40b7596 [term 1 LEADER]: Becoming Leader. State: Replica: 196d972917fe4f85985e3862d40b7596, State: Running, Role: LEADER
I20260709 13:13:33.974493 31749 raft_consensus.cc:359] T eb560d89d58246e5856a763e3be6f086 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:33.975235 31749 raft_consensus.cc:385] T eb560d89d58246e5856a763e3be6f086 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:33.974817 31800 consensus_queue.cc:237] T c8185106c7a94c3ebaace350d2363217 P 196d972917fe4f85985e3862d40b7596 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:33.975539 31749 raft_consensus.cc:740] T eb560d89d58246e5856a763e3be6f086 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Initialized, Role: FOLLOWER
I20260709 13:13:33.978233 31750 tablet_bootstrap.cc:492] T 81f4d53616e74e2ea71e52fdb3e8fc76 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:33.982028 31480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c90f0a848434cb7df23dbeae35ddf" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:33.982900 31480 raft_consensus.cc:2393] T bd1c90f0a848434cb7df23dbeae35ddf P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 196d972917fe4f85985e3862d40b7596 in current term 1: Already voted for candidate 76fb155ade354ee1ba78673e73b28aca in this term.
I20260709 13:13:33.983367 31756 raft_consensus.cc:493] T 4d146b574e8d4e21bd8d81cb29b4267a P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.983865 31756 raft_consensus.cc:515] T 4d146b574e8d4e21bd8d81cb29b4267a P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:33.985100 31688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22ba83039f2d4e2c9089947b949a1790. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.986019 31702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c90f0a848434cb7df23dbeae35ddf" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:33.987869 31521 leader_election.cc:304] T bd1c90f0a848434cb7df23dbeae35ddf P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 196d972917fe4f85985e3862d40b7596; no voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca
I20260709 13:13:33.990541 31771 raft_consensus.cc:3060] T bd1c90f0a848434cb7df23dbeae35ddf P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:33.981069 31804 leader_election.cc:290] T bd1c90f0a848434cb7df23dbeae35ddf P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:33.995072 31756 leader_election.cc:290] T 4d146b574e8d4e21bd8d81cb29b4267a P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715)
I20260709 13:13:33.996549 31629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d146b574e8d4e21bd8d81cb29b4267a" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:33.997707 31702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d146b574e8d4e21bd8d81cb29b4267a" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:33.999465 31747 tablet_bootstrap.cc:654] T 11617136d6c14faea3cee24e00514101 P 196d972917fe4f85985e3862d40b7596: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:33.999325 31803 consensus_queue.cc:1048] T 42f4b6d5299848c89ceb268c1fd088af P 196d972917fe4f85985e3862d40b7596 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:13:33.999823 31446 leader_election.cc:343] T 4d146b574e8d4e21bd8d81cb29b4267a P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:34.000501 31446 leader_election.cc:343] T 4d146b574e8d4e21bd8d81cb29b4267a P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:34.000939 31446 leader_election.cc:304] T 4d146b574e8d4e21bd8d81cb29b4267a P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6; no voters: 76fb155ade354ee1ba78673e73b28aca, c74453754ee34bea9b231ae318a55a31
I20260709 13:13:33.982021 31749 consensus_queue.cc:260] T eb560d89d58246e5856a763e3be6f086 P 76fb155ade354ee1ba78673e73b28aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:34.014398 31462 tablet_service.cc:1511] Processing CreateTablet for tablet 22ba83039f2d4e2c9089947b949a1790 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:13:34.007028 31749 ts_tablet_manager.cc:1434] T eb560d89d58246e5856a763e3be6f086 P 76fb155ade354ee1ba78673e73b28aca: Time spent starting tablet: real 0.057s	user 0.008s	sys 0.000s
I20260709 13:13:34.015787 31756 raft_consensus.cc:2749] T 4d146b574e8d4e21bd8d81cb29b4267a P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:34.016273 31462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22ba83039f2d4e2c9089947b949a1790. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.016449 31749 tablet_bootstrap.cc:492] T e698d6d2e2e74eca91e222e9bfdf8f13 P 76fb155ade354ee1ba78673e73b28aca: Bootstrap starting.
I20260709 13:13:34.034219 31612 tablet_service.cc:1511] Processing CreateTablet for tablet fb97ca15f56b46dd846db7b0ff156a32 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:13:34.035596 31612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb97ca15f56b46dd846db7b0ff156a32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.027230 31748 tablet_bootstrap.cc:492] T 364efc87879c4e6db82a829c76ef0045 P c74453754ee34bea9b231ae318a55a31: Bootstrap starting.
I20260709 13:13:34.044826 31468 tablet_service.cc:1511] Processing CreateTablet for tablet 0c12bd32cd944ce99a18fc4f9617961e (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:13:34.046248 31468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c12bd32cd944ce99a18fc4f9617961e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.054865 31689 tablet_service.cc:1511] Processing CreateTablet for tablet fb97ca15f56b46dd846db7b0ff156a32 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:13:34.055094 31687 tablet_service.cc:1511] Processing CreateTablet for tablet 8a98dff441f1479992f85708c9f03283 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:13:34.056795 31689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb97ca15f56b46dd846db7b0ff156a32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.058490 31687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a98dff441f1479992f85708c9f03283. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.066653 31749 tablet_bootstrap.cc:654] T e698d6d2e2e74eca91e222e9bfdf8f13 P 76fb155ade354ee1ba78673e73b28aca: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.066402 31759 consensus_queue.cc:1048] T 4fe725ada8f142d1bb9a35a30f865c10 P c74453754ee34bea9b231ae318a55a31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:34.073031 31763 raft_consensus.cc:493] T bec9a61b8e3c4bc0ba232063b38c8563 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.074085 31763 raft_consensus.cc:515] T bec9a61b8e3c4bc0ba232063b38c8563 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:34.076840 31555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec9a61b8e3c4bc0ba232063b38c8563" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:34.077471 31555 raft_consensus.cc:2468] T bec9a61b8e3c4bc0ba232063b38c8563 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 0.
I20260709 13:13:34.078737 31666 leader_election.cc:304] T bec9a61b8e3c4bc0ba232063b38c8563 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, 76fb155ade354ee1ba78673e73b28aca; no voters: 
I20260709 13:13:34.081032 31612 tablet_service.cc:1511] Processing CreateTablet for tablet 0c12bd32cd944ce99a18fc4f9617961e (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:13:34.082122 31612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c12bd32cd944ce99a18fc4f9617961e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.079452 31750 tablet_bootstrap.cc:654] T 81f4d53616e74e2ea71e52fdb3e8fc76 P 458d610e8abf4f2ea831ab7bf3576da6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.083307 31789 raft_consensus.cc:2804] T bec9a61b8e3c4bc0ba232063b38c8563 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:34.083696 31789 raft_consensus.cc:493] T bec9a61b8e3c4bc0ba232063b38c8563 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:34.084028 31789 raft_consensus.cc:3060] T bec9a61b8e3c4bc0ba232063b38c8563 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.086917 31748 tablet_bootstrap.cc:654] T 364efc87879c4e6db82a829c76ef0045 P c74453754ee34bea9b231ae318a55a31: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.107458 31759 raft_consensus.cc:493] T 11617136d6c14faea3cee24e00514101 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.107944 31759 raft_consensus.cc:515] T 11617136d6c14faea3cee24e00514101 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:34.107326 31629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec9a61b8e3c4bc0ba232063b38c8563" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:34.110705 31629 raft_consensus.cc:2468] T bec9a61b8e3c4bc0ba232063b38c8563 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 0.
I20260709 13:13:34.101145 31540 tablet_service.cc:1511] Processing CreateTablet for tablet 8a98dff441f1479992f85708c9f03283 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:13:34.092764 31763 leader_election.cc:290] T bec9a61b8e3c4bc0ba232063b38c8563 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:34.101504 31810 raft_consensus.cc:493] T eb560d89d58246e5856a763e3be6f086 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:34.142380 31807 log.cc:927] Time spent T 42f4b6d5299848c89ceb268c1fd088af P 76fb155ade354ee1ba78673e73b28aca: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:13:34.107298 31465 tablet_service.cc:1511] Processing CreateTablet for tablet 8a98dff441f1479992f85708c9f03283 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:13:34.142488 31544 tablet_service.cc:1511] Processing CreateTablet for tablet 0c12bd32cd944ce99a18fc4f9617961e (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:13:34.141464 31759 leader_election.cc:290] T 11617136d6c14faea3cee24e00514101 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:34.149638 31749 tablet_bootstrap.cc:492] T e698d6d2e2e74eca91e222e9bfdf8f13 P 76fb155ade354ee1ba78673e73b28aca: No bootstrap required, opened a new log
I20260709 13:13:34.144623 31540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a98dff441f1479992f85708c9f03283. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.172485 31612 tablet_service.cc:1511] Processing CreateTablet for tablet 1fb28788823d4c5fab527f4ee2da4d2e (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:13:34.173684 31612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fb28788823d4c5fab527f4ee2da4d2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.173648 31375 catalog_manager.cc:5697] T c8185106c7a94c3ebaace350d2363217 P 196d972917fe4f85985e3862d40b7596 reported cstate change: term changed from 0 to 1, leader changed from <none> to 196d972917fe4f85985e3862d40b7596 (127.23.140.66). New cstate: current_term: 1 leader_uuid: "196d972917fe4f85985e3862d40b7596" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:34.175233 31545 tablet_service.cc:1511] Processing CreateTablet for tablet 0f01040b42e14f0db6bcd06319237ddb (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:13:34.176586 31545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f01040b42e14f0db6bcd06319237ddb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.179209 31747 tablet_bootstrap.cc:492] T 11617136d6c14faea3cee24e00514101 P 196d972917fe4f85985e3862d40b7596: No bootstrap required, opened a new log
I20260709 13:13:34.179795 31747 ts_tablet_manager.cc:1403] T 11617136d6c14faea3cee24e00514101 P 196d972917fe4f85985e3862d40b7596: Time spent bootstrapping tablet: real 0.216s	user 0.026s	sys 0.037s
I20260709 13:13:34.136006 31810 raft_consensus.cc:515] T eb560d89d58246e5856a763e3be6f086 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:34.182271 31690 tablet_service.cc:1511] Processing CreateTablet for tablet 1fb28788823d4c5fab527f4ee2da4d2e (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:13:34.183498 31810 leader_election.cc:290] T eb560d89d58246e5856a763e3be6f086 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:34.183699 31690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fb28788823d4c5fab527f4ee2da4d2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.185349 31555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb560d89d58246e5856a763e3be6f086" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
W20260709 13:13:34.186970 31666 leader_election.cc:343] T eb560d89d58246e5856a763e3be6f086 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:34.190171 31465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a98dff441f1479992f85708c9f03283. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.192785 31789 raft_consensus.cc:515] T bec9a61b8e3c4bc0ba232063b38c8563 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:34.170001 31749 ts_tablet_manager.cc:1403] T e698d6d2e2e74eca91e222e9bfdf8f13 P 76fb155ade354ee1ba78673e73b28aca: Time spent bootstrapping tablet: real 0.154s	user 0.022s	sys 0.019s
I20260709 13:13:34.170428 31771 raft_consensus.cc:2749] T bd1c90f0a848434cb7df23dbeae35ddf P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:34.208381 31544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c12bd32cd944ce99a18fc4f9617961e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:13:34.216917 31595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:45715, user_credentials={real_user=slave}} blocked reactor thread for 74094us
I20260709 13:13:34.219347 31480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11617136d6c14faea3cee24e00514101" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:34.220057 31480 raft_consensus.cc:2468] T 11617136d6c14faea3cee24e00514101 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 0.
I20260709 13:13:34.221442 31749 raft_consensus.cc:359] T e698d6d2e2e74eca91e222e9bfdf8f13 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:34.198882 31539 tablet_service.cc:1511] Processing CreateTablet for tablet fb97ca15f56b46dd846db7b0ff156a32 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:13:34.222383 31749 raft_consensus.cc:385] T e698d6d2e2e74eca91e222e9bfdf8f13 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.222740 31749 raft_consensus.cc:740] T e698d6d2e2e74eca91e222e9bfdf8f13 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.221498 31748 tablet_bootstrap.cc:492] T 364efc87879c4e6db82a829c76ef0045 P c74453754ee34bea9b231ae318a55a31: No bootstrap required, opened a new log
I20260709 13:13:34.223073 31542 tablet_service.cc:1511] Processing CreateTablet for tablet dcf07174e49c498f8e19fd005690404b (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:13:34.224292 31479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb560d89d58246e5856a763e3be6f086" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:34.225003 31479 raft_consensus.cc:2468] T eb560d89d58246e5856a763e3be6f086 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 0.
I20260709 13:13:34.225301 31542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcf07174e49c498f8e19fd005690404b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.225844 31688 tablet_service.cc:1511] Processing CreateTablet for tablet 0f01040b42e14f0db6bcd06319237ddb (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:13:34.214200 31464 tablet_service.cc:1511] Processing CreateTablet for tablet 1fb28788823d4c5fab527f4ee2da4d2e (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:13:34.226605 31668 leader_election.cc:304] T eb560d89d58246e5856a763e3be6f086 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca; no voters: 196d972917fe4f85985e3862d40b7596
I20260709 13:13:34.227301 31464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fb28788823d4c5fab527f4ee2da4d2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.228005 31813 raft_consensus.cc:2804] T eb560d89d58246e5856a763e3be6f086 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:34.228453 31813 raft_consensus.cc:493] T eb560d89d58246e5856a763e3be6f086 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:34.228818 31813 raft_consensus.cc:3060] T eb560d89d58246e5856a763e3be6f086 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.226178 31594 leader_election.cc:304] T 11617136d6c14faea3cee24e00514101 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, c74453754ee34bea9b231ae318a55a31; no voters: 
I20260709 13:13:34.229256 31539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb97ca15f56b46dd846db7b0ff156a32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.229473 31748 ts_tablet_manager.cc:1403] T 364efc87879c4e6db82a829c76ef0045 P c74453754ee34bea9b231ae318a55a31: Time spent bootstrapping tablet: real 0.221s	user 0.017s	sys 0.003s
I20260709 13:13:34.233274 31763 consensus_queue.cc:1048] T bd1c90f0a848434cb7df23dbeae35ddf P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:34.233994 31759 raft_consensus.cc:2804] T 11617136d6c14faea3cee24e00514101 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:34.234452 31759 raft_consensus.cc:493] T 11617136d6c14faea3cee24e00514101 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:34.234864 31759 raft_consensus.cc:3060] T 11617136d6c14faea3cee24e00514101 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.237578 31467 tablet_service.cc:1511] Processing CreateTablet for tablet dcf07174e49c498f8e19fd005690404b (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:13:34.246068 31467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcf07174e49c498f8e19fd005690404b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.246802 31749 consensus_queue.cc:260] T e698d6d2e2e74eca91e222e9bfdf8f13 P 76fb155ade354ee1ba78673e73b28aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:34.250077 31688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f01040b42e14f0db6bcd06319237ddb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.250664 31749 ts_tablet_manager.cc:1434] T e698d6d2e2e74eca91e222e9bfdf8f13 P 76fb155ade354ee1ba78673e73b28aca: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.001s
I20260709 13:13:34.258416 31810 consensus_queue.cc:1048] T bd1c90f0a848434cb7df23dbeae35ddf P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:34.267758 31612 tablet_service.cc:1511] Processing CreateTablet for tablet 0f01040b42e14f0db6bcd06319237ddb (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:13:34.276088 31555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec9a61b8e3c4bc0ba232063b38c8563" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596"
I20260709 13:13:34.276837 31555 raft_consensus.cc:3060] T bec9a61b8e3c4bc0ba232063b38c8563 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.278787 31462 tablet_service.cc:1511] Processing CreateTablet for tablet 35bbba26df1b47a7b9923618bf451ffc (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:13:34.280123 31693 tablet_service.cc:1511] Processing CreateTablet for tablet 35bbba26df1b47a7b9923618bf451ffc (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:13:34.281384 31693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35bbba26df1b47a7b9923618bf451ffc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.280145 31462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35bbba26df1b47a7b9923618bf451ffc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.286897 31612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f01040b42e14f0db6bcd06319237ddb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.290283 31614 tablet_service.cc:1511] Processing CreateTablet for tablet dcf07174e49c498f8e19fd005690404b (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:13:34.291620 31614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcf07174e49c498f8e19fd005690404b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.292351 31759 raft_consensus.cc:515] T 11617136d6c14faea3cee24e00514101 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:34.299409 31789 leader_election.cc:290] T bec9a61b8e3c4bc0ba232063b38c8563 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 election: Requested vote from peers 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:34.299530 31800 raft_consensus.cc:493] T 2568dda6664d4363abc4fd891fa48370 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.301782 31800 raft_consensus.cc:515] T 2568dda6664d4363abc4fd891fa48370 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:34.304431 31800 leader_election.cc:290] T 2568dda6664d4363abc4fd891fa48370 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:34.306301 31479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2568dda6664d4363abc4fd891fa48370" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
W20260709 13:13:34.307992 31520 leader_election.cc:343] T 2568dda6664d4363abc4fd891fa48370 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:34.309010 31629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2568dda6664d4363abc4fd891fa48370" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:34.310660 31747 raft_consensus.cc:359] T 11617136d6c14faea3cee24e00514101 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
W20260709 13:13:34.311091 31521 leader_election.cc:343] T 2568dda6664d4363abc4fd891fa48370 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:34.311554 31747 raft_consensus.cc:385] T 11617136d6c14faea3cee24e00514101 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.311758 31521 leader_election.cc:304] T 2568dda6664d4363abc4fd891fa48370 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 196d972917fe4f85985e3862d40b7596; no voters: 458d610e8abf4f2ea831ab7bf3576da6, c74453754ee34bea9b231ae318a55a31
I20260709 13:13:34.312119 31747 raft_consensus.cc:740] T 11617136d6c14faea3cee24e00514101 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 196d972917fe4f85985e3862d40b7596, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.312990 31747 consensus_queue.cc:260] T 11617136d6c14faea3cee24e00514101 P 196d972917fe4f85985e3862d40b7596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:34.314132 31771 raft_consensus.cc:2749] T 2568dda6664d4363abc4fd891fa48370 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:34.315511 31747 ts_tablet_manager.cc:1434] T 11617136d6c14faea3cee24e00514101 P 196d972917fe4f85985e3862d40b7596: Time spent starting tablet: real 0.135s	user 0.008s	sys 0.001s
I20260709 13:13:34.316658 31747 tablet_bootstrap.cc:492] T e698d6d2e2e74eca91e222e9bfdf8f13 P 196d972917fe4f85985e3862d40b7596: Bootstrap starting.
I20260709 13:13:34.317835 31748 raft_consensus.cc:359] T 364efc87879c4e6db82a829c76ef0045 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:34.318621 31748 raft_consensus.cc:385] T 364efc87879c4e6db82a829c76ef0045 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.318933 31748 raft_consensus.cc:740] T 364efc87879c4e6db82a829c76ef0045 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.319729 31748 consensus_queue.cc:260] T 364efc87879c4e6db82a829c76ef0045 P c74453754ee34bea9b231ae318a55a31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:34.331125 31813 raft_consensus.cc:515] T eb560d89d58246e5856a763e3be6f086 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:34.334502 31479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb560d89d58246e5856a763e3be6f086" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
I20260709 13:13:34.335101 31479 raft_consensus.cc:3060] T eb560d89d58246e5856a763e3be6f086 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.329651 31628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec9a61b8e3c4bc0ba232063b38c8563" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31"
I20260709 13:13:34.336263 31628 raft_consensus.cc:3060] T bec9a61b8e3c4bc0ba232063b38c8563 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.337857 31813 leader_election.cc:290] T eb560d89d58246e5856a763e3be6f086 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 election: Requested vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:34.338764 31553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb560d89d58246e5856a763e3be6f086" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596"
W20260709 13:13:34.340296 31666 leader_election.cc:343] T eb560d89d58246e5856a763e3be6f086 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:34.342331 31749 tablet_bootstrap.cc:492] T 364efc87879c4e6db82a829c76ef0045 P 76fb155ade354ee1ba78673e73b28aca: Bootstrap starting.
I20260709 13:13:34.346319 31555 raft_consensus.cc:2468] T bec9a61b8e3c4bc0ba232063b38c8563 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 1.
I20260709 13:13:34.348053 31666 leader_election.cc:304] T bec9a61b8e3c4bc0ba232063b38c8563 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, 76fb155ade354ee1ba78673e73b28aca; no voters: 
I20260709 13:13:34.361162 31555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11617136d6c14faea3cee24e00514101" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:34.361907 31555 raft_consensus.cc:2468] T 11617136d6c14faea3cee24e00514101 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 0.
I20260709 13:13:34.363668 31748 ts_tablet_manager.cc:1434] T 364efc87879c4e6db82a829c76ef0045 P c74453754ee34bea9b231ae318a55a31: Time spent starting tablet: real 0.134s	user 0.006s	sys 0.001s
I20260709 13:13:34.364801 31748 tablet_bootstrap.cc:492] T 4d146b574e8d4e21bd8d81cb29b4267a P c74453754ee34bea9b231ae318a55a31: Bootstrap starting.
I20260709 13:13:34.369884 31540 tablet_service.cc:1511] Processing CreateTablet for tablet 35bbba26df1b47a7b9923618bf451ffc (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:13:34.371186 31540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35bbba26df1b47a7b9923618bf451ffc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.372424 31813 raft_consensus.cc:2804] T bec9a61b8e3c4bc0ba232063b38c8563 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:34.391465 31813 raft_consensus.cc:697] T bec9a61b8e3c4bc0ba232063b38c8563 P 76fb155ade354ee1ba78673e73b28aca [term 1 LEADER]: Becoming Leader. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Running, Role: LEADER
I20260709 13:13:34.402305 31759 leader_election.cc:290] T 11617136d6c14faea3cee24e00514101 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 election: Requested vote from peers 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:34.403692 31612 tablet_service.cc:1511] Processing CreateTablet for tablet ddbfc15d5bf24708a4268dfa206ede07 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:13:34.404600 31612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddbfc15d5bf24708a4268dfa206ede07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.406958 31480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11617136d6c14faea3cee24e00514101" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
I20260709 13:13:34.407430 31628 raft_consensus.cc:2468] T bec9a61b8e3c4bc0ba232063b38c8563 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 1.
I20260709 13:13:34.407608 31480 raft_consensus.cc:3060] T 11617136d6c14faea3cee24e00514101 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.414466 31462 tablet_service.cc:1511] Processing CreateTablet for tablet ddbfc15d5bf24708a4268dfa206ede07 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:13:34.415539 31462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddbfc15d5bf24708a4268dfa206ede07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.419525 31747 tablet_bootstrap.cc:654] T e698d6d2e2e74eca91e222e9bfdf8f13 P 196d972917fe4f85985e3862d40b7596: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.421186 31813 consensus_queue.cc:237] T bec9a61b8e3c4bc0ba232063b38c8563 P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:34.413476 31555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11617136d6c14faea3cee24e00514101" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596"
I20260709 13:13:34.403560 31689 tablet_service.cc:1511] Processing CreateTablet for tablet ddbfc15d5bf24708a4268dfa206ede07 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:13:34.401032 31479 raft_consensus.cc:2468] T eb560d89d58246e5856a763e3be6f086 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 1.
I20260709 13:13:34.432083 31689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddbfc15d5bf24708a4268dfa206ede07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.424656 31555 raft_consensus.cc:3060] T 11617136d6c14faea3cee24e00514101 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.435950 31540 tablet_service.cc:1511] Processing CreateTablet for tablet 3879ebc472ce44d99940e2168e9099bf (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:13:34.437512 31540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3879ebc472ce44d99940e2168e9099bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.443967 31749 tablet_bootstrap.cc:654] T 364efc87879c4e6db82a829c76ef0045 P 76fb155ade354ee1ba78673e73b28aca: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.444837 31750 tablet_bootstrap.cc:492] T 81f4d53616e74e2ea71e52fdb3e8fc76 P 458d610e8abf4f2ea831ab7bf3576da6: No bootstrap required, opened a new log
I20260709 13:13:34.445405 31750 ts_tablet_manager.cc:1403] T 81f4d53616e74e2ea71e52fdb3e8fc76 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.473s	user 0.024s	sys 0.013s
I20260709 13:13:34.448443 31748 tablet_bootstrap.cc:654] T 4d146b574e8d4e21bd8d81cb29b4267a P c74453754ee34bea9b231ae318a55a31: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.448395 31750 raft_consensus.cc:359] T 81f4d53616e74e2ea71e52fdb3e8fc76 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:34.449236 31750 raft_consensus.cc:385] T 81f4d53616e74e2ea71e52fdb3e8fc76 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.449577 31750 raft_consensus.cc:740] T 81f4d53616e74e2ea71e52fdb3e8fc76 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.450325 31750 consensus_queue.cc:260] T 81f4d53616e74e2ea71e52fdb3e8fc76 P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:34.452906 31750 ts_tablet_manager.cc:1434] T 81f4d53616e74e2ea71e52fdb3e8fc76 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:13:34.453971 31750 tablet_bootstrap.cc:492] T 2568dda6664d4363abc4fd891fa48370 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:34.472170 31612 tablet_service.cc:1511] Processing CreateTablet for tablet 3879ebc472ce44d99940e2168e9099bf (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:13:34.473389 31612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3879ebc472ce44d99940e2168e9099bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.476913 31480 raft_consensus.cc:2468] T 11617136d6c14faea3cee24e00514101 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 1.
I20260709 13:13:34.467001 31668 leader_election.cc:304] T eb560d89d58246e5856a763e3be6f086 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca; no voters: 196d972917fe4f85985e3862d40b7596
I20260709 13:13:34.478088 31594 leader_election.cc:304] T 11617136d6c14faea3cee24e00514101 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, c74453754ee34bea9b231ae318a55a31; no voters: 
I20260709 13:13:34.479497 31759 raft_consensus.cc:2804] T 11617136d6c14faea3cee24e00514101 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:34.480000 31759 raft_consensus.cc:697] T 11617136d6c14faea3cee24e00514101 P c74453754ee34bea9b231ae318a55a31 [term 1 LEADER]: Becoming Leader. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Running, Role: LEADER
I20260709 13:13:34.480888 31759 consensus_queue.cc:237] T 11617136d6c14faea3cee24e00514101 P c74453754ee34bea9b231ae318a55a31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:34.491827 31813 raft_consensus.cc:2804] T eb560d89d58246e5856a763e3be6f086 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:34.492384 31813 raft_consensus.cc:697] T eb560d89d58246e5856a763e3be6f086 P 76fb155ade354ee1ba78673e73b28aca [term 1 LEADER]: Becoming Leader. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Running, Role: LEADER
I20260709 13:13:34.492100 31378 catalog_manager.cc:5697] T bec9a61b8e3c4bc0ba232063b38c8563 P 76fb155ade354ee1ba78673e73b28aca reported cstate change: term changed from 0 to 1, leader changed from <none> to 76fb155ade354ee1ba78673e73b28aca (127.23.140.68). New cstate: current_term: 1 leader_uuid: "76fb155ade354ee1ba78673e73b28aca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:34.493254 31813 consensus_queue.cc:237] T eb560d89d58246e5856a763e3be6f086 P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:34.505281 31462 tablet_service.cc:1511] Processing CreateTablet for tablet cfe1afd9e187451faf5f631e0c2eef00 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:13:34.505836 31750 tablet_bootstrap.cc:654] T 2568dda6664d4363abc4fd891fa48370 P 458d610e8abf4f2ea831ab7bf3576da6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.506609 31462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfe1afd9e187451faf5f631e0c2eef00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.485524 31555 raft_consensus.cc:2468] T 11617136d6c14faea3cee24e00514101 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 1.
I20260709 13:13:34.510748 31690 tablet_service.cc:1511] Processing CreateTablet for tablet 3879ebc472ce44d99940e2168e9099bf (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:13:34.514578 31544 tablet_service.cc:1511] Processing CreateTablet for tablet cfe1afd9e187451faf5f631e0c2eef00 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:13:34.521150 31688 tablet_service.cc:1511] Processing CreateTablet for tablet 76a7de5cfe774df68279e2e1e7361c6b (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:13:34.522677 31690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3879ebc472ce44d99940e2168e9099bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.526427 31377 catalog_manager.cc:5697] T 11617136d6c14faea3cee24e00514101 P c74453754ee34bea9b231ae318a55a31 reported cstate change: term changed from 0 to 1, leader changed from <none> to c74453754ee34bea9b231ae318a55a31 (127.23.140.67). New cstate: current_term: 1 leader_uuid: "c74453754ee34bea9b231ae318a55a31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:34.527595 31467 tablet_service.cc:1511] Processing CreateTablet for tablet 76a7de5cfe774df68279e2e1e7361c6b (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:13:34.528272 31545 tablet_service.cc:1511] Processing CreateTablet for tablet 76a7de5cfe774df68279e2e1e7361c6b (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:13:34.529397 31467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76a7de5cfe774df68279e2e1e7361c6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.531032 31544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfe1afd9e187451faf5f631e0c2eef00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.534130 31545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76a7de5cfe774df68279e2e1e7361c6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.520645 31614 tablet_service.cc:1511] Processing CreateTablet for tablet cfe1afd9e187451faf5f631e0c2eef00 (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:13:34.539880 31688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76a7de5cfe774df68279e2e1e7361c6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.544482 31465 tablet_service.cc:1511] Processing CreateTablet for tablet 70ccde113c9246f5a008add70aacae7d (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:13:34.541738 31612 tablet_service.cc:1511] Processing CreateTablet for tablet 70ccde113c9246f5a008add70aacae7d (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:13:34.541368 31614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfe1afd9e187451faf5f631e0c2eef00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.546948 31693 tablet_service.cc:1511] Processing CreateTablet for tablet 70ccde113c9246f5a008add70aacae7d (DEFAULT_TABLE table=test-workload [id=708ce8e5f8084fd1bc972b46328462f4]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:13:34.548302 31693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70ccde113c9246f5a008add70aacae7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.549182 31817 raft_consensus.cc:493] T 364efc87879c4e6db82a829c76ef0045 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.549726 31817 raft_consensus.cc:515] T 364efc87879c4e6db82a829c76ef0045 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:34.551986 31817 leader_election.cc:290] T 364efc87879c4e6db82a829c76ef0045 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:34.555151 31702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "364efc87879c4e6db82a829c76ef0045" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
W20260709 13:13:34.556948 31595 leader_election.cc:343] T 364efc87879c4e6db82a829c76ef0045 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:34.559305 31480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "364efc87879c4e6db82a829c76ef0045" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
W20260709 13:13:34.560784 31594 leader_election.cc:343] T 364efc87879c4e6db82a829c76ef0045 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:34.561262 31594 leader_election.cc:304] T 364efc87879c4e6db82a829c76ef0045 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c74453754ee34bea9b231ae318a55a31; no voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca
I20260709 13:13:34.562419 31759 raft_consensus.cc:2749] T 364efc87879c4e6db82a829c76ef0045 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:34.582226 31612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70ccde113c9246f5a008add70aacae7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.581775 31465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70ccde113c9246f5a008add70aacae7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.596649 31747 tablet_bootstrap.cc:492] T e698d6d2e2e74eca91e222e9bfdf8f13 P 196d972917fe4f85985e3862d40b7596: No bootstrap required, opened a new log
I20260709 13:13:34.597229 31747 ts_tablet_manager.cc:1403] T e698d6d2e2e74eca91e222e9bfdf8f13 P 196d972917fe4f85985e3862d40b7596: Time spent bootstrapping tablet: real 0.281s	user 0.011s	sys 0.005s
I20260709 13:13:34.597282 31804 consensus_queue.cc:1048] T c8185106c7a94c3ebaace350d2363217 P 196d972917fe4f85985e3862d40b7596 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:34.598558 31748 tablet_bootstrap.cc:492] T 4d146b574e8d4e21bd8d81cb29b4267a P c74453754ee34bea9b231ae318a55a31: No bootstrap required, opened a new log
I20260709 13:13:34.599067 31748 ts_tablet_manager.cc:1403] T 4d146b574e8d4e21bd8d81cb29b4267a P c74453754ee34bea9b231ae318a55a31: Time spent bootstrapping tablet: real 0.234s	user 0.042s	sys 0.032s
I20260709 13:13:34.602797 31748 raft_consensus.cc:359] T 4d146b574e8d4e21bd8d81cb29b4267a P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:34.603560 31748 raft_consensus.cc:385] T 4d146b574e8d4e21bd8d81cb29b4267a P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.603863 31748 raft_consensus.cc:740] T 4d146b574e8d4e21bd8d81cb29b4267a P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.604341 31377 catalog_manager.cc:5697] T eb560d89d58246e5856a763e3be6f086 P 76fb155ade354ee1ba78673e73b28aca reported cstate change: term changed from 0 to 1, leader changed from <none> to 76fb155ade354ee1ba78673e73b28aca (127.23.140.68). New cstate: current_term: 1 leader_uuid: "76fb155ade354ee1ba78673e73b28aca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:34.600306 31747 raft_consensus.cc:359] T e698d6d2e2e74eca91e222e9bfdf8f13 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
W20260709 13:13:34.608230 31520 consensus_peers.cc:597] T c8185106c7a94c3ebaace350d2363217 P 196d972917fe4f85985e3862d40b7596 -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:34.608134 31747 raft_consensus.cc:385] T e698d6d2e2e74eca91e222e9bfdf8f13 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.610019 31747 raft_consensus.cc:740] T e698d6d2e2e74eca91e222e9bfdf8f13 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 196d972917fe4f85985e3862d40b7596, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.604640 31748 consensus_queue.cc:260] T 4d146b574e8d4e21bd8d81cb29b4267a P c74453754ee34bea9b231ae318a55a31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:34.612870 31747 consensus_queue.cc:260] T e698d6d2e2e74eca91e222e9bfdf8f13 P 196d972917fe4f85985e3862d40b7596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:34.614506 31748 ts_tablet_manager.cc:1434] T 4d146b574e8d4e21bd8d81cb29b4267a P c74453754ee34bea9b231ae318a55a31: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.002s
I20260709 13:13:34.615592 31748 tablet_bootstrap.cc:492] T 2568dda6664d4363abc4fd891fa48370 P c74453754ee34bea9b231ae318a55a31: Bootstrap starting.
I20260709 13:13:34.615903 31749 tablet_bootstrap.cc:492] T 364efc87879c4e6db82a829c76ef0045 P 76fb155ade354ee1ba78673e73b28aca: No bootstrap required, opened a new log
I20260709 13:13:34.616417 31749 ts_tablet_manager.cc:1403] T 364efc87879c4e6db82a829c76ef0045 P 76fb155ade354ee1ba78673e73b28aca: Time spent bootstrapping tablet: real 0.274s	user 0.016s	sys 0.004s
I20260709 13:13:34.619295 31749 raft_consensus.cc:359] T 364efc87879c4e6db82a829c76ef0045 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:34.620203 31749 raft_consensus.cc:385] T 364efc87879c4e6db82a829c76ef0045 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.620573 31749 raft_consensus.cc:740] T 364efc87879c4e6db82a829c76ef0045 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.621464 31749 consensus_queue.cc:260] T 364efc87879c4e6db82a829c76ef0045 P 76fb155ade354ee1ba78673e73b28aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:34.625161 31756 raft_consensus.cc:493] T 81f4d53616e74e2ea71e52fdb3e8fc76 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.625679 31756 raft_consensus.cc:515] T 81f4d53616e74e2ea71e52fdb3e8fc76 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
W20260709 13:13:34.627696 31426 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:34.627799 31756 leader_election.cc:290] T 81f4d53616e74e2ea71e52fdb3e8fc76 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:34.630049 31555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f4d53616e74e2ea71e52fdb3e8fc76" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
W20260709 13:13:34.631970 31443 leader_election.cc:343] T 81f4d53616e74e2ea71e52fdb3e8fc76 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:34.633389 31629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f4d53616e74e2ea71e52fdb3e8fc76" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
W20260709 13:13:34.635938 31446 leader_election.cc:343] T 81f4d53616e74e2ea71e52fdb3e8fc76 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:34.636061 31750 tablet_bootstrap.cc:492] T 2568dda6664d4363abc4fd891fa48370 P 458d610e8abf4f2ea831ab7bf3576da6: No bootstrap required, opened a new log
I20260709 13:13:34.637180 31446 leader_election.cc:304] T 81f4d53616e74e2ea71e52fdb3e8fc76 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6; no voters: 196d972917fe4f85985e3862d40b7596, c74453754ee34bea9b231ae318a55a31
I20260709 13:13:34.637508 31750 ts_tablet_manager.cc:1403] T 2568dda6664d4363abc4fd891fa48370 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.184s	user 0.014s	sys 0.007s
I20260709 13:13:34.638464 31756 raft_consensus.cc:2749] T 81f4d53616e74e2ea71e52fdb3e8fc76 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:34.640555 31750 raft_consensus.cc:359] T 2568dda6664d4363abc4fd891fa48370 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:34.641124 31750 raft_consensus.cc:385] T 2568dda6664d4363abc4fd891fa48370 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.641378 31750 raft_consensus.cc:740] T 2568dda6664d4363abc4fd891fa48370 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.642066 31750 consensus_queue.cc:260] T 2568dda6664d4363abc4fd891fa48370 P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:34.644023 31750 ts_tablet_manager.cc:1434] T 2568dda6664d4363abc4fd891fa48370 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:13:34.645083 31749 ts_tablet_manager.cc:1434] T 364efc87879c4e6db82a829c76ef0045 P 76fb155ade354ee1ba78673e73b28aca: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:13:34.645325 31750 tablet_bootstrap.cc:492] T 364efc87879c4e6db82a829c76ef0045 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:34.619603 31747 ts_tablet_manager.cc:1434] T e698d6d2e2e74eca91e222e9bfdf8f13 P 196d972917fe4f85985e3862d40b7596: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.001s
I20260709 13:13:34.650506 31748 tablet_bootstrap.cc:654] T 2568dda6664d4363abc4fd891fa48370 P c74453754ee34bea9b231ae318a55a31: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.658042 31747 tablet_bootstrap.cc:492] T eb560d89d58246e5856a763e3be6f086 P 196d972917fe4f85985e3862d40b7596: Bootstrap starting.
I20260709 13:13:34.651087 31749 tablet_bootstrap.cc:492] T 4d146b574e8d4e21bd8d81cb29b4267a P 76fb155ade354ee1ba78673e73b28aca: Bootstrap starting.
I20260709 13:13:34.665352 31749 tablet_bootstrap.cc:654] T 4d146b574e8d4e21bd8d81cb29b4267a P 76fb155ade354ee1ba78673e73b28aca: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.656905 31750 tablet_bootstrap.cc:654] T 364efc87879c4e6db82a829c76ef0045 P 458d610e8abf4f2ea831ab7bf3576da6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.670599 31747 tablet_bootstrap.cc:654] T eb560d89d58246e5856a763e3be6f086 P 196d972917fe4f85985e3862d40b7596: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.671635 31748 tablet_bootstrap.cc:492] T 2568dda6664d4363abc4fd891fa48370 P c74453754ee34bea9b231ae318a55a31: No bootstrap required, opened a new log
I20260709 13:13:34.672115 31748 ts_tablet_manager.cc:1403] T 2568dda6664d4363abc4fd891fa48370 P c74453754ee34bea9b231ae318a55a31: Time spent bootstrapping tablet: real 0.057s	user 0.010s	sys 0.000s
I20260709 13:13:34.674773 31748 raft_consensus.cc:359] T 2568dda6664d4363abc4fd891fa48370 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:34.675412 31748 raft_consensus.cc:385] T 2568dda6664d4363abc4fd891fa48370 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.675657 31748 raft_consensus.cc:740] T 2568dda6664d4363abc4fd891fa48370 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.678728 31748 consensus_queue.cc:260] T 2568dda6664d4363abc4fd891fa48370 P c74453754ee34bea9b231ae318a55a31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:34.681413 31750 tablet_bootstrap.cc:492] T 364efc87879c4e6db82a829c76ef0045 P 458d610e8abf4f2ea831ab7bf3576da6: No bootstrap required, opened a new log
I20260709 13:13:34.682436 31750 ts_tablet_manager.cc:1403] T 364efc87879c4e6db82a829c76ef0045 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.003s
I20260709 13:13:34.688268 31748 ts_tablet_manager.cc:1434] T 2568dda6664d4363abc4fd891fa48370 P c74453754ee34bea9b231ae318a55a31: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:13:34.689280 31748 tablet_bootstrap.cc:492] T 3e09c2945641463e91365b4826cc47e3 P c74453754ee34bea9b231ae318a55a31: Bootstrap starting.
I20260709 13:13:34.689847 31747 tablet_bootstrap.cc:492] T eb560d89d58246e5856a763e3be6f086 P 196d972917fe4f85985e3862d40b7596: No bootstrap required, opened a new log
I20260709 13:13:34.690521 31747 ts_tablet_manager.cc:1403] T eb560d89d58246e5856a763e3be6f086 P 196d972917fe4f85985e3862d40b7596: Time spent bootstrapping tablet: real 0.033s	user 0.013s	sys 0.009s
I20260709 13:13:34.689908 31750 raft_consensus.cc:359] T 364efc87879c4e6db82a829c76ef0045 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:34.690951 31750 raft_consensus.cc:385] T 364efc87879c4e6db82a829c76ef0045 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.691323 31750 raft_consensus.cc:740] T 364efc87879c4e6db82a829c76ef0045 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.692137 31750 consensus_queue.cc:260] T 364efc87879c4e6db82a829c76ef0045 P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:34.693737 31749 tablet_bootstrap.cc:492] T 4d146b574e8d4e21bd8d81cb29b4267a P 76fb155ade354ee1ba78673e73b28aca: No bootstrap required, opened a new log
I20260709 13:13:34.693519 31747 raft_consensus.cc:359] T eb560d89d58246e5856a763e3be6f086 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:34.694232 31749 ts_tablet_manager.cc:1403] T 4d146b574e8d4e21bd8d81cb29b4267a P 76fb155ade354ee1ba78673e73b28aca: Time spent bootstrapping tablet: real 0.043s	user 0.010s	sys 0.000s
I20260709 13:13:34.694361 31789 raft_consensus.cc:493] T e698d6d2e2e74eca91e222e9bfdf8f13 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.694979 31750 ts_tablet_manager.cc:1434] T 364efc87879c4e6db82a829c76ef0045 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 13:13:34.694893 31789 raft_consensus.cc:515] T e698d6d2e2e74eca91e222e9bfdf8f13 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:34.696066 31750 tablet_bootstrap.cc:492] T e698d6d2e2e74eca91e222e9bfdf8f13 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:34.697075 31789 leader_election.cc:290] T e698d6d2e2e74eca91e222e9bfdf8f13 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:34.696923 31749 raft_consensus.cc:359] T 4d146b574e8d4e21bd8d81cb29b4267a P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:34.700104 31480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e698d6d2e2e74eca91e222e9bfdf8f13" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:34.701365 31555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e698d6d2e2e74eca91e222e9bfdf8f13" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:34.701565 31756 raft_consensus.cc:493] T 2568dda6664d4363abc4fd891fa48370 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.702104 31756 raft_consensus.cc:515] T 2568dda6664d4363abc4fd891fa48370 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:34.702883 31750 tablet_bootstrap.cc:654] T e698d6d2e2e74eca91e222e9bfdf8f13 P 458d610e8abf4f2ea831ab7bf3576da6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.703991 31756 leader_election.cc:290] T 2568dda6664d4363abc4fd891fa48370 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:34.705232 31554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2568dda6664d4363abc4fd891fa48370" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:34.697654 31749 raft_consensus.cc:385] T 4d146b574e8d4e21bd8d81cb29b4267a P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.707582 31628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2568dda6664d4363abc4fd891fa48370" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:34.709388 31628 raft_consensus.cc:2468] T 2568dda6664d4363abc4fd891fa48370 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 0.
W20260709 13:13:34.708453 31668 leader_election.cc:343] T e698d6d2e2e74eca91e222e9bfdf8f13 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:34.709303 31554 raft_consensus.cc:2468] T 2568dda6664d4363abc4fd891fa48370 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 0.
I20260709 13:13:34.711230 31749 raft_consensus.cc:740] T 4d146b574e8d4e21bd8d81cb29b4267a P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.711143 31446 leader_election.cc:304] T 2568dda6664d4363abc4fd891fa48370 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, c74453754ee34bea9b231ae318a55a31; no voters: 
I20260709 13:13:34.712266 31749 consensus_queue.cc:260] T 4d146b574e8d4e21bd8d81cb29b4267a P 76fb155ade354ee1ba78673e73b28aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:34.712503 31756 raft_consensus.cc:2804] T 2568dda6664d4363abc4fd891fa48370 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:34.702044 31555 raft_consensus.cc:2468] T e698d6d2e2e74eca91e222e9bfdf8f13 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 0.
I20260709 13:13:34.712949 31747 raft_consensus.cc:385] T eb560d89d58246e5856a763e3be6f086 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.714990 31747 raft_consensus.cc:740] T eb560d89d58246e5856a763e3be6f086 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 196d972917fe4f85985e3862d40b7596, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.715721 31747 consensus_queue.cc:260] T eb560d89d58246e5856a763e3be6f086 P 196d972917fe4f85985e3862d40b7596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:34.717540 31747 ts_tablet_manager.cc:1434] T eb560d89d58246e5856a763e3be6f086 P 196d972917fe4f85985e3862d40b7596: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.000s
I20260709 13:13:34.718510 31747 tablet_bootstrap.cc:492] T 3e09c2945641463e91365b4826cc47e3 P 196d972917fe4f85985e3862d40b7596: Bootstrap starting.
I20260709 13:13:34.713173 31756 raft_consensus.cc:493] T 2568dda6664d4363abc4fd891fa48370 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:34.719794 31756 raft_consensus.cc:3060] T 2568dda6664d4363abc4fd891fa48370 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.724498 31747 tablet_bootstrap.cc:654] T 3e09c2945641463e91365b4826cc47e3 P 196d972917fe4f85985e3862d40b7596: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.727945 31750 tablet_bootstrap.cc:492] T e698d6d2e2e74eca91e222e9bfdf8f13 P 458d610e8abf4f2ea831ab7bf3576da6: No bootstrap required, opened a new log
I20260709 13:13:34.728415 31750 ts_tablet_manager.cc:1403] T e698d6d2e2e74eca91e222e9bfdf8f13 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.033s	user 0.019s	sys 0.011s
I20260709 13:13:34.730695 31750 raft_consensus.cc:359] T e698d6d2e2e74eca91e222e9bfdf8f13 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:34.714506 31666 leader_election.cc:304] T e698d6d2e2e74eca91e222e9bfdf8f13 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, 76fb155ade354ee1ba78673e73b28aca; no voters: 458d610e8abf4f2ea831ab7bf3576da6
I20260709 13:13:34.731951 31789 raft_consensus.cc:2804] T e698d6d2e2e74eca91e222e9bfdf8f13 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:34.714573 31748 tablet_bootstrap.cc:654] T 3e09c2945641463e91365b4826cc47e3 P c74453754ee34bea9b231ae318a55a31: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.732324 31789 raft_consensus.cc:493] T e698d6d2e2e74eca91e222e9bfdf8f13 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:34.732833 31789 raft_consensus.cc:3060] T e698d6d2e2e74eca91e222e9bfdf8f13 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.714483 31749 ts_tablet_manager.cc:1434] T 4d146b574e8d4e21bd8d81cb29b4267a P 76fb155ade354ee1ba78673e73b28aca: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:13:34.734612 31749 tablet_bootstrap.cc:492] T 3e09c2945641463e91365b4826cc47e3 P 76fb155ade354ee1ba78673e73b28aca: Bootstrap starting.
I20260709 13:13:34.735594 31747 tablet_bootstrap.cc:492] T 3e09c2945641463e91365b4826cc47e3 P 196d972917fe4f85985e3862d40b7596: No bootstrap required, opened a new log
I20260709 13:13:34.736086 31747 ts_tablet_manager.cc:1403] T 3e09c2945641463e91365b4826cc47e3 P 196d972917fe4f85985e3862d40b7596: Time spent bootstrapping tablet: real 0.018s	user 0.006s	sys 0.004s
I20260709 13:13:34.731336 31750 raft_consensus.cc:385] T e698d6d2e2e74eca91e222e9bfdf8f13 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.738794 31750 raft_consensus.cc:740] T e698d6d2e2e74eca91e222e9bfdf8f13 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.738919 31747 raft_consensus.cc:359] T 3e09c2945641463e91365b4826cc47e3 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:34.739671 31747 raft_consensus.cc:385] T 3e09c2945641463e91365b4826cc47e3 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.739609 31750 consensus_queue.cc:260] T e698d6d2e2e74eca91e222e9bfdf8f13 P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:34.740072 31747 raft_consensus.cc:740] T 3e09c2945641463e91365b4826cc47e3 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 196d972917fe4f85985e3862d40b7596, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.740893 31747 consensus_queue.cc:260] T 3e09c2945641463e91365b4826cc47e3 P 196d972917fe4f85985e3862d40b7596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:34.742420 31749 tablet_bootstrap.cc:654] T 3e09c2945641463e91365b4826cc47e3 P 76fb155ade354ee1ba78673e73b28aca: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.750834 31750 ts_tablet_manager.cc:1434] T e698d6d2e2e74eca91e222e9bfdf8f13 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.002s
I20260709 13:13:34.751327 31747 ts_tablet_manager.cc:1434] T 3e09c2945641463e91365b4826cc47e3 P 196d972917fe4f85985e3862d40b7596: Time spent starting tablet: real 0.015s	user 0.001s	sys 0.005s
I20260709 13:13:34.755275 31747 tablet_bootstrap.cc:492] T 81f4d53616e74e2ea71e52fdb3e8fc76 P 196d972917fe4f85985e3862d40b7596: Bootstrap starting.
I20260709 13:13:34.757427 31750 tablet_bootstrap.cc:492] T 4fe725ada8f142d1bb9a35a30f865c10 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:34.760205 31756 raft_consensus.cc:515] T 2568dda6664d4363abc4fd891fa48370 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:34.762440 31748 tablet_bootstrap.cc:492] T 3e09c2945641463e91365b4826cc47e3 P c74453754ee34bea9b231ae318a55a31: No bootstrap required, opened a new log
I20260709 13:13:34.762995 31555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2568dda6664d4363abc4fd891fa48370" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596"
I20260709 13:13:34.764528 31749 tablet_bootstrap.cc:492] T 3e09c2945641463e91365b4826cc47e3 P 76fb155ade354ee1ba78673e73b28aca: No bootstrap required, opened a new log
I20260709 13:13:34.765990 31747 tablet_bootstrap.cc:654] T 81f4d53616e74e2ea71e52fdb3e8fc76 P 196d972917fe4f85985e3862d40b7596: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.766050 31555 raft_consensus.cc:3060] T 2568dda6664d4363abc4fd891fa48370 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.766290 31750 tablet_bootstrap.cc:654] T 4fe725ada8f142d1bb9a35a30f865c10 P 458d610e8abf4f2ea831ab7bf3576da6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.766405 31749 ts_tablet_manager.cc:1403] T 3e09c2945641463e91365b4826cc47e3 P 76fb155ade354ee1ba78673e73b28aca: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.000s
I20260709 13:13:34.769341 31749 raft_consensus.cc:359] T 3e09c2945641463e91365b4826cc47e3 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:34.770021 31749 raft_consensus.cc:385] T 3e09c2945641463e91365b4826cc47e3 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.770289 31749 raft_consensus.cc:740] T 3e09c2945641463e91365b4826cc47e3 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.771026 31749 consensus_queue.cc:260] T 3e09c2945641463e91365b4826cc47e3 P 76fb155ade354ee1ba78673e73b28aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:34.765096 31789 raft_consensus.cc:515] T e698d6d2e2e74eca91e222e9bfdf8f13 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:34.773555 31555 raft_consensus.cc:2468] T 2568dda6664d4363abc4fd891fa48370 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 1.
I20260709 13:13:34.774282 31480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e698d6d2e2e74eca91e222e9bfdf8f13" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
I20260709 13:13:34.774904 31480 raft_consensus.cc:3060] T e698d6d2e2e74eca91e222e9bfdf8f13 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.774756 31443 leader_election.cc:304] T 2568dda6664d4363abc4fd891fa48370 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, 458d610e8abf4f2ea831ab7bf3576da6; no voters: 
I20260709 13:13:34.775671 31838 raft_consensus.cc:2804] T 2568dda6664d4363abc4fd891fa48370 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:34.775882 31756 leader_election.cc:290] T 2568dda6664d4363abc4fd891fa48370 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 election: Requested vote from peers 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:34.766067 31748 ts_tablet_manager.cc:1403] T 3e09c2945641463e91365b4826cc47e3 P c74453754ee34bea9b231ae318a55a31: Time spent bootstrapping tablet: real 0.077s	user 0.022s	sys 0.012s
I20260709 13:13:34.775369 31750 tablet_bootstrap.cc:492] T 4fe725ada8f142d1bb9a35a30f865c10 P 458d610e8abf4f2ea831ab7bf3576da6: No bootstrap required, opened a new log
I20260709 13:13:34.779613 31750 ts_tablet_manager.cc:1403] T 4fe725ada8f142d1bb9a35a30f865c10 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.022s	user 0.008s	sys 0.006s
I20260709 13:13:34.779394 31748 raft_consensus.cc:359] T 3e09c2945641463e91365b4826cc47e3 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:34.780109 31748 raft_consensus.cc:385] T 3e09c2945641463e91365b4826cc47e3 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.780419 31748 raft_consensus.cc:740] T 3e09c2945641463e91365b4826cc47e3 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.781198 31748 consensus_queue.cc:260] T 3e09c2945641463e91365b4826cc47e3 P c74453754ee34bea9b231ae318a55a31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:34.783180 31628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2568dda6664d4363abc4fd891fa48370" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31"
I20260709 13:13:34.783725 31628 raft_consensus.cc:3060] T 2568dda6664d4363abc4fd891fa48370 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.786134 31749 ts_tablet_manager.cc:1434] T 3e09c2945641463e91365b4826cc47e3 P 76fb155ade354ee1ba78673e73b28aca: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:13:34.787156 31748 ts_tablet_manager.cc:1434] T 3e09c2945641463e91365b4826cc47e3 P c74453754ee34bea9b231ae318a55a31: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:13:34.787400 31749 tablet_bootstrap.cc:492] T 40ab5d7d13ee4460933b5799482e3f87 P 76fb155ade354ee1ba78673e73b28aca: Bootstrap starting.
I20260709 13:13:34.788082 31748 tablet_bootstrap.cc:492] T 81f4d53616e74e2ea71e52fdb3e8fc76 P c74453754ee34bea9b231ae318a55a31: Bootstrap starting.
I20260709 13:13:34.791493 31750 raft_consensus.cc:359] T 4fe725ada8f142d1bb9a35a30f865c10 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:34.792351 31750 raft_consensus.cc:385] T 4fe725ada8f142d1bb9a35a30f865c10 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.792701 31750 raft_consensus.cc:740] T 4fe725ada8f142d1bb9a35a30f865c10 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.794817 31748 tablet_bootstrap.cc:654] T 81f4d53616e74e2ea71e52fdb3e8fc76 P c74453754ee34bea9b231ae318a55a31: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.793537 31750 consensus_queue.cc:260] T 4fe725ada8f142d1bb9a35a30f865c10 P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:34.800810 31480 raft_consensus.cc:2468] T e698d6d2e2e74eca91e222e9bfdf8f13 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 1.
I20260709 13:13:34.802047 31668 leader_election.cc:304] T e698d6d2e2e74eca91e222e9bfdf8f13 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca; no voters: 
I20260709 13:13:34.802930 31813 raft_consensus.cc:2804] T e698d6d2e2e74eca91e222e9bfdf8f13 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:34.803408 31555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e698d6d2e2e74eca91e222e9bfdf8f13" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596"
I20260709 13:13:34.804030 31813 raft_consensus.cc:697] T e698d6d2e2e74eca91e222e9bfdf8f13 P 76fb155ade354ee1ba78673e73b28aca [term 1 LEADER]: Becoming Leader. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Running, Role: LEADER
I20260709 13:13:34.804149 31789 leader_election.cc:290] T e698d6d2e2e74eca91e222e9bfdf8f13 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 election: Requested vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:34.805274 31813 consensus_queue.cc:237] T e698d6d2e2e74eca91e222e9bfdf8f13 P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:34.804049 31555 raft_consensus.cc:3060] T e698d6d2e2e74eca91e222e9bfdf8f13 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.816859 31749 tablet_bootstrap.cc:654] T 40ab5d7d13ee4460933b5799482e3f87 P 76fb155ade354ee1ba78673e73b28aca: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.821393 31748 tablet_bootstrap.cc:492] T 81f4d53616e74e2ea71e52fdb3e8fc76 P c74453754ee34bea9b231ae318a55a31: No bootstrap required, opened a new log
I20260709 13:13:34.821915 31748 ts_tablet_manager.cc:1403] T 81f4d53616e74e2ea71e52fdb3e8fc76 P c74453754ee34bea9b231ae318a55a31: Time spent bootstrapping tablet: real 0.034s	user 0.017s	sys 0.000s
I20260709 13:13:34.824951 31748 raft_consensus.cc:359] T 81f4d53616e74e2ea71e52fdb3e8fc76 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:34.825623 31748 raft_consensus.cc:385] T 81f4d53616e74e2ea71e52fdb3e8fc76 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.826016 31748 raft_consensus.cc:740] T 81f4d53616e74e2ea71e52fdb3e8fc76 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.826772 31748 consensus_queue.cc:260] T 81f4d53616e74e2ea71e52fdb3e8fc76 P c74453754ee34bea9b231ae318a55a31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:34.829320 31756 raft_consensus.cc:493] T 364efc87879c4e6db82a829c76ef0045 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.821637 31555 raft_consensus.cc:2468] T e698d6d2e2e74eca91e222e9bfdf8f13 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 1.
I20260709 13:13:34.830322 31756 raft_consensus.cc:515] T 364efc87879c4e6db82a829c76ef0045 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:34.831995 31748 ts_tablet_manager.cc:1434] T 81f4d53616e74e2ea71e52fdb3e8fc76 P c74453754ee34bea9b231ae318a55a31: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:13:34.832913 31756 leader_election.cc:290] T 364efc87879c4e6db82a829c76ef0045 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715)
I20260709 13:13:34.829407 31628 raft_consensus.cc:2468] T 2568dda6664d4363abc4fd891fa48370 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 1.
I20260709 13:13:34.832980 31748 tablet_bootstrap.cc:492] T 98a7e38754ed4644bf90b39aff07c70f P c74453754ee34bea9b231ae318a55a31: Bootstrap starting.
I20260709 13:13:34.834538 31629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "364efc87879c4e6db82a829c76ef0045" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:34.835201 31749 tablet_bootstrap.cc:492] T 40ab5d7d13ee4460933b5799482e3f87 P 76fb155ade354ee1ba78673e73b28aca: No bootstrap required, opened a new log
I20260709 13:13:34.835542 31629 raft_consensus.cc:2468] T 364efc87879c4e6db82a829c76ef0045 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 0.
I20260709 13:13:34.835778 31749 ts_tablet_manager.cc:1403] T 40ab5d7d13ee4460933b5799482e3f87 P 76fb155ade354ee1ba78673e73b28aca: Time spent bootstrapping tablet: real 0.049s	user 0.008s	sys 0.004s
I20260709 13:13:34.802953 31750 ts_tablet_manager.cc:1434] T 4fe725ada8f142d1bb9a35a30f865c10 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.000s
I20260709 13:13:34.838083 31702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "364efc87879c4e6db82a829c76ef0045" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:34.840179 31446 leader_election.cc:304] T 364efc87879c4e6db82a829c76ef0045 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, c74453754ee34bea9b231ae318a55a31; no voters: 
I20260709 13:13:34.840757 31702 raft_consensus.cc:2468] T 364efc87879c4e6db82a829c76ef0045 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 0.
I20260709 13:13:34.840858 31838 raft_consensus.cc:697] T 2568dda6664d4363abc4fd891fa48370 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 LEADER]: Becoming Leader. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Running, Role: LEADER
I20260709 13:13:34.838748 31749 raft_consensus.cc:359] T 40ab5d7d13ee4460933b5799482e3f87 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:34.840174 31747 tablet_bootstrap.cc:492] T 81f4d53616e74e2ea71e52fdb3e8fc76 P 196d972917fe4f85985e3862d40b7596: No bootstrap required, opened a new log
I20260709 13:13:34.842285 31747 ts_tablet_manager.cc:1403] T 81f4d53616e74e2ea71e52fdb3e8fc76 P 196d972917fe4f85985e3862d40b7596: Time spent bootstrapping tablet: real 0.087s	user 0.026s	sys 0.041s
I20260709 13:13:34.841848 31838 consensus_queue.cc:237] T 2568dda6664d4363abc4fd891fa48370 P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:34.840778 31748 tablet_bootstrap.cc:654] T 98a7e38754ed4644bf90b39aff07c70f P c74453754ee34bea9b231ae318a55a31: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.844974 31747 raft_consensus.cc:359] T 81f4d53616e74e2ea71e52fdb3e8fc76 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:34.845825 31747 raft_consensus.cc:385] T 81f4d53616e74e2ea71e52fdb3e8fc76 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.846154 31747 raft_consensus.cc:740] T 81f4d53616e74e2ea71e52fdb3e8fc76 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 196d972917fe4f85985e3862d40b7596, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.846928 31749 raft_consensus.cc:385] T 40ab5d7d13ee4460933b5799482e3f87 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.847298 31749 raft_consensus.cc:740] T 40ab5d7d13ee4460933b5799482e3f87 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.848129 31749 consensus_queue.cc:260] T 40ab5d7d13ee4460933b5799482e3f87 P 76fb155ade354ee1ba78673e73b28aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:34.841214 31750 tablet_bootstrap.cc:492] T c8185106c7a94c3ebaace350d2363217 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:34.841524 31842 raft_consensus.cc:2804] T 364efc87879c4e6db82a829c76ef0045 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:34.853935 31842 raft_consensus.cc:493] T 364efc87879c4e6db82a829c76ef0045 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:34.854293 31842 raft_consensus.cc:3060] T 364efc87879c4e6db82a829c76ef0045 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.858731 31749 ts_tablet_manager.cc:1434] T 40ab5d7d13ee4460933b5799482e3f87 P 76fb155ade354ee1ba78673e73b28aca: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.001s
I20260709 13:13:34.860081 31749 tablet_bootstrap.cc:492] T d78bdf917ee94331b91cb3fb308ef2a1 P 76fb155ade354ee1ba78673e73b28aca: Bootstrap starting.
I20260709 13:13:34.859747 31747 consensus_queue.cc:260] T 81f4d53616e74e2ea71e52fdb3e8fc76 P 196d972917fe4f85985e3862d40b7596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:34.861563 31377 catalog_manager.cc:5697] T e698d6d2e2e74eca91e222e9bfdf8f13 P 76fb155ade354ee1ba78673e73b28aca reported cstate change: term changed from 0 to 1, leader changed from <none> to 76fb155ade354ee1ba78673e73b28aca (127.23.140.68). New cstate: current_term: 1 leader_uuid: "76fb155ade354ee1ba78673e73b28aca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:34.866997 31747 ts_tablet_manager.cc:1434] T 81f4d53616e74e2ea71e52fdb3e8fc76 P 196d972917fe4f85985e3862d40b7596: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.001s
I20260709 13:13:34.867962 31747 tablet_bootstrap.cc:492] T 40ab5d7d13ee4460933b5799482e3f87 P 196d972917fe4f85985e3862d40b7596: Bootstrap starting.
I20260709 13:13:34.867507 31378 catalog_manager.cc:5697] T 2568dda6664d4363abc4fd891fa48370 P 458d610e8abf4f2ea831ab7bf3576da6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65). New cstate: current_term: 1 leader_uuid: "458d610e8abf4f2ea831ab7bf3576da6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:34.874135 31747 tablet_bootstrap.cc:654] T 40ab5d7d13ee4460933b5799482e3f87 P 196d972917fe4f85985e3862d40b7596: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.881037 31748 tablet_bootstrap.cc:492] T 98a7e38754ed4644bf90b39aff07c70f P c74453754ee34bea9b231ae318a55a31: No bootstrap required, opened a new log
I20260709 13:13:34.881489 31748 ts_tablet_manager.cc:1403] T 98a7e38754ed4644bf90b39aff07c70f P c74453754ee34bea9b231ae318a55a31: Time spent bootstrapping tablet: real 0.049s	user 0.018s	sys 0.021s
I20260709 13:13:34.884135 31748 raft_consensus.cc:359] T 98a7e38754ed4644bf90b39aff07c70f P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:34.884788 31748 raft_consensus.cc:385] T 98a7e38754ed4644bf90b39aff07c70f P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.885031 31748 raft_consensus.cc:740] T 98a7e38754ed4644bf90b39aff07c70f P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.885185 31555 raft_consensus.cc:3060] T eb560d89d58246e5856a763e3be6f086 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.885715 31748 consensus_queue.cc:260] T 98a7e38754ed4644bf90b39aff07c70f P c74453754ee34bea9b231ae318a55a31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:34.888007 31748 ts_tablet_manager.cc:1434] T 98a7e38754ed4644bf90b39aff07c70f P c74453754ee34bea9b231ae318a55a31: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:13:34.890208 31748 tablet_bootstrap.cc:492] T d78bdf917ee94331b91cb3fb308ef2a1 P c74453754ee34bea9b231ae318a55a31: Bootstrap starting.
I20260709 13:13:34.893419 31750 tablet_bootstrap.cc:654] T c8185106c7a94c3ebaace350d2363217 P 458d610e8abf4f2ea831ab7bf3576da6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.895668 31748 tablet_bootstrap.cc:654] T d78bdf917ee94331b91cb3fb308ef2a1 P c74453754ee34bea9b231ae318a55a31: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.899394 31749 tablet_bootstrap.cc:654] T d78bdf917ee94331b91cb3fb308ef2a1 P 76fb155ade354ee1ba78673e73b28aca: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.910913 31838 raft_consensus.cc:493] T 4fe725ada8f142d1bb9a35a30f865c10 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.911437 31838 raft_consensus.cc:515] T 4fe725ada8f142d1bb9a35a30f865c10 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:34.913400 31838 leader_election.cc:290] T 4fe725ada8f142d1bb9a35a30f865c10 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:34.915283 31702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe725ada8f142d1bb9a35a30f865c10" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:34.917209 31813 consensus_queue.cc:1048] T eb560d89d58246e5856a763e3be6f086 P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:34.913328 31842 raft_consensus.cc:515] T 364efc87879c4e6db82a829c76ef0045 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:34.925695 31629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe725ada8f142d1bb9a35a30f865c10" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:34.927407 31480 raft_consensus.cc:3060] T 4fe725ada8f142d1bb9a35a30f865c10 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.928112 31446 leader_election.cc:304] T 4fe725ada8f142d1bb9a35a30f865c10 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6; no voters: 76fb155ade354ee1ba78673e73b28aca, c74453754ee34bea9b231ae318a55a31
I20260709 13:13:34.902180 31759 consensus_queue.cc:1048] T 11617136d6c14faea3cee24e00514101 P c74453754ee34bea9b231ae318a55a31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
I20260709 13:13:34.937109 31747 tablet_bootstrap.cc:492] T 40ab5d7d13ee4460933b5799482e3f87 P 196d972917fe4f85985e3862d40b7596: No bootstrap required, opened a new log
I20260709 13:13:34.937857 31800 raft_consensus.cc:493] T eb560d89d58246e5856a763e3be6f086 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.938017 31747 ts_tablet_manager.cc:1403] T 40ab5d7d13ee4460933b5799482e3f87 P 196d972917fe4f85985e3862d40b7596: Time spent bootstrapping tablet: real 0.070s	user 0.033s	sys 0.014s
I20260709 13:13:34.938586 31800 raft_consensus.cc:515] T eb560d89d58246e5856a763e3be6f086 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:34.942147 31747 raft_consensus.cc:359] T 40ab5d7d13ee4460933b5799482e3f87 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:34.943074 31747 raft_consensus.cc:385] T 40ab5d7d13ee4460933b5799482e3f87 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.943024 31479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb560d89d58246e5856a763e3be6f086" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:34.943739 31747 raft_consensus.cc:740] T 40ab5d7d13ee4460933b5799482e3f87 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 196d972917fe4f85985e3862d40b7596, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.944130 31479 raft_consensus.cc:2468] T eb560d89d58246e5856a763e3be6f086 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 196d972917fe4f85985e3862d40b7596 in term 1.
I20260709 13:13:34.944700 31747 consensus_queue.cc:260] T 40ab5d7d13ee4460933b5799482e3f87 P 196d972917fe4f85985e3862d40b7596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:34.946017 31520 leader_election.cc:304] T eb560d89d58246e5856a763e3be6f086 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, 458d610e8abf4f2ea831ab7bf3576da6; no voters: 
I20260709 13:13:34.947531 31771 raft_consensus.cc:493] T 3e09c2945641463e91365b4826cc47e3 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.948015 31771 raft_consensus.cc:515] T 3e09c2945641463e91365b4826cc47e3 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:34.950472 31771 leader_election.cc:290] T 3e09c2945641463e91365b4826cc47e3 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715)
I20260709 13:13:34.951205 31771 raft_consensus.cc:2804] T eb560d89d58246e5856a763e3be6f086 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:34.952214 31771 raft_consensus.cc:493] T eb560d89d58246e5856a763e3be6f086 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:34.952785 31771 raft_consensus.cc:3060] T eb560d89d58246e5856a763e3be6f086 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:34.955194 31747 ts_tablet_manager.cc:1434] T 40ab5d7d13ee4460933b5799482e3f87 P 196d972917fe4f85985e3862d40b7596: Time spent starting tablet: real 0.017s	user 0.012s	sys 0.004s
I20260709 13:13:34.951685 31800 leader_election.cc:290] T eb560d89d58246e5856a763e3be6f086 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:34.963503 31749 tablet_bootstrap.cc:492] T d78bdf917ee94331b91cb3fb308ef2a1 P 76fb155ade354ee1ba78673e73b28aca: No bootstrap required, opened a new log
I20260709 13:13:34.964216 31749 ts_tablet_manager.cc:1403] T d78bdf917ee94331b91cb3fb308ef2a1 P 76fb155ade354ee1ba78673e73b28aca: Time spent bootstrapping tablet: real 0.104s	user 0.017s	sys 0.009s
I20260709 13:13:34.964143 31771 raft_consensus.cc:515] T eb560d89d58246e5856a763e3be6f086 P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:34.967770 31749 raft_consensus.cc:359] T d78bdf917ee94331b91cb3fb308ef2a1 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:34.968408 31749 raft_consensus.cc:385] T d78bdf917ee94331b91cb3fb308ef2a1 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.968672 31749 raft_consensus.cc:740] T d78bdf917ee94331b91cb3fb308ef2a1 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.968761 31478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb560d89d58246e5856a763e3be6f086" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
I20260709 13:13:34.969511 31813 consensus_queue.cc:1048] T eb560d89d58246e5856a763e3be6f086 P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:34.969576 31478 raft_consensus.cc:3060] T eb560d89d58246e5856a763e3be6f086 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:34.971971 31750 tablet_bootstrap.cc:492] T c8185106c7a94c3ebaace350d2363217 P 458d610e8abf4f2ea831ab7bf3576da6: No bootstrap required, opened a new log
I20260709 13:13:34.973842 31629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e09c2945641463e91365b4826cc47e3" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:34.974085 31750 ts_tablet_manager.cc:1403] T c8185106c7a94c3ebaace350d2363217 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.133s	user 0.023s	sys 0.011s
I20260709 13:13:34.974449 31629 raft_consensus.cc:2468] T 3e09c2945641463e91365b4826cc47e3 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 196d972917fe4f85985e3862d40b7596 in term 0.
I20260709 13:13:34.975248 31759 raft_consensus.cc:493] T 3e09c2945641463e91365b4826cc47e3 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.975397 31842 leader_election.cc:290] T 364efc87879c4e6db82a829c76ef0045 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 election: Requested vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715)
I20260709 13:13:34.975677 31759 raft_consensus.cc:515] T 3e09c2945641463e91365b4826cc47e3 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:34.976778 31750 raft_consensus.cc:359] T c8185106c7a94c3ebaace350d2363217 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:34.977417 31750 raft_consensus.cc:385] T c8185106c7a94c3ebaace350d2363217 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.977671 31750 raft_consensus.cc:740] T c8185106c7a94c3ebaace350d2363217 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.978670 31750 consensus_queue.cc:260] T c8185106c7a94c3ebaace350d2363217 P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:34.979564 31553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e09c2945641463e91365b4826cc47e3" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:34.980177 31553 raft_consensus.cc:2468] T 3e09c2945641463e91365b4826cc47e3 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 0.
I20260709 13:13:34.981076 31750 ts_tablet_manager.cc:1434] T c8185106c7a94c3ebaace350d2363217 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:13:34.981544 31592 leader_election.cc:304] T 3e09c2945641463e91365b4826cc47e3 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, c74453754ee34bea9b231ae318a55a31; no voters: 
I20260709 13:13:34.982023 31750 tablet_bootstrap.cc:492] T d78bdf917ee94331b91cb3fb308ef2a1 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:34.982717 31817 raft_consensus.cc:2804] T 3e09c2945641463e91365b4826cc47e3 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:34.982982 31554 raft_consensus.cc:1240] T eb560d89d58246e5856a763e3be6f086 P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Rejecting Update request from peer 76fb155ade354ee1ba78673e73b28aca for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:13:34.983119 31817 raft_consensus.cc:493] T 3e09c2945641463e91365b4826cc47e3 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:34.983582 31817 raft_consensus.cc:3060] T 3e09c2945641463e91365b4826cc47e3 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.984903 31702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e09c2945641463e91365b4826cc47e3" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:34.985247 31703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb560d89d58246e5856a763e3be6f086" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:34.985567 31702 raft_consensus.cc:2468] T 3e09c2945641463e91365b4826cc47e3 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 0.
I20260709 13:13:34.977674 31759 leader_election.cc:290] T 3e09c2945641463e91365b4826cc47e3 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431), 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715)
I20260709 13:13:34.984884 31748 tablet_bootstrap.cc:492] T d78bdf917ee94331b91cb3fb308ef2a1 P c74453754ee34bea9b231ae318a55a31: No bootstrap required, opened a new log
I20260709 13:13:34.986454 31759 raft_consensus.cc:493] T 98a7e38754ed4644bf90b39aff07c70f P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.987031 31748 ts_tablet_manager.cc:1403] T d78bdf917ee94331b91cb3fb308ef2a1 P c74453754ee34bea9b231ae318a55a31: Time spent bootstrapping tablet: real 0.097s	user 0.024s	sys 0.046s
I20260709 13:13:34.987069 31759 raft_consensus.cc:515] T 98a7e38754ed4644bf90b39aff07c70f P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:34.989916 31748 raft_consensus.cc:359] T d78bdf917ee94331b91cb3fb308ef2a1 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:34.990233 31477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a7e38754ed4644bf90b39aff07c70f" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:34.990584 31748 raft_consensus.cc:385] T d78bdf917ee94331b91cb3fb308ef2a1 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.990891 31748 raft_consensus.cc:740] T d78bdf917ee94331b91cb3fb308ef2a1 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.985530 31747 tablet_bootstrap.cc:492] T 98a7e38754ed4644bf90b39aff07c70f P 196d972917fe4f85985e3862d40b7596: Bootstrap starting.
I20260709 13:13:34.991532 31748 consensus_queue.cc:260] T d78bdf917ee94331b91cb3fb308ef2a1 P c74453754ee34bea9b231ae318a55a31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
W20260709 13:13:34.991863 31594 leader_election.cc:343] T 98a7e38754ed4644bf90b39aff07c70f P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:34.992890 31855 raft_consensus.cc:493] T 81f4d53616e74e2ea71e52fdb3e8fc76 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.993675 31748 ts_tablet_manager.cc:1434] T d78bdf917ee94331b91cb3fb308ef2a1 P c74453754ee34bea9b231ae318a55a31: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:13:34.993348 31855 raft_consensus.cc:515] T 81f4d53616e74e2ea71e52fdb3e8fc76 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:34.994596 31748 tablet_bootstrap.cc:492] T 5b669b8d34ee4de5b002d30fbcf02dd7 P c74453754ee34bea9b231ae318a55a31: Bootstrap starting.
I20260709 13:13:34.995373 31701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb560d89d58246e5856a763e3be6f086" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca"
I20260709 13:13:34.995601 31855 leader_election.cc:290] T 81f4d53616e74e2ea71e52fdb3e8fc76 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:34.997010 31703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e09c2945641463e91365b4826cc47e3" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:34.997416 31477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f4d53616e74e2ea71e52fdb3e8fc76" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:34.997684 31703 raft_consensus.cc:2468] T 3e09c2945641463e91365b4826cc47e3 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 196d972917fe4f85985e3862d40b7596 in term 0.
I20260709 13:13:34.998276 31477 raft_consensus.cc:2468] T 81f4d53616e74e2ea71e52fdb3e8fc76 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 196d972917fe4f85985e3862d40b7596 in term 0.
I20260709 13:13:34.998899 31629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "364efc87879c4e6db82a829c76ef0045" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31"
I20260709 13:13:34.999475 31629 raft_consensus.cc:3060] T 364efc87879c4e6db82a829c76ef0045 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:35.000007 31520 leader_election.cc:304] T 81f4d53616e74e2ea71e52fdb3e8fc76 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, 458d610e8abf4f2ea831ab7bf3576da6; no voters: 
I20260709 13:13:35.000790 31702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "364efc87879c4e6db82a829c76ef0045" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca"
I20260709 13:13:35.001358 31702 raft_consensus.cc:3060] T 364efc87879c4e6db82a829c76ef0045 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:35.001695 31748 tablet_bootstrap.cc:654] T 5b669b8d34ee4de5b002d30fbcf02dd7 P c74453754ee34bea9b231ae318a55a31: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:35.007311 31813 consensus_queue.cc:1059] T eb560d89d58246e5856a763e3be6f086 P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:35.008092 31855 raft_consensus.cc:2804] T 81f4d53616e74e2ea71e52fdb3e8fc76 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:35.008980 31855 raft_consensus.cc:493] T 81f4d53616e74e2ea71e52fdb3e8fc76 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:35.009500 31855 raft_consensus.cc:3060] T 81f4d53616e74e2ea71e52fdb3e8fc76 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:35.010512 31759 leader_election.cc:290] T 98a7e38754ed4644bf90b39aff07c70f P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:35.008162 31813 raft_consensus.cc:3055] T eb560d89d58246e5856a763e3be6f086 P 76fb155ade354ee1ba78673e73b28aca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:35.017236 31813 raft_consensus.cc:740] T eb560d89d58246e5856a763e3be6f086 P 76fb155ade354ee1ba78673e73b28aca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Running, Role: LEADER
I20260709 13:13:35.010468 31859 consensus_queue.cc:1048] T 11617136d6c14faea3cee24e00514101 P c74453754ee34bea9b231ae318a55a31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:35.018112 31813 consensus_queue.cc:260] T eb560d89d58246e5856a763e3be6f086 P 76fb155ade354ee1ba78673e73b28aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:35.019273 31813 raft_consensus.cc:3060] T eb560d89d58246e5856a763e3be6f086 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:35.018113 31748 tablet_bootstrap.cc:492] T 5b669b8d34ee4de5b002d30fbcf02dd7 P c74453754ee34bea9b231ae318a55a31: No bootstrap required, opened a new log
I20260709 13:13:35.024253 31748 ts_tablet_manager.cc:1403] T 5b669b8d34ee4de5b002d30fbcf02dd7 P c74453754ee34bea9b231ae318a55a31: Time spent bootstrapping tablet: real 0.030s	user 0.009s	sys 0.008s
I20260709 13:13:35.006341 31521 leader_election.cc:304] T 3e09c2945641463e91365b4826cc47e3 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, c74453754ee34bea9b231ae318a55a31; no voters: 
I20260709 13:13:35.027364 31804 raft_consensus.cc:2804] T 3e09c2945641463e91365b4826cc47e3 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:35.027815 31804 raft_consensus.cc:493] T 3e09c2945641463e91365b4826cc47e3 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:35.028266 31804 raft_consensus.cc:3060] T 3e09c2945641463e91365b4826cc47e3 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:35.028438 31771 leader_election.cc:290] T eb560d89d58246e5856a763e3be6f086 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 election: Requested vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:35.027066 31748 raft_consensus.cc:359] T 5b669b8d34ee4de5b002d30fbcf02dd7 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:35.031764 31748 raft_consensus.cc:385] T 5b669b8d34ee4de5b002d30fbcf02dd7 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:35.032073 31748 raft_consensus.cc:740] T 5b669b8d34ee4de5b002d30fbcf02dd7 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Initialized, Role: FOLLOWER
I20260709 13:13:35.033850 31748 consensus_queue.cc:260] T 5b669b8d34ee4de5b002d30fbcf02dd7 P c74453754ee34bea9b231ae318a55a31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:35.034574 31789 consensus_queue.cc:1048] T bec9a61b8e3c4bc0ba232063b38c8563 P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:35.023640 31817 raft_consensus.cc:515] T 3e09c2945641463e91365b4826cc47e3 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:35.036075 31476 raft_consensus.cc:3060] T c8185106c7a94c3ebaace350d2363217 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:35.047917 31703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e09c2945641463e91365b4826cc47e3" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca"
I20260709 13:13:35.048609 31703 raft_consensus.cc:3060] T 3e09c2945641463e91365b4826cc47e3 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:35.038426 31748 ts_tablet_manager.cc:1434] T 5b669b8d34ee4de5b002d30fbcf02dd7 P c74453754ee34bea9b231ae318a55a31: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:13:35.050283 31748 tablet_bootstrap.cc:492] T 1e727ab6847b4fbab9a94b63842c6b9c P c74453754ee34bea9b231ae318a55a31: Bootstrap starting.
I20260709 13:13:35.055954 31703 raft_consensus.cc:2468] T 3e09c2945641463e91365b4826cc47e3 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 1.
I20260709 13:13:35.057279 31595 leader_election.cc:304] T 3e09c2945641463e91365b4826cc47e3 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca, c74453754ee34bea9b231ae318a55a31; no voters: 
I20260709 13:13:35.039311 31478 raft_consensus.cc:2468] T eb560d89d58246e5856a763e3be6f086 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 196d972917fe4f85985e3862d40b7596 in term 2.
I20260709 13:13:35.058856 31759 raft_consensus.cc:2804] T 3e09c2945641463e91365b4826cc47e3 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:35.059096 31479 raft_consensus.cc:1240] T eb560d89d58246e5856a763e3be6f086 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Rejecting Update request from peer 76fb155ade354ee1ba78673e73b28aca for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:13:35.059592 31759 raft_consensus.cc:697] T 3e09c2945641463e91365b4826cc47e3 P c74453754ee34bea9b231ae318a55a31 [term 1 LEADER]: Becoming Leader. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Running, Role: LEADER
I20260709 13:13:35.058560 31859 raft_consensus.cc:493] T 5b669b8d34ee4de5b002d30fbcf02dd7 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.062604 31859 raft_consensus.cc:515] T 5b669b8d34ee4de5b002d30fbcf02dd7 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:35.071380 31629 raft_consensus.cc:2468] T 364efc87879c4e6db82a829c76ef0045 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 1.
I20260709 13:13:35.072595 31701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b669b8d34ee4de5b002d30fbcf02dd7" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:35.072806 31859 leader_election.cc:290] T 5b669b8d34ee4de5b002d30fbcf02dd7 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:35.073139 31446 leader_election.cc:304] T 364efc87879c4e6db82a829c76ef0045 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, c74453754ee34bea9b231ae318a55a31; no voters: 
W20260709 13:13:35.073994 31595 leader_election.cc:343] T 5b669b8d34ee4de5b002d30fbcf02dd7 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:35.074462 31702 raft_consensus.cc:2468] T 364efc87879c4e6db82a829c76ef0045 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 1.
I20260709 13:13:35.075053 31842 raft_consensus.cc:2804] T 364efc87879c4e6db82a829c76ef0045 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:35.075560 31842 raft_consensus.cc:697] T 364efc87879c4e6db82a829c76ef0045 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 LEADER]: Becoming Leader. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Running, Role: LEADER
I20260709 13:13:35.075989 31804 raft_consensus.cc:515] T 3e09c2945641463e91365b4826cc47e3 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:35.076617 31842 consensus_queue.cc:237] T 364efc87879c4e6db82a829c76ef0045 P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:35.078338 31520 leader_election.cc:304] T eb560d89d58246e5856a763e3be6f086 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, 458d610e8abf4f2ea831ab7bf3576da6; no voters: 76fb155ade354ee1ba78673e73b28aca
I20260709 13:13:35.079528 31771 raft_consensus.cc:2804] T eb560d89d58246e5856a763e3be6f086 P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:35.075495 31477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b669b8d34ee4de5b002d30fbcf02dd7" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:35.081590 31817 leader_election.cc:290] T 3e09c2945641463e91365b4826cc47e3 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 election: Requested vote from peers 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431), 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715)
I20260709 13:13:34.991087 31750 tablet_bootstrap.cc:654] T d78bdf917ee94331b91cb3fb308ef2a1 P 458d610e8abf4f2ea831ab7bf3576da6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:35.045104 31855 raft_consensus.cc:515] T 81f4d53616e74e2ea71e52fdb3e8fc76 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:35.060777 31759 consensus_queue.cc:237] T 3e09c2945641463e91365b4826cc47e3 P c74453754ee34bea9b231ae318a55a31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
W20260709 13:13:35.117081 31594 leader_election.cc:343] T 5b669b8d34ee4de5b002d30fbcf02dd7 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:35.085995 31747 tablet_bootstrap.cc:654] T 98a7e38754ed4644bf90b39aff07c70f P 196d972917fe4f85985e3862d40b7596: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:35.132673 31627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f4d53616e74e2ea71e52fdb3e8fc76" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31"
I20260709 13:13:35.133392 31627 raft_consensus.cc:3060] T 81f4d53616e74e2ea71e52fdb3e8fc76 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:35.086990 31859 raft_consensus.cc:493] T 4d146b574e8d4e21bd8d81cb29b4267a P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.134475 31859 raft_consensus.cc:515] T 4d146b574e8d4e21bd8d81cb29b4267a P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:35.135839 31629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e09c2945641463e91365b4826cc47e3" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31"
I20260709 13:13:35.136577 31859 leader_election.cc:290] T 4d146b574e8d4e21bd8d81cb29b4267a P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:34.969372 31749 consensus_queue.cc:260] T d78bdf917ee94331b91cb3fb308ef2a1 P 76fb155ade354ee1ba78673e73b28aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:35.138594 31749 ts_tablet_manager.cc:1434] T d78bdf917ee94331b91cb3fb308ef2a1 P 76fb155ade354ee1ba78673e73b28aca: Time spent starting tablet: real 0.174s	user 0.009s	sys 0.000s
I20260709 13:13:35.139477 31749 tablet_bootstrap.cc:492] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 76fb155ade354ee1ba78673e73b28aca: Bootstrap starting.
I20260709 13:13:35.140826 31627 raft_consensus.cc:2468] T 81f4d53616e74e2ea71e52fdb3e8fc76 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 196d972917fe4f85985e3862d40b7596 in term 1.
I20260709 13:13:35.114377 31748 tablet_bootstrap.cc:654] T 1e727ab6847b4fbab9a94b63842c6b9c P c74453754ee34bea9b231ae318a55a31: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:35.142889 31702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d146b574e8d4e21bd8d81cb29b4267a" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:35.143533 31702 raft_consensus.cc:2468] T 4d146b574e8d4e21bd8d81cb29b4267a P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 0.
I20260709 13:13:35.144795 31595 leader_election.cc:304] T 4d146b574e8d4e21bd8d81cb29b4267a P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca, c74453754ee34bea9b231ae318a55a31; no voters: 
I20260709 13:13:35.144835 31750 tablet_bootstrap.cc:492] T d78bdf917ee94331b91cb3fb308ef2a1 P 458d610e8abf4f2ea831ab7bf3576da6: No bootstrap required, opened a new log
I20260709 13:13:35.117723 31855 leader_election.cc:290] T 81f4d53616e74e2ea71e52fdb3e8fc76 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 election: Requested vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:35.118124 31771 raft_consensus.cc:697] T eb560d89d58246e5856a763e3be6f086 P 196d972917fe4f85985e3862d40b7596 [term 2 LEADER]: Becoming Leader. State: Replica: 196d972917fe4f85985e3862d40b7596, State: Running, Role: LEADER
I20260709 13:13:35.145521 31844 raft_consensus.cc:493] T d78bdf917ee94331b91cb3fb308ef2a1 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.145735 31859 raft_consensus.cc:2804] T 4d146b574e8d4e21bd8d81cb29b4267a P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:35.146203 31859 raft_consensus.cc:493] T 4d146b574e8d4e21bd8d81cb29b4267a P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:35.146093 31844 raft_consensus.cc:515] T d78bdf917ee94331b91cb3fb308ef2a1 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:35.146553 31771 consensus_queue.cc:237] T eb560d89d58246e5856a763e3be6f086 P 196d972917fe4f85985e3862d40b7596 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:35.146587 31859 raft_consensus.cc:3060] T 4d146b574e8d4e21bd8d81cb29b4267a P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:35.150250 31627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78bdf917ee94331b91cb3fb308ef2a1" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:35.150641 31480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78bdf917ee94331b91cb3fb308ef2a1" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:35.150876 31627 raft_consensus.cc:2468] T d78bdf917ee94331b91cb3fb308ef2a1 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 0.
W20260709 13:13:35.152218 31668 leader_election.cc:343] T d78bdf917ee94331b91cb3fb308ef2a1 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:35.121713 31476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f4d53616e74e2ea71e52fdb3e8fc76" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
I20260709 13:13:35.152792 31669 leader_election.cc:304] T d78bdf917ee94331b91cb3fb308ef2a1 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca, c74453754ee34bea9b231ae318a55a31; no voters: 458d610e8abf4f2ea831ab7bf3576da6
I20260709 13:13:35.153066 31476 raft_consensus.cc:3060] T 81f4d53616e74e2ea71e52fdb3e8fc76 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:35.122742 31838 raft_consensus.cc:2749] T 4fe725ada8f142d1bb9a35a30f865c10 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:35.144940 31813 consensus_queue.cc:1048] T bec9a61b8e3c4bc0ba232063b38c8563 P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:13:35.157087 31813 raft_consensus.cc:2804] T d78bdf917ee94331b91cb3fb308ef2a1 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:35.157457 31813 raft_consensus.cc:493] T d78bdf917ee94331b91cb3fb308ef2a1 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:35.123546 31703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e09c2945641463e91365b4826cc47e3" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca"
I20260709 13:13:35.157788 31813 raft_consensus.cc:3060] T d78bdf917ee94331b91cb3fb308ef2a1 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:35.158334 31703 raft_consensus.cc:2393] T 3e09c2945641463e91365b4826cc47e3 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 196d972917fe4f85985e3862d40b7596 in current term 1: Already voted for candidate c74453754ee34bea9b231ae318a55a31 in this term.
I20260709 13:13:35.129650 31555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a7e38754ed4644bf90b39aff07c70f" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:35.159298 31750 ts_tablet_manager.cc:1403] T d78bdf917ee94331b91cb3fb308ef2a1 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.177s	user 0.014s	sys 0.006s
I20260709 13:13:35.130388 31554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e09c2945641463e91365b4826cc47e3" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596"
I20260709 13:13:35.160254 31554 raft_consensus.cc:2393] T 3e09c2945641463e91365b4826cc47e3 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c74453754ee34bea9b231ae318a55a31 in current term 1: Already voted for candidate 196d972917fe4f85985e3862d40b7596 in this term.
I20260709 13:13:35.129642 31628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f4d53616e74e2ea71e52fdb3e8fc76" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:35.161039 31628 raft_consensus.cc:2376] T 81f4d53616e74e2ea71e52fdb3e8fc76 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 196d972917fe4f85985e3862d40b7596 in term 1. Re-sending same reply.
I20260709 13:13:35.117595 31594 leader_election.cc:304] T 5b669b8d34ee4de5b002d30fbcf02dd7 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c74453754ee34bea9b231ae318a55a31; no voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca
I20260709 13:13:35.162159 31857 raft_consensus.cc:2749] T 5b669b8d34ee4de5b002d30fbcf02dd7 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:13:35.162282 31594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:37919, user_credentials={real_user=slave}} blocked reactor thread for 45250.7us
I20260709 13:13:35.162906 31521 leader_election.cc:304] T 3e09c2945641463e91365b4826cc47e3 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 196d972917fe4f85985e3862d40b7596; no voters: 76fb155ade354ee1ba78673e73b28aca, c74453754ee34bea9b231ae318a55a31
I20260709 13:13:35.163743 31855 raft_consensus.cc:2749] T 3e09c2945641463e91365b4826cc47e3 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:35.118906 31804 leader_election.cc:290] T 3e09c2945641463e91365b4826cc47e3 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 election: Requested vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715)
I20260709 13:13:35.163843 31521 leader_election.cc:304] T 81f4d53616e74e2ea71e52fdb3e8fc76 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, c74453754ee34bea9b231ae318a55a31; no voters: 
I20260709 13:13:35.164556 31480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d146b574e8d4e21bd8d81cb29b4267a" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:35.164988 31804 raft_consensus.cc:2804] T 81f4d53616e74e2ea71e52fdb3e8fc76 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:35.165228 31480 raft_consensus.cc:2468] T 4d146b574e8d4e21bd8d81cb29b4267a P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 0.
I20260709 13:13:35.165723 31804 raft_consensus.cc:697] T 81f4d53616e74e2ea71e52fdb3e8fc76 P 196d972917fe4f85985e3862d40b7596 [term 1 LEADER]: Becoming Leader. State: Replica: 196d972917fe4f85985e3862d40b7596, State: Running, Role: LEADER
I20260709 13:13:35.167614 31804 consensus_queue.cc:237] T 81f4d53616e74e2ea71e52fdb3e8fc76 P 196d972917fe4f85985e3862d40b7596 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:35.169358 31844 leader_election.cc:290] T d78bdf917ee94331b91cb3fb308ef2a1 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
W20260709 13:13:35.172693 31592 leader_election.cc:343] T 98a7e38754ed4644bf90b39aff07c70f P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:35.173962 31592 leader_election.cc:304] T 98a7e38754ed4644bf90b39aff07c70f P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c74453754ee34bea9b231ae318a55a31; no voters: 196d972917fe4f85985e3862d40b7596, 458d610e8abf4f2ea831ab7bf3576da6
I20260709 13:13:35.174762 31857 raft_consensus.cc:2749] T 98a7e38754ed4644bf90b39aff07c70f P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:35.175523 31749 tablet_bootstrap.cc:654] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 76fb155ade354ee1ba78673e73b28aca: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:35.241339 31592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:37431, user_credentials={real_user=slave}} blocked reactor thread for 61742.5us
I20260709 13:13:35.245150 31476 raft_consensus.cc:2468] T 81f4d53616e74e2ea71e52fdb3e8fc76 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 196d972917fe4f85985e3862d40b7596 in term 1.
I20260709 13:13:35.252332 31748 tablet_bootstrap.cc:492] T 1e727ab6847b4fbab9a94b63842c6b9c P c74453754ee34bea9b231ae318a55a31: No bootstrap required, opened a new log
I20260709 13:13:35.185426 31813 raft_consensus.cc:515] T d78bdf917ee94331b91cb3fb308ef2a1 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:35.186098 31859 raft_consensus.cc:515] T 4d146b574e8d4e21bd8d81cb29b4267a P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:35.273517 31748 ts_tablet_manager.cc:1403] T 1e727ab6847b4fbab9a94b63842c6b9c P c74453754ee34bea9b231ae318a55a31: Time spent bootstrapping tablet: real 0.223s	user 0.014s	sys 0.000s
I20260709 13:13:35.275434 31750 raft_consensus.cc:359] T d78bdf917ee94331b91cb3fb308ef2a1 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:35.282181 31750 raft_consensus.cc:385] T d78bdf917ee94331b91cb3fb308ef2a1 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:35.283584 31750 raft_consensus.cc:740] T d78bdf917ee94331b91cb3fb308ef2a1 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:35.285156 31844 raft_consensus.cc:493] T 40ab5d7d13ee4460933b5799482e3f87 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.286968 31789 consensus_queue.cc:1048] T e698d6d2e2e74eca91e222e9bfdf8f13 P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:13:35.287477 31844 raft_consensus.cc:515] T 40ab5d7d13ee4460933b5799482e3f87 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:35.296885 31750 consensus_queue.cc:260] T d78bdf917ee94331b91cb3fb308ef2a1 P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:35.304158 31859 leader_election.cc:290] T 4d146b574e8d4e21bd8d81cb29b4267a P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 election: Requested vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:35.303767 31378 catalog_manager.cc:5697] T eb560d89d58246e5856a763e3be6f086 P 196d972917fe4f85985e3862d40b7596 reported cstate change: term changed from 1 to 2, leader changed from 76fb155ade354ee1ba78673e73b28aca (127.23.140.68) to 196d972917fe4f85985e3862d40b7596 (127.23.140.66). New cstate: current_term: 2 leader_uuid: "196d972917fe4f85985e3862d40b7596" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:35.304852 31627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78bdf917ee94331b91cb3fb308ef2a1" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31"
I20260709 13:13:35.305905 31627 raft_consensus.cc:3060] T d78bdf917ee94331b91cb3fb308ef2a1 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:35.306885 31378 catalog_manager.cc:5697] T 81f4d53616e74e2ea71e52fdb3e8fc76 P 196d972917fe4f85985e3862d40b7596 reported cstate change: term changed from 0 to 1, leader changed from <none> to 196d972917fe4f85985e3862d40b7596 (127.23.140.66). New cstate: current_term: 1 leader_uuid: "196d972917fe4f85985e3862d40b7596" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:35.308738 31480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d146b574e8d4e21bd8d81cb29b4267a" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
I20260709 13:13:35.309635 31480 raft_consensus.cc:3060] T 4d146b574e8d4e21bd8d81cb29b4267a P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:35.310393 31813 leader_election.cc:290] T d78bdf917ee94331b91cb3fb308ef2a1 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 election: Requested vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:35.313087 31844 leader_election.cc:290] T 40ab5d7d13ee4460933b5799482e3f87 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:35.316534 31750 ts_tablet_manager.cc:1434] T d78bdf917ee94331b91cb3fb308ef2a1 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.157s	user 0.012s	sys 0.000s
I20260709 13:13:35.313009 31703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d146b574e8d4e21bd8d81cb29b4267a" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca"
I20260709 13:13:35.317245 31703 raft_consensus.cc:3060] T 4d146b574e8d4e21bd8d81cb29b4267a P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:35.319933 31477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78bdf917ee94331b91cb3fb308ef2a1" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
I20260709 13:13:35.320678 31477 raft_consensus.cc:3060] T d78bdf917ee94331b91cb3fb308ef2a1 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:35.322337 31475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ab5d7d13ee4460933b5799482e3f87" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:35.323956 31554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ab5d7d13ee4460933b5799482e3f87" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:35.324898 31750 tablet_bootstrap.cc:492] T 40ab5d7d13ee4460933b5799482e3f87 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:35.324779 31554 raft_consensus.cc:2468] T 40ab5d7d13ee4460933b5799482e3f87 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 0.
I20260709 13:13:35.304224 31747 tablet_bootstrap.cc:492] T 98a7e38754ed4644bf90b39aff07c70f P 196d972917fe4f85985e3862d40b7596: No bootstrap required, opened a new log
W20260709 13:13:35.329847 31668 leader_election.cc:343] T 40ab5d7d13ee4460933b5799482e3f87 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:35.330716 31749 tablet_bootstrap.cc:492] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 76fb155ade354ee1ba78673e73b28aca: No bootstrap required, opened a new log
I20260709 13:13:35.331380 31749 ts_tablet_manager.cc:1403] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 76fb155ade354ee1ba78673e73b28aca: Time spent bootstrapping tablet: real 0.192s	user 0.020s	sys 0.008s
I20260709 13:13:35.331688 31666 leader_election.cc:304] T 40ab5d7d13ee4460933b5799482e3f87 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, 76fb155ade354ee1ba78673e73b28aca; no voters: 458d610e8abf4f2ea831ab7bf3576da6
I20260709 13:13:35.332976 31844 raft_consensus.cc:2804] T 40ab5d7d13ee4460933b5799482e3f87 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:35.333329 31844 raft_consensus.cc:493] T 40ab5d7d13ee4460933b5799482e3f87 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:35.339658 31748 raft_consensus.cc:359] T 1e727ab6847b4fbab9a94b63842c6b9c P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:35.340608 31748 raft_consensus.cc:385] T 1e727ab6847b4fbab9a94b63842c6b9c P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:35.339756 31376 catalog_manager.cc:5697] T 364efc87879c4e6db82a829c76ef0045 P 458d610e8abf4f2ea831ab7bf3576da6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65). New cstate: current_term: 1 leader_uuid: "458d610e8abf4f2ea831ab7bf3576da6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:35.341274 31747 ts_tablet_manager.cc:1403] T 98a7e38754ed4644bf90b39aff07c70f P 196d972917fe4f85985e3862d40b7596: Time spent bootstrapping tablet: real 0.356s	user 0.015s	sys 0.002s
I20260709 13:13:35.340890 31748 raft_consensus.cc:740] T 1e727ab6847b4fbab9a94b63842c6b9c P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Initialized, Role: FOLLOWER
I20260709 13:13:35.342402 31748 consensus_queue.cc:260] T 1e727ab6847b4fbab9a94b63842c6b9c P c74453754ee34bea9b231ae318a55a31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:35.344437 31748 ts_tablet_manager.cc:1434] T 1e727ab6847b4fbab9a94b63842c6b9c P c74453754ee34bea9b231ae318a55a31: Time spent starting tablet: real 0.060s	user 0.007s	sys 0.000s
I20260709 13:13:35.344970 31747 raft_consensus.cc:359] T 98a7e38754ed4644bf90b39aff07c70f P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:35.336995 31844 raft_consensus.cc:3060] T 40ab5d7d13ee4460933b5799482e3f87 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:35.352150 31750 tablet_bootstrap.cc:654] T 40ab5d7d13ee4460933b5799482e3f87 P 458d610e8abf4f2ea831ab7bf3576da6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:35.352556 31747 raft_consensus.cc:385] T 98a7e38754ed4644bf90b39aff07c70f P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:35.352685 31477 raft_consensus.cc:2468] T d78bdf917ee94331b91cb3fb308ef2a1 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 1.
I20260709 13:13:35.352980 31747 raft_consensus.cc:740] T 98a7e38754ed4644bf90b39aff07c70f P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 196d972917fe4f85985e3862d40b7596, State: Initialized, Role: FOLLOWER
I20260709 13:13:35.353940 31747 consensus_queue.cc:260] T 98a7e38754ed4644bf90b39aff07c70f P 196d972917fe4f85985e3862d40b7596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:35.354220 31668 leader_election.cc:304] T d78bdf917ee94331b91cb3fb308ef2a1 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca; no voters: 
I20260709 13:13:35.354225 31749 raft_consensus.cc:359] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:35.369156 31749 raft_consensus.cc:385] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:35.369445 31749 raft_consensus.cc:740] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Initialized, Role: FOLLOWER
I20260709 13:13:35.367000 31748 tablet_bootstrap.cc:492] T de27ea68aab2485bb532389bb5c82433 P c74453754ee34bea9b231ae318a55a31: Bootstrap starting.
I20260709 13:13:35.374346 31749 consensus_queue.cc:260] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 76fb155ade354ee1ba78673e73b28aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:35.379194 31703 raft_consensus.cc:2468] T 4d146b574e8d4e21bd8d81cb29b4267a P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 1.
I20260709 13:13:35.377568 31749 ts_tablet_manager.cc:1434] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 76fb155ade354ee1ba78673e73b28aca: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.002s
I20260709 13:13:35.381304 31789 raft_consensus.cc:2804] T d78bdf917ee94331b91cb3fb308ef2a1 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:35.375166 31844 raft_consensus.cc:515] T 40ab5d7d13ee4460933b5799482e3f87 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:35.381908 31789 raft_consensus.cc:697] T d78bdf917ee94331b91cb3fb308ef2a1 P 76fb155ade354ee1ba78673e73b28aca [term 1 LEADER]: Becoming Leader. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Running, Role: LEADER
I20260709 13:13:35.385249 31477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ab5d7d13ee4460933b5799482e3f87" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
W20260709 13:13:35.386619 31668 leader_election.cc:343] T 40ab5d7d13ee4460933b5799482e3f87 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:35.391083 31480 raft_consensus.cc:2468] T 4d146b574e8d4e21bd8d81cb29b4267a P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 1.
I20260709 13:13:35.390947 31838 consensus_queue.cc:1048] T 2568dda6664d4363abc4fd891fa48370 P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:35.392510 31594 leader_election.cc:304] T 4d146b574e8d4e21bd8d81cb29b4267a P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, c74453754ee34bea9b231ae318a55a31; no voters: 
I20260709 13:13:35.389503 31747 ts_tablet_manager.cc:1434] T 98a7e38754ed4644bf90b39aff07c70f P 196d972917fe4f85985e3862d40b7596: Time spent starting tablet: real 0.048s	user 0.009s	sys 0.000s
I20260709 13:13:35.393633 31874 raft_consensus.cc:2804] T 4d146b574e8d4e21bd8d81cb29b4267a P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:35.393986 31627 raft_consensus.cc:2468] T d78bdf917ee94331b91cb3fb308ef2a1 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 1.
I20260709 13:13:35.394169 31874 raft_consensus.cc:697] T 4d146b574e8d4e21bd8d81cb29b4267a P c74453754ee34bea9b231ae318a55a31 [term 1 LEADER]: Becoming Leader. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Running, Role: LEADER
I20260709 13:13:35.394440 31789 consensus_queue.cc:237] T d78bdf917ee94331b91cb3fb308ef2a1 P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:35.395413 31874 consensus_queue.cc:237] T 4d146b574e8d4e21bd8d81cb29b4267a P c74453754ee34bea9b231ae318a55a31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:35.398223 31749 tablet_bootstrap.cc:492] T 216111c5962f4b82ae52414985988860 P 76fb155ade354ee1ba78673e73b28aca: Bootstrap starting.
I20260709 13:13:35.400149 31377 catalog_manager.cc:5697] T 3e09c2945641463e91365b4826cc47e3 P c74453754ee34bea9b231ae318a55a31 reported cstate change: term changed from 0 to 1, leader changed from <none> to c74453754ee34bea9b231ae318a55a31 (127.23.140.67). New cstate: current_term: 1 leader_uuid: "c74453754ee34bea9b231ae318a55a31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:35.404404 31750 tablet_bootstrap.cc:492] T 40ab5d7d13ee4460933b5799482e3f87 P 458d610e8abf4f2ea831ab7bf3576da6: No bootstrap required, opened a new log
I20260709 13:13:35.405068 31750 ts_tablet_manager.cc:1403] T 40ab5d7d13ee4460933b5799482e3f87 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.081s	user 0.017s	sys 0.003s
I20260709 13:13:35.409065 31747 tablet_bootstrap.cc:492] T de27ea68aab2485bb532389bb5c82433 P 196d972917fe4f85985e3862d40b7596: Bootstrap starting.
I20260709 13:13:35.428647 31555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ab5d7d13ee4460933b5799482e3f87" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596"
I20260709 13:13:35.415788 31750 raft_consensus.cc:359] T 40ab5d7d13ee4460933b5799482e3f87 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:35.426190 31844 leader_election.cc:290] T 40ab5d7d13ee4460933b5799482e3f87 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 election: Requested vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:35.435928 31555 raft_consensus.cc:3060] T 40ab5d7d13ee4460933b5799482e3f87 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:35.431445 31813 consensus_queue.cc:1048] T e698d6d2e2e74eca91e222e9bfdf8f13 P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:13:35.420475 31842 consensus_queue.cc:1048] T 2568dda6664d4363abc4fd891fa48370 P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 13:13:35.420774 31749 tablet_bootstrap.cc:654] T 216111c5962f4b82ae52414985988860 P 76fb155ade354ee1ba78673e73b28aca: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:35.449694 31747 tablet_bootstrap.cc:654] T de27ea68aab2485bb532389bb5c82433 P 196d972917fe4f85985e3862d40b7596: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:35.458772 31555 raft_consensus.cc:2468] T 40ab5d7d13ee4460933b5799482e3f87 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 1.
I20260709 13:13:35.460139 31666 leader_election.cc:304] T 40ab5d7d13ee4460933b5799482e3f87 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, 76fb155ade354ee1ba78673e73b28aca; no voters: 458d610e8abf4f2ea831ab7bf3576da6
I20260709 13:13:35.435961 31750 raft_consensus.cc:385] T 40ab5d7d13ee4460933b5799482e3f87 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:35.461098 31750 raft_consensus.cc:740] T 40ab5d7d13ee4460933b5799482e3f87 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:35.461583 31813 raft_consensus.cc:2804] T 40ab5d7d13ee4460933b5799482e3f87 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:35.462260 31813 raft_consensus.cc:697] T 40ab5d7d13ee4460933b5799482e3f87 P 76fb155ade354ee1ba78673e73b28aca [term 1 LEADER]: Becoming Leader. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Running, Role: LEADER
I20260709 13:13:35.463305 31813 consensus_queue.cc:237] T 40ab5d7d13ee4460933b5799482e3f87 P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:35.464689 31749 tablet_bootstrap.cc:492] T 216111c5962f4b82ae52414985988860 P 76fb155ade354ee1ba78673e73b28aca: No bootstrap required, opened a new log
I20260709 13:13:35.465176 31749 ts_tablet_manager.cc:1403] T 216111c5962f4b82ae52414985988860 P 76fb155ade354ee1ba78673e73b28aca: Time spent bootstrapping tablet: real 0.067s	user 0.008s	sys 0.004s
I20260709 13:13:35.467471 31750 consensus_queue.cc:260] T 40ab5d7d13ee4460933b5799482e3f87 P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:35.433153 31748 tablet_bootstrap.cc:654] T de27ea68aab2485bb532389bb5c82433 P c74453754ee34bea9b231ae318a55a31: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:35.471999 31376 catalog_manager.cc:5697] T d78bdf917ee94331b91cb3fb308ef2a1 P 76fb155ade354ee1ba78673e73b28aca reported cstate change: term changed from 0 to 1, leader changed from <none> to 76fb155ade354ee1ba78673e73b28aca (127.23.140.68). New cstate: current_term: 1 leader_uuid: "76fb155ade354ee1ba78673e73b28aca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:35.468824 31749 raft_consensus.cc:359] T 216111c5962f4b82ae52414985988860 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:35.473573 31749 raft_consensus.cc:385] T 216111c5962f4b82ae52414985988860 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:35.473830 31749 raft_consensus.cc:740] T 216111c5962f4b82ae52414985988860 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Initialized, Role: FOLLOWER
I20260709 13:13:35.476727 31842 consensus_queue.cc:1048] T 364efc87879c4e6db82a829c76ef0045 P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:35.484102 31749 consensus_queue.cc:260] T 216111c5962f4b82ae52414985988860 P 76fb155ade354ee1ba78673e73b28aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:35.494922 31749 ts_tablet_manager.cc:1434] T 216111c5962f4b82ae52414985988860 P 76fb155ade354ee1ba78673e73b28aca: Time spent starting tablet: real 0.029s	user 0.003s	sys 0.006s
I20260709 13:13:35.496178 31749 tablet_bootstrap.cc:492] T b3705de0af7a48f69f751aab333fdf3d P 76fb155ade354ee1ba78673e73b28aca: Bootstrap starting.
I20260709 13:13:35.494968 31375 catalog_manager.cc:5697] T 4d146b574e8d4e21bd8d81cb29b4267a P c74453754ee34bea9b231ae318a55a31 reported cstate change: term changed from 0 to 1, leader changed from <none> to c74453754ee34bea9b231ae318a55a31 (127.23.140.67). New cstate: current_term: 1 leader_uuid: "c74453754ee34bea9b231ae318a55a31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:35.498695 31750 ts_tablet_manager.cc:1434] T 40ab5d7d13ee4460933b5799482e3f87 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.093s	user 0.005s	sys 0.004s
I20260709 13:13:35.512362 31750 tablet_bootstrap.cc:492] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:35.497344 31747 tablet_bootstrap.cc:492] T de27ea68aab2485bb532389bb5c82433 P 196d972917fe4f85985e3862d40b7596: No bootstrap required, opened a new log
I20260709 13:13:35.513235 31747 ts_tablet_manager.cc:1403] T de27ea68aab2485bb532389bb5c82433 P 196d972917fe4f85985e3862d40b7596: Time spent bootstrapping tablet: real 0.105s	user 0.008s	sys 0.005s
I20260709 13:13:35.523322 31747 raft_consensus.cc:359] T de27ea68aab2485bb532389bb5c82433 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:35.524302 31747 raft_consensus.cc:385] T de27ea68aab2485bb532389bb5c82433 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:35.525177 31747 raft_consensus.cc:740] T de27ea68aab2485bb532389bb5c82433 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 196d972917fe4f85985e3862d40b7596, State: Initialized, Role: FOLLOWER
I20260709 13:13:35.524179 31756 consensus_queue.cc:1048] T 364efc87879c4e6db82a829c76ef0045 P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:13:35.526124 31747 consensus_queue.cc:260] T de27ea68aab2485bb532389bb5c82433 P 196d972917fe4f85985e3862d40b7596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:35.505679 31748 tablet_bootstrap.cc:492] T de27ea68aab2485bb532389bb5c82433 P c74453754ee34bea9b231ae318a55a31: No bootstrap required, opened a new log
I20260709 13:13:35.507608 31749 tablet_bootstrap.cc:654] T b3705de0af7a48f69f751aab333fdf3d P 76fb155ade354ee1ba78673e73b28aca: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:35.527628 31748 ts_tablet_manager.cc:1403] T de27ea68aab2485bb532389bb5c82433 P c74453754ee34bea9b231ae318a55a31: Time spent bootstrapping tablet: real 0.161s	user 0.006s	sys 0.008s
I20260709 13:13:35.523921 31378 catalog_manager.cc:5697] T 40ab5d7d13ee4460933b5799482e3f87 P 76fb155ade354ee1ba78673e73b28aca reported cstate change: term changed from 0 to 1, leader changed from <none> to 76fb155ade354ee1ba78673e73b28aca (127.23.140.68). New cstate: current_term: 1 leader_uuid: "76fb155ade354ee1ba78673e73b28aca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:35.530609 31748 raft_consensus.cc:359] T de27ea68aab2485bb532389bb5c82433 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:35.531283 31748 raft_consensus.cc:385] T de27ea68aab2485bb532389bb5c82433 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:35.531558 31748 raft_consensus.cc:740] T de27ea68aab2485bb532389bb5c82433 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Initialized, Role: FOLLOWER
I20260709 13:13:35.533911 31747 ts_tablet_manager.cc:1434] T de27ea68aab2485bb532389bb5c82433 P 196d972917fe4f85985e3862d40b7596: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:13:35.536355 31747 tablet_bootstrap.cc:492] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 196d972917fe4f85985e3862d40b7596: Bootstrap starting.
I20260709 13:13:35.537901 31748 consensus_queue.cc:260] T de27ea68aab2485bb532389bb5c82433 P c74453754ee34bea9b231ae318a55a31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:35.540323 31748 ts_tablet_manager.cc:1434] T de27ea68aab2485bb532389bb5c82433 P c74453754ee34bea9b231ae318a55a31: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:13:35.519006 31750 tablet_bootstrap.cc:654] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 458d610e8abf4f2ea831ab7bf3576da6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:35.549335 31747 tablet_bootstrap.cc:654] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 196d972917fe4f85985e3862d40b7596: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:35.553664 31748 tablet_bootstrap.cc:492] T b3705de0af7a48f69f751aab333fdf3d P c74453754ee34bea9b231ae318a55a31: Bootstrap starting.
I20260709 13:13:35.557658 31749 tablet_bootstrap.cc:492] T b3705de0af7a48f69f751aab333fdf3d P 76fb155ade354ee1ba78673e73b28aca: No bootstrap required, opened a new log
I20260709 13:13:35.558226 31749 ts_tablet_manager.cc:1403] T b3705de0af7a48f69f751aab333fdf3d P 76fb155ade354ee1ba78673e73b28aca: Time spent bootstrapping tablet: real 0.062s	user 0.015s	sys 0.006s
I20260709 13:13:35.560994 31749 raft_consensus.cc:359] T b3705de0af7a48f69f751aab333fdf3d P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:35.561688 31749 raft_consensus.cc:385] T b3705de0af7a48f69f751aab333fdf3d P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:35.562043 31749 raft_consensus.cc:740] T b3705de0af7a48f69f751aab333fdf3d P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Initialized, Role: FOLLOWER
I20260709 13:13:35.562885 31749 consensus_queue.cc:260] T b3705de0af7a48f69f751aab333fdf3d P 76fb155ade354ee1ba78673e73b28aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:35.564637 31748 tablet_bootstrap.cc:654] T b3705de0af7a48f69f751aab333fdf3d P c74453754ee34bea9b231ae318a55a31: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:35.565270 31749 ts_tablet_manager.cc:1434] T b3705de0af7a48f69f751aab333fdf3d P 76fb155ade354ee1ba78673e73b28aca: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:13:35.566452 31749 tablet_bootstrap.cc:492] T 5b669b8d34ee4de5b002d30fbcf02dd7 P 76fb155ade354ee1ba78673e73b28aca: Bootstrap starting.
I20260709 13:13:35.572875 31749 tablet_bootstrap.cc:654] T 5b669b8d34ee4de5b002d30fbcf02dd7 P 76fb155ade354ee1ba78673e73b28aca: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:35.578285 31750 tablet_bootstrap.cc:492] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 458d610e8abf4f2ea831ab7bf3576da6: No bootstrap required, opened a new log
I20260709 13:13:35.578761 31750 ts_tablet_manager.cc:1403] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.067s	user 0.012s	sys 0.001s
I20260709 13:13:35.582655 31750 raft_consensus.cc:359] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:35.583596 31750 raft_consensus.cc:385] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:35.583913 31750 raft_consensus.cc:740] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:35.584677 31750 consensus_queue.cc:260] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:35.588318 31750 ts_tablet_manager.cc:1434] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:13:35.589442 31750 tablet_bootstrap.cc:492] T 98a7e38754ed4644bf90b39aff07c70f P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:35.595408 31750 tablet_bootstrap.cc:654] T 98a7e38754ed4644bf90b39aff07c70f P 458d610e8abf4f2ea831ab7bf3576da6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:35.599834 31747 tablet_bootstrap.cc:492] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 196d972917fe4f85985e3862d40b7596: No bootstrap required, opened a new log
I20260709 13:13:35.601668 31747 ts_tablet_manager.cc:1403] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 196d972917fe4f85985e3862d40b7596: Time spent bootstrapping tablet: real 0.066s	user 0.013s	sys 0.014s
I20260709 13:13:35.602900 31749 tablet_bootstrap.cc:492] T 5b669b8d34ee4de5b002d30fbcf02dd7 P 76fb155ade354ee1ba78673e73b28aca: No bootstrap required, opened a new log
I20260709 13:13:35.603374 31749 ts_tablet_manager.cc:1403] T 5b669b8d34ee4de5b002d30fbcf02dd7 P 76fb155ade354ee1ba78673e73b28aca: Time spent bootstrapping tablet: real 0.037s	user 0.019s	sys 0.012s
I20260709 13:13:35.604570 31747 raft_consensus.cc:359] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:35.605329 31747 raft_consensus.cc:385] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:35.605646 31747 raft_consensus.cc:740] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 196d972917fe4f85985e3862d40b7596, State: Initialized, Role: FOLLOWER
I20260709 13:13:35.606112 31749 raft_consensus.cc:359] T 5b669b8d34ee4de5b002d30fbcf02dd7 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:35.606475 31750 tablet_bootstrap.cc:492] T 98a7e38754ed4644bf90b39aff07c70f P 458d610e8abf4f2ea831ab7bf3576da6: No bootstrap required, opened a new log
I20260709 13:13:35.606801 31749 raft_consensus.cc:385] T 5b669b8d34ee4de5b002d30fbcf02dd7 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:35.607159 31750 ts_tablet_manager.cc:1403] T 98a7e38754ed4644bf90b39aff07c70f P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.005s
I20260709 13:13:35.607143 31749 raft_consensus.cc:740] T 5b669b8d34ee4de5b002d30fbcf02dd7 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Initialized, Role: FOLLOWER
I20260709 13:13:35.608038 31749 consensus_queue.cc:260] T 5b669b8d34ee4de5b002d30fbcf02dd7 P 76fb155ade354ee1ba78673e73b28aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:35.610198 31749 ts_tablet_manager.cc:1434] T 5b669b8d34ee4de5b002d30fbcf02dd7 P 76fb155ade354ee1ba78673e73b28aca: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 13:13:35.610345 31750 raft_consensus.cc:359] T 98a7e38754ed4644bf90b39aff07c70f P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:35.611300 31749 tablet_bootstrap.cc:492] T de27ea68aab2485bb532389bb5c82433 P 76fb155ade354ee1ba78673e73b28aca: Bootstrap starting.
I20260709 13:13:35.611322 31750 raft_consensus.cc:385] T 98a7e38754ed4644bf90b39aff07c70f P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:35.611863 31750 raft_consensus.cc:740] T 98a7e38754ed4644bf90b39aff07c70f P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:35.606504 31747 consensus_queue.cc:260] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 196d972917fe4f85985e3862d40b7596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:35.612706 31750 consensus_queue.cc:260] T 98a7e38754ed4644bf90b39aff07c70f P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:35.618116 31749 tablet_bootstrap.cc:654] T de27ea68aab2485bb532389bb5c82433 P 76fb155ade354ee1ba78673e73b28aca: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:35.620276 31748 tablet_bootstrap.cc:492] T b3705de0af7a48f69f751aab333fdf3d P c74453754ee34bea9b231ae318a55a31: No bootstrap required, opened a new log
I20260709 13:13:35.621011 31748 ts_tablet_manager.cc:1403] T b3705de0af7a48f69f751aab333fdf3d P c74453754ee34bea9b231ae318a55a31: Time spent bootstrapping tablet: real 0.080s	user 0.012s	sys 0.008s
I20260709 13:13:35.623881 31748 raft_consensus.cc:359] T b3705de0af7a48f69f751aab333fdf3d P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:35.624531 31748 raft_consensus.cc:385] T b3705de0af7a48f69f751aab333fdf3d P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:35.624789 31748 raft_consensus.cc:740] T b3705de0af7a48f69f751aab333fdf3d P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Initialized, Role: FOLLOWER
I20260709 13:13:35.626885 31750 ts_tablet_manager.cc:1434] T 98a7e38754ed4644bf90b39aff07c70f P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.003s
I20260709 13:13:35.625483 31748 consensus_queue.cc:260] T b3705de0af7a48f69f751aab333fdf3d P c74453754ee34bea9b231ae318a55a31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:35.629215 31747 ts_tablet_manager.cc:1434] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 196d972917fe4f85985e3862d40b7596: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.000s
I20260709 13:13:35.629464 31749 tablet_bootstrap.cc:492] T de27ea68aab2485bb532389bb5c82433 P 76fb155ade354ee1ba78673e73b28aca: No bootstrap required, opened a new log
I20260709 13:13:35.629962 31749 ts_tablet_manager.cc:1403] T de27ea68aab2485bb532389bb5c82433 P 76fb155ade354ee1ba78673e73b28aca: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 13:13:35.630724 31747 tablet_bootstrap.cc:492] T 216111c5962f4b82ae52414985988860 P 196d972917fe4f85985e3862d40b7596: Bootstrap starting.
I20260709 13:13:35.632676 31749 raft_consensus.cc:359] T de27ea68aab2485bb532389bb5c82433 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:35.633317 31749 raft_consensus.cc:385] T de27ea68aab2485bb532389bb5c82433 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:35.633581 31749 raft_consensus.cc:740] T de27ea68aab2485bb532389bb5c82433 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Initialized, Role: FOLLOWER
I20260709 13:13:35.635401 31748 ts_tablet_manager.cc:1434] T b3705de0af7a48f69f751aab333fdf3d P c74453754ee34bea9b231ae318a55a31: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 13:13:35.635967 31749 consensus_queue.cc:260] T de27ea68aab2485bb532389bb5c82433 P 76fb155ade354ee1ba78673e73b28aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:35.636636 31748 tablet_bootstrap.cc:492] T e3516a073925457498018b87cdbaa85f P c74453754ee34bea9b231ae318a55a31: Bootstrap starting.
I20260709 13:13:35.637773 31747 tablet_bootstrap.cc:654] T 216111c5962f4b82ae52414985988860 P 196d972917fe4f85985e3862d40b7596: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:35.638521 31749 ts_tablet_manager.cc:1434] T de27ea68aab2485bb532389bb5c82433 P 76fb155ade354ee1ba78673e73b28aca: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:13:35.639673 31749 tablet_bootstrap.cc:492] T 1e727ab6847b4fbab9a94b63842c6b9c P 76fb155ade354ee1ba78673e73b28aca: Bootstrap starting.
I20260709 13:13:35.640260 31750 tablet_bootstrap.cc:492] T b3705de0af7a48f69f751aab333fdf3d P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:35.647025 31750 tablet_bootstrap.cc:654] T b3705de0af7a48f69f751aab333fdf3d P 458d610e8abf4f2ea831ab7bf3576da6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:35.647665 31748 tablet_bootstrap.cc:654] T e3516a073925457498018b87cdbaa85f P c74453754ee34bea9b231ae318a55a31: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:35.655309 31749 tablet_bootstrap.cc:654] T 1e727ab6847b4fbab9a94b63842c6b9c P 76fb155ade354ee1ba78673e73b28aca: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:35.661720 31759 raft_consensus.cc:493] T 1e727ab6847b4fbab9a94b63842c6b9c P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.662533 31881 raft_consensus.cc:493] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.662412 31759 raft_consensus.cc:515] T 1e727ab6847b4fbab9a94b63842c6b9c P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:35.663098 31881 raft_consensus.cc:515] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:35.666256 31476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbd8bd53d8d845b2b35de45d6d2f61a1" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:35.666926 31476 raft_consensus.cc:2468] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 0.
I20260709 13:13:35.667006 31804 raft_consensus.cc:493] T de27ea68aab2485bb532389bb5c82433 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.667276 31749 tablet_bootstrap.cc:492] T 1e727ab6847b4fbab9a94b63842c6b9c P 76fb155ade354ee1ba78673e73b28aca: No bootstrap required, opened a new log
I20260709 13:13:35.667526 31804 raft_consensus.cc:515] T de27ea68aab2485bb532389bb5c82433 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:35.667748 31749 ts_tablet_manager.cc:1403] T 1e727ab6847b4fbab9a94b63842c6b9c P 76fb155ade354ee1ba78673e73b28aca: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.003s
I20260709 13:13:35.668769 31668 leader_election.cc:304] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca; no voters: 
I20260709 13:13:35.669692 31789 raft_consensus.cc:2804] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:35.670102 31789 raft_consensus.cc:493] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:35.670430 31789 raft_consensus.cc:3060] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:35.670862 31426 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:35.671204 31749 raft_consensus.cc:359] T 1e727ab6847b4fbab9a94b63842c6b9c P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:35.672313 31749 raft_consensus.cc:385] T 1e727ab6847b4fbab9a94b63842c6b9c P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:35.672623 31749 raft_consensus.cc:740] T 1e727ab6847b4fbab9a94b63842c6b9c P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Initialized, Role: FOLLOWER
I20260709 13:13:35.673532 31628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de27ea68aab2485bb532389bb5c82433" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:35.674177 31628 raft_consensus.cc:2468] T de27ea68aab2485bb532389bb5c82433 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 196d972917fe4f85985e3862d40b7596 in term 0.
I20260709 13:13:35.675050 31749 consensus_queue.cc:260] T 1e727ab6847b4fbab9a94b63842c6b9c P 76fb155ade354ee1ba78673e73b28aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:35.677152 31749 ts_tablet_manager.cc:1434] T 1e727ab6847b4fbab9a94b63842c6b9c P 76fb155ade354ee1ba78673e73b28aca: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:13:35.678233 31749 tablet_bootstrap.cc:492] T f66580482b2d470bacbfec917042485b P 76fb155ade354ee1ba78673e73b28aca: Bootstrap starting.
I20260709 13:13:35.679059 31555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e727ab6847b4fbab9a94b63842c6b9c" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:35.681479 31756 raft_consensus.cc:493] T 40ab5d7d13ee4460933b5799482e3f87 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.681720 31521 leader_election.cc:304] T de27ea68aab2485bb532389bb5c82433 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, c74453754ee34bea9b231ae318a55a31; no voters: 
W20260709 13:13:35.682533 31592 leader_election.cc:343] T 1e727ab6847b4fbab9a94b63842c6b9c P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:35.682214 31756 raft_consensus.cc:515] T 40ab5d7d13ee4460933b5799482e3f87 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:35.682801 31855 consensus_queue.cc:1048] T 81f4d53616e74e2ea71e52fdb3e8fc76 P 196d972917fe4f85985e3862d40b7596 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:35.683686 31759 leader_election.cc:290] T 1e727ab6847b4fbab9a94b63842c6b9c P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431), 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715)
I20260709 13:13:35.684281 31855 raft_consensus.cc:2804] T de27ea68aab2485bb532389bb5c82433 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:35.684691 31855 raft_consensus.cc:493] T de27ea68aab2485bb532389bb5c82433 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:35.685024 31855 raft_consensus.cc:3060] T de27ea68aab2485bb532389bb5c82433 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:35.685281 31703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e727ab6847b4fbab9a94b63842c6b9c" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:35.685984 31703 raft_consensus.cc:2468] T 1e727ab6847b4fbab9a94b63842c6b9c P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 0.
I20260709 13:13:35.687420 31595 leader_election.cc:304] T 1e727ab6847b4fbab9a94b63842c6b9c P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca, c74453754ee34bea9b231ae318a55a31; no voters: 196d972917fe4f85985e3862d40b7596
I20260709 13:13:35.691017 31881 leader_election.cc:290] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:35.695715 31553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ab5d7d13ee4460933b5799482e3f87" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:35.696579 31553 raft_consensus.cc:2393] T 40ab5d7d13ee4460933b5799482e3f87 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 458d610e8abf4f2ea831ab7bf3576da6 in current term 1: Already voted for candidate 76fb155ade354ee1ba78673e73b28aca in this term.
I20260709 13:13:35.696475 31855 raft_consensus.cc:515] T de27ea68aab2485bb532389bb5c82433 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:35.685146 31756 leader_election.cc:290] T 40ab5d7d13ee4460933b5799482e3f87 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:35.699947 31555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbd8bd53d8d845b2b35de45d6d2f61a1" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:35.700583 31555 raft_consensus.cc:2468] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 0.
I20260709 13:13:35.702071 31804 leader_election.cc:290] T de27ea68aab2485bb532389bb5c82433 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715)
I20260709 13:13:35.704526 31859 raft_consensus.cc:2804] T 1e727ab6847b4fbab9a94b63842c6b9c P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:35.705017 31859 raft_consensus.cc:493] T 1e727ab6847b4fbab9a94b63842c6b9c P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:35.705351 31859 raft_consensus.cc:3060] T 1e727ab6847b4fbab9a94b63842c6b9c P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:35.708254 31759 raft_consensus.cc:493] T b3705de0af7a48f69f751aab333fdf3d P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.708767 31759 raft_consensus.cc:515] T b3705de0af7a48f69f751aab333fdf3d P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:35.710878 31701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de27ea68aab2485bb532389bb5c82433" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:35.711341 31627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de27ea68aab2485bb532389bb5c82433" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31"
I20260709 13:13:35.711582 31701 raft_consensus.cc:2468] T de27ea68aab2485bb532389bb5c82433 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 196d972917fe4f85985e3862d40b7596 in term 0.
I20260709 13:13:35.711913 31627 raft_consensus.cc:3060] T de27ea68aab2485bb532389bb5c82433 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:35.712218 31476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3705de0af7a48f69f751aab333fdf3d" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
W20260709 13:13:35.713829 31594 leader_election.cc:343] T b3705de0af7a48f69f751aab333fdf3d P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:35.714443 31759 leader_election.cc:290] T b3705de0af7a48f69f751aab333fdf3d P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:35.715782 31701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3705de0af7a48f69f751aab333fdf3d" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:35.717134 31759 consensus_queue.cc:1048] T 3e09c2945641463e91365b4826cc47e3 P c74453754ee34bea9b231ae318a55a31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:35.716701 31859 raft_consensus.cc:515] T 1e727ab6847b4fbab9a94b63842c6b9c P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:35.716610 31701 raft_consensus.cc:2468] T b3705de0af7a48f69f751aab333fdf3d P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 0.
I20260709 13:13:35.722190 31595 leader_election.cc:304] T b3705de0af7a48f69f751aab333fdf3d P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca, c74453754ee34bea9b231ae318a55a31; no voters: 458d610e8abf4f2ea831ab7bf3576da6
I20260709 13:13:35.723201 31703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ab5d7d13ee4460933b5799482e3f87" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:35.723349 31750 tablet_bootstrap.cc:492] T b3705de0af7a48f69f751aab333fdf3d P 458d610e8abf4f2ea831ab7bf3576da6: No bootstrap required, opened a new log
I20260709 13:13:35.723343 31874 raft_consensus.cc:2804] T b3705de0af7a48f69f751aab333fdf3d P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:35.724062 31874 raft_consensus.cc:493] T b3705de0af7a48f69f751aab333fdf3d P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:35.724347 31874 raft_consensus.cc:3060] T b3705de0af7a48f69f751aab333fdf3d P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:35.727964 31627 raft_consensus.cc:2468] T de27ea68aab2485bb532389bb5c82433 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 196d972917fe4f85985e3862d40b7596 in term 1.
I20260709 13:13:35.728794 31701 raft_consensus.cc:1275] T eb560d89d58246e5856a763e3be6f086 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Refusing update from remote peer 196d972917fe4f85985e3862d40b7596: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 13:13:35.729224 31701 pending_rounds.cc:85] T eb560d89d58246e5856a763e3be6f086 P 76fb155ade354ee1ba78673e73b28aca: Aborting all ops after (but not including) 0
I20260709 13:13:35.730012 31701 pending_rounds.cc:107] T eb560d89d58246e5856a763e3be6f086 P 76fb155ade354ee1ba78673e73b28aca: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:13:35.730396 31701 raft_consensus.cc:2889] T eb560d89d58246e5856a763e3be6f086 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:35.729240 31521 leader_election.cc:304] T de27ea68aab2485bb532389bb5c82433 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, c74453754ee34bea9b231ae318a55a31; no voters: 
I20260709 13:13:35.732056 31804 raft_consensus.cc:2804] T de27ea68aab2485bb532389bb5c82433 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:35.724365 31750 ts_tablet_manager.cc:1403] T b3705de0af7a48f69f751aab333fdf3d P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.096s	user 0.017s	sys 0.018s
I20260709 13:13:35.733003 31771 consensus_queue.cc:1048] T eb560d89d58246e5856a763e3be6f086 P 196d972917fe4f85985e3862d40b7596 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:35.733526 31789 raft_consensus.cc:515] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:35.735590 31750 raft_consensus.cc:359] T b3705de0af7a48f69f751aab333fdf3d P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:35.737857 31750 raft_consensus.cc:385] T b3705de0af7a48f69f751aab333fdf3d P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:35.737654 31476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbd8bd53d8d845b2b35de45d6d2f61a1" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
I20260709 13:13:35.738430 31855 leader_election.cc:290] T de27ea68aab2485bb532389bb5c82433 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 election: Requested vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715)
I20260709 13:13:35.738435 31476 raft_consensus.cc:3060] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:35.740419 31446 leader_election.cc:304] T 40ab5d7d13ee4460933b5799482e3f87 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6; no voters: 196d972917fe4f85985e3862d40b7596, 76fb155ade354ee1ba78673e73b28aca
I20260709 13:13:35.741266 31756 raft_consensus.cc:3060] T 40ab5d7d13ee4460933b5799482e3f87 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:35.745229 31750 raft_consensus.cc:740] T b3705de0af7a48f69f751aab333fdf3d P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:35.747920 31859 leader_election.cc:290] T 1e727ab6847b4fbab9a94b63842c6b9c P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 election: Requested vote from peers 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431), 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715)
I20260709 13:13:35.748781 31555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e727ab6847b4fbab9a94b63842c6b9c" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596"
I20260709 13:13:35.749037 31703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e727ab6847b4fbab9a94b63842c6b9c" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca"
I20260709 13:13:35.749630 31749 tablet_bootstrap.cc:654] T f66580482b2d470bacbfec917042485b P 76fb155ade354ee1ba78673e73b28aca: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:35.749927 31747 tablet_bootstrap.cc:492] T 216111c5962f4b82ae52414985988860 P 196d972917fe4f85985e3862d40b7596: No bootstrap required, opened a new log
W20260709 13:13:35.749998 31592 leader_election.cc:343] T 1e727ab6847b4fbab9a94b63842c6b9c P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:35.750512 31747 ts_tablet_manager.cc:1403] T 216111c5962f4b82ae52414985988860 P 196d972917fe4f85985e3862d40b7596: Time spent bootstrapping tablet: real 0.120s	user 0.020s	sys 0.015s
I20260709 13:13:35.744560 31771 consensus_queue.cc:1048] T 81f4d53616e74e2ea71e52fdb3e8fc76 P 196d972917fe4f85985e3862d40b7596 [LEADER]: Connected to new peer: Peer: permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:13:35.742215 31789 leader_election.cc:290] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 election: Requested vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:35.749634 31703 raft_consensus.cc:3060] T 1e727ab6847b4fbab9a94b63842c6b9c P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:35.748538 31859 consensus_queue.cc:1048] T 3e09c2945641463e91365b4826cc47e3 P c74453754ee34bea9b231ae318a55a31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:13:35.777594 31756 raft_consensus.cc:2749] T 40ab5d7d13ee4460933b5799482e3f87 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:35.779971 31749 tablet_bootstrap.cc:492] T f66580482b2d470bacbfec917042485b P 76fb155ade354ee1ba78673e73b28aca: No bootstrap required, opened a new log
I20260709 13:13:35.764904 31750 consensus_queue.cc:260] T b3705de0af7a48f69f751aab333fdf3d P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:35.758180 31874 raft_consensus.cc:515] T b3705de0af7a48f69f751aab333fdf3d P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:35.783890 31749 ts_tablet_manager.cc:1403] T f66580482b2d470bacbfec917042485b P 76fb155ade354ee1ba78673e73b28aca: Time spent bootstrapping tablet: real 0.106s	user 0.019s	sys 0.010s
I20260709 13:13:35.783988 31874 leader_election.cc:290] T b3705de0af7a48f69f751aab333fdf3d P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 election: Requested vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:35.790473 31855 raft_consensus.cc:493] T 98a7e38754ed4644bf90b39aff07c70f P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.787376 31749 raft_consensus.cc:359] T f66580482b2d470bacbfec917042485b P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:35.791177 31855 raft_consensus.cc:515] T 98a7e38754ed4644bf90b39aff07c70f P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:35.792161 31749 raft_consensus.cc:385] T f66580482b2d470bacbfec917042485b P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:35.792805 31749 raft_consensus.cc:740] T f66580482b2d470bacbfec917042485b P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Initialized, Role: FOLLOWER
I20260709 13:13:35.793972 31749 consensus_queue.cc:260] T f66580482b2d470bacbfec917042485b P 76fb155ade354ee1ba78673e73b28aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:35.799758 31750 ts_tablet_manager.cc:1434] T b3705de0af7a48f69f751aab333fdf3d P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.067s	user 0.007s	sys 0.000s
I20260709 13:13:35.804157 31749 ts_tablet_manager.cc:1434] T f66580482b2d470bacbfec917042485b P 76fb155ade354ee1ba78673e73b28aca: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:13:35.805155 31702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de27ea68aab2485bb532389bb5c82433" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca"
I20260709 13:13:35.813156 31702 raft_consensus.cc:3060] T de27ea68aab2485bb532389bb5c82433 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:35.813977 31747 raft_consensus.cc:359] T 216111c5962f4b82ae52414985988860 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:35.814713 31747 raft_consensus.cc:385] T 216111c5962f4b82ae52414985988860 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:35.814991 31747 raft_consensus.cc:740] T 216111c5962f4b82ae52414985988860 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 196d972917fe4f85985e3862d40b7596, State: Initialized, Role: FOLLOWER
I20260709 13:13:35.815680 31747 consensus_queue.cc:260] T 216111c5962f4b82ae52414985988860 P 196d972917fe4f85985e3862d40b7596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:35.818024 31747 ts_tablet_manager.cc:1434] T 216111c5962f4b82ae52414985988860 P 196d972917fe4f85985e3862d40b7596: Time spent starting tablet: real 0.067s	user 0.007s	sys 0.001s
I20260709 13:13:35.822198 31813 raft_consensus.cc:493] T f66580482b2d470bacbfec917042485b P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.822520 31476 raft_consensus.cc:2468] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 1.
I20260709 13:13:35.822712 31813 raft_consensus.cc:515] T f66580482b2d470bacbfec917042485b P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:35.823437 31881 consensus_queue.cc:1048] T d78bdf917ee94331b91cb3fb308ef2a1 P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:35.824950 31813 leader_election.cc:290] T f66580482b2d470bacbfec917042485b P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:35.821610 31747 tablet_bootstrap.cc:492] T 075b9562a2b547c8aad80c2bae413556 P 196d972917fe4f85985e3862d40b7596: Bootstrap starting.
I20260709 13:13:35.825428 31749 tablet_bootstrap.cc:492] T e3516a073925457498018b87cdbaa85f P 76fb155ade354ee1ba78673e73b28aca: Bootstrap starting.
I20260709 13:13:35.825323 31480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3705de0af7a48f69f751aab333fdf3d" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
I20260709 13:13:35.820621 31804 raft_consensus.cc:697] T de27ea68aab2485bb532389bb5c82433 P 196d972917fe4f85985e3862d40b7596 [term 1 LEADER]: Becoming Leader. State: Replica: 196d972917fe4f85985e3862d40b7596, State: Running, Role: LEADER
I20260709 13:13:35.837940 31476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a7e38754ed4644bf90b39aff07c70f" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:35.838281 31668 leader_election.cc:304] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca; no voters: 
I20260709 13:13:35.833870 31855 leader_election.cc:290] T 98a7e38754ed4644bf90b39aff07c70f P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:35.839226 31628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66580482b2d470bacbfec917042485b" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:35.844441 31476 raft_consensus.cc:2468] T 98a7e38754ed4644bf90b39aff07c70f P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 196d972917fe4f85985e3862d40b7596 in term 0.
I20260709 13:13:35.840651 31475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66580482b2d470bacbfec917042485b" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:35.845949 31520 leader_election.cc:304] T 98a7e38754ed4644bf90b39aff07c70f P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, 458d610e8abf4f2ea831ab7bf3576da6; no voters: 
W20260709 13:13:35.846364 31669 leader_election.cc:343] T f66580482b2d470bacbfec917042485b P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:35.846712 31477 raft_consensus.cc:1275] T eb560d89d58246e5856a763e3be6f086 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Refusing update from remote peer 196d972917fe4f85985e3862d40b7596: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:13:35.846887 31855 raft_consensus.cc:2804] T 98a7e38754ed4644bf90b39aff07c70f P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:35.847285 31855 raft_consensus.cc:493] T 98a7e38754ed4644bf90b39aff07c70f P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:35.847610 31855 raft_consensus.cc:3060] T 98a7e38754ed4644bf90b39aff07c70f P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:35.847644 31881 raft_consensus.cc:493] T 5b669b8d34ee4de5b002d30fbcf02dd7 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.848167 31881 raft_consensus.cc:515] T 5b669b8d34ee4de5b002d30fbcf02dd7 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:35.848589 31771 consensus_queue.cc:1048] T eb560d89d58246e5856a763e3be6f086 P 196d972917fe4f85985e3862d40b7596 [LEADER]: Connected to new peer: Peer: permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:35.850296 31881 leader_election.cc:290] T 5b669b8d34ee4de5b002d30fbcf02dd7 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:35.834477 31480 raft_consensus.cc:3060] T b3705de0af7a48f69f751aab333fdf3d P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:35.852471 31628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b669b8d34ee4de5b002d30fbcf02dd7" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:35.853231 31628 raft_consensus.cc:2468] T 5b669b8d34ee4de5b002d30fbcf02dd7 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 0.
I20260709 13:13:35.856973 31669 leader_election.cc:304] T 5b669b8d34ee4de5b002d30fbcf02dd7 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca, c74453754ee34bea9b231ae318a55a31; no voters: 
I20260709 13:13:35.857961 31750 tablet_bootstrap.cc:492] T ac45af43771c45fd8e57204c190c322b P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:35.858826 31789 raft_consensus.cc:2804] T 5b669b8d34ee4de5b002d30fbcf02dd7 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:35.859231 31789 raft_consensus.cc:493] T 5b669b8d34ee4de5b002d30fbcf02dd7 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:35.859570 31789 raft_consensus.cc:3060] T 5b669b8d34ee4de5b002d30fbcf02dd7 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:35.861884 31813 raft_consensus.cc:2804] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:35.862449 31813 raft_consensus.cc:697] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 76fb155ade354ee1ba78673e73b28aca [term 1 LEADER]: Becoming Leader. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Running, Role: LEADER
I20260709 13:13:35.863371 31813 consensus_queue.cc:237] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
W20260709 13:13:35.866329 31668 leader_election.cc:343] T f66580482b2d470bacbfec917042485b P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:35.866880 31668 leader_election.cc:304] T f66580482b2d470bacbfec917042485b P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca; no voters: 458d610e8abf4f2ea831ab7bf3576da6, c74453754ee34bea9b231ae318a55a31
I20260709 13:13:35.867887 31881 raft_consensus.cc:2749] T f66580482b2d470bacbfec917042485b P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:35.869427 31476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b669b8d34ee4de5b002d30fbcf02dd7" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:35.871855 31855 raft_consensus.cc:515] T 98a7e38754ed4644bf90b39aff07c70f P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:35.872041 31702 raft_consensus.cc:2468] T de27ea68aab2485bb532389bb5c82433 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 196d972917fe4f85985e3862d40b7596 in term 1.
I20260709 13:13:35.875006 31478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a7e38754ed4644bf90b39aff07c70f" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
I20260709 13:13:35.875595 31478 raft_consensus.cc:3060] T 98a7e38754ed4644bf90b39aff07c70f P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:35.876147 31817 consensus_queue.cc:1048] T 4d146b574e8d4e21bd8d81cb29b4267a P c74453754ee34bea9b231ae318a55a31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:35.881254 31749 tablet_bootstrap.cc:654] T e3516a073925457498018b87cdbaa85f P 76fb155ade354ee1ba78673e73b28aca: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:35.842927 31701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3705de0af7a48f69f751aab333fdf3d" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca"
I20260709 13:13:35.886493 31748 tablet_bootstrap.cc:492] T e3516a073925457498018b87cdbaa85f P c74453754ee34bea9b231ae318a55a31: No bootstrap required, opened a new log
I20260709 13:13:35.886953 31748 ts_tablet_manager.cc:1403] T e3516a073925457498018b87cdbaa85f P c74453754ee34bea9b231ae318a55a31: Time spent bootstrapping tablet: real 0.251s	user 0.012s	sys 0.031s
I20260709 13:13:35.889459 31555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbd8bd53d8d845b2b35de45d6d2f61a1" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596"
I20260709 13:13:35.889874 31747 tablet_bootstrap.cc:654] T 075b9562a2b547c8aad80c2bae413556 P 196d972917fe4f85985e3862d40b7596: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:35.890131 31555 raft_consensus.cc:3060] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:35.892235 31859 consensus_queue.cc:1048] T 4d146b574e8d4e21bd8d81cb29b4267a P c74453754ee34bea9b231ae318a55a31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:13:35.899585 31668 leader_election.cc:343] T 5b669b8d34ee4de5b002d30fbcf02dd7 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:35.902433 31703 raft_consensus.cc:2468] T 1e727ab6847b4fbab9a94b63842c6b9c P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 1.
I20260709 13:13:35.903735 31595 leader_election.cc:304] T 1e727ab6847b4fbab9a94b63842c6b9c P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca, c74453754ee34bea9b231ae318a55a31; no voters: 196d972917fe4f85985e3862d40b7596
I20260709 13:13:35.905006 31859 raft_consensus.cc:2804] T 1e727ab6847b4fbab9a94b63842c6b9c P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:35.905488 31859 raft_consensus.cc:697] T 1e727ab6847b4fbab9a94b63842c6b9c P c74453754ee34bea9b231ae318a55a31 [term 1 LEADER]: Becoming Leader. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Running, Role: LEADER
I20260709 13:13:35.906303 31859 consensus_queue.cc:237] T 1e727ab6847b4fbab9a94b63842c6b9c P c74453754ee34bea9b231ae318a55a31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:35.886098 31701 raft_consensus.cc:3060] T b3705de0af7a48f69f751aab333fdf3d P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:35.907902 31789 raft_consensus.cc:515] T 5b669b8d34ee4de5b002d30fbcf02dd7 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:35.916677 31629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b669b8d34ee4de5b002d30fbcf02dd7" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31"
I20260709 13:13:35.897457 31804 consensus_queue.cc:237] T de27ea68aab2485bb532389bb5c82433 P 196d972917fe4f85985e3862d40b7596 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:35.917313 31629 raft_consensus.cc:3060] T 5b669b8d34ee4de5b002d30fbcf02dd7 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:35.921835 31478 raft_consensus.cc:2468] T 98a7e38754ed4644bf90b39aff07c70f P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 196d972917fe4f85985e3862d40b7596 in term 1.
I20260709 13:13:35.922523 31476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b669b8d34ee4de5b002d30fbcf02dd7" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
I20260709 13:13:35.923071 31520 leader_election.cc:304] T 98a7e38754ed4644bf90b39aff07c70f P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, 458d610e8abf4f2ea831ab7bf3576da6; no voters: 
I20260709 13:13:35.924014 31909 raft_consensus.cc:2804] T 98a7e38754ed4644bf90b39aff07c70f P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:35.924553 31909 raft_consensus.cc:697] T 98a7e38754ed4644bf90b39aff07c70f P 196d972917fe4f85985e3862d40b7596 [term 1 LEADER]: Becoming Leader. State: Replica: 196d972917fe4f85985e3862d40b7596, State: Running, Role: LEADER
I20260709 13:13:35.925413 31909 consensus_queue.cc:237] T 98a7e38754ed4644bf90b39aff07c70f P 196d972917fe4f85985e3862d40b7596 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:35.927910 31629 raft_consensus.cc:2468] T 5b669b8d34ee4de5b002d30fbcf02dd7 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 1.
I20260709 13:13:35.928143 31480 raft_consensus.cc:2468] T b3705de0af7a48f69f751aab333fdf3d P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 1.
I20260709 13:13:35.934108 31594 leader_election.cc:304] T b3705de0af7a48f69f751aab333fdf3d P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, c74453754ee34bea9b231ae318a55a31; no voters: 
I20260709 13:13:35.933478 31789 leader_election.cc:290] T 5b669b8d34ee4de5b002d30fbcf02dd7 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 election: Requested vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:35.932015 31855 leader_election.cc:290] T 98a7e38754ed4644bf90b39aff07c70f P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 election: Requested vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:35.929298 31669 leader_election.cc:304] T 5b669b8d34ee4de5b002d30fbcf02dd7 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca, c74453754ee34bea9b231ae318a55a31; no voters: 
I20260709 13:13:35.935884 31817 raft_consensus.cc:2804] T b3705de0af7a48f69f751aab333fdf3d P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:35.945672 31748 raft_consensus.cc:359] T e3516a073925457498018b87cdbaa85f P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:35.947130 31750 tablet_bootstrap.cc:654] T ac45af43771c45fd8e57204c190c322b P 458d610e8abf4f2ea831ab7bf3576da6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:35.949986 31748 raft_consensus.cc:385] T e3516a073925457498018b87cdbaa85f P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:35.950371 31748 raft_consensus.cc:740] T e3516a073925457498018b87cdbaa85f P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Initialized, Role: FOLLOWER
I20260709 13:13:35.952924 31881 raft_consensus.cc:2804] T 5b669b8d34ee4de5b002d30fbcf02dd7 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:35.953632 31881 raft_consensus.cc:697] T 5b669b8d34ee4de5b002d30fbcf02dd7 P 76fb155ade354ee1ba78673e73b28aca [term 1 LEADER]: Becoming Leader. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Running, Role: LEADER
I20260709 13:13:35.954770 31881 consensus_queue.cc:237] T 5b669b8d34ee4de5b002d30fbcf02dd7 P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:35.974974 31748 consensus_queue.cc:260] T e3516a073925457498018b87cdbaa85f P c74453754ee34bea9b231ae318a55a31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
W20260709 13:13:35.949088 31668 leader_election.cc:343] T 5b669b8d34ee4de5b002d30fbcf02dd7 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:35.958519 31817 raft_consensus.cc:697] T b3705de0af7a48f69f751aab333fdf3d P c74453754ee34bea9b231ae318a55a31 [term 1 LEADER]: Becoming Leader. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Running, Role: LEADER
I20260709 13:13:35.988690 31627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a7e38754ed4644bf90b39aff07c70f" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:35.989439 31627 raft_consensus.cc:2468] T 98a7e38754ed4644bf90b39aff07c70f P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 196d972917fe4f85985e3862d40b7596 in term 0.
I20260709 13:13:36.000891 31748 ts_tablet_manager.cc:1434] T e3516a073925457498018b87cdbaa85f P c74453754ee34bea9b231ae318a55a31: Time spent starting tablet: real 0.114s	user 0.005s	sys 0.005s
I20260709 13:13:36.001402 31817 consensus_queue.cc:237] T b3705de0af7a48f69f751aab333fdf3d P c74453754ee34bea9b231ae318a55a31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:36.021353 31747 tablet_bootstrap.cc:492] T 075b9562a2b547c8aad80c2bae413556 P 196d972917fe4f85985e3862d40b7596: No bootstrap required, opened a new log
I20260709 13:13:36.023430 31747 ts_tablet_manager.cc:1403] T 075b9562a2b547c8aad80c2bae413556 P 196d972917fe4f85985e3862d40b7596: Time spent bootstrapping tablet: real 0.202s	user 0.022s	sys 0.011s
I20260709 13:13:36.006436 31627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a7e38754ed4644bf90b39aff07c70f" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31"
I20260709 13:13:35.992532 31701 raft_consensus.cc:2468] T b3705de0af7a48f69f751aab333fdf3d P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 1.
I20260709 13:13:36.028359 31627 raft_consensus.cc:3060] T 98a7e38754ed4644bf90b39aff07c70f P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:36.021634 31555 raft_consensus.cc:2468] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 1.
I20260709 13:13:36.046551 31748 tablet_bootstrap.cc:492] T ac45af43771c45fd8e57204c190c322b P c74453754ee34bea9b231ae318a55a31: Bootstrap starting.
I20260709 13:13:36.051934 31789 consensus_queue.cc:1048] T 40ab5d7d13ee4460933b5799482e3f87 P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:36.058182 31747 raft_consensus.cc:359] T 075b9562a2b547c8aad80c2bae413556 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:36.058928 31747 raft_consensus.cc:385] T 075b9562a2b547c8aad80c2bae413556 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:36.059284 31747 raft_consensus.cc:740] T 075b9562a2b547c8aad80c2bae413556 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 196d972917fe4f85985e3862d40b7596, State: Initialized, Role: FOLLOWER
I20260709 13:13:36.060582 31747 consensus_queue.cc:260] T 075b9562a2b547c8aad80c2bae413556 P 196d972917fe4f85985e3862d40b7596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:36.061398 31749 tablet_bootstrap.cc:492] T e3516a073925457498018b87cdbaa85f P 76fb155ade354ee1ba78673e73b28aca: No bootstrap required, opened a new log
I20260709 13:13:36.086009 31378 catalog_manager.cc:5697] T de27ea68aab2485bb532389bb5c82433 P 196d972917fe4f85985e3862d40b7596 reported cstate change: term changed from 0 to 1, leader changed from <none> to 196d972917fe4f85985e3862d40b7596 (127.23.140.66). New cstate: current_term: 1 leader_uuid: "196d972917fe4f85985e3862d40b7596" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:36.101655 31374 catalog_manager.cc:5697] T 1e727ab6847b4fbab9a94b63842c6b9c P c74453754ee34bea9b231ae318a55a31 reported cstate change: term changed from 0 to 1, leader changed from <none> to c74453754ee34bea9b231ae318a55a31 (127.23.140.67). New cstate: current_term: 1 leader_uuid: "c74453754ee34bea9b231ae318a55a31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:36.123565 31747 ts_tablet_manager.cc:1434] T 075b9562a2b547c8aad80c2bae413556 P 196d972917fe4f85985e3862d40b7596: Time spent starting tablet: real 0.100s	user 0.006s	sys 0.000s
I20260709 13:13:36.097734 31376 catalog_manager.cc:5697] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 76fb155ade354ee1ba78673e73b28aca reported cstate change: term changed from 0 to 1, leader changed from <none> to 76fb155ade354ee1ba78673e73b28aca (127.23.140.68). New cstate: current_term: 1 leader_uuid: "76fb155ade354ee1ba78673e73b28aca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:36.123085 31749 ts_tablet_manager.cc:1403] T e3516a073925457498018b87cdbaa85f P 76fb155ade354ee1ba78673e73b28aca: Time spent bootstrapping tablet: real 0.298s	user 0.010s	sys 0.012s
I20260709 13:13:36.125625 31748 tablet_bootstrap.cc:654] T ac45af43771c45fd8e57204c190c322b P c74453754ee34bea9b231ae318a55a31: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:36.123131 31374 catalog_manager.cc:5697] T b3705de0af7a48f69f751aab333fdf3d P c74453754ee34bea9b231ae318a55a31 reported cstate change: term changed from 0 to 1, leader changed from <none> to c74453754ee34bea9b231ae318a55a31 (127.23.140.67). New cstate: current_term: 1 leader_uuid: "c74453754ee34bea9b231ae318a55a31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:36.132370 31749 raft_consensus.cc:359] T e3516a073925457498018b87cdbaa85f P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:36.133384 31749 raft_consensus.cc:385] T e3516a073925457498018b87cdbaa85f P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:36.133726 31749 raft_consensus.cc:740] T e3516a073925457498018b87cdbaa85f P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Initialized, Role: FOLLOWER
I20260709 13:13:36.135603 31749 consensus_queue.cc:260] T e3516a073925457498018b87cdbaa85f P 76fb155ade354ee1ba78673e73b28aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:36.138149 31747 tablet_bootstrap.cc:492] T ac45af43771c45fd8e57204c190c322b P 196d972917fe4f85985e3862d40b7596: Bootstrap starting.
I20260709 13:13:36.135004 31627 raft_consensus.cc:2468] T 98a7e38754ed4644bf90b39aff07c70f P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 196d972917fe4f85985e3862d40b7596 in term 1.
I20260709 13:13:36.145635 31749 ts_tablet_manager.cc:1434] T e3516a073925457498018b87cdbaa85f P 76fb155ade354ee1ba78673e73b28aca: Time spent starting tablet: real 0.021s	user 0.003s	sys 0.004s
W20260709 13:13:36.153981 31668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:37919, user_credentials={real_user=slave}} blocked reactor thread for 218053us
I20260709 13:13:36.155532 31750 tablet_bootstrap.cc:492] T ac45af43771c45fd8e57204c190c322b P 458d610e8abf4f2ea831ab7bf3576da6: No bootstrap required, opened a new log
I20260709 13:13:36.156829 31750 ts_tablet_manager.cc:1403] T ac45af43771c45fd8e57204c190c322b P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.313s	user 0.029s	sys 0.063s
I20260709 13:13:36.158170 31749 tablet_bootstrap.cc:492] T 075b9562a2b547c8aad80c2bae413556 P 76fb155ade354ee1ba78673e73b28aca: Bootstrap starting.
I20260709 13:13:36.166409 31749 tablet_bootstrap.cc:654] T 075b9562a2b547c8aad80c2bae413556 P 76fb155ade354ee1ba78673e73b28aca: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:36.173977 31750 raft_consensus.cc:359] T ac45af43771c45fd8e57204c190c322b P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:36.175036 31750 raft_consensus.cc:385] T ac45af43771c45fd8e57204c190c322b P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:36.175382 31750 raft_consensus.cc:740] T ac45af43771c45fd8e57204c190c322b P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:36.176326 31750 consensus_queue.cc:260] T ac45af43771c45fd8e57204c190c322b P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:36.179322 31747 tablet_bootstrap.cc:654] T ac45af43771c45fd8e57204c190c322b P 196d972917fe4f85985e3862d40b7596: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:36.181372 31921 raft_consensus.cc:493] T 216111c5962f4b82ae52414985988860 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.182248 31921 raft_consensus.cc:515] T 216111c5962f4b82ae52414985988860 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:36.184926 31750 ts_tablet_manager.cc:1434] T ac45af43771c45fd8e57204c190c322b P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.002s
I20260709 13:13:36.186126 31750 tablet_bootstrap.cc:492] T 216111c5962f4b82ae52414985988860 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:36.188354 31554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216111c5962f4b82ae52414985988860" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:36.189265 31554 raft_consensus.cc:2468] T 216111c5962f4b82ae52414985988860 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 0.
I20260709 13:13:36.191007 31666 leader_election.cc:304] T 216111c5962f4b82ae52414985988860 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, 76fb155ade354ee1ba78673e73b28aca; no voters: 
I20260709 13:13:36.192160 31920 raft_consensus.cc:2804] T 216111c5962f4b82ae52414985988860 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:36.192613 31920 raft_consensus.cc:493] T 216111c5962f4b82ae52414985988860 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:36.192943 31920 raft_consensus.cc:3060] T 216111c5962f4b82ae52414985988860 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:36.194074 31789 consensus_queue.cc:1048] T d78bdf917ee94331b91cb3fb308ef2a1 P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:36.199335 31475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216111c5962f4b82ae52414985988860" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:36.205252 31813 consensus_queue.cc:1048] T 40ab5d7d13ee4460933b5799482e3f87 P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:36.192163 31921 leader_election.cc:290] T 216111c5962f4b82ae52414985988860 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
W20260709 13:13:36.208843 31668 leader_election.cc:343] T 216111c5962f4b82ae52414985988860 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:36.209303 31750 tablet_bootstrap.cc:654] T 216111c5962f4b82ae52414985988860 P 458d610e8abf4f2ea831ab7bf3576da6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:36.205615 31920 raft_consensus.cc:515] T 216111c5962f4b82ae52414985988860 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:36.217718 31920 leader_election.cc:290] T 216111c5962f4b82ae52414985988860 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 election: Requested vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:36.219079 31554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216111c5962f4b82ae52414985988860" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596"
I20260709 13:13:36.219918 31554 raft_consensus.cc:3060] T 216111c5962f4b82ae52414985988860 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:36.226006 31748 tablet_bootstrap.cc:492] T ac45af43771c45fd8e57204c190c322b P c74453754ee34bea9b231ae318a55a31: No bootstrap required, opened a new log
I20260709 13:13:36.226511 31748 ts_tablet_manager.cc:1403] T ac45af43771c45fd8e57204c190c322b P c74453754ee34bea9b231ae318a55a31: Time spent bootstrapping tablet: real 0.180s	user 0.023s	sys 0.014s
I20260709 13:13:36.228796 31748 raft_consensus.cc:359] T ac45af43771c45fd8e57204c190c322b P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:36.229303 31748 raft_consensus.cc:385] T ac45af43771c45fd8e57204c190c322b P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:36.229523 31748 raft_consensus.cc:740] T ac45af43771c45fd8e57204c190c322b P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Initialized, Role: FOLLOWER
I20260709 13:13:36.236725 31748 consensus_queue.cc:260] T ac45af43771c45fd8e57204c190c322b P c74453754ee34bea9b231ae318a55a31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:36.238895 31748 ts_tablet_manager.cc:1434] T ac45af43771c45fd8e57204c190c322b P c74453754ee34bea9b231ae318a55a31: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:13:36.240037 31748 tablet_bootstrap.cc:492] T 5ea74721b8824d00b63c524b25ff23df P c74453754ee34bea9b231ae318a55a31: Bootstrap starting.
I20260709 13:13:36.241546 31477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216111c5962f4b82ae52414985988860" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
W20260709 13:13:36.243613 31668 leader_election.cc:343] T 216111c5962f4b82ae52414985988860 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:36.248879 31554 raft_consensus.cc:2468] T 216111c5962f4b82ae52414985988860 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 1.
I20260709 13:13:36.250821 31748 tablet_bootstrap.cc:654] T 5ea74721b8824d00b63c524b25ff23df P c74453754ee34bea9b231ae318a55a31: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:36.252727 31749 tablet_bootstrap.cc:492] T 075b9562a2b547c8aad80c2bae413556 P 76fb155ade354ee1ba78673e73b28aca: No bootstrap required, opened a new log
I20260709 13:13:36.253206 31749 ts_tablet_manager.cc:1403] T 075b9562a2b547c8aad80c2bae413556 P 76fb155ade354ee1ba78673e73b28aca: Time spent bootstrapping tablet: real 0.102s	user 0.015s	sys 0.008s
I20260709 13:13:36.255954 31749 raft_consensus.cc:359] T 075b9562a2b547c8aad80c2bae413556 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:36.256464 31749 raft_consensus.cc:385] T 075b9562a2b547c8aad80c2bae413556 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:36.256688 31749 raft_consensus.cc:740] T 075b9562a2b547c8aad80c2bae413556 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Initialized, Role: FOLLOWER
I20260709 13:13:36.257326 31749 consensus_queue.cc:260] T 075b9562a2b547c8aad80c2bae413556 P 76fb155ade354ee1ba78673e73b28aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:36.258984 31666 leader_election.cc:304] T 216111c5962f4b82ae52414985988860 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, 76fb155ade354ee1ba78673e73b28aca; no voters: 458d610e8abf4f2ea831ab7bf3576da6
I20260709 13:13:36.260340 31747 tablet_bootstrap.cc:492] T ac45af43771c45fd8e57204c190c322b P 196d972917fe4f85985e3862d40b7596: No bootstrap required, opened a new log
I20260709 13:13:36.260855 31747 ts_tablet_manager.cc:1403] T ac45af43771c45fd8e57204c190c322b P 196d972917fe4f85985e3862d40b7596: Time spent bootstrapping tablet: real 0.134s	user 0.012s	sys 0.016s
I20260709 13:13:36.260995 31920 raft_consensus.cc:2804] T 216111c5962f4b82ae52414985988860 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:36.261485 31920 raft_consensus.cc:697] T 216111c5962f4b82ae52414985988860 P 76fb155ade354ee1ba78673e73b28aca [term 1 LEADER]: Becoming Leader. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Running, Role: LEADER
I20260709 13:13:36.262295 31920 consensus_queue.cc:237] T 216111c5962f4b82ae52414985988860 P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:36.263568 31747 raft_consensus.cc:359] T ac45af43771c45fd8e57204c190c322b P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:36.264256 31747 raft_consensus.cc:385] T ac45af43771c45fd8e57204c190c322b P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:36.264628 31747 raft_consensus.cc:740] T ac45af43771c45fd8e57204c190c322b P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 196d972917fe4f85985e3862d40b7596, State: Initialized, Role: FOLLOWER
I20260709 13:13:36.265326 31747 consensus_queue.cc:260] T ac45af43771c45fd8e57204c190c322b P 196d972917fe4f85985e3862d40b7596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:36.268074 31747 ts_tablet_manager.cc:1434] T ac45af43771c45fd8e57204c190c322b P 196d972917fe4f85985e3862d40b7596: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:13:36.271813 31750 tablet_bootstrap.cc:492] T 216111c5962f4b82ae52414985988860 P 458d610e8abf4f2ea831ab7bf3576da6: No bootstrap required, opened a new log
I20260709 13:13:36.266217 31817 raft_consensus.cc:493] T e3516a073925457498018b87cdbaa85f P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.272325 31750 ts_tablet_manager.cc:1403] T 216111c5962f4b82ae52414985988860 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.086s	user 0.005s	sys 0.007s
I20260709 13:13:36.272445 31817 raft_consensus.cc:515] T e3516a073925457498018b87cdbaa85f P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:36.275375 31817 leader_election.cc:290] T e3516a073925457498018b87cdbaa85f P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431), 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715)
I20260709 13:13:36.275791 31750 raft_consensus.cc:359] T 216111c5962f4b82ae52414985988860 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:36.276463 31750 raft_consensus.cc:385] T 216111c5962f4b82ae52414985988860 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:36.276749 31750 raft_consensus.cc:740] T 216111c5962f4b82ae52414985988860 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:36.277781 31749 ts_tablet_manager.cc:1434] T 075b9562a2b547c8aad80c2bae413556 P 76fb155ade354ee1ba78673e73b28aca: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 13:13:36.278842 31749 tablet_bootstrap.cc:492] T 85d4a24725c749199c1b35d959b1b2b5 P 76fb155ade354ee1ba78673e73b28aca: Bootstrap starting.
I20260709 13:13:36.278770 31702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3516a073925457498018b87cdbaa85f" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:36.279450 31702 raft_consensus.cc:2468] T e3516a073925457498018b87cdbaa85f P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 0.
I20260709 13:13:36.280789 31595 leader_election.cc:304] T e3516a073925457498018b87cdbaa85f P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca, c74453754ee34bea9b231ae318a55a31; no voters: 
I20260709 13:13:36.281677 31857 raft_consensus.cc:493] T ac45af43771c45fd8e57204c190c322b P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.282158 31857 raft_consensus.cc:515] T ac45af43771c45fd8e57204c190c322b P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:36.284319 31857 leader_election.cc:290] T ac45af43771c45fd8e57204c190c322b P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:36.285178 31759 raft_consensus.cc:2804] T e3516a073925457498018b87cdbaa85f P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:36.285782 31749 tablet_bootstrap.cc:654] T 85d4a24725c749199c1b35d959b1b2b5 P 76fb155ade354ee1ba78673e73b28aca: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:36.285720 31759 raft_consensus.cc:493] T e3516a073925457498018b87cdbaa85f P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:36.286373 31759 raft_consensus.cc:3060] T e3516a073925457498018b87cdbaa85f P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:36.289448 31555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac45af43771c45fd8e57204c190c322b" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:36.290341 31555 raft_consensus.cc:2468] T ac45af43771c45fd8e57204c190c322b P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 0.
I20260709 13:13:36.293182 31554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3516a073925457498018b87cdbaa85f" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:36.293677 31592 leader_election.cc:304] T ac45af43771c45fd8e57204c190c322b P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, c74453754ee34bea9b231ae318a55a31; no voters: 
W20260709 13:13:36.294984 31592 leader_election.cc:343] T e3516a073925457498018b87cdbaa85f P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:36.296262 31920 raft_consensus.cc:493] T 075b9562a2b547c8aad80c2bae413556 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.296939 31859 raft_consensus.cc:2804] T ac45af43771c45fd8e57204c190c322b P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:36.297367 31859 raft_consensus.cc:493] T ac45af43771c45fd8e57204c190c322b P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:36.297712 31859 raft_consensus.cc:3060] T ac45af43771c45fd8e57204c190c322b P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:36.298754 31874 consensus_queue.cc:1048] T 1e727ab6847b4fbab9a94b63842c6b9c P c74453754ee34bea9b231ae318a55a31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:36.277546 31747 tablet_bootstrap.cc:492] T 1e727ab6847b4fbab9a94b63842c6b9c P 196d972917fe4f85985e3862d40b7596: Bootstrap starting.
I20260709 13:13:36.296743 31920 raft_consensus.cc:515] T 075b9562a2b547c8aad80c2bae413556 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:36.301364 31759 raft_consensus.cc:515] T e3516a073925457498018b87cdbaa85f P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:36.302426 31920 leader_election.cc:290] T 075b9562a2b547c8aad80c2bae413556 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:36.303830 31475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b9562a2b547c8aad80c2bae413556" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:36.308259 31477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac45af43771c45fd8e57204c190c322b" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:36.309145 31477 raft_consensus.cc:2468] T ac45af43771c45fd8e57204c190c322b P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 0.
I20260709 13:13:36.311512 31554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b9562a2b547c8aad80c2bae413556" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
W20260709 13:13:36.311659 31668 leader_election.cc:343] T 075b9562a2b547c8aad80c2bae413556 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:36.312222 31554 raft_consensus.cc:2468] T 075b9562a2b547c8aad80c2bae413556 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 0.
I20260709 13:13:36.313658 31666 leader_election.cc:304] T 075b9562a2b547c8aad80c2bae413556 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, 76fb155ade354ee1ba78673e73b28aca; no voters: 458d610e8abf4f2ea831ab7bf3576da6
I20260709 13:13:36.318486 31759 leader_election.cc:290] T e3516a073925457498018b87cdbaa85f P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 election: Requested vote from peers 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431), 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715)
I20260709 13:13:36.322369 31920 raft_consensus.cc:2804] T 075b9562a2b547c8aad80c2bae413556 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:36.322825 31920 raft_consensus.cc:493] T 075b9562a2b547c8aad80c2bae413556 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:36.323205 31920 raft_consensus.cc:3060] T 075b9562a2b547c8aad80c2bae413556 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:36.330271 31750 consensus_queue.cc:260] T 216111c5962f4b82ae52414985988860 P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:36.335283 31749 tablet_bootstrap.cc:492] T 85d4a24725c749199c1b35d959b1b2b5 P 76fb155ade354ee1ba78673e73b28aca: No bootstrap required, opened a new log
I20260709 13:13:36.335985 31749 ts_tablet_manager.cc:1403] T 85d4a24725c749199c1b35d959b1b2b5 P 76fb155ade354ee1ba78673e73b28aca: Time spent bootstrapping tablet: real 0.057s	user 0.042s	sys 0.009s
I20260709 13:13:36.338668 31703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3516a073925457498018b87cdbaa85f" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca"
I20260709 13:13:36.339282 31703 raft_consensus.cc:3060] T e3516a073925457498018b87cdbaa85f P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:36.339300 31749 raft_consensus.cc:359] T 85d4a24725c749199c1b35d959b1b2b5 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:36.342110 31749 raft_consensus.cc:385] T 85d4a24725c749199c1b35d959b1b2b5 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:36.342362 31749 raft_consensus.cc:740] T 85d4a24725c749199c1b35d959b1b2b5 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Initialized, Role: FOLLOWER
I20260709 13:13:36.342417 31554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3516a073925457498018b87cdbaa85f" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596"
I20260709 13:13:36.343168 31749 consensus_queue.cc:260] T 85d4a24725c749199c1b35d959b1b2b5 P 76fb155ade354ee1ba78673e73b28aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
W20260709 13:13:36.344944 31592 leader_election.cc:343] T e3516a073925457498018b87cdbaa85f P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:36.346239 31749 ts_tablet_manager.cc:1434] T 85d4a24725c749199c1b35d959b1b2b5 P 76fb155ade354ee1ba78673e73b28aca: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:13:36.349125 31750 ts_tablet_manager.cc:1434] T 216111c5962f4b82ae52414985988860 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.076s	user 0.007s	sys 0.002s
I20260709 13:13:36.352080 31750 tablet_bootstrap.cc:492] T 5b669b8d34ee4de5b002d30fbcf02dd7 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:36.352643 31747 tablet_bootstrap.cc:654] T 1e727ab6847b4fbab9a94b63842c6b9c P 196d972917fe4f85985e3862d40b7596: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:36.353427 31859 raft_consensus.cc:515] T ac45af43771c45fd8e57204c190c322b P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:36.356904 31859 leader_election.cc:290] T ac45af43771c45fd8e57204c190c322b P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 election: Requested vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:36.357879 31475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac45af43771c45fd8e57204c190c322b" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
I20260709 13:13:36.358122 31554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac45af43771c45fd8e57204c190c322b" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596"
I20260709 13:13:36.358543 31475 raft_consensus.cc:3060] T ac45af43771c45fd8e57204c190c322b P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:36.358659 31554 raft_consensus.cc:3060] T ac45af43771c45fd8e57204c190c322b P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:36.350432 31920 raft_consensus.cc:515] T 075b9562a2b547c8aad80c2bae413556 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:36.366963 31771 consensus_queue.cc:1048] T de27ea68aab2485bb532389bb5c82433 P 196d972917fe4f85985e3862d40b7596 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:36.368112 31750 tablet_bootstrap.cc:654] T 5b669b8d34ee4de5b002d30fbcf02dd7 P 458d610e8abf4f2ea831ab7bf3576da6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:36.369020 31477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b9562a2b547c8aad80c2bae413556" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
W20260709 13:13:36.370484 31668 leader_election.cc:343] T 075b9562a2b547c8aad80c2bae413556 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:36.372331 31920 leader_election.cc:290] T 075b9562a2b547c8aad80c2bae413556 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 election: Requested vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:36.379312 31552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b9562a2b547c8aad80c2bae413556" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596"
I20260709 13:13:36.379288 31377 catalog_manager.cc:5697] T 98a7e38754ed4644bf90b39aff07c70f P 196d972917fe4f85985e3862d40b7596 reported cstate change: term changed from 0 to 1, leader changed from <none> to 196d972917fe4f85985e3862d40b7596 (127.23.140.66). New cstate: current_term: 1 leader_uuid: "196d972917fe4f85985e3862d40b7596" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:36.380290 31552 raft_consensus.cc:3060] T 075b9562a2b547c8aad80c2bae413556 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:36.382454 31554 raft_consensus.cc:2468] T ac45af43771c45fd8e57204c190c322b P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 1.
I20260709 13:13:36.383420 31703 raft_consensus.cc:2468] T e3516a073925457498018b87cdbaa85f P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 1.
I20260709 13:13:36.383776 31592 leader_election.cc:304] T ac45af43771c45fd8e57204c190c322b P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, c74453754ee34bea9b231ae318a55a31; no voters: 
I20260709 13:13:36.384822 31859 raft_consensus.cc:2804] T ac45af43771c45fd8e57204c190c322b P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:36.385419 31859 raft_consensus.cc:697] T ac45af43771c45fd8e57204c190c322b P c74453754ee34bea9b231ae318a55a31 [term 1 LEADER]: Becoming Leader. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Running, Role: LEADER
I20260709 13:13:36.386488 31859 consensus_queue.cc:237] T ac45af43771c45fd8e57204c190c322b P c74453754ee34bea9b231ae318a55a31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:36.391258 31595 leader_election.cc:304] T e3516a073925457498018b87cdbaa85f P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca, c74453754ee34bea9b231ae318a55a31; no voters: 196d972917fe4f85985e3862d40b7596
I20260709 13:13:36.392779 31759 raft_consensus.cc:2804] T e3516a073925457498018b87cdbaa85f P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:36.393368 31759 raft_consensus.cc:697] T e3516a073925457498018b87cdbaa85f P c74453754ee34bea9b231ae318a55a31 [term 1 LEADER]: Becoming Leader. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Running, Role: LEADER
I20260709 13:13:36.395774 31759 consensus_queue.cc:237] T e3516a073925457498018b87cdbaa85f P c74453754ee34bea9b231ae318a55a31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:36.403537 31749 tablet_bootstrap.cc:492] T 256a5c9a935246e0a6c36b5b654fbbfb P 76fb155ade354ee1ba78673e73b28aca: Bootstrap starting.
I20260709 13:13:36.412825 31771 consensus_queue.cc:1048] T 98a7e38754ed4644bf90b39aff07c70f P 196d972917fe4f85985e3862d40b7596 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
W20260709 13:13:36.417780 31668 consensus_peers.cc:597] T 5b669b8d34ee4de5b002d30fbcf02dd7 P 76fb155ade354ee1ba78673e73b28aca -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:36.446120 31748 tablet_bootstrap.cc:492] T 5ea74721b8824d00b63c524b25ff23df P c74453754ee34bea9b231ae318a55a31: No bootstrap required, opened a new log
I20260709 13:13:36.446852 31748 ts_tablet_manager.cc:1403] T 5ea74721b8824d00b63c524b25ff23df P c74453754ee34bea9b231ae318a55a31: Time spent bootstrapping tablet: real 0.207s	user 0.010s	sys 0.003s
W20260709 13:13:36.454079 31939 log.cc:927] Time spent T 1e727ab6847b4fbab9a94b63842c6b9c P 76fb155ade354ee1ba78673e73b28aca: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:13:36.437312 31817 consensus_queue.cc:1048] T b3705de0af7a48f69f751aab333fdf3d P c74453754ee34bea9b231ae318a55a31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:13:36.467356 31920 consensus_queue.cc:1048] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:13:36.470664 31592 consensus_peers.cc:597] T 1e727ab6847b4fbab9a94b63842c6b9c P c74453754ee34bea9b231ae318a55a31 -> Peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Couldn't send request to peer 196d972917fe4f85985e3862d40b7596. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:36.457826 31475 raft_consensus.cc:2468] T ac45af43771c45fd8e57204c190c322b P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 1.
I20260709 13:13:36.479154 31920 consensus_queue.cc:1048] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:36.480469 31748 raft_consensus.cc:359] T 5ea74721b8824d00b63c524b25ff23df P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:36.481204 31748 raft_consensus.cc:385] T 5ea74721b8824d00b63c524b25ff23df P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:36.481498 31748 raft_consensus.cc:740] T 5ea74721b8824d00b63c524b25ff23df P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Initialized, Role: FOLLOWER
I20260709 13:13:36.482563 31552 raft_consensus.cc:2468] T 075b9562a2b547c8aad80c2bae413556 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 1.
I20260709 13:13:36.482735 31771 consensus_queue.cc:1048] T de27ea68aab2485bb532389bb5c82433 P 196d972917fe4f85985e3862d40b7596 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:36.485535 31747 tablet_bootstrap.cc:492] T 1e727ab6847b4fbab9a94b63842c6b9c P 196d972917fe4f85985e3862d40b7596: No bootstrap required, opened a new log
I20260709 13:13:36.496920 31747 ts_tablet_manager.cc:1403] T 1e727ab6847b4fbab9a94b63842c6b9c P 196d972917fe4f85985e3862d40b7596: Time spent bootstrapping tablet: real 0.223s	user 0.009s	sys 0.026s
I20260709 13:13:36.491139 31748 consensus_queue.cc:260] T 5ea74721b8824d00b63c524b25ff23df P c74453754ee34bea9b231ae318a55a31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:36.505508 31748 ts_tablet_manager.cc:1434] T 5ea74721b8824d00b63c524b25ff23df P c74453754ee34bea9b231ae318a55a31: Time spent starting tablet: real 0.058s	user 0.003s	sys 0.003s
I20260709 13:13:36.506611 31748 tablet_bootstrap.cc:492] T f66580482b2d470bacbfec917042485b P c74453754ee34bea9b231ae318a55a31: Bootstrap starting.
I20260709 13:13:36.508975 31666 leader_election.cc:304] T 075b9562a2b547c8aad80c2bae413556 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, 76fb155ade354ee1ba78673e73b28aca; no voters: 458d610e8abf4f2ea831ab7bf3576da6
I20260709 13:13:36.509939 31747 raft_consensus.cc:359] T 1e727ab6847b4fbab9a94b63842c6b9c P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:36.510793 31747 raft_consensus.cc:385] T 1e727ab6847b4fbab9a94b63842c6b9c P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:36.511099 31747 raft_consensus.cc:740] T 1e727ab6847b4fbab9a94b63842c6b9c P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 196d972917fe4f85985e3862d40b7596, State: Initialized, Role: FOLLOWER
I20260709 13:13:36.513996 31920 raft_consensus.cc:2804] T 075b9562a2b547c8aad80c2bae413556 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:36.514871 31920 raft_consensus.cc:697] T 075b9562a2b547c8aad80c2bae413556 P 76fb155ade354ee1ba78673e73b28aca [term 1 LEADER]: Becoming Leader. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Running, Role: LEADER
I20260709 13:13:36.517421 31378 catalog_manager.cc:5697] T 5b669b8d34ee4de5b002d30fbcf02dd7 P 76fb155ade354ee1ba78673e73b28aca reported cstate change: term changed from 0 to 1, leader changed from <none> to 76fb155ade354ee1ba78673e73b28aca (127.23.140.68). New cstate: current_term: 1 leader_uuid: "76fb155ade354ee1ba78673e73b28aca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:36.520053 31747 consensus_queue.cc:260] T 1e727ab6847b4fbab9a94b63842c6b9c P 196d972917fe4f85985e3862d40b7596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:36.522318 31747 ts_tablet_manager.cc:1434] T 1e727ab6847b4fbab9a94b63842c6b9c P 196d972917fe4f85985e3862d40b7596: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 13:13:36.516495 31750 tablet_bootstrap.cc:492] T 5b669b8d34ee4de5b002d30fbcf02dd7 P 458d610e8abf4f2ea831ab7bf3576da6: No bootstrap required, opened a new log
I20260709 13:13:36.526235 31750 ts_tablet_manager.cc:1403] T 5b669b8d34ee4de5b002d30fbcf02dd7 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.174s	user 0.043s	sys 0.025s
I20260709 13:13:36.529698 31378 catalog_manager.cc:5697] T 216111c5962f4b82ae52414985988860 P 76fb155ade354ee1ba78673e73b28aca reported cstate change: term changed from 0 to 1, leader changed from <none> to 76fb155ade354ee1ba78673e73b28aca (127.23.140.68). New cstate: current_term: 1 leader_uuid: "76fb155ade354ee1ba78673e73b28aca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:36.538448 31749 tablet_bootstrap.cc:654] T 256a5c9a935246e0a6c36b5b654fbbfb P 76fb155ade354ee1ba78673e73b28aca: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:36.550478 31747 tablet_bootstrap.cc:492] T 5ea74721b8824d00b63c524b25ff23df P 196d972917fe4f85985e3862d40b7596: Bootstrap starting.
I20260709 13:13:36.550037 31817 consensus_queue.cc:1048] T b3705de0af7a48f69f751aab333fdf3d P c74453754ee34bea9b231ae318a55a31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:13:36.554399 31771 consensus_queue.cc:1048] T 98a7e38754ed4644bf90b39aff07c70f P 196d972917fe4f85985e3862d40b7596 [LEADER]: Connected to new peer: Peer: permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:13:36.569609 31747 tablet_bootstrap.cc:654] T 5ea74721b8824d00b63c524b25ff23df P 196d972917fe4f85985e3862d40b7596: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:36.573267 31842 raft_consensus.cc:493] T 216111c5962f4b82ae52414985988860 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.573823 31842 raft_consensus.cc:515] T 216111c5962f4b82ae52414985988860 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:36.575980 31842 leader_election.cc:290] T 216111c5962f4b82ae52414985988860 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:36.577533 31701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216111c5962f4b82ae52414985988860" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:36.544556 31920 consensus_queue.cc:237] T 075b9562a2b547c8aad80c2bae413556 P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:36.580473 31844 consensus_queue.cc:1048] T 5b669b8d34ee4de5b002d30fbcf02dd7 P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:36.583912 31759 raft_consensus.cc:493] T 5ea74721b8824d00b63c524b25ff23df P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.587870 31552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216111c5962f4b82ae52414985988860" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:36.588723 31552 raft_consensus.cc:2393] T 216111c5962f4b82ae52414985988860 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 458d610e8abf4f2ea831ab7bf3576da6 in current term 1: Already voted for candidate 76fb155ade354ee1ba78673e73b28aca in this term.
I20260709 13:13:36.584575 31759 raft_consensus.cc:515] T 5ea74721b8824d00b63c524b25ff23df P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:36.618444 31376 catalog_manager.cc:5697] T e3516a073925457498018b87cdbaa85f P c74453754ee34bea9b231ae318a55a31 reported cstate change: term changed from 0 to 1, leader changed from <none> to c74453754ee34bea9b231ae318a55a31 (127.23.140.67). New cstate: current_term: 1 leader_uuid: "c74453754ee34bea9b231ae318a55a31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:36.623850 31443 leader_election.cc:304] T 216111c5962f4b82ae52414985988860 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6; no voters: 196d972917fe4f85985e3862d40b7596, 76fb155ade354ee1ba78673e73b28aca
I20260709 13:13:36.625126 31842 raft_consensus.cc:3060] T 216111c5962f4b82ae52414985988860 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:36.628731 31747 tablet_bootstrap.cc:492] T 5ea74721b8824d00b63c524b25ff23df P 196d972917fe4f85985e3862d40b7596: No bootstrap required, opened a new log
I20260709 13:13:36.629317 31747 ts_tablet_manager.cc:1403] T 5ea74721b8824d00b63c524b25ff23df P 196d972917fe4f85985e3862d40b7596: Time spent bootstrapping tablet: real 0.084s	user 0.014s	sys 0.001s
I20260709 13:13:36.632192 31376 catalog_manager.cc:5697] T ac45af43771c45fd8e57204c190c322b P c74453754ee34bea9b231ae318a55a31 reported cstate change: term changed from 0 to 1, leader changed from <none> to c74453754ee34bea9b231ae318a55a31 (127.23.140.67). New cstate: current_term: 1 leader_uuid: "c74453754ee34bea9b231ae318a55a31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:36.635416 31750 raft_consensus.cc:359] T 5b669b8d34ee4de5b002d30fbcf02dd7 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:36.636072 31750 raft_consensus.cc:385] T 5b669b8d34ee4de5b002d30fbcf02dd7 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:36.636332 31750 raft_consensus.cc:740] T 5b669b8d34ee4de5b002d30fbcf02dd7 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:36.636953 31750 consensus_queue.cc:260] T 5b669b8d34ee4de5b002d30fbcf02dd7 P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:36.639326 31748 tablet_bootstrap.cc:654] T f66580482b2d470bacbfec917042485b P c74453754ee34bea9b231ae318a55a31: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:36.643392 31750 ts_tablet_manager.cc:1434] T 5b669b8d34ee4de5b002d30fbcf02dd7 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.117s	user 0.006s	sys 0.001s
I20260709 13:13:36.644447 31750 tablet_bootstrap.cc:492] T f66580482b2d470bacbfec917042485b P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:36.644529 31759 leader_election.cc:290] T 5ea74721b8824d00b63c524b25ff23df P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:36.646974 31480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea74721b8824d00b63c524b25ff23df" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
W20260709 13:13:36.649855 31594 leader_election.cc:343] T 5ea74721b8824d00b63c524b25ff23df P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:36.651546 31750 tablet_bootstrap.cc:654] T f66580482b2d470bacbfec917042485b P 458d610e8abf4f2ea831ab7bf3576da6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:36.651934 31842 raft_consensus.cc:2749] T 216111c5962f4b82ae52414985988860 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:36.653880 31747 raft_consensus.cc:359] T 5ea74721b8824d00b63c524b25ff23df P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:36.654758 31747 raft_consensus.cc:385] T 5ea74721b8824d00b63c524b25ff23df P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:36.655107 31747 raft_consensus.cc:740] T 5ea74721b8824d00b63c524b25ff23df P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 196d972917fe4f85985e3862d40b7596, State: Initialized, Role: FOLLOWER
I20260709 13:13:36.657655 31747 consensus_queue.cc:260] T 5ea74721b8824d00b63c524b25ff23df P 196d972917fe4f85985e3862d40b7596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:36.662036 31554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea74721b8824d00b63c524b25ff23df" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:36.662703 31554 raft_consensus.cc:2468] T 5ea74721b8824d00b63c524b25ff23df P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 0.
I20260709 13:13:36.665323 31749 tablet_bootstrap.cc:492] T 256a5c9a935246e0a6c36b5b654fbbfb P 76fb155ade354ee1ba78673e73b28aca: No bootstrap required, opened a new log
I20260709 13:13:36.665846 31749 ts_tablet_manager.cc:1403] T 256a5c9a935246e0a6c36b5b654fbbfb P 76fb155ade354ee1ba78673e73b28aca: Time spent bootstrapping tablet: real 0.263s	user 0.017s	sys 0.010s
I20260709 13:13:36.667193 31592 leader_election.cc:304] T 5ea74721b8824d00b63c524b25ff23df P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, c74453754ee34bea9b231ae318a55a31; no voters: 458d610e8abf4f2ea831ab7bf3576da6
I20260709 13:13:36.667603 31747 ts_tablet_manager.cc:1434] T 5ea74721b8824d00b63c524b25ff23df P 196d972917fe4f85985e3862d40b7596: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.004s
I20260709 13:13:36.668744 31759 raft_consensus.cc:2804] T 5ea74721b8824d00b63c524b25ff23df P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:36.668612 31749 raft_consensus.cc:359] T 256a5c9a935246e0a6c36b5b654fbbfb P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:36.669010 31747 tablet_bootstrap.cc:492] T e3516a073925457498018b87cdbaa85f P 196d972917fe4f85985e3862d40b7596: Bootstrap starting.
I20260709 13:13:36.669353 31749 raft_consensus.cc:385] T 256a5c9a935246e0a6c36b5b654fbbfb P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:36.669953 31749 raft_consensus.cc:740] T 256a5c9a935246e0a6c36b5b654fbbfb P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Initialized, Role: FOLLOWER
I20260709 13:13:36.670691 31749 consensus_queue.cc:260] T 256a5c9a935246e0a6c36b5b654fbbfb P 76fb155ade354ee1ba78673e73b28aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:36.669137 31759 raft_consensus.cc:493] T 5ea74721b8824d00b63c524b25ff23df P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:36.688908 31759 raft_consensus.cc:3060] T 5ea74721b8824d00b63c524b25ff23df P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:36.687346 31749 ts_tablet_manager.cc:1434] T 256a5c9a935246e0a6c36b5b654fbbfb P 76fb155ade354ee1ba78673e73b28aca: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.001s
I20260709 13:13:36.703087 31748 tablet_bootstrap.cc:492] T f66580482b2d470bacbfec917042485b P c74453754ee34bea9b231ae318a55a31: No bootstrap required, opened a new log
I20260709 13:13:36.703858 31748 ts_tablet_manager.cc:1403] T f66580482b2d470bacbfec917042485b P c74453754ee34bea9b231ae318a55a31: Time spent bootstrapping tablet: real 0.198s	user 0.013s	sys 0.024s
I20260709 13:13:36.707439 31377 catalog_manager.cc:5697] T 075b9562a2b547c8aad80c2bae413556 P 76fb155ade354ee1ba78673e73b28aca reported cstate change: term changed from 0 to 1, leader changed from <none> to 76fb155ade354ee1ba78673e73b28aca (127.23.140.68). New cstate: current_term: 1 leader_uuid: "76fb155ade354ee1ba78673e73b28aca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:36.723536 31749 tablet_bootstrap.cc:492] T 36bf73ed3df141c889c046ad6902e304 P 76fb155ade354ee1ba78673e73b28aca: Bootstrap starting.
I20260709 13:13:36.728582 31747 tablet_bootstrap.cc:654] T e3516a073925457498018b87cdbaa85f P 196d972917fe4f85985e3862d40b7596: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:36.723383 31748 raft_consensus.cc:359] T f66580482b2d470bacbfec917042485b P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:36.736688 31748 raft_consensus.cc:385] T f66580482b2d470bacbfec917042485b P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:36.737079 31748 raft_consensus.cc:740] T f66580482b2d470bacbfec917042485b P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Initialized, Role: FOLLOWER
I20260709 13:13:36.739106 31759 raft_consensus.cc:515] T 5ea74721b8824d00b63c524b25ff23df P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:36.749305 31554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea74721b8824d00b63c524b25ff23df" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596"
I20260709 13:13:36.749701 31478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea74721b8824d00b63c524b25ff23df" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
I20260709 13:13:36.750675 31554 raft_consensus.cc:3060] T 5ea74721b8824d00b63c524b25ff23df P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:36.759527 31750 tablet_bootstrap.cc:492] T f66580482b2d470bacbfec917042485b P 458d610e8abf4f2ea831ab7bf3576da6: No bootstrap required, opened a new log
I20260709 13:13:36.759317 31748 consensus_queue.cc:260] T f66580482b2d470bacbfec917042485b P c74453754ee34bea9b231ae318a55a31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:36.760243 31750 ts_tablet_manager.cc:1403] T f66580482b2d470bacbfec917042485b P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.116s	user 0.027s	sys 0.043s
I20260709 13:13:36.751752 31759 leader_election.cc:290] T 5ea74721b8824d00b63c524b25ff23df P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 election: Requested vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:36.765641 31750 raft_consensus.cc:359] T f66580482b2d470bacbfec917042485b P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:36.767577 31750 raft_consensus.cc:385] T f66580482b2d470bacbfec917042485b P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:36.767930 31750 raft_consensus.cc:740] T f66580482b2d470bacbfec917042485b P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:36.766698 31874 raft_consensus.cc:493] T f66580482b2d470bacbfec917042485b P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:36.768695 31594 leader_election.cc:343] T 5ea74721b8824d00b63c524b25ff23df P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:36.769207 31749 tablet_bootstrap.cc:654] T 36bf73ed3df141c889c046ad6902e304 P 76fb155ade354ee1ba78673e73b28aca: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:36.769117 31874 raft_consensus.cc:515] T f66580482b2d470bacbfec917042485b P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:36.770177 31750 consensus_queue.cc:260] T f66580482b2d470bacbfec917042485b P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:36.769585 31748 ts_tablet_manager.cc:1434] T f66580482b2d470bacbfec917042485b P c74453754ee34bea9b231ae318a55a31: Time spent starting tablet: real 0.065s	user 0.009s	sys 0.001s
I20260709 13:13:36.771492 31874 leader_election.cc:290] T f66580482b2d470bacbfec917042485b P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:36.774520 31702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66580482b2d470bacbfec917042485b" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:36.776844 31702 raft_consensus.cc:2468] T f66580482b2d470bacbfec917042485b P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 0.
I20260709 13:13:36.784554 31920 raft_consensus.cc:493] T 85d4a24725c749199c1b35d959b1b2b5 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.785146 31920 raft_consensus.cc:515] T 85d4a24725c749199c1b35d959b1b2b5 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:36.786322 31595 leader_election.cc:304] T f66580482b2d470bacbfec917042485b P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca, c74453754ee34bea9b231ae318a55a31; no voters: 
I20260709 13:13:36.786854 31478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66580482b2d470bacbfec917042485b" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:36.787499 31478 raft_consensus.cc:2468] T f66580482b2d470bacbfec917042485b P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 0.
I20260709 13:13:36.788889 31748 tablet_bootstrap.cc:492] T fc35ae8230cf4ab792d0e15bcaf8b653 P c74453754ee34bea9b231ae318a55a31: Bootstrap starting.
W20260709 13:13:36.789027 31426 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:36.790220 31789 raft_consensus.cc:493] T 256a5c9a935246e0a6c36b5b654fbbfb P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.791034 31920 leader_election.cc:290] T 85d4a24725c749199c1b35d959b1b2b5 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:36.792634 31789 raft_consensus.cc:515] T 256a5c9a935246e0a6c36b5b654fbbfb P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:36.794778 31789 leader_election.cc:290] T 256a5c9a935246e0a6c36b5b654fbbfb P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:36.796240 31552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a5c9a935246e0a6c36b5b654fbbfb" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
W20260709 13:13:36.797721 31666 leader_election.cc:343] T 256a5c9a935246e0a6c36b5b654fbbfb P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:36.797664 31478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85d4a24725c749199c1b35d959b1b2b5" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:36.798885 31627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a5c9a935246e0a6c36b5b654fbbfb" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
W20260709 13:13:36.799634 31668 leader_election.cc:343] T 85d4a24725c749199c1b35d959b1b2b5 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:36.800361 31669 leader_election.cc:343] T 256a5c9a935246e0a6c36b5b654fbbfb P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:36.800837 31669 leader_election.cc:304] T 256a5c9a935246e0a6c36b5b654fbbfb P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca; no voters: 196d972917fe4f85985e3862d40b7596, c74453754ee34bea9b231ae318a55a31
I20260709 13:13:36.798456 31554 raft_consensus.cc:2468] T 5ea74721b8824d00b63c524b25ff23df P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 1.
I20260709 13:13:36.801728 31747 tablet_bootstrap.cc:492] T e3516a073925457498018b87cdbaa85f P 196d972917fe4f85985e3862d40b7596: No bootstrap required, opened a new log
I20260709 13:13:36.802245 31747 ts_tablet_manager.cc:1403] T e3516a073925457498018b87cdbaa85f P 196d972917fe4f85985e3862d40b7596: Time spent bootstrapping tablet: real 0.134s	user 0.020s	sys 0.011s
I20260709 13:13:36.801146 31750 ts_tablet_manager.cc:1434] T f66580482b2d470bacbfec917042485b P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.002s
I20260709 13:13:36.803347 31628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85d4a24725c749199c1b35d959b1b2b5" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:36.802476 31592 leader_election.cc:304] T 5ea74721b8824d00b63c524b25ff23df P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, c74453754ee34bea9b231ae318a55a31; no voters: 458d610e8abf4f2ea831ab7bf3576da6
I20260709 13:13:36.804593 31750 tablet_bootstrap.cc:492] T 075b9562a2b547c8aad80c2bae413556 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:36.805186 31817 raft_consensus.cc:2804] T f66580482b2d470bacbfec917042485b P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:36.814040 31817 raft_consensus.cc:493] T f66580482b2d470bacbfec917042485b P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:36.814471 31817 raft_consensus.cc:3060] T f66580482b2d470bacbfec917042485b P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:36.805136 31747 raft_consensus.cc:359] T e3516a073925457498018b87cdbaa85f P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:36.805739 31789 raft_consensus.cc:2749] T 256a5c9a935246e0a6c36b5b654fbbfb P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:36.808988 31748 tablet_bootstrap.cc:654] T fc35ae8230cf4ab792d0e15bcaf8b653 P c74453754ee34bea9b231ae318a55a31: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:36.810042 31669 leader_election.cc:343] T 85d4a24725c749199c1b35d959b1b2b5 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:36.818395 31669 leader_election.cc:304] T 85d4a24725c749199c1b35d959b1b2b5 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca; no voters: 458d610e8abf4f2ea831ab7bf3576da6, c74453754ee34bea9b231ae318a55a31
I20260709 13:13:36.819329 31747 raft_consensus.cc:385] T e3516a073925457498018b87cdbaa85f P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:36.819625 31747 raft_consensus.cc:740] T e3516a073925457498018b87cdbaa85f P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 196d972917fe4f85985e3862d40b7596, State: Initialized, Role: FOLLOWER
I20260709 13:13:36.819957 31750 tablet_bootstrap.cc:654] T 075b9562a2b547c8aad80c2bae413556 P 458d610e8abf4f2ea831ab7bf3576da6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:36.820050 31920 raft_consensus.cc:2749] T 85d4a24725c749199c1b35d959b1b2b5 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:36.820091 31881 consensus_queue.cc:1048] T 216111c5962f4b82ae52414985988860 P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:36.820319 31747 consensus_queue.cc:260] T e3516a073925457498018b87cdbaa85f P 196d972917fe4f85985e3862d40b7596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:36.811024 31874 raft_consensus.cc:2804] T 5ea74721b8824d00b63c524b25ff23df P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:36.823704 31874 raft_consensus.cc:697] T 5ea74721b8824d00b63c524b25ff23df P c74453754ee34bea9b231ae318a55a31 [term 1 LEADER]: Becoming Leader. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Running, Role: LEADER
I20260709 13:13:36.824971 31747 ts_tablet_manager.cc:1434] T e3516a073925457498018b87cdbaa85f P 196d972917fe4f85985e3862d40b7596: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:13:36.826368 31747 tablet_bootstrap.cc:492] T fc35ae8230cf4ab792d0e15bcaf8b653 P 196d972917fe4f85985e3862d40b7596: Bootstrap starting.
I20260709 13:13:36.827746 31817 raft_consensus.cc:515] T f66580482b2d470bacbfec917042485b P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:36.830945 31702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66580482b2d470bacbfec917042485b" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca"
I20260709 13:13:36.831532 31702 raft_consensus.cc:3060] T f66580482b2d470bacbfec917042485b P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:36.834892 31859 consensus_queue.cc:1048] T ac45af43771c45fd8e57204c190c322b P c74453754ee34bea9b231ae318a55a31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:36.842706 31881 consensus_queue.cc:1048] T 216111c5962f4b82ae52414985988860 P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:36.842938 31874 consensus_queue.cc:237] T 5ea74721b8824d00b63c524b25ff23df P c74453754ee34bea9b231ae318a55a31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:36.859761 31702 raft_consensus.cc:2468] T f66580482b2d470bacbfec917042485b P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 1.
I20260709 13:13:36.861033 31595 leader_election.cc:304] T f66580482b2d470bacbfec917042485b P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca, c74453754ee34bea9b231ae318a55a31; no voters: 
I20260709 13:13:36.861884 31759 raft_consensus.cc:2804] T f66580482b2d470bacbfec917042485b P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:36.862725 31759 raft_consensus.cc:697] T f66580482b2d470bacbfec917042485b P c74453754ee34bea9b231ae318a55a31 [term 1 LEADER]: Becoming Leader. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Running, Role: LEADER
I20260709 13:13:36.877506 31817 leader_election.cc:290] T f66580482b2d470bacbfec917042485b P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 election: Requested vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:36.877841 31750 tablet_bootstrap.cc:492] T 075b9562a2b547c8aad80c2bae413556 P 458d610e8abf4f2ea831ab7bf3576da6: No bootstrap required, opened a new log
I20260709 13:13:36.878376 31750 ts_tablet_manager.cc:1403] T 075b9562a2b547c8aad80c2bae413556 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.074s	user 0.011s	sys 0.001s
I20260709 13:13:36.879663 31480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66580482b2d470bacbfec917042485b" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
I20260709 13:13:36.880362 31480 raft_consensus.cc:3060] T f66580482b2d470bacbfec917042485b P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:36.881060 31750 raft_consensus.cc:359] T 075b9562a2b547c8aad80c2bae413556 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:36.888523 31750 raft_consensus.cc:385] T 075b9562a2b547c8aad80c2bae413556 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:36.888859 31750 raft_consensus.cc:740] T 075b9562a2b547c8aad80c2bae413556 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:36.889587 31750 consensus_queue.cc:260] T 075b9562a2b547c8aad80c2bae413556 P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:36.863601 31759 consensus_queue.cc:237] T f66580482b2d470bacbfec917042485b P c74453754ee34bea9b231ae318a55a31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:36.891415 31747 tablet_bootstrap.cc:654] T fc35ae8230cf4ab792d0e15bcaf8b653 P 196d972917fe4f85985e3862d40b7596: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:36.892099 31750 ts_tablet_manager.cc:1434] T 075b9562a2b547c8aad80c2bae413556 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:13:36.893206 31750 tablet_bootstrap.cc:492] T 5ea74721b8824d00b63c524b25ff23df P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:36.889230 31377 catalog_manager.cc:5697] T 5ea74721b8824d00b63c524b25ff23df P c74453754ee34bea9b231ae318a55a31 reported cstate change: term changed from 0 to 1, leader changed from <none> to c74453754ee34bea9b231ae318a55a31 (127.23.140.67). New cstate: current_term: 1 leader_uuid: "c74453754ee34bea9b231ae318a55a31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:36.893724 31480 raft_consensus.cc:2468] T f66580482b2d470bacbfec917042485b P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 1.
I20260709 13:13:36.883165 31749 tablet_bootstrap.cc:492] T 36bf73ed3df141c889c046ad6902e304 P 76fb155ade354ee1ba78673e73b28aca: No bootstrap required, opened a new log
I20260709 13:13:36.898398 31749 ts_tablet_manager.cc:1403] T 36bf73ed3df141c889c046ad6902e304 P 76fb155ade354ee1ba78673e73b28aca: Time spent bootstrapping tablet: real 0.186s	user 0.022s	sys 0.020s
I20260709 13:13:36.907238 31748 tablet_bootstrap.cc:492] T fc35ae8230cf4ab792d0e15bcaf8b653 P c74453754ee34bea9b231ae318a55a31: No bootstrap required, opened a new log
I20260709 13:13:36.907774 31748 ts_tablet_manager.cc:1403] T fc35ae8230cf4ab792d0e15bcaf8b653 P c74453754ee34bea9b231ae318a55a31: Time spent bootstrapping tablet: real 0.127s	user 0.005s	sys 0.016s
I20260709 13:13:36.911099 31749 raft_consensus.cc:359] T 36bf73ed3df141c889c046ad6902e304 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:36.912087 31749 raft_consensus.cc:385] T 36bf73ed3df141c889c046ad6902e304 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:36.912439 31749 raft_consensus.cc:740] T 36bf73ed3df141c889c046ad6902e304 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Initialized, Role: FOLLOWER
I20260709 13:13:36.914414 31750 tablet_bootstrap.cc:654] T 5ea74721b8824d00b63c524b25ff23df P 458d610e8abf4f2ea831ab7bf3576da6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:36.914456 31749 consensus_queue.cc:260] T 36bf73ed3df141c889c046ad6902e304 P 76fb155ade354ee1ba78673e73b28aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:36.917738 31748 raft_consensus.cc:359] T fc35ae8230cf4ab792d0e15bcaf8b653 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:36.922254 31748 raft_consensus.cc:385] T fc35ae8230cf4ab792d0e15bcaf8b653 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:36.922555 31748 raft_consensus.cc:740] T fc35ae8230cf4ab792d0e15bcaf8b653 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Initialized, Role: FOLLOWER
I20260709 13:13:36.923293 31748 consensus_queue.cc:260] T fc35ae8230cf4ab792d0e15bcaf8b653 P c74453754ee34bea9b231ae318a55a31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:36.926148 31748 ts_tablet_manager.cc:1434] T fc35ae8230cf4ab792d0e15bcaf8b653 P c74453754ee34bea9b231ae318a55a31: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 13:13:36.927215 31748 tablet_bootstrap.cc:492] T 8c4f880f34664227ac8bd46378c9995f P c74453754ee34bea9b231ae318a55a31: Bootstrap starting.
I20260709 13:13:36.930727 31804 raft_consensus.cc:493] T 1e727ab6847b4fbab9a94b63842c6b9c P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.931263 31804 raft_consensus.cc:515] T 1e727ab6847b4fbab9a94b63842c6b9c P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:36.933277 31804 leader_election.cc:290] T 1e727ab6847b4fbab9a94b63842c6b9c P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715)
I20260709 13:13:36.935851 31749 ts_tablet_manager.cc:1434] T 36bf73ed3df141c889c046ad6902e304 P 76fb155ade354ee1ba78673e73b28aca: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.002s
I20260709 13:13:36.940300 31702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e727ab6847b4fbab9a94b63842c6b9c" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:36.944861 31749 tablet_bootstrap.cc:492] T 8c4f880f34664227ac8bd46378c9995f P 76fb155ade354ee1ba78673e73b28aca: Bootstrap starting.
I20260709 13:13:36.947719 31628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e727ab6847b4fbab9a94b63842c6b9c" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:36.949672 31521 leader_election.cc:304] T 1e727ab6847b4fbab9a94b63842c6b9c P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 196d972917fe4f85985e3862d40b7596; no voters: 76fb155ade354ee1ba78673e73b28aca, c74453754ee34bea9b231ae318a55a31
I20260709 13:13:36.951272 31902 raft_consensus.cc:2749] T 1e727ab6847b4fbab9a94b63842c6b9c P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:36.952051 31874 consensus_queue.cc:1048] T ac45af43771c45fd8e57204c190c322b P c74453754ee34bea9b231ae318a55a31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:36.960737 31747 tablet_bootstrap.cc:492] T fc35ae8230cf4ab792d0e15bcaf8b653 P 196d972917fe4f85985e3862d40b7596: No bootstrap required, opened a new log
I20260709 13:13:36.961270 31747 ts_tablet_manager.cc:1403] T fc35ae8230cf4ab792d0e15bcaf8b653 P 196d972917fe4f85985e3862d40b7596: Time spent bootstrapping tablet: real 0.135s	user 0.017s	sys 0.026s
I20260709 13:13:36.962728 31553 raft_consensus.cc:3060] T 1e727ab6847b4fbab9a94b63842c6b9c P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:36.964716 31748 tablet_bootstrap.cc:654] T 8c4f880f34664227ac8bd46378c9995f P c74453754ee34bea9b231ae318a55a31: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:36.972194 31749 tablet_bootstrap.cc:654] T 8c4f880f34664227ac8bd46378c9995f P 76fb155ade354ee1ba78673e73b28aca: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:36.984969 31747 raft_consensus.cc:359] T fc35ae8230cf4ab792d0e15bcaf8b653 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:36.986016 31747 raft_consensus.cc:385] T fc35ae8230cf4ab792d0e15bcaf8b653 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:36.986374 31747 raft_consensus.cc:740] T fc35ae8230cf4ab792d0e15bcaf8b653 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 196d972917fe4f85985e3862d40b7596, State: Initialized, Role: FOLLOWER
I20260709 13:13:36.987392 31749 tablet_bootstrap.cc:492] T 8c4f880f34664227ac8bd46378c9995f P 76fb155ade354ee1ba78673e73b28aca: No bootstrap required, opened a new log
I20260709 13:13:36.987243 31747 consensus_queue.cc:260] T fc35ae8230cf4ab792d0e15bcaf8b653 P 196d972917fe4f85985e3862d40b7596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:36.987908 31749 ts_tablet_manager.cc:1403] T 8c4f880f34664227ac8bd46378c9995f P 76fb155ade354ee1ba78673e73b28aca: Time spent bootstrapping tablet: real 0.043s	user 0.012s	sys 0.000s
I20260709 13:13:36.991228 31749 raft_consensus.cc:359] T 8c4f880f34664227ac8bd46378c9995f P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:36.991816 31749 raft_consensus.cc:385] T 8c4f880f34664227ac8bd46378c9995f P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:36.992044 31749 raft_consensus.cc:740] T 8c4f880f34664227ac8bd46378c9995f P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Initialized, Role: FOLLOWER
I20260709 13:13:36.974785 31378 catalog_manager.cc:5697] T f66580482b2d470bacbfec917042485b P c74453754ee34bea9b231ae318a55a31 reported cstate change: term changed from 0 to 1, leader changed from <none> to c74453754ee34bea9b231ae318a55a31 (127.23.140.67). New cstate: current_term: 1 leader_uuid: "c74453754ee34bea9b231ae318a55a31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:36.994630 31750 tablet_bootstrap.cc:492] T 5ea74721b8824d00b63c524b25ff23df P 458d610e8abf4f2ea831ab7bf3576da6: No bootstrap required, opened a new log
I20260709 13:13:36.995101 31750 ts_tablet_manager.cc:1403] T 5ea74721b8824d00b63c524b25ff23df P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.102s	user 0.021s	sys 0.000s
I20260709 13:13:36.996558 31747 ts_tablet_manager.cc:1434] T fc35ae8230cf4ab792d0e15bcaf8b653 P 196d972917fe4f85985e3862d40b7596: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 13:13:36.997464 31747 tablet_bootstrap.cc:492] T 256a5c9a935246e0a6c36b5b654fbbfb P 196d972917fe4f85985e3862d40b7596: Bootstrap starting.
I20260709 13:13:36.997706 31750 raft_consensus.cc:359] T 5ea74721b8824d00b63c524b25ff23df P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:36.998394 31750 raft_consensus.cc:385] T 5ea74721b8824d00b63c524b25ff23df P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:36.998639 31750 raft_consensus.cc:740] T 5ea74721b8824d00b63c524b25ff23df P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:36.999289 31750 consensus_queue.cc:260] T 5ea74721b8824d00b63c524b25ff23df P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:37.002020 31749 consensus_queue.cc:260] T 8c4f880f34664227ac8bd46378c9995f P 76fb155ade354ee1ba78673e73b28aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:37.004376 31749 ts_tablet_manager.cc:1434] T 8c4f880f34664227ac8bd46378c9995f P 76fb155ade354ee1ba78673e73b28aca: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.000s
I20260709 13:13:37.005393 31749 tablet_bootstrap.cc:492] T a35171dce2e34beeafe34f3e80f18a41 P 76fb155ade354ee1ba78673e73b28aca: Bootstrap starting.
I20260709 13:13:37.010315 31874 consensus_queue.cc:1048] T e3516a073925457498018b87cdbaa85f P c74453754ee34bea9b231ae318a55a31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:37.010811 31477 raft_consensus.cc:3060] T 5b669b8d34ee4de5b002d30fbcf02dd7 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.019404 31552 raft_consensus.cc:3060] T e3516a073925457498018b87cdbaa85f P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.020470 31747 tablet_bootstrap.cc:654] T 256a5c9a935246e0a6c36b5b654fbbfb P 196d972917fe4f85985e3862d40b7596: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.027503 31749 tablet_bootstrap.cc:654] T a35171dce2e34beeafe34f3e80f18a41 P 76fb155ade354ee1ba78673e73b28aca: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.045334 31874 consensus_queue.cc:1048] T e3516a073925457498018b87cdbaa85f P c74453754ee34bea9b231ae318a55a31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:37.080286 31747 tablet_bootstrap.cc:492] T 256a5c9a935246e0a6c36b5b654fbbfb P 196d972917fe4f85985e3862d40b7596: No bootstrap required, opened a new log
I20260709 13:13:37.080945 31747 ts_tablet_manager.cc:1403] T 256a5c9a935246e0a6c36b5b654fbbfb P 196d972917fe4f85985e3862d40b7596: Time spent bootstrapping tablet: real 0.084s	user 0.019s	sys 0.000s
I20260709 13:13:37.084518 31747 raft_consensus.cc:359] T 256a5c9a935246e0a6c36b5b654fbbfb P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:37.085441 31747 raft_consensus.cc:385] T 256a5c9a935246e0a6c36b5b654fbbfb P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.086699 31747 raft_consensus.cc:740] T 256a5c9a935246e0a6c36b5b654fbbfb P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 196d972917fe4f85985e3862d40b7596, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.087595 31747 consensus_queue.cc:260] T 256a5c9a935246e0a6c36b5b654fbbfb P 196d972917fe4f85985e3862d40b7596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:37.092804 31747 ts_tablet_manager.cc:1434] T 256a5c9a935246e0a6c36b5b654fbbfb P 196d972917fe4f85985e3862d40b7596: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:13:37.093125 31748 tablet_bootstrap.cc:492] T 8c4f880f34664227ac8bd46378c9995f P c74453754ee34bea9b231ae318a55a31: No bootstrap required, opened a new log
I20260709 13:13:37.093906 31748 ts_tablet_manager.cc:1403] T 8c4f880f34664227ac8bd46378c9995f P c74453754ee34bea9b231ae318a55a31: Time spent bootstrapping tablet: real 0.167s	user 0.040s	sys 0.056s
I20260709 13:13:37.093863 31842 raft_consensus.cc:493] T 075b9562a2b547c8aad80c2bae413556 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.094810 31842 raft_consensus.cc:515] T 075b9562a2b547c8aad80c2bae413556 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:37.098495 31748 raft_consensus.cc:359] T 8c4f880f34664227ac8bd46378c9995f P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:37.099239 31748 raft_consensus.cc:385] T 8c4f880f34664227ac8bd46378c9995f P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.099516 31748 raft_consensus.cc:740] T 8c4f880f34664227ac8bd46378c9995f P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.099596 31842 leader_election.cc:290] T 075b9562a2b547c8aad80c2bae413556 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:37.099718 31552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b9562a2b547c8aad80c2bae413556" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:37.100715 31552 raft_consensus.cc:2393] T 075b9562a2b547c8aad80c2bae413556 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 458d610e8abf4f2ea831ab7bf3576da6 in current term 1: Already voted for candidate 76fb155ade354ee1ba78673e73b28aca in this term.
I20260709 13:13:37.101581 31702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b9562a2b547c8aad80c2bae413556" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:37.102348 31477 raft_consensus.cc:3060] T 075b9562a2b547c8aad80c2bae413556 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.104103 31443 leader_election.cc:304] T 075b9562a2b547c8aad80c2bae413556 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6; no voters: 196d972917fe4f85985e3862d40b7596, 76fb155ade354ee1ba78673e73b28aca
I20260709 13:13:37.045817 31750 ts_tablet_manager.cc:1434] T 5ea74721b8824d00b63c524b25ff23df P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.000s
I20260709 13:13:37.106724 31750 tablet_bootstrap.cc:492] T fc35ae8230cf4ab792d0e15bcaf8b653 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:37.106828 31804 raft_consensus.cc:493] T fc35ae8230cf4ab792d0e15bcaf8b653 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.093806 31747 tablet_bootstrap.cc:492] T 8c4f880f34664227ac8bd46378c9995f P 196d972917fe4f85985e3862d40b7596: Bootstrap starting.
I20260709 13:13:37.107483 31804 raft_consensus.cc:515] T fc35ae8230cf4ab792d0e15bcaf8b653 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:37.111886 31480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc35ae8230cf4ab792d0e15bcaf8b653" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:37.113138 31628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc35ae8230cf4ab792d0e15bcaf8b653" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
W20260709 13:13:37.113521 31520 leader_election.cc:343] T fc35ae8230cf4ab792d0e15bcaf8b653 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:37.113911 31628 raft_consensus.cc:2468] T fc35ae8230cf4ab792d0e15bcaf8b653 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 196d972917fe4f85985e3862d40b7596 in term 0.
I20260709 13:13:37.109570 31804 leader_election.cc:290] T fc35ae8230cf4ab792d0e15bcaf8b653 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:37.115787 31842 raft_consensus.cc:2749] T 075b9562a2b547c8aad80c2bae413556 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:37.111925 31881 consensus_queue.cc:1048] T 075b9562a2b547c8aad80c2bae413556 P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:13:37.100455 31748 consensus_queue.cc:260] T 8c4f880f34664227ac8bd46378c9995f P c74453754ee34bea9b231ae318a55a31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:37.119289 31748 ts_tablet_manager.cc:1434] T 8c4f880f34664227ac8bd46378c9995f P c74453754ee34bea9b231ae318a55a31: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:13:37.120289 31748 tablet_bootstrap.cc:492] T 256a5c9a935246e0a6c36b5b654fbbfb P c74453754ee34bea9b231ae318a55a31: Bootstrap starting.
I20260709 13:13:37.120581 31521 leader_election.cc:304] T fc35ae8230cf4ab792d0e15bcaf8b653 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, c74453754ee34bea9b231ae318a55a31; no voters: 458d610e8abf4f2ea831ab7bf3576da6
I20260709 13:13:37.121423 31804 raft_consensus.cc:2804] T fc35ae8230cf4ab792d0e15bcaf8b653 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:37.121825 31804 raft_consensus.cc:493] T fc35ae8230cf4ab792d0e15bcaf8b653 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:37.122247 31804 raft_consensus.cc:3060] T fc35ae8230cf4ab792d0e15bcaf8b653 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.125491 31747 tablet_bootstrap.cc:654] T 8c4f880f34664227ac8bd46378c9995f P 196d972917fe4f85985e3862d40b7596: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.140323 31750 tablet_bootstrap.cc:654] T fc35ae8230cf4ab792d0e15bcaf8b653 P 458d610e8abf4f2ea831ab7bf3576da6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.142652 31749 tablet_bootstrap.cc:492] T a35171dce2e34beeafe34f3e80f18a41 P 76fb155ade354ee1ba78673e73b28aca: No bootstrap required, opened a new log
I20260709 13:13:37.143679 31749 ts_tablet_manager.cc:1403] T a35171dce2e34beeafe34f3e80f18a41 P 76fb155ade354ee1ba78673e73b28aca: Time spent bootstrapping tablet: real 0.139s	user 0.025s	sys 0.013s
I20260709 13:13:37.146521 31749 raft_consensus.cc:359] T a35171dce2e34beeafe34f3e80f18a41 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:37.153256 31804 raft_consensus.cc:515] T fc35ae8230cf4ab792d0e15bcaf8b653 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:37.157375 31748 tablet_bootstrap.cc:654] T 256a5c9a935246e0a6c36b5b654fbbfb P c74453754ee34bea9b231ae318a55a31: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.163712 31804 leader_election.cc:290] T fc35ae8230cf4ab792d0e15bcaf8b653 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 election: Requested vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:37.163655 31480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc35ae8230cf4ab792d0e15bcaf8b653" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
I20260709 13:13:37.171983 31748 tablet_bootstrap.cc:492] T 256a5c9a935246e0a6c36b5b654fbbfb P c74453754ee34bea9b231ae318a55a31: No bootstrap required, opened a new log
I20260709 13:13:37.172498 31748 ts_tablet_manager.cc:1403] T 256a5c9a935246e0a6c36b5b654fbbfb P c74453754ee34bea9b231ae318a55a31: Time spent bootstrapping tablet: real 0.052s	user 0.006s	sys 0.004s
I20260709 13:13:37.173998 31628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc35ae8230cf4ab792d0e15bcaf8b653" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31"
I20260709 13:13:37.174634 31628 raft_consensus.cc:3060] T fc35ae8230cf4ab792d0e15bcaf8b653 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:37.175630 31520 leader_election.cc:343] T fc35ae8230cf4ab792d0e15bcaf8b653 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:37.175287 31748 raft_consensus.cc:359] T 256a5c9a935246e0a6c36b5b654fbbfb P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:37.176621 31748 raft_consensus.cc:385] T 256a5c9a935246e0a6c36b5b654fbbfb P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.176899 31748 raft_consensus.cc:740] T 256a5c9a935246e0a6c36b5b654fbbfb P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.185295 31813 consensus_queue.cc:1048] T 075b9562a2b547c8aad80c2bae413556 P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:37.147156 31749 raft_consensus.cc:385] T a35171dce2e34beeafe34f3e80f18a41 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.186931 31749 raft_consensus.cc:740] T a35171dce2e34beeafe34f3e80f18a41 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.187932 31749 consensus_queue.cc:260] T a35171dce2e34beeafe34f3e80f18a41 P 76fb155ade354ee1ba78673e73b28aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:37.188452 31748 consensus_queue.cc:260] T 256a5c9a935246e0a6c36b5b654fbbfb P c74453754ee34bea9b231ae318a55a31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:37.192229 31748 ts_tablet_manager.cc:1434] T 256a5c9a935246e0a6c36b5b654fbbfb P c74453754ee34bea9b231ae318a55a31: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.002s
I20260709 13:13:37.198490 31748 tablet_bootstrap.cc:492] T 680d6e1f38f4469ebe14094aa66fdfac P c74453754ee34bea9b231ae318a55a31: Bootstrap starting.
I20260709 13:13:37.199064 31749 ts_tablet_manager.cc:1434] T a35171dce2e34beeafe34f3e80f18a41 P 76fb155ade354ee1ba78673e73b28aca: Time spent starting tablet: real 0.055s	user 0.007s	sys 0.000s
I20260709 13:13:37.200171 31749 tablet_bootstrap.cc:492] T ee6c632286174388ab5e7bfb2ae40078 P 76fb155ade354ee1ba78673e73b28aca: Bootstrap starting.
I20260709 13:13:37.200519 31628 raft_consensus.cc:2468] T fc35ae8230cf4ab792d0e15bcaf8b653 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 196d972917fe4f85985e3862d40b7596 in term 1.
I20260709 13:13:37.202024 31521 leader_election.cc:304] T fc35ae8230cf4ab792d0e15bcaf8b653 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, c74453754ee34bea9b231ae318a55a31; no voters: 458d610e8abf4f2ea831ab7bf3576da6
I20260709 13:13:37.203099 31804 raft_consensus.cc:2804] T fc35ae8230cf4ab792d0e15bcaf8b653 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:37.203562 31804 raft_consensus.cc:697] T fc35ae8230cf4ab792d0e15bcaf8b653 P 196d972917fe4f85985e3862d40b7596 [term 1 LEADER]: Becoming Leader. State: Replica: 196d972917fe4f85985e3862d40b7596, State: Running, Role: LEADER
I20260709 13:13:37.206678 31804 consensus_queue.cc:237] T fc35ae8230cf4ab792d0e15bcaf8b653 P 196d972917fe4f85985e3862d40b7596 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:37.221228 31749 tablet_bootstrap.cc:654] T ee6c632286174388ab5e7bfb2ae40078 P 76fb155ade354ee1ba78673e73b28aca: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.225787 31747 tablet_bootstrap.cc:492] T 8c4f880f34664227ac8bd46378c9995f P 196d972917fe4f85985e3862d40b7596: No bootstrap required, opened a new log
I20260709 13:13:37.226307 31747 ts_tablet_manager.cc:1403] T 8c4f880f34664227ac8bd46378c9995f P 196d972917fe4f85985e3862d40b7596: Time spent bootstrapping tablet: real 0.133s	user 0.018s	sys 0.020s
I20260709 13:13:37.228049 31748 tablet_bootstrap.cc:654] T 680d6e1f38f4469ebe14094aa66fdfac P c74453754ee34bea9b231ae318a55a31: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.229336 31750 tablet_bootstrap.cc:492] T fc35ae8230cf4ab792d0e15bcaf8b653 P 458d610e8abf4f2ea831ab7bf3576da6: No bootstrap required, opened a new log
I20260709 13:13:37.233170 31750 ts_tablet_manager.cc:1403] T fc35ae8230cf4ab792d0e15bcaf8b653 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.127s	user 0.027s	sys 0.008s
I20260709 13:13:37.235878 31750 raft_consensus.cc:359] T fc35ae8230cf4ab792d0e15bcaf8b653 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:37.237988 31881 raft_consensus.cc:493] T 8c4f880f34664227ac8bd46378c9995f P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.238590 31881 raft_consensus.cc:515] T 8c4f880f34664227ac8bd46378c9995f P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:37.240797 31881 leader_election.cc:290] T 8c4f880f34664227ac8bd46378c9995f P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:37.242128 31628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4f880f34664227ac8bd46378c9995f" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:37.242969 31628 raft_consensus.cc:2468] T 8c4f880f34664227ac8bd46378c9995f P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 0.
I20260709 13:13:37.243754 31553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4f880f34664227ac8bd46378c9995f" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:37.238214 31750 raft_consensus.cc:385] T fc35ae8230cf4ab792d0e15bcaf8b653 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.244671 31750 raft_consensus.cc:740] T fc35ae8230cf4ab792d0e15bcaf8b653 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.245455 31750 consensus_queue.cc:260] T fc35ae8230cf4ab792d0e15bcaf8b653 P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:37.245554 31669 leader_election.cc:304] T 8c4f880f34664227ac8bd46378c9995f P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca, c74453754ee34bea9b231ae318a55a31; no voters: 
I20260709 13:13:37.247189 31881 raft_consensus.cc:2804] T 8c4f880f34664227ac8bd46378c9995f P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:37.247642 31881 raft_consensus.cc:493] T 8c4f880f34664227ac8bd46378c9995f P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:37.247816 31750 ts_tablet_manager.cc:1434] T fc35ae8230cf4ab792d0e15bcaf8b653 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.003s
I20260709 13:13:37.248103 31881 raft_consensus.cc:3060] T 8c4f880f34664227ac8bd46378c9995f P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.248939 31750 tablet_bootstrap.cc:492] T 85d4a24725c749199c1b35d959b1b2b5 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:37.255797 31750 tablet_bootstrap.cc:654] T 85d4a24725c749199c1b35d959b1b2b5 P 458d610e8abf4f2ea831ab7bf3576da6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.262490 31874 consensus_queue.cc:1048] T 5ea74721b8824d00b63c524b25ff23df P c74453754ee34bea9b231ae318a55a31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:37.264832 31881 raft_consensus.cc:515] T 8c4f880f34664227ac8bd46378c9995f P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:37.228958 31747 raft_consensus.cc:359] T 8c4f880f34664227ac8bd46378c9995f P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:37.274653 31477 raft_consensus.cc:3060] T 5ea74721b8824d00b63c524b25ff23df P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.281100 31844 raft_consensus.cc:493] T 36bf73ed3df141c889c046ad6902e304 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.281826 31844 raft_consensus.cc:515] T 36bf73ed3df141c889c046ad6902e304 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:37.284471 31844 leader_election.cc:290] T 36bf73ed3df141c889c046ad6902e304 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:37.287106 31480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bf73ed3df141c889c046ad6902e304" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
W20260709 13:13:37.288947 31668 leader_election.cc:343] T 36bf73ed3df141c889c046ad6902e304 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:37.295360 31555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bf73ed3df141c889c046ad6902e304" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
W20260709 13:13:37.297264 31666 leader_election.cc:343] T 36bf73ed3df141c889c046ad6902e304 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:37.297920 31666 leader_election.cc:304] T 36bf73ed3df141c889c046ad6902e304 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca; no voters: 196d972917fe4f85985e3862d40b7596, 458d610e8abf4f2ea831ab7bf3576da6
I20260709 13:13:37.299311 31813 raft_consensus.cc:2749] T 36bf73ed3df141c889c046ad6902e304 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:37.306401 31842 raft_consensus.cc:493] T 5ea74721b8824d00b63c524b25ff23df P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.273641 31747 raft_consensus.cc:385] T 8c4f880f34664227ac8bd46378c9995f P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.307022 31747 raft_consensus.cc:740] T 8c4f880f34664227ac8bd46378c9995f P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 196d972917fe4f85985e3862d40b7596, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.306937 31842 raft_consensus.cc:515] T 5ea74721b8824d00b63c524b25ff23df P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:37.307500 31874 consensus_queue.cc:1048] T 5ea74721b8824d00b63c524b25ff23df P c74453754ee34bea9b231ae318a55a31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:37.307883 31747 consensus_queue.cc:260] T 8c4f880f34664227ac8bd46378c9995f P 196d972917fe4f85985e3862d40b7596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:37.308933 31553 raft_consensus.cc:2468] T 8c4f880f34664227ac8bd46378c9995f P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 0.
I20260709 13:13:37.316700 31555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea74721b8824d00b63c524b25ff23df" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:37.317050 31747 ts_tablet_manager.cc:1434] T 8c4f880f34664227ac8bd46378c9995f P 196d972917fe4f85985e3862d40b7596: Time spent starting tablet: real 0.090s	user 0.005s	sys 0.002s
I20260709 13:13:37.321097 31842 leader_election.cc:290] T 5ea74721b8824d00b63c524b25ff23df P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:37.322635 31628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea74721b8824d00b63c524b25ff23df" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:37.324301 31446 leader_election.cc:304] T 5ea74721b8824d00b63c524b25ff23df P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6; no voters: 196d972917fe4f85985e3862d40b7596, c74453754ee34bea9b231ae318a55a31
I20260709 13:13:37.335948 31750 tablet_bootstrap.cc:492] T 85d4a24725c749199c1b35d959b1b2b5 P 458d610e8abf4f2ea831ab7bf3576da6: No bootstrap required, opened a new log
I20260709 13:13:37.336769 31750 ts_tablet_manager.cc:1403] T 85d4a24725c749199c1b35d959b1b2b5 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.088s	user 0.017s	sys 0.001s
I20260709 13:13:37.339987 31750 raft_consensus.cc:359] T 85d4a24725c749199c1b35d959b1b2b5 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:37.356614 31750 raft_consensus.cc:385] T 85d4a24725c749199c1b35d959b1b2b5 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.357024 31750 raft_consensus.cc:740] T 85d4a24725c749199c1b35d959b1b2b5 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.356714 31759 consensus_queue.cc:1048] T f66580482b2d470bacbfec917042485b P c74453754ee34bea9b231ae318a55a31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:37.357934 31750 consensus_queue.cc:260] T 85d4a24725c749199c1b35d959b1b2b5 P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:37.358321 31376 catalog_manager.cc:5697] T fc35ae8230cf4ab792d0e15bcaf8b653 P 196d972917fe4f85985e3862d40b7596 reported cstate change: term changed from 0 to 1, leader changed from <none> to 196d972917fe4f85985e3862d40b7596 (127.23.140.66). New cstate: current_term: 1 leader_uuid: "196d972917fe4f85985e3862d40b7596" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:37.360278 31750 ts_tablet_manager.cc:1434] T 85d4a24725c749199c1b35d959b1b2b5 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.000s
I20260709 13:13:37.361490 31750 tablet_bootstrap.cc:492] T a35171dce2e34beeafe34f3e80f18a41 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:37.372269 31750 tablet_bootstrap.cc:654] T a35171dce2e34beeafe34f3e80f18a41 P 458d610e8abf4f2ea831ab7bf3576da6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.384164 31750 tablet_bootstrap.cc:492] T a35171dce2e34beeafe34f3e80f18a41 P 458d610e8abf4f2ea831ab7bf3576da6: No bootstrap required, opened a new log
I20260709 13:13:37.384928 31750 ts_tablet_manager.cc:1403] T a35171dce2e34beeafe34f3e80f18a41 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.004s
I20260709 13:13:37.388226 31750 raft_consensus.cc:359] T a35171dce2e34beeafe34f3e80f18a41 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:37.389014 31750 raft_consensus.cc:385] T a35171dce2e34beeafe34f3e80f18a41 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.389299 31750 raft_consensus.cc:740] T a35171dce2e34beeafe34f3e80f18a41 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.390225 31750 consensus_queue.cc:260] T a35171dce2e34beeafe34f3e80f18a41 P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:37.391965 31553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4f880f34664227ac8bd46378c9995f" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596"
I20260709 13:13:37.392812 31553 raft_consensus.cc:3060] T 8c4f880f34664227ac8bd46378c9995f P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.400591 31750 ts_tablet_manager.cc:1434] T a35171dce2e34beeafe34f3e80f18a41 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.008s
I20260709 13:13:37.401880 31750 tablet_bootstrap.cc:492] T 36bf73ed3df141c889c046ad6902e304 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:37.408552 31750 tablet_bootstrap.cc:654] T 36bf73ed3df141c889c046ad6902e304 P 458d610e8abf4f2ea831ab7bf3576da6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.408718 31748 tablet_bootstrap.cc:492] T 680d6e1f38f4469ebe14094aa66fdfac P c74453754ee34bea9b231ae318a55a31: No bootstrap required, opened a new log
I20260709 13:13:37.409633 31748 ts_tablet_manager.cc:1403] T 680d6e1f38f4469ebe14094aa66fdfac P c74453754ee34bea9b231ae318a55a31: Time spent bootstrapping tablet: real 0.211s	user 0.028s	sys 0.051s
I20260709 13:13:37.410753 31747 tablet_bootstrap.cc:492] T 53c18818aa9c44c8987bb675a05026a4 P 196d972917fe4f85985e3862d40b7596: Bootstrap starting.
I20260709 13:13:37.416476 31748 raft_consensus.cc:359] T 680d6e1f38f4469ebe14094aa66fdfac P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:37.417224 31748 raft_consensus.cc:385] T 680d6e1f38f4469ebe14094aa66fdfac P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.417513 31748 raft_consensus.cc:740] T 680d6e1f38f4469ebe14094aa66fdfac P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.418478 31813 raft_consensus.cc:493] T a35171dce2e34beeafe34f3e80f18a41 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.419265 31748 consensus_queue.cc:260] T 680d6e1f38f4469ebe14094aa66fdfac P c74453754ee34bea9b231ae318a55a31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:37.424700 31748 ts_tablet_manager.cc:1434] T 680d6e1f38f4469ebe14094aa66fdfac P c74453754ee34bea9b231ae318a55a31: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:13:37.419183 31813 raft_consensus.cc:515] T a35171dce2e34beeafe34f3e80f18a41 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:37.425709 31748 tablet_bootstrap.cc:492] T 53c18818aa9c44c8987bb675a05026a4 P c74453754ee34bea9b231ae318a55a31: Bootstrap starting.
I20260709 13:13:37.426805 31628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4f880f34664227ac8bd46378c9995f" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31"
I20260709 13:13:37.428419 31628 raft_consensus.cc:3060] T 8c4f880f34664227ac8bd46378c9995f P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.432777 31477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35171dce2e34beeafe34f3e80f18a41" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:37.433540 31477 raft_consensus.cc:2468] T a35171dce2e34beeafe34f3e80f18a41 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 0.
I20260709 13:13:37.435232 31668 leader_election.cc:304] T a35171dce2e34beeafe34f3e80f18a41 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca; no voters: 
I20260709 13:13:37.435875 31552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35171dce2e34beeafe34f3e80f18a41" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:37.436123 31844 raft_consensus.cc:2804] T a35171dce2e34beeafe34f3e80f18a41 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:37.436563 31844 raft_consensus.cc:493] T a35171dce2e34beeafe34f3e80f18a41 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:37.436924 31844 raft_consensus.cc:3060] T a35171dce2e34beeafe34f3e80f18a41 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:37.437655 31666 leader_election.cc:343] T a35171dce2e34beeafe34f3e80f18a41 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:37.438265 31628 raft_consensus.cc:2468] T 8c4f880f34664227ac8bd46378c9995f P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 1.
I20260709 13:13:37.424481 31881 leader_election.cc:290] T 8c4f880f34664227ac8bd46378c9995f P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 election: Requested vote from peers 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:37.439633 31669 leader_election.cc:304] T 8c4f880f34664227ac8bd46378c9995f P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca, c74453754ee34bea9b231ae318a55a31; no voters: 
I20260709 13:13:37.427124 31813 leader_election.cc:290] T a35171dce2e34beeafe34f3e80f18a41 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:37.443492 31747 tablet_bootstrap.cc:654] T 53c18818aa9c44c8987bb675a05026a4 P 196d972917fe4f85985e3862d40b7596: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.420264 31553 raft_consensus.cc:2468] T 8c4f880f34664227ac8bd46378c9995f P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 1.
I20260709 13:13:37.450191 31759 raft_consensus.cc:493] T 680d6e1f38f4469ebe14094aa66fdfac P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.453251 31844 raft_consensus.cc:515] T a35171dce2e34beeafe34f3e80f18a41 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:37.454367 31759 raft_consensus.cc:515] T 680d6e1f38f4469ebe14094aa66fdfac P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:37.456655 31477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35171dce2e34beeafe34f3e80f18a41" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
I20260709 13:13:37.456948 31759 leader_election.cc:290] T 680d6e1f38f4469ebe14094aa66fdfac P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431), 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715)
I20260709 13:13:37.457232 31477 raft_consensus.cc:3060] T a35171dce2e34beeafe34f3e80f18a41 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.457652 31555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680d6e1f38f4469ebe14094aa66fdfac" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:37.458448 31552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35171dce2e34beeafe34f3e80f18a41" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596"
W20260709 13:13:37.459290 31592 leader_election.cc:343] T 680d6e1f38f4469ebe14094aa66fdfac P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:37.459802 31666 leader_election.cc:343] T a35171dce2e34beeafe34f3e80f18a41 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:37.460985 31844 leader_election.cc:290] T a35171dce2e34beeafe34f3e80f18a41 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 election: Requested vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:37.453186 31748 tablet_bootstrap.cc:654] T 53c18818aa9c44c8987bb675a05026a4 P c74453754ee34bea9b231ae318a55a31: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.450320 31881 raft_consensus.cc:2804] T 8c4f880f34664227ac8bd46378c9995f P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:37.466337 31750 tablet_bootstrap.cc:492] T 36bf73ed3df141c889c046ad6902e304 P 458d610e8abf4f2ea831ab7bf3576da6: No bootstrap required, opened a new log
I20260709 13:13:37.466571 31702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680d6e1f38f4469ebe14094aa66fdfac" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:37.466820 31750 ts_tablet_manager.cc:1403] T 36bf73ed3df141c889c046ad6902e304 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.065s	user 0.013s	sys 0.007s
W20260709 13:13:37.468132 31595 leader_election.cc:343] T 680d6e1f38f4469ebe14094aa66fdfac P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:37.468544 31595 leader_election.cc:304] T 680d6e1f38f4469ebe14094aa66fdfac P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c74453754ee34bea9b231ae318a55a31; no voters: 196d972917fe4f85985e3862d40b7596, 76fb155ade354ee1ba78673e73b28aca
I20260709 13:13:37.469553 31817 consensus_queue.cc:1048] T f66580482b2d470bacbfec917042485b P c74453754ee34bea9b231ae318a55a31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:37.470182 31857 raft_consensus.cc:2749] T 680d6e1f38f4469ebe14094aa66fdfac P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:37.473022 31477 raft_consensus.cc:2468] T a35171dce2e34beeafe34f3e80f18a41 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 1.
I20260709 13:13:37.474337 31668 leader_election.cc:304] T a35171dce2e34beeafe34f3e80f18a41 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca; no voters: 196d972917fe4f85985e3862d40b7596
I20260709 13:13:37.475083 31844 raft_consensus.cc:2804] T a35171dce2e34beeafe34f3e80f18a41 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:37.475594 31844 raft_consensus.cc:697] T a35171dce2e34beeafe34f3e80f18a41 P 76fb155ade354ee1ba78673e73b28aca [term 1 LEADER]: Becoming Leader. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Running, Role: LEADER
I20260709 13:13:37.475728 31750 raft_consensus.cc:359] T 36bf73ed3df141c889c046ad6902e304 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:37.476593 31750 raft_consensus.cc:385] T 36bf73ed3df141c889c046ad6902e304 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.476991 31750 raft_consensus.cc:740] T 36bf73ed3df141c889c046ad6902e304 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.476511 31844 consensus_queue.cc:237] T a35171dce2e34beeafe34f3e80f18a41 P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:37.477622 31750 consensus_queue.cc:260] T 36bf73ed3df141c889c046ad6902e304 P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:37.478384 31842 raft_consensus.cc:2749] T 5ea74721b8824d00b63c524b25ff23df P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:37.482276 31750 ts_tablet_manager.cc:1434] T 36bf73ed3df141c889c046ad6902e304 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:13:37.464870 31881 raft_consensus.cc:697] T 8c4f880f34664227ac8bd46378c9995f P 76fb155ade354ee1ba78673e73b28aca [term 1 LEADER]: Becoming Leader. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Running, Role: LEADER
I20260709 13:13:37.491560 31750 tablet_bootstrap.cc:492] T ee6c632286174388ab5e7bfb2ae40078 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:37.497036 31749 tablet_bootstrap.cc:492] T ee6c632286174388ab5e7bfb2ae40078 P 76fb155ade354ee1ba78673e73b28aca: No bootstrap required, opened a new log
I20260709 13:13:37.497813 31749 ts_tablet_manager.cc:1403] T ee6c632286174388ab5e7bfb2ae40078 P 76fb155ade354ee1ba78673e73b28aca: Time spent bootstrapping tablet: real 0.298s	user 0.052s	sys 0.043s
I20260709 13:13:37.506268 31747 tablet_bootstrap.cc:492] T 53c18818aa9c44c8987bb675a05026a4 P 196d972917fe4f85985e3862d40b7596: No bootstrap required, opened a new log
I20260709 13:13:37.506990 31747 ts_tablet_manager.cc:1403] T 53c18818aa9c44c8987bb675a05026a4 P 196d972917fe4f85985e3862d40b7596: Time spent bootstrapping tablet: real 0.101s	user 0.015s	sys 0.004s
I20260709 13:13:37.509191 31749 raft_consensus.cc:359] T ee6c632286174388ab5e7bfb2ae40078 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:37.513124 31749 raft_consensus.cc:385] T ee6c632286174388ab5e7bfb2ae40078 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.514201 31749 raft_consensus.cc:740] T ee6c632286174388ab5e7bfb2ae40078 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.515057 31749 consensus_queue.cc:260] T ee6c632286174388ab5e7bfb2ae40078 P 76fb155ade354ee1ba78673e73b28aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:37.517200 31750 tablet_bootstrap.cc:654] T ee6c632286174388ab5e7bfb2ae40078 P 458d610e8abf4f2ea831ab7bf3576da6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.517714 31749 ts_tablet_manager.cc:1434] T ee6c632286174388ab5e7bfb2ae40078 P 76fb155ade354ee1ba78673e73b28aca: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:13:37.519013 31749 tablet_bootstrap.cc:492] T 680d6e1f38f4469ebe14094aa66fdfac P 76fb155ade354ee1ba78673e73b28aca: Bootstrap starting.
I20260709 13:13:37.512955 31747 raft_consensus.cc:359] T 53c18818aa9c44c8987bb675a05026a4 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:37.519940 31747 raft_consensus.cc:385] T 53c18818aa9c44c8987bb675a05026a4 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.520313 31747 raft_consensus.cc:740] T 53c18818aa9c44c8987bb675a05026a4 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 196d972917fe4f85985e3862d40b7596, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.521235 31747 consensus_queue.cc:260] T 53c18818aa9c44c8987bb675a05026a4 P 196d972917fe4f85985e3862d40b7596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:37.527886 31881 consensus_queue.cc:237] T 8c4f880f34664227ac8bd46378c9995f P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:37.546268 31747 ts_tablet_manager.cc:1434] T 53c18818aa9c44c8987bb675a05026a4 P 196d972917fe4f85985e3862d40b7596: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 13:13:37.549213 31747 tablet_bootstrap.cc:492] T a35171dce2e34beeafe34f3e80f18a41 P 196d972917fe4f85985e3862d40b7596: Bootstrap starting.
I20260709 13:13:37.550052 31842 raft_consensus.cc:493] T 36bf73ed3df141c889c046ad6902e304 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.550648 31842 raft_consensus.cc:515] T 36bf73ed3df141c889c046ad6902e304 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:37.558928 31553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bf73ed3df141c889c046ad6902e304" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:37.562712 31842 leader_election.cc:290] T 36bf73ed3df141c889c046ad6902e304 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
W20260709 13:13:37.566648 31443 leader_election.cc:343] T 36bf73ed3df141c889c046ad6902e304 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:37.571215 31703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bf73ed3df141c889c046ad6902e304" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:37.571997 31703 raft_consensus.cc:2468] T 36bf73ed3df141c889c046ad6902e304 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 0.
I20260709 13:13:37.573487 31446 leader_election.cc:304] T 36bf73ed3df141c889c046ad6902e304 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca; no voters: 196d972917fe4f85985e3862d40b7596
I20260709 13:13:37.574443 31990 raft_consensus.cc:2804] T 36bf73ed3df141c889c046ad6902e304 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:37.574831 31990 raft_consensus.cc:493] T 36bf73ed3df141c889c046ad6902e304 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:37.575580 31990 raft_consensus.cc:3060] T 36bf73ed3df141c889c046ad6902e304 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.590020 31771 raft_consensus.cc:493] T 256a5c9a935246e0a6c36b5b654fbbfb P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.590591 31771 raft_consensus.cc:515] T 256a5c9a935246e0a6c36b5b654fbbfb P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:37.592732 31771 leader_election.cc:290] T 256a5c9a935246e0a6c36b5b654fbbfb P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715)
I20260709 13:13:37.594170 31703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a5c9a935246e0a6c36b5b654fbbfb" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:37.594909 31703 raft_consensus.cc:2468] T 256a5c9a935246e0a6c36b5b654fbbfb P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 196d972917fe4f85985e3862d40b7596 in term 0.
I20260709 13:13:37.596822 31748 tablet_bootstrap.cc:492] T 53c18818aa9c44c8987bb675a05026a4 P c74453754ee34bea9b231ae318a55a31: No bootstrap required, opened a new log
I20260709 13:13:37.597440 31748 ts_tablet_manager.cc:1403] T 53c18818aa9c44c8987bb675a05026a4 P c74453754ee34bea9b231ae318a55a31: Time spent bootstrapping tablet: real 0.172s	user 0.011s	sys 0.004s
I20260709 13:13:37.602164 31521 leader_election.cc:304] T 256a5c9a935246e0a6c36b5b654fbbfb P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, 76fb155ade354ee1ba78673e73b28aca; no voters: 
I20260709 13:13:37.603453 31804 raft_consensus.cc:2804] T 256a5c9a935246e0a6c36b5b654fbbfb P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:37.603896 31804 raft_consensus.cc:493] T 256a5c9a935246e0a6c36b5b654fbbfb P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:37.604283 31804 raft_consensus.cc:3060] T 256a5c9a935246e0a6c36b5b654fbbfb P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.605999 31628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a5c9a935246e0a6c36b5b654fbbfb" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:37.606735 31628 raft_consensus.cc:2468] T 256a5c9a935246e0a6c36b5b654fbbfb P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 196d972917fe4f85985e3862d40b7596 in term 0.
I20260709 13:13:37.608037 31990 raft_consensus.cc:515] T 36bf73ed3df141c889c046ad6902e304 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:37.603909 31748 raft_consensus.cc:359] T 53c18818aa9c44c8987bb675a05026a4 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:37.611135 31748 raft_consensus.cc:385] T 53c18818aa9c44c8987bb675a05026a4 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.611445 31748 raft_consensus.cc:740] T 53c18818aa9c44c8987bb675a05026a4 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.612206 31748 consensus_queue.cc:260] T 53c18818aa9c44c8987bb675a05026a4 P c74453754ee34bea9b231ae318a55a31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:37.613832 31749 tablet_bootstrap.cc:654] T 680d6e1f38f4469ebe14094aa66fdfac P 76fb155ade354ee1ba78673e73b28aca: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.618098 31703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bf73ed3df141c889c046ad6902e304" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca"
I20260709 13:13:37.618733 31750 tablet_bootstrap.cc:492] T ee6c632286174388ab5e7bfb2ae40078 P 458d610e8abf4f2ea831ab7bf3576da6: No bootstrap required, opened a new log
I20260709 13:13:37.618745 31703 raft_consensus.cc:3060] T 36bf73ed3df141c889c046ad6902e304 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.621515 31804 raft_consensus.cc:515] T 256a5c9a935246e0a6c36b5b654fbbfb P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:37.619239 31750 ts_tablet_manager.cc:1403] T ee6c632286174388ab5e7bfb2ae40078 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.131s	user 0.009s	sys 0.011s
I20260709 13:13:37.615063 31375 catalog_manager.cc:5697] T 8c4f880f34664227ac8bd46378c9995f P 76fb155ade354ee1ba78673e73b28aca reported cstate change: term changed from 0 to 1, leader changed from <none> to 76fb155ade354ee1ba78673e73b28aca (127.23.140.68). New cstate: current_term: 1 leader_uuid: "76fb155ade354ee1ba78673e73b28aca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:37.628352 31747 tablet_bootstrap.cc:654] T a35171dce2e34beeafe34f3e80f18a41 P 196d972917fe4f85985e3862d40b7596: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.632555 31703 raft_consensus.cc:2468] T 36bf73ed3df141c889c046ad6902e304 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 1.
I20260709 13:13:37.633848 31990 leader_election.cc:290] T 36bf73ed3df141c889c046ad6902e304 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 election: Requested vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:37.635623 31553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bf73ed3df141c889c046ad6902e304" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596"
W20260709 13:13:37.636916 31443 leader_election.cc:343] T 36bf73ed3df141c889c046ad6902e304 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:37.637491 31446 leader_election.cc:304] T 36bf73ed3df141c889c046ad6902e304 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca; no voters: 196d972917fe4f85985e3862d40b7596
I20260709 13:13:37.638286 31750 raft_consensus.cc:359] T ee6c632286174388ab5e7bfb2ae40078 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:37.638945 31750 raft_consensus.cc:385] T ee6c632286174388ab5e7bfb2ae40078 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.639227 31750 raft_consensus.cc:740] T ee6c632286174388ab5e7bfb2ae40078 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.639866 31748 ts_tablet_manager.cc:1434] T 53c18818aa9c44c8987bb675a05026a4 P c74453754ee34bea9b231ae318a55a31: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.003s
I20260709 13:13:37.643216 31748 tablet_bootstrap.cc:492] T ee6c632286174388ab5e7bfb2ae40078 P c74453754ee34bea9b231ae318a55a31: Bootstrap starting.
I20260709 13:13:37.646591 31842 raft_consensus.cc:493] T fc35ae8230cf4ab792d0e15bcaf8b653 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.647061 31842 raft_consensus.cc:515] T fc35ae8230cf4ab792d0e15bcaf8b653 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:37.647354 31749 tablet_bootstrap.cc:492] T 680d6e1f38f4469ebe14094aa66fdfac P 76fb155ade354ee1ba78673e73b28aca: No bootstrap required, opened a new log
I20260709 13:13:37.648072 31749 ts_tablet_manager.cc:1403] T 680d6e1f38f4469ebe14094aa66fdfac P 76fb155ade354ee1ba78673e73b28aca: Time spent bootstrapping tablet: real 0.129s	user 0.009s	sys 0.005s
I20260709 13:13:37.649168 31748 tablet_bootstrap.cc:654] T ee6c632286174388ab5e7bfb2ae40078 P c74453754ee34bea9b231ae318a55a31: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.649087 31842 leader_election.cc:290] T fc35ae8230cf4ab792d0e15bcaf8b653 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:37.650255 31750 consensus_queue.cc:260] T ee6c632286174388ab5e7bfb2ae40078 P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:37.641772 31990 raft_consensus.cc:2804] T 36bf73ed3df141c889c046ad6902e304 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:37.656086 31628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc35ae8230cf4ab792d0e15bcaf8b653" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:37.656221 31553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc35ae8230cf4ab792d0e15bcaf8b653" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:37.657707 31628 raft_consensus.cc:2393] T fc35ae8230cf4ab792d0e15bcaf8b653 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 458d610e8abf4f2ea831ab7bf3576da6 in current term 1: Already voted for candidate 196d972917fe4f85985e3862d40b7596 in this term.
I20260709 13:13:37.656262 31990 raft_consensus.cc:697] T 36bf73ed3df141c889c046ad6902e304 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 LEADER]: Becoming Leader. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Running, Role: LEADER
I20260709 13:13:37.655491 31749 raft_consensus.cc:359] T 680d6e1f38f4469ebe14094aa66fdfac P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:37.660197 31749 raft_consensus.cc:385] T 680d6e1f38f4469ebe14094aa66fdfac P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.660451 31749 raft_consensus.cc:740] T 680d6e1f38f4469ebe14094aa66fdfac P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.661244 31750 ts_tablet_manager.cc:1434] T ee6c632286174388ab5e7bfb2ae40078 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260709 13:13:37.660970 31990 consensus_queue.cc:237] T 36bf73ed3df141c889c046ad6902e304 P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:37.661201 31749 consensus_queue.cc:260] T 680d6e1f38f4469ebe14094aa66fdfac P 76fb155ade354ee1ba78673e73b28aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:37.661525 31446 leader_election.cc:304] T fc35ae8230cf4ab792d0e15bcaf8b653 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6; no voters: 196d972917fe4f85985e3862d40b7596, c74453754ee34bea9b231ae318a55a31
I20260709 13:13:37.662403 31750 tablet_bootstrap.cc:492] T 53c18818aa9c44c8987bb675a05026a4 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:37.662742 31842 raft_consensus.cc:3060] T fc35ae8230cf4ab792d0e15bcaf8b653 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.664723 31804 leader_election.cc:290] T 256a5c9a935246e0a6c36b5b654fbbfb P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 election: Requested vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715)
I20260709 13:13:37.663935 31375 catalog_manager.cc:5697] T a35171dce2e34beeafe34f3e80f18a41 P 76fb155ade354ee1ba78673e73b28aca reported cstate change: term changed from 0 to 1, leader changed from <none> to 76fb155ade354ee1ba78673e73b28aca (127.23.140.68). New cstate: current_term: 1 leader_uuid: "76fb155ade354ee1ba78673e73b28aca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:37.667071 31703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a5c9a935246e0a6c36b5b654fbbfb" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca"
I20260709 13:13:37.671696 31703 raft_consensus.cc:3060] T 256a5c9a935246e0a6c36b5b654fbbfb P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.667846 31628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a5c9a935246e0a6c36b5b654fbbfb" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31"
I20260709 13:13:37.680400 31628 raft_consensus.cc:3060] T 256a5c9a935246e0a6c36b5b654fbbfb P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.663950 31749 ts_tablet_manager.cc:1434] T 680d6e1f38f4469ebe14094aa66fdfac P 76fb155ade354ee1ba78673e73b28aca: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:13:37.688668 31881 raft_consensus.cc:493] T 680d6e1f38f4469ebe14094aa66fdfac P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.689147 31881 raft_consensus.cc:515] T 680d6e1f38f4469ebe14094aa66fdfac P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:37.691298 31881 leader_election.cc:290] T 680d6e1f38f4469ebe14094aa66fdfac P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:37.693871 31627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680d6e1f38f4469ebe14094aa66fdfac" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:37.694397 31750 tablet_bootstrap.cc:654] T 53c18818aa9c44c8987bb675a05026a4 P 458d610e8abf4f2ea831ab7bf3576da6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.694518 31627 raft_consensus.cc:2468] T 680d6e1f38f4469ebe14094aa66fdfac P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 0.
I20260709 13:13:37.696134 31669 leader_election.cc:304] T 680d6e1f38f4469ebe14094aa66fdfac P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca, c74453754ee34bea9b231ae318a55a31; no voters: 
I20260709 13:13:37.679456 31842 raft_consensus.cc:2749] T fc35ae8230cf4ab792d0e15bcaf8b653 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:37.666049 31747 tablet_bootstrap.cc:492] T a35171dce2e34beeafe34f3e80f18a41 P 196d972917fe4f85985e3862d40b7596: No bootstrap required, opened a new log
I20260709 13:13:37.697167 31747 ts_tablet_manager.cc:1403] T a35171dce2e34beeafe34f3e80f18a41 P 196d972917fe4f85985e3862d40b7596: Time spent bootstrapping tablet: real 0.148s	user 0.013s	sys 0.001s
I20260709 13:13:37.697865 31844 raft_consensus.cc:2804] T 680d6e1f38f4469ebe14094aa66fdfac P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:37.698239 31844 raft_consensus.cc:493] T 680d6e1f38f4469ebe14094aa66fdfac P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:37.698551 31844 raft_consensus.cc:3060] T 680d6e1f38f4469ebe14094aa66fdfac P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.700506 31747 raft_consensus.cc:359] T a35171dce2e34beeafe34f3e80f18a41 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:37.701601 31747 raft_consensus.cc:385] T a35171dce2e34beeafe34f3e80f18a41 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.701967 31747 raft_consensus.cc:740] T a35171dce2e34beeafe34f3e80f18a41 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 196d972917fe4f85985e3862d40b7596, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.703083 31553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680d6e1f38f4469ebe14094aa66fdfac" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
W20260709 13:13:37.704949 31666 leader_election.cc:343] T 680d6e1f38f4469ebe14094aa66fdfac P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:37.705030 31990 raft_consensus.cc:493] T 85d4a24725c749199c1b35d959b1b2b5 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.705818 31990 raft_consensus.cc:515] T 85d4a24725c749199c1b35d959b1b2b5 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:37.706211 31789 raft_consensus.cc:493] T ee6c632286174388ab5e7bfb2ae40078 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.706702 31789 raft_consensus.cc:515] T ee6c632286174388ab5e7bfb2ae40078 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:37.706857 31747 consensus_queue.cc:260] T a35171dce2e34beeafe34f3e80f18a41 P 196d972917fe4f85985e3862d40b7596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:37.708668 31789 leader_election.cc:290] T ee6c632286174388ab5e7bfb2ae40078 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:37.708768 31627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85d4a24725c749199c1b35d959b1b2b5" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:37.709781 31874 raft_consensus.cc:493] T 53c18818aa9c44c8987bb675a05026a4 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.710291 31874 raft_consensus.cc:515] T 53c18818aa9c44c8987bb675a05026a4 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:37.710294 31990 leader_election.cc:290] T 85d4a24725c749199c1b35d959b1b2b5 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715)
I20260709 13:13:37.712357 31874 leader_election.cc:290] T 53c18818aa9c44c8987bb675a05026a4 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:37.713186 31747 ts_tablet_manager.cc:1434] T a35171dce2e34beeafe34f3e80f18a41 P 196d972917fe4f85985e3862d40b7596: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:13:37.713865 31475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c18818aa9c44c8987bb675a05026a4" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
W20260709 13:13:37.714269 31446 leader_election.cc:343] T 85d4a24725c749199c1b35d959b1b2b5 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:37.715484 31475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6c632286174388ab5e7bfb2ae40078" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:37.716066 31475 raft_consensus.cc:2468] T ee6c632286174388ab5e7bfb2ae40078 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 0.
W20260709 13:13:37.716141 31594 leader_election.cc:343] T 53c18818aa9c44c8987bb675a05026a4 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:37.717473 31702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85d4a24725c749199c1b35d959b1b2b5" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:37.718309 31702 raft_consensus.cc:2468] T 85d4a24725c749199c1b35d959b1b2b5 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 0.
I20260709 13:13:37.720021 31844 raft_consensus.cc:515] T 680d6e1f38f4469ebe14094aa66fdfac P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:37.720651 31627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6c632286174388ab5e7bfb2ae40078" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:37.717396 31553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c18818aa9c44c8987bb675a05026a4" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:37.722012 31749 tablet_bootstrap.cc:492] T fb4f7292ed2f489e922ca5fb1c6e47bf P 76fb155ade354ee1ba78673e73b28aca: Bootstrap starting.
I20260709 13:13:37.722111 31553 raft_consensus.cc:2468] T 53c18818aa9c44c8987bb675a05026a4 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 0.
I20260709 13:13:37.723012 31552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680d6e1f38f4469ebe14094aa66fdfac" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596"
W20260709 13:13:37.734015 31666 leader_election.cc:343] T 680d6e1f38f4469ebe14094aa66fdfac P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:37.734513 31750 tablet_bootstrap.cc:492] T 53c18818aa9c44c8987bb675a05026a4 P 458d610e8abf4f2ea831ab7bf3576da6: No bootstrap required, opened a new log
I20260709 13:13:37.734970 31750 ts_tablet_manager.cc:1403] T 53c18818aa9c44c8987bb675a05026a4 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.073s	user 0.011s	sys 0.006s
I20260709 13:13:37.729638 31844 leader_election.cc:290] T 680d6e1f38f4469ebe14094aa66fdfac P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 election: Requested vote from peers 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
W20260709 13:13:37.723191 31669 leader_election.cc:343] T ee6c632286174388ab5e7bfb2ae40078 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:37.737919 31750 raft_consensus.cc:359] T 53c18818aa9c44c8987bb675a05026a4 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:37.737718 31375 catalog_manager.cc:5697] T 36bf73ed3df141c889c046ad6902e304 P 458d610e8abf4f2ea831ab7bf3576da6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65). New cstate: current_term: 1 leader_uuid: "458d610e8abf4f2ea831ab7bf3576da6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:37.738574 31750 raft_consensus.cc:385] T 53c18818aa9c44c8987bb675a05026a4 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.738871 31750 raft_consensus.cc:740] T 53c18818aa9c44c8987bb675a05026a4 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.723824 31446 leader_election.cc:304] T 85d4a24725c749199c1b35d959b1b2b5 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca; no voters: c74453754ee34bea9b231ae318a55a31
I20260709 13:13:37.739724 31750 consensus_queue.cc:260] T 53c18818aa9c44c8987bb675a05026a4 P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:37.740325 31592 leader_election.cc:304] T 53c18818aa9c44c8987bb675a05026a4 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, c74453754ee34bea9b231ae318a55a31; no voters: 458d610e8abf4f2ea831ab7bf3576da6
I20260709 13:13:37.679744 31703 raft_consensus.cc:2468] T 256a5c9a935246e0a6c36b5b654fbbfb P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 196d972917fe4f85985e3862d40b7596 in term 1.
I20260709 13:13:37.741183 31627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680d6e1f38f4469ebe14094aa66fdfac" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31"
I20260709 13:13:37.742534 31874 raft_consensus.cc:2804] T 53c18818aa9c44c8987bb675a05026a4 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:37.742880 31627 raft_consensus.cc:3060] T 680d6e1f38f4469ebe14094aa66fdfac P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.743708 31874 raft_consensus.cc:493] T 53c18818aa9c44c8987bb675a05026a4 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:37.744105 31874 raft_consensus.cc:3060] T 53c18818aa9c44c8987bb675a05026a4 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.740404 31668 leader_election.cc:304] T ee6c632286174388ab5e7bfb2ae40078 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca; no voters: c74453754ee34bea9b231ae318a55a31
I20260709 13:13:37.746223 31771 consensus_queue.cc:1048] T fc35ae8230cf4ab792d0e15bcaf8b653 P 196d972917fe4f85985e3862d40b7596 [LEADER]: Connected to new peer: Peer: permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:37.753152 31844 raft_consensus.cc:2804] T ee6c632286174388ab5e7bfb2ae40078 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:37.753574 31844 raft_consensus.cc:493] T ee6c632286174388ab5e7bfb2ae40078 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:37.754004 31844 raft_consensus.cc:3060] T ee6c632286174388ab5e7bfb2ae40078 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.727977 31628 raft_consensus.cc:2468] T 256a5c9a935246e0a6c36b5b654fbbfb P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 196d972917fe4f85985e3862d40b7596 in term 1.
I20260709 13:13:37.746176 31990 raft_consensus.cc:2804] T 85d4a24725c749199c1b35d959b1b2b5 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:37.756032 31990 raft_consensus.cc:493] T 85d4a24725c749199c1b35d959b1b2b5 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:37.756419 31990 raft_consensus.cc:3060] T 85d4a24725c749199c1b35d959b1b2b5 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.751262 31748 tablet_bootstrap.cc:492] T ee6c632286174388ab5e7bfb2ae40078 P c74453754ee34bea9b231ae318a55a31: No bootstrap required, opened a new log
I20260709 13:13:37.758253 31748 ts_tablet_manager.cc:1403] T ee6c632286174388ab5e7bfb2ae40078 P c74453754ee34bea9b231ae318a55a31: Time spent bootstrapping tablet: real 0.115s	user 0.013s	sys 0.033s
I20260709 13:13:37.764341 31750 ts_tablet_manager.cc:1434] T 53c18818aa9c44c8987bb675a05026a4 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:13:37.765403 31750 tablet_bootstrap.cc:492] T 6038006ca0e344af86fe5febd517c62a P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:37.766749 31748 raft_consensus.cc:359] T ee6c632286174388ab5e7bfb2ae40078 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:37.767516 31748 raft_consensus.cc:385] T ee6c632286174388ab5e7bfb2ae40078 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.767807 31748 raft_consensus.cc:740] T ee6c632286174388ab5e7bfb2ae40078 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.768460 31748 consensus_queue.cc:260] T ee6c632286174388ab5e7bfb2ae40078 P c74453754ee34bea9b231ae318a55a31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:37.769899 31521 leader_election.cc:304] T 256a5c9a935246e0a6c36b5b654fbbfb P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, 76fb155ade354ee1ba78673e73b28aca; no voters: 
I20260709 13:13:37.770743 31844 raft_consensus.cc:515] T ee6c632286174388ab5e7bfb2ae40078 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:37.771974 31990 raft_consensus.cc:515] T 85d4a24725c749199c1b35d959b1b2b5 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:37.774091 31990 leader_election.cc:290] T 85d4a24725c749199c1b35d959b1b2b5 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 election: Requested vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715)
I20260709 13:13:37.773685 31628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6c632286174388ab5e7bfb2ae40078" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31"
I20260709 13:13:37.775529 31748 ts_tablet_manager.cc:1434] T ee6c632286174388ab5e7bfb2ae40078 P c74453754ee34bea9b231ae318a55a31: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 13:13:37.776576 31748 tablet_bootstrap.cc:492] T 85d4a24725c749199c1b35d959b1b2b5 P c74453754ee34bea9b231ae318a55a31: Bootstrap starting.
I20260709 13:13:37.776822 31771 raft_consensus.cc:2804] T 256a5c9a935246e0a6c36b5b654fbbfb P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:37.779402 31628 raft_consensus.cc:3060] T ee6c632286174388ab5e7bfb2ae40078 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.781930 31629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85d4a24725c749199c1b35d959b1b2b5" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31"
I20260709 13:13:37.782536 31748 tablet_bootstrap.cc:654] T 85d4a24725c749199c1b35d959b1b2b5 P c74453754ee34bea9b231ae318a55a31: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:37.784229 31446 leader_election.cc:343] T 85d4a24725c749199c1b35d959b1b2b5 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:37.752184 31874 raft_consensus.cc:515] T 53c18818aa9c44c8987bb675a05026a4 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:37.751664 31749 tablet_bootstrap.cc:654] T fb4f7292ed2f489e922ca5fb1c6e47bf P 76fb155ade354ee1ba78673e73b28aca: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.791211 31480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c18818aa9c44c8987bb675a05026a4" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
I20260709 13:13:37.791721 31874 leader_election.cc:290] T 53c18818aa9c44c8987bb675a05026a4 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 election: Requested vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:37.791975 31480 raft_consensus.cc:3060] T 53c18818aa9c44c8987bb675a05026a4 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.793252 31552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c18818aa9c44c8987bb675a05026a4" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596"
I20260709 13:13:37.788230 31702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85d4a24725c749199c1b35d959b1b2b5" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca"
I20260709 13:13:37.793911 31552 raft_consensus.cc:3060] T 53c18818aa9c44c8987bb675a05026a4 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.794544 31702 raft_consensus.cc:3060] T 85d4a24725c749199c1b35d959b1b2b5 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.802070 31552 raft_consensus.cc:2468] T 53c18818aa9c44c8987bb675a05026a4 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 1.
I20260709 13:13:37.803508 31592 leader_election.cc:304] T 53c18818aa9c44c8987bb675a05026a4 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, c74453754ee34bea9b231ae318a55a31; no voters: 
I20260709 13:13:37.804924 31874 raft_consensus.cc:2804] T 53c18818aa9c44c8987bb675a05026a4 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:37.806155 31628 raft_consensus.cc:2468] T ee6c632286174388ab5e7bfb2ae40078 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 1.
I20260709 13:13:37.806699 31857 raft_consensus.cc:493] T ee6c632286174388ab5e7bfb2ae40078 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.807129 31857 raft_consensus.cc:515] T ee6c632286174388ab5e7bfb2ae40078 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:37.810351 31475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6c632286174388ab5e7bfb2ae40078" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
I20260709 13:13:37.811075 31475 raft_consensus.cc:3060] T ee6c632286174388ab5e7bfb2ae40078 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.810657 31874 raft_consensus.cc:697] T 53c18818aa9c44c8987bb675a05026a4 P c74453754ee34bea9b231ae318a55a31 [term 1 LEADER]: Becoming Leader. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Running, Role: LEADER
I20260709 13:13:37.811214 31771 raft_consensus.cc:697] T 256a5c9a935246e0a6c36b5b654fbbfb P 196d972917fe4f85985e3862d40b7596 [term 1 LEADER]: Becoming Leader. State: Replica: 196d972917fe4f85985e3862d40b7596, State: Running, Role: LEADER
I20260709 13:13:37.812273 31771 consensus_queue.cc:237] T 256a5c9a935246e0a6c36b5b654fbbfb P 196d972917fe4f85985e3862d40b7596 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:37.812209 31874 consensus_queue.cc:237] T 53c18818aa9c44c8987bb675a05026a4 P c74453754ee34bea9b231ae318a55a31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:37.815550 31477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6c632286174388ab5e7bfb2ae40078" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:37.818178 31701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6c632286174388ab5e7bfb2ae40078" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:37.818866 31750 tablet_bootstrap.cc:654] T 6038006ca0e344af86fe5febd517c62a P 458d610e8abf4f2ea831ab7bf3576da6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.818970 31701 raft_consensus.cc:2468] T ee6c632286174388ab5e7bfb2ae40078 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 1.
I20260709 13:13:37.820391 31595 leader_election.cc:304] T ee6c632286174388ab5e7bfb2ae40078 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca, c74453754ee34bea9b231ae318a55a31; no voters: 458d610e8abf4f2ea831ab7bf3576da6
I20260709 13:13:37.821242 31817 raft_consensus.cc:2804] T ee6c632286174388ab5e7bfb2ae40078 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:37.821604 31817 raft_consensus.cc:493] T ee6c632286174388ab5e7bfb2ae40078 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:37.821956 31817 raft_consensus.cc:3060] T ee6c632286174388ab5e7bfb2ae40078 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:37.823450 31857 leader_election.cc:290] T ee6c632286174388ab5e7bfb2ae40078 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:37.827908 31702 raft_consensus.cc:2468] T 85d4a24725c749199c1b35d959b1b2b5 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 1.
I20260709 13:13:37.829350 31446 leader_election.cc:304] T 85d4a24725c749199c1b35d959b1b2b5 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca; no voters: c74453754ee34bea9b231ae318a55a31
I20260709 13:13:37.830469 31990 raft_consensus.cc:2804] T 85d4a24725c749199c1b35d959b1b2b5 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:37.830952 31990 raft_consensus.cc:697] T 85d4a24725c749199c1b35d959b1b2b5 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 LEADER]: Becoming Leader. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Running, Role: LEADER
I20260709 13:13:37.831588 31990 consensus_queue.cc:237] T 85d4a24725c749199c1b35d959b1b2b5 P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:37.832667 31817 raft_consensus.cc:515] T ee6c632286174388ab5e7bfb2ae40078 P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:37.833207 31475 raft_consensus.cc:2468] T ee6c632286174388ab5e7bfb2ae40078 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 1.
I20260709 13:13:37.791222 31844 leader_election.cc:290] T ee6c632286174388ab5e7bfb2ae40078 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 election: Requested vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:37.767266 31627 raft_consensus.cc:2468] T 680d6e1f38f4469ebe14094aa66fdfac P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 1.
I20260709 13:13:37.834420 31771 consensus_queue.cc:1048] T fc35ae8230cf4ab792d0e15bcaf8b653 P 196d972917fe4f85985e3862d40b7596 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:37.835538 31480 raft_consensus.cc:2468] T 53c18818aa9c44c8987bb675a05026a4 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 1.
I20260709 13:13:37.836763 31668 leader_election.cc:304] T ee6c632286174388ab5e7bfb2ae40078 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca; no voters: 
I20260709 13:13:37.837369 31750 tablet_bootstrap.cc:492] T 6038006ca0e344af86fe5febd517c62a P 458d610e8abf4f2ea831ab7bf3576da6: No bootstrap required, opened a new log
I20260709 13:13:37.838230 31750 ts_tablet_manager.cc:1403] T 6038006ca0e344af86fe5febd517c62a P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.073s	user 0.007s	sys 0.005s
I20260709 13:13:37.838264 31817 leader_election.cc:290] T ee6c632286174388ab5e7bfb2ae40078 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 2 election: Requested vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:37.838908 31669 leader_election.cc:304] T 680d6e1f38f4469ebe14094aa66fdfac P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca, c74453754ee34bea9b231ae318a55a31; no voters: 196d972917fe4f85985e3862d40b7596
I20260709 13:13:37.840176 31844 raft_consensus.cc:2804] T 680d6e1f38f4469ebe14094aa66fdfac P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:37.840734 31749 tablet_bootstrap.cc:492] T fb4f7292ed2f489e922ca5fb1c6e47bf P 76fb155ade354ee1ba78673e73b28aca: No bootstrap required, opened a new log
I20260709 13:13:37.840912 31881 raft_consensus.cc:2804] T ee6c632286174388ab5e7bfb2ae40078 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:37.842221 31881 raft_consensus.cc:697] T ee6c632286174388ab5e7bfb2ae40078 P 76fb155ade354ee1ba78673e73b28aca [term 1 LEADER]: Becoming Leader. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Running, Role: LEADER
I20260709 13:13:37.842418 31749 ts_tablet_manager.cc:1403] T fb4f7292ed2f489e922ca5fb1c6e47bf P 76fb155ade354ee1ba78673e73b28aca: Time spent bootstrapping tablet: real 0.154s	user 0.008s	sys 0.010s
I20260709 13:13:37.843266 31881 consensus_queue.cc:237] T ee6c632286174388ab5e7bfb2ae40078 P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:37.846359 31703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6c632286174388ab5e7bfb2ae40078" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca"
I20260709 13:13:37.841226 31750 raft_consensus.cc:359] T 6038006ca0e344af86fe5febd517c62a P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:37.714449 31747 tablet_bootstrap.cc:492] T 680d6e1f38f4469ebe14094aa66fdfac P 196d972917fe4f85985e3862d40b7596: Bootstrap starting.
I20260709 13:13:37.848304 31378 catalog_manager.cc:5697] T 256a5c9a935246e0a6c36b5b654fbbfb P 196d972917fe4f85985e3862d40b7596 reported cstate change: term changed from 0 to 1, leader changed from <none> to 196d972917fe4f85985e3862d40b7596 (127.23.140.66). New cstate: current_term: 1 leader_uuid: "196d972917fe4f85985e3862d40b7596" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:37.847995 31750 raft_consensus.cc:385] T 6038006ca0e344af86fe5febd517c62a P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.855124 31750 raft_consensus.cc:740] T 6038006ca0e344af86fe5febd517c62a P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.856110 31750 consensus_queue.cc:260] T 6038006ca0e344af86fe5febd517c62a P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:37.858045 31749 raft_consensus.cc:359] T fb4f7292ed2f489e922ca5fb1c6e47bf P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:37.858747 31749 raft_consensus.cc:385] T fb4f7292ed2f489e922ca5fb1c6e47bf P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.859012 31749 raft_consensus.cc:740] T fb4f7292ed2f489e922ca5fb1c6e47bf P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.859087 31750 ts_tablet_manager.cc:1434] T 6038006ca0e344af86fe5febd517c62a P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.003s
I20260709 13:13:37.861317 31475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6c632286174388ab5e7bfb2ae40078" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
I20260709 13:13:37.859635 31749 consensus_queue.cc:260] T fb4f7292ed2f489e922ca5fb1c6e47bf P 76fb155ade354ee1ba78673e73b28aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:37.863010 31475 raft_consensus.cc:3060] T ee6c632286174388ab5e7bfb2ae40078 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:37.864450 31749 ts_tablet_manager.cc:1434] T fb4f7292ed2f489e922ca5fb1c6e47bf P 76fb155ade354ee1ba78673e73b28aca: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:13:37.870643 31749 tablet_bootstrap.cc:492] T 47cb0ae4817d4c19ac11b42143d00039 P 76fb155ade354ee1ba78673e73b28aca: Bootstrap starting.
I20260709 13:13:37.867849 31813 raft_consensus.cc:493] T fb4f7292ed2f489e922ca5fb1c6e47bf P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.874423 31813 raft_consensus.cc:515] T fb4f7292ed2f489e922ca5fb1c6e47bf P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:37.876485 31813 leader_election.cc:290] T fb4f7292ed2f489e922ca5fb1c6e47bf P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:37.878347 31552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4f7292ed2f489e922ca5fb1c6e47bf" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:37.879474 31844 raft_consensus.cc:697] T 680d6e1f38f4469ebe14094aa66fdfac P 76fb155ade354ee1ba78673e73b28aca [term 1 LEADER]: Becoming Leader. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Running, Role: LEADER
W20260709 13:13:37.879870 31666 leader_election.cc:343] T fb4f7292ed2f489e922ca5fb1c6e47bf P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:37.868474 31750 tablet_bootstrap.cc:492] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:37.880378 31844 consensus_queue.cc:237] T 680d6e1f38f4469ebe14094aa66fdfac P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:37.883549 31375 catalog_manager.cc:5697] T 53c18818aa9c44c8987bb675a05026a4 P c74453754ee34bea9b231ae318a55a31 reported cstate change: term changed from 0 to 1, leader changed from <none> to c74453754ee34bea9b231ae318a55a31 (127.23.140.67). New cstate: current_term: 1 leader_uuid: "c74453754ee34bea9b231ae318a55a31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:37.866995 31747 tablet_bootstrap.cc:654] T 680d6e1f38f4469ebe14094aa66fdfac P 196d972917fe4f85985e3862d40b7596: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.871419 31475 raft_consensus.cc:2468] T ee6c632286174388ab5e7bfb2ae40078 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 2.
I20260709 13:13:37.897867 31480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4f7292ed2f489e922ca5fb1c6e47bf" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:37.912845 31749 tablet_bootstrap.cc:654] T 47cb0ae4817d4c19ac11b42143d00039 P 76fb155ade354ee1ba78673e73b28aca: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.907296 31594 leader_election.cc:304] T ee6c632286174388ab5e7bfb2ae40078 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, c74453754ee34bea9b231ae318a55a31; no voters: 76fb155ade354ee1ba78673e73b28aca
I20260709 13:13:37.915638 31874 raft_consensus.cc:2804] T ee6c632286174388ab5e7bfb2ae40078 P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:37.916134 31874 raft_consensus.cc:697] T ee6c632286174388ab5e7bfb2ae40078 P c74453754ee34bea9b231ae318a55a31 [term 2 LEADER]: Becoming Leader. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Running, Role: LEADER
W20260709 13:13:37.902494 31668 leader_election.cc:343] T fb4f7292ed2f489e922ca5fb1c6e47bf P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:37.917250 31668 leader_election.cc:304] T fb4f7292ed2f489e922ca5fb1c6e47bf P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca; no voters: 196d972917fe4f85985e3862d40b7596, 458d610e8abf4f2ea831ab7bf3576da6
I20260709 13:13:37.916982 31874 consensus_queue.cc:237] T ee6c632286174388ab5e7bfb2ae40078 P c74453754ee34bea9b231ae318a55a31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:37.923367 31813 raft_consensus.cc:2749] T fb4f7292ed2f489e922ca5fb1c6e47bf P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:13:37.930873 31426 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:37.933280 31749 tablet_bootstrap.cc:492] T 47cb0ae4817d4c19ac11b42143d00039 P 76fb155ade354ee1ba78673e73b28aca: No bootstrap required, opened a new log
I20260709 13:13:37.933825 31749 ts_tablet_manager.cc:1403] T 47cb0ae4817d4c19ac11b42143d00039 P 76fb155ade354ee1ba78673e73b28aca: Time spent bootstrapping tablet: real 0.063s	user 0.009s	sys 0.005s
I20260709 13:13:37.941833 31748 tablet_bootstrap.cc:492] T 85d4a24725c749199c1b35d959b1b2b5 P c74453754ee34bea9b231ae318a55a31: No bootstrap required, opened a new log
I20260709 13:13:37.942371 31748 ts_tablet_manager.cc:1403] T 85d4a24725c749199c1b35d959b1b2b5 P c74453754ee34bea9b231ae318a55a31: Time spent bootstrapping tablet: real 0.166s	user 0.021s	sys 0.023s
I20260709 13:13:37.945039 31748 raft_consensus.cc:359] T 85d4a24725c749199c1b35d959b1b2b5 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:37.945711 31748 raft_consensus.cc:385] T 85d4a24725c749199c1b35d959b1b2b5 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.946066 31748 raft_consensus.cc:740] T 85d4a24725c749199c1b35d959b1b2b5 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.946835 31748 consensus_queue.cc:260] T 85d4a24725c749199c1b35d959b1b2b5 P c74453754ee34bea9b231ae318a55a31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:37.945469 31375 catalog_manager.cc:5697] T 85d4a24725c749199c1b35d959b1b2b5 P 458d610e8abf4f2ea831ab7bf3576da6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65). New cstate: current_term: 1 leader_uuid: "458d610e8abf4f2ea831ab7bf3576da6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:37.960234 31748 ts_tablet_manager.cc:1434] T 85d4a24725c749199c1b35d959b1b2b5 P c74453754ee34bea9b231ae318a55a31: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:13:37.961330 31748 tablet_bootstrap.cc:492] T 47cb0ae4817d4c19ac11b42143d00039 P c74453754ee34bea9b231ae318a55a31: Bootstrap starting.
I20260709 13:13:37.975414 31378 catalog_manager.cc:5697] T ee6c632286174388ab5e7bfb2ae40078 P 76fb155ade354ee1ba78673e73b28aca reported cstate change: term changed from 0 to 1, leader changed from <none> to 76fb155ade354ee1ba78673e73b28aca (127.23.140.68). New cstate: current_term: 1 leader_uuid: "76fb155ade354ee1ba78673e73b28aca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:37.985714 31748 tablet_bootstrap.cc:654] T 47cb0ae4817d4c19ac11b42143d00039 P c74453754ee34bea9b231ae318a55a31: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.996420 31749 raft_consensus.cc:359] T 47cb0ae4817d4c19ac11b42143d00039 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:37.986125 31750 tablet_bootstrap.cc:654] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 458d610e8abf4f2ea831ab7bf3576da6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.997220 31749 raft_consensus.cc:385] T 47cb0ae4817d4c19ac11b42143d00039 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.997566 31749 raft_consensus.cc:740] T 47cb0ae4817d4c19ac11b42143d00039 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.000983 31748 tablet_bootstrap.cc:492] T 47cb0ae4817d4c19ac11b42143d00039 P c74453754ee34bea9b231ae318a55a31: No bootstrap required, opened a new log
I20260709 13:13:38.000722 31377 catalog_manager.cc:5697] T ee6c632286174388ab5e7bfb2ae40078 P c74453754ee34bea9b231ae318a55a31 reported cstate change: term changed from 1 to 2, leader changed from 76fb155ade354ee1ba78673e73b28aca (127.23.140.68) to c74453754ee34bea9b231ae318a55a31 (127.23.140.67). New cstate: current_term: 2 leader_uuid: "c74453754ee34bea9b231ae318a55a31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:38.001578 31748 ts_tablet_manager.cc:1403] T 47cb0ae4817d4c19ac11b42143d00039 P c74453754ee34bea9b231ae318a55a31: Time spent bootstrapping tablet: real 0.041s	user 0.011s	sys 0.000s
I20260709 13:13:38.004294 31748 raft_consensus.cc:359] T 47cb0ae4817d4c19ac11b42143d00039 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:38.004978 31748 raft_consensus.cc:385] T 47cb0ae4817d4c19ac11b42143d00039 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.005271 31748 raft_consensus.cc:740] T 47cb0ae4817d4c19ac11b42143d00039 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.005924 31748 consensus_queue.cc:260] T 47cb0ae4817d4c19ac11b42143d00039 P c74453754ee34bea9b231ae318a55a31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:37.998279 31749 consensus_queue.cc:260] T 47cb0ae4817d4c19ac11b42143d00039 P 76fb155ade354ee1ba78673e73b28aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:38.018769 31749 ts_tablet_manager.cc:1434] T 47cb0ae4817d4c19ac11b42143d00039 P 76fb155ade354ee1ba78673e73b28aca: Time spent starting tablet: real 0.085s	user 0.007s	sys 0.000s
I20260709 13:13:38.019181 31747 tablet_bootstrap.cc:492] T 680d6e1f38f4469ebe14094aa66fdfac P 196d972917fe4f85985e3862d40b7596: No bootstrap required, opened a new log
I20260709 13:13:38.019791 31747 ts_tablet_manager.cc:1403] T 680d6e1f38f4469ebe14094aa66fdfac P 196d972917fe4f85985e3862d40b7596: Time spent bootstrapping tablet: real 0.306s	user 0.027s	sys 0.021s
I20260709 13:13:38.020579 31844 consensus_queue.cc:1048] T a35171dce2e34beeafe34f3e80f18a41 P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:38.022593 31553 raft_consensus.cc:3060] T a35171dce2e34beeafe34f3e80f18a41 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:38.022562 31747 raft_consensus.cc:359] T 680d6e1f38f4469ebe14094aa66fdfac P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:38.023425 31747 raft_consensus.cc:385] T 680d6e1f38f4469ebe14094aa66fdfac P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.023772 31747 raft_consensus.cc:740] T 680d6e1f38f4469ebe14094aa66fdfac P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 196d972917fe4f85985e3862d40b7596, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.024384 31747 consensus_queue.cc:260] T 680d6e1f38f4469ebe14094aa66fdfac P 196d972917fe4f85985e3862d40b7596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:38.026413 31747 ts_tablet_manager.cc:1434] T 680d6e1f38f4469ebe14094aa66fdfac P 196d972917fe4f85985e3862d40b7596: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:13:38.030258 31748 ts_tablet_manager.cc:1434] T 47cb0ae4817d4c19ac11b42143d00039 P c74453754ee34bea9b231ae318a55a31: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:13:38.031365 31748 tablet_bootstrap.cc:492] T 497217e9b47244fcb425c66935cb8a20 P c74453754ee34bea9b231ae318a55a31: Bootstrap starting.
I20260709 13:13:38.032915 31747 tablet_bootstrap.cc:492] T 36bf73ed3df141c889c046ad6902e304 P 196d972917fe4f85985e3862d40b7596: Bootstrap starting.
I20260709 13:13:38.034425 31378 catalog_manager.cc:5697] T 680d6e1f38f4469ebe14094aa66fdfac P 76fb155ade354ee1ba78673e73b28aca reported cstate change: term changed from 0 to 1, leader changed from <none> to 76fb155ade354ee1ba78673e73b28aca (127.23.140.68). New cstate: current_term: 1 leader_uuid: "76fb155ade354ee1ba78673e73b28aca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:38.034435 31844 consensus_queue.cc:1048] T 8c4f880f34664227ac8bd46378c9995f P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:13:38.039079 31920 consensus_queue.cc:1048] T 8c4f880f34664227ac8bd46378c9995f P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:38.039377 31747 tablet_bootstrap.cc:654] T 36bf73ed3df141c889c046ad6902e304 P 196d972917fe4f85985e3862d40b7596: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.040045 31749 tablet_bootstrap.cc:492] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 76fb155ade354ee1ba78673e73b28aca: Bootstrap starting.
I20260709 13:13:38.051175 31748 tablet_bootstrap.cc:654] T 497217e9b47244fcb425c66935cb8a20 P c74453754ee34bea9b231ae318a55a31: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.074103 31750 tablet_bootstrap.cc:492] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 458d610e8abf4f2ea831ab7bf3576da6: No bootstrap required, opened a new log
I20260709 13:13:38.074620 31750 ts_tablet_manager.cc:1403] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.207s	user 0.028s	sys 0.003s
I20260709 13:13:38.081455 31749 tablet_bootstrap.cc:654] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 76fb155ade354ee1ba78673e73b28aca: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:38.082194 31443 consensus_peers.cc:597] T 36bf73ed3df141c889c046ad6902e304 P 458d610e8abf4f2ea831ab7bf3576da6 -> Peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Couldn't send request to peer 196d972917fe4f85985e3862d40b7596. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:38.107911 31750 raft_consensus.cc:359] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:38.110662 31750 raft_consensus.cc:385] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.111827 31750 raft_consensus.cc:740] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.121598 31748 tablet_bootstrap.cc:492] T 497217e9b47244fcb425c66935cb8a20 P c74453754ee34bea9b231ae318a55a31: No bootstrap required, opened a new log
I20260709 13:13:38.122438 31748 ts_tablet_manager.cc:1403] T 497217e9b47244fcb425c66935cb8a20 P c74453754ee34bea9b231ae318a55a31: Time spent bootstrapping tablet: real 0.091s	user 0.028s	sys 0.033s
I20260709 13:13:38.126276 31748 raft_consensus.cc:359] T 497217e9b47244fcb425c66935cb8a20 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:38.128327 31748 raft_consensus.cc:385] T 497217e9b47244fcb425c66935cb8a20 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.128769 31748 raft_consensus.cc:740] T 497217e9b47244fcb425c66935cb8a20 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.148418 31750 consensus_queue.cc:260] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:38.152740 31750 ts_tablet_manager.cc:1434] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.078s	user 0.005s	sys 0.003s
I20260709 13:13:38.154060 31750 tablet_bootstrap.cc:492] T 47cb0ae4817d4c19ac11b42143d00039 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:38.162231 31748 consensus_queue.cc:260] T 497217e9b47244fcb425c66935cb8a20 P c74453754ee34bea9b231ae318a55a31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:38.161515 32009 raft_consensus.cc:493] T a35171dce2e34beeafe34f3e80f18a41 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.164952 31817 raft_consensus.cc:493] T 85d4a24725c749199c1b35d959b1b2b5 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.159938 31881 consensus_queue.cc:1048] T a35171dce2e34beeafe34f3e80f18a41 P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:13:38.169294 32009 raft_consensus.cc:515] T a35171dce2e34beeafe34f3e80f18a41 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:38.181159 32009 leader_election.cc:290] T a35171dce2e34beeafe34f3e80f18a41 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:38.169320 31817 raft_consensus.cc:515] T 85d4a24725c749199c1b35d959b1b2b5 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:38.184347 31703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35171dce2e34beeafe34f3e80f18a41" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:38.185322 31817 leader_election.cc:290] T 85d4a24725c749199c1b35d959b1b2b5 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:38.186069 31475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35171dce2e34beeafe34f3e80f18a41" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:38.189278 31748 ts_tablet_manager.cc:1434] T 497217e9b47244fcb425c66935cb8a20 P c74453754ee34bea9b231ae318a55a31: Time spent starting tablet: real 0.066s	user 0.006s	sys 0.001s
I20260709 13:13:38.189112 31477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85d4a24725c749199c1b35d959b1b2b5" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:38.191248 31747 tablet_bootstrap.cc:492] T 36bf73ed3df141c889c046ad6902e304 P 196d972917fe4f85985e3862d40b7596: No bootstrap required, opened a new log
I20260709 13:13:38.191726 31747 ts_tablet_manager.cc:1403] T 36bf73ed3df141c889c046ad6902e304 P 196d972917fe4f85985e3862d40b7596: Time spent bootstrapping tablet: real 0.159s	user 0.010s	sys 0.004s
I20260709 13:13:38.193038 31520 leader_election.cc:304] T a35171dce2e34beeafe34f3e80f18a41 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 196d972917fe4f85985e3862d40b7596; no voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca
I20260709 13:13:38.196137 31748 tablet_bootstrap.cc:492] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P c74453754ee34bea9b231ae318a55a31: Bootstrap starting.
I20260709 13:13:38.198357 31749 tablet_bootstrap.cc:492] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 76fb155ade354ee1ba78673e73b28aca: No bootstrap required, opened a new log
I20260709 13:13:38.198908 31749 ts_tablet_manager.cc:1403] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 76fb155ade354ee1ba78673e73b28aca: Time spent bootstrapping tablet: real 0.161s	user 0.028s	sys 0.024s
I20260709 13:13:38.198385 31747 raft_consensus.cc:359] T 36bf73ed3df141c889c046ad6902e304 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:38.213517 31749 raft_consensus.cc:359] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:38.201882 31702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85d4a24725c749199c1b35d959b1b2b5" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:38.214332 31749 raft_consensus.cc:385] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.214586 31842 raft_consensus.cc:493] T 6038006ca0e344af86fe5febd517c62a P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.214732 31702 raft_consensus.cc:2393] T 85d4a24725c749199c1b35d959b1b2b5 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c74453754ee34bea9b231ae318a55a31 in current term 1: Already voted for candidate 458d610e8abf4f2ea831ab7bf3576da6 in this term.
I20260709 13:13:38.211391 31990 consensus_queue.cc:1048] T 36bf73ed3df141c889c046ad6902e304 P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:38.215199 31842 raft_consensus.cc:515] T 6038006ca0e344af86fe5febd517c62a P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:38.214694 31749 raft_consensus.cc:740] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.216370 31749 consensus_queue.cc:260] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 76fb155ade354ee1ba78673e73b28aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:38.216801 31595 leader_election.cc:304] T 85d4a24725c749199c1b35d959b1b2b5 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c74453754ee34bea9b231ae318a55a31; no voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca
I20260709 13:13:38.217285 31842 leader_election.cc:290] T 6038006ca0e344af86fe5febd517c62a P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:38.218163 31874 raft_consensus.cc:3060] T 85d4a24725c749199c1b35d959b1b2b5 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:38.218463 31749 ts_tablet_manager.cc:1434] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 76fb155ade354ee1ba78673e73b28aca: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.004s
I20260709 13:13:38.213994 31747 raft_consensus.cc:385] T 36bf73ed3df141c889c046ad6902e304 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.206573 31748 tablet_bootstrap.cc:654] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P c74453754ee34bea9b231ae318a55a31: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.219735 31747 raft_consensus.cc:740] T 36bf73ed3df141c889c046ad6902e304 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 196d972917fe4f85985e3862d40b7596, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.221102 31804 consensus_queue.cc:1048] T 256a5c9a935246e0a6c36b5b654fbbfb P 196d972917fe4f85985e3862d40b7596 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:38.221782 31627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6038006ca0e344af86fe5febd517c62a" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:38.215632 31750 tablet_bootstrap.cc:654] T 47cb0ae4817d4c19ac11b42143d00039 P 458d610e8abf4f2ea831ab7bf3576da6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.222447 31804 consensus_queue.cc:1048] T 256a5c9a935246e0a6c36b5b654fbbfb P 196d972917fe4f85985e3862d40b7596 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:13:38.223181 31446 leader_election.cc:343] T 6038006ca0e344af86fe5febd517c62a P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:38.219458 31749 tablet_bootstrap.cc:492] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P 76fb155ade354ee1ba78673e73b28aca: Bootstrap starting.
I20260709 13:13:38.195139 32009 raft_consensus.cc:2749] T a35171dce2e34beeafe34f3e80f18a41 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:38.228394 31552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6038006ca0e344af86fe5febd517c62a" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
W20260709 13:13:38.230463 31443 leader_election.cc:343] T 6038006ca0e344af86fe5febd517c62a P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:38.230937 31443 leader_election.cc:304] T 6038006ca0e344af86fe5febd517c62a P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6; no voters: 196d972917fe4f85985e3862d40b7596, c74453754ee34bea9b231ae318a55a31
I20260709 13:13:38.232061 31990 raft_consensus.cc:2749] T 6038006ca0e344af86fe5febd517c62a P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:38.239010 31747 consensus_queue.cc:260] T 36bf73ed3df141c889c046ad6902e304 P 196d972917fe4f85985e3862d40b7596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:38.241230 31749 tablet_bootstrap.cc:654] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P 76fb155ade354ee1ba78673e73b28aca: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.241191 31747 ts_tablet_manager.cc:1434] T 36bf73ed3df141c889c046ad6902e304 P 196d972917fe4f85985e3862d40b7596: Time spent starting tablet: real 0.049s	user 0.005s	sys 0.001s
I20260709 13:13:38.263613 31747 tablet_bootstrap.cc:492] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P 196d972917fe4f85985e3862d40b7596: Bootstrap starting.
I20260709 13:13:38.260023 31874 raft_consensus.cc:2749] T 85d4a24725c749199c1b35d959b1b2b5 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:38.270936 31748 tablet_bootstrap.cc:492] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P c74453754ee34bea9b231ae318a55a31: No bootstrap required, opened a new log
I20260709 13:13:38.271497 31748 ts_tablet_manager.cc:1403] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P c74453754ee34bea9b231ae318a55a31: Time spent bootstrapping tablet: real 0.077s	user 0.014s	sys 0.007s
I20260709 13:13:38.306391 31480 raft_consensus.cc:1240] T ee6c632286174388ab5e7bfb2ae40078 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Rejecting Update request from peer 76fb155ade354ee1ba78673e73b28aca for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:38.308880 31844 consensus_queue.cc:1059] T ee6c632286174388ab5e7bfb2ae40078 P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:38.310587 31813 raft_consensus.cc:3055] T ee6c632286174388ab5e7bfb2ae40078 P 76fb155ade354ee1ba78673e73b28aca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:38.311067 31813 raft_consensus.cc:740] T ee6c632286174388ab5e7bfb2ae40078 P 76fb155ade354ee1ba78673e73b28aca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Running, Role: LEADER
I20260709 13:13:38.312211 31813 consensus_queue.cc:260] T ee6c632286174388ab5e7bfb2ae40078 P 76fb155ade354ee1ba78673e73b28aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:38.330453 31881 raft_consensus.cc:493] T 47cb0ae4817d4c19ac11b42143d00039 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.331139 31881 raft_consensus.cc:515] T 47cb0ae4817d4c19ac11b42143d00039 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:38.368728 31990 consensus_queue.cc:1048] T 85d4a24725c749199c1b35d959b1b2b5 P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:38.373538 31748 raft_consensus.cc:359] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:38.374404 31748 raft_consensus.cc:385] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.374720 31748 raft_consensus.cc:740] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.375202 31750 tablet_bootstrap.cc:492] T 47cb0ae4817d4c19ac11b42143d00039 P 458d610e8abf4f2ea831ab7bf3576da6: No bootstrap required, opened a new log
I20260709 13:13:38.373538 31813 raft_consensus.cc:3060] T ee6c632286174388ab5e7bfb2ae40078 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.375730 31750 ts_tablet_manager.cc:1403] T 47cb0ae4817d4c19ac11b42143d00039 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.222s	user 0.036s	sys 0.040s
I20260709 13:13:38.378067 31749 tablet_bootstrap.cc:492] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P 76fb155ade354ee1ba78673e73b28aca: No bootstrap required, opened a new log
I20260709 13:13:38.377991 31748 consensus_queue.cc:260] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P c74453754ee34bea9b231ae318a55a31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:38.382794 31749 ts_tablet_manager.cc:1403] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P 76fb155ade354ee1ba78673e73b28aca: Time spent bootstrapping tablet: real 0.164s	user 0.015s	sys 0.006s
I20260709 13:13:38.382936 31881 leader_election.cc:290] T 47cb0ae4817d4c19ac11b42143d00039 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:38.400821 31749 raft_consensus.cc:359] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:38.401496 31749 raft_consensus.cc:385] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.402101 31700 raft_consensus.cc:1275] T ee6c632286174388ab5e7bfb2ae40078 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Refusing update from remote peer c74453754ee34bea9b231ae318a55a31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 13:13:38.402456 31700 pending_rounds.cc:85] T ee6c632286174388ab5e7bfb2ae40078 P 76fb155ade354ee1ba78673e73b28aca: Aborting all ops after (but not including) 0
I20260709 13:13:38.402681 31700 pending_rounds.cc:107] T ee6c632286174388ab5e7bfb2ae40078 P 76fb155ade354ee1ba78673e73b28aca: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:13:38.402892 31700 raft_consensus.cc:2889] T ee6c632286174388ab5e7bfb2ae40078 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:38.403323 31627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47cb0ae4817d4c19ac11b42143d00039" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:38.404067 31627 raft_consensus.cc:2468] T 47cb0ae4817d4c19ac11b42143d00039 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 0.
I20260709 13:13:38.404832 31477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47cb0ae4817d4c19ac11b42143d00039" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:38.405241 31874 consensus_queue.cc:1048] T ee6c632286174388ab5e7bfb2ae40078 P c74453754ee34bea9b231ae318a55a31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:38.406917 31669 leader_election.cc:304] T 47cb0ae4817d4c19ac11b42143d00039 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca, c74453754ee34bea9b231ae318a55a31; no voters: 
I20260709 13:13:38.405480 31749 raft_consensus.cc:740] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.408267 31920 raft_consensus.cc:2804] T 47cb0ae4817d4c19ac11b42143d00039 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:38.408123 31749 consensus_queue.cc:260] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P 76fb155ade354ee1ba78673e73b28aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:38.408707 31920 raft_consensus.cc:493] T 47cb0ae4817d4c19ac11b42143d00039 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:38.409183 31920 raft_consensus.cc:3060] T 47cb0ae4817d4c19ac11b42143d00039 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:38.410593 31749 ts_tablet_manager.cc:1434] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P 76fb155ade354ee1ba78673e73b28aca: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 13:13:38.411886 31749 tablet_bootstrap.cc:492] T 0550046442d4469c96ad37cbbb191915 P 76fb155ade354ee1ba78673e73b28aca: Bootstrap starting.
I20260709 13:13:38.384994 31748 ts_tablet_manager.cc:1434] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P c74453754ee34bea9b231ae318a55a31: Time spent starting tablet: real 0.113s	user 0.008s	sys 0.010s
I20260709 13:13:38.418107 31748 tablet_bootstrap.cc:492] T 0550046442d4469c96ad37cbbb191915 P c74453754ee34bea9b231ae318a55a31: Bootstrap starting.
W20260709 13:13:38.368700 32034 log.cc:927] Time spent T 36bf73ed3df141c889c046ad6902e304 P 76fb155ade354ee1ba78673e73b28aca: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:13:38.387830 31750 raft_consensus.cc:359] T 47cb0ae4817d4c19ac11b42143d00039 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:38.420722 31750 raft_consensus.cc:385] T 47cb0ae4817d4c19ac11b42143d00039 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.420977 31750 raft_consensus.cc:740] T 47cb0ae4817d4c19ac11b42143d00039 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.421653 31750 consensus_queue.cc:260] T 47cb0ae4817d4c19ac11b42143d00039 P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:38.422881 31477 raft_consensus.cc:2468] T 47cb0ae4817d4c19ac11b42143d00039 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 0.
I20260709 13:13:38.428351 31750 ts_tablet_manager.cc:1434] T 47cb0ae4817d4c19ac11b42143d00039 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.000s
I20260709 13:13:38.429421 31750 tablet_bootstrap.cc:492] T 497217e9b47244fcb425c66935cb8a20 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:38.431804 31480 raft_consensus.cc:1275] T ee6c632286174388ab5e7bfb2ae40078 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Refusing update from remote peer c74453754ee34bea9b231ae318a55a31: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:13:38.393536 31747 tablet_bootstrap.cc:654] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P 196d972917fe4f85985e3862d40b7596: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.448012 31874 consensus_queue.cc:1048] T ee6c632286174388ab5e7bfb2ae40078 P c74453754ee34bea9b231ae318a55a31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:13:38.461172 31748 tablet_bootstrap.cc:654] T 0550046442d4469c96ad37cbbb191915 P c74453754ee34bea9b231ae318a55a31: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.464171 31817 consensus_queue.cc:1048] T 53c18818aa9c44c8987bb675a05026a4 P c74453754ee34bea9b231ae318a55a31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:38.485438 32009 raft_consensus.cc:493] T 36bf73ed3df141c889c046ad6902e304 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.486028 32009 raft_consensus.cc:515] T 36bf73ed3df141c889c046ad6902e304 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:38.488023 32009 leader_election.cc:290] T 36bf73ed3df141c889c046ad6902e304 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:38.489741 31804 raft_consensus.cc:493] T 680d6e1f38f4469ebe14094aa66fdfac P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.490232 31804 raft_consensus.cc:515] T 680d6e1f38f4469ebe14094aa66fdfac P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:38.490283 31475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bf73ed3df141c889c046ad6902e304" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:38.492228 31804 leader_election.cc:290] T 680d6e1f38f4469ebe14094aa66fdfac P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715)
I20260709 13:13:38.495916 32032 raft_consensus.cc:493] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.496237 31554 raft_consensus.cc:3060] T 680d6e1f38f4469ebe14094aa66fdfac P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:38.496446 32032 raft_consensus.cc:515] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:38.498936 32032 leader_election.cc:290] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:38.475773 31990 consensus_queue.cc:1048] T 85d4a24725c749199c1b35d959b1b2b5 P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:13:38.506820 31748 tablet_bootstrap.cc:492] T 0550046442d4469c96ad37cbbb191915 P c74453754ee34bea9b231ae318a55a31: No bootstrap required, opened a new log
I20260709 13:13:38.507886 31748 ts_tablet_manager.cc:1403] T 0550046442d4469c96ad37cbbb191915 P c74453754ee34bea9b231ae318a55a31: Time spent bootstrapping tablet: real 0.090s	user 0.023s	sys 0.023s
I20260709 13:13:38.515549 31628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee7f4cbe2594c5793b2cb27e1dd4b34" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:38.516258 31628 raft_consensus.cc:2468] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 0.
I20260709 13:13:38.518651 31669 leader_election.cc:304] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca, c74453754ee34bea9b231ae318a55a31; no voters: 
I20260709 13:13:38.527585 31701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680d6e1f38f4469ebe14094aa66fdfac" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:38.527877 31702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bf73ed3df141c889c046ad6902e304" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:38.521073 31813 raft_consensus.cc:2804] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:38.530009 31813 raft_consensus.cc:493] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:38.530424 31813 raft_consensus.cc:3060] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:38.530288 32033 consensus_queue.cc:1048] T 53c18818aa9c44c8987bb675a05026a4 P c74453754ee34bea9b231ae318a55a31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:38.534458 31920 raft_consensus.cc:515] T 47cb0ae4817d4c19ac11b42143d00039 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:38.536842 31920 leader_election.cc:290] T 47cb0ae4817d4c19ac11b42143d00039 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 election: Requested vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:38.537640 31555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee7f4cbe2594c5793b2cb27e1dd4b34" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:38.539248 31476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47cb0ae4817d4c19ac11b42143d00039" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
I20260709 13:13:38.539968 31476 raft_consensus.cc:3060] T 47cb0ae4817d4c19ac11b42143d00039 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:38.546265 31750 tablet_bootstrap.cc:654] T 497217e9b47244fcb425c66935cb8a20 P 458d610e8abf4f2ea831ab7bf3576da6: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:38.549621 31666 leader_election.cc:343] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:38.554173 31521 leader_election.cc:304] T 36bf73ed3df141c889c046ad6902e304 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 196d972917fe4f85985e3862d40b7596; no voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca
I20260709 13:13:38.555047 31804 raft_consensus.cc:2749] T 36bf73ed3df141c889c046ad6902e304 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:38.564224 31627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47cb0ae4817d4c19ac11b42143d00039" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31"
I20260709 13:13:38.564949 31627 raft_consensus.cc:3060] T 47cb0ae4817d4c19ac11b42143d00039 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:38.565091 31881 consensus_queue.cc:1048] T 680d6e1f38f4469ebe14094aa66fdfac P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:38.567019 31881 consensus_queue.cc:1048] T 680d6e1f38f4469ebe14094aa66fdfac P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:38.569159 31747 tablet_bootstrap.cc:492] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P 196d972917fe4f85985e3862d40b7596: No bootstrap required, opened a new log
I20260709 13:13:38.569795 31747 ts_tablet_manager.cc:1403] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P 196d972917fe4f85985e3862d40b7596: Time spent bootstrapping tablet: real 0.307s	user 0.013s	sys 0.006s
I20260709 13:13:38.571429 31626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680d6e1f38f4469ebe14094aa66fdfac" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:38.572350 31626 raft_consensus.cc:2393] T 680d6e1f38f4469ebe14094aa66fdfac P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 196d972917fe4f85985e3862d40b7596 in current term 1: Already voted for candidate 76fb155ade354ee1ba78673e73b28aca in this term.
I20260709 13:13:38.576547 31749 tablet_bootstrap.cc:654] T 0550046442d4469c96ad37cbbb191915 P 76fb155ade354ee1ba78673e73b28aca: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.577518 31521 leader_election.cc:304] T 680d6e1f38f4469ebe14094aa66fdfac P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 196d972917fe4f85985e3862d40b7596; no voters: 76fb155ade354ee1ba78673e73b28aca, c74453754ee34bea9b231ae318a55a31
I20260709 13:13:38.586174 31748 raft_consensus.cc:359] T 0550046442d4469c96ad37cbbb191915 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:38.588292 31748 raft_consensus.cc:385] T 0550046442d4469c96ad37cbbb191915 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.588740 31748 raft_consensus.cc:740] T 0550046442d4469c96ad37cbbb191915 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.589974 31748 consensus_queue.cc:260] T 0550046442d4469c96ad37cbbb191915 P c74453754ee34bea9b231ae318a55a31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:38.567318 31813 raft_consensus.cc:515] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:38.590898 31804 raft_consensus.cc:2749] T 680d6e1f38f4469ebe14094aa66fdfac P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:38.599725 31813 leader_election.cc:290] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 election: Requested vote from peers 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:38.601257 32033 raft_consensus.cc:493] T 0550046442d4469c96ad37cbbb191915 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.601739 32033 raft_consensus.cc:515] T 0550046442d4469c96ad37cbbb191915 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:38.603806 32033 leader_election.cc:290] T 0550046442d4469c96ad37cbbb191915 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431), 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715)
I20260709 13:13:38.605681 31699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0550046442d4469c96ad37cbbb191915" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:38.606068 31552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee7f4cbe2594c5793b2cb27e1dd4b34" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596"
I20260709 13:13:38.608741 31476 raft_consensus.cc:2468] T 47cb0ae4817d4c19ac11b42143d00039 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 1.
I20260709 13:13:38.611675 31748 ts_tablet_manager.cc:1434] T 0550046442d4469c96ad37cbbb191915 P c74453754ee34bea9b231ae318a55a31: Time spent starting tablet: real 0.104s	user 0.007s	sys 0.000s
I20260709 13:13:38.611748 31668 leader_election.cc:304] T 47cb0ae4817d4c19ac11b42143d00039 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca; no voters: 
I20260709 13:13:38.612298 31627 raft_consensus.cc:2468] T 47cb0ae4817d4c19ac11b42143d00039 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 1.
I20260709 13:13:38.612828 31748 tablet_bootstrap.cc:492] T 6038006ca0e344af86fe5febd517c62a P c74453754ee34bea9b231ae318a55a31: Bootstrap starting.
I20260709 13:13:38.614775 31555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0550046442d4469c96ad37cbbb191915" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:38.616513 31553 raft_consensus.cc:3060] T 36bf73ed3df141c889c046ad6902e304 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:38.617674 31595 leader_election.cc:343] T 0550046442d4469c96ad37cbbb191915 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:38.618558 31759 raft_consensus.cc:493] T 497217e9b47244fcb425c66935cb8a20 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.619056 31759 raft_consensus.cc:515] T 497217e9b47244fcb425c66935cb8a20 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:38.619825 31920 raft_consensus.cc:2804] T 47cb0ae4817d4c19ac11b42143d00039 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:38.620327 31920 raft_consensus.cc:697] T 47cb0ae4817d4c19ac11b42143d00039 P 76fb155ade354ee1ba78673e73b28aca [term 1 LEADER]: Becoming Leader. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Running, Role: LEADER
I20260709 13:13:38.621022 31759 leader_election.cc:290] T 497217e9b47244fcb425c66935cb8a20 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:38.621443 31748 tablet_bootstrap.cc:654] T 6038006ca0e344af86fe5febd517c62a P c74453754ee34bea9b231ae318a55a31: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.626012 32032 raft_consensus.cc:493] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.626514 32032 raft_consensus.cc:515] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:38.621143 31920 consensus_queue.cc:237] T 47cb0ae4817d4c19ac11b42143d00039 P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:38.629019 31628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee7f4cbe2594c5793b2cb27e1dd4b34" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31"
I20260709 13:13:38.629571 31842 raft_consensus.cc:493] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.629657 31628 raft_consensus.cc:3060] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:38.630194 31842 raft_consensus.cc:515] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:38.632267 31842 leader_election.cc:290] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:38.633250 32032 leader_election.cc:290] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:38.633472 31555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf0c159a4f34a2abd10a0f7c60b5fbf" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:38.634655 31699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf0c159a4f34a2abd10a0f7c60b5fbf" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:38.635113 31477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf0c159a4f34a2abd10a0f7c60b5fbf" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:38.636893 31699 raft_consensus.cc:2468] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 0.
W20260709 13:13:38.637688 31666 leader_election.cc:343] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:38.638407 31446 leader_election.cc:304] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca; no voters: 
I20260709 13:13:38.639612 31477 raft_consensus.cc:2468] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 0.
I20260709 13:13:38.640142 31990 raft_consensus.cc:2804] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:38.640493 31990 raft_consensus.cc:493] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:38.640563 31554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf0c159a4f34a2abd10a0f7c60b5fbf" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:38.640898 31990 raft_consensus.cc:3060] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:38.642025 31443 leader_election.cc:343] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:38.643061 31592 leader_election.cc:343] T 0550046442d4469c96ad37cbbb191915 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:38.643530 31592 leader_election.cc:304] T 0550046442d4469c96ad37cbbb191915 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c74453754ee34bea9b231ae318a55a31; no voters: 196d972917fe4f85985e3862d40b7596, 76fb155ade354ee1ba78673e73b28aca
I20260709 13:13:38.645669 31554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497217e9b47244fcb425c66935cb8a20" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:38.646816 31668 leader_election.cc:304] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca; no voters: 196d972917fe4f85985e3862d40b7596
I20260709 13:13:38.648501 31857 raft_consensus.cc:2749] T 0550046442d4469c96ad37cbbb191915 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:13:38.649302 31592 leader_election.cc:343] T 497217e9b47244fcb425c66935cb8a20 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:38.650156 31881 raft_consensus.cc:2804] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:38.650604 31881 raft_consensus.cc:493] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:38.650957 31881 raft_consensus.cc:3060] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:38.650332 31480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497217e9b47244fcb425c66935cb8a20" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:38.597182 31747 raft_consensus.cc:359] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
W20260709 13:13:38.654353 31594 leader_election.cc:343] T 497217e9b47244fcb425c66935cb8a20 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:38.654685 31747 raft_consensus.cc:385] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.654999 31747 raft_consensus.cc:740] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 196d972917fe4f85985e3862d40b7596, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.654968 31594 leader_election.cc:304] T 497217e9b47244fcb425c66935cb8a20 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c74453754ee34bea9b231ae318a55a31; no voters: 196d972917fe4f85985e3862d40b7596, 458d610e8abf4f2ea831ab7bf3576da6
I20260709 13:13:38.655894 31747 consensus_queue.cc:260] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P 196d972917fe4f85985e3862d40b7596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:38.656734 31552 raft_consensus.cc:3060] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:38.657742 31874 raft_consensus.cc:2749] T 497217e9b47244fcb425c66935cb8a20 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:38.663851 31552 raft_consensus.cc:2468] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 1.
I20260709 13:13:38.664433 31990 raft_consensus.cc:515] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:38.665619 31666 leader_election.cc:304] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, 76fb155ade354ee1ba78673e73b28aca; no voters: 
I20260709 13:13:38.666512 31813 raft_consensus.cc:2804] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:38.667074 31813 raft_consensus.cc:697] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P 76fb155ade354ee1ba78673e73b28aca [term 1 LEADER]: Becoming Leader. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Running, Role: LEADER
I20260709 13:13:38.667155 31699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf0c159a4f34a2abd10a0f7c60b5fbf" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca"
I20260709 13:13:38.667845 31881 raft_consensus.cc:515] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:38.668277 31990 leader_election.cc:290] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 election: Requested vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:38.667972 31813 consensus_queue.cc:237] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:38.670782 31699 raft_consensus.cc:2393] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 458d610e8abf4f2ea831ab7bf3576da6 in current term 1: Already voted for candidate 76fb155ade354ee1ba78673e73b28aca in this term.
I20260709 13:13:38.672960 31748 tablet_bootstrap.cc:492] T 6038006ca0e344af86fe5febd517c62a P c74453754ee34bea9b231ae318a55a31: No bootstrap required, opened a new log
I20260709 13:13:38.673439 31748 ts_tablet_manager.cc:1403] T 6038006ca0e344af86fe5febd517c62a P c74453754ee34bea9b231ae318a55a31: Time spent bootstrapping tablet: real 0.061s	user 0.023s	sys 0.000s
I20260709 13:13:38.676026 31748 raft_consensus.cc:359] T 6038006ca0e344af86fe5febd517c62a P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:38.676481 31750 tablet_bootstrap.cc:492] T 497217e9b47244fcb425c66935cb8a20 P 458d610e8abf4f2ea831ab7bf3576da6: No bootstrap required, opened a new log
I20260709 13:13:38.676697 31748 raft_consensus.cc:385] T 6038006ca0e344af86fe5febd517c62a P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.677014 31750 ts_tablet_manager.cc:1403] T 497217e9b47244fcb425c66935cb8a20 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.248s	user 0.014s	sys 0.013s
I20260709 13:13:38.677059 31748 raft_consensus.cc:740] T 6038006ca0e344af86fe5febd517c62a P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.681777 31750 raft_consensus.cc:359] T 497217e9b47244fcb425c66935cb8a20 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:38.681977 31748 consensus_queue.cc:260] T 6038006ca0e344af86fe5febd517c62a P c74453754ee34bea9b231ae318a55a31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:38.684317 31552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf0c159a4f34a2abd10a0f7c60b5fbf" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596"
I20260709 13:13:38.682451 31750 raft_consensus.cc:385] T 497217e9b47244fcb425c66935cb8a20 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.687749 31748 ts_tablet_manager.cc:1434] T 6038006ca0e344af86fe5febd517c62a P c74453754ee34bea9b231ae318a55a31: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:13:38.691313 31747 ts_tablet_manager.cc:1434] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P 196d972917fe4f85985e3862d40b7596: Time spent starting tablet: real 0.121s	user 0.007s	sys 0.000s
I20260709 13:13:38.690847 31750 raft_consensus.cc:740] T 497217e9b47244fcb425c66935cb8a20 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.697501 31748 tablet_bootstrap.cc:492] T 88b0a29c38284391bdaea82edf99c771 P c74453754ee34bea9b231ae318a55a31: Bootstrap starting.
I20260709 13:13:38.702155 31554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf0c159a4f34a2abd10a0f7c60b5fbf" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596"
I20260709 13:13:38.703261 31476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf0c159a4f34a2abd10a0f7c60b5fbf" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
I20260709 13:13:38.694813 31376 catalog_manager.cc:5697] T 47cb0ae4817d4c19ac11b42143d00039 P 76fb155ade354ee1ba78673e73b28aca reported cstate change: term changed from 0 to 1, leader changed from <none> to 76fb155ade354ee1ba78673e73b28aca (127.23.140.68). New cstate: current_term: 1 leader_uuid: "76fb155ade354ee1ba78673e73b28aca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:38.704036 31476 raft_consensus.cc:2393] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 76fb155ade354ee1ba78673e73b28aca in current term 1: Already voted for candidate 458d610e8abf4f2ea831ab7bf3576da6 in this term.
W20260709 13:13:38.704553 31666 leader_election.cc:343] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:38.705605 31668 leader_election.cc:304] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca; no voters: 196d972917fe4f85985e3862d40b7596, 458d610e8abf4f2ea831ab7bf3576da6
I20260709 13:13:38.698000 31881 leader_election.cc:290] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 election: Requested vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
W20260709 13:13:38.706799 31443 leader_election.cc:343] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:38.707257 31750 consensus_queue.cc:260] T 497217e9b47244fcb425c66935cb8a20 P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:38.707582 31443 leader_election.cc:304] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6; no voters: 196d972917fe4f85985e3862d40b7596, 76fb155ade354ee1ba78673e73b28aca
I20260709 13:13:38.708606 31990 raft_consensus.cc:2749] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:38.706905 32032 raft_consensus.cc:2749] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:38.710685 31750 ts_tablet_manager.cc:1434] T 497217e9b47244fcb425c66935cb8a20 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 13:13:38.712042 31750 tablet_bootstrap.cc:492] T fb4f7292ed2f489e922ca5fb1c6e47bf P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:38.663887 31628 raft_consensus.cc:2468] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 1.
I20260709 13:13:38.704030 31748 tablet_bootstrap.cc:654] T 88b0a29c38284391bdaea82edf99c771 P c74453754ee34bea9b231ae318a55a31: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.718111 31747 tablet_bootstrap.cc:492] T 497217e9b47244fcb425c66935cb8a20 P 196d972917fe4f85985e3862d40b7596: Bootstrap starting.
I20260709 13:13:38.724916 31750 tablet_bootstrap.cc:654] T fb4f7292ed2f489e922ca5fb1c6e47bf P 458d610e8abf4f2ea831ab7bf3576da6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.732883 31747 tablet_bootstrap.cc:654] T 497217e9b47244fcb425c66935cb8a20 P 196d972917fe4f85985e3862d40b7596: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.740314 31749 tablet_bootstrap.cc:492] T 0550046442d4469c96ad37cbbb191915 P 76fb155ade354ee1ba78673e73b28aca: No bootstrap required, opened a new log
I20260709 13:13:38.741029 31749 ts_tablet_manager.cc:1403] T 0550046442d4469c96ad37cbbb191915 P 76fb155ade354ee1ba78673e73b28aca: Time spent bootstrapping tablet: real 0.329s	user 0.018s	sys 0.018s
I20260709 13:13:38.746104 31749 raft_consensus.cc:359] T 0550046442d4469c96ad37cbbb191915 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:38.751879 31749 raft_consensus.cc:385] T 0550046442d4469c96ad37cbbb191915 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.752202 31749 raft_consensus.cc:740] T 0550046442d4469c96ad37cbbb191915 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.752355 31748 tablet_bootstrap.cc:492] T 88b0a29c38284391bdaea82edf99c771 P c74453754ee34bea9b231ae318a55a31: No bootstrap required, opened a new log
I20260709 13:13:38.752882 31748 ts_tablet_manager.cc:1403] T 88b0a29c38284391bdaea82edf99c771 P c74453754ee34bea9b231ae318a55a31: Time spent bootstrapping tablet: real 0.056s	user 0.015s	sys 0.005s
I20260709 13:13:38.753163 31749 consensus_queue.cc:260] T 0550046442d4469c96ad37cbbb191915 P 76fb155ade354ee1ba78673e73b28aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:38.755815 31748 raft_consensus.cc:359] T 88b0a29c38284391bdaea82edf99c771 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:38.756311 31749 ts_tablet_manager.cc:1434] T 0550046442d4469c96ad37cbbb191915 P 76fb155ade354ee1ba78673e73b28aca: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:13:38.756515 31748 raft_consensus.cc:385] T 88b0a29c38284391bdaea82edf99c771 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.756827 31748 raft_consensus.cc:740] T 88b0a29c38284391bdaea82edf99c771 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.757591 31748 consensus_queue.cc:260] T 88b0a29c38284391bdaea82edf99c771 P c74453754ee34bea9b231ae318a55a31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:38.757577 31749 tablet_bootstrap.cc:492] T 22ba83039f2d4e2c9089947b949a1790 P 76fb155ade354ee1ba78673e73b28aca: Bootstrap starting.
I20260709 13:13:38.760176 31748 ts_tablet_manager.cc:1434] T 88b0a29c38284391bdaea82edf99c771 P c74453754ee34bea9b231ae318a55a31: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:13:38.761101 31748 tablet_bootstrap.cc:492] T fb97ca15f56b46dd846db7b0ff156a32 P c74453754ee34bea9b231ae318a55a31: Bootstrap starting.
I20260709 13:13:38.765693 31749 tablet_bootstrap.cc:654] T 22ba83039f2d4e2c9089947b949a1790 P 76fb155ade354ee1ba78673e73b28aca: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.766709 31748 tablet_bootstrap.cc:654] T fb97ca15f56b46dd846db7b0ff156a32 P c74453754ee34bea9b231ae318a55a31: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.770620 31750 tablet_bootstrap.cc:492] T fb4f7292ed2f489e922ca5fb1c6e47bf P 458d610e8abf4f2ea831ab7bf3576da6: No bootstrap required, opened a new log
I20260709 13:13:38.771275 31750 ts_tablet_manager.cc:1403] T fb4f7292ed2f489e922ca5fb1c6e47bf P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.059s	user 0.012s	sys 0.011s
I20260709 13:13:38.777907 31749 tablet_bootstrap.cc:492] T 22ba83039f2d4e2c9089947b949a1790 P 76fb155ade354ee1ba78673e73b28aca: No bootstrap required, opened a new log
I20260709 13:13:38.778491 31749 ts_tablet_manager.cc:1403] T 22ba83039f2d4e2c9089947b949a1790 P 76fb155ade354ee1ba78673e73b28aca: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.008s
I20260709 13:13:38.778293 31750 raft_consensus.cc:359] T fb4f7292ed2f489e922ca5fb1c6e47bf P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:38.778975 31750 raft_consensus.cc:385] T fb4f7292ed2f489e922ca5fb1c6e47bf P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.779291 31750 raft_consensus.cc:740] T fb4f7292ed2f489e922ca5fb1c6e47bf P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.779449 31747 tablet_bootstrap.cc:492] T 497217e9b47244fcb425c66935cb8a20 P 196d972917fe4f85985e3862d40b7596: No bootstrap required, opened a new log
I20260709 13:13:38.780061 31747 ts_tablet_manager.cc:1403] T 497217e9b47244fcb425c66935cb8a20 P 196d972917fe4f85985e3862d40b7596: Time spent bootstrapping tablet: real 0.062s	user 0.016s	sys 0.015s
I20260709 13:13:38.779973 31750 consensus_queue.cc:260] T fb4f7292ed2f489e922ca5fb1c6e47bf P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:38.782357 31750 ts_tablet_manager.cc:1434] T fb4f7292ed2f489e922ca5fb1c6e47bf P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:13:38.783440 31750 tablet_bootstrap.cc:492] T b262a50e82034c57a4bfb7da683ff5d1 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:38.783975 31749 raft_consensus.cc:359] T 22ba83039f2d4e2c9089947b949a1790 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:38.784281 31747 raft_consensus.cc:359] T 497217e9b47244fcb425c66935cb8a20 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:38.784991 31747 raft_consensus.cc:385] T 497217e9b47244fcb425c66935cb8a20 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.784722 31749 raft_consensus.cc:385] T 22ba83039f2d4e2c9089947b949a1790 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.785267 31747 raft_consensus.cc:740] T 497217e9b47244fcb425c66935cb8a20 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 196d972917fe4f85985e3862d40b7596, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.785678 31749 raft_consensus.cc:740] T 22ba83039f2d4e2c9089947b949a1790 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.786559 31749 consensus_queue.cc:260] T 22ba83039f2d4e2c9089947b949a1790 P 76fb155ade354ee1ba78673e73b28aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:38.788945 31749 ts_tablet_manager.cc:1434] T 22ba83039f2d4e2c9089947b949a1790 P 76fb155ade354ee1ba78673e73b28aca: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:13:38.789893 31920 raft_consensus.cc:493] T 22ba83039f2d4e2c9089947b949a1790 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.789669 31747 consensus_queue.cc:260] T 497217e9b47244fcb425c66935cb8a20 P 196d972917fe4f85985e3862d40b7596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:38.790386 31920 raft_consensus.cc:515] T 22ba83039f2d4e2c9089947b949a1790 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:38.792949 31747 ts_tablet_manager.cc:1434] T 497217e9b47244fcb425c66935cb8a20 P 196d972917fe4f85985e3862d40b7596: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:13:38.794018 31747 tablet_bootstrap.cc:492] T 6038006ca0e344af86fe5febd517c62a P 196d972917fe4f85985e3862d40b7596: Bootstrap starting.
I20260709 13:13:38.789626 31750 tablet_bootstrap.cc:654] T b262a50e82034c57a4bfb7da683ff5d1 P 458d610e8abf4f2ea831ab7bf3576da6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.794747 31628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba83039f2d4e2c9089947b949a1790" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:38.796407 31476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba83039f2d4e2c9089947b949a1790" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:38.797066 31920 leader_election.cc:290] T 22ba83039f2d4e2c9089947b949a1790 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:38.803711 31749 tablet_bootstrap.cc:492] T b262a50e82034c57a4bfb7da683ff5d1 P 76fb155ade354ee1ba78673e73b28aca: Bootstrap starting.
I20260709 13:13:38.806239 31748 tablet_bootstrap.cc:492] T fb97ca15f56b46dd846db7b0ff156a32 P c74453754ee34bea9b231ae318a55a31: No bootstrap required, opened a new log
I20260709 13:13:38.806814 31748 ts_tablet_manager.cc:1403] T fb97ca15f56b46dd846db7b0ff156a32 P c74453754ee34bea9b231ae318a55a31: Time spent bootstrapping tablet: real 0.046s	user 0.013s	sys 0.004s
I20260709 13:13:38.809633 31748 raft_consensus.cc:359] T fb97ca15f56b46dd846db7b0ff156a32 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
W20260709 13:13:38.796783 31669 leader_election.cc:343] T 22ba83039f2d4e2c9089947b949a1790 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:38.810915 31748 raft_consensus.cc:385] T fb97ca15f56b46dd846db7b0ff156a32 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.810153 31749 tablet_bootstrap.cc:654] T b262a50e82034c57a4bfb7da683ff5d1 P 76fb155ade354ee1ba78673e73b28aca: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:38.811215 31668 leader_election.cc:343] T 22ba83039f2d4e2c9089947b949a1790 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:38.803661 31750 tablet_bootstrap.cc:492] T b262a50e82034c57a4bfb7da683ff5d1 P 458d610e8abf4f2ea831ab7bf3576da6: No bootstrap required, opened a new log
I20260709 13:13:38.812052 31750 ts_tablet_manager.cc:1403] T b262a50e82034c57a4bfb7da683ff5d1 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.001s
I20260709 13:13:38.800055 31747 tablet_bootstrap.cc:654] T 6038006ca0e344af86fe5febd517c62a P 196d972917fe4f85985e3862d40b7596: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.813228 31668 leader_election.cc:304] T 22ba83039f2d4e2c9089947b949a1790 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca; no voters: 458d610e8abf4f2ea831ab7bf3576da6, c74453754ee34bea9b231ae318a55a31
I20260709 13:13:38.814929 31750 raft_consensus.cc:359] T b262a50e82034c57a4bfb7da683ff5d1 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:38.818148 31750 raft_consensus.cc:385] T b262a50e82034c57a4bfb7da683ff5d1 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.818481 31750 raft_consensus.cc:740] T b262a50e82034c57a4bfb7da683ff5d1 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.820333 31920 raft_consensus.cc:2749] T 22ba83039f2d4e2c9089947b949a1790 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:38.811249 31748 raft_consensus.cc:740] T fb97ca15f56b46dd846db7b0ff156a32 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.824222 31749 tablet_bootstrap.cc:492] T b262a50e82034c57a4bfb7da683ff5d1 P 76fb155ade354ee1ba78673e73b28aca: No bootstrap required, opened a new log
I20260709 13:13:38.824681 31749 ts_tablet_manager.cc:1403] T b262a50e82034c57a4bfb7da683ff5d1 P 76fb155ade354ee1ba78673e73b28aca: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.001s
I20260709 13:13:38.825729 31748 consensus_queue.cc:260] T fb97ca15f56b46dd846db7b0ff156a32 P c74453754ee34bea9b231ae318a55a31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:38.827245 31749 raft_consensus.cc:359] T b262a50e82034c57a4bfb7da683ff5d1 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:38.827903 31749 raft_consensus.cc:385] T b262a50e82034c57a4bfb7da683ff5d1 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.828022 31748 ts_tablet_manager.cc:1434] T fb97ca15f56b46dd846db7b0ff156a32 P c74453754ee34bea9b231ae318a55a31: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.000s
I20260709 13:13:38.828171 31749 raft_consensus.cc:740] T b262a50e82034c57a4bfb7da683ff5d1 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.829138 31748 tablet_bootstrap.cc:492] T 0c12bd32cd944ce99a18fc4f9617961e P c74453754ee34bea9b231ae318a55a31: Bootstrap starting.
I20260709 13:13:38.828899 31749 consensus_queue.cc:260] T b262a50e82034c57a4bfb7da683ff5d1 P 76fb155ade354ee1ba78673e73b28aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:38.831080 31749 ts_tablet_manager.cc:1434] T b262a50e82034c57a4bfb7da683ff5d1 P 76fb155ade354ee1ba78673e73b28aca: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 13:13:38.832005 31749 tablet_bootstrap.cc:492] T 8a98dff441f1479992f85708c9f03283 P 76fb155ade354ee1ba78673e73b28aca: Bootstrap starting.
I20260709 13:13:38.823143 31750 consensus_queue.cc:260] T b262a50e82034c57a4bfb7da683ff5d1 P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:38.834681 31750 ts_tablet_manager.cc:1434] T b262a50e82034c57a4bfb7da683ff5d1 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:13:38.835740 31750 tablet_bootstrap.cc:492] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:38.837553 31749 tablet_bootstrap.cc:654] T 8a98dff441f1479992f85708c9f03283 P 76fb155ade354ee1ba78673e73b28aca: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.840842 31748 tablet_bootstrap.cc:654] T 0c12bd32cd944ce99a18fc4f9617961e P c74453754ee34bea9b231ae318a55a31: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.843438 31750 tablet_bootstrap.cc:654] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 458d610e8abf4f2ea831ab7bf3576da6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.850349 31749 tablet_bootstrap.cc:492] T 8a98dff441f1479992f85708c9f03283 P 76fb155ade354ee1ba78673e73b28aca: No bootstrap required, opened a new log
I20260709 13:13:38.850952 31749 ts_tablet_manager.cc:1403] T 8a98dff441f1479992f85708c9f03283 P 76fb155ade354ee1ba78673e73b28aca: Time spent bootstrapping tablet: real 0.019s	user 0.004s	sys 0.013s
I20260709 13:13:38.854300 31750 tablet_bootstrap.cc:492] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 458d610e8abf4f2ea831ab7bf3576da6: No bootstrap required, opened a new log
I20260709 13:13:38.853884 31749 raft_consensus.cc:359] T 8a98dff441f1479992f85708c9f03283 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:38.854774 31749 raft_consensus.cc:385] T 8a98dff441f1479992f85708c9f03283 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.854892 31750 ts_tablet_manager.cc:1403] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.001s
I20260709 13:13:38.855082 31749 raft_consensus.cc:740] T 8a98dff441f1479992f85708c9f03283 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.856472 31749 consensus_queue.cc:260] T 8a98dff441f1479992f85708c9f03283 P 76fb155ade354ee1ba78673e73b28aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:38.858124 31750 raft_consensus.cc:359] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:38.858820 31750 raft_consensus.cc:385] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.859114 31750 raft_consensus.cc:740] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.859920 31750 consensus_queue.cc:260] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:38.860353 31748 tablet_bootstrap.cc:492] T 0c12bd32cd944ce99a18fc4f9617961e P c74453754ee34bea9b231ae318a55a31: No bootstrap required, opened a new log
I20260709 13:13:38.861088 31748 ts_tablet_manager.cc:1403] T 0c12bd32cd944ce99a18fc4f9617961e P c74453754ee34bea9b231ae318a55a31: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.000s
I20260709 13:13:38.862016 31749 ts_tablet_manager.cc:1434] T 8a98dff441f1479992f85708c9f03283 P 76fb155ade354ee1ba78673e73b28aca: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.003s
I20260709 13:13:38.863045 31749 tablet_bootstrap.cc:492] T fb97ca15f56b46dd846db7b0ff156a32 P 76fb155ade354ee1ba78673e73b28aca: Bootstrap starting.
I20260709 13:13:38.864144 31748 raft_consensus.cc:359] T 0c12bd32cd944ce99a18fc4f9617961e P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:38.866699 31748 raft_consensus.cc:385] T 0c12bd32cd944ce99a18fc4f9617961e P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.867041 31748 raft_consensus.cc:740] T 0c12bd32cd944ce99a18fc4f9617961e P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.867781 31748 consensus_queue.cc:260] T 0c12bd32cd944ce99a18fc4f9617961e P c74453754ee34bea9b231ae318a55a31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:38.866321 31750 ts_tablet_manager.cc:1434] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:13:38.869227 31749 tablet_bootstrap.cc:654] T fb97ca15f56b46dd846db7b0ff156a32 P 76fb155ade354ee1ba78673e73b28aca: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.870060 31750 tablet_bootstrap.cc:492] T 88b0a29c38284391bdaea82edf99c771 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:38.871948 31748 ts_tablet_manager.cc:1434] T 0c12bd32cd944ce99a18fc4f9617961e P c74453754ee34bea9b231ae318a55a31: Time spent starting tablet: real 0.011s	user 0.001s	sys 0.004s
I20260709 13:13:38.878703 31748 tablet_bootstrap.cc:492] T 1fb28788823d4c5fab527f4ee2da4d2e P c74453754ee34bea9b231ae318a55a31: Bootstrap starting.
I20260709 13:13:38.875701 31378 catalog_manager.cc:5697] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P 76fb155ade354ee1ba78673e73b28aca reported cstate change: term changed from 0 to 1, leader changed from <none> to 76fb155ade354ee1ba78673e73b28aca (127.23.140.68). New cstate: current_term: 1 leader_uuid: "76fb155ade354ee1ba78673e73b28aca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:38.890894 31750 tablet_bootstrap.cc:654] T 88b0a29c38284391bdaea82edf99c771 P 458d610e8abf4f2ea831ab7bf3576da6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.895138 31748 tablet_bootstrap.cc:654] T 1fb28788823d4c5fab527f4ee2da4d2e P c74453754ee34bea9b231ae318a55a31: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.903605 31750 tablet_bootstrap.cc:492] T 88b0a29c38284391bdaea82edf99c771 P 458d610e8abf4f2ea831ab7bf3576da6: No bootstrap required, opened a new log
I20260709 13:13:38.904157 31750 ts_tablet_manager.cc:1403] T 88b0a29c38284391bdaea82edf99c771 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.002s
I20260709 13:13:38.907083 31750 raft_consensus.cc:359] T 88b0a29c38284391bdaea82edf99c771 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:38.908288 31750 raft_consensus.cc:385] T 88b0a29c38284391bdaea82edf99c771 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.908582 31750 raft_consensus.cc:740] T 88b0a29c38284391bdaea82edf99c771 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.909582 31750 consensus_queue.cc:260] T 88b0a29c38284391bdaea82edf99c771 P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:38.913422 31750 ts_tablet_manager.cc:1434] T 88b0a29c38284391bdaea82edf99c771 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:13:38.914446 31750 tablet_bootstrap.cc:492] T 22ba83039f2d4e2c9089947b949a1790 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:38.924217 31750 tablet_bootstrap.cc:654] T 22ba83039f2d4e2c9089947b949a1790 P 458d610e8abf4f2ea831ab7bf3576da6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.940773 32032 raft_consensus.cc:493] T 0550046442d4469c96ad37cbbb191915 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.941533 32032 raft_consensus.cc:515] T 0550046442d4469c96ad37cbbb191915 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:38.947500 32032 leader_election.cc:290] T 0550046442d4469c96ad37cbbb191915 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:38.950462 31628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0550046442d4469c96ad37cbbb191915" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:38.980945 31628 raft_consensus.cc:2468] T 0550046442d4469c96ad37cbbb191915 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 0.
I20260709 13:13:38.951222 31857 raft_consensus.cc:493] T 0c12bd32cd944ce99a18fc4f9617961e P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.982138 31857 raft_consensus.cc:515] T 0c12bd32cd944ce99a18fc4f9617961e P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:38.983821 31669 leader_election.cc:304] T 0550046442d4469c96ad37cbbb191915 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca, c74453754ee34bea9b231ae318a55a31; no voters: 
I20260709 13:13:38.984750 31857 leader_election.cc:290] T 0c12bd32cd944ce99a18fc4f9617961e P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:38.956158 31552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0550046442d4469c96ad37cbbb191915" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:38.985873 31920 raft_consensus.cc:2804] T 0550046442d4469c96ad37cbbb191915 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:38.986569 31920 raft_consensus.cc:493] T 0550046442d4469c96ad37cbbb191915 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:38.987021 31920 raft_consensus.cc:3060] T 0550046442d4469c96ad37cbbb191915 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:38.960427 31817 raft_consensus.cc:493] T 6038006ca0e344af86fe5febd517c62a P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.990139 31817 raft_consensus.cc:515] T 6038006ca0e344af86fe5febd517c62a P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
W20260709 13:13:38.991485 31666 leader_election.cc:343] T 0550046442d4469c96ad37cbbb191915 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:38.992681 31817 leader_election.cc:290] T 6038006ca0e344af86fe5febd517c62a P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:39.007939 31552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c12bd32cd944ce99a18fc4f9617961e" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:39.008412 31554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6038006ca0e344af86fe5febd517c62a" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:39.010914 31476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6038006ca0e344af86fe5febd517c62a" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:39.011893 31476 raft_consensus.cc:2468] T 6038006ca0e344af86fe5febd517c62a P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 0.
I20260709 13:13:39.015957 31594 leader_election.cc:304] T 6038006ca0e344af86fe5febd517c62a P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, c74453754ee34bea9b231ae318a55a31; no voters: 
I20260709 13:13:39.017309 31480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c12bd32cd944ce99a18fc4f9617961e" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:39.017365 31759 raft_consensus.cc:2804] T 6038006ca0e344af86fe5febd517c62a P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:39.019222 31759 raft_consensus.cc:493] T 6038006ca0e344af86fe5febd517c62a P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:39.019716 31759 raft_consensus.cc:3060] T 6038006ca0e344af86fe5febd517c62a P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:39.022455 31594 leader_election.cc:343] T 0c12bd32cd944ce99a18fc4f9617961e P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:39.023193 31592 leader_election.cc:343] T 0c12bd32cd944ce99a18fc4f9617961e P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:39.023900 31592 leader_election.cc:304] T 0c12bd32cd944ce99a18fc4f9617961e P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c74453754ee34bea9b231ae318a55a31; no voters: 196d972917fe4f85985e3862d40b7596, 458d610e8abf4f2ea831ab7bf3576da6
I20260709 13:13:39.025573 31817 raft_consensus.cc:2749] T 0c12bd32cd944ce99a18fc4f9617961e P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:39.064356 31747 tablet_bootstrap.cc:492] T 6038006ca0e344af86fe5febd517c62a P 196d972917fe4f85985e3862d40b7596: No bootstrap required, opened a new log
I20260709 13:13:39.064975 31747 ts_tablet_manager.cc:1403] T 6038006ca0e344af86fe5febd517c62a P 196d972917fe4f85985e3862d40b7596: Time spent bootstrapping tablet: real 0.271s	user 0.043s	sys 0.082s
I20260709 13:13:39.067984 31990 raft_consensus.cc:493] T 88b0a29c38284391bdaea82edf99c771 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.067742 31747 raft_consensus.cc:359] T 6038006ca0e344af86fe5febd517c62a P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:39.068594 31747 raft_consensus.cc:385] T 6038006ca0e344af86fe5febd517c62a P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.068966 31747 raft_consensus.cc:740] T 6038006ca0e344af86fe5febd517c62a P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 196d972917fe4f85985e3862d40b7596, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.068653 31990 raft_consensus.cc:515] T 88b0a29c38284391bdaea82edf99c771 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:39.069645 31747 consensus_queue.cc:260] T 6038006ca0e344af86fe5febd517c62a P 196d972917fe4f85985e3862d40b7596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:39.071735 31990 leader_election.cc:290] T 88b0a29c38284391bdaea82edf99c771 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:39.072849 31842 raft_consensus.cc:493] T 497217e9b47244fcb425c66935cb8a20 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.073284 31842 raft_consensus.cc:515] T 497217e9b47244fcb425c66935cb8a20 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:39.073804 31629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b0a29c38284391bdaea82edf99c771" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:39.074716 31629 raft_consensus.cc:2468] T 88b0a29c38284391bdaea82edf99c771 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 0.
I20260709 13:13:39.075471 31842 leader_election.cc:290] T 497217e9b47244fcb425c66935cb8a20 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:39.075977 31842 raft_consensus.cc:493] T fb4f7292ed2f489e922ca5fb1c6e47bf P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.076380 31842 raft_consensus.cc:515] T fb4f7292ed2f489e922ca5fb1c6e47bf P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:39.076725 31747 ts_tablet_manager.cc:1434] T 6038006ca0e344af86fe5febd517c62a P 196d972917fe4f85985e3862d40b7596: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:13:39.077790 31747 tablet_bootstrap.cc:492] T 88b0a29c38284391bdaea82edf99c771 P 196d972917fe4f85985e3862d40b7596: Bootstrap starting.
I20260709 13:13:39.077904 31446 leader_election.cc:304] T 88b0a29c38284391bdaea82edf99c771 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, c74453754ee34bea9b231ae318a55a31; no voters: 
I20260709 13:13:39.079820 31629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497217e9b47244fcb425c66935cb8a20" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:39.080780 31629 raft_consensus.cc:2468] T 497217e9b47244fcb425c66935cb8a20 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 0.
I20260709 13:13:39.080891 31842 leader_election.cc:290] T fb4f7292ed2f489e922ca5fb1c6e47bf P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:39.083887 31842 raft_consensus.cc:2804] T 88b0a29c38284391bdaea82edf99c771 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:39.084353 31842 raft_consensus.cc:493] T 88b0a29c38284391bdaea82edf99c771 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:39.084913 31842 raft_consensus.cc:3060] T 88b0a29c38284391bdaea82edf99c771 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.086774 31553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b0a29c38284391bdaea82edf99c771" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
W20260709 13:13:39.088863 31443 leader_election.cc:343] T 88b0a29c38284391bdaea82edf99c771 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:39.089519 31592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:37431, user_credentials={real_user=slave}} blocked reactor thread for 66375.7us
I20260709 13:13:39.090423 31747 tablet_bootstrap.cc:654] T 88b0a29c38284391bdaea82edf99c771 P 196d972917fe4f85985e3862d40b7596: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:39.091079 31554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4f7292ed2f489e922ca5fb1c6e47bf" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:39.093815 31804 raft_consensus.cc:493] T 497217e9b47244fcb425c66935cb8a20 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.094467 31804 raft_consensus.cc:515] T 497217e9b47244fcb425c66935cb8a20 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:39.097118 31804 leader_election.cc:290] T 497217e9b47244fcb425c66935cb8a20 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
W20260709 13:13:39.106498 31443 leader_election.cc:343] T fb4f7292ed2f489e922ca5fb1c6e47bf P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:39.108718 31750 tablet_bootstrap.cc:492] T 22ba83039f2d4e2c9089947b949a1790 P 458d610e8abf4f2ea831ab7bf3576da6: No bootstrap required, opened a new log
I20260709 13:13:39.109223 31750 ts_tablet_manager.cc:1403] T 22ba83039f2d4e2c9089947b949a1790 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.195s	user 0.044s	sys 0.035s
I20260709 13:13:39.112172 31750 raft_consensus.cc:359] T 22ba83039f2d4e2c9089947b949a1790 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:39.112910 31750 raft_consensus.cc:385] T 22ba83039f2d4e2c9089947b949a1790 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.113190 31750 raft_consensus.cc:740] T 22ba83039f2d4e2c9089947b949a1790 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.113936 31750 consensus_queue.cc:260] T 22ba83039f2d4e2c9089947b949a1790 P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:39.114711 31842 raft_consensus.cc:515] T 88b0a29c38284391bdaea82edf99c771 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:39.115715 31446 leader_election.cc:304] T 497217e9b47244fcb425c66935cb8a20 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, c74453754ee34bea9b231ae318a55a31; no voters: 
I20260709 13:13:39.117682 31990 raft_consensus.cc:2804] T 497217e9b47244fcb425c66935cb8a20 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:39.118122 31990 raft_consensus.cc:493] T 497217e9b47244fcb425c66935cb8a20 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:39.118420 31990 raft_consensus.cc:3060] T 497217e9b47244fcb425c66935cb8a20 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.119179 31554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b0a29c38284391bdaea82edf99c771" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596"
W20260709 13:13:39.120479 31443 leader_election.cc:343] T 88b0a29c38284391bdaea82edf99c771 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:39.124029 31592 leader_election.cc:343] T 6038006ca0e344af86fe5febd517c62a P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:39.124368 31749 tablet_bootstrap.cc:492] T fb97ca15f56b46dd846db7b0ff156a32 P 76fb155ade354ee1ba78673e73b28aca: No bootstrap required, opened a new log
I20260709 13:13:39.124821 31749 ts_tablet_manager.cc:1403] T fb97ca15f56b46dd846db7b0ff156a32 P 76fb155ade354ee1ba78673e73b28aca: Time spent bootstrapping tablet: real 0.262s	user 0.125s	sys 0.111s
I20260709 13:13:39.126475 31480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497217e9b47244fcb425c66935cb8a20" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:39.127450 31749 raft_consensus.cc:359] T fb97ca15f56b46dd846db7b0ff156a32 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:39.128108 31749 raft_consensus.cc:385] T fb97ca15f56b46dd846db7b0ff156a32 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.128384 31749 raft_consensus.cc:740] T fb97ca15f56b46dd846db7b0ff156a32 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.129278 31749 consensus_queue.cc:260] T fb97ca15f56b46dd846db7b0ff156a32 P 76fb155ade354ee1ba78673e73b28aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:39.129987 31553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497217e9b47244fcb425c66935cb8a20" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:39.130590 31553 raft_consensus.cc:2468] T 497217e9b47244fcb425c66935cb8a20 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 0.
I20260709 13:13:39.131600 31749 ts_tablet_manager.cc:1434] T fb97ca15f56b46dd846db7b0ff156a32 P 76fb155ade354ee1ba78673e73b28aca: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:13:39.125202 31990 raft_consensus.cc:515] T 497217e9b47244fcb425c66935cb8a20 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:39.132654 31749 tablet_bootstrap.cc:492] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 76fb155ade354ee1ba78673e73b28aca: Bootstrap starting.
I20260709 13:13:39.132624 31699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4f7292ed2f489e922ca5fb1c6e47bf" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:39.133323 31699 raft_consensus.cc:2468] T fb4f7292ed2f489e922ca5fb1c6e47bf P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 0.
I20260709 13:13:39.133884 31480 raft_consensus.cc:2393] T 497217e9b47244fcb425c66935cb8a20 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 196d972917fe4f85985e3862d40b7596 in current term 1: Already voted for candidate 458d610e8abf4f2ea831ab7bf3576da6 in this term.
I20260709 13:13:39.135464 31446 leader_election.cc:304] T fb4f7292ed2f489e922ca5fb1c6e47bf P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca; no voters: 196d972917fe4f85985e3862d40b7596
I20260709 13:13:39.137313 31747 tablet_bootstrap.cc:492] T 88b0a29c38284391bdaea82edf99c771 P 196d972917fe4f85985e3862d40b7596: No bootstrap required, opened a new log
I20260709 13:13:39.137785 31747 ts_tablet_manager.cc:1403] T 88b0a29c38284391bdaea82edf99c771 P 196d972917fe4f85985e3862d40b7596: Time spent bootstrapping tablet: real 0.060s	user 0.014s	sys 0.002s
I20260709 13:13:39.140093 31749 tablet_bootstrap.cc:654] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 76fb155ade354ee1ba78673e73b28aca: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:39.140508 31747 raft_consensus.cc:359] T 88b0a29c38284391bdaea82edf99c771 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:39.141175 31747 raft_consensus.cc:385] T 88b0a29c38284391bdaea82edf99c771 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.141413 31747 raft_consensus.cc:740] T 88b0a29c38284391bdaea82edf99c771 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 196d972917fe4f85985e3862d40b7596, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.116858 31750 ts_tablet_manager.cc:1434] T 22ba83039f2d4e2c9089947b949a1790 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:13:39.143146 31759 raft_consensus.cc:515] T 6038006ca0e344af86fe5febd517c62a P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:39.144541 31750 tablet_bootstrap.cc:492] T 0c12bd32cd944ce99a18fc4f9617961e P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:39.145179 31842 leader_election.cc:290] T 88b0a29c38284391bdaea82edf99c771 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 election: Requested vote from peers 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:39.145720 31842 raft_consensus.cc:493] T b262a50e82034c57a4bfb7da683ff5d1 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.146163 31842 raft_consensus.cc:515] T b262a50e82034c57a4bfb7da683ff5d1 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:39.146656 31789 raft_consensus.cc:493] T fb97ca15f56b46dd846db7b0ff156a32 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.147145 31789 raft_consensus.cc:515] T fb97ca15f56b46dd846db7b0ff156a32 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:39.148129 31842 leader_election.cc:290] T b262a50e82034c57a4bfb7da683ff5d1 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715)
I20260709 13:13:39.148635 31842 raft_consensus.cc:2804] T fb4f7292ed2f489e922ca5fb1c6e47bf P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:39.148950 31842 raft_consensus.cc:493] T fb4f7292ed2f489e922ca5fb1c6e47bf P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:39.149077 31789 leader_election.cc:290] T fb97ca15f56b46dd846db7b0ff156a32 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:39.149322 31842 raft_consensus.cc:3060] T fb4f7292ed2f489e922ca5fb1c6e47bf P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.151814 31759 leader_election.cc:290] T 6038006ca0e344af86fe5febd517c62a P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 election: Requested vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:39.152280 31627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497217e9b47244fcb425c66935cb8a20" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:39.153168 31627 raft_consensus.cc:2468] T 497217e9b47244fcb425c66935cb8a20 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 196d972917fe4f85985e3862d40b7596 in term 0.
I20260709 13:13:39.157609 31881 consensus_queue.cc:1048] T 47cb0ae4817d4c19ac11b42143d00039 P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:39.158185 31990 leader_election.cc:290] T 497217e9b47244fcb425c66935cb8a20 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 election: Requested vote from peers 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:39.160729 31747 consensus_queue.cc:260] T 88b0a29c38284391bdaea82edf99c771 P 196d972917fe4f85985e3862d40b7596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:39.165474 31476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6038006ca0e344af86fe5febd517c62a" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
I20260709 13:13:39.166285 31476 raft_consensus.cc:3060] T 6038006ca0e344af86fe5febd517c62a P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.167493 31881 consensus_queue.cc:1048] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:39.170675 31748 tablet_bootstrap.cc:492] T 1fb28788823d4c5fab527f4ee2da4d2e P c74453754ee34bea9b231ae318a55a31: No bootstrap required, opened a new log
I20260709 13:13:39.171517 31748 ts_tablet_manager.cc:1403] T 1fb28788823d4c5fab527f4ee2da4d2e P c74453754ee34bea9b231ae318a55a31: Time spent bootstrapping tablet: real 0.293s	user 0.020s	sys 0.015s
I20260709 13:13:39.171651 31881 raft_consensus.cc:493] T b262a50e82034c57a4bfb7da683ff5d1 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.171114 31920 raft_consensus.cc:515] T 0550046442d4469c96ad37cbbb191915 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:39.177299 31881 raft_consensus.cc:515] T b262a50e82034c57a4bfb7da683ff5d1 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:39.175660 31554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb97ca15f56b46dd846db7b0ff156a32" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:39.184067 31748 raft_consensus.cc:359] T 1fb28788823d4c5fab527f4ee2da4d2e P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:39.184715 31748 raft_consensus.cc:385] T 1fb28788823d4c5fab527f4ee2da4d2e P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.184947 31748 raft_consensus.cc:740] T 1fb28788823d4c5fab527f4ee2da4d2e P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.185520 31748 consensus_queue.cc:260] T 1fb28788823d4c5fab527f4ee2da4d2e P c74453754ee34bea9b231ae318a55a31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:39.187546 31747 ts_tablet_manager.cc:1434] T 88b0a29c38284391bdaea82edf99c771 P 196d972917fe4f85985e3862d40b7596: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.000s
W20260709 13:13:39.190835 31666 leader_election.cc:343] T fb97ca15f56b46dd846db7b0ff156a32 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:39.196976 32033 raft_consensus.cc:493] T fb97ca15f56b46dd846db7b0ff156a32 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.197484 32033 raft_consensus.cc:515] T fb97ca15f56b46dd846db7b0ff156a32 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:39.198132 31552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6038006ca0e344af86fe5febd517c62a" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596"
I20260709 13:13:39.198756 31552 raft_consensus.cc:3060] T 6038006ca0e344af86fe5febd517c62a P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.199615 32033 leader_election.cc:290] T fb97ca15f56b46dd846db7b0ff156a32 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431), 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715)
I20260709 13:13:39.202067 31627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb97ca15f56b46dd846db7b0ff156a32" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:39.202492 31521 leader_election.cc:304] T 497217e9b47244fcb425c66935cb8a20 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, c74453754ee34bea9b231ae318a55a31; no voters: 458d610e8abf4f2ea831ab7bf3576da6
I20260709 13:13:39.202677 31627 raft_consensus.cc:2468] T fb97ca15f56b46dd846db7b0ff156a32 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 0.
I20260709 13:13:39.204084 31771 raft_consensus.cc:2804] T 497217e9b47244fcb425c66935cb8a20 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:39.204456 31771 raft_consensus.cc:493] T 497217e9b47244fcb425c66935cb8a20 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:39.204767 31771 raft_consensus.cc:3060] T 497217e9b47244fcb425c66935cb8a20 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.208813 31552 raft_consensus.cc:2468] T 6038006ca0e344af86fe5febd517c62a P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 1.
I20260709 13:13:39.208904 31881 leader_election.cc:290] T b262a50e82034c57a4bfb7da683ff5d1 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:39.174989 31553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497217e9b47244fcb425c66935cb8a20" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596"
I20260709 13:13:39.217480 31748 ts_tablet_manager.cc:1434] T 1fb28788823d4c5fab527f4ee2da4d2e P c74453754ee34bea9b231ae318a55a31: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.000s
I20260709 13:13:39.213195 31702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb97ca15f56b46dd846db7b0ff156a32" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:39.220368 31702 raft_consensus.cc:2468] T fb97ca15f56b46dd846db7b0ff156a32 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 0.
I20260709 13:13:39.226934 31747 tablet_bootstrap.cc:492] T fb4f7292ed2f489e922ca5fb1c6e47bf P 196d972917fe4f85985e3862d40b7596: Bootstrap starting.
W20260709 13:13:39.216049 31446 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:45715, user_credentials={real_user=slave}} blocked reactor thread for 78198.1us
I20260709 13:13:39.246456 31748 tablet_bootstrap.cc:492] T b262a50e82034c57a4bfb7da683ff5d1 P c74453754ee34bea9b231ae318a55a31: Bootstrap starting.
I20260709 13:13:39.244607 31771 raft_consensus.cc:515] T 497217e9b47244fcb425c66935cb8a20 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:39.258137 31553 raft_consensus.cc:2393] T 497217e9b47244fcb425c66935cb8a20 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 458d610e8abf4f2ea831ab7bf3576da6 in current term 1: Already voted for candidate 196d972917fe4f85985e3862d40b7596 in this term.
I20260709 13:13:39.236784 31595 leader_election.cc:304] T fb97ca15f56b46dd846db7b0ff156a32 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca, c74453754ee34bea9b231ae318a55a31; no voters: 
I20260709 13:13:39.261847 31627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b262a50e82034c57a4bfb7da683ff5d1" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:39.267016 31771 leader_election.cc:290] T 497217e9b47244fcb425c66935cb8a20 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 election: Requested vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:39.271008 31749 tablet_bootstrap.cc:492] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 76fb155ade354ee1ba78673e73b28aca: No bootstrap required, opened a new log
I20260709 13:13:39.274447 31749 ts_tablet_manager.cc:1403] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 76fb155ade354ee1ba78673e73b28aca: Time spent bootstrapping tablet: real 0.142s	user 0.020s	sys 0.048s
I20260709 13:13:39.271492 31478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497217e9b47244fcb425c66935cb8a20" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
I20260709 13:13:39.278852 31478 raft_consensus.cc:2393] T 497217e9b47244fcb425c66935cb8a20 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 196d972917fe4f85985e3862d40b7596 in current term 1: Already voted for candidate 458d610e8abf4f2ea831ab7bf3576da6 in this term.
I20260709 13:13:39.280877 31749 raft_consensus.cc:359] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:39.281065 31626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b262a50e82034c57a4bfb7da683ff5d1" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:39.273936 32033 raft_consensus.cc:2804] T fb97ca15f56b46dd846db7b0ff156a32 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:39.281596 31749 raft_consensus.cc:385] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.281916 32033 raft_consensus.cc:493] T fb97ca15f56b46dd846db7b0ff156a32 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:39.281970 31749 raft_consensus.cc:740] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.282377 32033 raft_consensus.cc:3060] T fb97ca15f56b46dd846db7b0ff156a32 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.289479 31699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b262a50e82034c57a4bfb7da683ff5d1" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:39.290233 31699 raft_consensus.cc:2468] T b262a50e82034c57a4bfb7da683ff5d1 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 0.
I20260709 13:13:39.289510 31627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b0a29c38284391bdaea82edf99c771" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31"
I20260709 13:13:39.293232 31627 raft_consensus.cc:3060] T 88b0a29c38284391bdaea82edf99c771 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.297466 32075 raft_consensus.cc:493] T 8a98dff441f1479992f85708c9f03283 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.297948 32075 raft_consensus.cc:515] T 8a98dff441f1479992f85708c9f03283 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:39.266350 32032 consensus_queue.cc:1048] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 13:13:39.302731 32075 leader_election.cc:290] T 8a98dff441f1479992f85708c9f03283 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:39.306320 31749 consensus_queue.cc:260] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 76fb155ade354ee1ba78673e73b28aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:39.314558 31749 ts_tablet_manager.cc:1434] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 76fb155ade354ee1ba78673e73b28aca: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.001s
I20260709 13:13:39.318513 32076 raft_consensus.cc:493] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.319059 32076 raft_consensus.cc:515] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:39.326327 31747 tablet_bootstrap.cc:654] T fb4f7292ed2f489e922ca5fb1c6e47bf P 196d972917fe4f85985e3862d40b7596: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:39.326882 31629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497217e9b47244fcb425c66935cb8a20" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31"
I20260709 13:13:39.327502 31629 raft_consensus.cc:3060] T 497217e9b47244fcb425c66935cb8a20 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.329080 31669 leader_election.cc:304] T fb97ca15f56b46dd846db7b0ff156a32 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca, c74453754ee34bea9b231ae318a55a31; no voters: 196d972917fe4f85985e3862d40b7596
I20260709 13:13:39.330267 32032 raft_consensus.cc:2804] T fb97ca15f56b46dd846db7b0ff156a32 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:39.330628 32032 raft_consensus.cc:493] T fb97ca15f56b46dd846db7b0ff156a32 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:39.330958 32032 raft_consensus.cc:3060] T fb97ca15f56b46dd846db7b0ff156a32 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.333302 31920 leader_election.cc:290] T 0550046442d4469c96ad37cbbb191915 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 election: Requested vote from peers 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:39.338162 31555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0550046442d4469c96ad37cbbb191915" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596"
I20260709 13:13:39.339179 31750 tablet_bootstrap.cc:654] T 0c12bd32cd944ce99a18fc4f9617961e P 458d610e8abf4f2ea831ab7bf3576da6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:39.340317 31550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a98dff441f1479992f85708c9f03283" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:39.342316 31475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b262a50e82034c57a4bfb7da683ff5d1" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:39.342952 31475 raft_consensus.cc:2468] T b262a50e82034c57a4bfb7da683ff5d1 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 0.
I20260709 13:13:39.345518 32033 raft_consensus.cc:515] T fb97ca15f56b46dd846db7b0ff156a32 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
W20260709 13:13:39.346194 31666 leader_election.cc:343] T 0550046442d4469c96ad37cbbb191915 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:39.346920 31666 leader_election.cc:343] T 8a98dff441f1479992f85708c9f03283 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:39.347703 32033 leader_election.cc:290] T fb97ca15f56b46dd846db7b0ff156a32 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 election: Requested vote from peers 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431), 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715)
I20260709 13:13:39.348028 31475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a98dff441f1479992f85708c9f03283" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
W20260709 13:13:39.348853 32080 log.cc:927] Time spent T 47cb0ae4817d4c19ac11b42143d00039 P c74453754ee34bea9b231ae318a55a31: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:13:39.340493 31629 raft_consensus.cc:2468] T 497217e9b47244fcb425c66935cb8a20 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 1.
I20260709 13:13:39.359877 31842 raft_consensus.cc:515] T fb4f7292ed2f489e922ca5fb1c6e47bf P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:39.362501 31592 leader_election.cc:304] T 6038006ca0e344af86fe5febd517c62a P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, c74453754ee34bea9b231ae318a55a31; no voters: 
I20260709 13:13:39.365940 31699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb97ca15f56b46dd846db7b0ff156a32" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca"
W20260709 13:13:39.368391 31426 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:39.364737 31842 leader_election.cc:290] T fb4f7292ed2f489e922ca5fb1c6e47bf P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 election: Requested vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:39.370162 31446 leader_election.cc:304] T b262a50e82034c57a4bfb7da683ff5d1 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca; no voters: 
W20260709 13:13:39.403043 31446 leader_election.cc:343] T b262a50e82034c57a4bfb7da683ff5d1 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:39.404225 31446 leader_election.cc:304] T 497217e9b47244fcb425c66935cb8a20 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, c74453754ee34bea9b231ae318a55a31; no voters: 196d972917fe4f85985e3862d40b7596
I20260709 13:13:39.375594 31627 raft_consensus.cc:2468] T 88b0a29c38284391bdaea82edf99c771 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 1.
I20260709 13:13:39.375803 31668 leader_election.cc:304] T b262a50e82034c57a4bfb7da683ff5d1 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca; no voters: 
I20260709 13:13:39.376381 31920 consensus_queue.cc:1048] T 47cb0ae4817d4c19ac11b42143d00039 P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:39.379467 31748 tablet_bootstrap.cc:654] T b262a50e82034c57a4bfb7da683ff5d1 P c74453754ee34bea9b231ae318a55a31: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:39.384466 31626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497217e9b47244fcb425c66935cb8a20" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31"
I20260709 13:13:39.388321 31476 raft_consensus.cc:2468] T 6038006ca0e344af86fe5febd517c62a P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 1.
I20260709 13:13:39.390766 32032 raft_consensus.cc:515] T fb97ca15f56b46dd846db7b0ff156a32 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:39.393667 32083 raft_consensus.cc:493] T 88b0a29c38284391bdaea82edf99c771 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.394208 31553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4f7292ed2f489e922ca5fb1c6e47bf" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596"
I20260709 13:13:39.395324 31554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2a6746f9b2f4b1ab287b9e8f4c51106" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:39.396253 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0550046442d4469c96ad37cbbb191915" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31"
I20260709 13:13:39.398713 32033 raft_consensus.cc:2804] T 6038006ca0e344af86fe5febd517c62a P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:39.399178 32076 leader_election.cc:290] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:39.406817 31990 raft_consensus.cc:2804] T b262a50e82034c57a4bfb7da683ff5d1 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:13:39.408392 31669 leader_election.cc:343] T b262a50e82034c57a4bfb7da683ff5d1 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:39.408910 31552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb97ca15f56b46dd846db7b0ff156a32" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:39.420406 31749 tablet_bootstrap.cc:492] T 0f01040b42e14f0db6bcd06319237ddb P 76fb155ade354ee1ba78673e73b28aca: Bootstrap starting.
I20260709 13:13:39.412439 32075 raft_consensus.cc:2804] T b262a50e82034c57a4bfb7da683ff5d1 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:39.414758 32033 raft_consensus.cc:697] T 6038006ca0e344af86fe5febd517c62a P c74453754ee34bea9b231ae318a55a31 [term 1 LEADER]: Becoming Leader. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Running, Role: LEADER
I20260709 13:13:39.419174 31626 raft_consensus.cc:2393] T 497217e9b47244fcb425c66935cb8a20 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 196d972917fe4f85985e3862d40b7596 in current term 1: Already voted for candidate 458d610e8abf4f2ea831ab7bf3576da6 in this term.
I20260709 13:13:39.416815 31623 raft_consensus.cc:3060] T 0550046442d4469c96ad37cbbb191915 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.417939 31990 raft_consensus.cc:493] T b262a50e82034c57a4bfb7da683ff5d1 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:39.412694 32083 raft_consensus.cc:515] T 88b0a29c38284391bdaea82edf99c771 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:39.427441 32082 raft_consensus.cc:2804] T 497217e9b47244fcb425c66935cb8a20 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:39.430671 31521 leader_election.cc:304] T 497217e9b47244fcb425c66935cb8a20 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 196d972917fe4f85985e3862d40b7596; no voters: 458d610e8abf4f2ea831ab7bf3576da6, c74453754ee34bea9b231ae318a55a31
I20260709 13:13:39.431854 31750 tablet_bootstrap.cc:492] T 0c12bd32cd944ce99a18fc4f9617961e P 458d610e8abf4f2ea831ab7bf3576da6: No bootstrap required, opened a new log
I20260709 13:13:39.426111 31699 raft_consensus.cc:2393] T fb97ca15f56b46dd846db7b0ff156a32 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c74453754ee34bea9b231ae318a55a31 in current term 1: Already voted for candidate 76fb155ade354ee1ba78673e73b28aca in this term.
I20260709 13:13:39.423686 32075 raft_consensus.cc:493] T b262a50e82034c57a4bfb7da683ff5d1 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:39.431470 31549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb97ca15f56b46dd846db7b0ff156a32" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596"
I20260709 13:13:39.432360 31750 ts_tablet_manager.cc:1403] T 0c12bd32cd944ce99a18fc4f9617961e P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.288s	user 0.012s	sys 0.008s
I20260709 13:13:39.433380 32077 raft_consensus.cc:493] T 22ba83039f2d4e2c9089947b949a1790 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.431602 31990 raft_consensus.cc:3060] T b262a50e82034c57a4bfb7da683ff5d1 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.434504 31771 raft_consensus.cc:2749] T 497217e9b47244fcb425c66935cb8a20 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:39.435328 32075 raft_consensus.cc:3060] T b262a50e82034c57a4bfb7da683ff5d1 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.432803 31446 leader_election.cc:304] T 88b0a29c38284391bdaea82edf99c771 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, c74453754ee34bea9b231ae318a55a31; no voters: 196d972917fe4f85985e3862d40b7596
W20260709 13:13:39.450403 31669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:35791, user_credentials={real_user=slave}} blocked reactor thread for 65240.4us
I20260709 13:13:39.433423 32033 consensus_queue.cc:237] T 6038006ca0e344af86fe5febd517c62a P c74453754ee34bea9b231ae318a55a31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:39.436985 32077 raft_consensus.cc:515] T 22ba83039f2d4e2c9089947b949a1790 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
W20260709 13:13:39.470585 31668 leader_election.cc:343] T 8a98dff441f1479992f85708c9f03283 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:39.471060 31668 leader_election.cc:304] T 8a98dff441f1479992f85708c9f03283 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca; no voters: 196d972917fe4f85985e3862d40b7596, 458d610e8abf4f2ea831ab7bf3576da6
I20260709 13:13:39.471614 32077 leader_election.cc:290] T 22ba83039f2d4e2c9089947b949a1790 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715)
I20260709 13:13:39.473048 32077 raft_consensus.cc:2804] T 88b0a29c38284391bdaea82edf99c771 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:39.473512 32077 raft_consensus.cc:697] T 88b0a29c38284391bdaea82edf99c771 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 LEADER]: Becoming Leader. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Running, Role: LEADER
I20260709 13:13:39.474530 32077 consensus_queue.cc:237] T 88b0a29c38284391bdaea82edf99c771 P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:39.472076 31881 raft_consensus.cc:2749] T 8a98dff441f1479992f85708c9f03283 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:13:39.480836 31443 leader_election.cc:343] T fb4f7292ed2f489e922ca5fb1c6e47bf P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:39.484596 31749 tablet_bootstrap.cc:654] T 0f01040b42e14f0db6bcd06319237ddb P 76fb155ade354ee1ba78673e73b28aca: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:39.487627 31699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4f7292ed2f489e922ca5fb1c6e47bf" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca"
I20260709 13:13:39.487547 31702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2a6746f9b2f4b1ab287b9e8f4c51106" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:39.488613 31702 raft_consensus.cc:2468] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 0.
I20260709 13:13:39.489357 32083 leader_election.cc:290] T 88b0a29c38284391bdaea82edf99c771 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:39.453507 31552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb97ca15f56b46dd846db7b0ff156a32" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596"
I20260709 13:13:39.494642 31750 raft_consensus.cc:359] T 0c12bd32cd944ce99a18fc4f9617961e P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:39.467970 32032 leader_election.cc:290] T fb97ca15f56b46dd846db7b0ff156a32 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 election: Requested vote from peers 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:39.495683 31747 tablet_bootstrap.cc:492] T fb4f7292ed2f489e922ca5fb1c6e47bf P 196d972917fe4f85985e3862d40b7596: No bootstrap required, opened a new log
I20260709 13:13:39.503528 31747 ts_tablet_manager.cc:1403] T fb4f7292ed2f489e922ca5fb1c6e47bf P 196d972917fe4f85985e3862d40b7596: Time spent bootstrapping tablet: real 0.277s	user 0.016s	sys 0.016s
I20260709 13:13:39.496125 32075 raft_consensus.cc:515] T b262a50e82034c57a4bfb7da683ff5d1 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:39.497673 31750 raft_consensus.cc:385] T 0c12bd32cd944ce99a18fc4f9617961e P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.522786 31750 raft_consensus.cc:740] T 0c12bd32cd944ce99a18fc4f9617961e P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.523635 31750 consensus_queue.cc:260] T 0c12bd32cd944ce99a18fc4f9617961e P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:39.523918 31374 catalog_manager.cc:5697] T 6038006ca0e344af86fe5febd517c62a P c74453754ee34bea9b231ae318a55a31 reported cstate change: term changed from 0 to 1, leader changed from <none> to c74453754ee34bea9b231ae318a55a31 (127.23.140.67). New cstate: current_term: 1 leader_uuid: "c74453754ee34bea9b231ae318a55a31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:39.543376 31750 ts_tablet_manager.cc:1434] T 0c12bd32cd944ce99a18fc4f9617961e P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.108s	user 0.007s	sys 0.000s
I20260709 13:13:39.544477 31750 tablet_bootstrap.cc:492] T 1fb28788823d4c5fab527f4ee2da4d2e P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:39.502457 32082 raft_consensus.cc:697] T 497217e9b47244fcb425c66935cb8a20 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 LEADER]: Becoming Leader. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Running, Role: LEADER
I20260709 13:13:39.502813 31699 raft_consensus.cc:3060] T fb4f7292ed2f489e922ca5fb1c6e47bf P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.555052 31750 tablet_bootstrap.cc:654] T 1fb28788823d4c5fab527f4ee2da4d2e P 458d610e8abf4f2ea831ab7bf3576da6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:39.559119 31747 raft_consensus.cc:359] T fb4f7292ed2f489e922ca5fb1c6e47bf P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:39.559864 32075 leader_election.cc:290] T b262a50e82034c57a4bfb7da683ff5d1 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 election: Requested vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:39.575870 31990 raft_consensus.cc:515] T b262a50e82034c57a4bfb7da683ff5d1 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
W20260709 13:13:39.577411 32084 log.cc:927] Time spent T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P 196d972917fe4f85985e3862d40b7596: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 13:13:39.581115 31627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b0a29c38284391bdaea82edf99c771" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:39.582667 31747 raft_consensus.cc:385] T fb4f7292ed2f489e922ca5fb1c6e47bf P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.586941 31747 raft_consensus.cc:740] T fb4f7292ed2f489e922ca5fb1c6e47bf P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 196d972917fe4f85985e3862d40b7596, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.590764 31747 consensus_queue.cc:260] T fb4f7292ed2f489e922ca5fb1c6e47bf P 196d972917fe4f85985e3862d40b7596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
W20260709 13:13:39.589597 31443 leader_election.cc:343] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:39.606616 31592 leader_election.cc:343] T fb97ca15f56b46dd846db7b0ff156a32 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:39.607995 31592 leader_election.cc:343] T fb97ca15f56b46dd846db7b0ff156a32 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:39.611667 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b262a50e82034c57a4bfb7da683ff5d1" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31"
I20260709 13:13:39.606869 31627 raft_consensus.cc:2393] T 88b0a29c38284391bdaea82edf99c771 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 196d972917fe4f85985e3862d40b7596 in current term 1: Already voted for candidate 458d610e8abf4f2ea831ab7bf3576da6 in this term.
I20260709 13:13:39.608583 31592 leader_election.cc:304] T fb97ca15f56b46dd846db7b0ff156a32 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c74453754ee34bea9b231ae318a55a31; no voters: 196d972917fe4f85985e3862d40b7596, 76fb155ade354ee1ba78673e73b28aca
I20260709 13:13:39.610174 32082 consensus_queue.cc:237] T 497217e9b47244fcb425c66935cb8a20 P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:39.619050 31446 leader_election.cc:304] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca; no voters: 196d972917fe4f85985e3862d40b7596
I20260709 13:13:39.617384 31478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b262a50e82034c57a4bfb7da683ff5d1" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
I20260709 13:13:39.614694 31747 ts_tablet_manager.cc:1434] T fb4f7292ed2f489e922ca5fb1c6e47bf P 196d972917fe4f85985e3862d40b7596: Time spent starting tablet: real 0.111s	user 0.007s	sys 0.002s
I20260709 13:13:39.625316 32098 raft_consensus.cc:2804] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:39.629024 32098 raft_consensus.cc:493] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:39.628949 31478 raft_consensus.cc:2393] T b262a50e82034c57a4bfb7da683ff5d1 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 76fb155ade354ee1ba78673e73b28aca in current term 1: Already voted for candidate 458d610e8abf4f2ea831ab7bf3576da6 in this term.
I20260709 13:13:39.629516 32098 raft_consensus.cc:3060] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.631644 31699 raft_consensus.cc:2468] T fb4f7292ed2f489e922ca5fb1c6e47bf P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 1.
I20260709 13:13:39.635290 31749 tablet_bootstrap.cc:492] T 0f01040b42e14f0db6bcd06319237ddb P 76fb155ade354ee1ba78673e73b28aca: No bootstrap required, opened a new log
I20260709 13:13:39.636138 31749 ts_tablet_manager.cc:1403] T 0f01040b42e14f0db6bcd06319237ddb P 76fb155ade354ee1ba78673e73b28aca: Time spent bootstrapping tablet: real 0.226s	user 0.015s	sys 0.027s
I20260709 13:13:39.627372 32033 raft_consensus.cc:2749] T fb97ca15f56b46dd846db7b0ff156a32 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:39.626281 31623 raft_consensus.cc:2468] T 0550046442d4469c96ad37cbbb191915 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 1.
I20260709 13:13:39.641618 31747 tablet_bootstrap.cc:492] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 196d972917fe4f85985e3862d40b7596: Bootstrap starting.
W20260709 13:13:39.635197 31669 leader_election.cc:343] T b262a50e82034c57a4bfb7da683ff5d1 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:39.671780 31759 raft_consensus.cc:493] T 1fb28788823d4c5fab527f4ee2da4d2e P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.672473 31759 raft_consensus.cc:515] T 1fb28788823d4c5fab527f4ee2da4d2e P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:39.646137 31990 leader_election.cc:290] T b262a50e82034c57a4bfb7da683ff5d1 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 election: Requested vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715)
I20260709 13:13:39.678638 31748 tablet_bootstrap.cc:492] T b262a50e82034c57a4bfb7da683ff5d1 P c74453754ee34bea9b231ae318a55a31: No bootstrap required, opened a new log
I20260709 13:13:39.679347 31748 ts_tablet_manager.cc:1403] T b262a50e82034c57a4bfb7da683ff5d1 P c74453754ee34bea9b231ae318a55a31: Time spent bootstrapping tablet: real 0.444s	user 0.032s	sys 0.054s
I20260709 13:13:39.685369 31749 raft_consensus.cc:359] T 0f01040b42e14f0db6bcd06319237ddb P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:39.686502 31749 raft_consensus.cc:385] T 0f01040b42e14f0db6bcd06319237ddb P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.686960 31749 raft_consensus.cc:740] T 0f01040b42e14f0db6bcd06319237ddb P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.677145 31626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb97ca15f56b46dd846db7b0ff156a32" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31"
I20260709 13:13:39.694278 31626 raft_consensus.cc:2393] T fb97ca15f56b46dd846db7b0ff156a32 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 76fb155ade354ee1ba78673e73b28aca in current term 1: Already voted for candidate c74453754ee34bea9b231ae318a55a31 in this term.
I20260709 13:13:39.655079 31669 leader_election.cc:304] T b262a50e82034c57a4bfb7da683ff5d1 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca; no voters: 458d610e8abf4f2ea831ab7bf3576da6, c74453754ee34bea9b231ae318a55a31
I20260709 13:13:39.660516 31627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba83039f2d4e2c9089947b949a1790" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
W20260709 13:13:39.696162 31666 leader_election.cc:343] T fb97ca15f56b46dd846db7b0ff156a32 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:39.698376 31759 leader_election.cc:290] T 1fb28788823d4c5fab527f4ee2da4d2e P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:39.696066 31446 leader_election.cc:304] T fb4f7292ed2f489e922ca5fb1c6e47bf P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca; no voters: 196d972917fe4f85985e3862d40b7596
I20260709 13:13:39.700507 31749 consensus_queue.cc:260] T 0f01040b42e14f0db6bcd06319237ddb P 76fb155ade354ee1ba78673e73b28aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:39.704268 31749 ts_tablet_manager.cc:1434] T 0f01040b42e14f0db6bcd06319237ddb P 76fb155ade354ee1ba78673e73b28aca: Time spent starting tablet: real 0.068s	user 0.006s	sys 0.000s
I20260709 13:13:39.705327 31749 tablet_bootstrap.cc:492] T 35bbba26df1b47a7b9923618bf451ffc P 76fb155ade354ee1ba78673e73b28aca: Bootstrap starting.
I20260709 13:13:39.706293 31699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb28788823d4c5fab527f4ee2da4d2e" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:39.707502 31920 raft_consensus.cc:2749] T b262a50e82034c57a4bfb7da683ff5d1 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:39.704191 31627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b262a50e82034c57a4bfb7da683ff5d1" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31"
W20260709 13:13:39.708516 31668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:37919, user_credentials={real_user=slave}} blocked reactor thread for 72923.4us
W20260709 13:13:39.711020 31446 leader_election.cc:343] T 22ba83039f2d4e2c9089947b949a1790 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:39.720458 31700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b262a50e82034c57a4bfb7da683ff5d1" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca"
W20260709 13:13:39.707437 31669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:35791, user_credentials={real_user=slave}} blocked reactor thread for 73909.7us
I20260709 13:13:39.721485 31748 raft_consensus.cc:359] T b262a50e82034c57a4bfb7da683ff5d1 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:39.732487 31748 raft_consensus.cc:385] T b262a50e82034c57a4bfb7da683ff5d1 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.728735 31479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b0a29c38284391bdaea82edf99c771" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:39.732919 31748 raft_consensus.cc:740] T b262a50e82034c57a4bfb7da683ff5d1 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.709118 31702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba83039f2d4e2c9089947b949a1790" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:39.736543 31750 tablet_bootstrap.cc:492] T 1fb28788823d4c5fab527f4ee2da4d2e P 458d610e8abf4f2ea831ab7bf3576da6: No bootstrap required, opened a new log
I20260709 13:13:39.736776 31702 raft_consensus.cc:2468] T 22ba83039f2d4e2c9089947b949a1790 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 0.
I20260709 13:13:39.737062 31750 ts_tablet_manager.cc:1403] T 1fb28788823d4c5fab527f4ee2da4d2e P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.193s	user 0.028s	sys 0.024s
I20260709 13:13:39.738279 31669 leader_election.cc:304] T 0550046442d4469c96ad37cbbb191915 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca, c74453754ee34bea9b231ae318a55a31; no voters: 196d972917fe4f85985e3862d40b7596
I20260709 13:13:39.708549 32077 raft_consensus.cc:2804] T fb4f7292ed2f489e922ca5fb1c6e47bf P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:39.739315 32077 raft_consensus.cc:697] T fb4f7292ed2f489e922ca5fb1c6e47bf P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 LEADER]: Becoming Leader. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Running, Role: LEADER
I20260709 13:13:39.739507 31669 leader_election.cc:304] T fb97ca15f56b46dd846db7b0ff156a32 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca; no voters: 196d972917fe4f85985e3862d40b7596, c74453754ee34bea9b231ae318a55a31
I20260709 13:13:39.737016 31477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb28788823d4c5fab527f4ee2da4d2e" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:39.740432 32091 raft_consensus.cc:2749] T fb97ca15f56b46dd846db7b0ff156a32 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:39.740162 32077 consensus_queue.cc:237] T fb4f7292ed2f489e922ca5fb1c6e47bf P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:39.739652 32089 raft_consensus.cc:2804] T 0550046442d4469c96ad37cbbb191915 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:39.742422 31750 raft_consensus.cc:359] T 1fb28788823d4c5fab527f4ee2da4d2e P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:39.774273 31750 raft_consensus.cc:385] T 1fb28788823d4c5fab527f4ee2da4d2e P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.774607 31750 raft_consensus.cc:740] T 1fb28788823d4c5fab527f4ee2da4d2e P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.743328 31748 consensus_queue.cc:260] T b262a50e82034c57a4bfb7da683ff5d1 P c74453754ee34bea9b231ae318a55a31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
W20260709 13:13:39.743992 31595 leader_election.cc:343] T 1fb28788823d4c5fab527f4ee2da4d2e P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:39.777232 31748 ts_tablet_manager.cc:1434] T b262a50e82034c57a4bfb7da683ff5d1 P c74453754ee34bea9b231ae318a55a31: Time spent starting tablet: real 0.098s	user 0.008s	sys 0.000s
I20260709 13:13:39.777547 31627 raft_consensus.cc:3060] T b262a50e82034c57a4bfb7da683ff5d1 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.778290 31748 tablet_bootstrap.cc:492] T 22ba83039f2d4e2c9089947b949a1790 P c74453754ee34bea9b231ae318a55a31: Bootstrap starting.
I20260709 13:13:39.782078 31750 consensus_queue.cc:260] T 1fb28788823d4c5fab527f4ee2da4d2e P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:39.783834 32089 raft_consensus.cc:697] T 0550046442d4469c96ad37cbbb191915 P 76fb155ade354ee1ba78673e73b28aca [term 1 LEADER]: Becoming Leader. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Running, Role: LEADER
I20260709 13:13:39.784255 31750 ts_tablet_manager.cc:1434] T 1fb28788823d4c5fab527f4ee2da4d2e P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.046s	user 0.005s	sys 0.000s
I20260709 13:13:39.785225 31750 tablet_bootstrap.cc:492] T 35bbba26df1b47a7b9923618bf451ffc P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:39.754058 32098 raft_consensus.cc:515] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:39.763756 31700 raft_consensus.cc:2393] T b262a50e82034c57a4bfb7da683ff5d1 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 458d610e8abf4f2ea831ab7bf3576da6 in current term 1: Already voted for candidate 76fb155ade354ee1ba78673e73b28aca in this term.
I20260709 13:13:39.769069 31446 leader_election.cc:304] T 22ba83039f2d4e2c9089947b949a1790 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca; no voters: c74453754ee34bea9b231ae318a55a31
I20260709 13:13:39.784724 32089 consensus_queue.cc:237] T 0550046442d4469c96ad37cbbb191915 P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:39.786863 31747 tablet_bootstrap.cc:654] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 196d972917fe4f85985e3862d40b7596: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:39.748467 31520 leader_election.cc:304] T 88b0a29c38284391bdaea82edf99c771 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 196d972917fe4f85985e3862d40b7596; no voters: 458d610e8abf4f2ea831ab7bf3576da6, c74453754ee34bea9b231ae318a55a31
I20260709 13:13:39.788177 31376 catalog_manager.cc:5697] T 497217e9b47244fcb425c66935cb8a20 P 458d610e8abf4f2ea831ab7bf3576da6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65). New cstate: current_term: 1 leader_uuid: "458d610e8abf4f2ea831ab7bf3576da6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:39.789880 31477 raft_consensus.cc:2468] T 1fb28788823d4c5fab527f4ee2da4d2e P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 0.
I20260709 13:13:39.798184 32088 raft_consensus.cc:2804] T 22ba83039f2d4e2c9089947b949a1790 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:39.804864 32088 raft_consensus.cc:493] T 22ba83039f2d4e2c9089947b949a1790 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:39.805266 32088 raft_consensus.cc:3060] T 22ba83039f2d4e2c9089947b949a1790 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.805622 31700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2a6746f9b2f4b1ab287b9e8f4c51106" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca"
I20260709 13:13:39.806087 31594 leader_election.cc:304] T 1fb28788823d4c5fab527f4ee2da4d2e P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, c74453754ee34bea9b231ae318a55a31; no voters: 76fb155ade354ee1ba78673e73b28aca
I20260709 13:13:39.806906 31750 tablet_bootstrap.cc:654] T 35bbba26df1b47a7b9923618bf451ffc P 458d610e8abf4f2ea831ab7bf3576da6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:39.807289 31857 raft_consensus.cc:2804] T 1fb28788823d4c5fab527f4ee2da4d2e P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:39.807695 31857 raft_consensus.cc:493] T 1fb28788823d4c5fab527f4ee2da4d2e P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:39.808018 31857 raft_consensus.cc:3060] T 1fb28788823d4c5fab527f4ee2da4d2e P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.798635 32076 raft_consensus.cc:493] T 0c12bd32cd944ce99a18fc4f9617961e P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.806322 31700 raft_consensus.cc:3060] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.811242 32076 raft_consensus.cc:515] T 0c12bd32cd944ce99a18fc4f9617961e P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:39.819044 32076 leader_election.cc:290] T 0c12bd32cd944ce99a18fc4f9617961e P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:39.819510 31627 raft_consensus.cc:2468] T b262a50e82034c57a4bfb7da683ff5d1 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 1.
I20260709 13:13:39.826380 31748 tablet_bootstrap.cc:654] T 22ba83039f2d4e2c9089947b949a1790 P c74453754ee34bea9b231ae318a55a31: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:39.816253 32079 raft_consensus.cc:3060] T 88b0a29c38284391bdaea82edf99c771 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:39.830281 31520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:37919, user_credentials={real_user=slave}} blocked reactor thread for 81901.1us
I20260709 13:13:39.833705 31857 raft_consensus.cc:515] T 1fb28788823d4c5fab527f4ee2da4d2e P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:39.834168 31550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c12bd32cd944ce99a18fc4f9617961e" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:39.838097 31749 tablet_bootstrap.cc:654] T 35bbba26df1b47a7b9923618bf451ffc P 76fb155ade354ee1ba78673e73b28aca: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:39.838196 31446 leader_election.cc:304] T b262a50e82034c57a4bfb7da683ff5d1 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, c74453754ee34bea9b231ae318a55a31; no voters: 76fb155ade354ee1ba78673e73b28aca
I20260709 13:13:39.840358 31990 raft_consensus.cc:2804] T b262a50e82034c57a4bfb7da683ff5d1 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:39.842911 31857 leader_election.cc:290] T 1fb28788823d4c5fab527f4ee2da4d2e P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 election: Requested vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:39.845273 31990 raft_consensus.cc:697] T b262a50e82034c57a4bfb7da683ff5d1 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 LEADER]: Becoming Leader. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Running, Role: LEADER
I20260709 13:13:39.854223 31990 consensus_queue.cc:237] T b262a50e82034c57a4bfb7da683ff5d1 P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:39.846299 31476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb28788823d4c5fab527f4ee2da4d2e" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
I20260709 13:13:39.846586 32091 raft_consensus.cc:493] T 0f01040b42e14f0db6bcd06319237ddb P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:39.846789 31443 leader_election.cc:343] T 0c12bd32cd944ce99a18fc4f9617961e P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:39.846747 31551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2a6746f9b2f4b1ab287b9e8f4c51106" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596"
I20260709 13:13:39.850350 31627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c12bd32cd944ce99a18fc4f9617961e" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:39.858345 31476 raft_consensus.cc:3060] T 1fb28788823d4c5fab527f4ee2da4d2e P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:39.866532 31443 leader_election.cc:343] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:39.805696 32098 leader_election.cc:290] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 election: Requested vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:39.857604 31699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb28788823d4c5fab527f4ee2da4d2e" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca"
I20260709 13:13:39.861956 32091 raft_consensus.cc:515] T 0f01040b42e14f0db6bcd06319237ddb P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:39.884101 32091 leader_election.cc:290] T 0f01040b42e14f0db6bcd06319237ddb P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:39.864315 31627 raft_consensus.cc:2468] T 0c12bd32cd944ce99a18fc4f9617961e P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 0.
W20260709 13:13:39.885495 31595 leader_election.cc:343] T 1fb28788823d4c5fab527f4ee2da4d2e P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:39.885707 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f01040b42e14f0db6bcd06319237ddb" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:39.886715 31446 leader_election.cc:304] T 0c12bd32cd944ce99a18fc4f9617961e P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, c74453754ee34bea9b231ae318a55a31; no voters: 196d972917fe4f85985e3862d40b7596
W20260709 13:13:39.887257 31669 leader_election.cc:343] T 0f01040b42e14f0db6bcd06319237ddb P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:39.888027 32082 raft_consensus.cc:2804] T 0c12bd32cd944ce99a18fc4f9617961e P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:39.888419 32079 raft_consensus.cc:2749] T 88b0a29c38284391bdaea82edf99c771 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:39.888441 32082 raft_consensus.cc:493] T 0c12bd32cd944ce99a18fc4f9617961e P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:39.888489 31551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f01040b42e14f0db6bcd06319237ddb" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:39.889861 32082 raft_consensus.cc:3060] T 0c12bd32cd944ce99a18fc4f9617961e P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:39.891270 31666 leader_election.cc:343] T 0f01040b42e14f0db6bcd06319237ddb P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:39.891738 31666 leader_election.cc:304] T 0f01040b42e14f0db6bcd06319237ddb P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca; no voters: 196d972917fe4f85985e3862d40b7596, c74453754ee34bea9b231ae318a55a31
I20260709 13:13:39.852640 32088 raft_consensus.cc:515] T 22ba83039f2d4e2c9089947b949a1790 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:39.892444 32075 raft_consensus.cc:2749] T 0f01040b42e14f0db6bcd06319237ddb P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:39.896235 32088 leader_election.cc:290] T 22ba83039f2d4e2c9089947b949a1790 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 election: Requested vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715)
I20260709 13:13:39.876993 31476 raft_consensus.cc:2468] T 1fb28788823d4c5fab527f4ee2da4d2e P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 1.
I20260709 13:13:39.897787 31594 leader_election.cc:304] T 1fb28788823d4c5fab527f4ee2da4d2e P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, c74453754ee34bea9b231ae318a55a31; no voters: 76fb155ade354ee1ba78673e73b28aca
I20260709 13:13:39.898203 31699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba83039f2d4e2c9089947b949a1790" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca"
I20260709 13:13:39.898809 31699 raft_consensus.cc:3060] T 22ba83039f2d4e2c9089947b949a1790 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.900076 31700 raft_consensus.cc:2468] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 1.
I20260709 13:13:39.901918 31446 leader_election.cc:304] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca; no voters: 196d972917fe4f85985e3862d40b7596
I20260709 13:13:39.905486 32088 raft_consensus.cc:2804] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:39.902644 32033 raft_consensus.cc:2804] T 1fb28788823d4c5fab527f4ee2da4d2e P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:39.907323 32033 raft_consensus.cc:697] T 1fb28788823d4c5fab527f4ee2da4d2e P c74453754ee34bea9b231ae318a55a31 [term 1 LEADER]: Becoming Leader. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Running, Role: LEADER
I20260709 13:13:39.903465 31378 catalog_manager.cc:5697] T 0550046442d4469c96ad37cbbb191915 P 76fb155ade354ee1ba78673e73b28aca reported cstate change: term changed from 0 to 1, leader changed from <none> to 76fb155ade354ee1ba78673e73b28aca (127.23.140.68). New cstate: current_term: 1 leader_uuid: "76fb155ade354ee1ba78673e73b28aca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:39.909145 32088 raft_consensus.cc:697] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 LEADER]: Becoming Leader. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Running, Role: LEADER
I20260709 13:13:39.909487 32033 consensus_queue.cc:237] T 1fb28788823d4c5fab527f4ee2da4d2e P c74453754ee34bea9b231ae318a55a31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:39.910656 32088 consensus_queue.cc:237] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:39.915830 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba83039f2d4e2c9089947b949a1790" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31"
W20260709 13:13:39.917129 31446 leader_election.cc:343] T 22ba83039f2d4e2c9089947b949a1790 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:39.920569 32076 consensus_queue.cc:1048] T 88b0a29c38284391bdaea82edf99c771 P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:39.931792 31699 raft_consensus.cc:2468] T 22ba83039f2d4e2c9089947b949a1790 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 1.
I20260709 13:13:39.933017 31446 leader_election.cc:304] T 22ba83039f2d4e2c9089947b949a1790 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca; no voters: c74453754ee34bea9b231ae318a55a31
I20260709 13:13:39.936441 32076 raft_consensus.cc:2804] T 22ba83039f2d4e2c9089947b949a1790 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:39.936944 32076 raft_consensus.cc:697] T 22ba83039f2d4e2c9089947b949a1790 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 LEADER]: Becoming Leader. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Running, Role: LEADER
I20260709 13:13:39.939263 31748 tablet_bootstrap.cc:492] T 22ba83039f2d4e2c9089947b949a1790 P c74453754ee34bea9b231ae318a55a31: No bootstrap required, opened a new log
I20260709 13:13:39.939155 32076 consensus_queue.cc:237] T 22ba83039f2d4e2c9089947b949a1790 P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:39.939816 31748 ts_tablet_manager.cc:1403] T 22ba83039f2d4e2c9089947b949a1790 P c74453754ee34bea9b231ae318a55a31: Time spent bootstrapping tablet: real 0.162s	user 0.014s	sys 0.001s
I20260709 13:13:39.940917 31750 tablet_bootstrap.cc:492] T 35bbba26df1b47a7b9923618bf451ffc P 458d610e8abf4f2ea831ab7bf3576da6: No bootstrap required, opened a new log
I20260709 13:13:39.941412 31750 ts_tablet_manager.cc:1403] T 35bbba26df1b47a7b9923618bf451ffc P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.156s	user 0.009s	sys 0.004s
I20260709 13:13:39.939262 31747 tablet_bootstrap.cc:492] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 196d972917fe4f85985e3862d40b7596: No bootstrap required, opened a new log
I20260709 13:13:39.943221 31747 ts_tablet_manager.cc:1403] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 196d972917fe4f85985e3862d40b7596: Time spent bootstrapping tablet: real 0.303s	user 0.021s	sys 0.041s
I20260709 13:13:39.942569 31748 raft_consensus.cc:359] T 22ba83039f2d4e2c9089947b949a1790 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:39.944211 31748 raft_consensus.cc:385] T 22ba83039f2d4e2c9089947b949a1790 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.944592 31748 raft_consensus.cc:740] T 22ba83039f2d4e2c9089947b949a1790 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.946185 31748 consensus_queue.cc:260] T 22ba83039f2d4e2c9089947b949a1790 P c74453754ee34bea9b231ae318a55a31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:39.947865 31749 tablet_bootstrap.cc:492] T 35bbba26df1b47a7b9923618bf451ffc P 76fb155ade354ee1ba78673e73b28aca: No bootstrap required, opened a new log
I20260709 13:13:39.948379 31749 ts_tablet_manager.cc:1403] T 35bbba26df1b47a7b9923618bf451ffc P 76fb155ade354ee1ba78673e73b28aca: Time spent bootstrapping tablet: real 0.243s	user 0.025s	sys 0.001s
I20260709 13:13:39.951470 31748 ts_tablet_manager.cc:1434] T 22ba83039f2d4e2c9089947b949a1790 P c74453754ee34bea9b231ae318a55a31: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:13:39.953331 31748 tablet_bootstrap.cc:492] T 0f01040b42e14f0db6bcd06319237ddb P c74453754ee34bea9b231ae318a55a31: Bootstrap starting.
I20260709 13:13:39.955490 31750 raft_consensus.cc:359] T 35bbba26df1b47a7b9923618bf451ffc P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:39.957082 31750 raft_consensus.cc:385] T 35bbba26df1b47a7b9923618bf451ffc P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.957419 31750 raft_consensus.cc:740] T 35bbba26df1b47a7b9923618bf451ffc P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.958277 31750 consensus_queue.cc:260] T 35bbba26df1b47a7b9923618bf451ffc P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:39.962430 31749 raft_consensus.cc:359] T 35bbba26df1b47a7b9923618bf451ffc P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:39.963344 31749 raft_consensus.cc:385] T 35bbba26df1b47a7b9923618bf451ffc P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.963649 31749 raft_consensus.cc:740] T 35bbba26df1b47a7b9923618bf451ffc P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.931813 32082 raft_consensus.cc:515] T 0c12bd32cd944ce99a18fc4f9617961e P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:39.972236 31747 raft_consensus.cc:359] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:39.973050 31747 raft_consensus.cc:385] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.973428 31747 raft_consensus.cc:740] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 196d972917fe4f85985e3862d40b7596, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.979980 31747 consensus_queue.cc:260] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 196d972917fe4f85985e3862d40b7596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:39.982089 31551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c12bd32cd944ce99a18fc4f9617961e" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596"
I20260709 13:13:39.983461 31747 ts_tablet_manager.cc:1434] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 196d972917fe4f85985e3862d40b7596: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.000s
I20260709 13:13:39.984550 31747 tablet_bootstrap.cc:492] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 196d972917fe4f85985e3862d40b7596: Bootstrap starting.
I20260709 13:13:39.985721 31748 tablet_bootstrap.cc:654] T 0f01040b42e14f0db6bcd06319237ddb P c74453754ee34bea9b231ae318a55a31: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:39.979878 31378 catalog_manager.cc:5697] T 1fb28788823d4c5fab527f4ee2da4d2e P c74453754ee34bea9b231ae318a55a31 reported cstate change: term changed from 0 to 1, leader changed from <none> to c74453754ee34bea9b231ae318a55a31 (127.23.140.67). New cstate: current_term: 1 leader_uuid: "c74453754ee34bea9b231ae318a55a31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:39.971550 31749 consensus_queue.cc:260] T 35bbba26df1b47a7b9923618bf451ffc P 76fb155ade354ee1ba78673e73b28aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
W20260709 13:13:39.989706 31443 leader_election.cc:343] T 0c12bd32cd944ce99a18fc4f9617961e P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:39.990749 31750 ts_tablet_manager.cc:1434] T 35bbba26df1b47a7b9923618bf451ffc P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.000s
I20260709 13:13:39.992163 31750 tablet_bootstrap.cc:492] T 8a98dff441f1479992f85708c9f03283 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:40.000180 32033 consensus_queue.cc:1048] T 6038006ca0e344af86fe5febd517c62a P c74453754ee34bea9b231ae318a55a31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:40.006181 31749 ts_tablet_manager.cc:1434] T 35bbba26df1b47a7b9923618bf451ffc P 76fb155ade354ee1ba78673e73b28aca: Time spent starting tablet: real 0.058s	user 0.008s	sys 0.001s
I20260709 13:13:40.011133 32033 consensus_queue.cc:1048] T 6038006ca0e344af86fe5febd517c62a P c74453754ee34bea9b231ae318a55a31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:40.006132 32076 raft_consensus.cc:493] T 35bbba26df1b47a7b9923618bf451ffc P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.012240 32076 raft_consensus.cc:515] T 35bbba26df1b47a7b9923618bf451ffc P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:40.013805 31749 tablet_bootstrap.cc:492] T 1fb28788823d4c5fab527f4ee2da4d2e P 76fb155ade354ee1ba78673e73b28aca: Bootstrap starting.
I20260709 13:13:40.014497 32076 leader_election.cc:290] T 35bbba26df1b47a7b9923618bf451ffc P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:40.015954 31700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35bbba26df1b47a7b9923618bf451ffc" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:40.016561 31551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35bbba26df1b47a7b9923618bf451ffc" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:40.016956 32082 leader_election.cc:290] T 0c12bd32cd944ce99a18fc4f9617961e P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 election: Requested vote from peers 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
W20260709 13:13:40.018085 31443 leader_election.cc:343] T 35bbba26df1b47a7b9923618bf451ffc P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:40.016601 31700 raft_consensus.cc:2468] T 35bbba26df1b47a7b9923618bf451ffc P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 0.
I20260709 13:13:40.020041 31446 leader_election.cc:304] T 35bbba26df1b47a7b9923618bf451ffc P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca; no voters: 196d972917fe4f85985e3862d40b7596
I20260709 13:13:40.021245 32088 raft_consensus.cc:2804] T 35bbba26df1b47a7b9923618bf451ffc P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:40.021675 32088 raft_consensus.cc:493] T 35bbba26df1b47a7b9923618bf451ffc P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:40.022244 32088 raft_consensus.cc:3060] T 35bbba26df1b47a7b9923618bf451ffc P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:40.023752 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c12bd32cd944ce99a18fc4f9617961e" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31"
I20260709 13:13:40.024437 31624 raft_consensus.cc:3060] T 0c12bd32cd944ce99a18fc4f9617961e P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:40.025221 31750 tablet_bootstrap.cc:654] T 8a98dff441f1479992f85708c9f03283 P 458d610e8abf4f2ea831ab7bf3576da6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.026610 31749 tablet_bootstrap.cc:654] T 1fb28788823d4c5fab527f4ee2da4d2e P 76fb155ade354ee1ba78673e73b28aca: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.029470 31747 tablet_bootstrap.cc:654] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 196d972917fe4f85985e3862d40b7596: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.033706 31748 tablet_bootstrap.cc:492] T 0f01040b42e14f0db6bcd06319237ddb P c74453754ee34bea9b231ae318a55a31: No bootstrap required, opened a new log
I20260709 13:13:40.034181 31748 ts_tablet_manager.cc:1403] T 0f01040b42e14f0db6bcd06319237ddb P c74453754ee34bea9b231ae318a55a31: Time spent bootstrapping tablet: real 0.081s	user 0.011s	sys 0.000s
I20260709 13:13:40.036983 31748 raft_consensus.cc:359] T 0f01040b42e14f0db6bcd06319237ddb P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:40.037618 31748 raft_consensus.cc:385] T 0f01040b42e14f0db6bcd06319237ddb P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.037923 31748 raft_consensus.cc:740] T 0f01040b42e14f0db6bcd06319237ddb P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.038650 31748 consensus_queue.cc:260] T 0f01040b42e14f0db6bcd06319237ddb P c74453754ee34bea9b231ae318a55a31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:40.040450 32088 raft_consensus.cc:515] T 35bbba26df1b47a7b9923618bf451ffc P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:40.040477 31748 ts_tablet_manager.cc:1434] T 0f01040b42e14f0db6bcd06319237ddb P c74453754ee34bea9b231ae318a55a31: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:13:40.059157 31749 tablet_bootstrap.cc:492] T 1fb28788823d4c5fab527f4ee2da4d2e P 76fb155ade354ee1ba78673e73b28aca: No bootstrap required, opened a new log
I20260709 13:13:40.059716 31749 ts_tablet_manager.cc:1403] T 1fb28788823d4c5fab527f4ee2da4d2e P 76fb155ade354ee1ba78673e73b28aca: Time spent bootstrapping tablet: real 0.046s	user 0.013s	sys 0.007s
I20260709 13:13:40.062427 31749 raft_consensus.cc:359] T 1fb28788823d4c5fab527f4ee2da4d2e P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:40.063090 31749 raft_consensus.cc:385] T 1fb28788823d4c5fab527f4ee2da4d2e P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.063339 31749 raft_consensus.cc:740] T 1fb28788823d4c5fab527f4ee2da4d2e P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.064098 31749 consensus_queue.cc:260] T 1fb28788823d4c5fab527f4ee2da4d2e P 76fb155ade354ee1ba78673e73b28aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:40.066260 31750 tablet_bootstrap.cc:492] T 8a98dff441f1479992f85708c9f03283 P 458d610e8abf4f2ea831ab7bf3576da6: No bootstrap required, opened a new log
I20260709 13:13:40.066370 31749 ts_tablet_manager.cc:1434] T 1fb28788823d4c5fab527f4ee2da4d2e P 76fb155ade354ee1ba78673e73b28aca: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.003s
I20260709 13:13:40.066893 31750 ts_tablet_manager.cc:1403] T 8a98dff441f1479992f85708c9f03283 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.075s	user 0.006s	sys 0.006s
I20260709 13:13:40.067566 31749 tablet_bootstrap.cc:492] T ddbfc15d5bf24708a4268dfa206ede07 P 76fb155ade354ee1ba78673e73b28aca: Bootstrap starting.
I20260709 13:13:40.069468 31750 raft_consensus.cc:359] T 8a98dff441f1479992f85708c9f03283 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:40.070399 31750 raft_consensus.cc:385] T 8a98dff441f1479992f85708c9f03283 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.070667 31750 raft_consensus.cc:740] T 8a98dff441f1479992f85708c9f03283 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.079878 31749 tablet_bootstrap.cc:654] T ddbfc15d5bf24708a4268dfa206ede07 P 76fb155ade354ee1ba78673e73b28aca: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.080489 32032 raft_consensus.cc:493] T 1fb28788823d4c5fab527f4ee2da4d2e P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.081163 32032 raft_consensus.cc:515] T 1fb28788823d4c5fab527f4ee2da4d2e P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:40.084154 31804 raft_consensus.cc:493] T fb4f7292ed2f489e922ca5fb1c6e47bf P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.084722 31804 raft_consensus.cc:515] T fb4f7292ed2f489e922ca5fb1c6e47bf P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:40.009104 31375 catalog_manager.cc:5697] T 88b0a29c38284391bdaea82edf99c771 P 458d610e8abf4f2ea831ab7bf3576da6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65). New cstate: current_term: 1 leader_uuid: "458d610e8abf4f2ea831ab7bf3576da6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:40.091495 31804 leader_election.cc:290] T fb4f7292ed2f489e922ca5fb1c6e47bf P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:40.094187 31750 consensus_queue.cc:260] T 8a98dff441f1479992f85708c9f03283 P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:40.095140 31748 tablet_bootstrap.cc:492] T ddbfc15d5bf24708a4268dfa206ede07 P c74453754ee34bea9b231ae318a55a31: Bootstrap starting.
I20260709 13:13:40.096153 31699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35bbba26df1b47a7b9923618bf451ffc" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca"
I20260709 13:13:40.096755 31699 raft_consensus.cc:3060] T 35bbba26df1b47a7b9923618bf451ffc P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:40.098768 31624 raft_consensus.cc:2468] T 0c12bd32cd944ce99a18fc4f9617961e P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 1.
I20260709 13:13:40.100584 32032 leader_election.cc:290] T 1fb28788823d4c5fab527f4ee2da4d2e P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:40.101403 31476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4f7292ed2f489e922ca5fb1c6e47bf" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:40.101437 32088 leader_election.cc:290] T 35bbba26df1b47a7b9923618bf451ffc P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 election: Requested vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:40.107537 31477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb28788823d4c5fab527f4ee2da4d2e" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:40.113507 31477 raft_consensus.cc:2393] T 1fb28788823d4c5fab527f4ee2da4d2e P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 76fb155ade354ee1ba78673e73b28aca in current term 1: Already voted for candidate c74453754ee34bea9b231ae318a55a31 in this term.
I20260709 13:13:40.108908 31700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4f7292ed2f489e922ca5fb1c6e47bf" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:40.116104 31700 raft_consensus.cc:2393] T fb4f7292ed2f489e922ca5fb1c6e47bf P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 196d972917fe4f85985e3862d40b7596 in current term 1: Already voted for candidate 458d610e8abf4f2ea831ab7bf3576da6 in this term.
I20260709 13:13:40.117274 31550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35bbba26df1b47a7b9923618bf451ffc" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596"
I20260709 13:13:40.117729 31521 leader_election.cc:304] T fb4f7292ed2f489e922ca5fb1c6e47bf P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 196d972917fe4f85985e3862d40b7596; no voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca
I20260709 13:13:40.118350 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb28788823d4c5fab527f4ee2da4d2e" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
W20260709 13:13:40.118871 31443 leader_election.cc:343] T 35bbba26df1b47a7b9923618bf451ffc P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:40.122210 32079 raft_consensus.cc:3060] T fb4f7292ed2f489e922ca5fb1c6e47bf P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:40.123731 31699 raft_consensus.cc:2468] T 35bbba26df1b47a7b9923618bf451ffc P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 1.
I20260709 13:13:40.130184 31750 ts_tablet_manager.cc:1434] T 8a98dff441f1479992f85708c9f03283 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.063s	user 0.007s	sys 0.000s
I20260709 13:13:40.140954 32082 consensus_queue.cc:1048] T 88b0a29c38284391bdaea82edf99c771 P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:40.143831 31375 catalog_manager.cc:5697] T fb4f7292ed2f489e922ca5fb1c6e47bf P 458d610e8abf4f2ea831ab7bf3576da6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65). New cstate: current_term: 1 leader_uuid: "458d610e8abf4f2ea831ab7bf3576da6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:40.146231 31749 tablet_bootstrap.cc:492] T ddbfc15d5bf24708a4268dfa206ede07 P 76fb155ade354ee1ba78673e73b28aca: No bootstrap required, opened a new log
I20260709 13:13:40.146762 31749 ts_tablet_manager.cc:1403] T ddbfc15d5bf24708a4268dfa206ede07 P 76fb155ade354ee1ba78673e73b28aca: Time spent bootstrapping tablet: real 0.080s	user 0.026s	sys 0.011s
I20260709 13:13:40.149434 31749 raft_consensus.cc:359] T ddbfc15d5bf24708a4268dfa206ede07 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:40.150090 31749 raft_consensus.cc:385] T ddbfc15d5bf24708a4268dfa206ede07 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.150350 31749 raft_consensus.cc:740] T ddbfc15d5bf24708a4268dfa206ede07 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.150974 31749 consensus_queue.cc:260] T ddbfc15d5bf24708a4268dfa206ede07 P 76fb155ade354ee1ba78673e73b28aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:40.152388 31375 catalog_manager.cc:5697] T b262a50e82034c57a4bfb7da683ff5d1 P 458d610e8abf4f2ea831ab7bf3576da6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65). New cstate: current_term: 1 leader_uuid: "458d610e8abf4f2ea831ab7bf3576da6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:40.156993 31750 tablet_bootstrap.cc:492] T dcf07174e49c498f8e19fd005690404b P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:40.154646 31747 tablet_bootstrap.cc:492] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 196d972917fe4f85985e3862d40b7596: No bootstrap required, opened a new log
I20260709 13:13:40.157670 31747 ts_tablet_manager.cc:1403] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 196d972917fe4f85985e3862d40b7596: Time spent bootstrapping tablet: real 0.173s	user 0.017s	sys 0.008s
I20260709 13:13:40.141347 32079 raft_consensus.cc:2749] T fb4f7292ed2f489e922ca5fb1c6e47bf P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:40.158133 31748 tablet_bootstrap.cc:654] T ddbfc15d5bf24708a4268dfa206ede07 P c74453754ee34bea9b231ae318a55a31: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.155692 31749 ts_tablet_manager.cc:1434] T ddbfc15d5bf24708a4268dfa206ede07 P 76fb155ade354ee1ba78673e73b28aca: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
W20260709 13:13:40.160995 31446 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:35791, user_credentials={real_user=slave}} blocked reactor thread for 53788.9us
I20260709 13:13:40.161703 31749 tablet_bootstrap.cc:492] T 70ccde113c9246f5a008add70aacae7d P 76fb155ade354ee1ba78673e73b28aca: Bootstrap starting.
I20260709 13:13:40.164769 31668 leader_election.cc:304] T 1fb28788823d4c5fab527f4ee2da4d2e P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca; no voters: 458d610e8abf4f2ea831ab7bf3576da6, c74453754ee34bea9b231ae318a55a31
I20260709 13:13:40.165835 32032 raft_consensus.cc:3060] T 1fb28788823d4c5fab527f4ee2da4d2e P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:40.168426 31749 tablet_bootstrap.cc:654] T 70ccde113c9246f5a008add70aacae7d P 76fb155ade354ee1ba78673e73b28aca: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.169677 31750 tablet_bootstrap.cc:654] T dcf07174e49c498f8e19fd005690404b P 458d610e8abf4f2ea831ab7bf3576da6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.175751 32032 raft_consensus.cc:2749] T 1fb28788823d4c5fab527f4ee2da4d2e P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:40.178030 31748 tablet_bootstrap.cc:492] T ddbfc15d5bf24708a4268dfa206ede07 P c74453754ee34bea9b231ae318a55a31: No bootstrap required, opened a new log
I20260709 13:13:40.178722 31748 ts_tablet_manager.cc:1403] T ddbfc15d5bf24708a4268dfa206ede07 P c74453754ee34bea9b231ae318a55a31: Time spent bootstrapping tablet: real 0.090s	user 0.014s	sys 0.000s
I20260709 13:13:40.180536 31446 leader_election.cc:304] T 35bbba26df1b47a7b9923618bf451ffc P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca; no voters: 196d972917fe4f85985e3862d40b7596
I20260709 13:13:40.192142 31748 raft_consensus.cc:359] T ddbfc15d5bf24708a4268dfa206ede07 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:40.193971 31990 raft_consensus.cc:2804] T 35bbba26df1b47a7b9923618bf451ffc P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:40.194162 31749 tablet_bootstrap.cc:492] T 70ccde113c9246f5a008add70aacae7d P 76fb155ade354ee1ba78673e73b28aca: No bootstrap required, opened a new log
I20260709 13:13:40.202829 31749 ts_tablet_manager.cc:1403] T 70ccde113c9246f5a008add70aacae7d P 76fb155ade354ee1ba78673e73b28aca: Time spent bootstrapping tablet: real 0.041s	user 0.006s	sys 0.011s
I20260709 13:13:40.204711 31750 tablet_bootstrap.cc:492] T dcf07174e49c498f8e19fd005690404b P 458d610e8abf4f2ea831ab7bf3576da6: No bootstrap required, opened a new log
I20260709 13:13:40.205386 31750 ts_tablet_manager.cc:1403] T dcf07174e49c498f8e19fd005690404b P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.062s	user 0.014s	sys 0.014s
I20260709 13:13:40.205650 31749 raft_consensus.cc:359] T 70ccde113c9246f5a008add70aacae7d P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:40.208349 31750 raft_consensus.cc:359] T dcf07174e49c498f8e19fd005690404b P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:40.209019 31750 raft_consensus.cc:385] T dcf07174e49c498f8e19fd005690404b P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.209304 31750 raft_consensus.cc:740] T dcf07174e49c498f8e19fd005690404b P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.209933 31750 consensus_queue.cc:260] T dcf07174e49c498f8e19fd005690404b P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:40.210681 31446 leader_election.cc:304] T 0c12bd32cd944ce99a18fc4f9617961e P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, c74453754ee34bea9b231ae318a55a31; no voters: 196d972917fe4f85985e3862d40b7596
I20260709 13:13:40.211419 31990 raft_consensus.cc:697] T 35bbba26df1b47a7b9923618bf451ffc P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 LEADER]: Becoming Leader. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Running, Role: LEADER
I20260709 13:13:40.211680 32077 raft_consensus.cc:2804] T 0c12bd32cd944ce99a18fc4f9617961e P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:40.212210 32077 raft_consensus.cc:697] T 0c12bd32cd944ce99a18fc4f9617961e P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 LEADER]: Becoming Leader. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Running, Role: LEADER
I20260709 13:13:40.212339 31990 consensus_queue.cc:237] T 35bbba26df1b47a7b9923618bf451ffc P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:40.213060 31750 ts_tablet_manager.cc:1434] T dcf07174e49c498f8e19fd005690404b P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:13:40.213114 32077 consensus_queue.cc:237] T 0c12bd32cd944ce99a18fc4f9617961e P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:40.214314 31750 tablet_bootstrap.cc:492] T ddbfc15d5bf24708a4268dfa206ede07 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:40.206390 31749 raft_consensus.cc:385] T 70ccde113c9246f5a008add70aacae7d P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.216609 31749 raft_consensus.cc:740] T 70ccde113c9246f5a008add70aacae7d P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.217411 31749 consensus_queue.cc:260] T 70ccde113c9246f5a008add70aacae7d P 76fb155ade354ee1ba78673e73b28aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:40.160594 31747 raft_consensus.cc:359] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:40.218266 31747 raft_consensus.cc:385] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.218545 31747 raft_consensus.cc:740] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 196d972917fe4f85985e3862d40b7596, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.219218 31747 consensus_queue.cc:260] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 196d972917fe4f85985e3862d40b7596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:40.221458 31749 ts_tablet_manager.cc:1434] T 70ccde113c9246f5a008add70aacae7d P 76fb155ade354ee1ba78673e73b28aca: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:13:40.222518 31749 tablet_bootstrap.cc:492] T 3879ebc472ce44d99940e2168e9099bf P 76fb155ade354ee1ba78673e73b28aca: Bootstrap starting.
I20260709 13:13:40.223531 31748 raft_consensus.cc:385] T ddbfc15d5bf24708a4268dfa206ede07 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.223891 31748 raft_consensus.cc:740] T ddbfc15d5bf24708a4268dfa206ede07 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.224179 32127 consensus_queue.cc:1048] T 497217e9b47244fcb425c66935cb8a20 P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:40.224602 31748 consensus_queue.cc:260] T ddbfc15d5bf24708a4268dfa206ede07 P c74453754ee34bea9b231ae318a55a31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:40.225510 31750 tablet_bootstrap.cc:654] T ddbfc15d5bf24708a4268dfa206ede07 P 458d610e8abf4f2ea831ab7bf3576da6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.226773 31748 ts_tablet_manager.cc:1434] T ddbfc15d5bf24708a4268dfa206ede07 P c74453754ee34bea9b231ae318a55a31: Time spent starting tablet: real 0.048s	user 0.009s	sys 0.007s
I20260709 13:13:40.228830 31747 ts_tablet_manager.cc:1434] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 196d972917fe4f85985e3862d40b7596: Time spent starting tablet: real 0.071s	user 0.006s	sys 0.000s
I20260709 13:13:40.229852 31747 tablet_bootstrap.cc:492] T 0550046442d4469c96ad37cbbb191915 P 196d972917fe4f85985e3862d40b7596: Bootstrap starting.
I20260709 13:13:40.230017 32032 consensus_queue.cc:1048] T 0550046442d4469c96ad37cbbb191915 P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:40.238310 32098 raft_consensus.cc:493] T 8a98dff441f1479992f85708c9f03283 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.238821 32098 raft_consensus.cc:515] T 8a98dff441f1479992f85708c9f03283 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:40.240800 32098 leader_election.cc:290] T 8a98dff441f1479992f85708c9f03283 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:40.241350 31759 raft_consensus.cc:493] T ddbfc15d5bf24708a4268dfa206ede07 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.241859 31759 raft_consensus.cc:515] T ddbfc15d5bf24708a4268dfa206ede07 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:40.242390 31554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a98dff441f1479992f85708c9f03283" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:40.243594 31759 leader_election.cc:290] T ddbfc15d5bf24708a4268dfa206ede07 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:40.243920 31747 tablet_bootstrap.cc:654] T 0550046442d4469c96ad37cbbb191915 P 196d972917fe4f85985e3862d40b7596: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:40.243765 31443 leader_election.cc:343] T 8a98dff441f1479992f85708c9f03283 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:40.246071 31699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddbfc15d5bf24708a4268dfa206ede07" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:40.263453 31699 raft_consensus.cc:2468] T ddbfc15d5bf24708a4268dfa206ede07 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 0.
I20260709 13:13:40.249364 31474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddbfc15d5bf24708a4268dfa206ede07" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
W20260709 13:13:40.265684 31594 leader_election.cc:343] T ddbfc15d5bf24708a4268dfa206ede07 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:40.260792 31700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a98dff441f1479992f85708c9f03283" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:40.266572 31700 raft_consensus.cc:2468] T 8a98dff441f1479992f85708c9f03283 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 0.
I20260709 13:13:40.266621 32098 consensus_queue.cc:1048] T 497217e9b47244fcb425c66935cb8a20 P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:40.268774 31750 tablet_bootstrap.cc:492] T ddbfc15d5bf24708a4268dfa206ede07 P 458d610e8abf4f2ea831ab7bf3576da6: No bootstrap required, opened a new log
I20260709 13:13:40.269487 31595 leader_election.cc:304] T ddbfc15d5bf24708a4268dfa206ede07 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca, c74453754ee34bea9b231ae318a55a31; no voters: 458d610e8abf4f2ea831ab7bf3576da6
I20260709 13:13:40.270134 31750 ts_tablet_manager.cc:1403] T ddbfc15d5bf24708a4268dfa206ede07 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.056s	user 0.009s	sys 0.007s
I20260709 13:13:40.268404 31817 raft_consensus.cc:493] T 22ba83039f2d4e2c9089947b949a1790 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.271034 31817 raft_consensus.cc:515] T 22ba83039f2d4e2c9089947b949a1790 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:40.273133 31817 leader_election.cc:290] T 22ba83039f2d4e2c9089947b949a1790 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:40.272979 31750 raft_consensus.cc:359] T ddbfc15d5bf24708a4268dfa206ede07 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:40.273712 31750 raft_consensus.cc:385] T ddbfc15d5bf24708a4268dfa206ede07 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.274098 31750 raft_consensus.cc:740] T ddbfc15d5bf24708a4268dfa206ede07 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.274838 31750 consensus_queue.cc:260] T ddbfc15d5bf24708a4268dfa206ede07 P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:40.275527 31477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba83039f2d4e2c9089947b949a1790" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:40.275553 31446 leader_election.cc:304] T 8a98dff441f1479992f85708c9f03283 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca; no voters: 196d972917fe4f85985e3862d40b7596
I20260709 13:13:40.277202 31750 ts_tablet_manager.cc:1434] T ddbfc15d5bf24708a4268dfa206ede07 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 13:13:40.277587 32098 raft_consensus.cc:2804] T 8a98dff441f1479992f85708c9f03283 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:40.278057 32098 raft_consensus.cc:493] T 8a98dff441f1479992f85708c9f03283 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:40.278313 31750 tablet_bootstrap.cc:492] T cfe1afd9e187451faf5f631e0c2eef00 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:40.278470 32098 raft_consensus.cc:3060] T 8a98dff441f1479992f85708c9f03283 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:40.278321 31700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba83039f2d4e2c9089947b949a1790" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:40.279764 31700 raft_consensus.cc:2393] T 22ba83039f2d4e2c9089947b949a1790 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c74453754ee34bea9b231ae318a55a31 in current term 1: Already voted for candidate 458d610e8abf4f2ea831ab7bf3576da6 in this term.
I20260709 13:13:40.281405 31595 leader_election.cc:304] T 22ba83039f2d4e2c9089947b949a1790 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c74453754ee34bea9b231ae318a55a31; no voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca
I20260709 13:13:40.282292 32033 raft_consensus.cc:3060] T 22ba83039f2d4e2c9089947b949a1790 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:40.273685 31817 raft_consensus.cc:2804] T ddbfc15d5bf24708a4268dfa206ede07 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:40.282886 31817 raft_consensus.cc:493] T ddbfc15d5bf24708a4268dfa206ede07 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:40.283229 31817 raft_consensus.cc:3060] T ddbfc15d5bf24708a4268dfa206ede07 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:40.284899 31750 tablet_bootstrap.cc:654] T cfe1afd9e187451faf5f631e0c2eef00 P 458d610e8abf4f2ea831ab7bf3576da6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.287138 32098 raft_consensus.cc:515] T 8a98dff441f1479992f85708c9f03283 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:40.289086 32033 raft_consensus.cc:2749] T 22ba83039f2d4e2c9089947b949a1790 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:40.291328 31747 tablet_bootstrap.cc:492] T 0550046442d4469c96ad37cbbb191915 P 196d972917fe4f85985e3862d40b7596: No bootstrap required, opened a new log
I20260709 13:13:40.291814 31747 ts_tablet_manager.cc:1403] T 0550046442d4469c96ad37cbbb191915 P 196d972917fe4f85985e3862d40b7596: Time spent bootstrapping tablet: real 0.062s	user 0.011s	sys 0.000s
I20260709 13:13:40.296175 31750 tablet_bootstrap.cc:492] T cfe1afd9e187451faf5f631e0c2eef00 P 458d610e8abf4f2ea831ab7bf3576da6: No bootstrap required, opened a new log
I20260709 13:13:40.296622 31750 ts_tablet_manager.cc:1403] T cfe1afd9e187451faf5f631e0c2eef00 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.005s
I20260709 13:13:40.297219 31747 raft_consensus.cc:359] T 0550046442d4469c96ad37cbbb191915 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:40.297886 31747 raft_consensus.cc:385] T 0550046442d4469c96ad37cbbb191915 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.298141 31747 raft_consensus.cc:740] T 0550046442d4469c96ad37cbbb191915 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 196d972917fe4f85985e3862d40b7596, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.299199 31750 raft_consensus.cc:359] T cfe1afd9e187451faf5f631e0c2eef00 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:40.299861 31750 raft_consensus.cc:385] T cfe1afd9e187451faf5f631e0c2eef00 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.300107 31750 raft_consensus.cc:740] T cfe1afd9e187451faf5f631e0c2eef00 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.300721 31750 consensus_queue.cc:260] T cfe1afd9e187451faf5f631e0c2eef00 P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:40.302470 32127 consensus_queue.cc:1048] T fb4f7292ed2f489e922ca5fb1c6e47bf P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:40.303874 31748 tablet_bootstrap.cc:492] T 3879ebc472ce44d99940e2168e9099bf P c74453754ee34bea9b231ae318a55a31: Bootstrap starting.
I20260709 13:13:40.306694 31700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a98dff441f1479992f85708c9f03283" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca"
I20260709 13:13:40.326287 31700 raft_consensus.cc:3060] T 8a98dff441f1479992f85708c9f03283 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:40.329120 31748 tablet_bootstrap.cc:654] T 3879ebc472ce44d99940e2168e9099bf P c74453754ee34bea9b231ae318a55a31: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.308531 31554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a98dff441f1479992f85708c9f03283" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596"
I20260709 13:13:40.330354 31749 tablet_bootstrap.cc:654] T 3879ebc472ce44d99940e2168e9099bf P 76fb155ade354ee1ba78673e73b28aca: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.332203 32091 raft_consensus.cc:493] T 70ccde113c9246f5a008add70aacae7d P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:40.332995 31443 leader_election.cc:343] T 8a98dff441f1479992f85708c9f03283 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:40.332739 32091 raft_consensus.cc:515] T 70ccde113c9246f5a008add70aacae7d P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:40.336090 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70ccde113c9246f5a008add70aacae7d" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:40.324448 32077 consensus_queue.cc:1048] T fb4f7292ed2f489e922ca5fb1c6e47bf P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
W20260709 13:13:40.337667 31666 consensus_peers.cc:597] T 0550046442d4469c96ad37cbbb191915 P 76fb155ade354ee1ba78673e73b28aca -> Peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Couldn't send request to peer 196d972917fe4f85985e3862d40b7596. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:40.342415 31669 leader_election.cc:343] T 70ccde113c9246f5a008add70aacae7d P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:40.314555 31750 ts_tablet_manager.cc:1434] T cfe1afd9e187451faf5f631e0c2eef00 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 13:13:40.336033 31700 raft_consensus.cc:2468] T 8a98dff441f1479992f85708c9f03283 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 1.
I20260709 13:13:40.345451 31750 tablet_bootstrap.cc:492] T 70ccde113c9246f5a008add70aacae7d P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:40.303908 32098 leader_election.cc:290] T 8a98dff441f1479992f85708c9f03283 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 election: Requested vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:40.314942 31817 raft_consensus.cc:515] T ddbfc15d5bf24708a4268dfa206ede07 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:40.357345 31700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddbfc15d5bf24708a4268dfa206ede07" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca"
I20260709 13:13:40.358474 31817 leader_election.cc:290] T ddbfc15d5bf24708a4268dfa206ede07 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 election: Requested vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:40.350121 32091 leader_election.cc:290] T 70ccde113c9246f5a008add70aacae7d P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:40.361092 31477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddbfc15d5bf24708a4268dfa206ede07" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
I20260709 13:13:40.361743 31477 raft_consensus.cc:3060] T ddbfc15d5bf24708a4268dfa206ede07 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:40.298754 31747 consensus_queue.cc:260] T 0550046442d4469c96ad37cbbb191915 P 196d972917fe4f85985e3862d40b7596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:40.345286 31376 catalog_manager.cc:5697] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 458d610e8abf4f2ea831ab7bf3576da6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65). New cstate: current_term: 1 leader_uuid: "458d610e8abf4f2ea831ab7bf3576da6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:40.358096 31700 raft_consensus.cc:3060] T ddbfc15d5bf24708a4268dfa206ede07 P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:40.369252 31747 ts_tablet_manager.cc:1434] T 0550046442d4469c96ad37cbbb191915 P 196d972917fe4f85985e3862d40b7596: Time spent starting tablet: real 0.077s	user 0.006s	sys 0.001s
I20260709 13:13:40.370276 31747 tablet_bootstrap.cc:492] T 8a98dff441f1479992f85708c9f03283 P 196d972917fe4f85985e3862d40b7596: Bootstrap starting.
I20260709 13:13:40.366039 31376 catalog_manager.cc:5697] T 22ba83039f2d4e2c9089947b949a1790 P 458d610e8abf4f2ea831ab7bf3576da6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65). New cstate: current_term: 1 leader_uuid: "458d610e8abf4f2ea831ab7bf3576da6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:40.373359 31804 raft_consensus.cc:493] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.373131 31376 catalog_manager.cc:5697] T 0c12bd32cd944ce99a18fc4f9617961e P 458d610e8abf4f2ea831ab7bf3576da6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65). New cstate: current_term: 1 leader_uuid: "458d610e8abf4f2ea831ab7bf3576da6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:40.373845 31804 raft_consensus.cc:515] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:40.375003 31376 catalog_manager.cc:5697] T 35bbba26df1b47a7b9923618bf451ffc P 458d610e8abf4f2ea831ab7bf3576da6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65). New cstate: current_term: 1 leader_uuid: "458d610e8abf4f2ea831ab7bf3576da6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:40.376060 31804 leader_election.cc:290] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:40.377691 31699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf0c159a4f34a2abd10a0f7c60b5fbf" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:40.378540 31699 raft_consensus.cc:2393] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 196d972917fe4f85985e3862d40b7596 in current term 1: Already voted for candidate 76fb155ade354ee1ba78673e73b28aca in this term.
I20260709 13:13:40.353852 31446 leader_election.cc:304] T 8a98dff441f1479992f85708c9f03283 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca; no voters: 196d972917fe4f85985e3862d40b7596
I20260709 13:13:40.387863 31750 tablet_bootstrap.cc:654] T 70ccde113c9246f5a008add70aacae7d P 458d610e8abf4f2ea831ab7bf3576da6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.388111 32077 raft_consensus.cc:2804] T 8a98dff441f1479992f85708c9f03283 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:40.389031 31747 tablet_bootstrap.cc:654] T 8a98dff441f1479992f85708c9f03283 P 196d972917fe4f85985e3862d40b7596: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.388773 32077 raft_consensus.cc:697] T 8a98dff441f1479992f85708c9f03283 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 LEADER]: Becoming Leader. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Running, Role: LEADER
I20260709 13:13:40.389889 32077 consensus_queue.cc:237] T 8a98dff441f1479992f85708c9f03283 P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
W20260709 13:13:40.392802 31446 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.68:45715, user_credentials={real_user=slave}} blocked reactor thread for 44341.3us
I20260709 13:13:40.402472 31700 raft_consensus.cc:2468] T ddbfc15d5bf24708a4268dfa206ede07 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 1.
I20260709 13:13:40.403507 31474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70ccde113c9246f5a008add70aacae7d" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:40.404953 31474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf0c159a4f34a2abd10a0f7c60b5fbf" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:40.405697 31474 raft_consensus.cc:2393] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 196d972917fe4f85985e3862d40b7596 in current term 1: Already voted for candidate 458d610e8abf4f2ea831ab7bf3576da6 in this term.
W20260709 13:13:40.406564 31668 leader_election.cc:343] T 70ccde113c9246f5a008add70aacae7d P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:40.406925 31595 leader_election.cc:304] T ddbfc15d5bf24708a4268dfa206ede07 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca, c74453754ee34bea9b231ae318a55a31; no voters: 
I20260709 13:13:40.406993 31668 leader_election.cc:304] T 70ccde113c9246f5a008add70aacae7d P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca; no voters: 458d610e8abf4f2ea831ab7bf3576da6, c74453754ee34bea9b231ae318a55a31
I20260709 13:13:40.408120 31817 raft_consensus.cc:2804] T ddbfc15d5bf24708a4268dfa206ede07 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:40.409175 31520 leader_election.cc:304] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 196d972917fe4f85985e3862d40b7596; no voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca
I20260709 13:13:40.410276 31804 raft_consensus.cc:3060] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:40.410833 31920 raft_consensus.cc:2749] T 70ccde113c9246f5a008add70aacae7d P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:40.411618 31817 raft_consensus.cc:697] T ddbfc15d5bf24708a4268dfa206ede07 P c74453754ee34bea9b231ae318a55a31 [term 1 LEADER]: Becoming Leader. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Running, Role: LEADER
I20260709 13:13:40.417762 31817 consensus_queue.cc:237] T ddbfc15d5bf24708a4268dfa206ede07 P c74453754ee34bea9b231ae318a55a31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:40.418854 32033 raft_consensus.cc:493] T 0f01040b42e14f0db6bcd06319237ddb P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.419332 32033 raft_consensus.cc:515] T 0f01040b42e14f0db6bcd06319237ddb P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:40.420548 31804 raft_consensus.cc:2749] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:40.421334 32033 leader_election.cc:290] T 0f01040b42e14f0db6bcd06319237ddb P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431), 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715)
I20260709 13:13:40.424527 31699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f01040b42e14f0db6bcd06319237ddb" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:40.425201 31699 raft_consensus.cc:2468] T 0f01040b42e14f0db6bcd06319237ddb P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 0.
I20260709 13:13:40.427747 31990 consensus_queue.cc:1048] T b262a50e82034c57a4bfb7da683ff5d1 P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:40.428960 31595 leader_election.cc:304] T 0f01040b42e14f0db6bcd06319237ddb P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca, c74453754ee34bea9b231ae318a55a31; no voters: 
I20260709 13:13:40.431368 32033 raft_consensus.cc:2804] T 0f01040b42e14f0db6bcd06319237ddb P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:40.431782 32033 raft_consensus.cc:493] T 0f01040b42e14f0db6bcd06319237ddb P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:40.431478 31549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f01040b42e14f0db6bcd06319237ddb" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:40.433100 31771 raft_consensus.cc:493] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.433578 31771 raft_consensus.cc:515] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
W20260709 13:13:40.435717 31592 leader_election.cc:343] T 0f01040b42e14f0db6bcd06319237ddb P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:40.436383 31771 leader_election.cc:290] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:40.437127 32033 raft_consensus.cc:3060] T 0f01040b42e14f0db6bcd06319237ddb P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:40.437040 31699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2a6746f9b2f4b1ab287b9e8f4c51106" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:40.438689 31699 raft_consensus.cc:2393] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 196d972917fe4f85985e3862d40b7596 in current term 1: Already voted for candidate 458d610e8abf4f2ea831ab7bf3576da6 in this term.
I20260709 13:13:40.440426 31474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2a6746f9b2f4b1ab287b9e8f4c51106" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:40.444209 31749 tablet_bootstrap.cc:492] T 3879ebc472ce44d99940e2168e9099bf P 76fb155ade354ee1ba78673e73b28aca: No bootstrap required, opened a new log
I20260709 13:13:40.444712 31749 ts_tablet_manager.cc:1403] T 3879ebc472ce44d99940e2168e9099bf P 76fb155ade354ee1ba78673e73b28aca: Time spent bootstrapping tablet: real 0.222s	user 0.018s	sys 0.005s
I20260709 13:13:40.447777 31749 raft_consensus.cc:359] T 3879ebc472ce44d99940e2168e9099bf P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:40.448439 31749 raft_consensus.cc:385] T 3879ebc472ce44d99940e2168e9099bf P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.448697 31749 raft_consensus.cc:740] T 3879ebc472ce44d99940e2168e9099bf P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.449513 31749 consensus_queue.cc:260] T 3879ebc472ce44d99940e2168e9099bf P 76fb155ade354ee1ba78673e73b28aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:40.451045 31749 ts_tablet_manager.cc:1434] T 3879ebc472ce44d99940e2168e9099bf P 76fb155ade354ee1ba78673e73b28aca: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:13:40.451975 31749 tablet_bootstrap.cc:492] T 76a7de5cfe774df68279e2e1e7361c6b P 76fb155ade354ee1ba78673e73b28aca: Bootstrap starting.
I20260709 13:13:40.454336 32127 consensus_queue.cc:1048] T 22ba83039f2d4e2c9089947b949a1790 P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:40.464704 31759 consensus_queue.cc:1048] T 1fb28788823d4c5fab527f4ee2da4d2e P c74453754ee34bea9b231ae318a55a31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:40.467533 31477 raft_consensus.cc:2468] T ddbfc15d5bf24708a4268dfa206ede07 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 1.
I20260709 13:13:40.445704 31520 leader_election.cc:304] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 196d972917fe4f85985e3862d40b7596; no voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca
I20260709 13:13:40.474071 31771 raft_consensus.cc:3060] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:40.478497 31759 consensus_queue.cc:1048] T 1fb28788823d4c5fab527f4ee2da4d2e P c74453754ee34bea9b231ae318a55a31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:40.481593 31750 tablet_bootstrap.cc:492] T 70ccde113c9246f5a008add70aacae7d P 458d610e8abf4f2ea831ab7bf3576da6: No bootstrap required, opened a new log
I20260709 13:13:40.482175 31750 ts_tablet_manager.cc:1403] T 70ccde113c9246f5a008add70aacae7d P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.137s	user 0.024s	sys 0.030s
I20260709 13:13:40.485210 31750 raft_consensus.cc:359] T 70ccde113c9246f5a008add70aacae7d P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:40.485942 31750 raft_consensus.cc:385] T 70ccde113c9246f5a008add70aacae7d P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.486155 31748 tablet_bootstrap.cc:492] T 3879ebc472ce44d99940e2168e9099bf P c74453754ee34bea9b231ae318a55a31: No bootstrap required, opened a new log
I20260709 13:13:40.486754 31748 ts_tablet_manager.cc:1403] T 3879ebc472ce44d99940e2168e9099bf P c74453754ee34bea9b231ae318a55a31: Time spent bootstrapping tablet: real 0.183s	user 0.004s	sys 0.026s
I20260709 13:13:40.486310 31750 raft_consensus.cc:740] T 70ccde113c9246f5a008add70aacae7d P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.487691 31750 consensus_queue.cc:260] T 70ccde113c9246f5a008add70aacae7d P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:40.490331 31750 ts_tablet_manager.cc:1434] T 70ccde113c9246f5a008add70aacae7d P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:13:40.491358 31750 tablet_bootstrap.cc:492] T 76a7de5cfe774df68279e2e1e7361c6b P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:40.494926 31747 tablet_bootstrap.cc:492] T 8a98dff441f1479992f85708c9f03283 P 196d972917fe4f85985e3862d40b7596: No bootstrap required, opened a new log
I20260709 13:13:40.495447 31747 ts_tablet_manager.cc:1403] T 8a98dff441f1479992f85708c9f03283 P 196d972917fe4f85985e3862d40b7596: Time spent bootstrapping tablet: real 0.125s	user 0.009s	sys 0.000s
I20260709 13:13:40.498351 31750 tablet_bootstrap.cc:654] T 76a7de5cfe774df68279e2e1e7361c6b P 458d610e8abf4f2ea831ab7bf3576da6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.498322 31747 raft_consensus.cc:359] T 8a98dff441f1479992f85708c9f03283 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:40.499117 31747 raft_consensus.cc:385] T 8a98dff441f1479992f85708c9f03283 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.499400 31747 raft_consensus.cc:740] T 8a98dff441f1479992f85708c9f03283 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 196d972917fe4f85985e3862d40b7596, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.506898 31747 consensus_queue.cc:260] T 8a98dff441f1479992f85708c9f03283 P 196d972917fe4f85985e3862d40b7596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:40.524348 31771 raft_consensus.cc:2749] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:40.525977 31748 raft_consensus.cc:359] T 3879ebc472ce44d99940e2168e9099bf P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:40.532786 31748 raft_consensus.cc:385] T 3879ebc472ce44d99940e2168e9099bf P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.533111 31748 raft_consensus.cc:740] T 3879ebc472ce44d99940e2168e9099bf P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.533835 31748 consensus_queue.cc:260] T 3879ebc472ce44d99940e2168e9099bf P c74453754ee34bea9b231ae318a55a31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:40.529299 32088 consensus_queue.cc:1048] T 22ba83039f2d4e2c9089947b949a1790 P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:13:40.535954 31748 ts_tablet_manager.cc:1434] T 3879ebc472ce44d99940e2168e9099bf P c74453754ee34bea9b231ae318a55a31: Time spent starting tablet: real 0.049s	user 0.002s	sys 0.005s
I20260709 13:13:40.526413 32127 consensus_queue.cc:1048] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:40.528227 31747 ts_tablet_manager.cc:1434] T 8a98dff441f1479992f85708c9f03283 P 196d972917fe4f85985e3862d40b7596: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260709 13:13:40.538439 31747 tablet_bootstrap.cc:492] T fb97ca15f56b46dd846db7b0ff156a32 P 196d972917fe4f85985e3862d40b7596: Bootstrap starting.
I20260709 13:13:40.449679 32033 raft_consensus.cc:515] T 0f01040b42e14f0db6bcd06319237ddb P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:40.546602 31749 tablet_bootstrap.cc:654] T 76a7de5cfe774df68279e2e1e7361c6b P 76fb155ade354ee1ba78673e73b28aca: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.548462 31920 raft_consensus.cc:493] T 3879ebc472ce44d99940e2168e9099bf P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.549029 31920 raft_consensus.cc:515] T 3879ebc472ce44d99940e2168e9099bf P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:40.549958 32033 leader_election.cc:290] T 0f01040b42e14f0db6bcd06319237ddb P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 election: Requested vote from peers 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431), 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715)
I20260709 13:13:40.551090 31920 leader_election.cc:290] T 3879ebc472ce44d99940e2168e9099bf P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:40.529614 32082 raft_consensus.cc:493] T dcf07174e49c498f8e19fd005690404b P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.552101 31627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3879ebc472ce44d99940e2168e9099bf" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:40.552735 31627 raft_consensus.cc:2468] T 3879ebc472ce44d99940e2168e9099bf P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 0.
I20260709 13:13:40.552625 32082 raft_consensus.cc:515] T dcf07174e49c498f8e19fd005690404b P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:40.554039 31669 leader_election.cc:304] T 3879ebc472ce44d99940e2168e9099bf P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca, c74453754ee34bea9b231ae318a55a31; no voters: 
I20260709 13:13:40.554893 31920 raft_consensus.cc:2804] T 3879ebc472ce44d99940e2168e9099bf P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:40.555264 31920 raft_consensus.cc:493] T 3879ebc472ce44d99940e2168e9099bf P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:40.555649 31920 raft_consensus.cc:3060] T 3879ebc472ce44d99940e2168e9099bf P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:40.559762 31551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3879ebc472ce44d99940e2168e9099bf" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
W20260709 13:13:40.561729 31666 leader_election.cc:343] T 3879ebc472ce44d99940e2168e9099bf P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:40.562973 31699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f01040b42e14f0db6bcd06319237ddb" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca"
I20260709 13:13:40.563548 31699 raft_consensus.cc:3060] T 0f01040b42e14f0db6bcd06319237ddb P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:40.564467 32127 consensus_queue.cc:1048] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:40.567140 31549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f01040b42e14f0db6bcd06319237ddb" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596"
W20260709 13:13:40.569517 31592 leader_election.cc:343] T 0f01040b42e14f0db6bcd06319237ddb P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:40.589238 32127 consensus_queue.cc:1048] T b262a50e82034c57a4bfb7da683ff5d1 P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:40.577605 31748 tablet_bootstrap.cc:492] T dcf07174e49c498f8e19fd005690404b P c74453754ee34bea9b231ae318a55a31: Bootstrap starting.
W20260709 13:13:40.606196 31666 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:37431, user_credentials={real_user=slave}} blocked reactor thread for 44487us
I20260709 13:13:40.645442 31554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf07174e49c498f8e19fd005690404b" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
W20260709 13:13:40.650723 31443 leader_election.cc:343] T dcf07174e49c498f8e19fd005690404b P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:40.651669 32082 leader_election.cc:290] T dcf07174e49c498f8e19fd005690404b P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
W20260709 13:13:40.675930 31426 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:40.678167 31750 tablet_bootstrap.cc:492] T 76a7de5cfe774df68279e2e1e7361c6b P 458d610e8abf4f2ea831ab7bf3576da6: No bootstrap required, opened a new log
I20260709 13:13:40.678717 31750 ts_tablet_manager.cc:1403] T 76a7de5cfe774df68279e2e1e7361c6b P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.188s	user 0.041s	sys 0.033s
I20260709 13:13:40.589872 31373 catalog_manager.cc:5697] T 8a98dff441f1479992f85708c9f03283 P 458d610e8abf4f2ea831ab7bf3576da6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65). New cstate: current_term: 1 leader_uuid: "458d610e8abf4f2ea831ab7bf3576da6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:40.688401 31748 tablet_bootstrap.cc:654] T dcf07174e49c498f8e19fd005690404b P c74453754ee34bea9b231ae318a55a31: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.693738 31747 tablet_bootstrap.cc:654] T fb97ca15f56b46dd846db7b0ff156a32 P 196d972917fe4f85985e3862d40b7596: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.689908 32127 raft_consensus.cc:493] T cfe1afd9e187451faf5f631e0c2eef00 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.698263 32127 raft_consensus.cc:515] T cfe1afd9e187451faf5f631e0c2eef00 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:40.700940 32127 leader_election.cc:290] T cfe1afd9e187451faf5f631e0c2eef00 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:40.725031 31626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe1afd9e187451faf5f631e0c2eef00" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:40.739311 31554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe1afd9e187451faf5f631e0c2eef00" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:40.682076 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf07174e49c498f8e19fd005690404b" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
W20260709 13:13:40.741720 31443 leader_election.cc:343] T cfe1afd9e187451faf5f631e0c2eef00 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:40.743537 31446 leader_election.cc:343] T cfe1afd9e187451faf5f631e0c2eef00 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:40.744177 31446 leader_election.cc:304] T cfe1afd9e187451faf5f631e0c2eef00 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6; no voters: 196d972917fe4f85985e3862d40b7596, c74453754ee34bea9b231ae318a55a31
I20260709 13:13:40.745143 31990 raft_consensus.cc:2749] T cfe1afd9e187451faf5f631e0c2eef00 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:13:40.755903 31446 leader_election.cc:343] T dcf07174e49c498f8e19fd005690404b P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:40.756664 31446 leader_election.cc:304] T dcf07174e49c498f8e19fd005690404b P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6; no voters: 196d972917fe4f85985e3862d40b7596, c74453754ee34bea9b231ae318a55a31
I20260709 13:13:40.677965 31920 raft_consensus.cc:515] T 3879ebc472ce44d99940e2168e9099bf P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:40.724915 31750 raft_consensus.cc:359] T 76a7de5cfe774df68279e2e1e7361c6b P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:40.759258 31750 raft_consensus.cc:385] T 76a7de5cfe774df68279e2e1e7361c6b P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.759631 31750 raft_consensus.cc:740] T 76a7de5cfe774df68279e2e1e7361c6b P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.758682 32127 raft_consensus.cc:2749] T dcf07174e49c498f8e19fd005690404b P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:40.768713 31378 catalog_manager.cc:5697] T ddbfc15d5bf24708a4268dfa206ede07 P c74453754ee34bea9b231ae318a55a31 reported cstate change: term changed from 0 to 1, leader changed from <none> to c74453754ee34bea9b231ae318a55a31 (127.23.140.67). New cstate: current_term: 1 leader_uuid: "c74453754ee34bea9b231ae318a55a31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:40.775774 31771 raft_consensus.cc:493] T 0550046442d4469c96ad37cbbb191915 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.776978 31771 raft_consensus.cc:515] T 0550046442d4469c96ad37cbbb191915 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:40.786217 31771 leader_election.cc:290] T 0550046442d4469c96ad37cbbb191915 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715)
I20260709 13:13:40.784423 31750 consensus_queue.cc:260] T 76a7de5cfe774df68279e2e1e7361c6b P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:40.803253 31698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0550046442d4469c96ad37cbbb191915" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:40.812333 31554 raft_consensus.cc:3060] T 8a98dff441f1479992f85708c9f03283 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:40.812899 31750 ts_tablet_manager.cc:1434] T 76a7de5cfe774df68279e2e1e7361c6b P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.134s	user 0.009s	sys 0.001s
I20260709 13:13:40.814157 31920 leader_election.cc:290] T 3879ebc472ce44d99940e2168e9099bf P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 election: Requested vote from peers 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:40.816488 31626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0550046442d4469c96ad37cbbb191915" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:40.818878 31699 raft_consensus.cc:2468] T 0f01040b42e14f0db6bcd06319237ddb P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 1.
I20260709 13:13:40.819716 32077 raft_consensus.cc:493] T 70ccde113c9246f5a008add70aacae7d P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.820467 31595 leader_election.cc:304] T 0f01040b42e14f0db6bcd06319237ddb P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca, c74453754ee34bea9b231ae318a55a31; no voters: 196d972917fe4f85985e3862d40b7596
I20260709 13:13:40.820358 32077 raft_consensus.cc:515] T 70ccde113c9246f5a008add70aacae7d P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:40.821894 32033 raft_consensus.cc:2804] T 0f01040b42e14f0db6bcd06319237ddb P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:40.822476 32033 raft_consensus.cc:697] T 0f01040b42e14f0db6bcd06319237ddb P c74453754ee34bea9b231ae318a55a31 [term 1 LEADER]: Becoming Leader. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Running, Role: LEADER
I20260709 13:13:40.822837 32077 leader_election.cc:290] T 70ccde113c9246f5a008add70aacae7d P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715)
I20260709 13:13:40.823503 32033 consensus_queue.cc:237] T 0f01040b42e14f0db6bcd06319237ddb P c74453754ee34bea9b231ae318a55a31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:40.826926 31626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70ccde113c9246f5a008add70aacae7d" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:40.828356 31629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3879ebc472ce44d99940e2168e9099bf" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31"
I20260709 13:13:40.829141 31629 raft_consensus.cc:3060] T 3879ebc472ce44d99940e2168e9099bf P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:40.829064 31990 consensus_queue.cc:1048] T 8a98dff441f1479992f85708c9f03283 P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:13:40.831223 31446 leader_election.cc:343] T 70ccde113c9246f5a008add70aacae7d P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:40.831094 32127 consensus_queue.cc:1048] T 0c12bd32cd944ce99a18fc4f9617961e P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:13:40.781513 31666 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:37431, user_credentials={real_user=slave}} blocked reactor thread for 45701.9us
I20260709 13:13:40.838935 31554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3879ebc472ce44d99940e2168e9099bf" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596"
W20260709 13:13:40.840724 31443 consensus_peers.cc:597] T 35bbba26df1b47a7b9923618bf451ffc P 458d610e8abf4f2ea831ab7bf3576da6 -> Peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Couldn't send request to peer 196d972917fe4f85985e3862d40b7596. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:40.841674 31443 consensus_peers.cc:597] T 0c12bd32cd944ce99a18fc4f9617961e P 458d610e8abf4f2ea831ab7bf3576da6 -> Peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Couldn't send request to peer 196d972917fe4f85985e3862d40b7596. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:40.843680 31521 leader_election.cc:304] T 0550046442d4469c96ad37cbbb191915 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 196d972917fe4f85985e3862d40b7596; no voters: 76fb155ade354ee1ba78673e73b28aca, c74453754ee34bea9b231ae318a55a31
I20260709 13:13:40.844677 32079 raft_consensus.cc:2749] T 0550046442d4469c96ad37cbbb191915 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:40.846413 32077 raft_consensus.cc:493] T 76a7de5cfe774df68279e2e1e7361c6b P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.846984 32077 raft_consensus.cc:515] T 76a7de5cfe774df68279e2e1e7361c6b P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
W20260709 13:13:40.854418 31668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:37919, user_credentials={real_user=slave}} blocked reactor thread for 63716us
I20260709 13:13:40.785025 32091 raft_consensus.cc:493] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.892184 31747 tablet_bootstrap.cc:492] T fb97ca15f56b46dd846db7b0ff156a32 P 196d972917fe4f85985e3862d40b7596: No bootstrap required, opened a new log
I20260709 13:13:40.892904 31747 ts_tablet_manager.cc:1403] T fb97ca15f56b46dd846db7b0ff156a32 P 196d972917fe4f85985e3862d40b7596: Time spent bootstrapping tablet: real 0.355s	user 0.007s	sys 0.008s
W20260709 13:13:40.870222 31666 leader_election.cc:343] T 3879ebc472ce44d99940e2168e9099bf P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:40.868562 32091 raft_consensus.cc:515] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:40.900911 31629 raft_consensus.cc:2468] T 3879ebc472ce44d99940e2168e9099bf P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 1.
I20260709 13:13:40.901450 31700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70ccde113c9246f5a008add70aacae7d" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:40.907473 32077 leader_election.cc:290] T 76a7de5cfe774df68279e2e1e7361c6b P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:40.919039 31549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a7de5cfe774df68279e2e1e7361c6b" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:40.920396 31698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a7de5cfe774df68279e2e1e7361c6b" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:40.923369 32127 raft_consensus.cc:493] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.923852 32127 raft_consensus.cc:515] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:40.930474 32127 leader_election.cc:290] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
W20260709 13:13:40.933068 31443 leader_election.cc:343] T 76a7de5cfe774df68279e2e1e7361c6b P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:40.935897 31550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf0c159a4f34a2abd10a0f7c60b5fbf" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:40.936599 31550 raft_consensus.cc:2468] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 1.
I20260709 13:13:40.938181 31817 consensus_queue.cc:1048] T ddbfc15d5bf24708a4268dfa206ede07 P c74453754ee34bea9b231ae318a55a31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:40.938621 31443 leader_election.cc:304] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, 458d610e8abf4f2ea831ab7bf3576da6; no voters: 
I20260709 13:13:40.940230 32098 raft_consensus.cc:2804] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:40.940584 32098 raft_consensus.cc:493] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:40.940914 32098 raft_consensus.cc:3060] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:40.945734 32091 leader_election.cc:290] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:40.948045 32098 raft_consensus.cc:515] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:40.950402 31550 raft_consensus.cc:3060] T 0550046442d4469c96ad37cbbb191915 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:40.951007 31669 leader_election.cc:304] T 3879ebc472ce44d99940e2168e9099bf P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca, c74453754ee34bea9b231ae318a55a31; no voters: 196d972917fe4f85985e3862d40b7596
I20260709 13:13:40.959121 31747 raft_consensus.cc:359] T fb97ca15f56b46dd846db7b0ff156a32 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:40.959956 31747 raft_consensus.cc:385] T fb97ca15f56b46dd846db7b0ff156a32 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.960237 31747 raft_consensus.cc:740] T fb97ca15f56b46dd846db7b0ff156a32 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 196d972917fe4f85985e3862d40b7596, State: Initialized, Role: FOLLOWER
W20260709 13:13:40.958825 31446 leader_election.cc:343] T 76a7de5cfe774df68279e2e1e7361c6b P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:40.961426 31446 leader_election.cc:304] T 76a7de5cfe774df68279e2e1e7361c6b P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6; no voters: 196d972917fe4f85985e3862d40b7596, 76fb155ade354ee1ba78673e73b28aca
I20260709 13:13:40.962302 31747 consensus_queue.cc:260] T fb97ca15f56b46dd846db7b0ff156a32 P 196d972917fe4f85985e3862d40b7596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:40.966161 31479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf0c159a4f34a2abd10a0f7c60b5fbf" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:40.967027 31479 raft_consensus.cc:2393] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 76fb155ade354ee1ba78673e73b28aca in current term 2: Already voted for candidate 458d610e8abf4f2ea831ab7bf3576da6 in this term.
I20260709 13:13:40.967065 31747 ts_tablet_manager.cc:1434] T fb97ca15f56b46dd846db7b0ff156a32 P 196d972917fe4f85985e3862d40b7596: Time spent starting tablet: real 0.074s	user 0.008s	sys 0.000s
I20260709 13:13:40.960724 31700 raft_consensus.cc:2468] T 70ccde113c9246f5a008add70aacae7d P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 0.
I20260709 13:13:40.973227 31446 leader_election.cc:304] T 70ccde113c9246f5a008add70aacae7d P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca; no voters: c74453754ee34bea9b231ae318a55a31
I20260709 13:13:40.979331 31549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf0c159a4f34a2abd10a0f7c60b5fbf" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:40.979697 32077 raft_consensus.cc:2804] T 70ccde113c9246f5a008add70aacae7d P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:40.980130 32077 raft_consensus.cc:493] T 70ccde113c9246f5a008add70aacae7d P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:40.980499 32077 raft_consensus.cc:3060] T 70ccde113c9246f5a008add70aacae7d P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:40.976184 32082 consensus_queue.cc:1048] T 35bbba26df1b47a7b9923618bf451ffc P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:13:40.983634 31748 tablet_bootstrap.cc:492] T dcf07174e49c498f8e19fd005690404b P c74453754ee34bea9b231ae318a55a31: No bootstrap required, opened a new log
I20260709 13:13:40.984160 31748 ts_tablet_manager.cc:1403] T dcf07174e49c498f8e19fd005690404b P c74453754ee34bea9b231ae318a55a31: Time spent bootstrapping tablet: real 0.407s	user 0.035s	sys 0.002s
I20260709 13:13:40.984691 31554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf0c159a4f34a2abd10a0f7c60b5fbf" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596"
I20260709 13:13:40.985368 32098 leader_election.cc:290] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 2 election: Requested vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:40.980021 31549 raft_consensus.cc:2468] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 1.
I20260709 13:13:40.965029 32127 raft_consensus.cc:2749] T 76a7de5cfe774df68279e2e1e7361c6b P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:40.973894 32075 raft_consensus.cc:2804] T 3879ebc472ce44d99940e2168e9099bf P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:41.002357 31749 tablet_bootstrap.cc:492] T 76a7de5cfe774df68279e2e1e7361c6b P 76fb155ade354ee1ba78673e73b28aca: No bootstrap required, opened a new log
I20260709 13:13:41.002907 31749 ts_tablet_manager.cc:1403] T 76a7de5cfe774df68279e2e1e7361c6b P 76fb155ade354ee1ba78673e73b28aca: Time spent bootstrapping tablet: real 0.551s	user 0.029s	sys 0.024s
I20260709 13:13:40.986258 31702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf0c159a4f34a2abd10a0f7c60b5fbf" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:41.004112 31666 leader_election.cc:304] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, 76fb155ade354ee1ba78673e73b28aca; no voters: 458d610e8abf4f2ea831ab7bf3576da6
I20260709 13:13:40.973626 32159 consensus_queue.cc:1048] T 8a98dff441f1479992f85708c9f03283 P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.030s
I20260709 13:13:41.007493 32160 raft_consensus.cc:2804] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:41.007921 32160 raft_consensus.cc:493] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:41.008267 32160 raft_consensus.cc:3060] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.004472 32075 raft_consensus.cc:697] T 3879ebc472ce44d99940e2168e9099bf P 76fb155ade354ee1ba78673e73b28aca [term 1 LEADER]: Becoming Leader. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Running, Role: LEADER
I20260709 13:13:41.009933 32075 consensus_queue.cc:237] T 3879ebc472ce44d99940e2168e9099bf P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:40.992504 31699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf0c159a4f34a2abd10a0f7c60b5fbf" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca"
I20260709 13:13:41.019065 31759 consensus_queue.cc:1048] T ddbfc15d5bf24708a4268dfa206ede07 P c74453754ee34bea9b231ae318a55a31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:41.021164 31748 raft_consensus.cc:359] T dcf07174e49c498f8e19fd005690404b P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:41.022192 31748 raft_consensus.cc:385] T dcf07174e49c498f8e19fd005690404b P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:41.022576 31748 raft_consensus.cc:740] T dcf07174e49c498f8e19fd005690404b P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Initialized, Role: FOLLOWER
I20260709 13:13:41.027243 31748 consensus_queue.cc:260] T dcf07174e49c498f8e19fd005690404b P c74453754ee34bea9b231ae318a55a31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:41.037328 31749 raft_consensus.cc:359] T 76a7de5cfe774df68279e2e1e7361c6b P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:41.038121 31749 raft_consensus.cc:385] T 76a7de5cfe774df68279e2e1e7361c6b P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:41.038389 31749 raft_consensus.cc:740] T 76a7de5cfe774df68279e2e1e7361c6b P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Initialized, Role: FOLLOWER
I20260709 13:13:41.039036 31749 consensus_queue.cc:260] T 76a7de5cfe774df68279e2e1e7361c6b P 76fb155ade354ee1ba78673e73b28aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:41.043349 32160 raft_consensus.cc:515] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:41.045297 31749 ts_tablet_manager.cc:1434] T 76a7de5cfe774df68279e2e1e7361c6b P 76fb155ade354ee1ba78673e73b28aca: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.000s
I20260709 13:13:41.046571 32160 leader_election.cc:290] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 2 election: Requested vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:41.056041 31446 leader_election.cc:304] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6; no voters: 196d972917fe4f85985e3862d40b7596, 76fb155ade354ee1ba78673e73b28aca
I20260709 13:13:41.071444 31477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf0c159a4f34a2abd10a0f7c60b5fbf" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
I20260709 13:13:41.072331 31477 raft_consensus.cc:2393] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 76fb155ade354ee1ba78673e73b28aca in current term 2: Already voted for candidate 458d610e8abf4f2ea831ab7bf3576da6 in this term.
I20260709 13:13:41.072948 31554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf0c159a4f34a2abd10a0f7c60b5fbf" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596"
I20260709 13:13:41.073565 31554 raft_consensus.cc:3060] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.073894 31747 tablet_bootstrap.cc:492] T dcf07174e49c498f8e19fd005690404b P 196d972917fe4f85985e3862d40b7596: Bootstrap starting.
I20260709 13:13:41.074224 32077 raft_consensus.cc:515] T 70ccde113c9246f5a008add70aacae7d P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:41.077514 31702 raft_consensus.cc:2393] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 458d610e8abf4f2ea831ab7bf3576da6 in current term 2: Already voted for candidate 76fb155ade354ee1ba78673e73b28aca in this term.
I20260709 13:13:41.077734 32077 leader_election.cc:290] T 70ccde113c9246f5a008add70aacae7d P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 election: Requested vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715)
I20260709 13:13:41.088469 31748 ts_tablet_manager.cc:1434] T dcf07174e49c498f8e19fd005690404b P c74453754ee34bea9b231ae318a55a31: Time spent starting tablet: real 0.104s	user 0.009s	sys 0.000s
I20260709 13:13:41.090902 31748 tablet_bootstrap.cc:492] T cfe1afd9e187451faf5f631e0c2eef00 P c74453754ee34bea9b231ae318a55a31: Bootstrap starting.
I20260709 13:13:41.090698 31699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70ccde113c9246f5a008add70aacae7d" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca"
I20260709 13:13:41.091497 31699 raft_consensus.cc:3060] T 70ccde113c9246f5a008add70aacae7d P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:41.090353 32077 raft_consensus.cc:2749] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:41.121207 31629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70ccde113c9246f5a008add70aacae7d" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31"
W20260709 13:13:41.121955 32165 log.cc:927] Time spent T 0c12bd32cd944ce99a18fc4f9617961e P c74453754ee34bea9b231ae318a55a31: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:13:41.129451 31747 tablet_bootstrap.cc:654] T dcf07174e49c498f8e19fd005690404b P 196d972917fe4f85985e3862d40b7596: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:41.144510 31446 leader_election.cc:343] T 70ccde113c9246f5a008add70aacae7d P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:41.194052 31748 tablet_bootstrap.cc:654] T cfe1afd9e187451faf5f631e0c2eef00 P c74453754ee34bea9b231ae318a55a31: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:41.208374 31747 tablet_bootstrap.cc:492] T dcf07174e49c498f8e19fd005690404b P 196d972917fe4f85985e3862d40b7596: No bootstrap required, opened a new log
I20260709 13:13:41.208889 31747 ts_tablet_manager.cc:1403] T dcf07174e49c498f8e19fd005690404b P 196d972917fe4f85985e3862d40b7596: Time spent bootstrapping tablet: real 0.135s	user 0.008s	sys 0.009s
I20260709 13:13:41.212539 31747 raft_consensus.cc:359] T dcf07174e49c498f8e19fd005690404b P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:41.215013 31747 raft_consensus.cc:385] T dcf07174e49c498f8e19fd005690404b P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:41.215353 31747 raft_consensus.cc:740] T dcf07174e49c498f8e19fd005690404b P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 196d972917fe4f85985e3862d40b7596, State: Initialized, Role: FOLLOWER
I20260709 13:13:41.204736 31699 raft_consensus.cc:2468] T 70ccde113c9246f5a008add70aacae7d P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 1.
I20260709 13:13:41.217803 31747 consensus_queue.cc:260] T dcf07174e49c498f8e19fd005690404b P 196d972917fe4f85985e3862d40b7596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:41.220593 31747 ts_tablet_manager.cc:1434] T dcf07174e49c498f8e19fd005690404b P 196d972917fe4f85985e3862d40b7596: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:13:41.220714 31554 raft_consensus.cc:2468] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 2.
I20260709 13:13:41.221431 31446 leader_election.cc:304] T 70ccde113c9246f5a008add70aacae7d P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca; no voters: c74453754ee34bea9b231ae318a55a31
I20260709 13:13:41.221985 31666 leader_election.cc:304] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, 76fb155ade354ee1ba78673e73b28aca; no voters: 458d610e8abf4f2ea831ab7bf3576da6
I20260709 13:13:41.222185 31747 tablet_bootstrap.cc:492] T 35bbba26df1b47a7b9923618bf451ffc P 196d972917fe4f85985e3862d40b7596: Bootstrap starting.
I20260709 13:13:41.223142 32089 raft_consensus.cc:2804] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:41.224897 32089 raft_consensus.cc:697] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 76fb155ade354ee1ba78673e73b28aca [term 2 LEADER]: Becoming Leader. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Running, Role: LEADER
I20260709 13:13:41.226378 32088 raft_consensus.cc:2804] T 70ccde113c9246f5a008add70aacae7d P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:41.226935 32088 raft_consensus.cc:697] T 70ccde113c9246f5a008add70aacae7d P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 LEADER]: Becoming Leader. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Running, Role: LEADER
I20260709 13:13:41.227768 32088 consensus_queue.cc:237] T 70ccde113c9246f5a008add70aacae7d P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:41.229344 31747 tablet_bootstrap.cc:654] T 35bbba26df1b47a7b9923618bf451ffc P 196d972917fe4f85985e3862d40b7596: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:41.232645 31378 catalog_manager.cc:5697] T 0f01040b42e14f0db6bcd06319237ddb P c74453754ee34bea9b231ae318a55a31 reported cstate change: term changed from 0 to 1, leader changed from <none> to c74453754ee34bea9b231ae318a55a31 (127.23.140.67). New cstate: current_term: 1 leader_uuid: "c74453754ee34bea9b231ae318a55a31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:41.240974 32079 raft_consensus.cc:493] T fb97ca15f56b46dd846db7b0ff156a32 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:41.241506 32079 raft_consensus.cc:515] T fb97ca15f56b46dd846db7b0ff156a32 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:41.241894 31747 tablet_bootstrap.cc:492] T 35bbba26df1b47a7b9923618bf451ffc P 196d972917fe4f85985e3862d40b7596: No bootstrap required, opened a new log
I20260709 13:13:41.242514 31747 ts_tablet_manager.cc:1403] T 35bbba26df1b47a7b9923618bf451ffc P 196d972917fe4f85985e3862d40b7596: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.006s
I20260709 13:13:41.243624 32079 leader_election.cc:290] T fb97ca15f56b46dd846db7b0ff156a32 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715)
I20260709 13:13:41.245235 31747 raft_consensus.cc:359] T 35bbba26df1b47a7b9923618bf451ffc P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:41.246236 31747 raft_consensus.cc:385] T 35bbba26df1b47a7b9923618bf451ffc P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:41.246592 31747 raft_consensus.cc:740] T 35bbba26df1b47a7b9923618bf451ffc P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 196d972917fe4f85985e3862d40b7596, State: Initialized, Role: FOLLOWER
I20260709 13:13:41.247294 31747 consensus_queue.cc:260] T 35bbba26df1b47a7b9923618bf451ffc P 196d972917fe4f85985e3862d40b7596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:41.245671 32089 consensus_queue.cc:237] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:41.249583 31747 ts_tablet_manager.cc:1434] T 35bbba26df1b47a7b9923618bf451ffc P 196d972917fe4f85985e3862d40b7596: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:13:41.250626 31747 tablet_bootstrap.cc:492] T 3879ebc472ce44d99940e2168e9099bf P 196d972917fe4f85985e3862d40b7596: Bootstrap starting.
I20260709 13:13:41.251420 31629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb97ca15f56b46dd846db7b0ff156a32" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:41.252241 31629 raft_consensus.cc:2393] T fb97ca15f56b46dd846db7b0ff156a32 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 196d972917fe4f85985e3862d40b7596 in current term 1: Already voted for candidate c74453754ee34bea9b231ae318a55a31 in this term.
I20260709 13:13:41.253575 31699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb97ca15f56b46dd846db7b0ff156a32" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:41.254392 31699 raft_consensus.cc:2393] T fb97ca15f56b46dd846db7b0ff156a32 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 196d972917fe4f85985e3862d40b7596 in current term 1: Already voted for candidate 76fb155ade354ee1ba78673e73b28aca in this term.
I20260709 13:13:41.255334 31521 leader_election.cc:304] T fb97ca15f56b46dd846db7b0ff156a32 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 196d972917fe4f85985e3862d40b7596; no voters: 76fb155ade354ee1ba78673e73b28aca, c74453754ee34bea9b231ae318a55a31
I20260709 13:13:41.256433 32079 raft_consensus.cc:3060] T fb97ca15f56b46dd846db7b0ff156a32 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:41.257607 31747 tablet_bootstrap.cc:654] T 3879ebc472ce44d99940e2168e9099bf P 196d972917fe4f85985e3862d40b7596: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:41.264498 32079 raft_consensus.cc:2749] T fb97ca15f56b46dd846db7b0ff156a32 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:41.272773 31748 tablet_bootstrap.cc:492] T cfe1afd9e187451faf5f631e0c2eef00 P c74453754ee34bea9b231ae318a55a31: No bootstrap required, opened a new log
I20260709 13:13:41.273346 31748 ts_tablet_manager.cc:1403] T cfe1afd9e187451faf5f631e0c2eef00 P c74453754ee34bea9b231ae318a55a31: Time spent bootstrapping tablet: real 0.183s	user 0.007s	sys 0.006s
I20260709 13:13:41.275342 31817 raft_consensus.cc:493] T dcf07174e49c498f8e19fd005690404b P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:41.275759 31817 raft_consensus.cc:515] T dcf07174e49c498f8e19fd005690404b P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:41.276077 31748 raft_consensus.cc:359] T cfe1afd9e187451faf5f631e0c2eef00 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:41.276908 31748 raft_consensus.cc:385] T cfe1afd9e187451faf5f631e0c2eef00 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:41.277230 31748 raft_consensus.cc:740] T cfe1afd9e187451faf5f631e0c2eef00 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Initialized, Role: FOLLOWER
I20260709 13:13:41.277521 31817 leader_election.cc:290] T dcf07174e49c498f8e19fd005690404b P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:41.278002 31748 consensus_queue.cc:260] T cfe1afd9e187451faf5f631e0c2eef00 P c74453754ee34bea9b231ae318a55a31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:41.280230 31748 ts_tablet_manager.cc:1434] T cfe1afd9e187451faf5f631e0c2eef00 P c74453754ee34bea9b231ae318a55a31: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:13:41.281232 31748 tablet_bootstrap.cc:492] T 70ccde113c9246f5a008add70aacae7d P c74453754ee34bea9b231ae318a55a31: Bootstrap starting.
I20260709 13:13:41.283696 31551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf07174e49c498f8e19fd005690404b" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:41.284584 31551 raft_consensus.cc:2468] T dcf07174e49c498f8e19fd005690404b P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 0.
I20260709 13:13:41.285880 31592 leader_election.cc:304] T dcf07174e49c498f8e19fd005690404b P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, c74453754ee34bea9b231ae318a55a31; no voters: 
I20260709 13:13:41.286967 31748 tablet_bootstrap.cc:654] T 70ccde113c9246f5a008add70aacae7d P c74453754ee34bea9b231ae318a55a31: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:41.286919 32033 raft_consensus.cc:2804] T dcf07174e49c498f8e19fd005690404b P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:41.287556 32033 raft_consensus.cc:493] T dcf07174e49c498f8e19fd005690404b P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:41.287940 32033 raft_consensus.cc:3060] T dcf07174e49c498f8e19fd005690404b P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:41.293818 31475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf07174e49c498f8e19fd005690404b" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:41.294539 31475 raft_consensus.cc:2468] T dcf07174e49c498f8e19fd005690404b P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 0.
I20260709 13:13:41.301083 32033 raft_consensus.cc:515] T dcf07174e49c498f8e19fd005690404b P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:41.310901 31817 raft_consensus.cc:493] T fb97ca15f56b46dd846db7b0ff156a32 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:41.309118 31373 catalog_manager.cc:5697] T 70ccde113c9246f5a008add70aacae7d P 458d610e8abf4f2ea831ab7bf3576da6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65). New cstate: current_term: 1 leader_uuid: "458d610e8abf4f2ea831ab7bf3576da6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:41.313388 31817 raft_consensus.cc:515] T fb97ca15f56b46dd846db7b0ff156a32 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:41.317250 31817 leader_election.cc:290] T fb97ca15f56b46dd846db7b0ff156a32 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431), 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715)
I20260709 13:13:41.319192 31699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb97ca15f56b46dd846db7b0ff156a32" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:41.319336 31477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf07174e49c498f8e19fd005690404b" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
I20260709 13:13:41.319101 31554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb97ca15f56b46dd846db7b0ff156a32" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:41.321278 31477 raft_consensus.cc:3060] T dcf07174e49c498f8e19fd005690404b P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:41.329831 31551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf07174e49c498f8e19fd005690404b" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596"
I20260709 13:13:41.330476 31551 raft_consensus.cc:3060] T dcf07174e49c498f8e19fd005690404b P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:41.320138 31699 raft_consensus.cc:2468] T fb97ca15f56b46dd846db7b0ff156a32 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 1.
I20260709 13:13:41.332803 31477 raft_consensus.cc:2468] T dcf07174e49c498f8e19fd005690404b P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 1.
I20260709 13:13:41.335224 31595 leader_election.cc:304] T fb97ca15f56b46dd846db7b0ff156a32 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca, c74453754ee34bea9b231ae318a55a31; no voters: 
I20260709 13:13:41.345520 31817 raft_consensus.cc:2804] T fb97ca15f56b46dd846db7b0ff156a32 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:41.345490 31594 leader_election.cc:304] T dcf07174e49c498f8e19fd005690404b P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, c74453754ee34bea9b231ae318a55a31; no voters: 
I20260709 13:13:41.346493 31759 raft_consensus.cc:2804] T dcf07174e49c498f8e19fd005690404b P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:41.346912 31759 raft_consensus.cc:697] T dcf07174e49c498f8e19fd005690404b P c74453754ee34bea9b231ae318a55a31 [term 1 LEADER]: Becoming Leader. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Running, Role: LEADER
I20260709 13:13:41.347607 31747 tablet_bootstrap.cc:492] T 3879ebc472ce44d99940e2168e9099bf P 196d972917fe4f85985e3862d40b7596: No bootstrap required, opened a new log
I20260709 13:13:41.348157 31747 ts_tablet_manager.cc:1403] T 3879ebc472ce44d99940e2168e9099bf P 196d972917fe4f85985e3862d40b7596: Time spent bootstrapping tablet: real 0.098s	user 0.016s	sys 0.029s
I20260709 13:13:41.323734 32033 leader_election.cc:290] T dcf07174e49c498f8e19fd005690404b P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 election: Requested vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:41.347608 31759 consensus_queue.cc:237] T dcf07174e49c498f8e19fd005690404b P c74453754ee34bea9b231ae318a55a31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:41.350605 31771 raft_consensus.cc:493] T 35bbba26df1b47a7b9923618bf451ffc P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:41.351068 31771 raft_consensus.cc:515] T 35bbba26df1b47a7b9923618bf451ffc P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:41.352901 31771 leader_election.cc:290] T 35bbba26df1b47a7b9923618bf451ffc P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:41.323172 31554 raft_consensus.cc:2468] T fb97ca15f56b46dd846db7b0ff156a32 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 1.
I20260709 13:13:41.355055 31475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35bbba26df1b47a7b9923618bf451ffc" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:41.355100 31699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35bbba26df1b47a7b9923618bf451ffc" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:41.355913 31551 raft_consensus.cc:2468] T dcf07174e49c498f8e19fd005690404b P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 1.
I20260709 13:13:41.356601 31817 raft_consensus.cc:493] T fb97ca15f56b46dd846db7b0ff156a32 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:41.357026 31817 raft_consensus.cc:3060] T fb97ca15f56b46dd846db7b0ff156a32 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.363324 31747 raft_consensus.cc:359] T 3879ebc472ce44d99940e2168e9099bf P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:41.364347 31747 raft_consensus.cc:385] T 3879ebc472ce44d99940e2168e9099bf P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:41.364691 31747 raft_consensus.cc:740] T 3879ebc472ce44d99940e2168e9099bf P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 196d972917fe4f85985e3862d40b7596, State: Initialized, Role: FOLLOWER
I20260709 13:13:41.365531 31747 consensus_queue.cc:260] T 3879ebc472ce44d99940e2168e9099bf P 196d972917fe4f85985e3862d40b7596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:41.371585 31748 tablet_bootstrap.cc:492] T 70ccde113c9246f5a008add70aacae7d P c74453754ee34bea9b231ae318a55a31: No bootstrap required, opened a new log
I20260709 13:13:41.372087 31748 ts_tablet_manager.cc:1403] T 70ccde113c9246f5a008add70aacae7d P c74453754ee34bea9b231ae318a55a31: Time spent bootstrapping tablet: real 0.091s	user 0.010s	sys 0.001s
I20260709 13:13:41.372684 31747 ts_tablet_manager.cc:1434] T 3879ebc472ce44d99940e2168e9099bf P 196d972917fe4f85985e3862d40b7596: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.001s
I20260709 13:13:41.374807 31747 tablet_bootstrap.cc:492] T 0f01040b42e14f0db6bcd06319237ddb P 196d972917fe4f85985e3862d40b7596: Bootstrap starting.
I20260709 13:13:41.375142 31521 leader_election.cc:304] T 35bbba26df1b47a7b9923618bf451ffc P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 196d972917fe4f85985e3862d40b7596; no voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca
I20260709 13:13:41.375867 32079 raft_consensus.cc:2749] T 35bbba26df1b47a7b9923618bf451ffc P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:41.377827 31748 raft_consensus.cc:359] T 70ccde113c9246f5a008add70aacae7d P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:41.378610 31748 raft_consensus.cc:385] T 70ccde113c9246f5a008add70aacae7d P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:41.378417 31817 raft_consensus.cc:515] T fb97ca15f56b46dd846db7b0ff156a32 P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:41.380944 31747 tablet_bootstrap.cc:654] T 0f01040b42e14f0db6bcd06319237ddb P 196d972917fe4f85985e3862d40b7596: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:41.382586 31592 consensus_peers.cc:597] T 0f01040b42e14f0db6bcd06319237ddb P c74453754ee34bea9b231ae318a55a31 -> Peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Couldn't send request to peer 196d972917fe4f85985e3862d40b7596. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:41.383280 31551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb97ca15f56b46dd846db7b0ff156a32" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596"
I20260709 13:13:41.378921 31748 raft_consensus.cc:740] T 70ccde113c9246f5a008add70aacae7d P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Initialized, Role: FOLLOWER
I20260709 13:13:41.384974 31748 consensus_queue.cc:260] T 70ccde113c9246f5a008add70aacae7d P c74453754ee34bea9b231ae318a55a31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:41.384914 31376 catalog_manager.cc:5697] T 3879ebc472ce44d99940e2168e9099bf P 76fb155ade354ee1ba78673e73b28aca reported cstate change: term changed from 0 to 1, leader changed from <none> to 76fb155ade354ee1ba78673e73b28aca (127.23.140.68). New cstate: current_term: 1 leader_uuid: "76fb155ade354ee1ba78673e73b28aca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:41.387565 31748 ts_tablet_manager.cc:1434] T 70ccde113c9246f5a008add70aacae7d P c74453754ee34bea9b231ae318a55a31: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:13:41.387425 31376 catalog_manager.cc:5697] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 76fb155ade354ee1ba78673e73b28aca reported cstate change: term changed from 0 to 2, leader changed from <none> to 76fb155ade354ee1ba78673e73b28aca (127.23.140.68). New cstate: current_term: 2 leader_uuid: "76fb155ade354ee1ba78673e73b28aca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:41.383908 31551 raft_consensus.cc:3060] T fb97ca15f56b46dd846db7b0ff156a32 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.388900 31378 catalog_manager.cc:5697] T dcf07174e49c498f8e19fd005690404b P c74453754ee34bea9b231ae318a55a31 reported cstate change: term changed from 0 to 1, leader changed from <none> to c74453754ee34bea9b231ae318a55a31 (127.23.140.67). New cstate: current_term: 1 leader_uuid: "c74453754ee34bea9b231ae318a55a31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:41.390846 31747 tablet_bootstrap.cc:492] T 0f01040b42e14f0db6bcd06319237ddb P 196d972917fe4f85985e3862d40b7596: No bootstrap required, opened a new log
I20260709 13:13:41.391396 31747 ts_tablet_manager.cc:1403] T 0f01040b42e14f0db6bcd06319237ddb P 196d972917fe4f85985e3862d40b7596: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.001s
I20260709 13:13:41.394161 31747 raft_consensus.cc:359] T 0f01040b42e14f0db6bcd06319237ddb P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:41.394852 31747 raft_consensus.cc:385] T 0f01040b42e14f0db6bcd06319237ddb P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:41.395167 31747 raft_consensus.cc:740] T 0f01040b42e14f0db6bcd06319237ddb P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 196d972917fe4f85985e3862d40b7596, State: Initialized, Role: FOLLOWER
I20260709 13:13:41.395928 31747 consensus_queue.cc:260] T 0f01040b42e14f0db6bcd06319237ddb P 196d972917fe4f85985e3862d40b7596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:41.397612 31551 raft_consensus.cc:2468] T fb97ca15f56b46dd846db7b0ff156a32 P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 2.
I20260709 13:13:41.398927 31747 ts_tablet_manager.cc:1434] T 0f01040b42e14f0db6bcd06319237ddb P 196d972917fe4f85985e3862d40b7596: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:13:41.399626 31592 leader_election.cc:304] T fb97ca15f56b46dd846db7b0ff156a32 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, c74453754ee34bea9b231ae318a55a31; no voters: 
I20260709 13:13:41.399047 31817 leader_election.cc:290] T fb97ca15f56b46dd846db7b0ff156a32 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 2 election: Requested vote from peers 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431), 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715)
I20260709 13:13:41.401427 31817 raft_consensus.cc:2804] T fb97ca15f56b46dd846db7b0ff156a32 P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:41.400244 31699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb97ca15f56b46dd846db7b0ff156a32" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca"
I20260709 13:13:41.402244 31699 raft_consensus.cc:3060] T fb97ca15f56b46dd846db7b0ff156a32 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.402349 31817 raft_consensus.cc:697] T fb97ca15f56b46dd846db7b0ff156a32 P c74453754ee34bea9b231ae318a55a31 [term 2 LEADER]: Becoming Leader. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Running, Role: LEADER
I20260709 13:13:41.403344 31817 consensus_queue.cc:237] T fb97ca15f56b46dd846db7b0ff156a32 P c74453754ee34bea9b231ae318a55a31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:41.402652 31747 tablet_bootstrap.cc:492] T 0c12bd32cd944ce99a18fc4f9617961e P 196d972917fe4f85985e3862d40b7596: Bootstrap starting.
I20260709 13:13:41.405980 31759 consensus_queue.cc:1048] T 0f01040b42e14f0db6bcd06319237ddb P c74453754ee34bea9b231ae318a55a31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:41.409804 32075 raft_consensus.cc:493] T 76a7de5cfe774df68279e2e1e7361c6b P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:41.410320 32075 raft_consensus.cc:515] T 76a7de5cfe774df68279e2e1e7361c6b P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:41.414592 31747 tablet_bootstrap.cc:654] T 0c12bd32cd944ce99a18fc4f9617961e P 196d972917fe4f85985e3862d40b7596: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:41.414505 31551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a7de5cfe774df68279e2e1e7361c6b" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
W20260709 13:13:41.416692 31666 leader_election.cc:343] T 76a7de5cfe774df68279e2e1e7361c6b P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:41.417989 32075 leader_election.cc:290] T 76a7de5cfe774df68279e2e1e7361c6b P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:41.418269 31475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a7de5cfe774df68279e2e1e7361c6b" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:41.419131 31475 raft_consensus.cc:2468] T 76a7de5cfe774df68279e2e1e7361c6b P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 0.
I20260709 13:13:41.419500 32075 consensus_queue.cc:1048] T 3879ebc472ce44d99940e2168e9099bf P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:41.421147 31668 leader_election.cc:304] T 76a7de5cfe774df68279e2e1e7361c6b P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca; no voters: 196d972917fe4f85985e3862d40b7596
I20260709 13:13:41.422506 32089 raft_consensus.cc:2804] T 76a7de5cfe774df68279e2e1e7361c6b P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:41.422845 32089 raft_consensus.cc:493] T 76a7de5cfe774df68279e2e1e7361c6b P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:41.423157 32089 raft_consensus.cc:3060] T 76a7de5cfe774df68279e2e1e7361c6b P 76fb155ade354ee1ba78673e73b28aca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:41.425935 31759 raft_consensus.cc:493] T cfe1afd9e187451faf5f631e0c2eef00 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:41.426551 31759 raft_consensus.cc:515] T cfe1afd9e187451faf5f631e0c2eef00 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:41.429108 31759 leader_election.cc:290] T cfe1afd9e187451faf5f631e0c2eef00 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:41.431377 31475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe1afd9e187451faf5f631e0c2eef00" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:41.432278 31475 raft_consensus.cc:2468] T cfe1afd9e187451faf5f631e0c2eef00 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 0.
I20260709 13:13:41.434517 31594 leader_election.cc:304] T cfe1afd9e187451faf5f631e0c2eef00 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, c74453754ee34bea9b231ae318a55a31; no voters: 
I20260709 13:13:41.442215 32033 raft_consensus.cc:2804] T cfe1afd9e187451faf5f631e0c2eef00 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:41.442763 32033 raft_consensus.cc:493] T cfe1afd9e187451faf5f631e0c2eef00 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:41.443183 32033 raft_consensus.cc:3060] T cfe1afd9e187451faf5f631e0c2eef00 P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:41.449920 31551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe1afd9e187451faf5f631e0c2eef00" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
W20260709 13:13:41.454927 31592 leader_election.cc:343] T cfe1afd9e187451faf5f631e0c2eef00 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:41.460085 31699 raft_consensus.cc:2468] T fb97ca15f56b46dd846db7b0ff156a32 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 2.
I20260709 13:13:41.445542 32089 raft_consensus.cc:515] T 76a7de5cfe774df68279e2e1e7361c6b P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:41.463413 31475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a7de5cfe774df68279e2e1e7361c6b" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
I20260709 13:13:41.464059 31475 raft_consensus.cc:3060] T 76a7de5cfe774df68279e2e1e7361c6b P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:41.477454 32089 leader_election.cc:290] T 76a7de5cfe774df68279e2e1e7361c6b P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 election: Requested vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:41.478420 31475 raft_consensus.cc:2468] T 76a7de5cfe774df68279e2e1e7361c6b P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 1.
I20260709 13:13:41.479528 31668 leader_election.cc:304] T 76a7de5cfe774df68279e2e1e7361c6b P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca; no voters: 
I20260709 13:13:41.481267 32089 raft_consensus.cc:2804] T 76a7de5cfe774df68279e2e1e7361c6b P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:41.481762 32089 raft_consensus.cc:697] T 76a7de5cfe774df68279e2e1e7361c6b P 76fb155ade354ee1ba78673e73b28aca [term 1 LEADER]: Becoming Leader. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Running, Role: LEADER
I20260709 13:13:41.483706 31554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a7de5cfe774df68279e2e1e7361c6b" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596"
I20260709 13:13:41.483569 32089 consensus_queue.cc:237] T 76a7de5cfe774df68279e2e1e7361c6b P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
W20260709 13:13:41.484809 31666 leader_election.cc:343] T 76a7de5cfe774df68279e2e1e7361c6b P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:41.485809 31551 raft_consensus.cc:3060] T 3879ebc472ce44d99940e2168e9099bf P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:41.488704 32183 raft_consensus.cc:493] T 0f01040b42e14f0db6bcd06319237ddb P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:41.489172 32183 raft_consensus.cc:515] T 0f01040b42e14f0db6bcd06319237ddb P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:41.492421 32183 leader_election.cc:290] T 0f01040b42e14f0db6bcd06319237ddb P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715)
I20260709 13:13:41.492934 31697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f01040b42e14f0db6bcd06319237ddb" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:41.495380 31626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f01040b42e14f0db6bcd06319237ddb" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:41.496995 31521 leader_election.cc:304] T 0f01040b42e14f0db6bcd06319237ddb P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 196d972917fe4f85985e3862d40b7596; no voters: 76fb155ade354ee1ba78673e73b28aca, c74453754ee34bea9b231ae318a55a31
I20260709 13:13:41.498082 32183 raft_consensus.cc:2749] T 0f01040b42e14f0db6bcd06319237ddb P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:41.500092 31747 tablet_bootstrap.cc:492] T 0c12bd32cd944ce99a18fc4f9617961e P 196d972917fe4f85985e3862d40b7596: No bootstrap required, opened a new log
I20260709 13:13:41.500618 31747 ts_tablet_manager.cc:1403] T 0c12bd32cd944ce99a18fc4f9617961e P 196d972917fe4f85985e3862d40b7596: Time spent bootstrapping tablet: real 0.098s	user 0.039s	sys 0.039s
I20260709 13:13:41.505446 31747 raft_consensus.cc:359] T 0c12bd32cd944ce99a18fc4f9617961e P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:41.506098 31747 raft_consensus.cc:385] T 0c12bd32cd944ce99a18fc4f9617961e P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:41.507000 31747 raft_consensus.cc:740] T 0c12bd32cd944ce99a18fc4f9617961e P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 196d972917fe4f85985e3862d40b7596, State: Initialized, Role: FOLLOWER
I20260709 13:13:41.507712 31747 consensus_queue.cc:260] T 0c12bd32cd944ce99a18fc4f9617961e P 196d972917fe4f85985e3862d40b7596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:41.509513 31747 ts_tablet_manager.cc:1434] T 0c12bd32cd944ce99a18fc4f9617961e P 196d972917fe4f85985e3862d40b7596: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:13:41.511299 31747 tablet_bootstrap.cc:492] T 76a7de5cfe774df68279e2e1e7361c6b P 196d972917fe4f85985e3862d40b7596: Bootstrap starting.
I20260709 13:13:41.517082 31747 tablet_bootstrap.cc:654] T 76a7de5cfe774df68279e2e1e7361c6b P 196d972917fe4f85985e3862d40b7596: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:41.516868 31376 catalog_manager.cc:5697] T 76a7de5cfe774df68279e2e1e7361c6b P 76fb155ade354ee1ba78673e73b28aca reported cstate change: term changed from 0 to 1, leader changed from <none> to 76fb155ade354ee1ba78673e73b28aca (127.23.140.68). New cstate: current_term: 1 leader_uuid: "76fb155ade354ee1ba78673e73b28aca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:41.535861 31378 catalog_manager.cc:5697] T fb97ca15f56b46dd846db7b0ff156a32 P c74453754ee34bea9b231ae318a55a31 reported cstate change: term changed from 0 to 2, leader changed from <none> to c74453754ee34bea9b231ae318a55a31 (127.23.140.67). New cstate: current_term: 2 leader_uuid: "c74453754ee34bea9b231ae318a55a31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:41.468930 32033 raft_consensus.cc:515] T cfe1afd9e187451faf5f631e0c2eef00 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:41.542127 32033 leader_election.cc:290] T cfe1afd9e187451faf5f631e0c2eef00 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 election: Requested vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:41.544041 31554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe1afd9e187451faf5f631e0c2eef00" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596"
I20260709 13:13:41.547951 31475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe1afd9e187451faf5f631e0c2eef00" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
I20260709 13:13:41.548856 31475 raft_consensus.cc:3060] T cfe1afd9e187451faf5f631e0c2eef00 P 458d610e8abf4f2ea831ab7bf3576da6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:41.550000 32183 raft_consensus.cc:493] T 3879ebc472ce44d99940e2168e9099bf P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:41.550587 32183 raft_consensus.cc:515] T 3879ebc472ce44d99940e2168e9099bf P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:41.557178 31747 tablet_bootstrap.cc:492] T 76a7de5cfe774df68279e2e1e7361c6b P 196d972917fe4f85985e3862d40b7596: No bootstrap required, opened a new log
I20260709 13:13:41.557960 32183 leader_election.cc:290] T 3879ebc472ce44d99940e2168e9099bf P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715)
W20260709 13:13:41.558092 31592 leader_election.cc:343] T cfe1afd9e187451faf5f631e0c2eef00 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:41.558169 31747 ts_tablet_manager.cc:1403] T 76a7de5cfe774df68279e2e1e7361c6b P 196d972917fe4f85985e3862d40b7596: Time spent bootstrapping tablet: real 0.047s	user 0.016s	sys 0.024s
I20260709 13:13:41.559262 31699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3879ebc472ce44d99940e2168e9099bf" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:41.559165 32089 consensus_queue.cc:1048] T 3879ebc472ce44d99940e2168e9099bf P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:41.561448 31747 raft_consensus.cc:359] T 76a7de5cfe774df68279e2e1e7361c6b P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:41.562244 31747 raft_consensus.cc:385] T 76a7de5cfe774df68279e2e1e7361c6b P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:41.562552 31747 raft_consensus.cc:740] T 76a7de5cfe774df68279e2e1e7361c6b P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 196d972917fe4f85985e3862d40b7596, State: Initialized, Role: FOLLOWER
I20260709 13:13:41.563251 31747 consensus_queue.cc:260] T 76a7de5cfe774df68279e2e1e7361c6b P 196d972917fe4f85985e3862d40b7596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:41.565155 31747 ts_tablet_manager.cc:1434] T 76a7de5cfe774df68279e2e1e7361c6b P 196d972917fe4f85985e3862d40b7596: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:13:41.566074 31747 tablet_bootstrap.cc:492] T cfe1afd9e187451faf5f631e0c2eef00 P 196d972917fe4f85985e3862d40b7596: Bootstrap starting.
I20260709 13:13:41.567157 31626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3879ebc472ce44d99940e2168e9099bf" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:41.569100 31521 leader_election.cc:304] T 3879ebc472ce44d99940e2168e9099bf P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 196d972917fe4f85985e3862d40b7596; no voters: 76fb155ade354ee1ba78673e73b28aca, c74453754ee34bea9b231ae318a55a31
I20260709 13:13:41.572134 31747 tablet_bootstrap.cc:654] T cfe1afd9e187451faf5f631e0c2eef00 P 196d972917fe4f85985e3862d40b7596: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:41.575582 31475 raft_consensus.cc:2468] T cfe1afd9e187451faf5f631e0c2eef00 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 1.
I20260709 13:13:41.577311 31594 leader_election.cc:304] T cfe1afd9e187451faf5f631e0c2eef00 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, c74453754ee34bea9b231ae318a55a31; no voters: 196d972917fe4f85985e3862d40b7596
I20260709 13:13:41.578946 31817 raft_consensus.cc:2804] T cfe1afd9e187451faf5f631e0c2eef00 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:41.579622 31817 raft_consensus.cc:697] T cfe1afd9e187451faf5f631e0c2eef00 P c74453754ee34bea9b231ae318a55a31 [term 1 LEADER]: Becoming Leader. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Running, Role: LEADER
I20260709 13:13:41.580621 31817 consensus_queue.cc:237] T cfe1afd9e187451faf5f631e0c2eef00 P c74453754ee34bea9b231ae318a55a31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:41.583448 31747 tablet_bootstrap.cc:492] T cfe1afd9e187451faf5f631e0c2eef00 P 196d972917fe4f85985e3862d40b7596: No bootstrap required, opened a new log
I20260709 13:13:41.583973 31747 ts_tablet_manager.cc:1403] T cfe1afd9e187451faf5f631e0c2eef00 P 196d972917fe4f85985e3862d40b7596: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.007s
I20260709 13:13:41.586661 31747 raft_consensus.cc:359] T cfe1afd9e187451faf5f631e0c2eef00 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:41.587391 31747 raft_consensus.cc:385] T cfe1afd9e187451faf5f631e0c2eef00 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:41.587720 31747 raft_consensus.cc:740] T cfe1afd9e187451faf5f631e0c2eef00 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 196d972917fe4f85985e3862d40b7596, State: Initialized, Role: FOLLOWER
I20260709 13:13:41.588879 32183 raft_consensus.cc:2749] T 3879ebc472ce44d99940e2168e9099bf P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:41.588819 31747 consensus_queue.cc:260] T cfe1afd9e187451faf5f631e0c2eef00 P 196d972917fe4f85985e3862d40b7596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:41.591115 31747 ts_tablet_manager.cc:1434] T cfe1afd9e187451faf5f631e0c2eef00 P 196d972917fe4f85985e3862d40b7596: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:13:41.602264 31378 catalog_manager.cc:5697] T cfe1afd9e187451faf5f631e0c2eef00 P c74453754ee34bea9b231ae318a55a31 reported cstate change: term changed from 0 to 1, leader changed from <none> to c74453754ee34bea9b231ae318a55a31 (127.23.140.67). New cstate: current_term: 1 leader_uuid: "c74453754ee34bea9b231ae318a55a31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:41.627285 32079 raft_consensus.cc:493] T 76a7de5cfe774df68279e2e1e7361c6b P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:41.627786 32079 raft_consensus.cc:515] T 76a7de5cfe774df68279e2e1e7361c6b P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:41.629693 32079 leader_election.cc:290] T 76a7de5cfe774df68279e2e1e7361c6b P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:41.629843 31554 raft_consensus.cc:3060] T 35bbba26df1b47a7b9923618bf451ffc P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:41.630286 31699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a7de5cfe774df68279e2e1e7361c6b" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:41.630700 31475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a7de5cfe774df68279e2e1e7361c6b" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:41.631484 31475 raft_consensus.cc:2393] T 76a7de5cfe774df68279e2e1e7361c6b P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 196d972917fe4f85985e3862d40b7596 in current term 1: Already voted for candidate 76fb155ade354ee1ba78673e73b28aca in this term.
I20260709 13:13:41.632413 31520 leader_election.cc:304] T 76a7de5cfe774df68279e2e1e7361c6b P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 196d972917fe4f85985e3862d40b7596; no voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca
I20260709 13:13:41.633239 32079 raft_consensus.cc:3060] T 76a7de5cfe774df68279e2e1e7361c6b P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:41.639366 32079 raft_consensus.cc:2749] T 76a7de5cfe774df68279e2e1e7361c6b P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:41.640040 31550 raft_consensus.cc:3060] T 0c12bd32cd944ce99a18fc4f9617961e P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:41.748456 31550 raft_consensus.cc:1275] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Refusing update from remote peer 76fb155ade354ee1ba78673e73b28aca: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:13:41.749577 32089 consensus_queue.cc:1048] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:41.760726 31477 raft_consensus.cc:1275] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Refusing update from remote peer 76fb155ade354ee1ba78673e73b28aca: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:13:41.762197 32075 consensus_queue.cc:1048] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:41.770821 31626 raft_consensus.cc:3060] T 70ccde113c9246f5a008add70aacae7d P c74453754ee34bea9b231ae318a55a31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:41.790096 32127 consensus_queue.cc:1048] T 70ccde113c9246f5a008add70aacae7d P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:41.792511 32033 raft_consensus.cc:493] T 70ccde113c9246f5a008add70aacae7d P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:41.793049 32033 raft_consensus.cc:515] T 70ccde113c9246f5a008add70aacae7d P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:41.796869 32033 leader_election.cc:290] T 70ccde113c9246f5a008add70aacae7d P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:41.798029 31699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70ccde113c9246f5a008add70aacae7d" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:41.798743 31475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70ccde113c9246f5a008add70aacae7d" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:41.799247 31699 raft_consensus.cc:2468] T 70ccde113c9246f5a008add70aacae7d P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 1.
I20260709 13:13:41.800299 31595 leader_election.cc:304] T 70ccde113c9246f5a008add70aacae7d P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca, c74453754ee34bea9b231ae318a55a31; no voters: 458d610e8abf4f2ea831ab7bf3576da6
I20260709 13:13:41.801486 32033 raft_consensus.cc:2804] T 70ccde113c9246f5a008add70aacae7d P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:41.801931 32033 raft_consensus.cc:493] T 70ccde113c9246f5a008add70aacae7d P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 458d610e8abf4f2ea831ab7bf3576da6)
I20260709 13:13:41.802299 32033 raft_consensus.cc:3060] T 70ccde113c9246f5a008add70aacae7d P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.810528 32033 raft_consensus.cc:515] T 70ccde113c9246f5a008add70aacae7d P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:41.818187 31623 raft_consensus.cc:1240] T 70ccde113c9246f5a008add70aacae7d P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Rejecting Update request from peer 458d610e8abf4f2ea831ab7bf3576da6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:41.818287 32127 consensus_queue.cc:1048] T 70ccde113c9246f5a008add70aacae7d P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:41.821666 31697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70ccde113c9246f5a008add70aacae7d" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca"
I20260709 13:13:41.822176 32077 consensus_queue.cc:1059] T 70ccde113c9246f5a008add70aacae7d P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:41.823019 32077 raft_consensus.cc:3055] T 70ccde113c9246f5a008add70aacae7d P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:41.823328 32077 raft_consensus.cc:740] T 70ccde113c9246f5a008add70aacae7d P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Running, Role: LEADER
I20260709 13:13:41.824110 32077 consensus_queue.cc:260] T 70ccde113c9246f5a008add70aacae7d P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:41.825626 32077 raft_consensus.cc:3060] T 70ccde113c9246f5a008add70aacae7d P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.831048 32033 leader_election.cc:290] T 70ccde113c9246f5a008add70aacae7d P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 2 election: Requested vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:41.832412 31475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70ccde113c9246f5a008add70aacae7d" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
I20260709 13:13:41.839212 31817 consensus_queue.cc:1048] T dcf07174e49c498f8e19fd005690404b P c74453754ee34bea9b231ae318a55a31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:41.843602 31874 consensus_queue.cc:1048] T dcf07174e49c498f8e19fd005690404b P c74453754ee34bea9b231ae318a55a31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:41.848613 31475 raft_consensus.cc:2468] T 70ccde113c9246f5a008add70aacae7d P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 2.
I20260709 13:13:41.848809 31696 raft_consensus.cc:1275] T fb97ca15f56b46dd846db7b0ff156a32 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Refusing update from remote peer c74453754ee34bea9b231ae318a55a31: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:13:41.850924 31594 leader_election.cc:304] T 70ccde113c9246f5a008add70aacae7d P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, c74453754ee34bea9b231ae318a55a31; no voters: 76fb155ade354ee1ba78673e73b28aca
I20260709 13:13:41.853047 31759 raft_consensus.cc:2804] T 70ccde113c9246f5a008add70aacae7d P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:41.853195 31874 consensus_queue.cc:1048] T fb97ca15f56b46dd846db7b0ff156a32 P c74453754ee34bea9b231ae318a55a31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:41.853518 31759 raft_consensus.cc:697] T 70ccde113c9246f5a008add70aacae7d P c74453754ee34bea9b231ae318a55a31 [term 2 LEADER]: Becoming Leader. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Running, Role: LEADER
I20260709 13:13:41.854275 31759 consensus_queue.cc:237] T 70ccde113c9246f5a008add70aacae7d P c74453754ee34bea9b231ae318a55a31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:41.865701 31378 catalog_manager.cc:5697] T 70ccde113c9246f5a008add70aacae7d P c74453754ee34bea9b231ae318a55a31 reported cstate change: term changed from 1 to 2, leader changed from 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65) to c74453754ee34bea9b231ae318a55a31 (127.23.140.67). New cstate: current_term: 2 leader_uuid: "c74453754ee34bea9b231ae318a55a31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:41.877581 31551 raft_consensus.cc:1275] T fb97ca15f56b46dd846db7b0ff156a32 P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Refusing update from remote peer c74453754ee34bea9b231ae318a55a31: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:13:41.879770 31759 consensus_queue.cc:1048] T fb97ca15f56b46dd846db7b0ff156a32 P c74453754ee34bea9b231ae318a55a31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:41.890408 32160 consensus_queue.cc:1048] T 76a7de5cfe774df68279e2e1e7361c6b P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:41.906246 32160 consensus_queue.cc:1048] T 76a7de5cfe774df68279e2e1e7361c6b P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:41.987934 31550 raft_consensus.cc:3060] T 0f01040b42e14f0db6bcd06319237ddb P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:41.995378 32079 raft_consensus.cc:493] T cfe1afd9e187451faf5f631e0c2eef00 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:41.995944 32079 raft_consensus.cc:515] T cfe1afd9e187451faf5f631e0c2eef00 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:41.997931 32079 leader_election.cc:290] T cfe1afd9e187451faf5f631e0c2eef00 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:41.999392 31475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe1afd9e187451faf5f631e0c2eef00" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:41.999607 31626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe1afd9e187451faf5f631e0c2eef00" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:42.000195 31475 raft_consensus.cc:2393] T cfe1afd9e187451faf5f631e0c2eef00 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 196d972917fe4f85985e3862d40b7596 in current term 1: Already voted for candidate c74453754ee34bea9b231ae318a55a31 in this term.
I20260709 13:13:42.002470 31520 leader_election.cc:304] T cfe1afd9e187451faf5f631e0c2eef00 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 196d972917fe4f85985e3862d40b7596; no voters: 458d610e8abf4f2ea831ab7bf3576da6, c74453754ee34bea9b231ae318a55a31
I20260709 13:13:42.005180 32079 raft_consensus.cc:3060] T cfe1afd9e187451faf5f631e0c2eef00 P 196d972917fe4f85985e3862d40b7596 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:42.010455 32079 raft_consensus.cc:2749] T cfe1afd9e187451faf5f631e0c2eef00 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:42.024628 32033 consensus_queue.cc:1048] T cfe1afd9e187451faf5f631e0c2eef00 P c74453754ee34bea9b231ae318a55a31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:42.036253 31759 consensus_queue.cc:1048] T cfe1afd9e187451faf5f631e0c2eef00 P c74453754ee34bea9b231ae318a55a31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:42.338917 31475 raft_consensus.cc:1275] T 70ccde113c9246f5a008add70aacae7d P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Refusing update from remote peer c74453754ee34bea9b231ae318a55a31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:42.340157 31759 consensus_queue.cc:1048] T 70ccde113c9246f5a008add70aacae7d P c74453754ee34bea9b231ae318a55a31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:42.347060 31697 raft_consensus.cc:3060] T 70ccde113c9246f5a008add70aacae7d P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:42.357718 31697 raft_consensus.cc:1275] T 70ccde113c9246f5a008add70aacae7d P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Refusing update from remote peer c74453754ee34bea9b231ae318a55a31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:42.359434 31817 consensus_queue.cc:1048] T 70ccde113c9246f5a008add70aacae7d P c74453754ee34bea9b231ae318a55a31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:42.751268 24113 tablet_server.cc:179] TabletServer@127.23.140.65:0 shutting down...
W20260709 13:13:42.760885 31668 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:13:42.793972 31668 consensus_peers.cc:597] T d78bdf917ee94331b91cb3fb308ef2a1 P 76fb155ade354ee1ba78673e73b28aca -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:42.807817 31520 consensus_peers.cc:597] T fc35ae8230cf4ab792d0e15bcaf8b653 P 196d972917fe4f85985e3862d40b7596 -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:42.811076 31668 consensus_peers.cc:597] T bd1c90f0a848434cb7df23dbeae35ddf P 76fb155ade354ee1ba78673e73b28aca -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:42.821372 31594 consensus_peers.cc:597] T 53c18818aa9c44c8987bb675a05026a4 P c74453754ee34bea9b231ae318a55a31 -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:42.828944 31520 consensus_peers.cc:597] T c8185106c7a94c3ebaace350d2363217 P 196d972917fe4f85985e3862d40b7596 -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:42.834307 24113 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:42.836410 24113 tablet_replica.cc:333] T 8a98dff441f1479992f85708c9f03283 P 458d610e8abf4f2ea831ab7bf3576da6: stopping tablet replica
I20260709 13:13:42.837242 24113 raft_consensus.cc:2243] T 8a98dff441f1479992f85708c9f03283 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:42.838074 24113 raft_consensus.cc:2272] T 8a98dff441f1479992f85708c9f03283 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:42.839977 24113 tablet_replica.cc:333] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 458d610e8abf4f2ea831ab7bf3576da6: stopping tablet replica
I20260709 13:13:42.840579 24113 raft_consensus.cc:2243] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:42.841270 24113 raft_consensus.cc:2272] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:42.843148 24113 tablet_replica.cc:333] T 70ccde113c9246f5a008add70aacae7d P 458d610e8abf4f2ea831ab7bf3576da6: stopping tablet replica
I20260709 13:13:42.843686 24113 raft_consensus.cc:2243] T 70ccde113c9246f5a008add70aacae7d P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:42.844149 24113 raft_consensus.cc:2272] T 70ccde113c9246f5a008add70aacae7d P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:42.846654 24113 tablet_replica.cc:333] T fb4f7292ed2f489e922ca5fb1c6e47bf P 458d610e8abf4f2ea831ab7bf3576da6: stopping tablet replica
I20260709 13:13:42.847494 24113 raft_consensus.cc:2243] T fb4f7292ed2f489e922ca5fb1c6e47bf P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:42.848335 24113 raft_consensus.cc:2272] T fb4f7292ed2f489e922ca5fb1c6e47bf P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:42.850065 24113 tablet_replica.cc:333] T 497217e9b47244fcb425c66935cb8a20 P 458d610e8abf4f2ea831ab7bf3576da6: stopping tablet replica
I20260709 13:13:42.850610 24113 raft_consensus.cc:2243] T 497217e9b47244fcb425c66935cb8a20 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:42.851468 24113 raft_consensus.cc:2272] T 497217e9b47244fcb425c66935cb8a20 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:42.854812 24113 tablet_replica.cc:333] T 47cb0ae4817d4c19ac11b42143d00039 P 458d610e8abf4f2ea831ab7bf3576da6: stopping tablet replica
I20260709 13:13:42.855605 24113 raft_consensus.cc:2243] T 47cb0ae4817d4c19ac11b42143d00039 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:42.856096 24113 raft_consensus.cc:2272] T 47cb0ae4817d4c19ac11b42143d00039 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:42.858244 24113 tablet_replica.cc:333] T 6038006ca0e344af86fe5febd517c62a P 458d610e8abf4f2ea831ab7bf3576da6: stopping tablet replica
I20260709 13:13:42.858805 24113 raft_consensus.cc:2243] T 6038006ca0e344af86fe5febd517c62a P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:13:42.859189 31594 consensus_peers.cc:597] T cfe1afd9e187451faf5f631e0c2eef00 P c74453754ee34bea9b231ae318a55a31 -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:42.859202 24113 raft_consensus.cc:2272] T 6038006ca0e344af86fe5febd517c62a P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:42.859827 31594 consensus_peers.cc:597] T ddbfc15d5bf24708a4268dfa206ede07 P c74453754ee34bea9b231ae318a55a31 -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:42.861205 24113 tablet_replica.cc:333] T 53c18818aa9c44c8987bb675a05026a4 P 458d610e8abf4f2ea831ab7bf3576da6: stopping tablet replica
I20260709 13:13:42.861889 24113 raft_consensus.cc:2243] T 53c18818aa9c44c8987bb675a05026a4 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:42.862282 24113 raft_consensus.cc:2272] T 53c18818aa9c44c8987bb675a05026a4 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:42.863863 24113 tablet_replica.cc:333] T ee6c632286174388ab5e7bfb2ae40078 P 458d610e8abf4f2ea831ab7bf3576da6: stopping tablet replica
I20260709 13:13:42.864419 24113 raft_consensus.cc:2243] T ee6c632286174388ab5e7bfb2ae40078 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:42.864924 24113 raft_consensus.cc:2272] T ee6c632286174388ab5e7bfb2ae40078 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:42.867057 24113 tablet_replica.cc:333] T 85d4a24725c749199c1b35d959b1b2b5 P 458d610e8abf4f2ea831ab7bf3576da6: stopping tablet replica
I20260709 13:13:42.867781 24113 raft_consensus.cc:2243] T 85d4a24725c749199c1b35d959b1b2b5 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:42.868654 24113 raft_consensus.cc:2272] T 85d4a24725c749199c1b35d959b1b2b5 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:42.870707 24113 tablet_replica.cc:333] T 35bbba26df1b47a7b9923618bf451ffc P 458d610e8abf4f2ea831ab7bf3576da6: stopping tablet replica
I20260709 13:13:42.871296 24113 raft_consensus.cc:2243] T 35bbba26df1b47a7b9923618bf451ffc P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:42.871977 24113 raft_consensus.cc:2272] T 35bbba26df1b47a7b9923618bf451ffc P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:42.873905 24113 tablet_replica.cc:333] T 5ea74721b8824d00b63c524b25ff23df P 458d610e8abf4f2ea831ab7bf3576da6: stopping tablet replica
I20260709 13:13:42.874372 24113 raft_consensus.cc:2243] T 5ea74721b8824d00b63c524b25ff23df P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:42.874740 24113 raft_consensus.cc:2272] T 5ea74721b8824d00b63c524b25ff23df P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:42.876454 24113 tablet_replica.cc:333] T 5b669b8d34ee4de5b002d30fbcf02dd7 P 458d610e8abf4f2ea831ab7bf3576da6: stopping tablet replica
I20260709 13:13:42.877167 24113 raft_consensus.cc:2243] T 5b669b8d34ee4de5b002d30fbcf02dd7 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:42.877600 24113 raft_consensus.cc:2272] T 5b669b8d34ee4de5b002d30fbcf02dd7 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:42.879215 24113 tablet_replica.cc:333] T b3705de0af7a48f69f751aab333fdf3d P 458d610e8abf4f2ea831ab7bf3576da6: stopping tablet replica
W20260709 13:13:42.879942 31668 consensus_peers.cc:597] T 76a7de5cfe774df68279e2e1e7361c6b P 76fb155ade354ee1ba78673e73b28aca -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:42.879961 24113 raft_consensus.cc:2243] T b3705de0af7a48f69f751aab333fdf3d P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:42.880705 24113 raft_consensus.cc:2272] T b3705de0af7a48f69f751aab333fdf3d P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:42.882896 24113 tablet_replica.cc:333] T 216111c5962f4b82ae52414985988860 P 458d610e8abf4f2ea831ab7bf3576da6: stopping tablet replica
I20260709 13:13:42.883526 24113 raft_consensus.cc:2243] T 216111c5962f4b82ae52414985988860 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:42.883972 24113 raft_consensus.cc:2272] T 216111c5962f4b82ae52414985988860 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:42.886128 24113 tablet_replica.cc:333] T b262a50e82034c57a4bfb7da683ff5d1 P 458d610e8abf4f2ea831ab7bf3576da6: stopping tablet replica
I20260709 13:13:42.886767 24113 raft_consensus.cc:2243] T b262a50e82034c57a4bfb7da683ff5d1 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:42.887648 24113 raft_consensus.cc:2272] T b262a50e82034c57a4bfb7da683ff5d1 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:42.888127 31668 consensus_peers.cc:597] T 47cb0ae4817d4c19ac11b42143d00039 P 76fb155ade354ee1ba78673e73b28aca -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:42.889925 24113 tablet_replica.cc:333] T 40ab5d7d13ee4460933b5799482e3f87 P 458d610e8abf4f2ea831ab7bf3576da6: stopping tablet replica
I20260709 13:13:42.890722 24113 raft_consensus.cc:2243] T 40ab5d7d13ee4460933b5799482e3f87 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:42.891186 24113 raft_consensus.cc:2272] T 40ab5d7d13ee4460933b5799482e3f87 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:42.893338 24113 tablet_replica.cc:333] T 1fb28788823d4c5fab527f4ee2da4d2e P 458d610e8abf4f2ea831ab7bf3576da6: stopping tablet replica
I20260709 13:13:42.894086 24113 raft_consensus.cc:2243] T 1fb28788823d4c5fab527f4ee2da4d2e P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:42.894539 24113 raft_consensus.cc:2272] T 1fb28788823d4c5fab527f4ee2da4d2e P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:42.896837 24113 tablet_replica.cc:333] T 4d146b574e8d4e21bd8d81cb29b4267a P 458d610e8abf4f2ea831ab7bf3576da6: stopping tablet replica
I20260709 13:13:42.897516 24113 raft_consensus.cc:2243] T 4d146b574e8d4e21bd8d81cb29b4267a P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:42.898058 24113 raft_consensus.cc:2272] T 4d146b574e8d4e21bd8d81cb29b4267a P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:42.899422 31594 consensus_peers.cc:597] T 6038006ca0e344af86fe5febd517c62a P c74453754ee34bea9b231ae318a55a31 -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:42.900486 24113 tablet_replica.cc:333] T f66580482b2d470bacbfec917042485b P 458d610e8abf4f2ea831ab7bf3576da6: stopping tablet replica
I20260709 13:13:42.901333 24113 raft_consensus.cc:2243] T f66580482b2d470bacbfec917042485b P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:42.901854 24113 raft_consensus.cc:2272] T f66580482b2d470bacbfec917042485b P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:42.903683 24113 tablet_replica.cc:333] T e698d6d2e2e74eca91e222e9bfdf8f13 P 458d610e8abf4f2ea831ab7bf3576da6: stopping tablet replica
I20260709 13:13:42.904332 24113 raft_consensus.cc:2243] T e698d6d2e2e74eca91e222e9bfdf8f13 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:42.904757 24113 raft_consensus.cc:2272] T e698d6d2e2e74eca91e222e9bfdf8f13 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:42.906801 24113 tablet_replica.cc:333] T 364efc87879c4e6db82a829c76ef0045 P 458d610e8abf4f2ea831ab7bf3576da6: stopping tablet replica
I20260709 13:13:42.907356 24113 raft_consensus.cc:2243] T 364efc87879c4e6db82a829c76ef0045 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:42.908043 24113 raft_consensus.cc:2272] T 364efc87879c4e6db82a829c76ef0045 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:42.910665 24113 tablet_replica.cc:333] T 81f4d53616e74e2ea71e52fdb3e8fc76 P 458d610e8abf4f2ea831ab7bf3576da6: stopping tablet replica
I20260709 13:13:42.911377 24113 raft_consensus.cc:2243] T 81f4d53616e74e2ea71e52fdb3e8fc76 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:42.911893 24113 raft_consensus.cc:2272] T 81f4d53616e74e2ea71e52fdb3e8fc76 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:42.914003 24113 tablet_replica.cc:333] T d78bdf917ee94331b91cb3fb308ef2a1 P 458d610e8abf4f2ea831ab7bf3576da6: stopping tablet replica
I20260709 13:13:42.914531 24113 raft_consensus.cc:2243] T d78bdf917ee94331b91cb3fb308ef2a1 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:42.914947 24113 raft_consensus.cc:2272] T d78bdf917ee94331b91cb3fb308ef2a1 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:42.916571 24113 tablet_replica.cc:333] T dcf07174e49c498f8e19fd005690404b P 458d610e8abf4f2ea831ab7bf3576da6: stopping tablet replica
I20260709 13:13:42.917096 24113 raft_consensus.cc:2243] T dcf07174e49c498f8e19fd005690404b P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:42.917516 24113 raft_consensus.cc:2272] T dcf07174e49c498f8e19fd005690404b P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:42.919521 24113 tablet_replica.cc:333] T 4fe725ada8f142d1bb9a35a30f865c10 P 458d610e8abf4f2ea831ab7bf3576da6: stopping tablet replica
I20260709 13:13:42.920218 24113 raft_consensus.cc:2243] T 4fe725ada8f142d1bb9a35a30f865c10 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:42.920722 24113 raft_consensus.cc:2272] T 4fe725ada8f142d1bb9a35a30f865c10 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:42.921941 31594 consensus_peers.cc:597] T f66580482b2d470bacbfec917042485b P c74453754ee34bea9b231ae318a55a31 -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:42.923334 24113 tablet_replica.cc:333] T 98a7e38754ed4644bf90b39aff07c70f P 458d610e8abf4f2ea831ab7bf3576da6: stopping tablet replica
I20260709 13:13:42.924175 24113 raft_consensus.cc:2243] T 98a7e38754ed4644bf90b39aff07c70f P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:42.924649 24113 raft_consensus.cc:2272] T 98a7e38754ed4644bf90b39aff07c70f P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:42.926810 24113 tablet_replica.cc:333] T 36bf73ed3df141c889c046ad6902e304 P 458d610e8abf4f2ea831ab7bf3576da6: stopping tablet replica
I20260709 13:13:42.927439 24113 raft_consensus.cc:2243] T 36bf73ed3df141c889c046ad6902e304 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:42.928406 24113 raft_consensus.cc:2272] T 36bf73ed3df141c889c046ad6902e304 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:42.930651 24113 tablet_replica.cc:333] T a35171dce2e34beeafe34f3e80f18a41 P 458d610e8abf4f2ea831ab7bf3576da6: stopping tablet replica
I20260709 13:13:42.931365 24113 raft_consensus.cc:2243] T a35171dce2e34beeafe34f3e80f18a41 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:42.931845 24113 raft_consensus.cc:2272] T a35171dce2e34beeafe34f3e80f18a41 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:42.933683 31594 consensus_peers.cc:597] T 70ccde113c9246f5a008add70aacae7d P c74453754ee34bea9b231ae318a55a31 -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:42.934065 24113 tablet_replica.cc:333] T 11617136d6c14faea3cee24e00514101 P 458d610e8abf4f2ea831ab7bf3576da6: stopping tablet replica
I20260709 13:13:42.934928 24113 raft_consensus.cc:2243] T 11617136d6c14faea3cee24e00514101 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:42.935442 24113 raft_consensus.cc:2272] T 11617136d6c14faea3cee24e00514101 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:42.936751 31594 consensus_peers.cc:597] T 5ea74721b8824d00b63c524b25ff23df P c74453754ee34bea9b231ae318a55a31 -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:42.937809 24113 tablet_replica.cc:333] T 2568dda6664d4363abc4fd891fa48370 P 458d610e8abf4f2ea831ab7bf3576da6: stopping tablet replica
I20260709 13:13:42.938416 24113 raft_consensus.cc:2243] T 2568dda6664d4363abc4fd891fa48370 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:42.939122 24113 raft_consensus.cc:2272] T 2568dda6664d4363abc4fd891fa48370 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:42.941056 24113 tablet_replica.cc:333] T 76a7de5cfe774df68279e2e1e7361c6b P 458d610e8abf4f2ea831ab7bf3576da6: stopping tablet replica
I20260709 13:13:42.941587 24113 raft_consensus.cc:2243] T 76a7de5cfe774df68279e2e1e7361c6b P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:42.942028 24113 raft_consensus.cc:2272] T 76a7de5cfe774df68279e2e1e7361c6b P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:42.943608 24113 tablet_replica.cc:333] T eb560d89d58246e5856a763e3be6f086 P 458d610e8abf4f2ea831ab7bf3576da6: stopping tablet replica
I20260709 13:13:42.944330 24113 raft_consensus.cc:2243] T eb560d89d58246e5856a763e3be6f086 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:42.944805 24113 raft_consensus.cc:2272] T eb560d89d58246e5856a763e3be6f086 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:42.947120 24113 tablet_replica.cc:333] T cfe1afd9e187451faf5f631e0c2eef00 P 458d610e8abf4f2ea831ab7bf3576da6: stopping tablet replica
I20260709 13:13:42.947860 24113 raft_consensus.cc:2243] T cfe1afd9e187451faf5f631e0c2eef00 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:13:42.948305 31668 consensus_peers.cc:597] T 075b9562a2b547c8aad80c2bae413556 P 76fb155ade354ee1ba78673e73b28aca -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:42.948321 24113 raft_consensus.cc:2272] T cfe1afd9e187451faf5f631e0c2eef00 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:42.952463 24113 tablet_replica.cc:333] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 458d610e8abf4f2ea831ab7bf3576da6: stopping tablet replica
W20260709 13:13:42.952903 31520 consensus_peers.cc:597] T 81f4d53616e74e2ea71e52fdb3e8fc76 P 196d972917fe4f85985e3862d40b7596 -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:42.953024 24113 raft_consensus.cc:2243] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:42.953562 24113 raft_consensus.cc:2272] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:42.955300 24113 tablet_replica.cc:333] T 0c12bd32cd944ce99a18fc4f9617961e P 458d610e8abf4f2ea831ab7bf3576da6: stopping tablet replica
I20260709 13:13:42.955845 24113 raft_consensus.cc:2243] T 0c12bd32cd944ce99a18fc4f9617961e P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:42.956547 24113 raft_consensus.cc:2272] T 0c12bd32cd944ce99a18fc4f9617961e P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:42.958226 24113 tablet_replica.cc:333] T c8185106c7a94c3ebaace350d2363217 P 458d610e8abf4f2ea831ab7bf3576da6: stopping tablet replica
I20260709 13:13:42.958724 24113 raft_consensus.cc:2243] T c8185106c7a94c3ebaace350d2363217 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:42.959111 24113 raft_consensus.cc:2272] T c8185106c7a94c3ebaace350d2363217 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:42.960856 24113 tablet_replica.cc:333] T 22ba83039f2d4e2c9089947b949a1790 P 458d610e8abf4f2ea831ab7bf3576da6: stopping tablet replica
I20260709 13:13:42.961351 24113 raft_consensus.cc:2243] T 22ba83039f2d4e2c9089947b949a1790 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:42.962124 24113 raft_consensus.cc:2272] T 22ba83039f2d4e2c9089947b949a1790 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:42.964200 24113 tablet_replica.cc:333] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 458d610e8abf4f2ea831ab7bf3576da6: stopping tablet replica
I20260709 13:13:42.964713 24113 raft_consensus.cc:2243] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:42.965094 24113 raft_consensus.cc:2272] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:42.966586 31594 consensus_peers.cc:597] T 4fe725ada8f142d1bb9a35a30f865c10 P c74453754ee34bea9b231ae318a55a31 -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:42.967024 24113 tablet_replica.cc:333] T ac45af43771c45fd8e57204c190c322b P 458d610e8abf4f2ea831ab7bf3576da6: stopping tablet replica
W20260709 13:13:42.967182 31594 consensus_peers.cc:597] T 1fb28788823d4c5fab527f4ee2da4d2e P c74453754ee34bea9b231ae318a55a31 -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:42.967672 24113 raft_consensus.cc:2243] T ac45af43771c45fd8e57204c190c322b P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:42.968122 24113 raft_consensus.cc:2272] T ac45af43771c45fd8e57204c190c322b P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:42.969825 24113 tablet_replica.cc:333] T fc35ae8230cf4ab792d0e15bcaf8b653 P 458d610e8abf4f2ea831ab7bf3576da6: stopping tablet replica
I20260709 13:13:42.970314 24113 raft_consensus.cc:2243] T fc35ae8230cf4ab792d0e15bcaf8b653 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:42.970686 24113 raft_consensus.cc:2272] T fc35ae8230cf4ab792d0e15bcaf8b653 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:42.972281 24113 tablet_replica.cc:333] T 075b9562a2b547c8aad80c2bae413556 P 458d610e8abf4f2ea831ab7bf3576da6: stopping tablet replica
I20260709 13:13:42.972815 24113 raft_consensus.cc:2243] T 075b9562a2b547c8aad80c2bae413556 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:42.973227 24113 raft_consensus.cc:2272] T 075b9562a2b547c8aad80c2bae413556 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:42.974898 24113 tablet_replica.cc:333] T ddbfc15d5bf24708a4268dfa206ede07 P 458d610e8abf4f2ea831ab7bf3576da6: stopping tablet replica
I20260709 13:13:42.975387 24113 raft_consensus.cc:2243] T ddbfc15d5bf24708a4268dfa206ede07 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:42.975766 24113 raft_consensus.cc:2272] T ddbfc15d5bf24708a4268dfa206ede07 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:42.977334 24113 tablet_replica.cc:333] T 88b0a29c38284391bdaea82edf99c771 P 458d610e8abf4f2ea831ab7bf3576da6: stopping tablet replica
I20260709 13:13:42.977869 24113 raft_consensus.cc:2243] T 88b0a29c38284391bdaea82edf99c771 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:42.978621 24113 raft_consensus.cc:2272] T 88b0a29c38284391bdaea82edf99c771 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:42.980665 24113 tablet_replica.cc:333] T bd1c90f0a848434cb7df23dbeae35ddf P 458d610e8abf4f2ea831ab7bf3576da6: stopping tablet replica
I20260709 13:13:42.981231 24113 raft_consensus.cc:2243] T bd1c90f0a848434cb7df23dbeae35ddf P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:42.981690 24113 raft_consensus.cc:2272] T bd1c90f0a848434cb7df23dbeae35ddf P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:42.992343 31668 consensus_peers.cc:597] T 216111c5962f4b82ae52414985988860 P 76fb155ade354ee1ba78673e73b28aca -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:42.999990 31520 consensus_peers.cc:597] T 98a7e38754ed4644bf90b39aff07c70f P 196d972917fe4f85985e3862d40b7596 -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:43.004271 31594 consensus_peers.cc:597] T ee6c632286174388ab5e7bfb2ae40078 P c74453754ee34bea9b231ae318a55a31 -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:43.043007 31520 consensus_peers.cc:597] T eb560d89d58246e5856a763e3be6f086 P 196d972917fe4f85985e3862d40b7596 -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:37919: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:43.048916 24113 tablet_server.cc:196] TabletServer@127.23.140.65:0 shutdown complete.
W20260709 13:13:43.063545 31668 consensus_peers.cc:597] T 5b669b8d34ee4de5b002d30fbcf02dd7 P 76fb155ade354ee1ba78673e73b28aca -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:37919: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:43.087155 31594 consensus_peers.cc:597] T 4d146b574e8d4e21bd8d81cb29b4267a P c74453754ee34bea9b231ae318a55a31 -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:37919: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:43.089092 31594 consensus_peers.cc:597] T dcf07174e49c498f8e19fd005690404b P c74453754ee34bea9b231ae318a55a31 -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:37919: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:43.107111 31668 consensus_peers.cc:597] T 40ab5d7d13ee4460933b5799482e3f87 P 76fb155ade354ee1ba78673e73b28aca -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:37919: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:43.111270 24113 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:43.120234 32218 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:43.120613 32217 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:43.125120 24113 server_base.cc:1061] running on GCE node
W20260709 13:13:43.126683 32220 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:43.129882 24113 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:43.130160 24113 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:43.130399 24113 hybrid_clock.cc:648] HybridClock initialized: now 1783602823130378 us; error 0 us; skew 500 ppm
I20260709 13:13:43.131062 24113 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
W20260709 13:13:43.134250 31668 consensus_peers.cc:597] T e698d6d2e2e74eca91e222e9bfdf8f13 P 76fb155ade354ee1ba78673e73b28aca -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:37919: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:43.135388 24113 webserver.cc:533] Webserver started at http://127.23.140.65:34313/ using document root <none> and password file <none>
I20260709 13:13:43.136092 24113 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:43.136338 24113 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:13:43.140787 24113 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.002s	sys 0.000s
W20260709 13:13:43.146224 31668 consensus_peers.cc:597] T a35171dce2e34beeafe34f3e80f18a41 P 76fb155ade354ee1ba78673e73b28aca -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:37919: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:43.149164 32225 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:43.150269 24113 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:13:43.150638 24113 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602598684750-24113-0/minicluster-data/ts-0-root
uuid: "458d610e8abf4f2ea831ab7bf3576da6"
format_stamp: "Formatted at 2026-07-09 13:13:31 on dist-test-slave-1rs3"
I20260709 13:13:43.151153 24113 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602598684750-24113-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602598684750-24113-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602598684750-24113-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:43.180073 24113 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:43.181774 24113 kserver.cc:163] Server-wide thread pool size limit: 3276
W20260709 13:13:43.181774 31594 consensus_peers.cc:597] T b3705de0af7a48f69f751aab333fdf3d P c74453754ee34bea9b231ae318a55a31 -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:37919: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:43.184058 24113 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:43.189246 32232 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 13:13:43.193478 31594 consensus_peers.cc:597] T 11617136d6c14faea3cee24e00514101 P c74453754ee34bea9b231ae318a55a31 -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:37919: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:43.207926 31668 consensus_peers.cc:597] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 76fb155ade354ee1ba78673e73b28aca -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:37919: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:43.291785 31594 consensus_peers.cc:597] T ac45af43771c45fd8e57204c190c322b P c74453754ee34bea9b231ae318a55a31 -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:37919: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:43.294201 31668 consensus_peers.cc:597] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 76fb155ade354ee1ba78673e73b28aca -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:37919: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:43.439375 24113 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:13:43.439788 24113 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.252s	user 0.009s	sys 0.001s
I20260709 13:13:43.440150 24113 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:13:43.448638 32232 tablet_bootstrap.cc:492] T cfe1afd9e187451faf5f631e0c2eef00 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:43.474460 32232 tablet_bootstrap.cc:492] T cfe1afd9e187451faf5f631e0c2eef00 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:43.475378 32232 tablet_bootstrap.cc:492] T cfe1afd9e187451faf5f631e0c2eef00 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap complete.
I20260709 13:13:43.475975 32232 ts_tablet_manager.cc:1403] T cfe1afd9e187451faf5f631e0c2eef00 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.004s
I20260709 13:13:43.478452 32232 raft_consensus.cc:359] T cfe1afd9e187451faf5f631e0c2eef00 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:43.479099 32232 raft_consensus.cc:740] T cfe1afd9e187451faf5f631e0c2eef00 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:43.479776 32232 consensus_queue.cc:260] T cfe1afd9e187451faf5f631e0c2eef00 P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:43.482321 32232 ts_tablet_manager.cc:1434] T cfe1afd9e187451faf5f631e0c2eef00 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:13:43.483124 32232 tablet_bootstrap.cc:492] T eb560d89d58246e5856a763e3be6f086 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:43.500236 32232 tablet_bootstrap.cc:492] T eb560d89d58246e5856a763e3be6f086 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:43.501186 32232 tablet_bootstrap.cc:492] T eb560d89d58246e5856a763e3be6f086 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap complete.
I20260709 13:13:43.501863 32232 ts_tablet_manager.cc:1403] T eb560d89d58246e5856a763e3be6f086 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.004s
I20260709 13:13:43.504148 32232 raft_consensus.cc:359] T eb560d89d58246e5856a763e3be6f086 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:43.504813 32232 raft_consensus.cc:740] T eb560d89d58246e5856a763e3be6f086 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:43.506006 32232 consensus_queue.cc:260] T eb560d89d58246e5856a763e3be6f086 P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:43.507862 32232 ts_tablet_manager.cc:1434] T eb560d89d58246e5856a763e3be6f086 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:13:43.508878 32232 tablet_bootstrap.cc:492] T 1fb28788823d4c5fab527f4ee2da4d2e P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:43.521471 32232 tablet_bootstrap.cc:492] T 1fb28788823d4c5fab527f4ee2da4d2e P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:43.522220 32232 tablet_bootstrap.cc:492] T 1fb28788823d4c5fab527f4ee2da4d2e P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap complete.
I20260709 13:13:43.522706 32232 ts_tablet_manager.cc:1403] T 1fb28788823d4c5fab527f4ee2da4d2e P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.004s
I20260709 13:13:43.524386 32232 raft_consensus.cc:359] T 1fb28788823d4c5fab527f4ee2da4d2e P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:43.524916 32232 raft_consensus.cc:740] T 1fb28788823d4c5fab527f4ee2da4d2e P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:43.525566 32232 consensus_queue.cc:260] T 1fb28788823d4c5fab527f4ee2da4d2e P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:43.527184 32232 ts_tablet_manager.cc:1434] T 1fb28788823d4c5fab527f4ee2da4d2e P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:13:43.527773 32232 tablet_bootstrap.cc:492] T 98a7e38754ed4644bf90b39aff07c70f P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:43.538189 32232 tablet_bootstrap.cc:492] T 98a7e38754ed4644bf90b39aff07c70f P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:43.539078 32232 tablet_bootstrap.cc:492] T 98a7e38754ed4644bf90b39aff07c70f P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap complete.
I20260709 13:13:43.539698 32232 ts_tablet_manager.cc:1403] T 98a7e38754ed4644bf90b39aff07c70f P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.012s	user 0.007s	sys 0.004s
I20260709 13:13:43.541783 32232 raft_consensus.cc:359] T 98a7e38754ed4644bf90b39aff07c70f P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:43.542753 32232 raft_consensus.cc:740] T 98a7e38754ed4644bf90b39aff07c70f P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:43.543503 32232 consensus_queue.cc:260] T 98a7e38754ed4644bf90b39aff07c70f P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:43.545610 32232 ts_tablet_manager.cc:1434] T 98a7e38754ed4644bf90b39aff07c70f P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:13:43.546371 32232 tablet_bootstrap.cc:492] T b3705de0af7a48f69f751aab333fdf3d P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:43.564409 32232 tablet_bootstrap.cc:492] T b3705de0af7a48f69f751aab333fdf3d P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:43.565356 32232 tablet_bootstrap.cc:492] T b3705de0af7a48f69f751aab333fdf3d P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap complete.
I20260709 13:13:43.565999 32232 ts_tablet_manager.cc:1403] T b3705de0af7a48f69f751aab333fdf3d P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.004s
I20260709 13:13:43.568287 32232 raft_consensus.cc:359] T b3705de0af7a48f69f751aab333fdf3d P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:43.568895 32232 raft_consensus.cc:740] T b3705de0af7a48f69f751aab333fdf3d P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:43.569633 32232 consensus_queue.cc:260] T b3705de0af7a48f69f751aab333fdf3d P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:43.571557 32232 ts_tablet_manager.cc:1434] T b3705de0af7a48f69f751aab333fdf3d P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:13:43.572310 32232 tablet_bootstrap.cc:492] T dcf07174e49c498f8e19fd005690404b P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:43.593272 32232 tablet_bootstrap.cc:492] T dcf07174e49c498f8e19fd005690404b P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:43.594265 32232 tablet_bootstrap.cc:492] T dcf07174e49c498f8e19fd005690404b P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap complete.
I20260709 13:13:43.594871 32232 ts_tablet_manager.cc:1403] T dcf07174e49c498f8e19fd005690404b P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.004s
I20260709 13:13:43.598433 32232 raft_consensus.cc:359] T dcf07174e49c498f8e19fd005690404b P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:43.599107 32232 raft_consensus.cc:740] T dcf07174e49c498f8e19fd005690404b P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:43.599766 32232 consensus_queue.cc:260] T dcf07174e49c498f8e19fd005690404b P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:43.601732 32232 ts_tablet_manager.cc:1434] T dcf07174e49c498f8e19fd005690404b P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:13:43.602455 32232 tablet_bootstrap.cc:492] T 11617136d6c14faea3cee24e00514101 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:43.616389 32232 tablet_bootstrap.cc:492] T 11617136d6c14faea3cee24e00514101 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:43.617305 32232 tablet_bootstrap.cc:492] T 11617136d6c14faea3cee24e00514101 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap complete.
I20260709 13:13:43.617955 32232 ts_tablet_manager.cc:1403] T 11617136d6c14faea3cee24e00514101 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.006s
I20260709 13:13:43.619684 32232 raft_consensus.cc:359] T 11617136d6c14faea3cee24e00514101 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:43.620187 32232 raft_consensus.cc:740] T 11617136d6c14faea3cee24e00514101 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:43.620719 32232 consensus_queue.cc:260] T 11617136d6c14faea3cee24e00514101 P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:43.622080 32232 ts_tablet_manager.cc:1434] T 11617136d6c14faea3cee24e00514101 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:13:43.622790 32232 tablet_bootstrap.cc:492] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:43.637728 32232 tablet_bootstrap.cc:492] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:43.638756 32232 tablet_bootstrap.cc:492] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap complete.
I20260709 13:13:43.639427 32232 ts_tablet_manager.cc:1403] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.000s
I20260709 13:13:43.641502 32232 raft_consensus.cc:359] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:43.642061 32232 raft_consensus.cc:740] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:43.642659 32232 consensus_queue.cc:260] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:43.644064 32232 ts_tablet_manager.cc:1434] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.004s	user 0.002s	sys 0.000s
I20260709 13:13:43.644693 32232 tablet_bootstrap.cc:492] T ac45af43771c45fd8e57204c190c322b P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:43.662734 32232 tablet_bootstrap.cc:492] T ac45af43771c45fd8e57204c190c322b P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:43.663422 32232 tablet_bootstrap.cc:492] T ac45af43771c45fd8e57204c190c322b P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap complete.
I20260709 13:13:43.663910 32232 ts_tablet_manager.cc:1403] T ac45af43771c45fd8e57204c190c322b P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 13:13:43.665678 32232 raft_consensus.cc:359] T ac45af43771c45fd8e57204c190c322b P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:43.666251 32232 raft_consensus.cc:740] T ac45af43771c45fd8e57204c190c322b P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:43.666828 32232 consensus_queue.cc:260] T ac45af43771c45fd8e57204c190c322b P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:43.668776 32232 ts_tablet_manager.cc:1434] T ac45af43771c45fd8e57204c190c322b P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:13:43.669509 32232 tablet_bootstrap.cc:492] T 22ba83039f2d4e2c9089947b949a1790 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:43.674006 24113 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:13:43.674407 24113 ts_tablet_manager.cc:595] Time spent register tablets: real 0.234s	user 0.223s	sys 0.002s
I20260709 13:13:43.716905 32232 tablet_bootstrap.cc:492] T 22ba83039f2d4e2c9089947b949a1790 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:43.719241 32232 tablet_bootstrap.cc:492] T 22ba83039f2d4e2c9089947b949a1790 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap complete.
I20260709 13:13:43.720709 32232 ts_tablet_manager.cc:1403] T 22ba83039f2d4e2c9089947b949a1790 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.051s	user 0.040s	sys 0.008s
I20260709 13:13:43.725158 32232 raft_consensus.cc:359] T 22ba83039f2d4e2c9089947b949a1790 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:43.726141 32232 raft_consensus.cc:740] T 22ba83039f2d4e2c9089947b949a1790 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:43.727102 32232 consensus_queue.cc:260] T 22ba83039f2d4e2c9089947b949a1790 P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:43.729678 32232 ts_tablet_manager.cc:1434] T 22ba83039f2d4e2c9089947b949a1790 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 13:13:43.730705 32232 tablet_bootstrap.cc:492] T 88b0a29c38284391bdaea82edf99c771 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:43.753636 32232 tablet_bootstrap.cc:492] T 88b0a29c38284391bdaea82edf99c771 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:43.754493 32232 tablet_bootstrap.cc:492] T 88b0a29c38284391bdaea82edf99c771 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap complete.
I20260709 13:13:43.755062 32232 ts_tablet_manager.cc:1403] T 88b0a29c38284391bdaea82edf99c771 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.025s	user 0.019s	sys 0.000s
I20260709 13:13:43.756997 32232 raft_consensus.cc:359] T 88b0a29c38284391bdaea82edf99c771 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:43.757639 32232 raft_consensus.cc:740] T 88b0a29c38284391bdaea82edf99c771 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:43.758630 32232 consensus_queue.cc:260] T 88b0a29c38284391bdaea82edf99c771 P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:43.760548 32232 ts_tablet_manager.cc:1434] T 88b0a29c38284391bdaea82edf99c771 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:13:43.761312 32232 tablet_bootstrap.cc:492] T bd1c90f0a848434cb7df23dbeae35ddf P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:43.775167 32232 tablet_bootstrap.cc:492] T bd1c90f0a848434cb7df23dbeae35ddf P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:43.776103 32232 tablet_bootstrap.cc:492] T bd1c90f0a848434cb7df23dbeae35ddf P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap complete.
I20260709 13:13:43.777036 32232 ts_tablet_manager.cc:1403] T bd1c90f0a848434cb7df23dbeae35ddf P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.004s
I20260709 13:13:43.779304 32232 raft_consensus.cc:359] T bd1c90f0a848434cb7df23dbeae35ddf P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:43.779944 32232 raft_consensus.cc:740] T bd1c90f0a848434cb7df23dbeae35ddf P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:43.780584 32232 consensus_queue.cc:260] T bd1c90f0a848434cb7df23dbeae35ddf P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:43.782950 32232 ts_tablet_manager.cc:1434] T bd1c90f0a848434cb7df23dbeae35ddf P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:13:43.783694 32232 tablet_bootstrap.cc:492] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:43.806195 32232 tablet_bootstrap.cc:492] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:43.807080 32232 tablet_bootstrap.cc:492] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap complete.
I20260709 13:13:43.807703 32232 ts_tablet_manager.cc:1403] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.004s
I20260709 13:13:43.810230 32232 raft_consensus.cc:359] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:43.810879 32232 raft_consensus.cc:740] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:43.811422 32232 consensus_queue.cc:260] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:43.813738 32232 ts_tablet_manager.cc:1434] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:13:43.814536 32232 tablet_bootstrap.cc:492] T 53c18818aa9c44c8987bb675a05026a4 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:43.827545 32232 tablet_bootstrap.cc:492] T 53c18818aa9c44c8987bb675a05026a4 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:43.828439 32232 tablet_bootstrap.cc:492] T 53c18818aa9c44c8987bb675a05026a4 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap complete.
I20260709 13:13:43.829608 32232 ts_tablet_manager.cc:1403] T 53c18818aa9c44c8987bb675a05026a4 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.004s
I20260709 13:13:43.831974 32232 raft_consensus.cc:359] T 53c18818aa9c44c8987bb675a05026a4 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:43.832660 32232 raft_consensus.cc:740] T 53c18818aa9c44c8987bb675a05026a4 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:43.833268 32232 consensus_queue.cc:260] T 53c18818aa9c44c8987bb675a05026a4 P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:43.835291 32232 ts_tablet_manager.cc:1434] T 53c18818aa9c44c8987bb675a05026a4 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:13:43.835914 32232 tablet_bootstrap.cc:492] T 35bbba26df1b47a7b9923618bf451ffc P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:43.847260 32232 tablet_bootstrap.cc:492] T 35bbba26df1b47a7b9923618bf451ffc P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:43.848132 32232 tablet_bootstrap.cc:492] T 35bbba26df1b47a7b9923618bf451ffc P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap complete.
I20260709 13:13:43.848727 32232 ts_tablet_manager.cc:1403] T 35bbba26df1b47a7b9923618bf451ffc P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.013s	user 0.004s	sys 0.005s
I20260709 13:13:43.850950 32232 raft_consensus.cc:359] T 35bbba26df1b47a7b9923618bf451ffc P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:43.851593 32232 raft_consensus.cc:740] T 35bbba26df1b47a7b9923618bf451ffc P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:43.852332 32232 consensus_queue.cc:260] T 35bbba26df1b47a7b9923618bf451ffc P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:43.853603 31759 raft_consensus.cc:493] T 497217e9b47244fcb425c66935cb8a20 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 458d610e8abf4f2ea831ab7bf3576da6)
I20260709 13:13:43.854357 31759 raft_consensus.cc:515] T 497217e9b47244fcb425c66935cb8a20 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:43.854807 32232 ts_tablet_manager.cc:1434] T 35bbba26df1b47a7b9923618bf451ffc P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.003s
I20260709 13:13:43.855695 32232 tablet_bootstrap.cc:492] T 2568dda6664d4363abc4fd891fa48370 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:43.856410 31759 leader_election.cc:290] T 497217e9b47244fcb425c66935cb8a20 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:43.858955 32160 raft_consensus.cc:493] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 458d610e8abf4f2ea831ab7bf3576da6)
I20260709 13:13:43.859683 31554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497217e9b47244fcb425c66935cb8a20" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:43.859679 32160 raft_consensus.cc:515] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
W20260709 13:13:43.864631 31594 leader_election.cc:336] T 497217e9b47244fcb425c66935cb8a20 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Network error: Client connection negotiation failed: client connection to 127.23.140.65:37919: connect: Connection refused (error 111)
I20260709 13:13:43.865260 31594 leader_election.cc:304] T 497217e9b47244fcb425c66935cb8a20 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c74453754ee34bea9b231ae318a55a31; no voters: 196d972917fe4f85985e3862d40b7596, 458d610e8abf4f2ea831ab7bf3576da6
I20260709 13:13:43.867249 31759 raft_consensus.cc:2749] T 497217e9b47244fcb425c66935cb8a20 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:43.869513 32160 leader_election.cc:290] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:43.871127 31554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2a6746f9b2f4b1ab287b9e8f4c51106" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
W20260709 13:13:43.872455 31668 leader_election.cc:336] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Network error: Client connection negotiation failed: client connection to 127.23.140.65:37919: connect: Connection refused (error 111)
I20260709 13:13:43.874253 31666 leader_election.cc:304] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca; no voters: 196d972917fe4f85985e3862d40b7596, 458d610e8abf4f2ea831ab7bf3576da6
I20260709 13:13:43.875578 32160 raft_consensus.cc:2749] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:43.878109 32075 raft_consensus.cc:493] T 8a98dff441f1479992f85708c9f03283 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 458d610e8abf4f2ea831ab7bf3576da6)
I20260709 13:13:43.878777 32075 raft_consensus.cc:515] T 8a98dff441f1479992f85708c9f03283 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:43.883180 31554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a98dff441f1479992f85708c9f03283" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:43.883991 32309 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.140.65:37919 every 8 connection(s)
I20260709 13:13:43.884536 24113 rpc_server.cc:307] RPC server started. Bound to: 127.23.140.65:37919
I20260709 13:13:43.886659 32089 raft_consensus.cc:493] T 35bbba26df1b47a7b9923618bf451ffc P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 458d610e8abf4f2ea831ab7bf3576da6)
I20260709 13:13:43.887219 32089 raft_consensus.cc:515] T 35bbba26df1b47a7b9923618bf451ffc P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:43.889673 32089 leader_election.cc:290] T 35bbba26df1b47a7b9923618bf451ffc P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:43.881445 32075 leader_election.cc:290] T 8a98dff441f1479992f85708c9f03283 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:43.895345 31554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35bbba26df1b47a7b9923618bf451ffc" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:43.901312 32232 tablet_bootstrap.cc:492] T 2568dda6664d4363abc4fd891fa48370 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:43.902278 32232 tablet_bootstrap.cc:492] T 2568dda6664d4363abc4fd891fa48370 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap complete.
I20260709 13:13:43.902872 32232 ts_tablet_manager.cc:1403] T 2568dda6664d4363abc4fd891fa48370 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.047s	user 0.029s	sys 0.007s
I20260709 13:13:43.905082 32232 raft_consensus.cc:359] T 2568dda6664d4363abc4fd891fa48370 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:43.923164 32160 raft_consensus.cc:493] T 364efc87879c4e6db82a829c76ef0045 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 458d610e8abf4f2ea831ab7bf3576da6)
I20260709 13:13:43.923905 32160 raft_consensus.cc:515] T 364efc87879c4e6db82a829c76ef0045 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:43.905692 32232 raft_consensus.cc:740] T 2568dda6664d4363abc4fd891fa48370 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:43.932744 32232 consensus_queue.cc:260] T 2568dda6664d4363abc4fd891fa48370 P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:43.934031 32075 raft_consensus.cc:493] T 85d4a24725c749199c1b35d959b1b2b5 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 458d610e8abf4f2ea831ab7bf3576da6)
I20260709 13:13:43.934607 32075 raft_consensus.cc:515] T 85d4a24725c749199c1b35d959b1b2b5 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:43.935323 32160 leader_election.cc:290] T 364efc87879c4e6db82a829c76ef0045 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:43.936167 31626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "364efc87879c4e6db82a829c76ef0045" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:43.936637 32075 leader_election.cc:290] T 85d4a24725c749199c1b35d959b1b2b5 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:43.937358 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85d4a24725c749199c1b35d959b1b2b5" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:43.937671 32232 ts_tablet_manager.cc:1434] T 2568dda6664d4363abc4fd891fa48370 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.000s
I20260709 13:13:43.938558 32232 tablet_bootstrap.cc:492] T b262a50e82034c57a4bfb7da683ff5d1 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:43.951120 32310 heartbeater.cc:344] Connected to a master server at 127.23.140.126:37181
I20260709 13:13:43.951576 32310 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:43.951596 31817 raft_consensus.cc:493] T 364efc87879c4e6db82a829c76ef0045 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 458d610e8abf4f2ea831ab7bf3576da6)
I20260709 13:13:43.952155 31817 raft_consensus.cc:515] T 364efc87879c4e6db82a829c76ef0045 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:43.952517 32310 heartbeater.cc:507] Master 127.23.140.126:37181 requested a full tablet report, sending...
I20260709 13:13:43.954478 31817 leader_election.cc:290] T 364efc87879c4e6db82a829c76ef0045 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:43.955900 31697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "364efc87879c4e6db82a829c76ef0045" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:43.956539 31697 raft_consensus.cc:2468] T 364efc87879c4e6db82a829c76ef0045 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 1.
I20260709 13:13:43.958102 31595 leader_election.cc:304] T 364efc87879c4e6db82a829c76ef0045 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca, c74453754ee34bea9b231ae318a55a31; no voters: 
I20260709 13:13:43.959247 31759 raft_consensus.cc:2804] T 364efc87879c4e6db82a829c76ef0045 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:43.959712 31759 raft_consensus.cc:493] T 364efc87879c4e6db82a829c76ef0045 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 458d610e8abf4f2ea831ab7bf3576da6)
I20260709 13:13:43.960139 31759 raft_consensus.cc:3060] T 364efc87879c4e6db82a829c76ef0045 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:43.960932 32079 raft_consensus.cc:493] T 2568dda6664d4363abc4fd891fa48370 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 458d610e8abf4f2ea831ab7bf3576da6)
I20260709 13:13:43.961432 32079 raft_consensus.cc:515] T 2568dda6664d4363abc4fd891fa48370 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:43.984488 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2568dda6664d4363abc4fd891fa48370" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:43.982723 32079 leader_election.cc:290] T 2568dda6664d4363abc4fd891fa48370 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:43.982800 32183 raft_consensus.cc:493] T 88b0a29c38284391bdaea82edf99c771 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 458d610e8abf4f2ea831ab7bf3576da6)
I20260709 13:13:43.987972 32183 raft_consensus.cc:515] T 88b0a29c38284391bdaea82edf99c771 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:43.990046 32183 leader_election.cc:290] T 88b0a29c38284391bdaea82edf99c771 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:43.992645 32233 raft_consensus.cc:493] T 497217e9b47244fcb425c66935cb8a20 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 458d610e8abf4f2ea831ab7bf3576da6)
I20260709 13:13:43.992686 31626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b0a29c38284391bdaea82edf99c771" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:43.993230 32233 raft_consensus.cc:515] T 497217e9b47244fcb425c66935cb8a20 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:43.995476 32233 leader_election.cc:290] T 497217e9b47244fcb425c66935cb8a20 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:44.002421 32232 tablet_bootstrap.cc:492] T b262a50e82034c57a4bfb7da683ff5d1 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:44.003096 31759 raft_consensus.cc:515] T 364efc87879c4e6db82a829c76ef0045 P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:44.007556 32232 tablet_bootstrap.cc:492] T b262a50e82034c57a4bfb7da683ff5d1 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap complete.
I20260709 13:13:44.010987 32232 ts_tablet_manager.cc:1403] T b262a50e82034c57a4bfb7da683ff5d1 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.073s	user 0.026s	sys 0.016s
I20260709 13:13:44.015802 31626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497217e9b47244fcb425c66935cb8a20" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:44.016476 31626 raft_consensus.cc:2468] T 497217e9b47244fcb425c66935cb8a20 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 196d972917fe4f85985e3862d40b7596 in term 1.
I20260709 13:13:44.017666 31521 leader_election.cc:304] T 497217e9b47244fcb425c66935cb8a20 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, c74453754ee34bea9b231ae318a55a31; no voters: 
I20260709 13:13:44.017545 32232 raft_consensus.cc:359] T b262a50e82034c57a4bfb7da683ff5d1 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:44.018325 32232 raft_consensus.cc:740] T b262a50e82034c57a4bfb7da683ff5d1 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.019280 32232 consensus_queue.cc:260] T b262a50e82034c57a4bfb7da683ff5d1 P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:44.018321 31697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "364efc87879c4e6db82a829c76ef0045" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca"
I20260709 13:13:44.020481 31697 raft_consensus.cc:3060] T 364efc87879c4e6db82a829c76ef0045 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:44.021258 32232 ts_tablet_manager.cc:1434] T b262a50e82034c57a4bfb7da683ff5d1 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 13:13:44.021627 31759 leader_election.cc:290] T 364efc87879c4e6db82a829c76ef0045 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 2 election: Requested vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:44.022557 32232 tablet_bootstrap.cc:492] T 76a7de5cfe774df68279e2e1e7361c6b P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:44.022104 32183 raft_consensus.cc:2804] T 497217e9b47244fcb425c66935cb8a20 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:44.023339 32183 raft_consensus.cc:493] T 497217e9b47244fcb425c66935cb8a20 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 458d610e8abf4f2ea831ab7bf3576da6)
I20260709 13:13:44.023701 32183 raft_consensus.cc:3060] T 497217e9b47244fcb425c66935cb8a20 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:44.026129 32282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a98dff441f1479992f85708c9f03283" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:44.029644 32280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "364efc87879c4e6db82a829c76ef0045" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:44.031394 32279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85d4a24725c749199c1b35d959b1b2b5" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
W20260709 13:13:44.031575 31668 leader_election.cc:343] T 8a98dff441f1479992f85708c9f03283 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:44.032061 31668 leader_election.cc:304] T 8a98dff441f1479992f85708c9f03283 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca; no voters: 196d972917fe4f85985e3862d40b7596, 458d610e8abf4f2ea831ab7bf3576da6
W20260709 13:13:44.033113 31668 leader_election.cc:343] T 364efc87879c4e6db82a829c76ef0045 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:44.033496 31668 leader_election.cc:304] T 364efc87879c4e6db82a829c76ef0045 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca; no voters: 458d610e8abf4f2ea831ab7bf3576da6, c74453754ee34bea9b231ae318a55a31
I20260709 13:13:44.034260 32089 raft_consensus.cc:2749] T 8a98dff441f1479992f85708c9f03283 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:13:44.036005 31668 leader_election.cc:343] T 85d4a24725c749199c1b35d959b1b2b5 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:44.036386 31668 leader_election.cc:304] T 85d4a24725c749199c1b35d959b1b2b5 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca; no voters: 458d610e8abf4f2ea831ab7bf3576da6, c74453754ee34bea9b231ae318a55a31
I20260709 13:13:44.037469 32089 raft_consensus.cc:2749] T 85d4a24725c749199c1b35d959b1b2b5 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:44.037663 32233 raft_consensus.cc:493] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 458d610e8abf4f2ea831ab7bf3576da6)
I20260709 13:13:44.038408 32233 raft_consensus.cc:515] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:44.043480 31759 raft_consensus.cc:493] T 85d4a24725c749199c1b35d959b1b2b5 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 458d610e8abf4f2ea831ab7bf3576da6)
I20260709 13:13:44.044804 31759 raft_consensus.cc:515] T 85d4a24725c749199c1b35d959b1b2b5 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:44.057864 31759 leader_election.cc:290] T 85d4a24725c749199c1b35d959b1b2b5 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:44.053537 32233 leader_election.cc:290] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:44.064585 31696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2a6746f9b2f4b1ab287b9e8f4c51106" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:44.065327 31696 raft_consensus.cc:2468] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 196d972917fe4f85985e3862d40b7596 in term 1.
I20260709 13:13:44.066315 32232 tablet_bootstrap.cc:492] T 76a7de5cfe774df68279e2e1e7361c6b P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:44.067251 32232 tablet_bootstrap.cc:492] T 76a7de5cfe774df68279e2e1e7361c6b P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap complete.
I20260709 13:13:44.067873 32232 ts_tablet_manager.cc:1403] T 76a7de5cfe774df68279e2e1e7361c6b P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.046s	user 0.020s	sys 0.012s
I20260709 13:13:44.060606 32279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "364efc87879c4e6db82a829c76ef0045" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:44.070928 32232 raft_consensus.cc:359] T 76a7de5cfe774df68279e2e1e7361c6b P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:44.071587 32232 raft_consensus.cc:740] T 76a7de5cfe774df68279e2e1e7361c6b P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.071638 32079 raft_consensus.cc:493] T 0c12bd32cd944ce99a18fc4f9617961e P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 458d610e8abf4f2ea831ab7bf3576da6)
I20260709 13:13:44.072244 32079 raft_consensus.cc:515] T 0c12bd32cd944ce99a18fc4f9617961e P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:44.072321 32232 consensus_queue.cc:260] T 76a7de5cfe774df68279e2e1e7361c6b P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:44.074411 32079 leader_election.cc:290] T 0c12bd32cd944ce99a18fc4f9617961e P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:44.074563 32232 ts_tablet_manager.cc:1434] T 76a7de5cfe774df68279e2e1e7361c6b P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:13:44.075435 32232 tablet_bootstrap.cc:492] T 0c12bd32cd944ce99a18fc4f9617961e P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:44.075716 31626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c12bd32cd944ce99a18fc4f9617961e" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:44.076159 31697 raft_consensus.cc:2468] T 364efc87879c4e6db82a829c76ef0045 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 2.
I20260709 13:13:44.076792 32160 raft_consensus.cc:2749] T 364efc87879c4e6db82a829c76ef0045 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:44.086668 32233 raft_consensus.cc:493] T 35bbba26df1b47a7b9923618bf451ffc P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 458d610e8abf4f2ea831ab7bf3576da6)
I20260709 13:13:44.087481 32233 raft_consensus.cc:515] T 35bbba26df1b47a7b9923618bf451ffc P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:44.098438 32282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35bbba26df1b47a7b9923618bf451ffc" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:44.099395 32282 raft_consensus.cc:2468] T 35bbba26df1b47a7b9923618bf451ffc P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 1.
I20260709 13:13:44.103060 32233 leader_election.cc:290] T 35bbba26df1b47a7b9923618bf451ffc P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:44.103552 31668 leader_election.cc:304] T 35bbba26df1b47a7b9923618bf451ffc P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca; no voters: 196d972917fe4f85985e3862d40b7596
I20260709 13:13:44.104844 31817 raft_consensus.cc:493] T 2568dda6664d4363abc4fd891fa48370 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 458d610e8abf4f2ea831ab7bf3576da6)
I20260709 13:13:44.105520 31817 raft_consensus.cc:515] T 2568dda6664d4363abc4fd891fa48370 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:44.107887 31817 leader_election.cc:290] T 2568dda6664d4363abc4fd891fa48370 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:44.108016 32089 raft_consensus.cc:2804] T 35bbba26df1b47a7b9923618bf451ffc P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:44.108625 32089 raft_consensus.cc:493] T 35bbba26df1b47a7b9923618bf451ffc P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Starting leader election (detected failure of leader 458d610e8abf4f2ea831ab7bf3576da6)
I20260709 13:13:44.109100 32235 raft_consensus.cc:493] T 0c12bd32cd944ce99a18fc4f9617961e P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 458d610e8abf4f2ea831ab7bf3576da6)
I20260709 13:13:44.109630 32235 raft_consensus.cc:515] T 0c12bd32cd944ce99a18fc4f9617961e P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:44.110242 32183 raft_consensus.cc:515] T 497217e9b47244fcb425c66935cb8a20 P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:44.111805 32235 leader_election.cc:290] T 0c12bd32cd944ce99a18fc4f9617961e P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:44.113762 31551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c12bd32cd944ce99a18fc4f9617961e" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:44.109097 32089 raft_consensus.cc:3060] T 35bbba26df1b47a7b9923618bf451ffc P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:44.114624 31551 raft_consensus.cc:2468] T 0c12bd32cd944ce99a18fc4f9617961e P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 1.
I20260709 13:13:44.117446 31550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2568dda6664d4363abc4fd891fa48370" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:44.118304 31550 raft_consensus.cc:2468] T 2568dda6664d4363abc4fd891fa48370 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 1.
I20260709 13:13:44.121430 32277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "364efc87879c4e6db82a829c76ef0045" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
I20260709 13:13:44.121618 32089 raft_consensus.cc:515] T 35bbba26df1b47a7b9923618bf451ffc P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:44.122946 32277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85d4a24725c749199c1b35d959b1b2b5" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:44.123677 32089 leader_election.cc:290] T 35bbba26df1b47a7b9923618bf451ffc P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 2 election: Requested vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:44.125422 32279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c12bd32cd944ce99a18fc4f9617961e" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:44.129256 32281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2568dda6664d4363abc4fd891fa48370" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:44.130159 32281 raft_consensus.cc:2468] T 2568dda6664d4363abc4fd891fa48370 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 1.
I20260709 13:13:44.132086 31697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85d4a24725c749199c1b35d959b1b2b5" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:44.132754 31697 raft_consensus.cc:2468] T 85d4a24725c749199c1b35d959b1b2b5 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 1.
W20260709 13:13:44.132964 31594 leader_election.cc:343] T 364efc87879c4e6db82a829c76ef0045 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:44.135070 31594 leader_election.cc:343] T 364efc87879c4e6db82a829c76ef0045 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:44.135861 31595 leader_election.cc:304] T 364efc87879c4e6db82a829c76ef0045 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca, c74453754ee34bea9b231ae318a55a31; no voters: 458d610e8abf4f2ea831ab7bf3576da6
I20260709 13:13:44.138224 32183 leader_election.cc:290] T 497217e9b47244fcb425c66935cb8a20 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 election: Requested vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:44.136289 32075 raft_consensus.cc:493] T fb4f7292ed2f489e922ca5fb1c6e47bf P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 458d610e8abf4f2ea831ab7bf3576da6)
I20260709 13:13:44.137633 32160 raft_consensus.cc:493] T b262a50e82034c57a4bfb7da683ff5d1 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 458d610e8abf4f2ea831ab7bf3576da6)
I20260709 13:13:44.139755 32075 raft_consensus.cc:515] T fb4f7292ed2f489e922ca5fb1c6e47bf P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:44.139935 32160 raft_consensus.cc:515] T b262a50e82034c57a4bfb7da683ff5d1 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:44.141795 32160 leader_election.cc:290] T b262a50e82034c57a4bfb7da683ff5d1 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:44.141831 32075 leader_election.cc:290] T fb4f7292ed2f489e922ca5fb1c6e47bf P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:44.143008 31697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35bbba26df1b47a7b9923618bf451ffc" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:44.138857 31759 raft_consensus.cc:2804] T 364efc87879c4e6db82a829c76ef0045 P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:44.143782 31697 raft_consensus.cc:2393] T 35bbba26df1b47a7b9923618bf451ffc P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 196d972917fe4f85985e3862d40b7596 in current term 2: Already voted for candidate 76fb155ade354ee1ba78673e73b28aca in this term.
I20260709 13:13:44.145222 31759 raft_consensus.cc:697] T 364efc87879c4e6db82a829c76ef0045 P c74453754ee34bea9b231ae318a55a31 [term 2 LEADER]: Becoming Leader. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Running, Role: LEADER
I20260709 13:13:44.145318 32278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4f7292ed2f489e922ca5fb1c6e47bf" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:44.146124 31759 consensus_queue.cc:237] T 364efc87879c4e6db82a829c76ef0045 P c74453754ee34bea9b231ae318a55a31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:44.136011 31521 leader_election.cc:304] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, 76fb155ade354ee1ba78673e73b28aca; no voters: 
I20260709 13:13:44.148448 32279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2568dda6664d4363abc4fd891fa48370" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:44.138995 31595 leader_election.cc:304] T 85d4a24725c749199c1b35d959b1b2b5 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca, c74453754ee34bea9b231ae318a55a31; no voters: 
I20260709 13:13:44.149201 32279 raft_consensus.cc:2468] T 2568dda6664d4363abc4fd891fa48370 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 196d972917fe4f85985e3862d40b7596 in term 1.
W20260709 13:13:44.149905 31594 leader_election.cc:343] T 85d4a24725c749199c1b35d959b1b2b5 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:44.151017 32279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b0a29c38284391bdaea82edf99c771" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:44.151867 32279 raft_consensus.cc:2468] T 88b0a29c38284391bdaea82edf99c771 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 196d972917fe4f85985e3862d40b7596 in term 1.
I20260709 13:13:44.153496 32279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497217e9b47244fcb425c66935cb8a20" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:44.155377 32279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2a6746f9b2f4b1ab287b9e8f4c51106" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:44.156031 32235 raft_consensus.cc:2804] T 85d4a24725c749199c1b35d959b1b2b5 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:44.156425 32235 raft_consensus.cc:493] T 85d4a24725c749199c1b35d959b1b2b5 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 458d610e8abf4f2ea831ab7bf3576da6)
I20260709 13:13:44.156821 32235 raft_consensus.cc:3060] T 85d4a24725c749199c1b35d959b1b2b5 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:44.158529 31550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35bbba26df1b47a7b9923618bf451ffc" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596"
I20260709 13:13:44.135284 32281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35bbba26df1b47a7b9923618bf451ffc" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
I20260709 13:13:44.160583 32281 raft_consensus.cc:3060] T 35bbba26df1b47a7b9923618bf451ffc P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:44.160524 32282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35bbba26df1b47a7b9923618bf451ffc" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:44.159602 32279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c12bd32cd944ce99a18fc4f9617961e" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:44.163668 32279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497217e9b47244fcb425c66935cb8a20" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
W20260709 13:13:44.165179 31668 leader_election.cc:343] T fb4f7292ed2f489e922ca5fb1c6e47bf P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:44.166592 31520 leader_election.cc:304] T 2568dda6664d4363abc4fd891fa48370 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, 458d610e8abf4f2ea831ab7bf3576da6; no voters: c74453754ee34bea9b231ae318a55a31
I20260709 13:13:44.167361 32319 raft_consensus.cc:2804] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:44.167757 32319 raft_consensus.cc:493] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 458d610e8abf4f2ea831ab7bf3576da6)
I20260709 13:13:44.168133 32319 raft_consensus.cc:3060] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:44.168041 31520 leader_election.cc:304] T 88b0a29c38284391bdaea82edf99c771 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, 458d610e8abf4f2ea831ab7bf3576da6; no voters: c74453754ee34bea9b231ae318a55a31
I20260709 13:13:44.168962 32233 raft_consensus.cc:2804] T 2568dda6664d4363abc4fd891fa48370 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:44.169023 31376 ts_manager.cc:194] Re-registered known tserver with Master: 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:44.169381 32233 raft_consensus.cc:493] T 2568dda6664d4363abc4fd891fa48370 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 458d610e8abf4f2ea831ab7bf3576da6)
I20260709 13:13:44.169948 32233 raft_consensus.cc:3060] T 2568dda6664d4363abc4fd891fa48370 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:44.170467 31520 leader_election.cc:343] T 497217e9b47244fcb425c66935cb8a20 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:44.171608 31520 leader_election.cc:343] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:44.173952 32079 raft_consensus.cc:2804] T 88b0a29c38284391bdaea82edf99c771 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:44.174324 32079 raft_consensus.cc:493] T 88b0a29c38284391bdaea82edf99c771 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 458d610e8abf4f2ea831ab7bf3576da6)
I20260709 13:13:44.174667 32079 raft_consensus.cc:3060] T 88b0a29c38284391bdaea82edf99c771 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:44.177098 32319 raft_consensus.cc:515] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:44.179632 32319 leader_election.cc:290] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 election: Requested vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:44.165789 32235 raft_consensus.cc:515] T 85d4a24725c749199c1b35d959b1b2b5 P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:44.183171 31697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85d4a24725c749199c1b35d959b1b2b5" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca"
I20260709 13:13:44.183722 31697 raft_consensus.cc:3060] T 85d4a24725c749199c1b35d959b1b2b5 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:44.137064 31592 leader_election.cc:304] T 0c12bd32cd944ce99a18fc4f9617961e P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, c74453754ee34bea9b231ae318a55a31; no voters: 
I20260709 13:13:44.187031 32033 raft_consensus.cc:493] T 88b0a29c38284391bdaea82edf99c771 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 458d610e8abf4f2ea831ab7bf3576da6)
W20260709 13:13:44.187151 31520 leader_election.cc:343] T 0c12bd32cd944ce99a18fc4f9617961e P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:44.187645 32033 raft_consensus.cc:515] T 88b0a29c38284391bdaea82edf99c771 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:44.190003 31817 raft_consensus.cc:2804] T 0c12bd32cd944ce99a18fc4f9617961e P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:44.190495 31817 raft_consensus.cc:493] T 0c12bd32cd944ce99a18fc4f9617961e P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 458d610e8abf4f2ea831ab7bf3576da6)
I20260709 13:13:44.190927 31817 raft_consensus.cc:3060] T 0c12bd32cd944ce99a18fc4f9617961e P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:44.193955 31592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.66:37431, user_credentials={real_user=slave}} blocked reactor thread for 56997.3us
I20260709 13:13:44.194471 32079 raft_consensus.cc:515] T 88b0a29c38284391bdaea82edf99c771 P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:44.195802 31697 raft_consensus.cc:2468] T 85d4a24725c749199c1b35d959b1b2b5 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 2.
I20260709 13:13:44.196380 32079 leader_election.cc:290] T 88b0a29c38284391bdaea82edf99c771 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 election: Requested vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:44.196503 32232 tablet_bootstrap.cc:492] T 0c12bd32cd944ce99a18fc4f9617961e P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:44.196902 31595 leader_election.cc:304] T 85d4a24725c749199c1b35d959b1b2b5 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca, c74453754ee34bea9b231ae318a55a31; no voters: 
I20260709 13:13:44.197425 32232 tablet_bootstrap.cc:492] T 0c12bd32cd944ce99a18fc4f9617961e P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap complete.
W20260709 13:13:44.197903 31594 leader_election.cc:343] T 0c12bd32cd944ce99a18fc4f9617961e P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:44.198122 32232 ts_tablet_manager.cc:1403] T 0c12bd32cd944ce99a18fc4f9617961e P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.123s	user 0.066s	sys 0.052s
W20260709 13:13:44.199025 31594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:37919, user_credentials={real_user=slave}} blocked reactor thread for 45635us
I20260709 13:13:44.159416 31550 raft_consensus.cc:3060] T 35bbba26df1b47a7b9923618bf451ffc P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:44.200727 32232 raft_consensus.cc:359] T 0c12bd32cd944ce99a18fc4f9617961e P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:44.201385 32232 raft_consensus.cc:740] T 0c12bd32cd944ce99a18fc4f9617961e P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.202183 32232 consensus_queue.cc:260] T 0c12bd32cd944ce99a18fc4f9617961e P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:44.203680 32327 raft_consensus.cc:2804] T 85d4a24725c749199c1b35d959b1b2b5 P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:44.204192 32327 raft_consensus.cc:697] T 85d4a24725c749199c1b35d959b1b2b5 P c74453754ee34bea9b231ae318a55a31 [term 2 LEADER]: Becoming Leader. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Running, Role: LEADER
I20260709 13:13:44.204993 32327 consensus_queue.cc:237] T 85d4a24725c749199c1b35d959b1b2b5 P c74453754ee34bea9b231ae318a55a31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:44.206117 32033 leader_election.cc:290] T 88b0a29c38284391bdaea82edf99c771 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:44.207383 32277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b262a50e82034c57a4bfb7da683ff5d1" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:44.208122 32277 raft_consensus.cc:2468] T b262a50e82034c57a4bfb7da683ff5d1 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 1.
I20260709 13:13:44.209344 32232 ts_tablet_manager.cc:1434] T 0c12bd32cd944ce99a18fc4f9617961e P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:13:44.210165 32232 tablet_bootstrap.cc:492] T e698d6d2e2e74eca91e222e9bfdf8f13 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:44.210224 31668 leader_election.cc:304] T b262a50e82034c57a4bfb7da683ff5d1 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca; no voters: 
I20260709 13:13:44.211016 32320 raft_consensus.cc:2804] T b262a50e82034c57a4bfb7da683ff5d1 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:44.211382 32320 raft_consensus.cc:493] T b262a50e82034c57a4bfb7da683ff5d1 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Starting leader election (detected failure of leader 458d610e8abf4f2ea831ab7bf3576da6)
I20260709 13:13:44.211719 32320 raft_consensus.cc:3060] T b262a50e82034c57a4bfb7da683ff5d1 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:44.209457 32235 leader_election.cc:290] T 85d4a24725c749199c1b35d959b1b2b5 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 2 election: Requested vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:44.216689 32075 raft_consensus.cc:493] T 22ba83039f2d4e2c9089947b949a1790 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 458d610e8abf4f2ea831ab7bf3576da6)
I20260709 13:13:44.217259 32075 raft_consensus.cc:515] T 22ba83039f2d4e2c9089947b949a1790 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:44.219262 31554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4f7292ed2f489e922ca5fb1c6e47bf" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:44.219406 32075 leader_election.cc:290] T 22ba83039f2d4e2c9089947b949a1790 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:44.219867 31554 raft_consensus.cc:2468] T fb4f7292ed2f489e922ca5fb1c6e47bf P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 1.
I20260709 13:13:44.220081 31374 catalog_manager.cc:5697] T 364efc87879c4e6db82a829c76ef0045 P c74453754ee34bea9b231ae318a55a31 reported cstate change: term changed from 1 to 2, leader changed from 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65) to c74453754ee34bea9b231ae318a55a31 (127.23.140.67). New cstate: current_term: 2 leader_uuid: "c74453754ee34bea9b231ae318a55a31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:44.223564 31697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2a6746f9b2f4b1ab287b9e8f4c51106" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca"
I20260709 13:13:44.223701 31666 leader_election.cc:304] T fb4f7292ed2f489e922ca5fb1c6e47bf P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, 76fb155ade354ee1ba78673e73b28aca; no voters: 458d610e8abf4f2ea831ab7bf3576da6
I20260709 13:13:44.224382 31697 raft_consensus.cc:3060] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:44.225365 32075 raft_consensus.cc:2804] T fb4f7292ed2f489e922ca5fb1c6e47bf P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:44.225878 32075 raft_consensus.cc:493] T fb4f7292ed2f489e922ca5fb1c6e47bf P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Starting leader election (detected failure of leader 458d610e8abf4f2ea831ab7bf3576da6)
I20260709 13:13:44.226276 32075 raft_consensus.cc:3060] T fb4f7292ed2f489e922ca5fb1c6e47bf P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:44.227028 32278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba83039f2d4e2c9089947b949a1790" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:44.228287 32278 raft_consensus.cc:2468] T 22ba83039f2d4e2c9089947b949a1790 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 1.
I20260709 13:13:44.230232 31592 leader_election.cc:304] T 2568dda6664d4363abc4fd891fa48370 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, c74453754ee34bea9b231ae318a55a31; no voters: 
I20260709 13:13:44.230814 32232 tablet_bootstrap.cc:492] T e698d6d2e2e74eca91e222e9bfdf8f13 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:44.233873 32325 raft_consensus.cc:2804] T 2568dda6664d4363abc4fd891fa48370 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:44.234273 32325 raft_consensus.cc:493] T 2568dda6664d4363abc4fd891fa48370 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 458d610e8abf4f2ea831ab7bf3576da6)
I20260709 13:13:44.234627 32325 raft_consensus.cc:3060] T 2568dda6664d4363abc4fd891fa48370 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:44.234724 32232 tablet_bootstrap.cc:492] T e698d6d2e2e74eca91e222e9bfdf8f13 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap complete.
I20260709 13:13:44.235219 31668 leader_election.cc:304] T 22ba83039f2d4e2c9089947b949a1790 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca; no voters: 
I20260709 13:13:44.235495 32232 ts_tablet_manager.cc:1403] T e698d6d2e2e74eca91e222e9bfdf8f13 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.004s
I20260709 13:13:44.237150 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b0a29c38284391bdaea82edf99c771" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31"
I20260709 13:13:44.236980 31626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497217e9b47244fcb425c66935cb8a20" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31"
I20260709 13:13:44.238281 32160 raft_consensus.cc:2804] T 22ba83039f2d4e2c9089947b949a1790 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:44.238310 31623 raft_consensus.cc:3060] T 88b0a29c38284391bdaea82edf99c771 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:44.238782 32160 raft_consensus.cc:493] T 22ba83039f2d4e2c9089947b949a1790 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Starting leader election (detected failure of leader 458d610e8abf4f2ea831ab7bf3576da6)
I20260709 13:13:44.239336 32160 raft_consensus.cc:3060] T 22ba83039f2d4e2c9089947b949a1790 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:44.240011 32232 raft_consensus.cc:359] T e698d6d2e2e74eca91e222e9bfdf8f13 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:44.240695 32232 raft_consensus.cc:740] T e698d6d2e2e74eca91e222e9bfdf8f13 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.241997 31626 raft_consensus.cc:3060] T 497217e9b47244fcb425c66935cb8a20 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:44.243834 32325 raft_consensus.cc:515] T 2568dda6664d4363abc4fd891fa48370 P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:44.244704 32232 consensus_queue.cc:260] T e698d6d2e2e74eca91e222e9bfdf8f13 P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:44.246255 32232 ts_tablet_manager.cc:1434] T e698d6d2e2e74eca91e222e9bfdf8f13 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:13:44.246414 31623 raft_consensus.cc:2468] T 88b0a29c38284391bdaea82edf99c771 P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 196d972917fe4f85985e3862d40b7596 in term 2.
I20260709 13:13:44.246989 32232 tablet_bootstrap.cc:492] T 4d146b574e8d4e21bd8d81cb29b4267a P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:44.247661 32326 raft_consensus.cc:493] T b262a50e82034c57a4bfb7da683ff5d1 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 458d610e8abf4f2ea831ab7bf3576da6)
I20260709 13:13:44.248215 32326 raft_consensus.cc:515] T b262a50e82034c57a4bfb7da683ff5d1 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:44.249204 31627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b262a50e82034c57a4bfb7da683ff5d1" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:44.253041 31627 raft_consensus.cc:2468] T b262a50e82034c57a4bfb7da683ff5d1 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 1.
I20260709 13:13:44.253952 32320 raft_consensus.cc:515] T b262a50e82034c57a4bfb7da683ff5d1 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:44.258721 32325 leader_election.cc:290] T 2568dda6664d4363abc4fd891fa48370 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 2 election: Requested vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:44.262048 32160 raft_consensus.cc:515] T 22ba83039f2d4e2c9089947b949a1790 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:44.187645 31520 leader_election.cc:304] T 0c12bd32cd944ce99a18fc4f9617961e P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 196d972917fe4f85985e3862d40b7596; no voters: 458d610e8abf4f2ea831ab7bf3576da6, c74453754ee34bea9b231ae318a55a31
I20260709 13:13:44.273214 32079 raft_consensus.cc:2749] T 0c12bd32cd944ce99a18fc4f9617961e P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:13:44.274237 31520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:37919, user_credentials={real_user=slave}} blocked reactor thread for 87103.3us
W20260709 13:13:44.275272 31520 leader_election.cc:343] T 497217e9b47244fcb425c66935cb8a20 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:44.250902 31817 raft_consensus.cc:515] T 0c12bd32cd944ce99a18fc4f9617961e P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:44.269734 31521 leader_election.cc:304] T 35bbba26df1b47a7b9923618bf451ffc P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 196d972917fe4f85985e3862d40b7596; no voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca
W20260709 13:13:44.278247 31594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:37919, user_credentials={real_user=slave}} blocked reactor thread for 78568.2us
I20260709 13:13:44.281797 31554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b0a29c38284391bdaea82edf99c771" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:44.282590 31554 raft_consensus.cc:2393] T 88b0a29c38284391bdaea82edf99c771 P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c74453754ee34bea9b231ae318a55a31 in current term 2: Already voted for candidate 196d972917fe4f85985e3862d40b7596 in this term.
I20260709 13:13:44.283298 32160 leader_election.cc:290] T 22ba83039f2d4e2c9089947b949a1790 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 2 election: Requested vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:44.289878 31626 raft_consensus.cc:2468] T 497217e9b47244fcb425c66935cb8a20 P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 196d972917fe4f85985e3862d40b7596 in term 2.
I20260709 13:13:44.294389 31626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba83039f2d4e2c9089947b949a1790" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:44.296854 31817 leader_election.cc:290] T 0c12bd32cd944ce99a18fc4f9617961e P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 2 election: Requested vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:44.304301 31627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b262a50e82034c57a4bfb7da683ff5d1" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31"
I20260709 13:13:44.304915 31627 raft_consensus.cc:3060] T b262a50e82034c57a4bfb7da683ff5d1 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:44.306725 31817 raft_consensus.cc:493] T 22ba83039f2d4e2c9089947b949a1790 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 458d610e8abf4f2ea831ab7bf3576da6)
I20260709 13:13:44.307237 31817 raft_consensus.cc:515] T 22ba83039f2d4e2c9089947b949a1790 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:44.286087 32319 raft_consensus.cc:493] T 36bf73ed3df141c889c046ad6902e304 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 458d610e8abf4f2ea831ab7bf3576da6)
I20260709 13:13:44.312805 31626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba83039f2d4e2c9089947b949a1790" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31"
I20260709 13:13:44.313311 31626 raft_consensus.cc:3060] T 22ba83039f2d4e2c9089947b949a1790 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:44.314251 31554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c12bd32cd944ce99a18fc4f9617961e" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596"
I20260709 13:13:44.315016 31554 raft_consensus.cc:3060] T 0c12bd32cd944ce99a18fc4f9617961e P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:44.319558 31552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2568dda6664d4363abc4fd891fa48370" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596"
I20260709 13:13:44.312103 32319 raft_consensus.cc:515] T 36bf73ed3df141c889c046ad6902e304 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:44.329622 31554 raft_consensus.cc:2468] T 0c12bd32cd944ce99a18fc4f9617961e P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 2.
I20260709 13:13:44.330235 31817 leader_election.cc:290] T 22ba83039f2d4e2c9089947b949a1790 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:44.322903 31626 raft_consensus.cc:2468] T 22ba83039f2d4e2c9089947b949a1790 P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 2.
I20260709 13:13:44.331089 31627 raft_consensus.cc:2468] T b262a50e82034c57a4bfb7da683ff5d1 P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 2.
I20260709 13:13:44.298326 32233 raft_consensus.cc:515] T 2568dda6664d4363abc4fd891fa48370 P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:44.333220 31592 leader_election.cc:304] T 0c12bd32cd944ce99a18fc4f9617961e P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, c74453754ee34bea9b231ae318a55a31; no voters: 
I20260709 13:13:44.334192 31817 raft_consensus.cc:2804] T 0c12bd32cd944ce99a18fc4f9617961e P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:44.326927 32278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2a6746f9b2f4b1ab287b9e8f4c51106" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
I20260709 13:13:44.334744 31817 raft_consensus.cc:697] T 0c12bd32cd944ce99a18fc4f9617961e P c74453754ee34bea9b231ae318a55a31 [term 2 LEADER]: Becoming Leader. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Running, Role: LEADER
I20260709 13:13:44.328861 32320 leader_election.cc:290] T b262a50e82034c57a4bfb7da683ff5d1 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 2 election: Requested vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:44.338817 32079 raft_consensus.cc:493] T 8a98dff441f1479992f85708c9f03283 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 458d610e8abf4f2ea831ab7bf3576da6)
I20260709 13:13:44.342741 32282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b0a29c38284391bdaea82edf99c771" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:44.329675 32277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba83039f2d4e2c9089947b949a1790" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
I20260709 13:13:44.343446 32282 raft_consensus.cc:2468] T 88b0a29c38284391bdaea82edf99c771 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 1.
I20260709 13:13:44.332872 31696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba83039f2d4e2c9089947b949a1790" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:44.342674 32079 raft_consensus.cc:515] T 8a98dff441f1479992f85708c9f03283 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:44.344341 31696 raft_consensus.cc:2393] T 22ba83039f2d4e2c9089947b949a1790 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c74453754ee34bea9b231ae318a55a31 in current term 2: Already voted for candidate 76fb155ade354ee1ba78673e73b28aca in this term.
I20260709 13:13:44.345340 32079 leader_election.cc:290] T 8a98dff441f1479992f85708c9f03283 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:44.343519 32277 raft_consensus.cc:3060] T 22ba83039f2d4e2c9089947b949a1790 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:44.346360 32281 raft_consensus.cc:2468] T 35bbba26df1b47a7b9923618bf451ffc P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 2.
I20260709 13:13:44.341260 32326 leader_election.cc:290] T b262a50e82034c57a4bfb7da683ff5d1 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:44.336958 31817 consensus_queue.cc:237] T 0c12bd32cd944ce99a18fc4f9617961e P c74453754ee34bea9b231ae318a55a31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:44.340158 32319 leader_election.cc:290] T 36bf73ed3df141c889c046ad6902e304 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:44.347864 31697 raft_consensus.cc:2468] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 196d972917fe4f85985e3862d40b7596 in term 2.
I20260709 13:13:44.368575 31521 leader_election.cc:304] T 88b0a29c38284391bdaea82edf99c771 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, c74453754ee34bea9b231ae318a55a31; no voters: 
I20260709 13:13:44.373358 32232 tablet_bootstrap.cc:492] T 4d146b574e8d4e21bd8d81cb29b4267a P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:44.374450 32232 tablet_bootstrap.cc:492] T 4d146b574e8d4e21bd8d81cb29b4267a P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap complete.
I20260709 13:13:44.375182 32232 ts_tablet_manager.cc:1403] T 4d146b574e8d4e21bd8d81cb29b4267a P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.128s	user 0.019s	sys 0.004s
I20260709 13:13:44.371184 31521 leader_election.cc:304] T 497217e9b47244fcb425c66935cb8a20 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, c74453754ee34bea9b231ae318a55a31; no voters: 458d610e8abf4f2ea831ab7bf3576da6
I20260709 13:13:44.378319 32278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2568dda6664d4363abc4fd891fa48370" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
I20260709 13:13:44.378945 32278 raft_consensus.cc:3060] T 2568dda6664d4363abc4fd891fa48370 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:44.380970 32075 raft_consensus.cc:515] T fb4f7292ed2f489e922ca5fb1c6e47bf P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:44.382402 32276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b262a50e82034c57a4bfb7da683ff5d1" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
I20260709 13:13:44.383239 32276 raft_consensus.cc:3060] T b262a50e82034c57a4bfb7da683ff5d1 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:44.386035 31668 leader_election.cc:304] T 35bbba26df1b47a7b9923618bf451ffc P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca; no voters: 
W20260709 13:13:44.387902 31520 leader_election.cc:343] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:44.387811 32280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a98dff441f1479992f85708c9f03283" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:44.372258 31702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b262a50e82034c57a4bfb7da683ff5d1" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:44.389338 32232 raft_consensus.cc:359] T 4d146b574e8d4e21bd8d81cb29b4267a P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:44.390718 32232 raft_consensus.cc:740] T 4d146b574e8d4e21bd8d81cb29b4267a P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.391791 32275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b0a29c38284391bdaea82edf99c771" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
I20260709 13:13:44.392174 32232 consensus_queue.cc:260] T 4d146b574e8d4e21bd8d81cb29b4267a P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:44.390264 31702 raft_consensus.cc:2393] T b262a50e82034c57a4bfb7da683ff5d1 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c74453754ee34bea9b231ae318a55a31 in current term 2: Already voted for candidate 76fb155ade354ee1ba78673e73b28aca in this term.
I20260709 13:13:44.388140 31594 leader_election.cc:304] T 88b0a29c38284391bdaea82edf99c771 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, c74453754ee34bea9b231ae318a55a31; no voters: 196d972917fe4f85985e3862d40b7596
I20260709 13:13:44.397018 32089 raft_consensus.cc:2804] T 35bbba26df1b47a7b9923618bf451ffc P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:44.398722 32326 raft_consensus.cc:2764] T 88b0a29c38284391bdaea82edf99c771 P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:13:44.399122 32089 raft_consensus.cc:697] T 35bbba26df1b47a7b9923618bf451ffc P 76fb155ade354ee1ba78673e73b28aca [term 2 LEADER]: Becoming Leader. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Running, Role: LEADER
I20260709 13:13:44.399977 32089 consensus_queue.cc:237] T 35bbba26df1b47a7b9923618bf451ffc P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:44.400393 32274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c12bd32cd944ce99a18fc4f9617961e" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
I20260709 13:13:44.401188 32274 raft_consensus.cc:3060] T 0c12bd32cd944ce99a18fc4f9617961e P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:44.403555 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba83039f2d4e2c9089947b949a1790" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:44.403908 32276 raft_consensus.cc:2468] T b262a50e82034c57a4bfb7da683ff5d1 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 2.
I20260709 13:13:44.404277 32279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b262a50e82034c57a4bfb7da683ff5d1" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:44.405068 32279 raft_consensus.cc:2393] T b262a50e82034c57a4bfb7da683ff5d1 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c74453754ee34bea9b231ae318a55a31 in current term 2: Already voted for candidate 76fb155ade354ee1ba78673e73b28aca in this term.
I20260709 13:13:44.386062 32278 raft_consensus.cc:2468] T 2568dda6664d4363abc4fd891fa48370 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 2.
I20260709 13:13:44.406872 32233 leader_election.cc:290] T 2568dda6664d4363abc4fd891fa48370 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 election: Requested vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:44.407692 31669 leader_election.cc:304] T 22ba83039f2d4e2c9089947b949a1790 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca, c74453754ee34bea9b231ae318a55a31; no voters: 
I20260709 13:13:44.410303 32160 raft_consensus.cc:2804] T 22ba83039f2d4e2c9089947b949a1790 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:44.410748 32160 raft_consensus.cc:697] T 22ba83039f2d4e2c9089947b949a1790 P 76fb155ade354ee1ba78673e73b28aca [term 2 LEADER]: Becoming Leader. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Running, Role: LEADER
I20260709 13:13:44.412611 31669 leader_election.cc:304] T b262a50e82034c57a4bfb7da683ff5d1 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca, c74453754ee34bea9b231ae318a55a31; no voters: 
I20260709 13:13:44.377545 31552 raft_consensus.cc:2393] T 2568dda6664d4363abc4fd891fa48370 P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c74453754ee34bea9b231ae318a55a31 in current term 2: Already voted for candidate 196d972917fe4f85985e3862d40b7596 in this term.
I20260709 13:13:44.375241 32319 raft_consensus.cc:2804] T 88b0a29c38284391bdaea82edf99c771 P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:44.371541 31550 raft_consensus.cc:2468] T 35bbba26df1b47a7b9923618bf451ffc P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 2.
I20260709 13:13:44.389456 32280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bf73ed3df141c889c046ad6902e304" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:44.411500 32160 consensus_queue.cc:237] T 22ba83039f2d4e2c9089947b949a1790 P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:44.422727 32075 leader_election.cc:290] T fb4f7292ed2f489e922ca5fb1c6e47bf P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 2 election: Requested vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:44.431008 31627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2568dda6664d4363abc4fd891fa48370" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31"
I20260709 13:13:44.431926 31627 raft_consensus.cc:2393] T 2568dda6664d4363abc4fd891fa48370 P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 196d972917fe4f85985e3862d40b7596 in current term 2: Already voted for candidate c74453754ee34bea9b231ae318a55a31 in this term.
I20260709 13:13:44.413797 32275 raft_consensus.cc:3060] T 88b0a29c38284391bdaea82edf99c771 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:44.434230 31521 leader_election.cc:304] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, 76fb155ade354ee1ba78673e73b28aca; no voters: 458d610e8abf4f2ea831ab7bf3576da6
I20260709 13:13:44.421365 32183 raft_consensus.cc:2749] T 35bbba26df1b47a7b9923618bf451ffc P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:44.466691 32232 ts_tablet_manager.cc:1434] T 4d146b574e8d4e21bd8d81cb29b4267a P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.091s	user 0.013s	sys 0.008s
I20260709 13:13:44.424481 32320 raft_consensus.cc:493] T 36bf73ed3df141c889c046ad6902e304 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 458d610e8abf4f2ea831ab7bf3576da6)
I20260709 13:13:44.467962 32232 tablet_bootstrap.cc:492] T f66580482b2d470bacbfec917042485b P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:44.428745 32319 raft_consensus.cc:697] T 88b0a29c38284391bdaea82edf99c771 P 196d972917fe4f85985e3862d40b7596 [term 2 LEADER]: Becoming Leader. State: Replica: 196d972917fe4f85985e3862d40b7596, State: Running, Role: LEADER
I20260709 13:13:44.433043 31697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bf73ed3df141c889c046ad6902e304" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:44.471825 32323 raft_consensus.cc:2804] T 497217e9b47244fcb425c66935cb8a20 P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:44.478036 32281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85d4a24725c749199c1b35d959b1b2b5" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
W20260709 13:13:44.491510 31669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:35791, user_credentials={real_user=slave}} blocked reactor thread for 79009.9us
I20260709 13:13:44.488996 32277 raft_consensus.cc:2468] T 22ba83039f2d4e2c9089947b949a1790 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 2.
W20260709 13:13:44.492393 31668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:37919, user_credentials={real_user=slave}} blocked reactor thread for 76677.1us
I20260709 13:13:44.472385 32334 raft_consensus.cc:2804] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:44.495805 32334 raft_consensus.cc:697] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 196d972917fe4f85985e3862d40b7596 [term 2 LEADER]: Becoming Leader. State: Replica: 196d972917fe4f85985e3862d40b7596, State: Running, Role: LEADER
I20260709 13:13:44.496814 32334 consensus_queue.cc:237] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 196d972917fe4f85985e3862d40b7596 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:44.469274 32089 raft_consensus.cc:2804] T b262a50e82034c57a4bfb7da683ff5d1 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:44.472868 32320 raft_consensus.cc:515] T 36bf73ed3df141c889c046ad6902e304 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:44.502372 32319 consensus_queue.cc:237] T 88b0a29c38284391bdaea82edf99c771 P 196d972917fe4f85985e3862d40b7596 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:44.504372 31697 raft_consensus.cc:2468] T 36bf73ed3df141c889c046ad6902e304 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 196d972917fe4f85985e3862d40b7596 in term 1.
I20260709 13:13:44.493726 32323 raft_consensus.cc:697] T 497217e9b47244fcb425c66935cb8a20 P 196d972917fe4f85985e3862d40b7596 [term 2 LEADER]: Becoming Leader. State: Replica: 196d972917fe4f85985e3862d40b7596, State: Running, Role: LEADER
I20260709 13:13:44.521270 31549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4f7292ed2f489e922ca5fb1c6e47bf" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596"
I20260709 13:13:44.521972 31549 raft_consensus.cc:3060] T fb4f7292ed2f489e922ca5fb1c6e47bf P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:44.509780 32089 raft_consensus.cc:697] T b262a50e82034c57a4bfb7da683ff5d1 P 76fb155ade354ee1ba78673e73b28aca [term 2 LEADER]: Becoming Leader. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Running, Role: LEADER
I20260709 13:13:44.539381 32323 consensus_queue.cc:237] T 497217e9b47244fcb425c66935cb8a20 P 196d972917fe4f85985e3862d40b7596 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
W20260709 13:13:44.543574 31520 leader_election.cc:343] T 8a98dff441f1479992f85708c9f03283 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:44.544863 31594 leader_election.cc:304] T 22ba83039f2d4e2c9089947b949a1790 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c74453754ee34bea9b231ae318a55a31; no voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca
I20260709 13:13:44.553771 31594 leader_election.cc:304] T b262a50e82034c57a4bfb7da683ff5d1 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c74453754ee34bea9b231ae318a55a31; no voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca
I20260709 13:13:44.561448 31759 raft_consensus.cc:2749] T b262a50e82034c57a4bfb7da683ff5d1 P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:44.562317 31594 leader_election.cc:304] T 2568dda6664d4363abc4fd891fa48370 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, c74453754ee34bea9b231ae318a55a31; no voters: 196d972917fe4f85985e3862d40b7596
I20260709 13:13:44.563082 32033 raft_consensus.cc:2804] T 2568dda6664d4363abc4fd891fa48370 P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:44.550693 32274 raft_consensus.cc:2468] T 0c12bd32cd944ce99a18fc4f9617961e P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 2.
W20260709 13:13:44.573437 31520 leader_election.cc:343] T 36bf73ed3df141c889c046ad6902e304 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:44.560920 32320 leader_election.cc:290] T 36bf73ed3df141c889c046ad6902e304 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:44.560143 32327 raft_consensus.cc:2749] T 22ba83039f2d4e2c9089947b949a1790 P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:44.570168 32089 consensus_queue.cc:237] T b262a50e82034c57a4bfb7da683ff5d1 P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:44.594097 31701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a98dff441f1479992f85708c9f03283" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:44.595132 31701 raft_consensus.cc:2468] T 8a98dff441f1479992f85708c9f03283 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 196d972917fe4f85985e3862d40b7596 in term 1.
I20260709 13:13:44.577615 31551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bf73ed3df141c889c046ad6902e304" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:44.602488 31551 raft_consensus.cc:2468] T 36bf73ed3df141c889c046ad6902e304 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 1.
W20260709 13:13:44.611204 31594 leader_election.cc:343] T 85d4a24725c749199c1b35d959b1b2b5 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:44.611649 31666 leader_election.cc:304] T 36bf73ed3df141c889c046ad6902e304 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, 76fb155ade354ee1ba78673e73b28aca; no voters: 
I20260709 13:13:44.619011 32275 raft_consensus.cc:2468] T 88b0a29c38284391bdaea82edf99c771 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 196d972917fe4f85985e3862d40b7596 in term 2.
I20260709 13:13:44.619800 31521 leader_election.cc:304] T 36bf73ed3df141c889c046ad6902e304 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, 76fb155ade354ee1ba78673e73b28aca; no voters: 458d610e8abf4f2ea831ab7bf3576da6
I20260709 13:13:44.621361 32279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2568dda6664d4363abc4fd891fa48370" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
I20260709 13:13:44.621613 32339 raft_consensus.cc:2804] T 36bf73ed3df141c889c046ad6902e304 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:44.622071 32339 raft_consensus.cc:493] T 36bf73ed3df141c889c046ad6902e304 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 458d610e8abf4f2ea831ab7bf3576da6)
I20260709 13:13:44.622238 32279 raft_consensus.cc:2393] T 2568dda6664d4363abc4fd891fa48370 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 196d972917fe4f85985e3862d40b7596 in current term 2: Already voted for candidate c74453754ee34bea9b231ae318a55a31 in this term.
I20260709 13:13:44.622481 32339 raft_consensus.cc:3060] T 36bf73ed3df141c889c046ad6902e304 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:44.622247 32347 raft_consensus.cc:2804] T 36bf73ed3df141c889c046ad6902e304 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:44.624094 32347 raft_consensus.cc:493] T 36bf73ed3df141c889c046ad6902e304 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Starting leader election (detected failure of leader 458d610e8abf4f2ea831ab7bf3576da6)
I20260709 13:13:44.624435 32347 raft_consensus.cc:3060] T 36bf73ed3df141c889c046ad6902e304 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:44.621668 32277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bf73ed3df141c889c046ad6902e304" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
W20260709 13:13:44.627358 31668 leader_election.cc:343] T 36bf73ed3df141c889c046ad6902e304 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:44.631621 31521 leader_election.cc:304] T 8a98dff441f1479992f85708c9f03283 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, 76fb155ade354ee1ba78673e73b28aca; no voters: 458d610e8abf4f2ea831ab7bf3576da6
I20260709 13:13:44.632669 31520 leader_election.cc:304] T 2568dda6664d4363abc4fd891fa48370 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 196d972917fe4f85985e3862d40b7596; no voters: 458d610e8abf4f2ea831ab7bf3576da6, c74453754ee34bea9b231ae318a55a31
W20260709 13:13:44.634855 31594 consensus_peers.cc:597] T 364efc87879c4e6db82a829c76ef0045 P c74453754ee34bea9b231ae318a55a31 -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:44.636325 32339 raft_consensus.cc:515] T 36bf73ed3df141c889c046ad6902e304 P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:44.638984 32339 leader_election.cc:290] T 36bf73ed3df141c889c046ad6902e304 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 election: Requested vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:44.649814 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4f7292ed2f489e922ca5fb1c6e47bf" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
I20260709 13:13:44.653571 31549 raft_consensus.cc:2468] T fb4f7292ed2f489e922ca5fb1c6e47bf P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 2.
I20260709 13:13:44.656903 32183 raft_consensus.cc:2804] T 8a98dff441f1479992f85708c9f03283 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:44.657362 32183 raft_consensus.cc:493] T 8a98dff441f1479992f85708c9f03283 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 458d610e8abf4f2ea831ab7bf3576da6)
I20260709 13:13:44.657657 32233 raft_consensus.cc:2749] T 2568dda6664d4363abc4fd891fa48370 P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:44.657730 32183 raft_consensus.cc:3060] T 8a98dff441f1479992f85708c9f03283 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:44.662380 31666 leader_election.cc:304] T fb4f7292ed2f489e922ca5fb1c6e47bf P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, 76fb155ade354ee1ba78673e73b28aca; no voters: 
I20260709 13:13:44.664858 32343 raft_consensus.cc:2804] T fb4f7292ed2f489e922ca5fb1c6e47bf P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:44.665434 32343 raft_consensus.cc:697] T fb4f7292ed2f489e922ca5fb1c6e47bf P 76fb155ade354ee1ba78673e73b28aca [term 2 LEADER]: Becoming Leader. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Running, Role: LEADER
I20260709 13:13:44.667367 32343 consensus_queue.cc:237] T fb4f7292ed2f489e922ca5fb1c6e47bf P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:44.667753 32347 raft_consensus.cc:515] T 36bf73ed3df141c889c046ad6902e304 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
W20260709 13:13:44.670037 31668 leader_election.cc:343] T fb4f7292ed2f489e922ca5fb1c6e47bf P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:44.673329 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bf73ed3df141c889c046ad6902e304" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
W20260709 13:13:44.674714 31594 consensus_peers.cc:597] T 85d4a24725c749199c1b35d959b1b2b5 P c74453754ee34bea9b231ae318a55a31 -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:44.676424 32278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bf73ed3df141c889c046ad6902e304" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
W20260709 13:13:44.678318 31520 leader_election.cc:343] T 36bf73ed3df141c889c046ad6902e304 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:44.681186 32347 leader_election.cc:290] T 36bf73ed3df141c889c046ad6902e304 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 2 election: Requested vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:44.682545 32183 raft_consensus.cc:515] T 8a98dff441f1479992f85708c9f03283 P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:44.694571 31549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bf73ed3df141c889c046ad6902e304" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596"
I20260709 13:13:44.695461 31549 raft_consensus.cc:2393] T 36bf73ed3df141c889c046ad6902e304 P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 76fb155ade354ee1ba78673e73b28aca in current term 2: Already voted for candidate 196d972917fe4f85985e3862d40b7596 in this term.
I20260709 13:13:44.700610 31702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bf73ed3df141c889c046ad6902e304" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca"
I20260709 13:13:44.702014 31702 raft_consensus.cc:2393] T 36bf73ed3df141c889c046ad6902e304 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 196d972917fe4f85985e3862d40b7596 in current term 2: Already voted for candidate 76fb155ade354ee1ba78673e73b28aca in this term.
W20260709 13:13:44.702621 31668 leader_election.cc:343] T 36bf73ed3df141c889c046ad6902e304 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:44.613225 32033 raft_consensus.cc:697] T 2568dda6664d4363abc4fd891fa48370 P c74453754ee34bea9b231ae318a55a31 [term 2 LEADER]: Becoming Leader. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Running, Role: LEADER
I20260709 13:13:44.705832 32033 consensus_queue.cc:237] T 2568dda6664d4363abc4fd891fa48370 P c74453754ee34bea9b231ae318a55a31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:44.711427 31666 leader_election.cc:304] T 36bf73ed3df141c889c046ad6902e304 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca; no voters: 196d972917fe4f85985e3862d40b7596, 458d610e8abf4f2ea831ab7bf3576da6
I20260709 13:13:44.714251 32320 raft_consensus.cc:2749] T 36bf73ed3df141c889c046ad6902e304 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:44.718889 31702 raft_consensus.cc:1275] T 85d4a24725c749199c1b35d959b1b2b5 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Refusing update from remote peer c74453754ee34bea9b231ae318a55a31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:44.730638 32232 tablet_bootstrap.cc:492] T f66580482b2d470bacbfec917042485b P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:44.731770 32232 tablet_bootstrap.cc:492] T f66580482b2d470bacbfec917042485b P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap complete.
I20260709 13:13:44.732766 32232 ts_tablet_manager.cc:1403] T f66580482b2d470bacbfec917042485b P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.265s	user 0.044s	sys 0.050s
I20260709 13:13:44.735145 32278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a98dff441f1479992f85708c9f03283" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
I20260709 13:13:44.735478 32232 raft_consensus.cc:359] T f66580482b2d470bacbfec917042485b P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:44.736228 32232 raft_consensus.cc:740] T f66580482b2d470bacbfec917042485b P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
W20260709 13:13:44.736529 31520 leader_election.cc:343] T 8a98dff441f1479992f85708c9f03283 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:44.736747 31521 leader_election.cc:304] T 36bf73ed3df141c889c046ad6902e304 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 196d972917fe4f85985e3862d40b7596; no voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca
I20260709 13:13:44.737097 32232 consensus_queue.cc:260] T f66580482b2d470bacbfec917042485b P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:44.737634 32319 raft_consensus.cc:2749] T 36bf73ed3df141c889c046ad6902e304 P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:44.740005 32183 leader_election.cc:290] T 8a98dff441f1479992f85708c9f03283 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 election: Requested vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:44.740598 32232 ts_tablet_manager.cc:1434] T f66580482b2d470bacbfec917042485b P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:13:44.741569 32232 tablet_bootstrap.cc:492] T 85d4a24725c749199c1b35d959b1b2b5 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:44.741176 32033 consensus_queue.cc:1048] T 85d4a24725c749199c1b35d959b1b2b5 P c74453754ee34bea9b231ae318a55a31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:44.742744 31378 catalog_manager.cc:5697] T 85d4a24725c749199c1b35d959b1b2b5 P c74453754ee34bea9b231ae318a55a31 reported cstate change: term changed from 1 to 2, leader changed from 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65) to c74453754ee34bea9b231ae318a55a31 (127.23.140.67). New cstate: current_term: 2 leader_uuid: "c74453754ee34bea9b231ae318a55a31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:44.744468 31378 catalog_manager.cc:5697] T 0c12bd32cd944ce99a18fc4f9617961e P c74453754ee34bea9b231ae318a55a31 reported cstate change: term changed from 1 to 2, leader changed from 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65) to c74453754ee34bea9b231ae318a55a31 (127.23.140.67). New cstate: current_term: 2 leader_uuid: "c74453754ee34bea9b231ae318a55a31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:44.746801 31702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a98dff441f1479992f85708c9f03283" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca"
I20260709 13:13:44.746273 31374 catalog_manager.cc:5697] T 35bbba26df1b47a7b9923618bf451ffc P 76fb155ade354ee1ba78673e73b28aca reported cstate change: term changed from 1 to 2, leader changed from 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65) to 76fb155ade354ee1ba78673e73b28aca (127.23.140.68). New cstate: current_term: 2 leader_uuid: "76fb155ade354ee1ba78673e73b28aca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:44.747306 31702 raft_consensus.cc:3060] T 8a98dff441f1479992f85708c9f03283 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:44.749303 31373 catalog_manager.cc:5697] T 88b0a29c38284391bdaea82edf99c771 P 196d972917fe4f85985e3862d40b7596 reported cstate change: term changed from 1 to 2, leader changed from 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65) to 196d972917fe4f85985e3862d40b7596 (127.23.140.66). New cstate: current_term: 2 leader_uuid: "196d972917fe4f85985e3862d40b7596" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:44.751683 31702 raft_consensus.cc:2468] T 8a98dff441f1479992f85708c9f03283 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 196d972917fe4f85985e3862d40b7596 in term 2.
I20260709 13:13:44.752565 31521 leader_election.cc:304] T 8a98dff441f1479992f85708c9f03283 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, 76fb155ade354ee1ba78673e73b28aca; no voters: 458d610e8abf4f2ea831ab7bf3576da6
I20260709 13:13:44.751184 31373 catalog_manager.cc:5697] T 497217e9b47244fcb425c66935cb8a20 P 196d972917fe4f85985e3862d40b7596 reported cstate change: term changed from 1 to 2, leader changed from 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65) to 196d972917fe4f85985e3862d40b7596 (127.23.140.66). New cstate: current_term: 2 leader_uuid: "196d972917fe4f85985e3862d40b7596" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:44.755229 31703 raft_consensus.cc:1275] T 364efc87879c4e6db82a829c76ef0045 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Refusing update from remote peer c74453754ee34bea9b231ae318a55a31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:44.757768 32183 raft_consensus.cc:2804] T 8a98dff441f1479992f85708c9f03283 P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:44.758533 32183 raft_consensus.cc:697] T 8a98dff441f1479992f85708c9f03283 P 196d972917fe4f85985e3862d40b7596 [term 2 LEADER]: Becoming Leader. State: Replica: 196d972917fe4f85985e3862d40b7596, State: Running, Role: LEADER
I20260709 13:13:44.761795 32325 consensus_queue.cc:1048] T 364efc87879c4e6db82a829c76ef0045 P c74453754ee34bea9b231ae318a55a31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:44.762367 32183 consensus_queue.cc:237] T 8a98dff441f1479992f85708c9f03283 P 196d972917fe4f85985e3862d40b7596 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:44.771806 31373 catalog_manager.cc:5697] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 196d972917fe4f85985e3862d40b7596 reported cstate change: term changed from 1 to 2, leader changed from 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65) to 196d972917fe4f85985e3862d40b7596 (127.23.140.66). New cstate: current_term: 2 leader_uuid: "196d972917fe4f85985e3862d40b7596" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:44.799752 31376 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54974
I20260709 13:13:44.806520 32310 heartbeater.cc:499] Master 127.23.140.126:37181 was elected leader, sending a full tablet report...
I20260709 13:13:44.809432 31378 catalog_manager.cc:5697] T 2568dda6664d4363abc4fd891fa48370 P c74453754ee34bea9b231ae318a55a31 reported cstate change: term changed from 1 to 2, leader changed from 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65) to c74453754ee34bea9b231ae318a55a31 (127.23.140.67). New cstate: current_term: 2 leader_uuid: "c74453754ee34bea9b231ae318a55a31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:44.875120 31549 raft_consensus.cc:1275] T 0c12bd32cd944ce99a18fc4f9617961e P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Refusing update from remote peer c74453754ee34bea9b231ae318a55a31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:44.878806 32235 consensus_queue.cc:1048] T 0c12bd32cd944ce99a18fc4f9617961e P c74453754ee34bea9b231ae318a55a31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:44.892540 32232 tablet_bootstrap.cc:492] T 85d4a24725c749199c1b35d959b1b2b5 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:44.893464 32232 tablet_bootstrap.cc:492] T 85d4a24725c749199c1b35d959b1b2b5 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap complete.
I20260709 13:13:44.895606 32232 ts_tablet_manager.cc:1403] T 85d4a24725c749199c1b35d959b1b2b5 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.154s	user 0.034s	sys 0.089s
I20260709 13:13:44.897647 31376 catalog_manager.cc:5697] T 8a98dff441f1479992f85708c9f03283 P 196d972917fe4f85985e3862d40b7596 reported cstate change: term changed from 1 to 2, leader changed from 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65) to 196d972917fe4f85985e3862d40b7596 (127.23.140.66). New cstate: current_term: 2 leader_uuid: "196d972917fe4f85985e3862d40b7596" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:44.899209 32232 raft_consensus.cc:359] T 85d4a24725c749199c1b35d959b1b2b5 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:44.899890 32232 raft_consensus.cc:740] T 85d4a24725c749199c1b35d959b1b2b5 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.900650 32232 consensus_queue.cc:260] T 85d4a24725c749199c1b35d959b1b2b5 P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:44.902599 32232 ts_tablet_manager.cc:1434] T 85d4a24725c749199c1b35d959b1b2b5 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:13:44.903569 32232 tablet_bootstrap.cc:492] T 497217e9b47244fcb425c66935cb8a20 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:44.902981 31373 catalog_manager.cc:5697] T 22ba83039f2d4e2c9089947b949a1790 P 76fb155ade354ee1ba78673e73b28aca reported cstate change: term changed from 1 to 2, leader changed from 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65) to 76fb155ade354ee1ba78673e73b28aca (127.23.140.68). New cstate: current_term: 2 leader_uuid: "76fb155ade354ee1ba78673e73b28aca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:44.905215 31373 catalog_manager.cc:5697] T fb4f7292ed2f489e922ca5fb1c6e47bf P 76fb155ade354ee1ba78673e73b28aca reported cstate change: term changed from 1 to 2, leader changed from 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65) to 76fb155ade354ee1ba78673e73b28aca (127.23.140.68). New cstate: current_term: 2 leader_uuid: "76fb155ade354ee1ba78673e73b28aca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:44.907760 31373 catalog_manager.cc:5697] T b262a50e82034c57a4bfb7da683ff5d1 P 76fb155ade354ee1ba78673e73b28aca reported cstate change: term changed from 1 to 2, leader changed from 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65) to 76fb155ade354ee1ba78673e73b28aca (127.23.140.68). New cstate: current_term: 2 leader_uuid: "76fb155ade354ee1ba78673e73b28aca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:44.910956 32273 raft_consensus.cc:1275] T 22ba83039f2d4e2c9089947b949a1790 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Refusing update from remote peer 76fb155ade354ee1ba78673e73b28aca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:44.912431 32343 consensus_queue.cc:1048] T 22ba83039f2d4e2c9089947b949a1790 P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:44.931485 31627 raft_consensus.cc:1275] T 22ba83039f2d4e2c9089947b949a1790 P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Refusing update from remote peer 76fb155ade354ee1ba78673e73b28aca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:44.955834 32343 consensus_queue.cc:1048] T 22ba83039f2d4e2c9089947b949a1790 P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:44.959671 31550 raft_consensus.cc:1275] T 35bbba26df1b47a7b9923618bf451ffc P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Refusing update from remote peer 76fb155ade354ee1ba78673e73b28aca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:44.961596 32089 consensus_queue.cc:1048] T 35bbba26df1b47a7b9923618bf451ffc P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:44.965405 31629 raft_consensus.cc:1275] T 88b0a29c38284391bdaea82edf99c771 P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Refusing update from remote peer 196d972917fe4f85985e3862d40b7596: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:44.966883 32273 raft_consensus.cc:1275] T 0c12bd32cd944ce99a18fc4f9617961e P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Refusing update from remote peer c74453754ee34bea9b231ae318a55a31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:44.968394 32351 consensus_queue.cc:1048] T 0c12bd32cd944ce99a18fc4f9617961e P c74453754ee34bea9b231ae318a55a31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:44.975788 32273 raft_consensus.cc:1275] T 35bbba26df1b47a7b9923618bf451ffc P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Refusing update from remote peer 76fb155ade354ee1ba78673e73b28aca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:44.977344 32347 consensus_queue.cc:1048] T 35bbba26df1b47a7b9923618bf451ffc P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:44.977447 32183 consensus_queue.cc:1048] T 88b0a29c38284391bdaea82edf99c771 P 196d972917fe4f85985e3862d40b7596 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:44.993669 32274 raft_consensus.cc:1275] T b262a50e82034c57a4bfb7da683ff5d1 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Refusing update from remote peer 76fb155ade354ee1ba78673e73b28aca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:44.996533 32347 consensus_queue.cc:1048] T b262a50e82034c57a4bfb7da683ff5d1 P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:45.022575 31626 raft_consensus.cc:1275] T b262a50e82034c57a4bfb7da683ff5d1 P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Refusing update from remote peer 76fb155ade354ee1ba78673e73b28aca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:45.024396 32348 consensus_queue.cc:1048] T b262a50e82034c57a4bfb7da683ff5d1 P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:45.064375 31699 raft_consensus.cc:1275] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Refusing update from remote peer 196d972917fe4f85985e3862d40b7596: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:45.066905 32323 consensus_queue.cc:1048] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 196d972917fe4f85985e3862d40b7596 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:45.086448 32232 tablet_bootstrap.cc:492] T 497217e9b47244fcb425c66935cb8a20 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:45.087473 32232 tablet_bootstrap.cc:492] T 497217e9b47244fcb425c66935cb8a20 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap complete.
I20260709 13:13:45.088121 32232 ts_tablet_manager.cc:1403] T 497217e9b47244fcb425c66935cb8a20 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.185s	user 0.029s	sys 0.056s
I20260709 13:13:45.090669 32232 raft_consensus.cc:359] T 497217e9b47244fcb425c66935cb8a20 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:45.091310 32232 raft_consensus.cc:740] T 497217e9b47244fcb425c66935cb8a20 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.092254 32232 consensus_queue.cc:260] T 497217e9b47244fcb425c66935cb8a20 P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:45.094566 32232 ts_tablet_manager.cc:1434] T 497217e9b47244fcb425c66935cb8a20 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:13:45.095428 32232 tablet_bootstrap.cc:492] T 4fe725ada8f142d1bb9a35a30f865c10 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:45.143718 32274 raft_consensus.cc:3060] T 85d4a24725c749199c1b35d959b1b2b5 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:45.153457 32232 tablet_bootstrap.cc:492] T 4fe725ada8f142d1bb9a35a30f865c10 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:13:45.153788 31520 consensus_peers.cc:597] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 196d972917fe4f85985e3862d40b7596 -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:45.154486 32232 tablet_bootstrap.cc:492] T 4fe725ada8f142d1bb9a35a30f865c10 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap complete.
I20260709 13:13:45.155198 32232 ts_tablet_manager.cc:1403] T 4fe725ada8f142d1bb9a35a30f865c10 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.060s	user 0.025s	sys 0.025s
I20260709 13:13:45.157696 32232 raft_consensus.cc:359] T 4fe725ada8f142d1bb9a35a30f865c10 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:45.158373 32232 raft_consensus.cc:740] T 4fe725ada8f142d1bb9a35a30f865c10 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.159036 32232 consensus_queue.cc:260] T 4fe725ada8f142d1bb9a35a30f865c10 P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:45.161008 32232 ts_tablet_manager.cc:1434] T 4fe725ada8f142d1bb9a35a30f865c10 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:13:45.165728 32232 tablet_bootstrap.cc:492] T 47cb0ae4817d4c19ac11b42143d00039 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:45.178376 31627 raft_consensus.cc:1275] T 497217e9b47244fcb425c66935cb8a20 P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Refusing update from remote peer 196d972917fe4f85985e3862d40b7596: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:45.181046 32319 consensus_queue.cc:1048] T 497217e9b47244fcb425c66935cb8a20 P 196d972917fe4f85985e3862d40b7596 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:45.186425 32278 raft_consensus.cc:1275] T 88b0a29c38284391bdaea82edf99c771 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Refusing update from remote peer 196d972917fe4f85985e3862d40b7596: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:45.191411 32281 raft_consensus.cc:3060] T 497217e9b47244fcb425c66935cb8a20 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:45.197973 32232 tablet_bootstrap.cc:492] T 47cb0ae4817d4c19ac11b42143d00039 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:45.198971 32232 tablet_bootstrap.cc:492] T 47cb0ae4817d4c19ac11b42143d00039 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap complete.
I20260709 13:13:45.199570 32183 consensus_queue.cc:1048] T 88b0a29c38284391bdaea82edf99c771 P 196d972917fe4f85985e3862d40b7596 [LEADER]: Connected to new peer: Peer: permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:45.199604 32232 ts_tablet_manager.cc:1403] T 47cb0ae4817d4c19ac11b42143d00039 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.013s
I20260709 13:13:45.202433 32281 raft_consensus.cc:1275] T 497217e9b47244fcb425c66935cb8a20 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Refusing update from remote peer 196d972917fe4f85985e3862d40b7596: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:45.204257 32319 consensus_queue.cc:1048] T 497217e9b47244fcb425c66935cb8a20 P 196d972917fe4f85985e3862d40b7596 [LEADER]: Connected to new peer: Peer: permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:45.204007 32232 raft_consensus.cc:359] T 47cb0ae4817d4c19ac11b42143d00039 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:45.210060 31550 raft_consensus.cc:1275] T 2568dda6664d4363abc4fd891fa48370 P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Refusing update from remote peer c74453754ee34bea9b231ae318a55a31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:45.210248 32232 raft_consensus.cc:740] T 47cb0ae4817d4c19ac11b42143d00039 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
W20260709 13:13:45.214761 31668 consensus_peers.cc:597] T 216111c5962f4b82ae52414985988860 P 76fb155ade354ee1ba78673e73b28aca -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:45.220085 32351 consensus_queue.cc:1048] T 2568dda6664d4363abc4fd891fa48370 P c74453754ee34bea9b231ae318a55a31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:13:45.221875 31520 consensus_peers.cc:597] T fc35ae8230cf4ab792d0e15bcaf8b653 P 196d972917fe4f85985e3862d40b7596 -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:45.223589 32232 consensus_queue.cc:260] T 47cb0ae4817d4c19ac11b42143d00039 P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:45.224285 32278 raft_consensus.cc:1275] T 2568dda6664d4363abc4fd891fa48370 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Refusing update from remote peer c74453754ee34bea9b231ae318a55a31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:45.225776 32351 consensus_queue.cc:1048] T 2568dda6664d4363abc4fd891fa48370 P c74453754ee34bea9b231ae318a55a31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:45.226670 32232 ts_tablet_manager.cc:1434] T 47cb0ae4817d4c19ac11b42143d00039 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.000s
I20260709 13:13:45.227542 32232 tablet_bootstrap.cc:492] T 36bf73ed3df141c889c046ad6902e304 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
W20260709 13:13:45.238919 31594 consensus_peers.cc:597] T ddbfc15d5bf24708a4268dfa206ede07 P c74453754ee34bea9b231ae318a55a31 -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:45.260732 32232 tablet_bootstrap.cc:492] T 36bf73ed3df141c889c046ad6902e304 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:45.261694 32232 tablet_bootstrap.cc:492] T 36bf73ed3df141c889c046ad6902e304 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap complete.
I20260709 13:13:45.262319 32232 ts_tablet_manager.cc:1403] T 36bf73ed3df141c889c046ad6902e304 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.035s	user 0.029s	sys 0.003s
I20260709 13:13:45.265163 32232 raft_consensus.cc:359] T 36bf73ed3df141c889c046ad6902e304 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:45.265848 32232 raft_consensus.cc:740] T 36bf73ed3df141c889c046ad6902e304 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.266484 32232 consensus_queue.cc:260] T 36bf73ed3df141c889c046ad6902e304 P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:45.267369 31699 raft_consensus.cc:1275] T 8a98dff441f1479992f85708c9f03283 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Refusing update from remote peer 196d972917fe4f85985e3862d40b7596: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:45.268649 32232 ts_tablet_manager.cc:1434] T 36bf73ed3df141c889c046ad6902e304 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:13:45.269907 32232 tablet_bootstrap.cc:492] T fb4f7292ed2f489e922ca5fb1c6e47bf P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
W20260709 13:13:45.271296 31668 consensus_peers.cc:597] T d78bdf917ee94331b91cb3fb308ef2a1 P 76fb155ade354ee1ba78673e73b28aca -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:45.276430 32319 consensus_queue.cc:1048] T 8a98dff441f1479992f85708c9f03283 P 196d972917fe4f85985e3862d40b7596 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:13:45.280334 31594 consensus_peers.cc:597] T 70ccde113c9246f5a008add70aacae7d P c74453754ee34bea9b231ae318a55a31 -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:45.304065 31668 consensus_peers.cc:597] T fb4f7292ed2f489e922ca5fb1c6e47bf P 76fb155ade354ee1ba78673e73b28aca -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:45.305023 31520 consensus_peers.cc:597] T 8a98dff441f1479992f85708c9f03283 P 196d972917fe4f85985e3862d40b7596 -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:45.308353 32232 tablet_bootstrap.cc:492] T fb4f7292ed2f489e922ca5fb1c6e47bf P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:45.309638 32232 tablet_bootstrap.cc:492] T fb4f7292ed2f489e922ca5fb1c6e47bf P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap complete.
I20260709 13:13:45.310380 32232 ts_tablet_manager.cc:1403] T fb4f7292ed2f489e922ca5fb1c6e47bf P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.041s	user 0.024s	sys 0.000s
W20260709 13:13:45.311921 31520 consensus_peers.cc:597] T c8185106c7a94c3ebaace350d2363217 P 196d972917fe4f85985e3862d40b7596 -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:45.312609 32232 raft_consensus.cc:359] T fb4f7292ed2f489e922ca5fb1c6e47bf P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:45.313278 32232 raft_consensus.cc:740] T fb4f7292ed2f489e922ca5fb1c6e47bf P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.313959 32232 consensus_queue.cc:260] T fb4f7292ed2f489e922ca5fb1c6e47bf P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:45.316196 31549 raft_consensus.cc:1275] T fb4f7292ed2f489e922ca5fb1c6e47bf P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Refusing update from remote peer 76fb155ade354ee1ba78673e73b28aca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:45.316784 32232 ts_tablet_manager.cc:1434] T fb4f7292ed2f489e922ca5fb1c6e47bf P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:13:45.317999 32347 consensus_queue.cc:1048] T fb4f7292ed2f489e922ca5fb1c6e47bf P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:45.319175 32232 tablet_bootstrap.cc:492] T ddbfc15d5bf24708a4268dfa206ede07 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
W20260709 13:13:45.324052 31594 consensus_peers.cc:597] T 5ea74721b8824d00b63c524b25ff23df P c74453754ee34bea9b231ae318a55a31 -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:45.345386 32232 tablet_bootstrap.cc:492] T ddbfc15d5bf24708a4268dfa206ede07 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:45.346513 32232 tablet_bootstrap.cc:492] T ddbfc15d5bf24708a4268dfa206ede07 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap complete.
I20260709 13:13:45.347230 32232 ts_tablet_manager.cc:1403] T ddbfc15d5bf24708a4268dfa206ede07 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.028s	user 0.020s	sys 0.004s
I20260709 13:13:45.350044 32232 raft_consensus.cc:359] T ddbfc15d5bf24708a4268dfa206ede07 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:45.402643 32232 raft_consensus.cc:740] T ddbfc15d5bf24708a4268dfa206ede07 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.404418 32232 consensus_queue.cc:260] T ddbfc15d5bf24708a4268dfa206ede07 P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:45.435663 32232 ts_tablet_manager.cc:1434] T ddbfc15d5bf24708a4268dfa206ede07 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.088s	user 0.000s	sys 0.013s
I20260709 13:13:45.459668 32232 tablet_bootstrap.cc:492] T 6038006ca0e344af86fe5febd517c62a P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
W20260709 13:13:45.497875 31594 consensus_peers.cc:597] T 6038006ca0e344af86fe5febd517c62a P c74453754ee34bea9b231ae318a55a31 -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:45.510355 31668 consensus_peers.cc:597] T 5b669b8d34ee4de5b002d30fbcf02dd7 P 76fb155ade354ee1ba78673e73b28aca -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:45.566673 31668 consensus_peers.cc:597] T a35171dce2e34beeafe34f3e80f18a41 P 76fb155ade354ee1ba78673e73b28aca -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:45.571931 31594 consensus_peers.cc:597] T ee6c632286174388ab5e7bfb2ae40078 P c74453754ee34bea9b231ae318a55a31 -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:45.576618 32232 tablet_bootstrap.cc:492] T 6038006ca0e344af86fe5febd517c62a P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:45.577718 32232 tablet_bootstrap.cc:492] T 6038006ca0e344af86fe5febd517c62a P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap complete.
I20260709 13:13:45.578420 32232 ts_tablet_manager.cc:1403] T 6038006ca0e344af86fe5febd517c62a P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.119s	user 0.021s	sys 0.016s
I20260709 13:13:45.581703 32232 raft_consensus.cc:359] T 6038006ca0e344af86fe5febd517c62a P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:45.582446 32232 raft_consensus.cc:740] T 6038006ca0e344af86fe5febd517c62a P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.583217 32232 consensus_queue.cc:260] T 6038006ca0e344af86fe5febd517c62a P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:45.586086 32232 ts_tablet_manager.cc:1434] T 6038006ca0e344af86fe5febd517c62a P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:13:45.587970 32232 tablet_bootstrap.cc:492] T 364efc87879c4e6db82a829c76ef0045 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:45.618594 32232 tablet_bootstrap.cc:492] T 364efc87879c4e6db82a829c76ef0045 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:45.619663 32232 tablet_bootstrap.cc:492] T 364efc87879c4e6db82a829c76ef0045 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap complete.
I20260709 13:13:45.620311 32232 ts_tablet_manager.cc:1403] T 364efc87879c4e6db82a829c76ef0045 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.033s	user 0.016s	sys 0.008s
I20260709 13:13:45.623565 32232 raft_consensus.cc:359] T 364efc87879c4e6db82a829c76ef0045 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:45.627121 32232 raft_consensus.cc:740] T 364efc87879c4e6db82a829c76ef0045 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.628444 32232 consensus_queue.cc:260] T 364efc87879c4e6db82a829c76ef0045 P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:45.631456 32232 ts_tablet_manager.cc:1434] T 364efc87879c4e6db82a829c76ef0045 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:13:45.632674 32232 tablet_bootstrap.cc:492] T 81f4d53616e74e2ea71e52fdb3e8fc76 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
W20260709 13:13:45.640141 31668 consensus_peers.cc:597] T 075b9562a2b547c8aad80c2bae413556 P 76fb155ade354ee1ba78673e73b28aca -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:45.657083 31520 consensus_peers.cc:597] T 81f4d53616e74e2ea71e52fdb3e8fc76 P 196d972917fe4f85985e3862d40b7596 -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:45.665352 32232 tablet_bootstrap.cc:492] T 81f4d53616e74e2ea71e52fdb3e8fc76 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:45.666273 32232 tablet_bootstrap.cc:492] T 81f4d53616e74e2ea71e52fdb3e8fc76 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap complete.
I20260709 13:13:45.666810 32232 ts_tablet_manager.cc:1403] T 81f4d53616e74e2ea71e52fdb3e8fc76 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.035s	user 0.024s	sys 0.008s
I20260709 13:13:45.668763 32232 raft_consensus.cc:359] T 81f4d53616e74e2ea71e52fdb3e8fc76 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:45.669318 32232 raft_consensus.cc:740] T 81f4d53616e74e2ea71e52fdb3e8fc76 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.669983 32232 consensus_queue.cc:260] T 81f4d53616e74e2ea71e52fdb3e8fc76 P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:45.672068 32232 ts_tablet_manager.cc:1434] T 81f4d53616e74e2ea71e52fdb3e8fc76 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:13:45.673352 32232 tablet_bootstrap.cc:492] T 5ea74721b8824d00b63c524b25ff23df P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:45.700742 32232 tablet_bootstrap.cc:492] T 5ea74721b8824d00b63c524b25ff23df P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:45.701666 32232 tablet_bootstrap.cc:492] T 5ea74721b8824d00b63c524b25ff23df P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap complete.
I20260709 13:13:45.702330 32232 ts_tablet_manager.cc:1403] T 5ea74721b8824d00b63c524b25ff23df P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.011s
I20260709 13:13:45.705129 32232 raft_consensus.cc:359] T 5ea74721b8824d00b63c524b25ff23df P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:45.706182 32232 raft_consensus.cc:740] T 5ea74721b8824d00b63c524b25ff23df P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
W20260709 13:13:45.708667 31668 consensus_peers.cc:597] T 40ab5d7d13ee4460933b5799482e3f87 P 76fb155ade354ee1ba78673e73b28aca -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:45.708948 32232 consensus_queue.cc:260] T 5ea74721b8824d00b63c524b25ff23df P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:45.711387 32232 ts_tablet_manager.cc:1434] T 5ea74721b8824d00b63c524b25ff23df P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:13:45.712098 32232 tablet_bootstrap.cc:492] T ee6c632286174388ab5e7bfb2ae40078 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:45.726256 32232 tablet_bootstrap.cc:492] T ee6c632286174388ab5e7bfb2ae40078 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:45.727373 32232 tablet_bootstrap.cc:492] T ee6c632286174388ab5e7bfb2ae40078 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap complete.
I20260709 13:13:45.728130 32232 ts_tablet_manager.cc:1403] T ee6c632286174388ab5e7bfb2ae40078 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.004s
I20260709 13:13:45.730836 32232 raft_consensus.cc:359] T ee6c632286174388ab5e7bfb2ae40078 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:45.731632 32232 raft_consensus.cc:740] T ee6c632286174388ab5e7bfb2ae40078 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.732421 32232 consensus_queue.cc:260] T ee6c632286174388ab5e7bfb2ae40078 P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:45.734298 32232 ts_tablet_manager.cc:1434] T ee6c632286174388ab5e7bfb2ae40078 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:13:45.735447 32232 tablet_bootstrap.cc:492] T d78bdf917ee94331b91cb3fb308ef2a1 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:45.751678 32232 tablet_bootstrap.cc:492] T d78bdf917ee94331b91cb3fb308ef2a1 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:45.752563 32232 tablet_bootstrap.cc:492] T d78bdf917ee94331b91cb3fb308ef2a1 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap complete.
I20260709 13:13:45.753327 32232 ts_tablet_manager.cc:1403] T d78bdf917ee94331b91cb3fb308ef2a1 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.004s
I20260709 13:13:45.756036 32232 raft_consensus.cc:359] T d78bdf917ee94331b91cb3fb308ef2a1 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:45.756764 32232 raft_consensus.cc:740] T d78bdf917ee94331b91cb3fb308ef2a1 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.757596 32232 consensus_queue.cc:260] T d78bdf917ee94331b91cb3fb308ef2a1 P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:45.759941 32232 ts_tablet_manager.cc:1434] T d78bdf917ee94331b91cb3fb308ef2a1 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:13:45.761420 32232 tablet_bootstrap.cc:492] T 075b9562a2b547c8aad80c2bae413556 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:45.777415 32232 tablet_bootstrap.cc:492] T 075b9562a2b547c8aad80c2bae413556 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:45.778455 32232 tablet_bootstrap.cc:492] T 075b9562a2b547c8aad80c2bae413556 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap complete.
I20260709 13:13:45.779212 32232 ts_tablet_manager.cc:1403] T 075b9562a2b547c8aad80c2bae413556 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 13:13:45.782150 32232 raft_consensus.cc:359] T 075b9562a2b547c8aad80c2bae413556 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:45.782876 32232 raft_consensus.cc:740] T 075b9562a2b547c8aad80c2bae413556 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.783601 32232 consensus_queue.cc:260] T 075b9562a2b547c8aad80c2bae413556 P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:45.786191 32232 ts_tablet_manager.cc:1434] T 075b9562a2b547c8aad80c2bae413556 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:13:45.787182 32232 tablet_bootstrap.cc:492] T 40ab5d7d13ee4460933b5799482e3f87 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:45.805024 32232 tablet_bootstrap.cc:492] T 40ab5d7d13ee4460933b5799482e3f87 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:45.806576 32232 tablet_bootstrap.cc:492] T 40ab5d7d13ee4460933b5799482e3f87 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap complete.
I20260709 13:13:45.807281 32232 ts_tablet_manager.cc:1403] T 40ab5d7d13ee4460933b5799482e3f87 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
I20260709 13:13:45.809928 32232 raft_consensus.cc:359] T 40ab5d7d13ee4460933b5799482e3f87 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:45.810551 32232 raft_consensus.cc:740] T 40ab5d7d13ee4460933b5799482e3f87 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.811257 32232 consensus_queue.cc:260] T 40ab5d7d13ee4460933b5799482e3f87 P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:45.813313 32232 ts_tablet_manager.cc:1434] T 40ab5d7d13ee4460933b5799482e3f87 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:13:45.814949 32232 tablet_bootstrap.cc:492] T 70ccde113c9246f5a008add70aacae7d P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:45.832504 32232 tablet_bootstrap.cc:492] T 70ccde113c9246f5a008add70aacae7d P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:45.833467 32232 tablet_bootstrap.cc:492] T 70ccde113c9246f5a008add70aacae7d P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap complete.
I20260709 13:13:45.834161 32232 ts_tablet_manager.cc:1403] T 70ccde113c9246f5a008add70aacae7d P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.008s
I20260709 13:13:45.836166 32232 raft_consensus.cc:359] T 70ccde113c9246f5a008add70aacae7d P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:45.836706 32232 raft_consensus.cc:740] T 70ccde113c9246f5a008add70aacae7d P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.837319 32232 consensus_queue.cc:260] T 70ccde113c9246f5a008add70aacae7d P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:45.839444 32232 ts_tablet_manager.cc:1434] T 70ccde113c9246f5a008add70aacae7d P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:13:45.840579 32232 tablet_bootstrap.cc:492] T 5b669b8d34ee4de5b002d30fbcf02dd7 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:45.847492 32274 raft_consensus.cc:3060] T fb4f7292ed2f489e922ca5fb1c6e47bf P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:45.861025 32232 tablet_bootstrap.cc:492] T 5b669b8d34ee4de5b002d30fbcf02dd7 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:45.862126 32232 tablet_bootstrap.cc:492] T 5b669b8d34ee4de5b002d30fbcf02dd7 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap complete.
I20260709 13:13:45.862835 32232 ts_tablet_manager.cc:1403] T 5b669b8d34ee4de5b002d30fbcf02dd7 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.023s	user 0.006s	sys 0.011s
I20260709 13:13:45.865537 32232 raft_consensus.cc:359] T 5b669b8d34ee4de5b002d30fbcf02dd7 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:45.866225 32232 raft_consensus.cc:740] T 5b669b8d34ee4de5b002d30fbcf02dd7 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.867048 32232 consensus_queue.cc:260] T 5b669b8d34ee4de5b002d30fbcf02dd7 P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:45.869158 32232 ts_tablet_manager.cc:1434] T 5b669b8d34ee4de5b002d30fbcf02dd7 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:13:45.869984 32232 tablet_bootstrap.cc:492] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:45.885138 32232 tablet_bootstrap.cc:492] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:45.886129 32232 tablet_bootstrap.cc:492] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap complete.
I20260709 13:13:45.886674 32232 ts_tablet_manager.cc:1403] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.008s
I20260709 13:13:45.888566 32232 raft_consensus.cc:359] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:45.889066 32232 raft_consensus.cc:740] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.889595 32232 consensus_queue.cc:260] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:45.891244 32232 ts_tablet_manager.cc:1434] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:13:45.892230 32232 tablet_bootstrap.cc:492] T fc35ae8230cf4ab792d0e15bcaf8b653 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:45.906962 32232 tablet_bootstrap.cc:492] T fc35ae8230cf4ab792d0e15bcaf8b653 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:45.907866 32232 tablet_bootstrap.cc:492] T fc35ae8230cf4ab792d0e15bcaf8b653 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap complete.
I20260709 13:13:45.908511 32232 ts_tablet_manager.cc:1403] T fc35ae8230cf4ab792d0e15bcaf8b653 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.016s	user 0.006s	sys 0.008s
I20260709 13:13:45.910887 32232 raft_consensus.cc:359] T fc35ae8230cf4ab792d0e15bcaf8b653 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:45.911458 32232 raft_consensus.cc:740] T fc35ae8230cf4ab792d0e15bcaf8b653 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.912217 32232 consensus_queue.cc:260] T fc35ae8230cf4ab792d0e15bcaf8b653 P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:45.914330 32232 ts_tablet_manager.cc:1434] T fc35ae8230cf4ab792d0e15bcaf8b653 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:13:45.915179 32232 tablet_bootstrap.cc:492] T a35171dce2e34beeafe34f3e80f18a41 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:45.931113 32232 tablet_bootstrap.cc:492] T a35171dce2e34beeafe34f3e80f18a41 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:45.931953 32232 tablet_bootstrap.cc:492] T a35171dce2e34beeafe34f3e80f18a41 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap complete.
I20260709 13:13:45.932559 32232 ts_tablet_manager.cc:1403] T a35171dce2e34beeafe34f3e80f18a41 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.004s
I20260709 13:13:45.934993 32232 raft_consensus.cc:359] T a35171dce2e34beeafe34f3e80f18a41 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:45.935504 32232 raft_consensus.cc:740] T a35171dce2e34beeafe34f3e80f18a41 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.936151 32232 consensus_queue.cc:260] T a35171dce2e34beeafe34f3e80f18a41 P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:45.938136 32232 ts_tablet_manager.cc:1434] T a35171dce2e34beeafe34f3e80f18a41 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.003s
I20260709 13:13:45.939592 32232 tablet_bootstrap.cc:492] T c8185106c7a94c3ebaace350d2363217 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:45.952641 32232 tablet_bootstrap.cc:492] T c8185106c7a94c3ebaace350d2363217 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:45.953737 32232 tablet_bootstrap.cc:492] T c8185106c7a94c3ebaace350d2363217 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap complete.
I20260709 13:13:45.954419 32232 ts_tablet_manager.cc:1403] T c8185106c7a94c3ebaace350d2363217 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.001s
I20260709 13:13:45.956303 32232 raft_consensus.cc:359] T c8185106c7a94c3ebaace350d2363217 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:45.956760 32232 raft_consensus.cc:740] T c8185106c7a94c3ebaace350d2363217 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.957232 32232 consensus_queue.cc:260] T c8185106c7a94c3ebaace350d2363217 P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:45.959093 32232 ts_tablet_manager.cc:1434] T c8185106c7a94c3ebaace350d2363217 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:13:45.960330 32232 tablet_bootstrap.cc:492] T 8a98dff441f1479992f85708c9f03283 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:45.980345 32232 tablet_bootstrap.cc:492] T 8a98dff441f1479992f85708c9f03283 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:45.981323 32232 tablet_bootstrap.cc:492] T 8a98dff441f1479992f85708c9f03283 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap complete.
I20260709 13:13:45.982023 32232 ts_tablet_manager.cc:1403] T 8a98dff441f1479992f85708c9f03283 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.003s
I20260709 13:13:45.984627 32232 raft_consensus.cc:359] T 8a98dff441f1479992f85708c9f03283 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:45.985296 32232 raft_consensus.cc:740] T 8a98dff441f1479992f85708c9f03283 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.986043 32232 consensus_queue.cc:260] T 8a98dff441f1479992f85708c9f03283 P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:45.988623 32232 ts_tablet_manager.cc:1434] T 8a98dff441f1479992f85708c9f03283 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:13:45.990095 32232 tablet_bootstrap.cc:492] T 216111c5962f4b82ae52414985988860 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap starting.
I20260709 13:13:46.005800 32232 tablet_bootstrap.cc:492] T 216111c5962f4b82ae52414985988860 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:46.006901 32232 tablet_bootstrap.cc:492] T 216111c5962f4b82ae52414985988860 P 458d610e8abf4f2ea831ab7bf3576da6: Bootstrap complete.
I20260709 13:13:46.007681 32232 ts_tablet_manager.cc:1403] T 216111c5962f4b82ae52414985988860 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.001s
I20260709 13:13:46.010324 32232 raft_consensus.cc:359] T 216111c5962f4b82ae52414985988860 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:46.010919 32232 raft_consensus.cc:740] T 216111c5962f4b82ae52414985988860 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Initialized, Role: FOLLOWER
I20260709 13:13:46.011610 32232 consensus_queue.cc:260] T 216111c5962f4b82ae52414985988860 P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:46.013561 32232 ts_tablet_manager.cc:1434] T 216111c5962f4b82ae52414985988860 P 458d610e8abf4f2ea831ab7bf3576da6: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:13:46.049294 32278 raft_consensus.cc:3060] T 364efc87879c4e6db82a829c76ef0045 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:46.123461 32274 raft_consensus.cc:3060] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:46.446787 32278 raft_consensus.cc:3060] T 8a98dff441f1479992f85708c9f03283 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:46.662359 32089 raft_consensus.cc:493] T 36bf73ed3df141c889c046ad6902e304 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.662954 32089 raft_consensus.cc:515] T 36bf73ed3df141c889c046ad6902e304 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:46.664844 32089 leader_election.cc:290] T 36bf73ed3df141c889c046ad6902e304 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:46.665606 32278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bf73ed3df141c889c046ad6902e304" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:46.666320 31549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bf73ed3df141c889c046ad6902e304" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:46.666354 32278 raft_consensus.cc:2468] T 36bf73ed3df141c889c046ad6902e304 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 1.
I20260709 13:13:46.666961 31549 raft_consensus.cc:2468] T 36bf73ed3df141c889c046ad6902e304 P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 2.
I20260709 13:13:46.667752 31668 leader_election.cc:304] T 36bf73ed3df141c889c046ad6902e304 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca; no voters: 
I20260709 13:13:46.668537 32089 raft_consensus.cc:2804] T 36bf73ed3df141c889c046ad6902e304 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:46.668814 32089 raft_consensus.cc:493] T 36bf73ed3df141c889c046ad6902e304 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:46.669056 32089 raft_consensus.cc:3060] T 36bf73ed3df141c889c046ad6902e304 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:46.674258 32089 raft_consensus.cc:515] T 36bf73ed3df141c889c046ad6902e304 P 76fb155ade354ee1ba78673e73b28aca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:46.675760 32089 leader_election.cc:290] T 36bf73ed3df141c889c046ad6902e304 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 3 election: Requested vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:46.676558 32278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bf73ed3df141c889c046ad6902e304" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
I20260709 13:13:46.676760 31549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bf73ed3df141c889c046ad6902e304" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596"
I20260709 13:13:46.677098 32278 raft_consensus.cc:3060] T 36bf73ed3df141c889c046ad6902e304 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:13:46.677345 31549 raft_consensus.cc:3060] T 36bf73ed3df141c889c046ad6902e304 P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:46.683274 32278 raft_consensus.cc:2468] T 36bf73ed3df141c889c046ad6902e304 P 458d610e8abf4f2ea831ab7bf3576da6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 3.
I20260709 13:13:46.684073 31549 raft_consensus.cc:2468] T 36bf73ed3df141c889c046ad6902e304 P 196d972917fe4f85985e3862d40b7596 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 3.
I20260709 13:13:46.684291 31668 leader_election.cc:304] T 36bf73ed3df141c889c046ad6902e304 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca; no voters: 
I20260709 13:13:46.685048 32089 raft_consensus.cc:2804] T 36bf73ed3df141c889c046ad6902e304 P 76fb155ade354ee1ba78673e73b28aca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:46.685478 32089 raft_consensus.cc:697] T 36bf73ed3df141c889c046ad6902e304 P 76fb155ade354ee1ba78673e73b28aca [term 3 LEADER]: Becoming Leader. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Running, Role: LEADER
I20260709 13:13:46.686157 32089 consensus_queue.cc:237] T 36bf73ed3df141c889c046ad6902e304 P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:46.695134 31378 catalog_manager.cc:5697] T 36bf73ed3df141c889c046ad6902e304 P 76fb155ade354ee1ba78673e73b28aca reported cstate change: term changed from 1 to 3, leader changed from 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65) to 76fb155ade354ee1ba78673e73b28aca (127.23.140.68). New cstate: current_term: 3 leader_uuid: "76fb155ade354ee1ba78673e73b28aca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:47.221455 32273 raft_consensus.cc:1275] T 36bf73ed3df141c889c046ad6902e304 P 458d610e8abf4f2ea831ab7bf3576da6 [term 3 FOLLOWER]: Refusing update from remote peer 76fb155ade354ee1ba78673e73b28aca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:47.222838 32348 consensus_queue.cc:1048] T 36bf73ed3df141c889c046ad6902e304 P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:47.227290 31549 raft_consensus.cc:1275] T 36bf73ed3df141c889c046ad6902e304 P 196d972917fe4f85985e3862d40b7596 [term 3 FOLLOWER]: Refusing update from remote peer 76fb155ade354ee1ba78673e73b28aca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:47.229234 32412 consensus_queue.cc:1048] T 36bf73ed3df141c889c046ad6902e304 P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:13:54.110520 31668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:37919, user_credentials={real_user=slave}} blocked reactor thread for 198070us
I20260709 13:13:54.464591 32412 raft_consensus.cc:493] T 256a5c9a935246e0a6c36b5b654fbbfb P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 196d972917fe4f85985e3862d40b7596)
I20260709 13:13:54.466588 32412 raft_consensus.cc:515] T 256a5c9a935246e0a6c36b5b654fbbfb P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:54.473037 32443 raft_consensus.cc:493] T 1fb28788823d4c5fab527f4ee2da4d2e P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c74453754ee34bea9b231ae318a55a31)
I20260709 13:13:54.473932 32443 raft_consensus.cc:515] T 1fb28788823d4c5fab527f4ee2da4d2e P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:54.476424 32443 leader_election.cc:290] T 1fb28788823d4c5fab527f4ee2da4d2e P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:54.479082 32412 leader_election.cc:290] T 256a5c9a935246e0a6c36b5b654fbbfb P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:54.514436 31626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a5c9a935246e0a6c36b5b654fbbfb" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:54.517365 31626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb28788823d4c5fab527f4ee2da4d2e" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:54.608630 32450 raft_consensus.cc:493] T 6038006ca0e344af86fe5febd517c62a P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c74453754ee34bea9b231ae318a55a31)
I20260709 13:13:54.618122 31549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a5c9a935246e0a6c36b5b654fbbfb" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:54.618574 32450 raft_consensus.cc:515] T 6038006ca0e344af86fe5febd517c62a P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:54.609335 32452 raft_consensus.cc:493] T 36bf73ed3df141c889c046ad6902e304 P 196d972917fe4f85985e3862d40b7596 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 76fb155ade354ee1ba78673e73b28aca)
I20260709 13:13:54.617383 32447 raft_consensus.cc:493] T b262a50e82034c57a4bfb7da683ff5d1 P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 76fb155ade354ee1ba78673e73b28aca)
I20260709 13:13:54.619652 32447 raft_consensus.cc:515] T b262a50e82034c57a4bfb7da683ff5d1 P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:54.621374 32450 leader_election.cc:290] T 6038006ca0e344af86fe5febd517c62a P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:54.622102 32447 leader_election.cc:290] T b262a50e82034c57a4bfb7da683ff5d1 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:54.623668 32279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b262a50e82034c57a4bfb7da683ff5d1" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:54.624320 32452 raft_consensus.cc:515] T 36bf73ed3df141c889c046ad6902e304 P 196d972917fe4f85985e3862d40b7596 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:54.626510 32452 leader_election.cc:290] T 36bf73ed3df141c889c046ad6902e304 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:54.639029 31629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6038006ca0e344af86fe5febd517c62a" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:54.640375 32453 raft_consensus.cc:493] T 5ea74721b8824d00b63c524b25ff23df P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c74453754ee34bea9b231ae318a55a31)
I20260709 13:13:54.640954 32453 raft_consensus.cc:515] T 5ea74721b8824d00b63c524b25ff23df P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:54.643203 31699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bf73ed3df141c889c046ad6902e304" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:54.645345 32453 leader_election.cc:290] T 5ea74721b8824d00b63c524b25ff23df P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:54.652041 31629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea74721b8824d00b63c524b25ff23df" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:54.655678 32443 raft_consensus.cc:493] T ee6c632286174388ab5e7bfb2ae40078 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c74453754ee34bea9b231ae318a55a31)
I20260709 13:13:54.656277 32443 raft_consensus.cc:515] T ee6c632286174388ab5e7bfb2ae40078 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:54.658569 32443 leader_election.cc:290] T ee6c632286174388ab5e7bfb2ae40078 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:54.664803 32450 raft_consensus.cc:493] T fb97ca15f56b46dd846db7b0ff156a32 P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c74453754ee34bea9b231ae318a55a31)
I20260709 13:13:54.665439 32450 raft_consensus.cc:515] T fb97ca15f56b46dd846db7b0ff156a32 P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:54.667639 32450 leader_election.cc:290] T fb97ca15f56b46dd846db7b0ff156a32 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715)
I20260709 13:13:54.669461 32451 raft_consensus.cc:493] T dcf07174e49c498f8e19fd005690404b P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c74453754ee34bea9b231ae318a55a31)
I20260709 13:13:54.669435 31699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb97ca15f56b46dd846db7b0ff156a32" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:54.670197 32451 raft_consensus.cc:515] T dcf07174e49c498f8e19fd005690404b P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:54.670507 32278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bf73ed3df141c889c046ad6902e304" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:54.671638 32278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea74721b8824d00b63c524b25ff23df" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:54.672312 32451 leader_election.cc:290] T dcf07174e49c498f8e19fd005690404b P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:54.675695 32275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6038006ca0e344af86fe5febd517c62a" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:54.676359 32275 raft_consensus.cc:2468] T 6038006ca0e344af86fe5febd517c62a P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 196d972917fe4f85985e3862d40b7596 in term 1.
I20260709 13:13:54.677924 32443 raft_consensus.cc:493] T 1e727ab6847b4fbab9a94b63842c6b9c P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c74453754ee34bea9b231ae318a55a31)
I20260709 13:13:54.678462 32443 raft_consensus.cc:515] T 1e727ab6847b4fbab9a94b63842c6b9c P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:54.680104 32442 raft_consensus.cc:493] T 70ccde113c9246f5a008add70aacae7d P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c74453754ee34bea9b231ae318a55a31)
I20260709 13:13:54.680629 32442 raft_consensus.cc:515] T 70ccde113c9246f5a008add70aacae7d P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:54.682777 32442 leader_election.cc:290] T 70ccde113c9246f5a008add70aacae7d P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:54.687011 32443 leader_election.cc:290] T 1e727ab6847b4fbab9a94b63842c6b9c P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:54.693302 31629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb97ca15f56b46dd846db7b0ff156a32" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:54.696051 31629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf07174e49c498f8e19fd005690404b" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:54.700301 31521 leader_election.cc:304] T fb97ca15f56b46dd846db7b0ff156a32 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 196d972917fe4f85985e3862d40b7596; no voters: 76fb155ade354ee1ba78673e73b28aca, c74453754ee34bea9b231ae318a55a31
I20260709 13:13:54.701119 32453 raft_consensus.cc:2749] T fb97ca15f56b46dd846db7b0ff156a32 P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:54.718866 32453 raft_consensus.cc:493] T cfe1afd9e187451faf5f631e0c2eef00 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c74453754ee34bea9b231ae318a55a31)
I20260709 13:13:54.719367 32453 raft_consensus.cc:515] T cfe1afd9e187451faf5f631e0c2eef00 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:54.725193 32455 raft_consensus.cc:493] T ac45af43771c45fd8e57204c190c322b P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c74453754ee34bea9b231ae318a55a31)
I20260709 13:13:54.726727 31669 leader_election.cc:304] T 256a5c9a935246e0a6c36b5b654fbbfb P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca; no voters: 196d972917fe4f85985e3862d40b7596, c74453754ee34bea9b231ae318a55a31
I20260709 13:13:54.719846 31627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39414 (request call id 366) took 1157 ms. Trace:
I20260709 13:13:54.740267 32412 raft_consensus.cc:2749] T 256a5c9a935246e0a6c36b5b654fbbfb P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:54.750574 32453 leader_election.cc:290] T cfe1afd9e187451faf5f631e0c2eef00 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:54.751538 31553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e727ab6847b4fbab9a94b63842c6b9c" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:54.738351 31627 rpcz_store.cc:276] 0709 13:13:53.562937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:54.719029 (+1156092us) service_pool.cc:224] Handling call
0709 13:13:54.719309 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:54.719468 (+   159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:54.719493 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:54.719531 (+    38us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:54.719559 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:54.719608 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:54.719696 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:54.755854 32412 raft_consensus.cc:493] T 4fe725ada8f142d1bb9a35a30f865c10 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c74453754ee34bea9b231ae318a55a31)
I20260709 13:13:54.765084 32412 raft_consensus.cc:515] T 4fe725ada8f142d1bb9a35a30f865c10 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:54.741451 32443 raft_consensus.cc:493] T f66580482b2d470bacbfec917042485b P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c74453754ee34bea9b231ae318a55a31)
I20260709 13:13:54.776790 32412 leader_election.cc:290] T 4fe725ada8f142d1bb9a35a30f865c10 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:54.782614 32457 raft_consensus.cc:493] T f66580482b2d470bacbfec917042485b P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c74453754ee34bea9b231ae318a55a31)
I20260709 13:13:54.783380 32457 raft_consensus.cc:515] T f66580482b2d470bacbfec917042485b P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:54.774039 32442 raft_consensus.cc:493] T ddbfc15d5bf24708a4268dfa206ede07 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c74453754ee34bea9b231ae318a55a31)
I20260709 13:13:54.788332 32443 raft_consensus.cc:515] T f66580482b2d470bacbfec917042485b P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
W20260709 13:13:54.807938 31669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:35791, user_credentials={real_user=slave}} blocked reactor thread for 67339.5us
I20260709 13:13:54.802386 31697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b262a50e82034c57a4bfb7da683ff5d1" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:54.754884 32455 raft_consensus.cc:515] T ac45af43771c45fd8e57204c190c322b P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:54.820915 32455 leader_election.cc:290] T ac45af43771c45fd8e57204c190c322b P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:54.797538 32453 raft_consensus.cc:493] T e3516a073925457498018b87cdbaa85f P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c74453754ee34bea9b231ae318a55a31)
I20260709 13:13:54.822062 32453 raft_consensus.cc:515] T e3516a073925457498018b87cdbaa85f P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:54.823459 32461 raft_consensus.cc:493] T 4d146b574e8d4e21bd8d81cb29b4267a P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c74453754ee34bea9b231ae318a55a31)
I20260709 13:13:54.824247 32461 raft_consensus.cc:515] T 4d146b574e8d4e21bd8d81cb29b4267a P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:54.805126 32442 raft_consensus.cc:515] T ddbfc15d5bf24708a4268dfa206ede07 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:54.828603 31697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3516a073925457498018b87cdbaa85f" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:54.834218 32453 leader_election.cc:290] T e3516a073925457498018b87cdbaa85f P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715)
I20260709 13:13:54.842234 32456 raft_consensus.cc:493] T b3705de0af7a48f69f751aab333fdf3d P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c74453754ee34bea9b231ae318a55a31)
I20260709 13:13:54.842948 32443 leader_election.cc:290] T f66580482b2d470bacbfec917042485b P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:54.843050 32457 leader_election.cc:290] T f66580482b2d470bacbfec917042485b P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715)
I20260709 13:13:54.843288 31595 leader_election.cc:304] T b262a50e82034c57a4bfb7da683ff5d1 P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c74453754ee34bea9b231ae318a55a31; no voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca
W20260709 13:13:54.843024 31666 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:37431, user_credentials={real_user=slave}} blocked reactor thread for 68020.9us
I20260709 13:13:54.834492 32455 raft_consensus.cc:493] T 075b9562a2b547c8aad80c2bae413556 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76fb155ade354ee1ba78673e73b28aca)
I20260709 13:13:54.847638 32449 raft_consensus.cc:2749] T b262a50e82034c57a4bfb7da683ff5d1 P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:54.848037 32456 raft_consensus.cc:515] T b3705de0af7a48f69f751aab333fdf3d P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:54.847254 32455 raft_consensus.cc:515] T 075b9562a2b547c8aad80c2bae413556 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:54.850590 32456 leader_election.cc:290] T b3705de0af7a48f69f751aab333fdf3d P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
I20260709 13:13:54.850678 32455 leader_election.cc:290] T 075b9562a2b547c8aad80c2bae413556 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:54.852321 32442 leader_election.cc:290] T ddbfc15d5bf24708a4268dfa206ede07 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
W20260709 13:13:54.853638 31592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:37431, user_credentials={real_user=slave}} blocked reactor thread for 128589us
I20260709 13:13:54.853937 32453 raft_consensus.cc:493] T 11617136d6c14faea3cee24e00514101 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c74453754ee34bea9b231ae318a55a31)
I20260709 13:13:54.854602 32453 raft_consensus.cc:515] T 11617136d6c14faea3cee24e00514101 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:54.855103 32461 leader_election.cc:290] T 4d146b574e8d4e21bd8d81cb29b4267a P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715)
I20260709 13:13:54.859485 32453 leader_election.cc:290] T 11617136d6c14faea3cee24e00514101 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:54.867276 32453 raft_consensus.cc:493] T 0f01040b42e14f0db6bcd06319237ddb P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c74453754ee34bea9b231ae318a55a31)
I20260709 13:13:54.867785 32453 raft_consensus.cc:515] T 0f01040b42e14f0db6bcd06319237ddb P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:54.869837 32453 leader_election.cc:290] T 0f01040b42e14f0db6bcd06319237ddb P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715)
I20260709 13:13:54.871006 31627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe1afd9e187451faf5f631e0c2eef00" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:54.871579 31629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3516a073925457498018b87cdbaa85f" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:54.872691 31626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f01040b42e14f0db6bcd06319237ddb" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:54.871107 31700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f01040b42e14f0db6bcd06319237ddb" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:54.872814 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11617136d6c14faea3cee24e00514101" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:54.874222 31626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6c632286174388ab5e7bfb2ae40078" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:54.875780 31626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70ccde113c9246f5a008add70aacae7d" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:54.886005 31626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e727ab6847b4fbab9a94b63842c6b9c" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:54.888952 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe725ada8f142d1bb9a35a30f865c10" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:54.889642 32275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb28788823d4c5fab527f4ee2da4d2e" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:54.894944 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66580482b2d470bacbfec917042485b" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:54.901440 31626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3705de0af7a48f69f751aab333fdf3d" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:54.902050 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddbfc15d5bf24708a4268dfa206ede07" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:54.909420 31521 leader_election.cc:304] T e3516a073925457498018b87cdbaa85f P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 196d972917fe4f85985e3862d40b7596; no voters: 76fb155ade354ee1ba78673e73b28aca, c74453754ee34bea9b231ae318a55a31
I20260709 13:13:54.911149 31669 leader_election.cc:304] T 1e727ab6847b4fbab9a94b63842c6b9c P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca; no voters: 196d972917fe4f85985e3862d40b7596, c74453754ee34bea9b231ae318a55a31
I20260709 13:13:54.914400 31521 leader_election.cc:304] T 0f01040b42e14f0db6bcd06319237ddb P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 196d972917fe4f85985e3862d40b7596; no voters: 76fb155ade354ee1ba78673e73b28aca, c74453754ee34bea9b231ae318a55a31
I20260709 13:13:54.914908 32453 raft_consensus.cc:2749] T e3516a073925457498018b87cdbaa85f P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:54.920568 32463 raft_consensus.cc:2749] T 1e727ab6847b4fbab9a94b63842c6b9c P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:54.913404 32275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6c632286174388ab5e7bfb2ae40078" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:54.924636 32453 raft_consensus.cc:2749] T 0f01040b42e14f0db6bcd06319237ddb P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:54.935102 32281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe725ada8f142d1bb9a35a30f865c10" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:54.936178 32275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70ccde113c9246f5a008add70aacae7d" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:54.938807 32277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66580482b2d470bacbfec917042485b" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:54.947755 32275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf07174e49c498f8e19fd005690404b" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:54.948027 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe1afd9e187451faf5f631e0c2eef00" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:54.948958 32277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3705de0af7a48f69f751aab333fdf3d" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:54.949162 32281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11617136d6c14faea3cee24e00514101" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:54.946614 31520 leader_election.cc:304] T 36bf73ed3df141c889c046ad6902e304 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 196d972917fe4f85985e3862d40b7596; no voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca
I20260709 13:13:54.954521 31520 leader_election.cc:304] T 5ea74721b8824d00b63c524b25ff23df P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 196d972917fe4f85985e3862d40b7596; no voters: 458d610e8abf4f2ea831ab7bf3576da6, c74453754ee34bea9b231ae318a55a31
I20260709 13:13:54.955399 32454 raft_consensus.cc:2749] T 5ea74721b8824d00b63c524b25ff23df P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:54.954138 32453 raft_consensus.cc:2749] T 36bf73ed3df141c889c046ad6902e304 P 196d972917fe4f85985e3862d40b7596 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:54.959733 31520 leader_election.cc:304] T 6038006ca0e344af86fe5febd517c62a P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, 458d610e8abf4f2ea831ab7bf3576da6; no voters: c74453754ee34bea9b231ae318a55a31
I20260709 13:13:54.960652 32452 raft_consensus.cc:2804] T 6038006ca0e344af86fe5febd517c62a P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:54.961033 32452 raft_consensus.cc:493] T 6038006ca0e344af86fe5febd517c62a P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c74453754ee34bea9b231ae318a55a31)
I20260709 13:13:54.961414 32452 raft_consensus.cc:3060] T 6038006ca0e344af86fe5febd517c62a P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:54.965925 32281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddbfc15d5bf24708a4268dfa206ede07" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:54.972847 31668 leader_election.cc:304] T 1fb28788823d4c5fab527f4ee2da4d2e P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca; no voters: 458d610e8abf4f2ea831ab7bf3576da6, c74453754ee34bea9b231ae318a55a31
I20260709 13:13:54.975504 32428 raft_consensus.cc:2749] T 1fb28788823d4c5fab527f4ee2da4d2e P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:54.977927 31668 leader_election.cc:304] T ee6c632286174388ab5e7bfb2ae40078 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca; no voters: 458d610e8abf4f2ea831ab7bf3576da6, c74453754ee34bea9b231ae318a55a31
I20260709 13:13:54.978242 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:54.979686 32463 raft_consensus.cc:2749] T ee6c632286174388ab5e7bfb2ae40078 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:54.983016 31668 leader_election.cc:304] T 4fe725ada8f142d1bb9a35a30f865c10 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca; no voters: 458d610e8abf4f2ea831ab7bf3576da6, c74453754ee34bea9b231ae318a55a31
I20260709 13:13:54.983920 32462 raft_consensus.cc:2749] T 4fe725ada8f142d1bb9a35a30f865c10 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:54.985828 31668 leader_election.cc:304] T 70ccde113c9246f5a008add70aacae7d P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca; no voters: 458d610e8abf4f2ea831ab7bf3576da6, c74453754ee34bea9b231ae318a55a31
I20260709 13:13:54.986593 32428 raft_consensus.cc:2749] T 70ccde113c9246f5a008add70aacae7d P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:54.987049 31668 leader_election.cc:304] T f66580482b2d470bacbfec917042485b P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca; no voters: 458d610e8abf4f2ea831ab7bf3576da6, c74453754ee34bea9b231ae318a55a31
I20260709 13:13:54.987872 32428 raft_consensus.cc:2749] T f66580482b2d470bacbfec917042485b P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:54.988282 31668 leader_election.cc:304] T b3705de0af7a48f69f751aab333fdf3d P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca; no voters: 458d610e8abf4f2ea831ab7bf3576da6, c74453754ee34bea9b231ae318a55a31
I20260709 13:13:54.989076 32428 raft_consensus.cc:2749] T b3705de0af7a48f69f751aab333fdf3d P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:54.991950 32452 raft_consensus.cc:515] T 6038006ca0e344af86fe5febd517c62a P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:54.995236 31626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6038006ca0e344af86fe5febd517c62a" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31"
I20260709 13:13:54.996903 31520 leader_election.cc:304] T cfe1afd9e187451faf5f631e0c2eef00 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 196d972917fe4f85985e3862d40b7596; no voters: 458d610e8abf4f2ea831ab7bf3576da6, c74453754ee34bea9b231ae318a55a31
I20260709 13:13:54.997639 32450 raft_consensus.cc:2749] T cfe1afd9e187451faf5f631e0c2eef00 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:54.998042 31520 leader_election.cc:304] T dcf07174e49c498f8e19fd005690404b P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 196d972917fe4f85985e3862d40b7596; no voters: 458d610e8abf4f2ea831ab7bf3576da6, c74453754ee34bea9b231ae318a55a31
I20260709 13:13:54.998778 32450 raft_consensus.cc:2749] T dcf07174e49c498f8e19fd005690404b P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:54.999236 31520 leader_election.cc:304] T 11617136d6c14faea3cee24e00514101 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 196d972917fe4f85985e3862d40b7596; no voters: 458d610e8abf4f2ea831ab7bf3576da6, c74453754ee34bea9b231ae318a55a31
I20260709 13:13:54.999971 32450 raft_consensus.cc:2749] T 11617136d6c14faea3cee24e00514101 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:55.001421 32452 leader_election.cc:290] T 6038006ca0e344af86fe5febd517c62a P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 election: Requested vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:55.007203 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6038006ca0e344af86fe5febd517c62a" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
I20260709 13:13:55.009922 31548 raft_consensus.cc:1240] T 6038006ca0e344af86fe5febd517c62a P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Rejecting Update request from peer c74453754ee34bea9b231ae318a55a31 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:55.009930 31700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66580482b2d470bacbfec917042485b" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:55.011198 31552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b9562a2b547c8aad80c2bae413556" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:55.011634 31697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d146b574e8d4e21bd8d81cb29b4267a" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:55.010797 31698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b9562a2b547c8aad80c2bae413556" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "76fb155ade354ee1ba78673e73b28aca" is_pre_election: true
I20260709 13:13:55.013155 31550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac45af43771c45fd8e57204c190c322b" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:55.013583 31520 leader_election.cc:304] T 6038006ca0e344af86fe5febd517c62a P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 196d972917fe4f85985e3862d40b7596; no voters: 458d610e8abf4f2ea831ab7bf3576da6, c74453754ee34bea9b231ae318a55a31
I20260709 13:13:55.014312 32453 raft_consensus.cc:2749] T 6038006ca0e344af86fe5febd517c62a P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:55.017334 32226 leader_election.cc:304] T 075b9562a2b547c8aad80c2bae413556 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6; no voters: 196d972917fe4f85985e3862d40b7596, 76fb155ade354ee1ba78673e73b28aca
I20260709 13:13:55.018496 32465 raft_consensus.cc:2749] T 075b9562a2b547c8aad80c2bae413556 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:55.021799 32466 consensus_queue.cc:1059] T 6038006ca0e344af86fe5febd517c62a P c74453754ee34bea9b231ae318a55a31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:55.023548 32466 raft_consensus.cc:3055] T 6038006ca0e344af86fe5febd517c62a P c74453754ee34bea9b231ae318a55a31 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:55.023909 32466 raft_consensus.cc:740] T 6038006ca0e344af86fe5febd517c62a P c74453754ee34bea9b231ae318a55a31 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Running, Role: LEADER
I20260709 13:13:55.024698 32466 consensus_queue.cc:260] T 6038006ca0e344af86fe5febd517c62a P c74453754ee34bea9b231ae318a55a31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:55.026613 32466 raft_consensus.cc:3060] T 6038006ca0e344af86fe5febd517c62a P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:55.042601 31668 leader_election.cc:304] T ddbfc15d5bf24708a4268dfa206ede07 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca; no voters: 458d610e8abf4f2ea831ab7bf3576da6, c74453754ee34bea9b231ae318a55a31
I20260709 13:13:55.043924 32442 raft_consensus.cc:2749] T ddbfc15d5bf24708a4268dfa206ede07 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:55.065827 31626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac45af43771c45fd8e57204c190c322b" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:55.066124 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66580482b2d470bacbfec917042485b" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:55.066419 31629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d146b574e8d4e21bd8d81cb29b4267a" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:55.070879 32229 leader_election.cc:304] T ac45af43771c45fd8e57204c190c322b P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6; no voters: 196d972917fe4f85985e3862d40b7596, c74453754ee34bea9b231ae318a55a31
I20260709 13:13:55.071743 32465 raft_consensus.cc:2749] T ac45af43771c45fd8e57204c190c322b P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:55.072631 32229 leader_election.cc:304] T f66580482b2d470bacbfec917042485b P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6; no voters: 76fb155ade354ee1ba78673e73b28aca, c74453754ee34bea9b231ae318a55a31
I20260709 13:13:55.073490 32465 raft_consensus.cc:2749] T f66580482b2d470bacbfec917042485b P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:55.074306 32229 leader_election.cc:304] T 4d146b574e8d4e21bd8d81cb29b4267a P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6; no voters: 76fb155ade354ee1ba78673e73b28aca, c74453754ee34bea9b231ae318a55a31
I20260709 13:13:55.075193 32465 raft_consensus.cc:2749] T 4d146b574e8d4e21bd8d81cb29b4267a P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:55.106403 31698 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "075b9562a2b547c8aad80c2bae413556"
dest_uuid: "76fb155ade354ee1ba78673e73b28aca"
mode: GRACEFUL
new_leader_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
 from {username='slave'} at 127.0.0.1:50386
I20260709 13:13:55.107311 31698 raft_consensus.cc:606] T 075b9562a2b547c8aad80c2bae413556 P 76fb155ade354ee1ba78673e73b28aca [term 1 LEADER]: Received request to transfer leadership to TS 458d610e8abf4f2ea831ab7bf3576da6
I20260709 13:13:55.110216 31697 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ee7f4cbe2594c5793b2cb27e1dd4b34"
dest_uuid: "76fb155ade354ee1ba78673e73b28aca"
mode: GRACEFUL
new_leader_uuid: "196d972917fe4f85985e3862d40b7596"
 from {username='slave'} at 127.0.0.1:50386
I20260709 13:13:55.110826 31697 raft_consensus.cc:606] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P 76fb155ade354ee1ba78673e73b28aca [term 1 LEADER]: Received request to transfer leadership to TS 196d972917fe4f85985e3862d40b7596
I20260709 13:13:55.113467 31697 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36bf73ed3df141c889c046ad6902e304"
dest_uuid: "76fb155ade354ee1ba78673e73b28aca"
mode: GRACEFUL
new_leader_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
 from {username='slave'} at 127.0.0.1:50386
I20260709 13:13:55.114074 31697 raft_consensus.cc:606] T 36bf73ed3df141c889c046ad6902e304 P 76fb155ade354ee1ba78673e73b28aca [term 3 LEADER]: Received request to transfer leadership to TS 458d610e8abf4f2ea831ab7bf3576da6
I20260709 13:13:55.118458 31697 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "76a7de5cfe774df68279e2e1e7361c6b"
dest_uuid: "76fb155ade354ee1ba78673e73b28aca"
mode: GRACEFUL
new_leader_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
 from {username='slave'} at 127.0.0.1:50386
I20260709 13:13:55.119052 31697 raft_consensus.cc:606] T 76a7de5cfe774df68279e2e1e7361c6b P 76fb155ade354ee1ba78673e73b28aca [term 1 LEADER]: Received request to transfer leadership to TS 458d610e8abf4f2ea831ab7bf3576da6
I20260709 13:13:55.121680 31697 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d78bdf917ee94331b91cb3fb308ef2a1"
dest_uuid: "76fb155ade354ee1ba78673e73b28aca"
mode: GRACEFUL
new_leader_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
 from {username='slave'} at 127.0.0.1:50386
I20260709 13:13:55.122208 31697 raft_consensus.cc:606] T d78bdf917ee94331b91cb3fb308ef2a1 P 76fb155ade354ee1ba78673e73b28aca [term 1 LEADER]: Received request to transfer leadership to TS 458d610e8abf4f2ea831ab7bf3576da6
I20260709 13:13:55.138711 31623 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dcf07174e49c498f8e19fd005690404b"
dest_uuid: "c74453754ee34bea9b231ae318a55a31"
mode: GRACEFUL
new_leader_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
 from {username='slave'} at 127.0.0.1:40662
I20260709 13:13:55.139367 31623 raft_consensus.cc:606] T dcf07174e49c498f8e19fd005690404b P c74453754ee34bea9b231ae318a55a31 [term 1 LEADER]: Received request to transfer leadership to TS 458d610e8abf4f2ea831ab7bf3576da6
I20260709 13:13:55.140590 24113 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:13:55.141791 24113 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:55.236614 32442 raft_consensus.cc:993] T 36bf73ed3df141c889c046ad6902e304 P 76fb155ade354ee1ba78673e73b28aca: : Instructing follower 458d610e8abf4f2ea831ab7bf3576da6 to start an election
I20260709 13:13:55.237128 32462 raft_consensus.cc:1081] T 36bf73ed3df141c889c046ad6902e304 P 76fb155ade354ee1ba78673e73b28aca [term 3 LEADER]: Signalling peer 458d610e8abf4f2ea831ab7bf3576da6 to start an election
I20260709 13:13:55.238498 32277 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "36bf73ed3df141c889c046ad6902e304"
dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
 from {username='slave'} at 127.0.0.1:47200
I20260709 13:13:55.238945 32277 raft_consensus.cc:493] T 36bf73ed3df141c889c046ad6902e304 P 458d610e8abf4f2ea831ab7bf3576da6 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:55.239181 32277 raft_consensus.cc:3060] T 36bf73ed3df141c889c046ad6902e304 P 458d610e8abf4f2ea831ab7bf3576da6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:55.245121 32277 raft_consensus.cc:515] T 36bf73ed3df141c889c046ad6902e304 P 458d610e8abf4f2ea831ab7bf3576da6 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:55.247710 31697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bf73ed3df141c889c046ad6902e304" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "76fb155ade354ee1ba78673e73b28aca"
I20260709 13:13:55.248301 31697 raft_consensus.cc:3055] T 36bf73ed3df141c889c046ad6902e304 P 76fb155ade354ee1ba78673e73b28aca [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:55.248587 31697 raft_consensus.cc:740] T 36bf73ed3df141c889c046ad6902e304 P 76fb155ade354ee1ba78673e73b28aca [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Running, Role: LEADER
I20260709 13:13:55.248982 32277 leader_election.cc:290] T 36bf73ed3df141c889c046ad6902e304 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 4 election: Requested vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:55.253624 31697 consensus_queue.cc:260] T 36bf73ed3df141c889c046ad6902e304 P 76fb155ade354ee1ba78673e73b28aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:55.254951 31697 raft_consensus.cc:3060] T 36bf73ed3df141c889c046ad6902e304 P 76fb155ade354ee1ba78673e73b28aca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:55.256465 32458 raft_consensus.cc:993] T dcf07174e49c498f8e19fd005690404b P c74453754ee34bea9b231ae318a55a31: : Instructing follower 458d610e8abf4f2ea831ab7bf3576da6 to start an election
I20260709 13:13:55.256932 32458 raft_consensus.cc:1081] T dcf07174e49c498f8e19fd005690404b P c74453754ee34bea9b231ae318a55a31 [term 1 LEADER]: Signalling peer 458d610e8abf4f2ea831ab7bf3576da6 to start an election
I20260709 13:13:55.249197 31552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bf73ed3df141c889c046ad6902e304" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "196d972917fe4f85985e3862d40b7596"
I20260709 13:13:55.258270 31552 raft_consensus.cc:3060] T 36bf73ed3df141c889c046ad6902e304 P 196d972917fe4f85985e3862d40b7596 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:55.258697 32273 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dcf07174e49c498f8e19fd005690404b"
dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
 from {username='slave'} at 127.0.0.1:47214
I20260709 13:13:55.259248 32273 raft_consensus.cc:493] T dcf07174e49c498f8e19fd005690404b P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:55.259555 32273 raft_consensus.cc:3060] T dcf07174e49c498f8e19fd005690404b P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:55.263087 31697 raft_consensus.cc:2468] T 36bf73ed3df141c889c046ad6902e304 P 76fb155ade354ee1ba78673e73b28aca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 4.
I20260709 13:13:55.264757 32229 leader_election.cc:304] T 36bf73ed3df141c889c046ad6902e304 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca; no voters: 
I20260709 13:13:55.265632 32465 raft_consensus.cc:2804] T 36bf73ed3df141c889c046ad6902e304 P 458d610e8abf4f2ea831ab7bf3576da6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:55.266108 32465 raft_consensus.cc:697] T 36bf73ed3df141c889c046ad6902e304 P 458d610e8abf4f2ea831ab7bf3576da6 [term 4 LEADER]: Becoming Leader. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Running, Role: LEADER
I20260709 13:13:55.266919 32465 consensus_queue.cc:237] T 36bf73ed3df141c889c046ad6902e304 P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:55.268312 32273 raft_consensus.cc:515] T dcf07174e49c498f8e19fd005690404b P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:55.270386 32273 leader_election.cc:290] T dcf07174e49c498f8e19fd005690404b P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 2 election: Requested vote from peers 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:55.271102 31550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf07174e49c498f8e19fd005690404b" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "196d972917fe4f85985e3862d40b7596"
I20260709 13:13:55.271390 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf07174e49c498f8e19fd005690404b" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c74453754ee34bea9b231ae318a55a31"
I20260709 13:13:55.271739 31550 raft_consensus.cc:3060] T dcf07174e49c498f8e19fd005690404b P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:55.271778 31552 raft_consensus.cc:2468] T 36bf73ed3df141c889c046ad6902e304 P 196d972917fe4f85985e3862d40b7596 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 4.
I20260709 13:13:55.272250 31623 raft_consensus.cc:3055] T dcf07174e49c498f8e19fd005690404b P c74453754ee34bea9b231ae318a55a31 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:55.272722 31623 raft_consensus.cc:740] T dcf07174e49c498f8e19fd005690404b P c74453754ee34bea9b231ae318a55a31 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Running, Role: LEADER
I20260709 13:13:55.273787 31623 consensus_queue.cc:260] T dcf07174e49c498f8e19fd005690404b P c74453754ee34bea9b231ae318a55a31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:55.275449 31623 raft_consensus.cc:3060] T dcf07174e49c498f8e19fd005690404b P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:55.282274 31550 raft_consensus.cc:2468] T dcf07174e49c498f8e19fd005690404b P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 2.
I20260709 13:13:55.283619 32226 leader_election.cc:304] T dcf07174e49c498f8e19fd005690404b P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, 458d610e8abf4f2ea831ab7bf3576da6; no voters: 
I20260709 13:13:55.284397 32465 raft_consensus.cc:2804] T dcf07174e49c498f8e19fd005690404b P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:55.287153 32465 raft_consensus.cc:697] T dcf07174e49c498f8e19fd005690404b P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 LEADER]: Becoming Leader. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Running, Role: LEADER
I20260709 13:13:55.288401 31623 raft_consensus.cc:2468] T dcf07174e49c498f8e19fd005690404b P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 2.
I20260709 13:13:55.288735 32465 consensus_queue.cc:237] T dcf07174e49c498f8e19fd005690404b P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:55.287798 31374 catalog_manager.cc:5697] T 36bf73ed3df141c889c046ad6902e304 P 458d610e8abf4f2ea831ab7bf3576da6 reported cstate change: term changed from 3 to 4, leader changed from 76fb155ade354ee1ba78673e73b28aca (127.23.140.68) to 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65). New cstate: current_term: 4 leader_uuid: "458d610e8abf4f2ea831ab7bf3576da6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:55.331111 31374 catalog_manager.cc:5697] T dcf07174e49c498f8e19fd005690404b P 458d610e8abf4f2ea831ab7bf3576da6 reported cstate change: term changed from 1 to 2, leader changed from c74453754ee34bea9b231ae318a55a31 (127.23.140.67) to 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65). New cstate: current_term: 2 leader_uuid: "458d610e8abf4f2ea831ab7bf3576da6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:55.341861 32428 raft_consensus.cc:993] T 76a7de5cfe774df68279e2e1e7361c6b P 76fb155ade354ee1ba78673e73b28aca: : Instructing follower 458d610e8abf4f2ea831ab7bf3576da6 to start an election
I20260709 13:13:55.342278 32442 raft_consensus.cc:1081] T 76a7de5cfe774df68279e2e1e7361c6b P 76fb155ade354ee1ba78673e73b28aca [term 1 LEADER]: Signalling peer 458d610e8abf4f2ea831ab7bf3576da6 to start an election
I20260709 13:13:55.343844 32273 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "76a7de5cfe774df68279e2e1e7361c6b"
dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
 from {username='slave'} at 127.0.0.1:47200
I20260709 13:13:55.344424 32273 raft_consensus.cc:493] T 76a7de5cfe774df68279e2e1e7361c6b P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:55.344818 32273 raft_consensus.cc:3060] T 76a7de5cfe774df68279e2e1e7361c6b P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:55.355607 32273 raft_consensus.cc:515] T 76a7de5cfe774df68279e2e1e7361c6b P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:55.357033 32273 leader_election.cc:290] T 76a7de5cfe774df68279e2e1e7361c6b P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 2 election: Requested vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:55.357818 31697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a7de5cfe774df68279e2e1e7361c6b" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "76fb155ade354ee1ba78673e73b28aca"
I20260709 13:13:55.358067 31550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a7de5cfe774df68279e2e1e7361c6b" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "196d972917fe4f85985e3862d40b7596"
I20260709 13:13:55.358358 31697 raft_consensus.cc:3055] T 76a7de5cfe774df68279e2e1e7361c6b P 76fb155ade354ee1ba78673e73b28aca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:55.358669 31550 raft_consensus.cc:3060] T 76a7de5cfe774df68279e2e1e7361c6b P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:55.358692 31697 raft_consensus.cc:740] T 76a7de5cfe774df68279e2e1e7361c6b P 76fb155ade354ee1ba78673e73b28aca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Running, Role: LEADER
I20260709 13:13:55.359735 31697 consensus_queue.cc:260] T 76a7de5cfe774df68279e2e1e7361c6b P 76fb155ade354ee1ba78673e73b28aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:55.360940 31697 raft_consensus.cc:3060] T 76a7de5cfe774df68279e2e1e7361c6b P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:55.364390 31550 raft_consensus.cc:2468] T 76a7de5cfe774df68279e2e1e7361c6b P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 2.
I20260709 13:13:55.365489 32226 leader_election.cc:304] T 76a7de5cfe774df68279e2e1e7361c6b P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, 458d610e8abf4f2ea831ab7bf3576da6; no voters: 
I20260709 13:13:55.366374 32465 raft_consensus.cc:2804] T 76a7de5cfe774df68279e2e1e7361c6b P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:55.367846 32465 raft_consensus.cc:697] T 76a7de5cfe774df68279e2e1e7361c6b P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 LEADER]: Becoming Leader. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Running, Role: LEADER
I20260709 13:13:55.368677 31697 raft_consensus.cc:2468] T 76a7de5cfe774df68279e2e1e7361c6b P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 2.
I20260709 13:13:55.368788 32465 consensus_queue.cc:237] T 76a7de5cfe774df68279e2e1e7361c6b P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:55.375043 32442 raft_consensus.cc:993] T d78bdf917ee94331b91cb3fb308ef2a1 P 76fb155ade354ee1ba78673e73b28aca: : Instructing follower 458d610e8abf4f2ea831ab7bf3576da6 to start an election
I20260709 13:13:55.377480 32428 raft_consensus.cc:1081] T d78bdf917ee94331b91cb3fb308ef2a1 P 76fb155ade354ee1ba78673e73b28aca [term 1 LEADER]: Signalling peer 458d610e8abf4f2ea831ab7bf3576da6 to start an election
I20260709 13:13:55.378957 32273 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d78bdf917ee94331b91cb3fb308ef2a1"
dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
 from {username='slave'} at 127.0.0.1:47200
I20260709 13:13:55.379484 32273 raft_consensus.cc:493] T d78bdf917ee94331b91cb3fb308ef2a1 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:55.379892 32273 raft_consensus.cc:3060] T d78bdf917ee94331b91cb3fb308ef2a1 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:55.382242 31374 catalog_manager.cc:5697] T 76a7de5cfe774df68279e2e1e7361c6b P 458d610e8abf4f2ea831ab7bf3576da6 reported cstate change: term changed from 1 to 2, leader changed from 76fb155ade354ee1ba78673e73b28aca (127.23.140.68) to 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65). New cstate: current_term: 2 leader_uuid: "458d610e8abf4f2ea831ab7bf3576da6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:55.386060 32273 raft_consensus.cc:515] T d78bdf917ee94331b91cb3fb308ef2a1 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:55.387897 32273 leader_election.cc:290] T d78bdf917ee94331b91cb3fb308ef2a1 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 2 election: Requested vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715)
I20260709 13:13:55.388640 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78bdf917ee94331b91cb3fb308ef2a1" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c74453754ee34bea9b231ae318a55a31"
I20260709 13:13:55.389003 31697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78bdf917ee94331b91cb3fb308ef2a1" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "76fb155ade354ee1ba78673e73b28aca"
I20260709 13:13:55.389317 31623 raft_consensus.cc:3060] T d78bdf917ee94331b91cb3fb308ef2a1 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:55.389540 31697 raft_consensus.cc:3055] T d78bdf917ee94331b91cb3fb308ef2a1 P 76fb155ade354ee1ba78673e73b28aca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:55.389920 31697 raft_consensus.cc:740] T d78bdf917ee94331b91cb3fb308ef2a1 P 76fb155ade354ee1ba78673e73b28aca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Running, Role: LEADER
I20260709 13:13:55.390632 31697 consensus_queue.cc:260] T d78bdf917ee94331b91cb3fb308ef2a1 P 76fb155ade354ee1ba78673e73b28aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:55.391865 31697 raft_consensus.cc:3060] T d78bdf917ee94331b91cb3fb308ef2a1 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:55.396381 31623 raft_consensus.cc:2468] T d78bdf917ee94331b91cb3fb308ef2a1 P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 2.
I20260709 13:13:55.397774 32229 leader_election.cc:304] T d78bdf917ee94331b91cb3fb308ef2a1 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, c74453754ee34bea9b231ae318a55a31; no voters: 
I20260709 13:13:55.398586 31697 raft_consensus.cc:2468] T d78bdf917ee94331b91cb3fb308ef2a1 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 2.
I20260709 13:13:55.398663 32465 raft_consensus.cc:2804] T d78bdf917ee94331b91cb3fb308ef2a1 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:55.399585 32465 raft_consensus.cc:697] T d78bdf917ee94331b91cb3fb308ef2a1 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 LEADER]: Becoming Leader. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Running, Role: LEADER
I20260709 13:13:55.400457 32465 consensus_queue.cc:237] T d78bdf917ee94331b91cb3fb308ef2a1 P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:55.408634 31374 catalog_manager.cc:5697] T d78bdf917ee94331b91cb3fb308ef2a1 P 458d610e8abf4f2ea831ab7bf3576da6 reported cstate change: term changed from 1 to 2, leader changed from 76fb155ade354ee1ba78673e73b28aca (127.23.140.68) to 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65). New cstate: current_term: 2 leader_uuid: "458d610e8abf4f2ea831ab7bf3576da6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:55.514114 32428 raft_consensus.cc:993] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P 76fb155ade354ee1ba78673e73b28aca: : Instructing follower 196d972917fe4f85985e3862d40b7596 to start an election
I20260709 13:13:55.515398 32463 raft_consensus.cc:1081] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P 76fb155ade354ee1ba78673e73b28aca [term 1 LEADER]: Signalling peer 196d972917fe4f85985e3862d40b7596 to start an election
I20260709 13:13:55.518303 31548 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0ee7f4cbe2594c5793b2cb27e1dd4b34"
dest_uuid: "196d972917fe4f85985e3862d40b7596"
 from {username='slave'} at 127.0.0.1:43946
I20260709 13:13:55.519411 31548 raft_consensus.cc:493] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:55.519981 31548 raft_consensus.cc:3060] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:55.544333 31548 raft_consensus.cc:515] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:55.549561 31629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee7f4cbe2594c5793b2cb27e1dd4b34" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c74453754ee34bea9b231ae318a55a31"
I20260709 13:13:55.550707 31629 raft_consensus.cc:3060] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:55.551615 31697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee7f4cbe2594c5793b2cb27e1dd4b34" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "76fb155ade354ee1ba78673e73b28aca"
I20260709 13:13:55.552372 31697 raft_consensus.cc:3055] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P 76fb155ade354ee1ba78673e73b28aca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:55.552834 31697 raft_consensus.cc:740] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P 76fb155ade354ee1ba78673e73b28aca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Running, Role: LEADER
I20260709 13:13:55.555846 31697 consensus_queue.cc:260] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P 76fb155ade354ee1ba78673e73b28aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:55.558058 31697 raft_consensus.cc:3060] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:55.560122 31650 debug-util.cc:398] Leaking SignalData structure 0x7b08003ab660 after lost signal to thread 24116
W20260709 13:13:55.562688 31650 debug-util.cc:398] Leaking SignalData structure 0x7b0800356dc0 after lost signal to thread 31412
I20260709 13:13:55.550614 31548 leader_election.cc:290] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 election: Requested vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715)
W20260709 13:13:55.573148 31650 debug-util.cc:398] Leaking SignalData structure 0x7b08000d9ce0 after lost signal to thread 32309
I20260709 13:13:55.589540 31697 raft_consensus.cc:2468] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 196d972917fe4f85985e3862d40b7596 in term 2.
I20260709 13:13:55.591369 31629 raft_consensus.cc:2468] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 196d972917fe4f85985e3862d40b7596 in term 2.
I20260709 13:13:55.592170 31521 leader_election.cc:304] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, 76fb155ade354ee1ba78673e73b28aca; no voters: 
I20260709 13:13:55.593765 32442 raft_consensus.cc:993] T 075b9562a2b547c8aad80c2bae413556 P 76fb155ade354ee1ba78673e73b28aca: : Instructing follower 458d610e8abf4f2ea831ab7bf3576da6 to start an election
I20260709 13:13:55.597225 32442 raft_consensus.cc:1081] T 075b9562a2b547c8aad80c2bae413556 P 76fb155ade354ee1ba78673e73b28aca [term 1 LEADER]: Signalling peer 458d610e8abf4f2ea831ab7bf3576da6 to start an election
I20260709 13:13:55.599426 32453 raft_consensus.cc:2804] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:55.599557 32273 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "075b9562a2b547c8aad80c2bae413556"
dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
 from {username='slave'} at 127.0.0.1:47200
I20260709 13:13:55.600373 32273 raft_consensus.cc:493] T 075b9562a2b547c8aad80c2bae413556 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:55.600786 32273 raft_consensus.cc:3060] T 075b9562a2b547c8aad80c2bae413556 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:55.615159 32273 raft_consensus.cc:515] T 075b9562a2b547c8aad80c2bae413556 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:55.617300 32453 raft_consensus.cc:697] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P 196d972917fe4f85985e3862d40b7596 [term 2 LEADER]: Becoming Leader. State: Replica: 196d972917fe4f85985e3862d40b7596, State: Running, Role: LEADER
I20260709 13:13:55.619292 32453 consensus_queue.cc:237] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P 196d972917fe4f85985e3862d40b7596 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:55.640995 31697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b9562a2b547c8aad80c2bae413556" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "76fb155ade354ee1ba78673e73b28aca"
I20260709 13:13:55.641661 31697 raft_consensus.cc:3055] T 075b9562a2b547c8aad80c2bae413556 P 76fb155ade354ee1ba78673e73b28aca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:55.643384 31697 raft_consensus.cc:740] T 075b9562a2b547c8aad80c2bae413556 P 76fb155ade354ee1ba78673e73b28aca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Running, Role: LEADER
I20260709 13:13:55.644344 31697 consensus_queue.cc:260] T 075b9562a2b547c8aad80c2bae413556 P 76fb155ade354ee1ba78673e73b28aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:55.648662 31697 raft_consensus.cc:3060] T 075b9562a2b547c8aad80c2bae413556 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:55.655556 32273 leader_election.cc:290] T 075b9562a2b547c8aad80c2bae413556 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 2 election: Requested vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:55.657795 31548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075b9562a2b547c8aad80c2bae413556" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "196d972917fe4f85985e3862d40b7596"
I20260709 13:13:55.658568 31548 raft_consensus.cc:3060] T 075b9562a2b547c8aad80c2bae413556 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:55.673113 31552 raft_consensus.cc:1275] T 36bf73ed3df141c889c046ad6902e304 P 196d972917fe4f85985e3862d40b7596 [term 4 FOLLOWER]: Refusing update from remote peer 458d610e8abf4f2ea831ab7bf3576da6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:55.675282 32465 consensus_queue.cc:1048] T 36bf73ed3df141c889c046ad6902e304 P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:55.675976 31697 raft_consensus.cc:2468] T 075b9562a2b547c8aad80c2bae413556 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 2.
I20260709 13:13:55.677577 32229 leader_election.cc:304] T 075b9562a2b547c8aad80c2bae413556 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca; no voters: 
I20260709 13:13:55.681854 32465 raft_consensus.cc:2804] T 075b9562a2b547c8aad80c2bae413556 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:55.683136 32465 raft_consensus.cc:697] T 075b9562a2b547c8aad80c2bae413556 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 LEADER]: Becoming Leader. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Running, Role: LEADER
I20260709 13:13:55.691408 32465 consensus_queue.cc:237] T 075b9562a2b547c8aad80c2bae413556 P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:55.678328 31548 raft_consensus.cc:2468] T 075b9562a2b547c8aad80c2bae413556 P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 2.
I20260709 13:13:55.706723 31374 catalog_manager.cc:5697] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P 196d972917fe4f85985e3862d40b7596 reported cstate change: term changed from 1 to 2, leader changed from 76fb155ade354ee1ba78673e73b28aca (127.23.140.68) to 196d972917fe4f85985e3862d40b7596 (127.23.140.66). New cstate: current_term: 2 leader_uuid: "196d972917fe4f85985e3862d40b7596" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:55.824575 31700 raft_consensus.cc:1275] T 76a7de5cfe774df68279e2e1e7361c6b P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Refusing update from remote peer 458d610e8abf4f2ea831ab7bf3576da6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:55.828565 32461 consensus_queue.cc:1048] T 76a7de5cfe774df68279e2e1e7361c6b P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:13:55.837358 31550 raft_consensus.cc:1275] T dcf07174e49c498f8e19fd005690404b P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Refusing update from remote peer 458d610e8abf4f2ea831ab7bf3576da6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:55.840458 32490 consensus_queue.cc:1048] T dcf07174e49c498f8e19fd005690404b P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:55.847170 31374 catalog_manager.cc:5697] T 075b9562a2b547c8aad80c2bae413556 P 458d610e8abf4f2ea831ab7bf3576da6 reported cstate change: term changed from 1 to 2, leader changed from 76fb155ade354ee1ba78673e73b28aca (127.23.140.68) to 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65). New cstate: current_term: 2 leader_uuid: "458d610e8abf4f2ea831ab7bf3576da6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:55.864367 31698 raft_consensus.cc:1275] T 36bf73ed3df141c889c046ad6902e304 P 76fb155ade354ee1ba78673e73b28aca [term 4 FOLLOWER]: Refusing update from remote peer 458d610e8abf4f2ea831ab7bf3576da6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:55.868103 32489 consensus_queue.cc:1048] T 36bf73ed3df141c889c046ad6902e304 P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:55.883359 31552 raft_consensus.cc:1275] T 76a7de5cfe774df68279e2e1e7361c6b P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Refusing update from remote peer 458d610e8abf4f2ea831ab7bf3576da6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:55.885592 32465 consensus_queue.cc:1048] T 76a7de5cfe774df68279e2e1e7361c6b P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:55.887717 31626 raft_consensus.cc:1275] T dcf07174e49c498f8e19fd005690404b P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Refusing update from remote peer 458d610e8abf4f2ea831ab7bf3576da6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:55.890964 32488 consensus_queue.cc:1048] T dcf07174e49c498f8e19fd005690404b P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:55.933178 31623 raft_consensus.cc:1275] T d78bdf917ee94331b91cb3fb308ef2a1 P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Refusing update from remote peer 458d610e8abf4f2ea831ab7bf3576da6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:55.934715 32488 consensus_queue.cc:1048] T d78bdf917ee94331b91cb3fb308ef2a1 P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:55.978729 31700 raft_consensus.cc:1275] T d78bdf917ee94331b91cb3fb308ef2a1 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Refusing update from remote peer 458d610e8abf4f2ea831ab7bf3576da6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:55.993525 32489 consensus_queue.cc:1048] T d78bdf917ee94331b91cb3fb308ef2a1 P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:56.133994 31697 raft_consensus.cc:1275] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Refusing update from remote peer 196d972917fe4f85985e3862d40b7596: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:56.135803 32484 consensus_queue.cc:1048] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P 196d972917fe4f85985e3862d40b7596 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:56.143505 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:56.163199 31626 raft_consensus.cc:1275] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Refusing update from remote peer 196d972917fe4f85985e3862d40b7596: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:56.170266 31550 raft_consensus.cc:1275] T 075b9562a2b547c8aad80c2bae413556 P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Refusing update from remote peer 458d610e8abf4f2ea831ab7bf3576da6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:56.170256 32450 consensus_queue.cc:1048] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P 196d972917fe4f85985e3862d40b7596 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:56.173318 32489 consensus_queue.cc:1048] T 075b9562a2b547c8aad80c2bae413556 P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:56.223930 31697 raft_consensus.cc:1275] T 075b9562a2b547c8aad80c2bae413556 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Refusing update from remote peer 458d610e8abf4f2ea831ab7bf3576da6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:56.225446 32465 consensus_queue.cc:1048] T 075b9562a2b547c8aad80c2bae413556 P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:56.250150 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:56.311728 32490 raft_consensus.cc:493] T 6038006ca0e344af86fe5febd517c62a P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c74453754ee34bea9b231ae318a55a31)
I20260709 13:13:56.312314 32490 raft_consensus.cc:515] T 6038006ca0e344af86fe5febd517c62a P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:56.314507 32490 leader_election.cc:290] T 6038006ca0e344af86fe5febd517c62a P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:56.316231 31626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6038006ca0e344af86fe5febd517c62a" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:56.317030 31626 raft_consensus.cc:2468] T 6038006ca0e344af86fe5febd517c62a P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 2.
I20260709 13:13:56.318871 32229 leader_election.cc:304] T 6038006ca0e344af86fe5febd517c62a P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, c74453754ee34bea9b231ae318a55a31; no voters: 
I20260709 13:13:56.320545 31548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6038006ca0e344af86fe5febd517c62a" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596" is_pre_election: true
I20260709 13:13:56.321580 31548 raft_consensus.cc:2393] T 6038006ca0e344af86fe5febd517c62a P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 458d610e8abf4f2ea831ab7bf3576da6 in current term 2: Already voted for candidate 196d972917fe4f85985e3862d40b7596 in this term.
I20260709 13:13:56.324028 32489 raft_consensus.cc:2804] T 6038006ca0e344af86fe5febd517c62a P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:56.324609 32489 raft_consensus.cc:493] T 6038006ca0e344af86fe5febd517c62a P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c74453754ee34bea9b231ae318a55a31)
I20260709 13:13:56.325034 32489 raft_consensus.cc:3060] T 6038006ca0e344af86fe5febd517c62a P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:56.327638 31698 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "216111c5962f4b82ae52414985988860"
dest_uuid: "76fb155ade354ee1ba78673e73b28aca"
mode: GRACEFUL
new_leader_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
 from {username='slave'} at 127.0.0.1:50386
I20260709 13:13:56.328469 31698 raft_consensus.cc:606] T 216111c5962f4b82ae52414985988860 P 76fb155ade354ee1ba78673e73b28aca [term 1 LEADER]: Received request to transfer leadership to TS 458d610e8abf4f2ea831ab7bf3576da6
I20260709 13:13:56.340710 31626 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2568dda6664d4363abc4fd891fa48370"
dest_uuid: "c74453754ee34bea9b231ae318a55a31"
mode: GRACEFUL
new_leader_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
 from {username='slave'} at 127.0.0.1:40662
I20260709 13:13:56.343346 31626 raft_consensus.cc:606] T 2568dda6664d4363abc4fd891fa48370 P c74453754ee34bea9b231ae318a55a31 [term 2 LEADER]: Received request to transfer leadership to TS 458d610e8abf4f2ea831ab7bf3576da6
I20260709 13:13:56.347782 32489 raft_consensus.cc:515] T 6038006ca0e344af86fe5febd517c62a P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:56.348758 31697 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a35171dce2e34beeafe34f3e80f18a41"
dest_uuid: "76fb155ade354ee1ba78673e73b28aca"
mode: GRACEFUL
new_leader_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
 from {username='slave'} at 127.0.0.1:50386
I20260709 13:13:56.349449 31697 raft_consensus.cc:606] T a35171dce2e34beeafe34f3e80f18a41 P 76fb155ade354ee1ba78673e73b28aca [term 1 LEADER]: Received request to transfer leadership to TS 458d610e8abf4f2ea831ab7bf3576da6
I20260709 13:13:56.350723 31548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6038006ca0e344af86fe5febd517c62a" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "196d972917fe4f85985e3862d40b7596"
I20260709 13:13:56.351521 31548 raft_consensus.cc:2393] T 6038006ca0e344af86fe5febd517c62a P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 458d610e8abf4f2ea831ab7bf3576da6 in current term 2: Already voted for candidate 196d972917fe4f85985e3862d40b7596 in this term.
I20260709 13:13:56.352671 31697 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b262a50e82034c57a4bfb7da683ff5d1"
dest_uuid: "76fb155ade354ee1ba78673e73b28aca"
mode: GRACEFUL
new_leader_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
 from {username='slave'} at 127.0.0.1:50386
I20260709 13:13:56.353722 31697 raft_consensus.cc:606] T b262a50e82034c57a4bfb7da683ff5d1 P 76fb155ade354ee1ba78673e73b28aca [term 2 LEADER]: Received request to transfer leadership to TS 458d610e8abf4f2ea831ab7bf3576da6
I20260709 13:13:56.354885 32489 leader_election.cc:290] T 6038006ca0e344af86fe5febd517c62a P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 2 election: Requested vote from peers 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:56.356598 31626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6038006ca0e344af86fe5febd517c62a" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31"
I20260709 13:13:56.359819 31629 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cfe1afd9e187451faf5f631e0c2eef00"
dest_uuid: "c74453754ee34bea9b231ae318a55a31"
mode: GRACEFUL
new_leader_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
 from {username='slave'} at 127.0.0.1:40662
I20260709 13:13:56.360448 31629 raft_consensus.cc:606] T cfe1afd9e187451faf5f631e0c2eef00 P c74453754ee34bea9b231ae318a55a31 [term 1 LEADER]: Received request to transfer leadership to TS 458d610e8abf4f2ea831ab7bf3576da6
I20260709 13:13:56.363092 24113 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:13:56.364888 24113 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:56.371513 32460 raft_consensus.cc:993] T 2568dda6664d4363abc4fd891fa48370 P c74453754ee34bea9b231ae318a55a31: : Instructing follower 458d610e8abf4f2ea831ab7bf3576da6 to start an election
I20260709 13:13:56.371799 31626 raft_consensus.cc:2468] T 6038006ca0e344af86fe5febd517c62a P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 2.
I20260709 13:13:56.372360 32449 raft_consensus.cc:1081] T 2568dda6664d4363abc4fd891fa48370 P c74453754ee34bea9b231ae318a55a31 [term 2 LEADER]: Signalling peer 458d610e8abf4f2ea831ab7bf3576da6 to start an election
I20260709 13:13:56.373239 32229 leader_election.cc:304] T 6038006ca0e344af86fe5febd517c62a P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, c74453754ee34bea9b231ae318a55a31; no voters: 196d972917fe4f85985e3862d40b7596
I20260709 13:13:56.374577 32273 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2568dda6664d4363abc4fd891fa48370"
dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
 from {username='slave'} at 127.0.0.1:47214
I20260709 13:13:56.375097 32273 raft_consensus.cc:493] T 2568dda6664d4363abc4fd891fa48370 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:56.375393 32273 raft_consensus.cc:3060] T 2568dda6664d4363abc4fd891fa48370 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:56.380270 32273 raft_consensus.cc:515] T 2568dda6664d4363abc4fd891fa48370 P 458d610e8abf4f2ea831ab7bf3576da6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:56.380905 32489 raft_consensus.cc:2804] T 6038006ca0e344af86fe5febd517c62a P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:56.381672 32489 raft_consensus.cc:697] T 6038006ca0e344af86fe5febd517c62a P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 LEADER]: Becoming Leader. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Running, Role: LEADER
I20260709 13:13:56.382645 32489 consensus_queue.cc:237] T 6038006ca0e344af86fe5febd517c62a P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:56.383203 31550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2568dda6664d4363abc4fd891fa48370" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "196d972917fe4f85985e3862d40b7596"
I20260709 13:13:56.383819 31550 raft_consensus.cc:3060] T 2568dda6664d4363abc4fd891fa48370 P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:56.387264 32273 leader_election.cc:290] T 2568dda6664d4363abc4fd891fa48370 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 3 election: Requested vote from peers 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:56.390185 31626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2568dda6664d4363abc4fd891fa48370" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c74453754ee34bea9b231ae318a55a31"
I20260709 13:13:56.390905 31626 raft_consensus.cc:3055] T 2568dda6664d4363abc4fd891fa48370 P c74453754ee34bea9b231ae318a55a31 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:56.391280 31626 raft_consensus.cc:740] T 2568dda6664d4363abc4fd891fa48370 P c74453754ee34bea9b231ae318a55a31 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Running, Role: LEADER
I20260709 13:13:56.392283 31626 consensus_queue.cc:260] T 2568dda6664d4363abc4fd891fa48370 P c74453754ee34bea9b231ae318a55a31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:56.393460 31550 raft_consensus.cc:2468] T 2568dda6664d4363abc4fd891fa48370 P 196d972917fe4f85985e3862d40b7596 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 3.
I20260709 13:13:56.393988 31626 raft_consensus.cc:3060] T 2568dda6664d4363abc4fd891fa48370 P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:56.397490 32226 leader_election.cc:304] T 2568dda6664d4363abc4fd891fa48370 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, 458d610e8abf4f2ea831ab7bf3576da6; no voters: 
I20260709 13:13:56.398875 32490 raft_consensus.cc:2804] T 2568dda6664d4363abc4fd891fa48370 P 458d610e8abf4f2ea831ab7bf3576da6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:56.399349 32490 raft_consensus.cc:697] T 2568dda6664d4363abc4fd891fa48370 P 458d610e8abf4f2ea831ab7bf3576da6 [term 3 LEADER]: Becoming Leader. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Running, Role: LEADER
I20260709 13:13:56.400290 32490 consensus_queue.cc:237] T 2568dda6664d4363abc4fd891fa48370 P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:56.402841 31626 raft_consensus.cc:2468] T 2568dda6664d4363abc4fd891fa48370 P c74453754ee34bea9b231ae318a55a31 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 3.
I20260709 13:13:56.411015 31378 catalog_manager.cc:5697] T 6038006ca0e344af86fe5febd517c62a P 458d610e8abf4f2ea831ab7bf3576da6 reported cstate change: term changed from 1 to 2, leader changed from c74453754ee34bea9b231ae318a55a31 (127.23.140.67) to 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65). New cstate: current_term: 2 leader_uuid: "458d610e8abf4f2ea831ab7bf3576da6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:56.430768 31378 catalog_manager.cc:5697] T 2568dda6664d4363abc4fd891fa48370 P 458d610e8abf4f2ea831ab7bf3576da6 reported cstate change: term changed from 2 to 3, leader changed from c74453754ee34bea9b231ae318a55a31 (127.23.140.67) to 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65). New cstate: current_term: 3 leader_uuid: "458d610e8abf4f2ea831ab7bf3576da6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:56.581940 32453 raft_consensus.cc:493] T 6038006ca0e344af86fe5febd517c62a P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.582413 32453 raft_consensus.cc:515] T 6038006ca0e344af86fe5febd517c62a P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:56.584555 32453 leader_election.cc:290] T 6038006ca0e344af86fe5febd517c62a P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:56.585072 31626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6038006ca0e344af86fe5febd517c62a" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31" is_pre_election: true
I20260709 13:13:56.584848 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6038006ca0e344af86fe5febd517c62a" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6" is_pre_election: true
I20260709 13:13:56.585781 31626 raft_consensus.cc:2468] T 6038006ca0e344af86fe5febd517c62a P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 196d972917fe4f85985e3862d40b7596 in term 2.
I20260709 13:13:56.586917 31521 leader_election.cc:304] T 6038006ca0e344af86fe5febd517c62a P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, c74453754ee34bea9b231ae318a55a31; no voters: 458d610e8abf4f2ea831ab7bf3576da6
I20260709 13:13:56.587625 32453 raft_consensus.cc:2804] T 6038006ca0e344af86fe5febd517c62a P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:56.587980 32453 raft_consensus.cc:493] T 6038006ca0e344af86fe5febd517c62a P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:56.588533 32453 raft_consensus.cc:3060] T 6038006ca0e344af86fe5febd517c62a P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:56.625833 32453 raft_consensus.cc:515] T 6038006ca0e344af86fe5febd517c62a P 196d972917fe4f85985e3862d40b7596 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:56.628136 32453 leader_election.cc:290] T 6038006ca0e344af86fe5febd517c62a P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 3 election: Requested vote from peers 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:56.629522 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6038006ca0e344af86fe5febd517c62a" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
I20260709 13:13:56.630366 31626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6038006ca0e344af86fe5febd517c62a" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c74453754ee34bea9b231ae318a55a31"
I20260709 13:13:56.630973 31626 raft_consensus.cc:3060] T 6038006ca0e344af86fe5febd517c62a P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:56.636154 31626 raft_consensus.cc:2468] T 6038006ca0e344af86fe5febd517c62a P c74453754ee34bea9b231ae318a55a31 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 196d972917fe4f85985e3862d40b7596 in term 3.
I20260709 13:13:56.637138 31521 leader_election.cc:304] T 6038006ca0e344af86fe5febd517c62a P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, c74453754ee34bea9b231ae318a55a31; no voters: 458d610e8abf4f2ea831ab7bf3576da6
I20260709 13:13:56.638120 32453 raft_consensus.cc:2804] T 6038006ca0e344af86fe5febd517c62a P 196d972917fe4f85985e3862d40b7596 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:56.638643 32453 raft_consensus.cc:697] T 6038006ca0e344af86fe5febd517c62a P 196d972917fe4f85985e3862d40b7596 [term 3 LEADER]: Becoming Leader. State: Replica: 196d972917fe4f85985e3862d40b7596, State: Running, Role: LEADER
I20260709 13:13:56.639523 32453 consensus_queue.cc:237] T 6038006ca0e344af86fe5febd517c62a P 196d972917fe4f85985e3862d40b7596 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:56.674365 31378 catalog_manager.cc:5697] T 6038006ca0e344af86fe5febd517c62a P 196d972917fe4f85985e3862d40b7596 reported cstate change: term changed from 2 to 3, leader changed from 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65) to 196d972917fe4f85985e3862d40b7596 (127.23.140.66). New cstate: current_term: 3 leader_uuid: "196d972917fe4f85985e3862d40b7596" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:56.741153 32428 raft_consensus.cc:993] T 216111c5962f4b82ae52414985988860 P 76fb155ade354ee1ba78673e73b28aca: : Instructing follower 458d610e8abf4f2ea831ab7bf3576da6 to start an election
I20260709 13:13:56.741864 32462 raft_consensus.cc:1081] T 216111c5962f4b82ae52414985988860 P 76fb155ade354ee1ba78673e73b28aca [term 1 LEADER]: Signalling peer 458d610e8abf4f2ea831ab7bf3576da6 to start an election
I20260709 13:13:56.743709 32277 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "216111c5962f4b82ae52414985988860"
dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
 from {username='slave'} at 127.0.0.1:47200
I20260709 13:13:56.744334 32277 raft_consensus.cc:493] T 216111c5962f4b82ae52414985988860 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:56.744683 32277 raft_consensus.cc:3060] T 216111c5962f4b82ae52414985988860 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:56.752640 32277 raft_consensus.cc:515] T 216111c5962f4b82ae52414985988860 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:56.754494 32277 leader_election.cc:290] T 216111c5962f4b82ae52414985988860 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 2 election: Requested vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:56.755506 31550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216111c5962f4b82ae52414985988860" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "196d972917fe4f85985e3862d40b7596"
I20260709 13:13:56.756219 31550 raft_consensus.cc:3060] T 216111c5962f4b82ae52414985988860 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:56.756771 31697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216111c5962f4b82ae52414985988860" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "76fb155ade354ee1ba78673e73b28aca"
I20260709 13:13:56.761937 32428 raft_consensus.cc:993] T b262a50e82034c57a4bfb7da683ff5d1 P 76fb155ade354ee1ba78673e73b28aca: : Instructing follower 458d610e8abf4f2ea831ab7bf3576da6 to start an election
I20260709 13:13:56.762466 32428 raft_consensus.cc:1081] T b262a50e82034c57a4bfb7da683ff5d1 P 76fb155ade354ee1ba78673e73b28aca [term 2 LEADER]: Signalling peer 458d610e8abf4f2ea831ab7bf3576da6 to start an election
I20260709 13:13:56.764111 32273 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b262a50e82034c57a4bfb7da683ff5d1"
dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
 from {username='slave'} at 127.0.0.1:47200
I20260709 13:13:56.764678 32273 raft_consensus.cc:493] T b262a50e82034c57a4bfb7da683ff5d1 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:56.765022 32273 raft_consensus.cc:3060] T b262a50e82034c57a4bfb7da683ff5d1 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:56.761893 31697 raft_consensus.cc:3055] T 216111c5962f4b82ae52414985988860 P 76fb155ade354ee1ba78673e73b28aca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:56.766093 31697 raft_consensus.cc:740] T 216111c5962f4b82ae52414985988860 P 76fb155ade354ee1ba78673e73b28aca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Running, Role: LEADER
I20260709 13:13:56.766911 31697 consensus_queue.cc:260] T 216111c5962f4b82ae52414985988860 P 76fb155ade354ee1ba78673e73b28aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:56.768492 31697 raft_consensus.cc:3060] T 216111c5962f4b82ae52414985988860 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:56.776701 32273 raft_consensus.cc:515] T b262a50e82034c57a4bfb7da683ff5d1 P 458d610e8abf4f2ea831ab7bf3576da6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:56.777216 31550 raft_consensus.cc:2468] T 216111c5962f4b82ae52414985988860 P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 2.
I20260709 13:13:56.778750 32226 leader_election.cc:304] T 216111c5962f4b82ae52414985988860 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, 458d610e8abf4f2ea831ab7bf3576da6; no voters: 
I20260709 13:13:56.778925 32273 leader_election.cc:290] T b262a50e82034c57a4bfb7da683ff5d1 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 3 election: Requested vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715)
I20260709 13:13:56.779578 32489 raft_consensus.cc:2804] T 216111c5962f4b82ae52414985988860 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:56.780092 32489 raft_consensus.cc:697] T 216111c5962f4b82ae52414985988860 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 LEADER]: Becoming Leader. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Running, Role: LEADER
I20260709 13:13:56.780455 31698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b262a50e82034c57a4bfb7da683ff5d1" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "76fb155ade354ee1ba78673e73b28aca"
I20260709 13:13:56.780715 31697 raft_consensus.cc:2468] T 216111c5962f4b82ae52414985988860 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 2.
I20260709 13:13:56.781107 32489 consensus_queue.cc:237] T 216111c5962f4b82ae52414985988860 P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:56.781167 31698 raft_consensus.cc:3055] T b262a50e82034c57a4bfb7da683ff5d1 P 76fb155ade354ee1ba78673e73b28aca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:56.785231 31698 raft_consensus.cc:740] T b262a50e82034c57a4bfb7da683ff5d1 P 76fb155ade354ee1ba78673e73b28aca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Running, Role: LEADER
I20260709 13:13:56.786266 31698 consensus_queue.cc:260] T b262a50e82034c57a4bfb7da683ff5d1 P 76fb155ade354ee1ba78673e73b28aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:56.787320 31626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b262a50e82034c57a4bfb7da683ff5d1" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c74453754ee34bea9b231ae318a55a31"
I20260709 13:13:56.787569 31698 raft_consensus.cc:3060] T b262a50e82034c57a4bfb7da683ff5d1 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:56.789932 31626 raft_consensus.cc:3060] T b262a50e82034c57a4bfb7da683ff5d1 P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:56.796085 31698 raft_consensus.cc:2468] T b262a50e82034c57a4bfb7da683ff5d1 P 76fb155ade354ee1ba78673e73b28aca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 3.
I20260709 13:13:56.800060 32229 leader_election.cc:304] T b262a50e82034c57a4bfb7da683ff5d1 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca; no voters: 
I20260709 13:13:56.802621 32489 raft_consensus.cc:2804] T b262a50e82034c57a4bfb7da683ff5d1 P 458d610e8abf4f2ea831ab7bf3576da6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:56.809486 31548 raft_consensus.cc:1240] T 6038006ca0e344af86fe5febd517c62a P 196d972917fe4f85985e3862d40b7596 [term 3 LEADER]: Rejecting Update request from peer 458d610e8abf4f2ea831ab7bf3576da6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:56.809935 31378 catalog_manager.cc:5697] T 216111c5962f4b82ae52414985988860 P 458d610e8abf4f2ea831ab7bf3576da6 reported cstate change: term changed from 1 to 2, leader changed from 76fb155ade354ee1ba78673e73b28aca (127.23.140.68) to 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65). New cstate: current_term: 2 leader_uuid: "458d610e8abf4f2ea831ab7bf3576da6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:56.810657 32489 raft_consensus.cc:697] T b262a50e82034c57a4bfb7da683ff5d1 P 458d610e8abf4f2ea831ab7bf3576da6 [term 3 LEADER]: Becoming Leader. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Running, Role: LEADER
I20260709 13:13:56.811758 32489 consensus_queue.cc:237] T b262a50e82034c57a4bfb7da683ff5d1 P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:56.815877 32465 consensus_queue.cc:1059] T 6038006ca0e344af86fe5febd517c62a P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:56.819057 31626 raft_consensus.cc:2468] T b262a50e82034c57a4bfb7da683ff5d1 P c74453754ee34bea9b231ae318a55a31 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 3.
I20260709 13:13:56.826175 32428 raft_consensus.cc:993] T a35171dce2e34beeafe34f3e80f18a41 P 76fb155ade354ee1ba78673e73b28aca: : Instructing follower 458d610e8abf4f2ea831ab7bf3576da6 to start an election
I20260709 13:13:56.826603 32428 raft_consensus.cc:1081] T a35171dce2e34beeafe34f3e80f18a41 P 76fb155ade354ee1ba78673e73b28aca [term 1 LEADER]: Signalling peer 458d610e8abf4f2ea831ab7bf3576da6 to start an election
I20260709 13:13:56.829846 32273 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a35171dce2e34beeafe34f3e80f18a41"
dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
 from {username='slave'} at 127.0.0.1:47200
I20260709 13:13:56.830457 32273 raft_consensus.cc:493] T a35171dce2e34beeafe34f3e80f18a41 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:56.830871 32273 raft_consensus.cc:3060] T a35171dce2e34beeafe34f3e80f18a41 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:56.837359 32465 consensus_queue.cc:1243] T 6038006ca0e344af86fe5febd517c62a P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Peer 196d972917fe4f85985e3862d40b7596 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:13:56.838127 32273 raft_consensus.cc:515] T a35171dce2e34beeafe34f3e80f18a41 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:56.843627 32490 raft_consensus.cc:3055] T 6038006ca0e344af86fe5febd517c62a P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:56.834578 31378 catalog_manager.cc:5697] T b262a50e82034c57a4bfb7da683ff5d1 P 458d610e8abf4f2ea831ab7bf3576da6 reported cstate change: term changed from 2 to 3, leader changed from 76fb155ade354ee1ba78673e73b28aca (127.23.140.68) to 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65). New cstate: current_term: 3 leader_uuid: "458d610e8abf4f2ea831ab7bf3576da6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:56.844053 32490 raft_consensus.cc:740] T 6038006ca0e344af86fe5febd517c62a P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Running, Role: LEADER
I20260709 13:13:56.844511 32273 leader_election.cc:290] T a35171dce2e34beeafe34f3e80f18a41 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 2 election: Requested vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:56.848016 31697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35171dce2e34beeafe34f3e80f18a41" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "76fb155ade354ee1ba78673e73b28aca"
I20260709 13:13:56.848680 31697 raft_consensus.cc:3055] T a35171dce2e34beeafe34f3e80f18a41 P 76fb155ade354ee1ba78673e73b28aca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:56.845046 32490 consensus_queue.cc:260] T 6038006ca0e344af86fe5febd517c62a P 458d610e8abf4f2ea831ab7bf3576da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:56.848959 31697 raft_consensus.cc:740] T a35171dce2e34beeafe34f3e80f18a41 P 76fb155ade354ee1ba78673e73b28aca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Running, Role: LEADER
I20260709 13:13:56.849713 32490 raft_consensus.cc:3060] T 6038006ca0e344af86fe5febd517c62a P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:56.845492 31548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35171dce2e34beeafe34f3e80f18a41" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "196d972917fe4f85985e3862d40b7596"
I20260709 13:13:56.853183 31548 raft_consensus.cc:3060] T a35171dce2e34beeafe34f3e80f18a41 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:56.849730 31697 consensus_queue.cc:260] T a35171dce2e34beeafe34f3e80f18a41 P 76fb155ade354ee1ba78673e73b28aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:56.855177 31697 raft_consensus.cc:3060] T a35171dce2e34beeafe34f3e80f18a41 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:56.875432 31697 raft_consensus.cc:2468] T a35171dce2e34beeafe34f3e80f18a41 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 2.
I20260709 13:13:56.876011 32460 raft_consensus.cc:993] T cfe1afd9e187451faf5f631e0c2eef00 P c74453754ee34bea9b231ae318a55a31: : Instructing follower 458d610e8abf4f2ea831ab7bf3576da6 to start an election
I20260709 13:13:56.876595 32460 raft_consensus.cc:1081] T cfe1afd9e187451faf5f631e0c2eef00 P c74453754ee34bea9b231ae318a55a31 [term 1 LEADER]: Signalling peer 458d610e8abf4f2ea831ab7bf3576da6 to start an election
I20260709 13:13:56.876564 32229 leader_election.cc:304] T a35171dce2e34beeafe34f3e80f18a41 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca; no voters: 
I20260709 13:13:56.877810 32516 raft_consensus.cc:2804] T a35171dce2e34beeafe34f3e80f18a41 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:56.879504 32516 raft_consensus.cc:697] T a35171dce2e34beeafe34f3e80f18a41 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 LEADER]: Becoming Leader. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Running, Role: LEADER
I20260709 13:13:56.880618 32273 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cfe1afd9e187451faf5f631e0c2eef00"
dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
 from {username='slave'} at 127.0.0.1:47214
I20260709 13:13:56.880517 32516 consensus_queue.cc:237] T a35171dce2e34beeafe34f3e80f18a41 P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:56.881229 32273 raft_consensus.cc:493] T cfe1afd9e187451faf5f631e0c2eef00 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:56.881642 32273 raft_consensus.cc:3060] T cfe1afd9e187451faf5f631e0c2eef00 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:56.893121 32273 raft_consensus.cc:515] T cfe1afd9e187451faf5f631e0c2eef00 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:56.897534 31550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe1afd9e187451faf5f631e0c2eef00" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "196d972917fe4f85985e3862d40b7596"
I20260709 13:13:56.898139 31550 raft_consensus.cc:3060] T cfe1afd9e187451faf5f631e0c2eef00 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:56.906985 31550 raft_consensus.cc:2468] T cfe1afd9e187451faf5f631e0c2eef00 P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 2.
I20260709 13:13:56.908128 32226 leader_election.cc:304] T cfe1afd9e187451faf5f631e0c2eef00 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, 458d610e8abf4f2ea831ab7bf3576da6; no voters: 
I20260709 13:13:56.909090 32490 raft_consensus.cc:2804] T cfe1afd9e187451faf5f631e0c2eef00 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:56.909591 32490 raft_consensus.cc:697] T cfe1afd9e187451faf5f631e0c2eef00 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 LEADER]: Becoming Leader. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Running, Role: LEADER
I20260709 13:13:56.910517 32490 consensus_queue.cc:237] T cfe1afd9e187451faf5f631e0c2eef00 P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:56.910959 31548 raft_consensus.cc:2468] T a35171dce2e34beeafe34f3e80f18a41 P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 2.
I20260709 13:13:56.916627 31626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe1afd9e187451faf5f631e0c2eef00" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c74453754ee34bea9b231ae318a55a31"
I20260709 13:13:56.917183 31626 raft_consensus.cc:3055] T cfe1afd9e187451faf5f631e0c2eef00 P c74453754ee34bea9b231ae318a55a31 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:56.917479 31626 raft_consensus.cc:740] T cfe1afd9e187451faf5f631e0c2eef00 P c74453754ee34bea9b231ae318a55a31 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Running, Role: LEADER
I20260709 13:13:56.918358 31626 consensus_queue.cc:260] T cfe1afd9e187451faf5f631e0c2eef00 P c74453754ee34bea9b231ae318a55a31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } }
I20260709 13:13:56.919217 32273 leader_election.cc:290] T cfe1afd9e187451faf5f631e0c2eef00 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 2 election: Requested vote from peers 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:56.919607 31626 raft_consensus.cc:3060] T cfe1afd9e187451faf5f631e0c2eef00 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:56.936735 31378 catalog_manager.cc:5697] T a35171dce2e34beeafe34f3e80f18a41 P 458d610e8abf4f2ea831ab7bf3576da6 reported cstate change: term changed from 1 to 2, leader changed from 76fb155ade354ee1ba78673e73b28aca (127.23.140.68) to 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65). New cstate: current_term: 2 leader_uuid: "458d610e8abf4f2ea831ab7bf3576da6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:56.939639 31626 raft_consensus.cc:2468] T cfe1afd9e187451faf5f631e0c2eef00 P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 2.
I20260709 13:13:56.955370 31378 catalog_manager.cc:5697] T cfe1afd9e187451faf5f631e0c2eef00 P 458d610e8abf4f2ea831ab7bf3576da6 reported cstate change: term changed from 1 to 2, leader changed from c74453754ee34bea9b231ae318a55a31 (127.23.140.67) to 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65). New cstate: current_term: 2 leader_uuid: "458d610e8abf4f2ea831ab7bf3576da6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:57.011255 31548 raft_consensus.cc:1275] T 2568dda6664d4363abc4fd891fa48370 P 196d972917fe4f85985e3862d40b7596 [term 3 FOLLOWER]: Refusing update from remote peer 458d610e8abf4f2ea831ab7bf3576da6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:57.012782 32490 consensus_queue.cc:1048] T 2568dda6664d4363abc4fd891fa48370 P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:57.024870 31626 raft_consensus.cc:1275] T 2568dda6664d4363abc4fd891fa48370 P c74453754ee34bea9b231ae318a55a31 [term 3 FOLLOWER]: Refusing update from remote peer 458d610e8abf4f2ea831ab7bf3576da6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:57.026993 32465 consensus_queue.cc:1048] T 2568dda6664d4363abc4fd891fa48370 P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:57.055420 32273 raft_consensus.cc:1275] T 6038006ca0e344af86fe5febd517c62a P 458d610e8abf4f2ea831ab7bf3576da6 [term 3 FOLLOWER]: Refusing update from remote peer 196d972917fe4f85985e3862d40b7596: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:13:57.055794 32273 pending_rounds.cc:85] T 6038006ca0e344af86fe5febd517c62a P 458d610e8abf4f2ea831ab7bf3576da6: Aborting all ops after (but not including) 1
I20260709 13:13:57.056008 32273 pending_rounds.cc:107] T 6038006ca0e344af86fe5febd517c62a P 458d610e8abf4f2ea831ab7bf3576da6: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:13:57.056296 32273 raft_consensus.cc:2889] T 6038006ca0e344af86fe5febd517c62a P 458d610e8abf4f2ea831ab7bf3576da6 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:57.110890 32484 consensus_queue.cc:1048] T 6038006ca0e344af86fe5febd517c62a P 196d972917fe4f85985e3862d40b7596 [LEADER]: Connected to new peer: Peer: permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:13:57.168995 31520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:37919, user_credentials={real_user=slave}} blocked reactor thread for 50342.2us
W20260709 13:13:57.169770 31595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:45715, user_credentials={real_user=slave}} blocked reactor thread for 63720.7us
W20260709 13:13:57.217454 31594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:37919, user_credentials={real_user=slave}} blocked reactor thread for 72036.8us
I20260709 13:13:57.219893 31629 raft_consensus.cc:1275] T 6038006ca0e344af86fe5febd517c62a P c74453754ee34bea9b231ae318a55a31 [term 3 FOLLOWER]: Refusing update from remote peer 196d972917fe4f85985e3862d40b7596: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:57.249522 31698 raft_consensus.cc:1275] T 216111c5962f4b82ae52414985988860 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Refusing update from remote peer 458d610e8abf4f2ea831ab7bf3576da6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:57.254166 32490 consensus_queue.cc:1048] T 216111c5962f4b82ae52414985988860 P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:57.244536 32453 consensus_queue.cc:1048] T 6038006ca0e344af86fe5febd517c62a P 196d972917fe4f85985e3862d40b7596 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
W20260709 13:13:57.277050 31595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.68:45715, user_credentials={real_user=slave}} blocked reactor thread for 74166.8us
I20260709 13:13:57.312227 31548 raft_consensus.cc:1275] T 216111c5962f4b82ae52414985988860 P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Refusing update from remote peer 458d610e8abf4f2ea831ab7bf3576da6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:57.313704 32465 consensus_queue.cc:1048] T 216111c5962f4b82ae52414985988860 P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:57.342782 31629 raft_consensus.cc:1275] T cfe1afd9e187451faf5f631e0c2eef00 P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Refusing update from remote peer 458d610e8abf4f2ea831ab7bf3576da6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:57.344127 32465 consensus_queue.cc:1048] T cfe1afd9e187451faf5f631e0c2eef00 P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:57.363449 31548 raft_consensus.cc:1275] T cfe1afd9e187451faf5f631e0c2eef00 P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Refusing update from remote peer 458d610e8abf4f2ea831ab7bf3576da6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:57.364995 32516 consensus_queue.cc:1048] T cfe1afd9e187451faf5f631e0c2eef00 P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:57.366446 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:57.382496 31629 raft_consensus.cc:1275] T b262a50e82034c57a4bfb7da683ff5d1 P c74453754ee34bea9b231ae318a55a31 [term 3 FOLLOWER]: Refusing update from remote peer 458d610e8abf4f2ea831ab7bf3576da6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:57.383805 32516 consensus_queue.cc:1048] T b262a50e82034c57a4bfb7da683ff5d1 P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:57.395310 31700 raft_consensus.cc:1275] T b262a50e82034c57a4bfb7da683ff5d1 P 76fb155ade354ee1ba78673e73b28aca [term 3 FOLLOWER]: Refusing update from remote peer 458d610e8abf4f2ea831ab7bf3576da6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:57.397797 32489 consensus_queue.cc:1048] T b262a50e82034c57a4bfb7da683ff5d1 P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:57.451630 31700 raft_consensus.cc:1275] T a35171dce2e34beeafe34f3e80f18a41 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Refusing update from remote peer 458d610e8abf4f2ea831ab7bf3576da6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:57.459267 32516 consensus_queue.cc:1048] T a35171dce2e34beeafe34f3e80f18a41 P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:57.482519 31548 raft_consensus.cc:1275] T a35171dce2e34beeafe34f3e80f18a41 P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Refusing update from remote peer 458d610e8abf4f2ea831ab7bf3576da6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:57.484161 32465 consensus_queue.cc:1048] T a35171dce2e34beeafe34f3e80f18a41 P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:57.537552 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:57.574496 31626 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f01040b42e14f0db6bcd06319237ddb"
dest_uuid: "c74453754ee34bea9b231ae318a55a31"
mode: GRACEFUL
new_leader_uuid: "76fb155ade354ee1ba78673e73b28aca"
 from {username='slave'} at 127.0.0.1:40662
I20260709 13:13:57.575100 31626 raft_consensus.cc:606] T 0f01040b42e14f0db6bcd06319237ddb P c74453754ee34bea9b231ae318a55a31 [term 1 LEADER]: Received request to transfer leadership to TS 76fb155ade354ee1ba78673e73b28aca
I20260709 13:13:57.577955 31626 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e09c2945641463e91365b4826cc47e3"
dest_uuid: "c74453754ee34bea9b231ae318a55a31"
mode: GRACEFUL
new_leader_uuid: "196d972917fe4f85985e3862d40b7596"
 from {username='slave'} at 127.0.0.1:40662
I20260709 13:13:57.578838 31626 raft_consensus.cc:606] T 3e09c2945641463e91365b4826cc47e3 P c74453754ee34bea9b231ae318a55a31 [term 1 LEADER]: Received request to transfer leadership to TS 196d972917fe4f85985e3862d40b7596
I20260709 13:13:57.582257 31629 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ddbfc15d5bf24708a4268dfa206ede07"
dest_uuid: "c74453754ee34bea9b231ae318a55a31"
mode: GRACEFUL
new_leader_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
 from {username='slave'} at 127.0.0.1:40662
I20260709 13:13:57.582818 31629 raft_consensus.cc:606] T ddbfc15d5bf24708a4268dfa206ede07 P c74453754ee34bea9b231ae318a55a31 [term 1 LEADER]: Received request to transfer leadership to TS 458d610e8abf4f2ea831ab7bf3576da6
I20260709 13:13:57.586231 31629 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee6c632286174388ab5e7bfb2ae40078"
dest_uuid: "c74453754ee34bea9b231ae318a55a31"
mode: GRACEFUL
new_leader_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
 from {username='slave'} at 127.0.0.1:40662
I20260709 13:13:57.586668 31629 raft_consensus.cc:606] T ee6c632286174388ab5e7bfb2ae40078 P c74453754ee34bea9b231ae318a55a31 [term 2 LEADER]: Received request to transfer leadership to TS 458d610e8abf4f2ea831ab7bf3576da6
I20260709 13:13:57.588820 31629 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fb97ca15f56b46dd846db7b0ff156a32"
dest_uuid: "c74453754ee34bea9b231ae318a55a31"
mode: GRACEFUL
new_leader_uuid: "196d972917fe4f85985e3862d40b7596"
 from {username='slave'} at 127.0.0.1:40662
I20260709 13:13:57.589274 31629 raft_consensus.cc:606] T fb97ca15f56b46dd846db7b0ff156a32 P c74453754ee34bea9b231ae318a55a31 [term 2 LEADER]: Received request to transfer leadership to TS 196d972917fe4f85985e3862d40b7596
I20260709 13:13:57.590302 24113 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:13:57.591974 24113 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:57.594102 32528 raft_consensus.cc:993] T 0f01040b42e14f0db6bcd06319237ddb P c74453754ee34bea9b231ae318a55a31: : Instructing follower 76fb155ade354ee1ba78673e73b28aca to start an election
I20260709 13:13:57.594677 32528 raft_consensus.cc:1081] T 0f01040b42e14f0db6bcd06319237ddb P c74453754ee34bea9b231ae318a55a31 [term 1 LEADER]: Signalling peer 76fb155ade354ee1ba78673e73b28aca to start an election
I20260709 13:13:57.600967 31700 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f01040b42e14f0db6bcd06319237ddb"
dest_uuid: "76fb155ade354ee1ba78673e73b28aca"
 from {username='slave'} at 127.0.0.1:53316
I20260709 13:13:57.601606 31700 raft_consensus.cc:493] T 0f01040b42e14f0db6bcd06319237ddb P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:57.602025 31700 raft_consensus.cc:3060] T 0f01040b42e14f0db6bcd06319237ddb P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:57.610718 31700 raft_consensus.cc:515] T 0f01040b42e14f0db6bcd06319237ddb P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:57.614926 31550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f01040b42e14f0db6bcd06319237ddb" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "196d972917fe4f85985e3862d40b7596"
I20260709 13:13:57.615521 31550 raft_consensus.cc:3060] T 0f01040b42e14f0db6bcd06319237ddb P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:57.615521 31700 leader_election.cc:290] T 0f01040b42e14f0db6bcd06319237ddb P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 2 election: Requested vote from peers 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431), c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791)
I20260709 13:13:57.616672 31629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f01040b42e14f0db6bcd06319237ddb" candidate_uuid: "76fb155ade354ee1ba78673e73b28aca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c74453754ee34bea9b231ae318a55a31"
I20260709 13:13:57.617704 31629 raft_consensus.cc:3055] T 0f01040b42e14f0db6bcd06319237ddb P c74453754ee34bea9b231ae318a55a31 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:57.618040 31629 raft_consensus.cc:740] T 0f01040b42e14f0db6bcd06319237ddb P c74453754ee34bea9b231ae318a55a31 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Running, Role: LEADER
I20260709 13:13:57.618818 31629 consensus_queue.cc:260] T 0f01040b42e14f0db6bcd06319237ddb P c74453754ee34bea9b231ae318a55a31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:57.620131 31629 raft_consensus.cc:3060] T 0f01040b42e14f0db6bcd06319237ddb P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:57.621101 31550 raft_consensus.cc:2468] T 0f01040b42e14f0db6bcd06319237ddb P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 2.
I20260709 13:13:57.622198 31666 leader_election.cc:304] T 0f01040b42e14f0db6bcd06319237ddb P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, 76fb155ade354ee1ba78673e73b28aca; no voters: 
I20260709 13:13:57.622843 32428 raft_consensus.cc:2804] T 0f01040b42e14f0db6bcd06319237ddb P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:57.623261 32428 raft_consensus.cc:697] T 0f01040b42e14f0db6bcd06319237ddb P 76fb155ade354ee1ba78673e73b28aca [term 2 LEADER]: Becoming Leader. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Running, Role: LEADER
I20260709 13:13:57.624003 32428 consensus_queue.cc:237] T 0f01040b42e14f0db6bcd06319237ddb P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:57.628683 31629 raft_consensus.cc:2468] T 0f01040b42e14f0db6bcd06319237ddb P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76fb155ade354ee1ba78673e73b28aca in term 2.
I20260709 13:13:57.636464 31378 catalog_manager.cc:5697] T 0f01040b42e14f0db6bcd06319237ddb P 76fb155ade354ee1ba78673e73b28aca reported cstate change: term changed from 1 to 2, leader changed from c74453754ee34bea9b231ae318a55a31 (127.23.140.67) to 76fb155ade354ee1ba78673e73b28aca (127.23.140.68). New cstate: current_term: 2 leader_uuid: "76fb155ade354ee1ba78673e73b28aca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:57.645984 32530 raft_consensus.cc:993] T ee6c632286174388ab5e7bfb2ae40078 P c74453754ee34bea9b231ae318a55a31: : Instructing follower 458d610e8abf4f2ea831ab7bf3576da6 to start an election
I20260709 13:13:57.646577 32459 raft_consensus.cc:1081] T ee6c632286174388ab5e7bfb2ae40078 P c74453754ee34bea9b231ae318a55a31 [term 2 LEADER]: Signalling peer 458d610e8abf4f2ea831ab7bf3576da6 to start an election
I20260709 13:13:57.648701 32281 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee6c632286174388ab5e7bfb2ae40078"
dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
 from {username='slave'} at 127.0.0.1:47214
I20260709 13:13:57.649194 32281 raft_consensus.cc:493] T ee6c632286174388ab5e7bfb2ae40078 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:57.649529 32281 raft_consensus.cc:3060] T ee6c632286174388ab5e7bfb2ae40078 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:57.655292 32281 raft_consensus.cc:515] T ee6c632286174388ab5e7bfb2ae40078 P 458d610e8abf4f2ea831ab7bf3576da6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:57.657310 32281 leader_election.cc:290] T ee6c632286174388ab5e7bfb2ae40078 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 3 election: Requested vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715)
I20260709 13:13:57.658435 31698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6c632286174388ab5e7bfb2ae40078" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "76fb155ade354ee1ba78673e73b28aca"
I20260709 13:13:57.659101 31698 raft_consensus.cc:3060] T ee6c632286174388ab5e7bfb2ae40078 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:57.659825 31629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6c632286174388ab5e7bfb2ae40078" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "c74453754ee34bea9b231ae318a55a31"
I20260709 13:13:57.660398 31629 raft_consensus.cc:3055] T ee6c632286174388ab5e7bfb2ae40078 P c74453754ee34bea9b231ae318a55a31 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:57.660686 31629 raft_consensus.cc:740] T ee6c632286174388ab5e7bfb2ae40078 P c74453754ee34bea9b231ae318a55a31 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Running, Role: LEADER
I20260709 13:13:57.661459 31629 consensus_queue.cc:260] T ee6c632286174388ab5e7bfb2ae40078 P c74453754ee34bea9b231ae318a55a31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:57.662712 31629 raft_consensus.cc:3060] T ee6c632286174388ab5e7bfb2ae40078 P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:57.666973 31698 raft_consensus.cc:2468] T ee6c632286174388ab5e7bfb2ae40078 P 76fb155ade354ee1ba78673e73b28aca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 3.
I20260709 13:13:57.668536 32229 leader_election.cc:304] T ee6c632286174388ab5e7bfb2ae40078 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca; no voters: 
I20260709 13:13:57.669605 32489 raft_consensus.cc:2804] T ee6c632286174388ab5e7bfb2ae40078 P 458d610e8abf4f2ea831ab7bf3576da6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:57.670133 32489 raft_consensus.cc:697] T ee6c632286174388ab5e7bfb2ae40078 P 458d610e8abf4f2ea831ab7bf3576da6 [term 3 LEADER]: Becoming Leader. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Running, Role: LEADER
I20260709 13:13:57.671075 32489 consensus_queue.cc:237] T ee6c632286174388ab5e7bfb2ae40078 P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:57.671577 31629 raft_consensus.cc:2468] T ee6c632286174388ab5e7bfb2ae40078 P c74453754ee34bea9b231ae318a55a31 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 3.
I20260709 13:13:57.687493 31378 catalog_manager.cc:5697] T ee6c632286174388ab5e7bfb2ae40078 P 458d610e8abf4f2ea831ab7bf3576da6 reported cstate change: term changed from 2 to 3, leader changed from c74453754ee34bea9b231ae318a55a31 (127.23.140.67) to 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65). New cstate: current_term: 3 leader_uuid: "458d610e8abf4f2ea831ab7bf3576da6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:57.699512 32530 raft_consensus.cc:993] T fb97ca15f56b46dd846db7b0ff156a32 P c74453754ee34bea9b231ae318a55a31: : Instructing follower 196d972917fe4f85985e3862d40b7596 to start an election
I20260709 13:13:57.699970 32530 raft_consensus.cc:1081] T fb97ca15f56b46dd846db7b0ff156a32 P c74453754ee34bea9b231ae318a55a31 [term 2 LEADER]: Signalling peer 196d972917fe4f85985e3862d40b7596 to start an election
I20260709 13:13:57.701957 31548 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fb97ca15f56b46dd846db7b0ff156a32"
dest_uuid: "196d972917fe4f85985e3862d40b7596"
 from {username='slave'} at 127.0.0.1:43954
I20260709 13:13:57.702440 31548 raft_consensus.cc:493] T fb97ca15f56b46dd846db7b0ff156a32 P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:57.702821 31548 raft_consensus.cc:3060] T fb97ca15f56b46dd846db7b0ff156a32 P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:57.709347 31548 raft_consensus.cc:515] T fb97ca15f56b46dd846db7b0ff156a32 P 196d972917fe4f85985e3862d40b7596 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:57.711318 31548 leader_election.cc:290] T fb97ca15f56b46dd846db7b0ff156a32 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 3 election: Requested vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715)
I20260709 13:13:57.712527 31700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb97ca15f56b46dd846db7b0ff156a32" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "76fb155ade354ee1ba78673e73b28aca"
I20260709 13:13:57.713188 31700 raft_consensus.cc:3060] T fb97ca15f56b46dd846db7b0ff156a32 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:57.715845 31629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb97ca15f56b46dd846db7b0ff156a32" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "c74453754ee34bea9b231ae318a55a31"
I20260709 13:13:57.716542 31629 raft_consensus.cc:3055] T fb97ca15f56b46dd846db7b0ff156a32 P c74453754ee34bea9b231ae318a55a31 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:57.716909 31629 raft_consensus.cc:740] T fb97ca15f56b46dd846db7b0ff156a32 P c74453754ee34bea9b231ae318a55a31 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Running, Role: LEADER
I20260709 13:13:57.718037 31629 consensus_queue.cc:260] T fb97ca15f56b46dd846db7b0ff156a32 P c74453754ee34bea9b231ae318a55a31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:57.719534 31629 raft_consensus.cc:3060] T fb97ca15f56b46dd846db7b0ff156a32 P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:57.722962 31700 raft_consensus.cc:2468] T fb97ca15f56b46dd846db7b0ff156a32 P 76fb155ade354ee1ba78673e73b28aca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 196d972917fe4f85985e3862d40b7596 in term 3.
I20260709 13:13:57.723995 31521 leader_election.cc:304] T fb97ca15f56b46dd846db7b0ff156a32 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, 76fb155ade354ee1ba78673e73b28aca; no voters: 
I20260709 13:13:57.724663 32453 raft_consensus.cc:2804] T fb97ca15f56b46dd846db7b0ff156a32 P 196d972917fe4f85985e3862d40b7596 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:57.725119 32453 raft_consensus.cc:697] T fb97ca15f56b46dd846db7b0ff156a32 P 196d972917fe4f85985e3862d40b7596 [term 3 LEADER]: Becoming Leader. State: Replica: 196d972917fe4f85985e3862d40b7596, State: Running, Role: LEADER
I20260709 13:13:57.726002 32453 consensus_queue.cc:237] T fb97ca15f56b46dd846db7b0ff156a32 P 196d972917fe4f85985e3862d40b7596 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:57.726699 31629 raft_consensus.cc:2468] T fb97ca15f56b46dd846db7b0ff156a32 P c74453754ee34bea9b231ae318a55a31 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 196d972917fe4f85985e3862d40b7596 in term 3.
I20260709 13:13:57.736446 31378 catalog_manager.cc:5697] T fb97ca15f56b46dd846db7b0ff156a32 P 196d972917fe4f85985e3862d40b7596 reported cstate change: term changed from 2 to 3, leader changed from c74453754ee34bea9b231ae318a55a31 (127.23.140.67) to 196d972917fe4f85985e3862d40b7596 (127.23.140.66). New cstate: current_term: 3 leader_uuid: "196d972917fe4f85985e3862d40b7596" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:57.751803 32459 raft_consensus.cc:993] T ddbfc15d5bf24708a4268dfa206ede07 P c74453754ee34bea9b231ae318a55a31: : Instructing follower 458d610e8abf4f2ea831ab7bf3576da6 to start an election
I20260709 13:13:57.752341 32459 raft_consensus.cc:1081] T ddbfc15d5bf24708a4268dfa206ede07 P c74453754ee34bea9b231ae318a55a31 [term 1 LEADER]: Signalling peer 458d610e8abf4f2ea831ab7bf3576da6 to start an election
I20260709 13:13:57.754038 32273 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ddbfc15d5bf24708a4268dfa206ede07"
dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
 from {username='slave'} at 127.0.0.1:47214
I20260709 13:13:57.754563 32273 raft_consensus.cc:493] T ddbfc15d5bf24708a4268dfa206ede07 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:57.754946 32273 raft_consensus.cc:3060] T ddbfc15d5bf24708a4268dfa206ede07 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:57.761152 32273 raft_consensus.cc:515] T ddbfc15d5bf24708a4268dfa206ede07 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:57.764439 31629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddbfc15d5bf24708a4268dfa206ede07" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c74453754ee34bea9b231ae318a55a31"
I20260709 13:13:57.765005 31629 raft_consensus.cc:3055] T ddbfc15d5bf24708a4268dfa206ede07 P c74453754ee34bea9b231ae318a55a31 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:57.765286 31629 raft_consensus.cc:740] T ddbfc15d5bf24708a4268dfa206ede07 P c74453754ee34bea9b231ae318a55a31 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Running, Role: LEADER
I20260709 13:13:57.765931 31629 consensus_queue.cc:260] T ddbfc15d5bf24708a4268dfa206ede07 P c74453754ee34bea9b231ae318a55a31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:57.766721 31629 raft_consensus.cc:3060] T ddbfc15d5bf24708a4268dfa206ede07 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:57.774434 31629 raft_consensus.cc:2468] T ddbfc15d5bf24708a4268dfa206ede07 P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 2.
I20260709 13:13:57.776571 32273 leader_election.cc:290] T ddbfc15d5bf24708a4268dfa206ede07 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 2 election: Requested vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715)
I20260709 13:13:57.777045 31698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddbfc15d5bf24708a4268dfa206ede07" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "76fb155ade354ee1ba78673e73b28aca"
I20260709 13:13:57.777709 31698 raft_consensus.cc:3060] T ddbfc15d5bf24708a4268dfa206ede07 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:57.779027 32229 leader_election.cc:304] T ddbfc15d5bf24708a4268dfa206ede07 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, c74453754ee34bea9b231ae318a55a31; no voters: 
I20260709 13:13:57.779979 32489 raft_consensus.cc:2804] T ddbfc15d5bf24708a4268dfa206ede07 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:57.780467 32489 raft_consensus.cc:697] T ddbfc15d5bf24708a4268dfa206ede07 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 LEADER]: Becoming Leader. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Running, Role: LEADER
I20260709 13:13:57.781313 32489 consensus_queue.cc:237] T ddbfc15d5bf24708a4268dfa206ede07 P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:13:57.845543 32459 raft_consensus.cc:993] T 3e09c2945641463e91365b4826cc47e3 P c74453754ee34bea9b231ae318a55a31: : Instructing follower 196d972917fe4f85985e3862d40b7596 to start an election
I20260709 13:13:57.846071 32459 raft_consensus.cc:1081] T 3e09c2945641463e91365b4826cc47e3 P c74453754ee34bea9b231ae318a55a31 [term 1 LEADER]: Signalling peer 196d972917fe4f85985e3862d40b7596 to start an election
I20260709 13:13:57.872123 31550 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3e09c2945641463e91365b4826cc47e3"
dest_uuid: "196d972917fe4f85985e3862d40b7596"
 from {username='slave'} at 127.0.0.1:43954
I20260709 13:13:57.872974 31550 raft_consensus.cc:493] T 3e09c2945641463e91365b4826cc47e3 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:57.873318 31550 raft_consensus.cc:3060] T 3e09c2945641463e91365b4826cc47e3 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:57.853399 31698 raft_consensus.cc:2468] T ddbfc15d5bf24708a4268dfa206ede07 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 2.
I20260709 13:13:57.884392 31550 raft_consensus.cc:515] T 3e09c2945641463e91365b4826cc47e3 P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:57.889346 31550 leader_election.cc:290] T 3e09c2945641463e91365b4826cc47e3 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 election: Requested vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715)
I20260709 13:13:57.891067 31700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e09c2945641463e91365b4826cc47e3" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "76fb155ade354ee1ba78673e73b28aca"
I20260709 13:13:57.891816 31700 raft_consensus.cc:3060] T 3e09c2945641463e91365b4826cc47e3 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:57.908666 31629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e09c2945641463e91365b4826cc47e3" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c74453754ee34bea9b231ae318a55a31"
I20260709 13:13:57.909330 31629 raft_consensus.cc:3055] T 3e09c2945641463e91365b4826cc47e3 P c74453754ee34bea9b231ae318a55a31 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:57.909618 31629 raft_consensus.cc:740] T 3e09c2945641463e91365b4826cc47e3 P c74453754ee34bea9b231ae318a55a31 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Running, Role: LEADER
I20260709 13:13:57.910593 31629 consensus_queue.cc:260] T 3e09c2945641463e91365b4826cc47e3 P c74453754ee34bea9b231ae318a55a31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:57.912201 31629 raft_consensus.cc:3060] T 3e09c2945641463e91365b4826cc47e3 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:57.901609 31700 raft_consensus.cc:2468] T 3e09c2945641463e91365b4826cc47e3 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 196d972917fe4f85985e3862d40b7596 in term 2.
I20260709 13:13:57.914995 31521 leader_election.cc:304] T 3e09c2945641463e91365b4826cc47e3 P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, 76fb155ade354ee1ba78673e73b28aca; no voters: 
I20260709 13:13:57.915750 32484 raft_consensus.cc:2804] T 3e09c2945641463e91365b4826cc47e3 P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:57.916184 32484 raft_consensus.cc:697] T 3e09c2945641463e91365b4826cc47e3 P 196d972917fe4f85985e3862d40b7596 [term 2 LEADER]: Becoming Leader. State: Replica: 196d972917fe4f85985e3862d40b7596, State: Running, Role: LEADER
I20260709 13:13:57.917081 32484 consensus_queue.cc:237] T 3e09c2945641463e91365b4826cc47e3 P 196d972917fe4f85985e3862d40b7596 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:57.919214 31629 raft_consensus.cc:2468] T 3e09c2945641463e91365b4826cc47e3 P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 196d972917fe4f85985e3862d40b7596 in term 2.
I20260709 13:13:57.918548 31378 catalog_manager.cc:5697] T ddbfc15d5bf24708a4268dfa206ede07 P 458d610e8abf4f2ea831ab7bf3576da6 reported cstate change: term changed from 1 to 2, leader changed from c74453754ee34bea9b231ae318a55a31 (127.23.140.67) to 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65). New cstate: current_term: 2 leader_uuid: "458d610e8abf4f2ea831ab7bf3576da6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:57.954720 31374 catalog_manager.cc:5697] T 3e09c2945641463e91365b4826cc47e3 P 196d972917fe4f85985e3862d40b7596 reported cstate change: term changed from 1 to 2, leader changed from c74453754ee34bea9b231ae318a55a31 (127.23.140.67) to 196d972917fe4f85985e3862d40b7596 (127.23.140.66). New cstate: current_term: 2 leader_uuid: "196d972917fe4f85985e3862d40b7596" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:58.012120 31550 raft_consensus.cc:1275] T 0f01040b42e14f0db6bcd06319237ddb P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Refusing update from remote peer 76fb155ade354ee1ba78673e73b28aca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:58.013551 32442 consensus_queue.cc:1048] T 0f01040b42e14f0db6bcd06319237ddb P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:58.029495 31629 raft_consensus.cc:1275] T 0f01040b42e14f0db6bcd06319237ddb P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Refusing update from remote peer 76fb155ade354ee1ba78673e73b28aca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:58.034538 32548 consensus_queue.cc:1048] T 0f01040b42e14f0db6bcd06319237ddb P 76fb155ade354ee1ba78673e73b28aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:58.095933 31700 raft_consensus.cc:1275] T ee6c632286174388ab5e7bfb2ae40078 P 76fb155ade354ee1ba78673e73b28aca [term 3 FOLLOWER]: Refusing update from remote peer 458d610e8abf4f2ea831ab7bf3576da6: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:58.097374 32489 consensus_queue.cc:1048] T ee6c632286174388ab5e7bfb2ae40078 P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:58.117831 31629 raft_consensus.cc:1275] T ee6c632286174388ab5e7bfb2ae40078 P c74453754ee34bea9b231ae318a55a31 [term 3 FOLLOWER]: Refusing update from remote peer 458d610e8abf4f2ea831ab7bf3576da6: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:58.122156 32516 consensus_queue.cc:1048] T ee6c632286174388ab5e7bfb2ae40078 P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:58.147315 31700 raft_consensus.cc:1275] T fb97ca15f56b46dd846db7b0ff156a32 P 76fb155ade354ee1ba78673e73b28aca [term 3 FOLLOWER]: Refusing update from remote peer 196d972917fe4f85985e3862d40b7596: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:58.148689 32526 consensus_queue.cc:1048] T fb97ca15f56b46dd846db7b0ff156a32 P 196d972917fe4f85985e3862d40b7596 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:58.167289 31629 raft_consensus.cc:1275] T fb97ca15f56b46dd846db7b0ff156a32 P c74453754ee34bea9b231ae318a55a31 [term 3 FOLLOWER]: Refusing update from remote peer 196d972917fe4f85985e3862d40b7596: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:58.169092 32484 consensus_queue.cc:1048] T fb97ca15f56b46dd846db7b0ff156a32 P 196d972917fe4f85985e3862d40b7596 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:58.219226 31629 raft_consensus.cc:1275] T ddbfc15d5bf24708a4268dfa206ede07 P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Refusing update from remote peer 458d610e8abf4f2ea831ab7bf3576da6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:58.220539 32516 consensus_queue.cc:1048] T ddbfc15d5bf24708a4268dfa206ede07 P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:58.227756 31700 raft_consensus.cc:1275] T ddbfc15d5bf24708a4268dfa206ede07 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Refusing update from remote peer 458d610e8abf4f2ea831ab7bf3576da6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:58.275367 32516 consensus_queue.cc:1048] T ddbfc15d5bf24708a4268dfa206ede07 P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:58.311005 31623 raft_consensus.cc:1275] T 3e09c2945641463e91365b4826cc47e3 P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Refusing update from remote peer 196d972917fe4f85985e3862d40b7596: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:58.319358 32565 consensus_queue.cc:1048] T 3e09c2945641463e91365b4826cc47e3 P 196d972917fe4f85985e3862d40b7596 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:58.421882 31700 raft_consensus.cc:1275] T 3e09c2945641463e91365b4826cc47e3 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Refusing update from remote peer 196d972917fe4f85985e3862d40b7596: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:58.433223 32564 consensus_queue.cc:1048] T 3e09c2945641463e91365b4826cc47e3 P 196d972917fe4f85985e3862d40b7596 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:58.592891 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:58.641216 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:58.707038 31550 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "256a5c9a935246e0a6c36b5b654fbbfb"
dest_uuid: "196d972917fe4f85985e3862d40b7596"
mode: GRACEFUL
new_leader_uuid: "c74453754ee34bea9b231ae318a55a31"
 from {username='slave'} at 127.0.0.1:57498
I20260709 13:13:58.707631 31550 raft_consensus.cc:606] T 256a5c9a935246e0a6c36b5b654fbbfb P 196d972917fe4f85985e3862d40b7596 [term 1 LEADER]: Received request to transfer leadership to TS c74453754ee34bea9b231ae318a55a31
I20260709 13:13:58.711141 31698 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bdf0c159a4f34a2abd10a0f7c60b5fbf"
dest_uuid: "76fb155ade354ee1ba78673e73b28aca"
mode: GRACEFUL
new_leader_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
 from {username='slave'} at 127.0.0.1:50386
I20260709 13:13:58.711728 31698 raft_consensus.cc:606] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 76fb155ade354ee1ba78673e73b28aca [term 2 LEADER]: Received request to transfer leadership to TS 458d610e8abf4f2ea831ab7bf3576da6
I20260709 13:13:58.713165 24113 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:13:58.714958 24113 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:58.816578 32564 raft_consensus.cc:993] T 256a5c9a935246e0a6c36b5b654fbbfb P 196d972917fe4f85985e3862d40b7596: : Instructing follower c74453754ee34bea9b231ae318a55a31 to start an election
I20260709 13:13:58.817149 32564 raft_consensus.cc:1081] T 256a5c9a935246e0a6c36b5b654fbbfb P 196d972917fe4f85985e3862d40b7596 [term 1 LEADER]: Signalling peer c74453754ee34bea9b231ae318a55a31 to start an election
I20260709 13:13:58.818692 31629 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "256a5c9a935246e0a6c36b5b654fbbfb"
dest_uuid: "c74453754ee34bea9b231ae318a55a31"
 from {username='slave'} at 127.0.0.1:39388
I20260709 13:13:58.819233 31629 raft_consensus.cc:493] T 256a5c9a935246e0a6c36b5b654fbbfb P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:58.820434 31629 raft_consensus.cc:3060] T 256a5c9a935246e0a6c36b5b654fbbfb P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:58.828447 31629 raft_consensus.cc:515] T 256a5c9a935246e0a6c36b5b654fbbfb P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:58.830770 31629 leader_election.cc:290] T 256a5c9a935246e0a6c36b5b654fbbfb P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 2 election: Requested vote from peers 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431), 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715)
I20260709 13:13:58.831697 31552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a5c9a935246e0a6c36b5b654fbbfb" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "196d972917fe4f85985e3862d40b7596"
I20260709 13:13:58.832369 31552 raft_consensus.cc:3055] T 256a5c9a935246e0a6c36b5b654fbbfb P 196d972917fe4f85985e3862d40b7596 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:58.832728 31552 raft_consensus.cc:740] T 256a5c9a935246e0a6c36b5b654fbbfb P 196d972917fe4f85985e3862d40b7596 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 196d972917fe4f85985e3862d40b7596, State: Running, Role: LEADER
I20260709 13:13:58.834180 31700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a5c9a935246e0a6c36b5b654fbbfb" candidate_uuid: "c74453754ee34bea9b231ae318a55a31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "76fb155ade354ee1ba78673e73b28aca"
I20260709 13:13:58.834748 31700 raft_consensus.cc:3060] T 256a5c9a935246e0a6c36b5b654fbbfb P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:58.840234 31700 raft_consensus.cc:2468] T 256a5c9a935246e0a6c36b5b654fbbfb P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 2.
I20260709 13:13:58.833448 31552 consensus_queue.cc:260] T 256a5c9a935246e0a6c36b5b654fbbfb P 196d972917fe4f85985e3862d40b7596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:58.841213 31595 leader_election.cc:304] T 256a5c9a935246e0a6c36b5b654fbbfb P c74453754ee34bea9b231ae318a55a31 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca, c74453754ee34bea9b231ae318a55a31; no voters: 
I20260709 13:13:58.841874 31552 raft_consensus.cc:3060] T 256a5c9a935246e0a6c36b5b654fbbfb P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:58.842049 32528 raft_consensus.cc:2804] T 256a5c9a935246e0a6c36b5b654fbbfb P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:58.842741 32528 raft_consensus.cc:697] T 256a5c9a935246e0a6c36b5b654fbbfb P c74453754ee34bea9b231ae318a55a31 [term 2 LEADER]: Becoming Leader. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Running, Role: LEADER
I20260709 13:13:58.843590 32528 consensus_queue.cc:237] T 256a5c9a935246e0a6c36b5b654fbbfb P c74453754ee34bea9b231ae318a55a31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:13:58.852931 31552 raft_consensus.cc:2468] T 256a5c9a935246e0a6c36b5b654fbbfb P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c74453754ee34bea9b231ae318a55a31 in term 2.
I20260709 13:13:58.861152 31374 catalog_manager.cc:5697] T 256a5c9a935246e0a6c36b5b654fbbfb P c74453754ee34bea9b231ae318a55a31 reported cstate change: term changed from 1 to 2, leader changed from 196d972917fe4f85985e3862d40b7596 (127.23.140.66) to c74453754ee34bea9b231ae318a55a31 (127.23.140.67). New cstate: current_term: 2 leader_uuid: "c74453754ee34bea9b231ae318a55a31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:58.914750 32442 raft_consensus.cc:993] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 76fb155ade354ee1ba78673e73b28aca: : Instructing follower 458d610e8abf4f2ea831ab7bf3576da6 to start an election
I20260709 13:13:58.915239 32548 raft_consensus.cc:1081] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 76fb155ade354ee1ba78673e73b28aca [term 2 LEADER]: Signalling peer 458d610e8abf4f2ea831ab7bf3576da6 to start an election
I20260709 13:13:58.918453 32275 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bdf0c159a4f34a2abd10a0f7c60b5fbf"
dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
 from {username='slave'} at 127.0.0.1:47200
I20260709 13:13:58.919059 32275 raft_consensus.cc:493] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:58.919467 32275 raft_consensus.cc:3060] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:58.927996 32275 raft_consensus.cc:515] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 458d610e8abf4f2ea831ab7bf3576da6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:58.933107 31700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf0c159a4f34a2abd10a0f7c60b5fbf" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "76fb155ade354ee1ba78673e73b28aca"
I20260709 13:13:58.933706 31700 raft_consensus.cc:3055] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 76fb155ade354ee1ba78673e73b28aca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:58.935112 31700 raft_consensus.cc:740] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 76fb155ade354ee1ba78673e73b28aca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 76fb155ade354ee1ba78673e73b28aca, State: Running, Role: LEADER
I20260709 13:13:58.935951 31700 consensus_queue.cc:260] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 76fb155ade354ee1ba78673e73b28aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:58.937023 31700 raft_consensus.cc:3060] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:58.933797 32275 leader_election.cc:290] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 3 election: Requested vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:13:58.934105 31552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf0c159a4f34a2abd10a0f7c60b5fbf" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "196d972917fe4f85985e3862d40b7596"
I20260709 13:13:58.941942 31552 raft_consensus.cc:3060] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:58.943251 31700 raft_consensus.cc:2468] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 76fb155ade354ee1ba78673e73b28aca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 3.
I20260709 13:13:58.944334 32229 leader_election.cc:304] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca; no voters: 
I20260709 13:13:58.945216 32489 raft_consensus.cc:2804] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 458d610e8abf4f2ea831ab7bf3576da6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:58.945678 32489 raft_consensus.cc:697] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 458d610e8abf4f2ea831ab7bf3576da6 [term 3 LEADER]: Becoming Leader. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Running, Role: LEADER
I20260709 13:13:58.946569 32489 consensus_queue.cc:237] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:13:58.948992 31552 raft_consensus.cc:2468] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 196d972917fe4f85985e3862d40b7596 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 3.
I20260709 13:13:58.958046 31374 catalog_manager.cc:5697] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 458d610e8abf4f2ea831ab7bf3576da6 reported cstate change: term changed from 2 to 3, leader changed from 76fb155ade354ee1ba78673e73b28aca (127.23.140.68) to 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65). New cstate: current_term: 3 leader_uuid: "458d610e8abf4f2ea831ab7bf3576da6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:59.282435 31700 raft_consensus.cc:1275] T 256a5c9a935246e0a6c36b5b654fbbfb P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Refusing update from remote peer c74453754ee34bea9b231ae318a55a31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:59.284386 32528 consensus_queue.cc:1048] T 256a5c9a935246e0a6c36b5b654fbbfb P c74453754ee34bea9b231ae318a55a31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:59.296705 31550 raft_consensus.cc:1275] T 256a5c9a935246e0a6c36b5b654fbbfb P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Refusing update from remote peer c74453754ee34bea9b231ae318a55a31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:59.298148 32530 consensus_queue.cc:1048] T 256a5c9a935246e0a6c36b5b654fbbfb P c74453754ee34bea9b231ae318a55a31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:59.368492 31550 raft_consensus.cc:1275] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 196d972917fe4f85985e3862d40b7596 [term 3 FOLLOWER]: Refusing update from remote peer 458d610e8abf4f2ea831ab7bf3576da6: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:59.369608 32490 consensus_queue.cc:1048] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:59.390993 31700 raft_consensus.cc:1275] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 76fb155ade354ee1ba78673e73b28aca [term 3 FOLLOWER]: Refusing update from remote peer 458d610e8abf4f2ea831ab7bf3576da6: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:59.393980 32490 consensus_queue.cc:1048] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:59.715864 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:59.761180 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:59.808300 31623 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3516a073925457498018b87cdbaa85f"
dest_uuid: "c74453754ee34bea9b231ae318a55a31"
mode: GRACEFUL
new_leader_uuid: "196d972917fe4f85985e3862d40b7596"
 from {username='slave'} at 127.0.0.1:40662
I20260709 13:13:59.808842 31623 raft_consensus.cc:606] T e3516a073925457498018b87cdbaa85f P c74453754ee34bea9b231ae318a55a31 [term 1 LEADER]: Received request to transfer leadership to TS 196d972917fe4f85985e3862d40b7596
I20260709 13:13:59.810125 24113 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:13:59.811316 24113 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:00.269644 32530 raft_consensus.cc:993] T e3516a073925457498018b87cdbaa85f P c74453754ee34bea9b231ae318a55a31: : Instructing follower 196d972917fe4f85985e3862d40b7596 to start an election
I20260709 13:14:00.270193 32530 raft_consensus.cc:1081] T e3516a073925457498018b87cdbaa85f P c74453754ee34bea9b231ae318a55a31 [term 1 LEADER]: Signalling peer 196d972917fe4f85985e3862d40b7596 to start an election
I20260709 13:14:00.275345 31548 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e3516a073925457498018b87cdbaa85f"
dest_uuid: "196d972917fe4f85985e3862d40b7596"
 from {username='slave'} at 127.0.0.1:43954
I20260709 13:14:00.275893 31548 raft_consensus.cc:493] T e3516a073925457498018b87cdbaa85f P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:00.276253 31548 raft_consensus.cc:3060] T e3516a073925457498018b87cdbaa85f P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:00.283494 31548 raft_consensus.cc:515] T e3516a073925457498018b87cdbaa85f P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:14:00.285319 31548 leader_election.cc:290] T e3516a073925457498018b87cdbaa85f P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 election: Requested vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715)
I20260709 13:14:00.286221 31698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3516a073925457498018b87cdbaa85f" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "76fb155ade354ee1ba78673e73b28aca"
I20260709 13:14:00.287048 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3516a073925457498018b87cdbaa85f" candidate_uuid: "196d972917fe4f85985e3862d40b7596" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c74453754ee34bea9b231ae318a55a31"
I20260709 13:14:00.287673 31623 raft_consensus.cc:3055] T e3516a073925457498018b87cdbaa85f P c74453754ee34bea9b231ae318a55a31 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:00.288005 31623 raft_consensus.cc:740] T e3516a073925457498018b87cdbaa85f P c74453754ee34bea9b231ae318a55a31 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c74453754ee34bea9b231ae318a55a31, State: Running, Role: LEADER
I20260709 13:14:00.288849 31623 consensus_queue.cc:260] T e3516a073925457498018b87cdbaa85f P c74453754ee34bea9b231ae318a55a31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:14:00.289381 31698 raft_consensus.cc:3060] T e3516a073925457498018b87cdbaa85f P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:00.290169 31623 raft_consensus.cc:3060] T e3516a073925457498018b87cdbaa85f P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:00.297037 31698 raft_consensus.cc:2468] T e3516a073925457498018b87cdbaa85f P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 196d972917fe4f85985e3862d40b7596 in term 2.
I20260709 13:14:00.297730 31623 raft_consensus.cc:2468] T e3516a073925457498018b87cdbaa85f P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 196d972917fe4f85985e3862d40b7596 in term 2.
I20260709 13:14:00.298969 31521 leader_election.cc:304] T e3516a073925457498018b87cdbaa85f P 196d972917fe4f85985e3862d40b7596 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 196d972917fe4f85985e3862d40b7596, c74453754ee34bea9b231ae318a55a31; no voters: 
I20260709 13:14:00.300347 32564 raft_consensus.cc:2804] T e3516a073925457498018b87cdbaa85f P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:00.301676 32564 raft_consensus.cc:697] T e3516a073925457498018b87cdbaa85f P 196d972917fe4f85985e3862d40b7596 [term 2 LEADER]: Becoming Leader. State: Replica: 196d972917fe4f85985e3862d40b7596, State: Running, Role: LEADER
I20260709 13:14:00.302666 32564 consensus_queue.cc:237] T e3516a073925457498018b87cdbaa85f P 196d972917fe4f85985e3862d40b7596 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } }
I20260709 13:14:00.335932 31374 catalog_manager.cc:5697] T e3516a073925457498018b87cdbaa85f P 196d972917fe4f85985e3862d40b7596 reported cstate change: term changed from 1 to 2, leader changed from c74453754ee34bea9b231ae318a55a31 (127.23.140.67) to 196d972917fe4f85985e3862d40b7596 (127.23.140.66). New cstate: current_term: 2 leader_uuid: "196d972917fe4f85985e3862d40b7596" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:00.812265 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:00.866452 31623 raft_consensus.cc:1275] T e3516a073925457498018b87cdbaa85f P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Refusing update from remote peer 196d972917fe4f85985e3862d40b7596: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:00.867703 32565 consensus_queue.cc:1048] T e3516a073925457498018b87cdbaa85f P 196d972917fe4f85985e3862d40b7596 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:00.868424 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:00.894055 31698 raft_consensus.cc:1275] T e3516a073925457498018b87cdbaa85f P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Refusing update from remote peer 196d972917fe4f85985e3862d40b7596: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:00.899461 32565 consensus_queue.cc:1048] T e3516a073925457498018b87cdbaa85f P 196d972917fe4f85985e3862d40b7596 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:00.924865 31550 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eb560d89d58246e5856a763e3be6f086"
dest_uuid: "196d972917fe4f85985e3862d40b7596"
mode: GRACEFUL
new_leader_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
 from {username='slave'} at 127.0.0.1:57498
I20260709 13:14:00.925451 31550 raft_consensus.cc:606] T eb560d89d58246e5856a763e3be6f086 P 196d972917fe4f85985e3862d40b7596 [term 2 LEADER]: Received request to transfer leadership to TS 458d610e8abf4f2ea831ab7bf3576da6
I20260709 13:14:00.927099 24113 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:14:00.928426 24113 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:01.018234 32565 raft_consensus.cc:993] T eb560d89d58246e5856a763e3be6f086 P 196d972917fe4f85985e3862d40b7596: : Instructing follower 458d610e8abf4f2ea831ab7bf3576da6 to start an election
I20260709 13:14:01.018786 32588 raft_consensus.cc:1081] T eb560d89d58246e5856a763e3be6f086 P 196d972917fe4f85985e3862d40b7596 [term 2 LEADER]: Signalling peer 458d610e8abf4f2ea831ab7bf3576da6 to start an election
I20260709 13:14:01.020745 32281 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eb560d89d58246e5856a763e3be6f086"
dest_uuid: "458d610e8abf4f2ea831ab7bf3576da6"
 from {username='slave'} at 127.0.0.1:47224
I20260709 13:14:01.021297 32281 raft_consensus.cc:493] T eb560d89d58246e5856a763e3be6f086 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:01.021677 32281 raft_consensus.cc:3060] T eb560d89d58246e5856a763e3be6f086 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:01.028081 32281 raft_consensus.cc:515] T eb560d89d58246e5856a763e3be6f086 P 458d610e8abf4f2ea831ab7bf3576da6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:14:01.030354 32281 leader_election.cc:290] T eb560d89d58246e5856a763e3be6f086 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 3 election: Requested vote from peers 76fb155ade354ee1ba78673e73b28aca (127.23.140.68:45715), 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431)
I20260709 13:14:01.030957 31700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb560d89d58246e5856a763e3be6f086" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "76fb155ade354ee1ba78673e73b28aca"
I20260709 13:14:01.031560 31700 raft_consensus.cc:3060] T eb560d89d58246e5856a763e3be6f086 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:01.032245 31550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb560d89d58246e5856a763e3be6f086" candidate_uuid: "458d610e8abf4f2ea831ab7bf3576da6" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "196d972917fe4f85985e3862d40b7596"
I20260709 13:14:01.032861 31550 raft_consensus.cc:3055] T eb560d89d58246e5856a763e3be6f086 P 196d972917fe4f85985e3862d40b7596 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:01.033130 31550 raft_consensus.cc:740] T eb560d89d58246e5856a763e3be6f086 P 196d972917fe4f85985e3862d40b7596 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 196d972917fe4f85985e3862d40b7596, State: Running, Role: LEADER
I20260709 13:14:01.033896 31550 consensus_queue.cc:260] T eb560d89d58246e5856a763e3be6f086 P 196d972917fe4f85985e3862d40b7596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:14:01.035043 31550 raft_consensus.cc:3060] T eb560d89d58246e5856a763e3be6f086 P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:01.038208 31700 raft_consensus.cc:2468] T eb560d89d58246e5856a763e3be6f086 P 76fb155ade354ee1ba78673e73b28aca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 3.
I20260709 13:14:01.039453 32229 leader_election.cc:304] T eb560d89d58246e5856a763e3be6f086 P 458d610e8abf4f2ea831ab7bf3576da6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 458d610e8abf4f2ea831ab7bf3576da6, 76fb155ade354ee1ba78673e73b28aca; no voters: 
I20260709 13:14:01.040261 32583 raft_consensus.cc:2804] T eb560d89d58246e5856a763e3be6f086 P 458d610e8abf4f2ea831ab7bf3576da6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:01.040697 32583 raft_consensus.cc:697] T eb560d89d58246e5856a763e3be6f086 P 458d610e8abf4f2ea831ab7bf3576da6 [term 3 LEADER]: Becoming Leader. State: Replica: 458d610e8abf4f2ea831ab7bf3576da6, State: Running, Role: LEADER
I20260709 13:14:01.041554 32583 consensus_queue.cc:237] T eb560d89d58246e5856a763e3be6f086 P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } }
I20260709 13:14:01.042109 31550 raft_consensus.cc:2468] T eb560d89d58246e5856a763e3be6f086 P 196d972917fe4f85985e3862d40b7596 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 458d610e8abf4f2ea831ab7bf3576da6 in term 3.
I20260709 13:14:01.053208 31374 catalog_manager.cc:5697] T eb560d89d58246e5856a763e3be6f086 P 458d610e8abf4f2ea831ab7bf3576da6 reported cstate change: term changed from 2 to 3, leader changed from 196d972917fe4f85985e3862d40b7596 (127.23.140.66) to 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65). New cstate: current_term: 3 leader_uuid: "458d610e8abf4f2ea831ab7bf3576da6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:01.441691 31698 raft_consensus.cc:1275] T eb560d89d58246e5856a763e3be6f086 P 76fb155ade354ee1ba78673e73b28aca [term 3 FOLLOWER]: Refusing update from remote peer 458d610e8abf4f2ea831ab7bf3576da6: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:14:01.443086 32583 consensus_queue.cc:1048] T eb560d89d58246e5856a763e3be6f086 P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:01.453105 31548 raft_consensus.cc:1275] T eb560d89d58246e5856a763e3be6f086 P 196d972917fe4f85985e3862d40b7596 [term 3 FOLLOWER]: Refusing update from remote peer 458d610e8abf4f2ea831ab7bf3576da6: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:14:01.454931 32489 consensus_queue.cc:1048] T eb560d89d58246e5856a763e3be6f086 P 458d610e8abf4f2ea831ab7bf3576da6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "196d972917fe4f85985e3862d40b7596" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:01.929241 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:01.969139 24113 tablet_server.cc:179] TabletServer@127.23.140.65:37919 shutting down...
W20260709 13:14:01.979072 31520 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 75 similar messages]
W20260709 13:14:01.984230 31520 consensus_peers.cc:597] T 6038006ca0e344af86fe5febd517c62a P 196d972917fe4f85985e3862d40b7596 -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:01.985044 31520 consensus_peers.cc:597] T fc35ae8230cf4ab792d0e15bcaf8b653 P 196d972917fe4f85985e3862d40b7596 -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:01.990710 31594 consensus_peers.cc:597] T 70ccde113c9246f5a008add70aacae7d P c74453754ee34bea9b231ae318a55a31 -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:02.007268 24113 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:02.008314 24113 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:02.009095 24113 raft_consensus.cc:2243] T 216111c5962f4b82ae52414985988860 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.009940 24113 raft_consensus.cc:2272] T 216111c5962f4b82ae52414985988860 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.012485 24113 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:02.013127 24113 raft_consensus.cc:2243] T 8a98dff441f1479992f85708c9f03283 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.013541 24113 raft_consensus.cc:2272] T 8a98dff441f1479992f85708c9f03283 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.015409 24113 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:02.015980 24113 raft_consensus.cc:2243] T fc35ae8230cf4ab792d0e15bcaf8b653 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.016352 24113 raft_consensus.cc:2272] T fc35ae8230cf4ab792d0e15bcaf8b653 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.018442 24113 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:02.019030 24113 raft_consensus.cc:2243] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.019428 24113 raft_consensus.cc:2272] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.021371 24113 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:02.022137 24113 raft_consensus.cc:2243] T 075b9562a2b547c8aad80c2bae413556 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.022863 24113 raft_consensus.cc:2272] T 075b9562a2b547c8aad80c2bae413556 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.024709 24113 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:02.025218 24113 raft_consensus.cc:2243] T d78bdf917ee94331b91cb3fb308ef2a1 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.026032 24113 raft_consensus.cc:2272] T d78bdf917ee94331b91cb3fb308ef2a1 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.028020 24113 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:02.028566 24113 raft_consensus.cc:2243] T ee6c632286174388ab5e7bfb2ae40078 P 458d610e8abf4f2ea831ab7bf3576da6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.029281 24113 raft_consensus.cc:2272] T ee6c632286174388ab5e7bfb2ae40078 P 458d610e8abf4f2ea831ab7bf3576da6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.031507 24113 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:02.032354 24113 raft_consensus.cc:2243] T 81f4d53616e74e2ea71e52fdb3e8fc76 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.032809 24113 raft_consensus.cc:2272] T 81f4d53616e74e2ea71e52fdb3e8fc76 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.035530 24113 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:02.036350 24113 raft_consensus.cc:2243] T 364efc87879c4e6db82a829c76ef0045 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.036983 24113 raft_consensus.cc:2272] T 364efc87879c4e6db82a829c76ef0045 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.039178 24113 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:02.039719 24113 raft_consensus.cc:2243] T 6038006ca0e344af86fe5febd517c62a P 458d610e8abf4f2ea831ab7bf3576da6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.040051 24113 raft_consensus.cc:2272] T 6038006ca0e344af86fe5febd517c62a P 458d610e8abf4f2ea831ab7bf3576da6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.042526 24113 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:02.043139 24113 raft_consensus.cc:2243] T 70ccde113c9246f5a008add70aacae7d P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.043532 24113 raft_consensus.cc:2272] T 70ccde113c9246f5a008add70aacae7d P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:02.044622 31520 consensus_peers.cc:597] T c8185106c7a94c3ebaace350d2363217 P 196d972917fe4f85985e3862d40b7596 -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:02.045920 24113 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:02.046564 24113 raft_consensus.cc:2243] T fb4f7292ed2f489e922ca5fb1c6e47bf P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.047014 24113 raft_consensus.cc:2272] T fb4f7292ed2f489e922ca5fb1c6e47bf P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.049060 24113 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:02.049650 24113 raft_consensus.cc:2243] T 47cb0ae4817d4c19ac11b42143d00039 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.050093 24113 raft_consensus.cc:2272] T 47cb0ae4817d4c19ac11b42143d00039 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.052567 24113 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:02.053313 24113 raft_consensus.cc:2243] T 497217e9b47244fcb425c66935cb8a20 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.053846 24113 raft_consensus.cc:2272] T 497217e9b47244fcb425c66935cb8a20 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.055950 24113 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:02.056524 24113 raft_consensus.cc:2243] T 85d4a24725c749199c1b35d959b1b2b5 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.056969 24113 raft_consensus.cc:2272] T 85d4a24725c749199c1b35d959b1b2b5 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.059681 24113 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:02.060563 24113 raft_consensus.cc:2243] T eb560d89d58246e5856a763e3be6f086 P 458d610e8abf4f2ea831ab7bf3576da6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.061396 24113 raft_consensus.cc:2272] T eb560d89d58246e5856a763e3be6f086 P 458d610e8abf4f2ea831ab7bf3576da6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.064539 24113 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:02.065131 24113 raft_consensus.cc:2243] T 76a7de5cfe774df68279e2e1e7361c6b P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.065984 24113 raft_consensus.cc:2272] T 76a7de5cfe774df68279e2e1e7361c6b P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.068235 24113 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:02.068997 24113 raft_consensus.cc:2243] T 53c18818aa9c44c8987bb675a05026a4 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.069860 24113 raft_consensus.cc:2272] T 53c18818aa9c44c8987bb675a05026a4 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.073005 24113 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:02.073886 24113 raft_consensus.cc:2243] T cfe1afd9e187451faf5f631e0c2eef00 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.074851 24113 raft_consensus.cc:2272] T cfe1afd9e187451faf5f631e0c2eef00 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:02.074798 31668 consensus_peers.cc:597] T 47cb0ae4817d4c19ac11b42143d00039 P 76fb155ade354ee1ba78673e73b28aca -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:02.076164 31594 consensus_peers.cc:597] T 4fe725ada8f142d1bb9a35a30f865c10 P c74453754ee34bea9b231ae318a55a31 -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:02.078176 24113 tablet_replica.cc:333] stopping tablet replica
W20260709 13:14:02.076917 31594 consensus_peers.cc:597] T 364efc87879c4e6db82a829c76ef0045 P c74453754ee34bea9b231ae318a55a31 -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:02.079362 31594 consensus_peers.cc:597] T ac45af43771c45fd8e57204c190c322b P c74453754ee34bea9b231ae318a55a31 -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:02.079423 24113 raft_consensus.cc:2243] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.080232 24113 raft_consensus.cc:2272] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.083242 24113 tablet_replica.cc:333] stopping tablet replica
W20260709 13:14:02.083830 31668 consensus_peers.cc:597] T bd1c90f0a848434cb7df23dbeae35ddf P 76fb155ade354ee1ba78673e73b28aca -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:02.084043 24113 raft_consensus.cc:2243] T ddbfc15d5bf24708a4268dfa206ede07 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.085022 24113 raft_consensus.cc:2272] T ddbfc15d5bf24708a4268dfa206ede07 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.087424 24113 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:02.088384 24113 raft_consensus.cc:2243] T 88b0a29c38284391bdaea82edf99c771 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.088992 24113 raft_consensus.cc:2272] T 88b0a29c38284391bdaea82edf99c771 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.091854 24113 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:02.092720 24113 raft_consensus.cc:2243] T bd1c90f0a848434cb7df23dbeae35ddf P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.093281 24113 raft_consensus.cc:2272] T bd1c90f0a848434cb7df23dbeae35ddf P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.095660 24113 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:02.096474 24113 raft_consensus.cc:2243] T e698d6d2e2e74eca91e222e9bfdf8f13 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.097064 24113 raft_consensus.cc:2272] T e698d6d2e2e74eca91e222e9bfdf8f13 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.100397 24113 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:02.101004 24113 raft_consensus.cc:2243] T f66580482b2d470bacbfec917042485b P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.101464 24113 raft_consensus.cc:2272] T f66580482b2d470bacbfec917042485b P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.103849 24113 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:02.104379 24113 raft_consensus.cc:2243] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 458d610e8abf4f2ea831ab7bf3576da6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.105089 24113 raft_consensus.cc:2272] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 458d610e8abf4f2ea831ab7bf3576da6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.107429 24113 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:02.108124 24113 raft_consensus.cc:2243] T 22ba83039f2d4e2c9089947b949a1790 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.108553 24113 raft_consensus.cc:2272] T 22ba83039f2d4e2c9089947b949a1790 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.111016 24113 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:02.111721 24113 raft_consensus.cc:2243] T ac45af43771c45fd8e57204c190c322b P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.112108 24113 raft_consensus.cc:2272] T ac45af43771c45fd8e57204c190c322b P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.114542 24113 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:02.115243 24113 raft_consensus.cc:2243] T a35171dce2e34beeafe34f3e80f18a41 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.116464 24113 raft_consensus.cc:2272] T a35171dce2e34beeafe34f3e80f18a41 P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.120124 24113 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:02.120841 24113 raft_consensus.cc:2243] T 36bf73ed3df141c889c046ad6902e304 P 458d610e8abf4f2ea831ab7bf3576da6 [term 4 LEADER]: Raft consensus shutting down.
W20260709 13:14:02.120883 31668 consensus_peers.cc:597] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 76fb155ade354ee1ba78673e73b28aca -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:02.121719 24113 raft_consensus.cc:2272] T 36bf73ed3df141c889c046ad6902e304 P 458d610e8abf4f2ea831ab7bf3576da6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.123642 24113 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:02.124171 24113 raft_consensus.cc:2243] T 2568dda6664d4363abc4fd891fa48370 P 458d610e8abf4f2ea831ab7bf3576da6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.124872 24113 raft_consensus.cc:2272] T 2568dda6664d4363abc4fd891fa48370 P 458d610e8abf4f2ea831ab7bf3576da6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.126964 24113 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:02.127481 24113 raft_consensus.cc:2243] T 11617136d6c14faea3cee24e00514101 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.127856 24113 raft_consensus.cc:2272] T 11617136d6c14faea3cee24e00514101 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.129896 24113 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:02.130409 24113 raft_consensus.cc:2243] T 1fb28788823d4c5fab527f4ee2da4d2e P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.130807 24113 raft_consensus.cc:2272] T 1fb28788823d4c5fab527f4ee2da4d2e P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.132679 24113 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:02.133188 24113 raft_consensus.cc:2243] T 4d146b574e8d4e21bd8d81cb29b4267a P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.133577 24113 raft_consensus.cc:2272] T 4d146b574e8d4e21bd8d81cb29b4267a P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.135546 24113 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:02.136077 24113 raft_consensus.cc:2243] T 4fe725ada8f142d1bb9a35a30f865c10 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.136466 24113 raft_consensus.cc:2272] T 4fe725ada8f142d1bb9a35a30f865c10 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.138288 24113 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:02.138834 24113 raft_consensus.cc:2243] T dcf07174e49c498f8e19fd005690404b P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.139554 24113 raft_consensus.cc:2272] T dcf07174e49c498f8e19fd005690404b P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.142035 24113 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:02.142762 24113 raft_consensus.cc:2243] T c8185106c7a94c3ebaace350d2363217 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:14:02.142777 31520 consensus_peers.cc:597] T 8a98dff441f1479992f85708c9f03283 P 196d972917fe4f85985e3862d40b7596 -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:02.143321 24113 raft_consensus.cc:2272] T c8185106c7a94c3ebaace350d2363217 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:02.144991 31594 consensus_peers.cc:597] T 53c18818aa9c44c8987bb675a05026a4 P c74453754ee34bea9b231ae318a55a31 -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:02.145815 24113 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:02.146373 24113 raft_consensus.cc:2243] T 0c12bd32cd944ce99a18fc4f9617961e P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.146771 24113 raft_consensus.cc:2272] T 0c12bd32cd944ce99a18fc4f9617961e P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.148737 24113 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:02.149251 24113 raft_consensus.cc:2243] T b3705de0af7a48f69f751aab333fdf3d P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.149622 24113 raft_consensus.cc:2272] T b3705de0af7a48f69f751aab333fdf3d P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.151538 24113 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:02.152065 24113 raft_consensus.cc:2243] T 5b669b8d34ee4de5b002d30fbcf02dd7 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.152506 24113 raft_consensus.cc:2272] T 5b669b8d34ee4de5b002d30fbcf02dd7 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.155056 24113 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:02.155750 24113 raft_consensus.cc:2243] T 5ea74721b8824d00b63c524b25ff23df P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.156184 24113 raft_consensus.cc:2272] T 5ea74721b8824d00b63c524b25ff23df P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.158758 24113 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:02.159439 24113 raft_consensus.cc:2243] T 35bbba26df1b47a7b9923618bf451ffc P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.159932 24113 raft_consensus.cc:2272] T 35bbba26df1b47a7b9923618bf451ffc P 458d610e8abf4f2ea831ab7bf3576da6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.162482 24113 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:02.163065 24113 raft_consensus.cc:2243] T 98a7e38754ed4644bf90b39aff07c70f P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.163533 24113 raft_consensus.cc:2272] T 98a7e38754ed4644bf90b39aff07c70f P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.166090 24113 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:02.166754 24113 raft_consensus.cc:2243] T 40ab5d7d13ee4460933b5799482e3f87 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.167191 24113 raft_consensus.cc:2272] T 40ab5d7d13ee4460933b5799482e3f87 P 458d610e8abf4f2ea831ab7bf3576da6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.169931 24113 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:02.170533 24113 raft_consensus.cc:2243] T b262a50e82034c57a4bfb7da683ff5d1 P 458d610e8abf4f2ea831ab7bf3576da6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.171432 24113 raft_consensus.cc:2272] T b262a50e82034c57a4bfb7da683ff5d1 P 458d610e8abf4f2ea831ab7bf3576da6 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:02.173849 31668 consensus_peers.cc:597] T 5b669b8d34ee4de5b002d30fbcf02dd7 P 76fb155ade354ee1ba78673e73b28aca -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:02.184098 31594 consensus_peers.cc:597] T f66580482b2d470bacbfec917042485b P c74453754ee34bea9b231ae318a55a31 -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:02.190230 31594 consensus_peers.cc:597] T 0c12bd32cd944ce99a18fc4f9617961e P c74453754ee34bea9b231ae318a55a31 -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:02.208712 31668 consensus_peers.cc:597] T 35bbba26df1b47a7b9923618bf451ffc P 76fb155ade354ee1ba78673e73b28aca -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:02.235814 24113 tablet_server.cc:196] TabletServer@127.23.140.65:37919 shutdown complete.
W20260709 13:14:02.240476 31520 consensus_peers.cc:597] T 497217e9b47244fcb425c66935cb8a20 P 196d972917fe4f85985e3862d40b7596 -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:37919: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:02.260531 31594 consensus_peers.cc:597] T 5ea74721b8824d00b63c524b25ff23df P c74453754ee34bea9b231ae318a55a31 -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:37919: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:02.265491 31520 consensus_peers.cc:597] T 88b0a29c38284391bdaea82edf99c771 P 196d972917fe4f85985e3862d40b7596 -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:37919: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:02.266512 31668 consensus_peers.cc:597] T 40ab5d7d13ee4460933b5799482e3f87 P 76fb155ade354ee1ba78673e73b28aca -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:37919: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:02.272873 31520 consensus_peers.cc:597] T 98a7e38754ed4644bf90b39aff07c70f P 196d972917fe4f85985e3862d40b7596 -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:37919: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:02.287352 31594 consensus_peers.cc:597] T 11617136d6c14faea3cee24e00514101 P c74453754ee34bea9b231ae318a55a31 -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:37919: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:02.290063 31594 consensus_peers.cc:597] T b3705de0af7a48f69f751aab333fdf3d P c74453754ee34bea9b231ae318a55a31 -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:37919: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:02.292253 31594 consensus_peers.cc:597] T 85d4a24725c749199c1b35d959b1b2b5 P c74453754ee34bea9b231ae318a55a31 -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:37919: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:02.316354 31520 consensus_peers.cc:597] T 81f4d53616e74e2ea71e52fdb3e8fc76 P 196d972917fe4f85985e3862d40b7596 -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:37919: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:02.322088 24113 tablet_server.cc:179] TabletServer@127.23.140.66:0 shutting down...
W20260709 13:14:02.333453 31592 consensus_peers.cc:597] T 11617136d6c14faea3cee24e00514101 P c74453754ee34bea9b231ae318a55a31 -> Peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Couldn't send request to peer 196d972917fe4f85985e3862d40b7596. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:02.347241 31666 consensus_peers.cc:597] T fb4f7292ed2f489e922ca5fb1c6e47bf P 76fb155ade354ee1ba78673e73b28aca -> Peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Couldn't send request to peer 196d972917fe4f85985e3862d40b7596. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:02.363065 31668 consensus_peers.cc:597] T 22ba83039f2d4e2c9089947b949a1790 P 76fb155ade354ee1ba78673e73b28aca -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:37919: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:02.366983 31668 consensus_peers.cc:597] T fb4f7292ed2f489e922ca5fb1c6e47bf P 76fb155ade354ee1ba78673e73b28aca -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:37919: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:02.369194 24113 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:14:02.369501 31668 consensus_peers.cc:597] T e698d6d2e2e74eca91e222e9bfdf8f13 P 76fb155ade354ee1ba78673e73b28aca -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:37919: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:02.370850 31592 consensus_peers.cc:597] T 256a5c9a935246e0a6c36b5b654fbbfb P c74453754ee34bea9b231ae318a55a31 -> Peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Couldn't send request to peer 196d972917fe4f85985e3862d40b7596. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:02.370909 24113 tablet_replica.cc:333] T dcf07174e49c498f8e19fd005690404b P 196d972917fe4f85985e3862d40b7596: stopping tablet replica
I20260709 13:14:02.372179 24113 raft_consensus.cc:2243] T dcf07174e49c498f8e19fd005690404b P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.372715 24113 raft_consensus.cc:2272] T dcf07174e49c498f8e19fd005690404b P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.375062 24113 tablet_replica.cc:333] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 196d972917fe4f85985e3862d40b7596: stopping tablet replica
I20260709 13:14:02.375885 24113 raft_consensus.cc:2243] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 196d972917fe4f85985e3862d40b7596 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.376808 24113 raft_consensus.cc:2272] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.378762 24113 tablet_replica.cc:333] T fb4f7292ed2f489e922ca5fb1c6e47bf P 196d972917fe4f85985e3862d40b7596: stopping tablet replica
I20260709 13:14:02.379307 24113 raft_consensus.cc:2243] T fb4f7292ed2f489e922ca5fb1c6e47bf P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.379724 24113 raft_consensus.cc:2272] T fb4f7292ed2f489e922ca5fb1c6e47bf P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.381587 24113 tablet_replica.cc:333] T 497217e9b47244fcb425c66935cb8a20 P 196d972917fe4f85985e3862d40b7596: stopping tablet replica
I20260709 13:14:02.382190 24113 raft_consensus.cc:2243] T 497217e9b47244fcb425c66935cb8a20 P 196d972917fe4f85985e3862d40b7596 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.382952 24113 raft_consensus.cc:2272] T 497217e9b47244fcb425c66935cb8a20 P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.385486 24113 tablet_replica.cc:333] T 6038006ca0e344af86fe5febd517c62a P 196d972917fe4f85985e3862d40b7596: stopping tablet replica
I20260709 13:14:02.386190 24113 raft_consensus.cc:2243] T 6038006ca0e344af86fe5febd517c62a P 196d972917fe4f85985e3862d40b7596 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.387151 24113 raft_consensus.cc:2272] T 6038006ca0e344af86fe5febd517c62a P 196d972917fe4f85985e3862d40b7596 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:02.388794 31666 consensus_peers.cc:597] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 76fb155ade354ee1ba78673e73b28aca -> Peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Couldn't send request to peer 196d972917fe4f85985e3862d40b7596. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:02.389736 24113 tablet_replica.cc:333] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P 196d972917fe4f85985e3862d40b7596: stopping tablet replica
I20260709 13:14:02.390640 24113 raft_consensus.cc:2243] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P 196d972917fe4f85985e3862d40b7596 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.391338 24113 raft_consensus.cc:2272] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.393359 24113 tablet_replica.cc:333] T 8a98dff441f1479992f85708c9f03283 P 196d972917fe4f85985e3862d40b7596: stopping tablet replica
I20260709 13:14:02.393915 24113 raft_consensus.cc:2243] T 8a98dff441f1479992f85708c9f03283 P 196d972917fe4f85985e3862d40b7596 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.394598 24113 raft_consensus.cc:2272] T 8a98dff441f1479992f85708c9f03283 P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.396503 24113 tablet_replica.cc:333] T 680d6e1f38f4469ebe14094aa66fdfac P 196d972917fe4f85985e3862d40b7596: stopping tablet replica
I20260709 13:14:02.396943 24113 raft_consensus.cc:2243] T 680d6e1f38f4469ebe14094aa66fdfac P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.397293 24113 raft_consensus.cc:2272] T 680d6e1f38f4469ebe14094aa66fdfac P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.398939 24113 tablet_replica.cc:333] T fb97ca15f56b46dd846db7b0ff156a32 P 196d972917fe4f85985e3862d40b7596: stopping tablet replica
I20260709 13:14:02.399422 24113 raft_consensus.cc:2243] T fb97ca15f56b46dd846db7b0ff156a32 P 196d972917fe4f85985e3862d40b7596 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.400030 24113 raft_consensus.cc:2272] T fb97ca15f56b46dd846db7b0ff156a32 P 196d972917fe4f85985e3862d40b7596 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.402408 24113 tablet_replica.cc:333] T 53c18818aa9c44c8987bb675a05026a4 P 196d972917fe4f85985e3862d40b7596: stopping tablet replica
I20260709 13:14:02.403152 24113 raft_consensus.cc:2243] T 53c18818aa9c44c8987bb675a05026a4 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.403653 24113 raft_consensus.cc:2272] T 53c18818aa9c44c8987bb675a05026a4 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.405467 24113 tablet_replica.cc:333] T 0550046442d4469c96ad37cbbb191915 P 196d972917fe4f85985e3862d40b7596: stopping tablet replica
I20260709 13:14:02.406046 24113 raft_consensus.cc:2243] T 0550046442d4469c96ad37cbbb191915 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.406424 24113 raft_consensus.cc:2272] T 0550046442d4469c96ad37cbbb191915 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.408270 24113 tablet_replica.cc:333] T 256a5c9a935246e0a6c36b5b654fbbfb P 196d972917fe4f85985e3862d40b7596: stopping tablet replica
I20260709 13:14:02.408766 24113 raft_consensus.cc:2243] T 256a5c9a935246e0a6c36b5b654fbbfb P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.409140 24113 raft_consensus.cc:2272] T 256a5c9a935246e0a6c36b5b654fbbfb P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.410758 24113 tablet_replica.cc:333] T 8c4f880f34664227ac8bd46378c9995f P 196d972917fe4f85985e3862d40b7596: stopping tablet replica
I20260709 13:14:02.411307 24113 raft_consensus.cc:2243] T 8c4f880f34664227ac8bd46378c9995f P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.411707 24113 raft_consensus.cc:2272] T 8c4f880f34664227ac8bd46378c9995f P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.413407 24113 tablet_replica.cc:333] T 216111c5962f4b82ae52414985988860 P 196d972917fe4f85985e3862d40b7596: stopping tablet replica
I20260709 13:14:02.413968 24113 raft_consensus.cc:2243] T 216111c5962f4b82ae52414985988860 P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.414378 24113 raft_consensus.cc:2272] T 216111c5962f4b82ae52414985988860 P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.416077 24113 tablet_replica.cc:333] T e3516a073925457498018b87cdbaa85f P 196d972917fe4f85985e3862d40b7596: stopping tablet replica
I20260709 13:14:02.416594 24113 raft_consensus.cc:2243] T e3516a073925457498018b87cdbaa85f P 196d972917fe4f85985e3862d40b7596 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.417356 24113 raft_consensus.cc:2272] T e3516a073925457498018b87cdbaa85f P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.419561 24113 tablet_replica.cc:333] T 81f4d53616e74e2ea71e52fdb3e8fc76 P 196d972917fe4f85985e3862d40b7596: stopping tablet replica
I20260709 13:14:02.420254 24113 raft_consensus.cc:2243] T 81f4d53616e74e2ea71e52fdb3e8fc76 P 196d972917fe4f85985e3862d40b7596 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.421171 24113 raft_consensus.cc:2272] T 81f4d53616e74e2ea71e52fdb3e8fc76 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.423202 24113 tablet_replica.cc:333] T 0f01040b42e14f0db6bcd06319237ddb P 196d972917fe4f85985e3862d40b7596: stopping tablet replica
I20260709 13:14:02.423761 24113 raft_consensus.cc:2243] T 0f01040b42e14f0db6bcd06319237ddb P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.424156 24113 raft_consensus.cc:2272] T 0f01040b42e14f0db6bcd06319237ddb P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.426605 24113 tablet_replica.cc:333] T de27ea68aab2485bb532389bb5c82433 P 196d972917fe4f85985e3862d40b7596: stopping tablet replica
I20260709 13:14:02.427039 24113 raft_consensus.cc:2243] T de27ea68aab2485bb532389bb5c82433 P 196d972917fe4f85985e3862d40b7596 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.427888 24113 raft_consensus.cc:2272] T de27ea68aab2485bb532389bb5c82433 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.430328 24113 tablet_replica.cc:333] T 76a7de5cfe774df68279e2e1e7361c6b P 196d972917fe4f85985e3862d40b7596: stopping tablet replica
I20260709 13:14:02.430856 24113 raft_consensus.cc:2243] T 76a7de5cfe774df68279e2e1e7361c6b P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.431336 24113 raft_consensus.cc:2272] T 76a7de5cfe774df68279e2e1e7361c6b P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.433719 24113 tablet_replica.cc:333] T 3e09c2945641463e91365b4826cc47e3 P 196d972917fe4f85985e3862d40b7596: stopping tablet replica
I20260709 13:14:02.434455 24113 raft_consensus.cc:2243] T 3e09c2945641463e91365b4826cc47e3 P 196d972917fe4f85985e3862d40b7596 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:14:02.434993 32565 consensus_queue.cc:1175] T 3e09c2945641463e91365b4826cc47e3 P 196d972917fe4f85985e3862d40b7596 [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c74453754ee34bea9b231ae318a55a31" responder_term: 2 status { last_received { term: 2 index: 2 } last_committed_idx: 2 last_received_current_leader { term: 2 index: 2 } }
I20260709 13:14:02.435705 24113 raft_consensus.cc:2272] T 3e09c2945641463e91365b4826cc47e3 P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.437564 24113 tablet_replica.cc:333] T eb560d89d58246e5856a763e3be6f086 P 196d972917fe4f85985e3862d40b7596: stopping tablet replica
I20260709 13:14:02.438112 24113 raft_consensus.cc:2243] T eb560d89d58246e5856a763e3be6f086 P 196d972917fe4f85985e3862d40b7596 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.438503 24113 raft_consensus.cc:2272] T eb560d89d58246e5856a763e3be6f086 P 196d972917fe4f85985e3862d40b7596 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.440636 24113 tablet_replica.cc:333] T e698d6d2e2e74eca91e222e9bfdf8f13 P 196d972917fe4f85985e3862d40b7596: stopping tablet replica
I20260709 13:14:02.441154 24113 raft_consensus.cc:2243] T e698d6d2e2e74eca91e222e9bfdf8f13 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.441604 24113 raft_consensus.cc:2272] T e698d6d2e2e74eca91e222e9bfdf8f13 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.443523 24113 tablet_replica.cc:333] T fc35ae8230cf4ab792d0e15bcaf8b653 P 196d972917fe4f85985e3862d40b7596: stopping tablet replica
I20260709 13:14:02.444044 24113 raft_consensus.cc:2243] T fc35ae8230cf4ab792d0e15bcaf8b653 P 196d972917fe4f85985e3862d40b7596 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.444794 24113 raft_consensus.cc:2272] T fc35ae8230cf4ab792d0e15bcaf8b653 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.446557 24113 tablet_replica.cc:333] T 075b9562a2b547c8aad80c2bae413556 P 196d972917fe4f85985e3862d40b7596: stopping tablet replica
I20260709 13:14:02.446995 24113 raft_consensus.cc:2243] T 075b9562a2b547c8aad80c2bae413556 P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.447336 24113 raft_consensus.cc:2272] T 075b9562a2b547c8aad80c2bae413556 P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.448861 24113 tablet_replica.cc:333] T 88b0a29c38284391bdaea82edf99c771 P 196d972917fe4f85985e3862d40b7596: stopping tablet replica
I20260709 13:14:02.449321 24113 raft_consensus.cc:2243] T 88b0a29c38284391bdaea82edf99c771 P 196d972917fe4f85985e3862d40b7596 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.450017 24113 raft_consensus.cc:2272] T 88b0a29c38284391bdaea82edf99c771 P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.451655 24113 tablet_replica.cc:333] T bd1c90f0a848434cb7df23dbeae35ddf P 196d972917fe4f85985e3862d40b7596: stopping tablet replica
I20260709 13:14:02.452121 24113 raft_consensus.cc:2243] T bd1c90f0a848434cb7df23dbeae35ddf P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.452469 24113 raft_consensus.cc:2272] T bd1c90f0a848434cb7df23dbeae35ddf P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.454631 24113 tablet_replica.cc:333] T bec9a61b8e3c4bc0ba232063b38c8563 P 196d972917fe4f85985e3862d40b7596: stopping tablet replica
I20260709 13:14:02.455394 24113 raft_consensus.cc:2243] T bec9a61b8e3c4bc0ba232063b38c8563 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.455916 24113 raft_consensus.cc:2272] T bec9a61b8e3c4bc0ba232063b38c8563 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.458683 24113 tablet_replica.cc:333] T 98a7e38754ed4644bf90b39aff07c70f P 196d972917fe4f85985e3862d40b7596: stopping tablet replica
I20260709 13:14:02.459443 24113 raft_consensus.cc:2243] T 98a7e38754ed4644bf90b39aff07c70f P 196d972917fe4f85985e3862d40b7596 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.461054 24113 raft_consensus.cc:2272] T 98a7e38754ed4644bf90b39aff07c70f P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:02.461480 31666 consensus_peers.cc:597] T bd1c90f0a848434cb7df23dbeae35ddf P 76fb155ade354ee1ba78673e73b28aca -> Peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Couldn't send request to peer 196d972917fe4f85985e3862d40b7596. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:02.463768 24113 tablet_replica.cc:333] T 36bf73ed3df141c889c046ad6902e304 P 196d972917fe4f85985e3862d40b7596: stopping tablet replica
I20260709 13:14:02.464573 24113 raft_consensus.cc:2243] T 36bf73ed3df141c889c046ad6902e304 P 196d972917fe4f85985e3862d40b7596 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.465049 24113 raft_consensus.cc:2272] T 36bf73ed3df141c889c046ad6902e304 P 196d972917fe4f85985e3862d40b7596 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.467370 24113 tablet_replica.cc:333] T a35171dce2e34beeafe34f3e80f18a41 P 196d972917fe4f85985e3862d40b7596: stopping tablet replica
I20260709 13:14:02.468042 24113 raft_consensus.cc:2243] T a35171dce2e34beeafe34f3e80f18a41 P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.468497 24113 raft_consensus.cc:2272] T a35171dce2e34beeafe34f3e80f18a41 P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:02.468866 31592 consensus_peers.cc:597] T 1e727ab6847b4fbab9a94b63842c6b9c P c74453754ee34bea9b231ae318a55a31 -> Peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Couldn't send request to peer 196d972917fe4f85985e3862d40b7596. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:02.471313 24113 tablet_replica.cc:333] T 11617136d6c14faea3cee24e00514101 P 196d972917fe4f85985e3862d40b7596: stopping tablet replica
I20260709 13:14:02.472082 24113 raft_consensus.cc:2243] T 11617136d6c14faea3cee24e00514101 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.472545 24113 raft_consensus.cc:2272] T 11617136d6c14faea3cee24e00514101 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.475162 24113 tablet_replica.cc:333] T 2568dda6664d4363abc4fd891fa48370 P 196d972917fe4f85985e3862d40b7596: stopping tablet replica
I20260709 13:14:02.476104 24113 raft_consensus.cc:2243] T 2568dda6664d4363abc4fd891fa48370 P 196d972917fe4f85985e3862d40b7596 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.476576 24113 raft_consensus.cc:2272] T 2568dda6664d4363abc4fd891fa48370 P 196d972917fe4f85985e3862d40b7596 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:02.476925 31594 consensus_peers.cc:597] T 1fb28788823d4c5fab527f4ee2da4d2e P c74453754ee34bea9b231ae318a55a31 -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:37919: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:02.477365 31594 consensus_peers.cc:597] T 4d146b574e8d4e21bd8d81cb29b4267a P c74453754ee34bea9b231ae318a55a31 -> Peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Couldn't send request to peer 458d610e8abf4f2ea831ab7bf3576da6. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:37919: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:02.478554 24113 tablet_replica.cc:333] T 40ab5d7d13ee4460933b5799482e3f87 P 196d972917fe4f85985e3862d40b7596: stopping tablet replica
I20260709 13:14:02.479172 24113 raft_consensus.cc:2243] T 40ab5d7d13ee4460933b5799482e3f87 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.479557 24113 raft_consensus.cc:2272] T 40ab5d7d13ee4460933b5799482e3f87 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.481300 24113 tablet_replica.cc:333] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 196d972917fe4f85985e3862d40b7596: stopping tablet replica
I20260709 13:14:02.481873 24113 raft_consensus.cc:2243] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 196d972917fe4f85985e3862d40b7596 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.482270 24113 raft_consensus.cc:2272] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 196d972917fe4f85985e3862d40b7596 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.483992 24113 tablet_replica.cc:333] T ac45af43771c45fd8e57204c190c322b P 196d972917fe4f85985e3862d40b7596: stopping tablet replica
I20260709 13:14:02.484494 24113 raft_consensus.cc:2243] T ac45af43771c45fd8e57204c190c322b P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.484895 24113 raft_consensus.cc:2272] T ac45af43771c45fd8e57204c190c322b P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.486603 24113 tablet_replica.cc:333] T 35bbba26df1b47a7b9923618bf451ffc P 196d972917fe4f85985e3862d40b7596: stopping tablet replica
I20260709 13:14:02.487149 24113 raft_consensus.cc:2243] T 35bbba26df1b47a7b9923618bf451ffc P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.487538 24113 raft_consensus.cc:2272] T 35bbba26df1b47a7b9923618bf451ffc P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.489302 24113 tablet_replica.cc:333] T 5ea74721b8824d00b63c524b25ff23df P 196d972917fe4f85985e3862d40b7596: stopping tablet replica
I20260709 13:14:02.489845 24113 raft_consensus.cc:2243] T 5ea74721b8824d00b63c524b25ff23df P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.490239 24113 raft_consensus.cc:2272] T 5ea74721b8824d00b63c524b25ff23df P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.491977 24113 tablet_replica.cc:333] T cfe1afd9e187451faf5f631e0c2eef00 P 196d972917fe4f85985e3862d40b7596: stopping tablet replica
I20260709 13:14:02.492470 24113 raft_consensus.cc:2243] T cfe1afd9e187451faf5f631e0c2eef00 P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.492856 24113 raft_consensus.cc:2272] T cfe1afd9e187451faf5f631e0c2eef00 P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.494737 24113 tablet_replica.cc:333] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 196d972917fe4f85985e3862d40b7596: stopping tablet replica
I20260709 13:14:02.495209 24113 raft_consensus.cc:2243] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.495599 24113 raft_consensus.cc:2272] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.497357 24113 tablet_replica.cc:333] T 0c12bd32cd944ce99a18fc4f9617961e P 196d972917fe4f85985e3862d40b7596: stopping tablet replica
I20260709 13:14:02.498015 24113 raft_consensus.cc:2243] T 0c12bd32cd944ce99a18fc4f9617961e P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.498476 24113 raft_consensus.cc:2272] T 0c12bd32cd944ce99a18fc4f9617961e P 196d972917fe4f85985e3862d40b7596 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.500433 24113 tablet_replica.cc:333] T 3879ebc472ce44d99940e2168e9099bf P 196d972917fe4f85985e3862d40b7596: stopping tablet replica
I20260709 13:14:02.500968 24113 raft_consensus.cc:2243] T 3879ebc472ce44d99940e2168e9099bf P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:14:02.501137 31592 consensus_peers.cc:597] T ac45af43771c45fd8e57204c190c322b P c74453754ee34bea9b231ae318a55a31 -> Peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Couldn't send request to peer 196d972917fe4f85985e3862d40b7596. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:02.501386 24113 raft_consensus.cc:2272] T 3879ebc472ce44d99940e2168e9099bf P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.503451 24113 tablet_replica.cc:333] T c8185106c7a94c3ebaace350d2363217 P 196d972917fe4f85985e3862d40b7596: stopping tablet replica
I20260709 13:14:02.503925 24113 raft_consensus.cc:2243] T c8185106c7a94c3ebaace350d2363217 P 196d972917fe4f85985e3862d40b7596 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.504582 24113 raft_consensus.cc:2272] T c8185106c7a94c3ebaace350d2363217 P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.506327 24113 tablet_replica.cc:333] T 1e727ab6847b4fbab9a94b63842c6b9c P 196d972917fe4f85985e3862d40b7596: stopping tablet replica
I20260709 13:14:02.506788 24113 raft_consensus.cc:2243] T 1e727ab6847b4fbab9a94b63842c6b9c P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.507161 24113 raft_consensus.cc:2272] T 1e727ab6847b4fbab9a94b63842c6b9c P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.508867 24113 tablet_replica.cc:333] T 42f4b6d5299848c89ceb268c1fd088af P 196d972917fe4f85985e3862d40b7596: stopping tablet replica
I20260709 13:14:02.509331 24113 raft_consensus.cc:2243] T 42f4b6d5299848c89ceb268c1fd088af P 196d972917fe4f85985e3862d40b7596 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.510063 24113 raft_consensus.cc:2272] T 42f4b6d5299848c89ceb268c1fd088af P 196d972917fe4f85985e3862d40b7596 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:02.550686 31666 consensus_peers.cc:597] T 3879ebc472ce44d99940e2168e9099bf P 76fb155ade354ee1ba78673e73b28aca -> Peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Couldn't send request to peer 196d972917fe4f85985e3862d40b7596. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:02.555040 31592 consensus_peers.cc:597] T 5ea74721b8824d00b63c524b25ff23df P c74453754ee34bea9b231ae318a55a31 -> Peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Couldn't send request to peer 196d972917fe4f85985e3862d40b7596. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:02.572921 31666 consensus_peers.cc:597] T 35bbba26df1b47a7b9923618bf451ffc P 76fb155ade354ee1ba78673e73b28aca -> Peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Couldn't send request to peer 196d972917fe4f85985e3862d40b7596. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:02.590741 31666 consensus_peers.cc:597] T 40ab5d7d13ee4460933b5799482e3f87 P 76fb155ade354ee1ba78673e73b28aca -> Peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Couldn't send request to peer 196d972917fe4f85985e3862d40b7596. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.66:37431: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:02.594789 24113 tablet_server.cc:196] TabletServer@127.23.140.66:0 shutdown complete.
W20260709 13:14:02.594842 31666 consensus_peers.cc:597] T 680d6e1f38f4469ebe14094aa66fdfac P 76fb155ade354ee1ba78673e73b28aca -> Peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Couldn't send request to peer 196d972917fe4f85985e3862d40b7596. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.66:37431: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:02.604058 31666 consensus_peers.cc:597] T e698d6d2e2e74eca91e222e9bfdf8f13 P 76fb155ade354ee1ba78673e73b28aca -> Peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Couldn't send request to peer 196d972917fe4f85985e3862d40b7596. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.66:37431: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:02.657603 31666 consensus_peers.cc:597] T 0f01040b42e14f0db6bcd06319237ddb P 76fb155ade354ee1ba78673e73b28aca -> Peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Couldn't send request to peer 196d972917fe4f85985e3862d40b7596. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.66:37431: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:02.672734 24113 tablet_server.cc:179] TabletServer@127.23.140.67:0 shutting down...
W20260709 13:14:02.701524 31669 consensus_peers.cc:597] T 3879ebc472ce44d99940e2168e9099bf P 76fb155ade354ee1ba78673e73b28aca -> Peer c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791): Couldn't send request to peer c74453754ee34bea9b231ae318a55a31. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:02.710362 31666 consensus_peers.cc:597] T 8c4f880f34664227ac8bd46378c9995f P 76fb155ade354ee1ba78673e73b28aca -> Peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Couldn't send request to peer 196d972917fe4f85985e3862d40b7596. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.66:37431: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:02.727000 24113 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:14:02.728245 31666 consensus_peers.cc:597] T 0550046442d4469c96ad37cbbb191915 P 76fb155ade354ee1ba78673e73b28aca -> Peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Couldn't send request to peer 196d972917fe4f85985e3862d40b7596. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.66:37431: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:02.729914 24113 tablet_replica.cc:333] T 70ccde113c9246f5a008add70aacae7d P c74453754ee34bea9b231ae318a55a31: stopping tablet replica
I20260709 13:14:02.730614 24113 raft_consensus.cc:2243] T 70ccde113c9246f5a008add70aacae7d P c74453754ee34bea9b231ae318a55a31 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:14:02.731377 31666 consensus_peers.cc:597] T bec9a61b8e3c4bc0ba232063b38c8563 P 76fb155ade354ee1ba78673e73b28aca -> Peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Couldn't send request to peer 196d972917fe4f85985e3862d40b7596. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.66:37431: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:02.731444 24113 raft_consensus.cc:2272] T 70ccde113c9246f5a008add70aacae7d P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.733860 24113 tablet_replica.cc:333] T cfe1afd9e187451faf5f631e0c2eef00 P c74453754ee34bea9b231ae318a55a31: stopping tablet replica
I20260709 13:14:02.734438 24113 raft_consensus.cc:2243] T cfe1afd9e187451faf5f631e0c2eef00 P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.734925 24113 raft_consensus.cc:2272] T cfe1afd9e187451faf5f631e0c2eef00 P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.736750 24113 tablet_replica.cc:333] T b262a50e82034c57a4bfb7da683ff5d1 P c74453754ee34bea9b231ae318a55a31: stopping tablet replica
I20260709 13:14:02.737309 24113 raft_consensus.cc:2243] T b262a50e82034c57a4bfb7da683ff5d1 P c74453754ee34bea9b231ae318a55a31 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.737715 24113 raft_consensus.cc:2272] T b262a50e82034c57a4bfb7da683ff5d1 P c74453754ee34bea9b231ae318a55a31 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.739554 24113 tablet_replica.cc:333] T ddbfc15d5bf24708a4268dfa206ede07 P c74453754ee34bea9b231ae318a55a31: stopping tablet replica
I20260709 13:14:02.740093 24113 raft_consensus.cc:2243] T ddbfc15d5bf24708a4268dfa206ede07 P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.740470 24113 raft_consensus.cc:2272] T ddbfc15d5bf24708a4268dfa206ede07 P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.742295 24113 tablet_replica.cc:333] T 88b0a29c38284391bdaea82edf99c771 P c74453754ee34bea9b231ae318a55a31: stopping tablet replica
I20260709 13:14:02.742837 24113 raft_consensus.cc:2243] T 88b0a29c38284391bdaea82edf99c771 P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.743237 24113 raft_consensus.cc:2272] T 88b0a29c38284391bdaea82edf99c771 P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.744890 24113 tablet_replica.cc:333] T 6038006ca0e344af86fe5febd517c62a P c74453754ee34bea9b231ae318a55a31: stopping tablet replica
I20260709 13:14:02.745493 24113 raft_consensus.cc:2243] T 6038006ca0e344af86fe5febd517c62a P c74453754ee34bea9b231ae318a55a31 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.745925 24113 raft_consensus.cc:2272] T 6038006ca0e344af86fe5febd517c62a P c74453754ee34bea9b231ae318a55a31 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.747609 24113 tablet_replica.cc:333] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P c74453754ee34bea9b231ae318a55a31: stopping tablet replica
I20260709 13:14:02.748397 24113 raft_consensus.cc:2243] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.748823 24113 raft_consensus.cc:2272] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.751248 24113 tablet_replica.cc:333] T 497217e9b47244fcb425c66935cb8a20 P c74453754ee34bea9b231ae318a55a31: stopping tablet replica
I20260709 13:14:02.751936 24113 raft_consensus.cc:2243] T 497217e9b47244fcb425c66935cb8a20 P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.752380 24113 raft_consensus.cc:2272] T 497217e9b47244fcb425c66935cb8a20 P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:02.752477 31592 consensus_peers.cc:597] T 53c18818aa9c44c8987bb675a05026a4 P c74453754ee34bea9b231ae318a55a31 -> Peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Couldn't send request to peer 196d972917fe4f85985e3862d40b7596. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.66:37431: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:02.754426 24113 tablet_replica.cc:333] T 47cb0ae4817d4c19ac11b42143d00039 P c74453754ee34bea9b231ae318a55a31: stopping tablet replica
I20260709 13:14:02.755019 24113 raft_consensus.cc:2243] T 47cb0ae4817d4c19ac11b42143d00039 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.755506 24113 raft_consensus.cc:2272] T 47cb0ae4817d4c19ac11b42143d00039 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.758064 24113 tablet_replica.cc:333] T 85d4a24725c749199c1b35d959b1b2b5 P c74453754ee34bea9b231ae318a55a31: stopping tablet replica
I20260709 13:14:02.758790 24113 raft_consensus.cc:2243] T 85d4a24725c749199c1b35d959b1b2b5 P c74453754ee34bea9b231ae318a55a31 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.759729 24113 raft_consensus.cc:2272] T 85d4a24725c749199c1b35d959b1b2b5 P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.761849 24113 tablet_replica.cc:333] T ee6c632286174388ab5e7bfb2ae40078 P c74453754ee34bea9b231ae318a55a31: stopping tablet replica
I20260709 13:14:02.762408 24113 raft_consensus.cc:2243] T ee6c632286174388ab5e7bfb2ae40078 P c74453754ee34bea9b231ae318a55a31 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.762795 24113 raft_consensus.cc:2272] T ee6c632286174388ab5e7bfb2ae40078 P c74453754ee34bea9b231ae318a55a31 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.764730 24113 tablet_replica.cc:333] T fb97ca15f56b46dd846db7b0ff156a32 P c74453754ee34bea9b231ae318a55a31: stopping tablet replica
I20260709 13:14:02.765506 24113 raft_consensus.cc:2243] T fb97ca15f56b46dd846db7b0ff156a32 P c74453754ee34bea9b231ae318a55a31 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.765976 24113 raft_consensus.cc:2272] T fb97ca15f56b46dd846db7b0ff156a32 P c74453754ee34bea9b231ae318a55a31 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.768388 24113 tablet_replica.cc:333] T 53c18818aa9c44c8987bb675a05026a4 P c74453754ee34bea9b231ae318a55a31: stopping tablet replica
I20260709 13:14:02.768896 24113 raft_consensus.cc:2243] T 53c18818aa9c44c8987bb675a05026a4 P c74453754ee34bea9b231ae318a55a31 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.769695 24113 raft_consensus.cc:2272] T 53c18818aa9c44c8987bb675a05026a4 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.771519 24113 tablet_replica.cc:333] T 680d6e1f38f4469ebe14094aa66fdfac P c74453754ee34bea9b231ae318a55a31: stopping tablet replica
I20260709 13:14:02.772030 24113 raft_consensus.cc:2243] T 680d6e1f38f4469ebe14094aa66fdfac P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.772421 24113 raft_consensus.cc:2272] T 680d6e1f38f4469ebe14094aa66fdfac P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.774569 24113 tablet_replica.cc:333] T 0550046442d4469c96ad37cbbb191915 P c74453754ee34bea9b231ae318a55a31: stopping tablet replica
I20260709 13:14:02.775307 24113 raft_consensus.cc:2243] T 0550046442d4469c96ad37cbbb191915 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.775880 24113 raft_consensus.cc:2272] T 0550046442d4469c96ad37cbbb191915 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.778226 24113 tablet_replica.cc:333] T 8c4f880f34664227ac8bd46378c9995f P c74453754ee34bea9b231ae318a55a31: stopping tablet replica
I20260709 13:14:02.778746 24113 raft_consensus.cc:2243] T 8c4f880f34664227ac8bd46378c9995f P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.779160 24113 raft_consensus.cc:2272] T 8c4f880f34664227ac8bd46378c9995f P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.780956 24113 tablet_replica.cc:333] T 256a5c9a935246e0a6c36b5b654fbbfb P c74453754ee34bea9b231ae318a55a31: stopping tablet replica
I20260709 13:14:02.781522 24113 raft_consensus.cc:2243] T 256a5c9a935246e0a6c36b5b654fbbfb P c74453754ee34bea9b231ae318a55a31 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.782228 24113 raft_consensus.cc:2272] T 256a5c9a935246e0a6c36b5b654fbbfb P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.784575 24113 tablet_replica.cc:333] T fc35ae8230cf4ab792d0e15bcaf8b653 P c74453754ee34bea9b231ae318a55a31: stopping tablet replica
I20260709 13:14:02.785245 24113 raft_consensus.cc:2243] T fc35ae8230cf4ab792d0e15bcaf8b653 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.785768 24113 raft_consensus.cc:2272] T fc35ae8230cf4ab792d0e15bcaf8b653 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.788327 24113 tablet_replica.cc:333] T e3516a073925457498018b87cdbaa85f P c74453754ee34bea9b231ae318a55a31: stopping tablet replica
I20260709 13:14:02.789068 24113 raft_consensus.cc:2243] T e3516a073925457498018b87cdbaa85f P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.789565 24113 raft_consensus.cc:2272] T e3516a073925457498018b87cdbaa85f P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.792568 24113 tablet_replica.cc:333] T b3705de0af7a48f69f751aab333fdf3d P c74453754ee34bea9b231ae318a55a31: stopping tablet replica
I20260709 13:14:02.793327 24113 raft_consensus.cc:2243] T b3705de0af7a48f69f751aab333fdf3d P c74453754ee34bea9b231ae318a55a31 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.794256 24113 raft_consensus.cc:2272] T b3705de0af7a48f69f751aab333fdf3d P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.796947 24113 tablet_replica.cc:333] T 5ea74721b8824d00b63c524b25ff23df P c74453754ee34bea9b231ae318a55a31: stopping tablet replica
I20260709 13:14:02.797719 24113 raft_consensus.cc:2243] T 5ea74721b8824d00b63c524b25ff23df P c74453754ee34bea9b231ae318a55a31 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.798991 24113 raft_consensus.cc:2272] T 5ea74721b8824d00b63c524b25ff23df P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.802642 24113 tablet_replica.cc:333] T 5b669b8d34ee4de5b002d30fbcf02dd7 P c74453754ee34bea9b231ae318a55a31: stopping tablet replica
I20260709 13:14:02.803506 24113 raft_consensus.cc:2243] T 5b669b8d34ee4de5b002d30fbcf02dd7 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.804138 24113 raft_consensus.cc:2272] T 5b669b8d34ee4de5b002d30fbcf02dd7 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.806675 24113 tablet_replica.cc:333] T bec9a61b8e3c4bc0ba232063b38c8563 P c74453754ee34bea9b231ae318a55a31: stopping tablet replica
I20260709 13:14:02.807338 24113 raft_consensus.cc:2243] T bec9a61b8e3c4bc0ba232063b38c8563 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.807770 24113 raft_consensus.cc:2272] T bec9a61b8e3c4bc0ba232063b38c8563 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.809645 24113 tablet_replica.cc:333] T d78bdf917ee94331b91cb3fb308ef2a1 P c74453754ee34bea9b231ae318a55a31: stopping tablet replica
I20260709 13:14:02.810163 24113 raft_consensus.cc:2243] T d78bdf917ee94331b91cb3fb308ef2a1 P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.810546 24113 raft_consensus.cc:2272] T d78bdf917ee94331b91cb3fb308ef2a1 P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.812640 24113 tablet_replica.cc:333] T 11617136d6c14faea3cee24e00514101 P c74453754ee34bea9b231ae318a55a31: stopping tablet replica
I20260709 13:14:02.813378 24113 raft_consensus.cc:2243] T 11617136d6c14faea3cee24e00514101 P c74453754ee34bea9b231ae318a55a31 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.814116 24113 raft_consensus.cc:2272] T 11617136d6c14faea3cee24e00514101 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.816437 24113 tablet_replica.cc:333] T 2568dda6664d4363abc4fd891fa48370 P c74453754ee34bea9b231ae318a55a31: stopping tablet replica
I20260709 13:14:02.816900 24113 raft_consensus.cc:2243] T 2568dda6664d4363abc4fd891fa48370 P c74453754ee34bea9b231ae318a55a31 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.817221 24113 raft_consensus.cc:2272] T 2568dda6664d4363abc4fd891fa48370 P c74453754ee34bea9b231ae318a55a31 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.818850 24113 tablet_replica.cc:333] T 98a7e38754ed4644bf90b39aff07c70f P c74453754ee34bea9b231ae318a55a31: stopping tablet replica
I20260709 13:14:02.819300 24113 raft_consensus.cc:2243] T 98a7e38754ed4644bf90b39aff07c70f P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.819630 24113 raft_consensus.cc:2272] T 98a7e38754ed4644bf90b39aff07c70f P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.821403 24113 tablet_replica.cc:333] T 81f4d53616e74e2ea71e52fdb3e8fc76 P c74453754ee34bea9b231ae318a55a31: stopping tablet replica
I20260709 13:14:02.821908 24113 raft_consensus.cc:2243] T 81f4d53616e74e2ea71e52fdb3e8fc76 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.822237 24113 raft_consensus.cc:2272] T 81f4d53616e74e2ea71e52fdb3e8fc76 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.823849 24113 tablet_replica.cc:333] T 0f01040b42e14f0db6bcd06319237ddb P c74453754ee34bea9b231ae318a55a31: stopping tablet replica
I20260709 13:14:02.824419 24113 raft_consensus.cc:2243] T 0f01040b42e14f0db6bcd06319237ddb P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.824744 24113 raft_consensus.cc:2272] T 0f01040b42e14f0db6bcd06319237ddb P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.826387 24113 tablet_replica.cc:333] T de27ea68aab2485bb532389bb5c82433 P c74453754ee34bea9b231ae318a55a31: stopping tablet replica
I20260709 13:14:02.826809 24113 raft_consensus.cc:2243] T de27ea68aab2485bb532389bb5c82433 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.827124 24113 raft_consensus.cc:2272] T de27ea68aab2485bb532389bb5c82433 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.828732 24113 tablet_replica.cc:333] T 3e09c2945641463e91365b4826cc47e3 P c74453754ee34bea9b231ae318a55a31: stopping tablet replica
I20260709 13:14:02.829171 24113 raft_consensus.cc:2243] T 3e09c2945641463e91365b4826cc47e3 P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.829499 24113 raft_consensus.cc:2272] T 3e09c2945641463e91365b4826cc47e3 P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.831213 24113 tablet_replica.cc:333] T 364efc87879c4e6db82a829c76ef0045 P c74453754ee34bea9b231ae318a55a31: stopping tablet replica
I20260709 13:14:02.831723 24113 raft_consensus.cc:2243] T 364efc87879c4e6db82a829c76ef0045 P c74453754ee34bea9b231ae318a55a31 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.832386 24113 raft_consensus.cc:2272] T 364efc87879c4e6db82a829c76ef0045 P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.834219 24113 tablet_replica.cc:333] T 1fb28788823d4c5fab527f4ee2da4d2e P c74453754ee34bea9b231ae318a55a31: stopping tablet replica
I20260709 13:14:02.834685 24113 raft_consensus.cc:2243] T 1fb28788823d4c5fab527f4ee2da4d2e P c74453754ee34bea9b231ae318a55a31 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.835357 24113 raft_consensus.cc:2272] T 1fb28788823d4c5fab527f4ee2da4d2e P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.837069 24113 tablet_replica.cc:333] T 4d146b574e8d4e21bd8d81cb29b4267a P c74453754ee34bea9b231ae318a55a31: stopping tablet replica
I20260709 13:14:02.837514 24113 raft_consensus.cc:2243] T 4d146b574e8d4e21bd8d81cb29b4267a P c74453754ee34bea9b231ae318a55a31 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.838410 24113 raft_consensus.cc:2272] T 4d146b574e8d4e21bd8d81cb29b4267a P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.840140 24113 tablet_replica.cc:333] T dcf07174e49c498f8e19fd005690404b P c74453754ee34bea9b231ae318a55a31: stopping tablet replica
I20260709 13:14:02.840598 24113 raft_consensus.cc:2243] T dcf07174e49c498f8e19fd005690404b P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.840950 24113 raft_consensus.cc:2272] T dcf07174e49c498f8e19fd005690404b P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.842887 24113 tablet_replica.cc:333] T 4fe725ada8f142d1bb9a35a30f865c10 P c74453754ee34bea9b231ae318a55a31: stopping tablet replica
I20260709 13:14:02.843321 24113 raft_consensus.cc:2243] T 4fe725ada8f142d1bb9a35a30f865c10 P c74453754ee34bea9b231ae318a55a31 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.843968 24113 raft_consensus.cc:2272] T 4fe725ada8f142d1bb9a35a30f865c10 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.845777 24113 tablet_replica.cc:333] T f66580482b2d470bacbfec917042485b P c74453754ee34bea9b231ae318a55a31: stopping tablet replica
I20260709 13:14:02.846221 24113 raft_consensus.cc:2243] T f66580482b2d470bacbfec917042485b P c74453754ee34bea9b231ae318a55a31 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.846858 24113 raft_consensus.cc:2272] T f66580482b2d470bacbfec917042485b P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.848577 24113 tablet_replica.cc:333] T 22ba83039f2d4e2c9089947b949a1790 P c74453754ee34bea9b231ae318a55a31: stopping tablet replica
I20260709 13:14:02.849100 24113 raft_consensus.cc:2243] T 22ba83039f2d4e2c9089947b949a1790 P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.849444 24113 raft_consensus.cc:2272] T 22ba83039f2d4e2c9089947b949a1790 P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.851193 24113 tablet_replica.cc:333] T ac45af43771c45fd8e57204c190c322b P c74453754ee34bea9b231ae318a55a31: stopping tablet replica
I20260709 13:14:02.851747 24113 raft_consensus.cc:2243] T ac45af43771c45fd8e57204c190c322b P c74453754ee34bea9b231ae318a55a31 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.852605 24113 raft_consensus.cc:2272] T ac45af43771c45fd8e57204c190c322b P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.854966 24113 tablet_replica.cc:333] T 3879ebc472ce44d99940e2168e9099bf P c74453754ee34bea9b231ae318a55a31: stopping tablet replica
W20260709 13:14:02.855541 31592 consensus_peers.cc:597] T 0c12bd32cd944ce99a18fc4f9617961e P c74453754ee34bea9b231ae318a55a31 -> Peer 196d972917fe4f85985e3862d40b7596 (127.23.140.66:37431): Couldn't send request to peer 196d972917fe4f85985e3862d40b7596. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.66:37431: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:02.855594 24113 raft_consensus.cc:2243] T 3879ebc472ce44d99940e2168e9099bf P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.856334 24113 raft_consensus.cc:2272] T 3879ebc472ce44d99940e2168e9099bf P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.858541 24113 tablet_replica.cc:333] T 0c12bd32cd944ce99a18fc4f9617961e P c74453754ee34bea9b231ae318a55a31: stopping tablet replica
I20260709 13:14:02.859181 24113 raft_consensus.cc:2243] T 0c12bd32cd944ce99a18fc4f9617961e P c74453754ee34bea9b231ae318a55a31 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.859997 24113 raft_consensus.cc:2272] T 0c12bd32cd944ce99a18fc4f9617961e P c74453754ee34bea9b231ae318a55a31 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.861980 24113 tablet_replica.cc:333] T c8185106c7a94c3ebaace350d2363217 P c74453754ee34bea9b231ae318a55a31: stopping tablet replica
I20260709 13:14:02.862473 24113 raft_consensus.cc:2243] T c8185106c7a94c3ebaace350d2363217 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.862888 24113 raft_consensus.cc:2272] T c8185106c7a94c3ebaace350d2363217 P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.864686 24113 tablet_replica.cc:333] T 1e727ab6847b4fbab9a94b63842c6b9c P c74453754ee34bea9b231ae318a55a31: stopping tablet replica
I20260709 13:14:02.865155 24113 raft_consensus.cc:2243] T 1e727ab6847b4fbab9a94b63842c6b9c P c74453754ee34bea9b231ae318a55a31 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.865938 24113 raft_consensus.cc:2272] T 1e727ab6847b4fbab9a94b63842c6b9c P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.867700 24113 tablet_replica.cc:333] T 42f4b6d5299848c89ceb268c1fd088af P c74453754ee34bea9b231ae318a55a31: stopping tablet replica
I20260709 13:14:02.868145 24113 raft_consensus.cc:2243] T 42f4b6d5299848c89ceb268c1fd088af P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.868535 24113 raft_consensus.cc:2272] T 42f4b6d5299848c89ceb268c1fd088af P c74453754ee34bea9b231ae318a55a31 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:02.906138 31669 consensus_peers.cc:597] T 0f01040b42e14f0db6bcd06319237ddb P 76fb155ade354ee1ba78673e73b28aca -> Peer c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791): Couldn't send request to peer c74453754ee34bea9b231ae318a55a31. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:02.917481 31669 consensus_peers.cc:597] T 22ba83039f2d4e2c9089947b949a1790 P 76fb155ade354ee1ba78673e73b28aca -> Peer c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791): Couldn't send request to peer c74453754ee34bea9b231ae318a55a31. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:02.921368 31669 consensus_peers.cc:597] T 47cb0ae4817d4c19ac11b42143d00039 P 76fb155ade354ee1ba78673e73b28aca -> Peer c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791): Couldn't send request to peer c74453754ee34bea9b231ae318a55a31. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:02.953866 24113 tablet_server.cc:196] TabletServer@127.23.140.67:0 shutdown complete.
W20260709 13:14:02.970252 31669 consensus_peers.cc:597] T 0550046442d4469c96ad37cbbb191915 P 76fb155ade354ee1ba78673e73b28aca -> Peer c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791): Couldn't send request to peer c74453754ee34bea9b231ae318a55a31. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.67:35791: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:03.024748 31669 consensus_peers.cc:597] T 5b669b8d34ee4de5b002d30fbcf02dd7 P 76fb155ade354ee1ba78673e73b28aca -> Peer c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791): Couldn't send request to peer c74453754ee34bea9b231ae318a55a31. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.67:35791: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:03.026268 24113 tablet_server.cc:179] TabletServer@127.23.140.68:0 shutting down...
I20260709 13:14:03.056495 32442 raft_consensus.cc:493] T ee6c632286174388ab5e7bfb2ae40078 P 76fb155ade354ee1ba78673e73b28aca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 458d610e8abf4f2ea831ab7bf3576da6)
I20260709 13:14:03.056998 32442 raft_consensus.cc:515] T ee6c632286174388ab5e7bfb2ae40078 P 76fb155ade354ee1ba78673e73b28aca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74453754ee34bea9b231ae318a55a31" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 35791 } } peers { permanent_uuid: "76fb155ade354ee1ba78673e73b28aca" member_type: VOTER last_known_addr { host: "127.23.140.68" port: 45715 } } peers { permanent_uuid: "458d610e8abf4f2ea831ab7bf3576da6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 37919 } }
I20260709 13:14:03.058552 32442 leader_election.cc:290] T ee6c632286174388ab5e7bfb2ae40078 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791), 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919)
W20260709 13:14:03.062613 31668 leader_election.cc:336] T ee6c632286174388ab5e7bfb2ae40078 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 458d610e8abf4f2ea831ab7bf3576da6 (127.23.140.65:37919): Network error: Client connection negotiation failed: client connection to 127.23.140.65:37919: connect: Connection refused (error 111)
W20260709 13:14:03.063127 31669 leader_election.cc:336] T ee6c632286174388ab5e7bfb2ae40078 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c74453754ee34bea9b231ae318a55a31 (127.23.140.67:35791): Network error: Client connection negotiation failed: client connection to 127.23.140.67:35791: connect: Connection refused (error 111)
I20260709 13:14:03.063567 31669 leader_election.cc:304] T ee6c632286174388ab5e7bfb2ae40078 P 76fb155ade354ee1ba78673e73b28aca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 76fb155ade354ee1ba78673e73b28aca; no voters: 458d610e8abf4f2ea831ab7bf3576da6, c74453754ee34bea9b231ae318a55a31
I20260709 13:14:03.064337 32442 raft_consensus.cc:2749] T ee6c632286174388ab5e7bfb2ae40078 P 76fb155ade354ee1ba78673e73b28aca [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:03.069500 24113 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:03.070428 24113 tablet_replica.cc:333] T 3879ebc472ce44d99940e2168e9099bf P 76fb155ade354ee1ba78673e73b28aca: stopping tablet replica
I20260709 13:14:03.071107 24113 raft_consensus.cc:2243] T 3879ebc472ce44d99940e2168e9099bf P 76fb155ade354ee1ba78673e73b28aca [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:03.071874 24113 raft_consensus.cc:2272] T 3879ebc472ce44d99940e2168e9099bf P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.073870 24113 tablet_replica.cc:333] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 76fb155ade354ee1ba78673e73b28aca: stopping tablet replica
I20260709 13:14:03.074378 24113 raft_consensus.cc:2243] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.074756 24113 raft_consensus.cc:2272] T d2a6746f9b2f4b1ab287b9e8f4c51106 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.076912 24113 tablet_replica.cc:333] T fb97ca15f56b46dd846db7b0ff156a32 P 76fb155ade354ee1ba78673e73b28aca: stopping tablet replica
I20260709 13:14:03.077464 24113 raft_consensus.cc:2243] T fb97ca15f56b46dd846db7b0ff156a32 P 76fb155ade354ee1ba78673e73b28aca [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.077901 24113 raft_consensus.cc:2272] T fb97ca15f56b46dd846db7b0ff156a32 P 76fb155ade354ee1ba78673e73b28aca [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.079931 24113 tablet_replica.cc:333] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P 76fb155ade354ee1ba78673e73b28aca: stopping tablet replica
I20260709 13:14:03.080487 24113 raft_consensus.cc:2243] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.080856 24113 raft_consensus.cc:2272] T 0ee7f4cbe2594c5793b2cb27e1dd4b34 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.082548 24113 tablet_replica.cc:333] T 22ba83039f2d4e2c9089947b949a1790 P 76fb155ade354ee1ba78673e73b28aca: stopping tablet replica
I20260709 13:14:03.083053 24113 raft_consensus.cc:2243] T 22ba83039f2d4e2c9089947b949a1790 P 76fb155ade354ee1ba78673e73b28aca [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:03.083773 24113 raft_consensus.cc:2272] T 22ba83039f2d4e2c9089947b949a1790 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.085419 24113 tablet_replica.cc:333] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 76fb155ade354ee1ba78673e73b28aca: stopping tablet replica
I20260709 13:14:03.085973 24113 raft_consensus.cc:2243] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 76fb155ade354ee1ba78673e73b28aca [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.086345 24113 raft_consensus.cc:2272] T bdf0c159a4f34a2abd10a0f7c60b5fbf P 76fb155ade354ee1ba78673e73b28aca [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.088843 24113 tablet_replica.cc:333] T 47cb0ae4817d4c19ac11b42143d00039 P 76fb155ade354ee1ba78673e73b28aca: stopping tablet replica
I20260709 13:14:03.089603 24113 raft_consensus.cc:2243] T 47cb0ae4817d4c19ac11b42143d00039 P 76fb155ade354ee1ba78673e73b28aca [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:03.090520 24113 raft_consensus.cc:2272] T 47cb0ae4817d4c19ac11b42143d00039 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.092427 24113 tablet_replica.cc:333] T 70ccde113c9246f5a008add70aacae7d P 76fb155ade354ee1ba78673e73b28aca: stopping tablet replica
I20260709 13:14:03.093143 24113 raft_consensus.cc:2243] T 70ccde113c9246f5a008add70aacae7d P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.093544 24113 raft_consensus.cc:2272] T 70ccde113c9246f5a008add70aacae7d P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.095302 24113 tablet_replica.cc:333] T fb4f7292ed2f489e922ca5fb1c6e47bf P 76fb155ade354ee1ba78673e73b28aca: stopping tablet replica
I20260709 13:14:03.095777 24113 raft_consensus.cc:2243] T fb4f7292ed2f489e922ca5fb1c6e47bf P 76fb155ade354ee1ba78673e73b28aca [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:03.096386 24113 raft_consensus.cc:2272] T fb4f7292ed2f489e922ca5fb1c6e47bf P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.098173 24113 tablet_replica.cc:333] T 8a98dff441f1479992f85708c9f03283 P 76fb155ade354ee1ba78673e73b28aca: stopping tablet replica
I20260709 13:14:03.098681 24113 raft_consensus.cc:2243] T 8a98dff441f1479992f85708c9f03283 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.099071 24113 raft_consensus.cc:2272] T 8a98dff441f1479992f85708c9f03283 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.101073 24113 tablet_replica.cc:333] T 680d6e1f38f4469ebe14094aa66fdfac P 76fb155ade354ee1ba78673e73b28aca: stopping tablet replica
I20260709 13:14:03.101809 24113 raft_consensus.cc:2243] T 680d6e1f38f4469ebe14094aa66fdfac P 76fb155ade354ee1ba78673e73b28aca [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:03.102725 24113 raft_consensus.cc:2272] T 680d6e1f38f4469ebe14094aa66fdfac P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.104890 24113 tablet_replica.cc:333] T ee6c632286174388ab5e7bfb2ae40078 P 76fb155ade354ee1ba78673e73b28aca: stopping tablet replica
I20260709 13:14:03.105352 24113 raft_consensus.cc:2243] T ee6c632286174388ab5e7bfb2ae40078 P 76fb155ade354ee1ba78673e73b28aca [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.105692 24113 raft_consensus.cc:2272] T ee6c632286174388ab5e7bfb2ae40078 P 76fb155ade354ee1ba78673e73b28aca [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.107316 24113 tablet_replica.cc:333] T 216111c5962f4b82ae52414985988860 P 76fb155ade354ee1ba78673e73b28aca: stopping tablet replica
I20260709 13:14:03.107788 24113 raft_consensus.cc:2243] T 216111c5962f4b82ae52414985988860 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.108114 24113 raft_consensus.cc:2272] T 216111c5962f4b82ae52414985988860 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.109717 24113 tablet_replica.cc:333] T e3516a073925457498018b87cdbaa85f P 76fb155ade354ee1ba78673e73b28aca: stopping tablet replica
I20260709 13:14:03.110239 24113 raft_consensus.cc:2243] T e3516a073925457498018b87cdbaa85f P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.110565 24113 raft_consensus.cc:2272] T e3516a073925457498018b87cdbaa85f P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.112125 24113 tablet_replica.cc:333] T e698d6d2e2e74eca91e222e9bfdf8f13 P 76fb155ade354ee1ba78673e73b28aca: stopping tablet replica
I20260709 13:14:03.112805 24113 raft_consensus.cc:2243] T e698d6d2e2e74eca91e222e9bfdf8f13 P 76fb155ade354ee1ba78673e73b28aca [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:03.113546 24113 raft_consensus.cc:2272] T e698d6d2e2e74eca91e222e9bfdf8f13 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.116027 24113 tablet_replica.cc:333] T f66580482b2d470bacbfec917042485b P 76fb155ade354ee1ba78673e73b28aca: stopping tablet replica
I20260709 13:14:03.116695 24113 raft_consensus.cc:2243] T f66580482b2d470bacbfec917042485b P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.117057 24113 raft_consensus.cc:2272] T f66580482b2d470bacbfec917042485b P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.118734 24113 tablet_replica.cc:333] T 35bbba26df1b47a7b9923618bf451ffc P 76fb155ade354ee1ba78673e73b28aca: stopping tablet replica
I20260709 13:14:03.119203 24113 raft_consensus.cc:2243] T 35bbba26df1b47a7b9923618bf451ffc P 76fb155ade354ee1ba78673e73b28aca [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:03.119851 24113 raft_consensus.cc:2272] T 35bbba26df1b47a7b9923618bf451ffc P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.121582 24113 tablet_replica.cc:333] T 5b669b8d34ee4de5b002d30fbcf02dd7 P 76fb155ade354ee1ba78673e73b28aca: stopping tablet replica
I20260709 13:14:03.122097 24113 raft_consensus.cc:2243] T 5b669b8d34ee4de5b002d30fbcf02dd7 P 76fb155ade354ee1ba78673e73b28aca [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:03.123075 24113 raft_consensus.cc:2272] T 5b669b8d34ee4de5b002d30fbcf02dd7 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.125537 24113 tablet_replica.cc:333] T b3705de0af7a48f69f751aab333fdf3d P 76fb155ade354ee1ba78673e73b28aca: stopping tablet replica
I20260709 13:14:03.126319 24113 raft_consensus.cc:2243] T b3705de0af7a48f69f751aab333fdf3d P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.126780 24113 raft_consensus.cc:2272] T b3705de0af7a48f69f751aab333fdf3d P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.128412 24113 tablet_replica.cc:333] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 76fb155ade354ee1ba78673e73b28aca: stopping tablet replica
I20260709 13:14:03.128873 24113 raft_consensus.cc:2243] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 76fb155ade354ee1ba78673e73b28aca [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:03.129505 24113 raft_consensus.cc:2272] T dbd8bd53d8d845b2b35de45d6d2f61a1 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.131220 24113 tablet_replica.cc:333] T b262a50e82034c57a4bfb7da683ff5d1 P 76fb155ade354ee1ba78673e73b28aca: stopping tablet replica
I20260709 13:14:03.131716 24113 raft_consensus.cc:2243] T b262a50e82034c57a4bfb7da683ff5d1 P 76fb155ade354ee1ba78673e73b28aca [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.132095 24113 raft_consensus.cc:2272] T b262a50e82034c57a4bfb7da683ff5d1 P 76fb155ade354ee1ba78673e73b28aca [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.133700 24113 tablet_replica.cc:333] T 40ab5d7d13ee4460933b5799482e3f87 P 76fb155ade354ee1ba78673e73b28aca: stopping tablet replica
I20260709 13:14:03.134249 24113 raft_consensus.cc:2243] T 40ab5d7d13ee4460933b5799482e3f87 P 76fb155ade354ee1ba78673e73b28aca [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:03.134930 24113 raft_consensus.cc:2272] T 40ab5d7d13ee4460933b5799482e3f87 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.136600 24113 tablet_replica.cc:333] T a35171dce2e34beeafe34f3e80f18a41 P 76fb155ade354ee1ba78673e73b28aca: stopping tablet replica
I20260709 13:14:03.137095 24113 raft_consensus.cc:2243] T a35171dce2e34beeafe34f3e80f18a41 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.137465 24113 raft_consensus.cc:2272] T a35171dce2e34beeafe34f3e80f18a41 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.139173 24113 tablet_replica.cc:333] T 36bf73ed3df141c889c046ad6902e304 P 76fb155ade354ee1ba78673e73b28aca: stopping tablet replica
I20260709 13:14:03.139691 24113 raft_consensus.cc:2243] T 36bf73ed3df141c889c046ad6902e304 P 76fb155ade354ee1ba78673e73b28aca [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.140079 24113 raft_consensus.cc:2272] T 36bf73ed3df141c889c046ad6902e304 P 76fb155ade354ee1ba78673e73b28aca [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.141805 24113 tablet_replica.cc:333] T 0f01040b42e14f0db6bcd06319237ddb P 76fb155ade354ee1ba78673e73b28aca: stopping tablet replica
I20260709 13:14:03.142304 24113 raft_consensus.cc:2243] T 0f01040b42e14f0db6bcd06319237ddb P 76fb155ade354ee1ba78673e73b28aca [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:03.143034 24113 raft_consensus.cc:2272] T 0f01040b42e14f0db6bcd06319237ddb P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.144630 24113 tablet_replica.cc:333] T de27ea68aab2485bb532389bb5c82433 P 76fb155ade354ee1ba78673e73b28aca: stopping tablet replica
I20260709 13:14:03.145159 24113 raft_consensus.cc:2243] T de27ea68aab2485bb532389bb5c82433 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.145556 24113 raft_consensus.cc:2272] T de27ea68aab2485bb532389bb5c82433 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.147119 24113 tablet_replica.cc:333] T 76a7de5cfe774df68279e2e1e7361c6b P 76fb155ade354ee1ba78673e73b28aca: stopping tablet replica
I20260709 13:14:03.147642 24113 raft_consensus.cc:2243] T 76a7de5cfe774df68279e2e1e7361c6b P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.148034 24113 raft_consensus.cc:2272] T 76a7de5cfe774df68279e2e1e7361c6b P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.149631 24113 tablet_replica.cc:333] T eb560d89d58246e5856a763e3be6f086 P 76fb155ade354ee1ba78673e73b28aca: stopping tablet replica
I20260709 13:14:03.150143 24113 raft_consensus.cc:2243] T eb560d89d58246e5856a763e3be6f086 P 76fb155ade354ee1ba78673e73b28aca [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.150547 24113 raft_consensus.cc:2272] T eb560d89d58246e5856a763e3be6f086 P 76fb155ade354ee1ba78673e73b28aca [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.152112 24113 tablet_replica.cc:333] T 3e09c2945641463e91365b4826cc47e3 P 76fb155ade354ee1ba78673e73b28aca: stopping tablet replica
I20260709 13:14:03.152606 24113 raft_consensus.cc:2243] T 3e09c2945641463e91365b4826cc47e3 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.153057 24113 raft_consensus.cc:2272] T 3e09c2945641463e91365b4826cc47e3 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.154768 24113 tablet_replica.cc:333] T 364efc87879c4e6db82a829c76ef0045 P 76fb155ade354ee1ba78673e73b28aca: stopping tablet replica
I20260709 13:14:03.155251 24113 raft_consensus.cc:2243] T 364efc87879c4e6db82a829c76ef0045 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.155617 24113 raft_consensus.cc:2272] T 364efc87879c4e6db82a829c76ef0045 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.157269 24113 tablet_replica.cc:333] T 1fb28788823d4c5fab527f4ee2da4d2e P 76fb155ade354ee1ba78673e73b28aca: stopping tablet replica
I20260709 13:14:03.157801 24113 raft_consensus.cc:2243] T 1fb28788823d4c5fab527f4ee2da4d2e P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.158228 24113 raft_consensus.cc:2272] T 1fb28788823d4c5fab527f4ee2da4d2e P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.159891 24113 tablet_replica.cc:333] T 4d146b574e8d4e21bd8d81cb29b4267a P 76fb155ade354ee1ba78673e73b28aca: stopping tablet replica
I20260709 13:14:03.160380 24113 raft_consensus.cc:2243] T 4d146b574e8d4e21bd8d81cb29b4267a P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.160763 24113 raft_consensus.cc:2272] T 4d146b574e8d4e21bd8d81cb29b4267a P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.162374 24113 tablet_replica.cc:333] T bec9a61b8e3c4bc0ba232063b38c8563 P 76fb155ade354ee1ba78673e73b28aca: stopping tablet replica
I20260709 13:14:03.162868 24113 raft_consensus.cc:2243] T bec9a61b8e3c4bc0ba232063b38c8563 P 76fb155ade354ee1ba78673e73b28aca [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:03.163592 24113 raft_consensus.cc:2272] T bec9a61b8e3c4bc0ba232063b38c8563 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.165386 24113 tablet_replica.cc:333] T d78bdf917ee94331b91cb3fb308ef2a1 P 76fb155ade354ee1ba78673e73b28aca: stopping tablet replica
I20260709 13:14:03.165953 24113 raft_consensus.cc:2243] T d78bdf917ee94331b91cb3fb308ef2a1 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.166340 24113 raft_consensus.cc:2272] T d78bdf917ee94331b91cb3fb308ef2a1 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.167979 24113 tablet_replica.cc:333] T 4fe725ada8f142d1bb9a35a30f865c10 P 76fb155ade354ee1ba78673e73b28aca: stopping tablet replica
I20260709 13:14:03.168541 24113 raft_consensus.cc:2243] T 4fe725ada8f142d1bb9a35a30f865c10 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.168946 24113 raft_consensus.cc:2272] T 4fe725ada8f142d1bb9a35a30f865c10 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.170755 24113 tablet_replica.cc:333] T 85d4a24725c749199c1b35d959b1b2b5 P 76fb155ade354ee1ba78673e73b28aca: stopping tablet replica
I20260709 13:14:03.171262 24113 raft_consensus.cc:2243] T 85d4a24725c749199c1b35d959b1b2b5 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.171648 24113 raft_consensus.cc:2272] T 85d4a24725c749199c1b35d959b1b2b5 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.173357 24113 tablet_replica.cc:333] T 1e727ab6847b4fbab9a94b63842c6b9c P 76fb155ade354ee1ba78673e73b28aca: stopping tablet replica
I20260709 13:14:03.173907 24113 raft_consensus.cc:2243] T 1e727ab6847b4fbab9a94b63842c6b9c P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.174269 24113 raft_consensus.cc:2272] T 1e727ab6847b4fbab9a94b63842c6b9c P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.175976 24113 tablet_replica.cc:333] T 42f4b6d5299848c89ceb268c1fd088af P 76fb155ade354ee1ba78673e73b28aca: stopping tablet replica
I20260709 13:14:03.176461 24113 raft_consensus.cc:2243] T 42f4b6d5299848c89ceb268c1fd088af P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.176846 24113 raft_consensus.cc:2272] T 42f4b6d5299848c89ceb268c1fd088af P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.178642 24113 tablet_replica.cc:333] T 0550046442d4469c96ad37cbbb191915 P 76fb155ade354ee1ba78673e73b28aca: stopping tablet replica
I20260709 13:14:03.179150 24113 raft_consensus.cc:2243] T 0550046442d4469c96ad37cbbb191915 P 76fb155ade354ee1ba78673e73b28aca [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:03.179850 24113 raft_consensus.cc:2272] T 0550046442d4469c96ad37cbbb191915 P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.181560 24113 tablet_replica.cc:333] T 8c4f880f34664227ac8bd46378c9995f P 76fb155ade354ee1ba78673e73b28aca: stopping tablet replica
I20260709 13:14:03.182075 24113 raft_consensus.cc:2243] T 8c4f880f34664227ac8bd46378c9995f P 76fb155ade354ee1ba78673e73b28aca [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:03.182824 24113 raft_consensus.cc:2272] T 8c4f880f34664227ac8bd46378c9995f P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.184502 24113 tablet_replica.cc:333] T 256a5c9a935246e0a6c36b5b654fbbfb P 76fb155ade354ee1ba78673e73b28aca: stopping tablet replica
I20260709 13:14:03.185005 24113 raft_consensus.cc:2243] T 256a5c9a935246e0a6c36b5b654fbbfb P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.185401 24113 raft_consensus.cc:2272] T 256a5c9a935246e0a6c36b5b654fbbfb P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.187050 24113 tablet_replica.cc:333] T 075b9562a2b547c8aad80c2bae413556 P 76fb155ade354ee1ba78673e73b28aca: stopping tablet replica
I20260709 13:14:03.187515 24113 raft_consensus.cc:2243] T 075b9562a2b547c8aad80c2bae413556 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.187884 24113 raft_consensus.cc:2272] T 075b9562a2b547c8aad80c2bae413556 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.189543 24113 tablet_replica.cc:333] T ddbfc15d5bf24708a4268dfa206ede07 P 76fb155ade354ee1ba78673e73b28aca: stopping tablet replica
I20260709 13:14:03.190047 24113 raft_consensus.cc:2243] T ddbfc15d5bf24708a4268dfa206ede07 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.190421 24113 raft_consensus.cc:2272] T ddbfc15d5bf24708a4268dfa206ede07 P 76fb155ade354ee1ba78673e73b28aca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.192082 24113 tablet_replica.cc:333] T bd1c90f0a848434cb7df23dbeae35ddf P 76fb155ade354ee1ba78673e73b28aca: stopping tablet replica
I20260709 13:14:03.192519 24113 raft_consensus.cc:2243] T bd1c90f0a848434cb7df23dbeae35ddf P 76fb155ade354ee1ba78673e73b28aca [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:03.193246 24113 raft_consensus.cc:2272] T bd1c90f0a848434cb7df23dbeae35ddf P 76fb155ade354ee1ba78673e73b28aca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.257028 24113 tablet_server.cc:196] TabletServer@127.23.140.68:0 shutdown complete.
I20260709 13:14:03.314561 24113 master.cc:562] Master@127.23.140.126:37181 shutting down...
I20260709 13:14:03.338114 24113 raft_consensus.cc:2243] T 00000000000000000000000000000000 P e22434eebf05497a894dca04ce76caaa [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:03.338599 24113 raft_consensus.cc:2272] T 00000000000000000000000000000000 P e22434eebf05497a894dca04ce76caaa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.338879 24113 tablet_replica.cc:333] T 00000000000000000000000000000000 P e22434eebf05497a894dca04ce76caaa: stopping tablet replica
I20260709 13:14:03.360878 24113 master.cc:584] Master@127.23.140.126:37181 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (31963 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:14:03.446797 24113 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.23.140.126:34933
I20260709 13:14:03.447871 24113 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:03.453783 32620 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:03.454607 32621 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:03.455497 32623 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:03.455514 24113 server_base.cc:1061] running on GCE node
I20260709 13:14:03.456804 24113 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:03.457013 24113 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:03.457173 24113 hybrid_clock.cc:648] HybridClock initialized: now 1783602843457156 us; error 0 us; skew 500 ppm
I20260709 13:14:03.457690 24113 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:03.459995 24113 webserver.cc:533] Webserver started at http://127.23.140.126:35339/ using document root <none> and password file <none>
I20260709 13:14:03.460470 24113 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:03.460666 24113 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:03.460937 24113 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:03.462095 24113 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602598684750-24113-0/minicluster-data/master-0-root/instance:
uuid: "6e1d1a89bc3f472dbac96104fecbc4d5"
format_stamp: "Formatted at 2026-07-09 13:14:03 on dist-test-slave-1rs3"
I20260709 13:14:03.466312 24113 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 13:14:03.469442 32628 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:03.470291 24113 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:14:03.470522 24113 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602598684750-24113-0/minicluster-data/master-0-root
uuid: "6e1d1a89bc3f472dbac96104fecbc4d5"
format_stamp: "Formatted at 2026-07-09 13:14:03 on dist-test-slave-1rs3"
I20260709 13:14:03.470759 24113 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602598684750-24113-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602598684750-24113-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602598684750-24113-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:03.486860 24113 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:03.488157 24113 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:03.525604 24113 rpc_server.cc:307] RPC server started. Bound to: 127.23.140.126:34933
I20260709 13:14:03.525684 32679 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.140.126:34933 every 8 connection(s)
I20260709 13:14:03.529644 32680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:03.539726 32680 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e1d1a89bc3f472dbac96104fecbc4d5: Bootstrap starting.
I20260709 13:14:03.544477 32680 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6e1d1a89bc3f472dbac96104fecbc4d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:03.548683 32680 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e1d1a89bc3f472dbac96104fecbc4d5: No bootstrap required, opened a new log
I20260709 13:14:03.550803 32680 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6e1d1a89bc3f472dbac96104fecbc4d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e1d1a89bc3f472dbac96104fecbc4d5" member_type: VOTER }
I20260709 13:14:03.551158 32680 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6e1d1a89bc3f472dbac96104fecbc4d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:03.551415 32680 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6e1d1a89bc3f472dbac96104fecbc4d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e1d1a89bc3f472dbac96104fecbc4d5, State: Initialized, Role: FOLLOWER
I20260709 13:14:03.551963 32680 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6e1d1a89bc3f472dbac96104fecbc4d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e1d1a89bc3f472dbac96104fecbc4d5" member_type: VOTER }
I20260709 13:14:03.552407 32680 raft_consensus.cc:399] T 00000000000000000000000000000000 P 6e1d1a89bc3f472dbac96104fecbc4d5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:14:03.552640 32680 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6e1d1a89bc3f472dbac96104fecbc4d5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:14:03.552922 32680 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6e1d1a89bc3f472dbac96104fecbc4d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:03.557277 32680 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6e1d1a89bc3f472dbac96104fecbc4d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e1d1a89bc3f472dbac96104fecbc4d5" member_type: VOTER }
I20260709 13:14:03.557783 32680 leader_election.cc:304] T 00000000000000000000000000000000 P 6e1d1a89bc3f472dbac96104fecbc4d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6e1d1a89bc3f472dbac96104fecbc4d5; no voters: 
I20260709 13:14:03.558845 32680 leader_election.cc:290] T 00000000000000000000000000000000 P 6e1d1a89bc3f472dbac96104fecbc4d5 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:14:03.559193 32683 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6e1d1a89bc3f472dbac96104fecbc4d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:03.560539 32683 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6e1d1a89bc3f472dbac96104fecbc4d5 [term 1 LEADER]: Becoming Leader. State: Replica: 6e1d1a89bc3f472dbac96104fecbc4d5, State: Running, Role: LEADER
I20260709 13:14:03.561198 32683 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6e1d1a89bc3f472dbac96104fecbc4d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e1d1a89bc3f472dbac96104fecbc4d5" member_type: VOTER }
I20260709 13:14:03.561729 32680 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6e1d1a89bc3f472dbac96104fecbc4d5 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:14:03.565456 32684 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e1d1a89bc3f472dbac96104fecbc4d5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6e1d1a89bc3f472dbac96104fecbc4d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e1d1a89bc3f472dbac96104fecbc4d5" member_type: VOTER } }
I20260709 13:14:03.566241 32684 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e1d1a89bc3f472dbac96104fecbc4d5 [sys.catalog]: This master's current role is: LEADER
I20260709 13:14:03.566071 32685 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e1d1a89bc3f472dbac96104fecbc4d5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6e1d1a89bc3f472dbac96104fecbc4d5. Latest consensus state: current_term: 1 leader_uuid: "6e1d1a89bc3f472dbac96104fecbc4d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e1d1a89bc3f472dbac96104fecbc4d5" member_type: VOTER } }
I20260709 13:14:03.567005 32685 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e1d1a89bc3f472dbac96104fecbc4d5 [sys.catalog]: This master's current role is: LEADER
I20260709 13:14:03.568506 32690 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:14:03.576434 32690 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:14:03.577366 24113 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:14:03.584821 32690 catalog_manager.cc:1383] Generated new cluster ID: 912be35f48a84871a8e9499fd96816d3
I20260709 13:14:03.585105 32690 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:14:03.603294 32690 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:14:03.604552 32690 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:14:03.618562 32690 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 6e1d1a89bc3f472dbac96104fecbc4d5: Generated new TSK 0
I20260709 13:14:03.619190 32690 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:14:03.644229 24113 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:03.650384 32701 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:03.651147 32702 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:03.653421 32704 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:03.653707 24113 server_base.cc:1061] running on GCE node
I20260709 13:14:03.655194 24113 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:03.655418 24113 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:03.655581 24113 hybrid_clock.cc:648] HybridClock initialized: now 1783602843655560 us; error 0 us; skew 500 ppm
I20260709 13:14:03.656098 24113 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:03.658381 24113 webserver.cc:533] Webserver started at http://127.23.140.65:45351/ using document root <none> and password file <none>
I20260709 13:14:03.658851 24113 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:03.659049 24113 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:03.659322 24113 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:03.660440 24113 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602598684750-24113-0/minicluster-data/ts-0-root/instance:
uuid: "371b5d0b1c9e48c79defeea5005327a6"
format_stamp: "Formatted at 2026-07-09 13:14:03 on dist-test-slave-1rs3"
I20260709 13:14:03.665120 24113 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:14:03.668432 32709 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:03.669166 24113 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:14:03.669459 24113 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602598684750-24113-0/minicluster-data/ts-0-root
uuid: "371b5d0b1c9e48c79defeea5005327a6"
format_stamp: "Formatted at 2026-07-09 13:14:03 on dist-test-slave-1rs3"
I20260709 13:14:03.669735 24113 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602598684750-24113-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602598684750-24113-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602598684750-24113-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:03.680393 24113 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:03.681564 24113 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:03.682981 24113 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:03.685195 24113 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:03.685397 24113 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:03.685637 24113 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:03.685838 24113 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.001s
I20260709 13:14:03.724434 24113 rpc_server.cc:307] RPC server started. Bound to: 127.23.140.65:41633
I20260709 13:14:03.724519   303 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.140.65:41633 every 8 connection(s)
I20260709 13:14:03.729658 24113 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:03.736344   308 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:03.737938   309 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:03.739223   311 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:03.739813 24113 server_base.cc:1061] running on GCE node
I20260709 13:14:03.740962 24113 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:03.741174 24113 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:03.741364 24113 hybrid_clock.cc:648] HybridClock initialized: now 1783602843741346 us; error 0 us; skew 500 ppm
I20260709 13:14:03.742072 24113 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:03.744782 24113 webserver.cc:533] Webserver started at http://127.23.140.66:34969/ using document root <none> and password file <none>
I20260709 13:14:03.744836   304 heartbeater.cc:344] Connected to a master server at 127.23.140.126:34933
I20260709 13:14:03.745302   304 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:03.745323 24113 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:03.745715 24113 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:03.746043 24113 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:03.746156   304 heartbeater.cc:507] Master 127.23.140.126:34933 requested a full tablet report, sending...
I20260709 13:14:03.747114 24113 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602598684750-24113-0/minicluster-data/ts-1-root/instance:
uuid: "c3db9c6332ea4354b25af20b8d98cde9"
format_stamp: "Formatted at 2026-07-09 13:14:03 on dist-test-slave-1rs3"
I20260709 13:14:03.748180 32645 ts_manager.cc:194] Registered new tserver with Master: 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633)
I20260709 13:14:03.749953 32645 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40898
I20260709 13:14:03.751794 24113 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:14:03.755077   316 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:03.755784 24113 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:14:03.756052 24113 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602598684750-24113-0/minicluster-data/ts-1-root
uuid: "c3db9c6332ea4354b25af20b8d98cde9"
format_stamp: "Formatted at 2026-07-09 13:14:03 on dist-test-slave-1rs3"
I20260709 13:14:03.756325 24113 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602598684750-24113-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602598684750-24113-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602598684750-24113-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:03.766319 24113 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:03.767418 24113 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:03.768810 24113 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:03.771052 24113 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:03.771313 24113 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:03.771538 24113 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:03.771698 24113 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:03.811724 24113 rpc_server.cc:307] RPC server started. Bound to: 127.23.140.66:38883
I20260709 13:14:03.811858   378 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.140.66:38883 every 8 connection(s)
I20260709 13:14:03.816419 24113 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:03.823985   382 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:03.824970   383 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:03.828135   385 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:03.828280   379 heartbeater.cc:344] Connected to a master server at 127.23.140.126:34933
I20260709 13:14:03.828756   379 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:03.828760 24113 server_base.cc:1061] running on GCE node
I20260709 13:14:03.829782   379 heartbeater.cc:507] Master 127.23.140.126:34933 requested a full tablet report, sending...
I20260709 13:14:03.829937 24113 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:03.830232 24113 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:03.830442 24113 hybrid_clock.cc:648] HybridClock initialized: now 1783602843830425 us; error 0 us; skew 500 ppm
I20260709 13:14:03.831230 24113 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:03.831949 32645 ts_manager.cc:194] Registered new tserver with Master: c3db9c6332ea4354b25af20b8d98cde9 (127.23.140.66:38883)
I20260709 13:14:03.833865 24113 webserver.cc:533] Webserver started at http://127.23.140.67:46649/ using document root <none> and password file <none>
I20260709 13:14:03.833904 32645 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40910
I20260709 13:14:03.834656 24113 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:03.834887 24113 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:03.835215 24113 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:03.836314 24113 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602598684750-24113-0/minicluster-data/ts-2-root/instance:
uuid: "ccb5d7de9811449d8105001cb43ac775"
format_stamp: "Formatted at 2026-07-09 13:14:03 on dist-test-slave-1rs3"
I20260709 13:14:03.840409 24113 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:14:03.843551   390 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:03.844554 24113 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:14:03.844842 24113 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602598684750-24113-0/minicluster-data/ts-2-root
uuid: "ccb5d7de9811449d8105001cb43ac775"
format_stamp: "Formatted at 2026-07-09 13:14:03 on dist-test-slave-1rs3"
I20260709 13:14:03.845129 24113 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602598684750-24113-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602598684750-24113-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602598684750-24113-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:03.877385 24113 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:03.878636 24113 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:03.880095 24113 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:03.882304 24113 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:03.882527 24113 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:03.882766 24113 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:03.882933 24113 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:03.922711 24113 rpc_server.cc:307] RPC server started. Bound to: 127.23.140.67:39377
I20260709 13:14:03.922825   453 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.140.67:39377 every 8 connection(s)
I20260709 13:14:03.938025   454 heartbeater.cc:344] Connected to a master server at 127.23.140.126:34933
I20260709 13:14:03.938470   454 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:03.939172   454 heartbeater.cc:507] Master 127.23.140.126:34933 requested a full tablet report, sending...
I20260709 13:14:03.941047 32645 ts_manager.cc:194] Registered new tserver with Master: ccb5d7de9811449d8105001cb43ac775 (127.23.140.67:39377)
I20260709 13:14:03.941632 24113 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01574795s
I20260709 13:14:03.942469 32645 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40916
I20260709 13:14:03.965371 32645 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40926:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:14:03.968206 32645 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:14:04.040539   344 tablet_service.cc:1511] Processing CreateTablet for tablet 58c124bee20f4d039daa8d54154c0616 (DEFAULT_TABLE table=test-workload [id=90665aeaabc34b1bbe015f8fe2ac3013]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:14:04.040861   343 tablet_service.cc:1511] Processing CreateTablet for tablet ccc5273ee6eb48e9ad577cb60a46001a (DEFAULT_TABLE table=test-workload [id=90665aeaabc34b1bbe015f8fe2ac3013]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:14:04.042064   344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58c124bee20f4d039daa8d54154c0616. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:04.042725   343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccc5273ee6eb48e9ad577cb60a46001a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:04.046480   342 tablet_service.cc:1511] Processing CreateTablet for tablet efc64f8df3094f568e2fb0be3e56380b (DEFAULT_TABLE table=test-workload [id=90665aeaabc34b1bbe015f8fe2ac3013]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:14:04.047942   342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efc64f8df3094f568e2fb0be3e56380b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:04.051347   341 tablet_service.cc:1511] Processing CreateTablet for tablet 4fdcc1f9d3d34a1480606d325fe3616f (DEFAULT_TABLE table=test-workload [id=90665aeaabc34b1bbe015f8fe2ac3013]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:14:04.052908   341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fdcc1f9d3d34a1480606d325fe3616f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:04.055366   340 tablet_service.cc:1511] Processing CreateTablet for tablet 2af3bf69a6b44d8b9ad324f545ddf5d5 (DEFAULT_TABLE table=test-workload [id=90665aeaabc34b1bbe015f8fe2ac3013]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:14:04.056736   340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2af3bf69a6b44d8b9ad324f545ddf5d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:04.059894 32737 tablet_service.cc:1511] Processing CreateTablet for tablet 58c124bee20f4d039daa8d54154c0616 (DEFAULT_TABLE table=test-workload [id=90665aeaabc34b1bbe015f8fe2ac3013]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:14:04.061270 32737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58c124bee20f4d039daa8d54154c0616. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:04.062440 32733 tablet_service.cc:1511] Processing CreateTablet for tablet 2af3bf69a6b44d8b9ad324f545ddf5d5 (DEFAULT_TABLE table=test-workload [id=90665aeaabc34b1bbe015f8fe2ac3013]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:14:04.062646 32734 tablet_service.cc:1511] Processing CreateTablet for tablet 4fdcc1f9d3d34a1480606d325fe3616f (DEFAULT_TABLE table=test-workload [id=90665aeaabc34b1bbe015f8fe2ac3013]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:14:04.063767 32733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2af3bf69a6b44d8b9ad324f545ddf5d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:04.064827   338 tablet_service.cc:1511] Processing CreateTablet for tablet 31972c45882a4ef1bd838a1790d929b4 (DEFAULT_TABLE table=test-workload [id=90665aeaabc34b1bbe015f8fe2ac3013]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:14:04.064944 32735 tablet_service.cc:1511] Processing CreateTablet for tablet efc64f8df3094f568e2fb0be3e56380b (DEFAULT_TABLE table=test-workload [id=90665aeaabc34b1bbe015f8fe2ac3013]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:14:04.066226   338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31972c45882a4ef1bd838a1790d929b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:04.066313 32735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efc64f8df3094f568e2fb0be3e56380b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:04.071602 32734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fdcc1f9d3d34a1480606d325fe3616f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:04.072048 32731 tablet_service.cc:1511] Processing CreateTablet for tablet 31972c45882a4ef1bd838a1790d929b4 (DEFAULT_TABLE table=test-workload [id=90665aeaabc34b1bbe015f8fe2ac3013]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:14:04.072407 32730 tablet_service.cc:1511] Processing CreateTablet for tablet c97f937160cf4068a000607700371c56 (DEFAULT_TABLE table=test-workload [id=90665aeaabc34b1bbe015f8fe2ac3013]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:14:04.073349 32731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31972c45882a4ef1bd838a1790d929b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:04.074344 32736 tablet_service.cc:1511] Processing CreateTablet for tablet ccc5273ee6eb48e9ad577cb60a46001a (DEFAULT_TABLE table=test-workload [id=90665aeaabc34b1bbe015f8fe2ac3013]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:14:04.075598 32736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccc5273ee6eb48e9ad577cb60a46001a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:04.084375 32730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c97f937160cf4068a000607700371c56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:04.099316   337 tablet_service.cc:1511] Processing CreateTablet for tablet c97f937160cf4068a000607700371c56 (DEFAULT_TABLE table=test-workload [id=90665aeaabc34b1bbe015f8fe2ac3013]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:14:04.100936   337 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c97f937160cf4068a000607700371c56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:04.061270   339 tablet_service.cc:1511] Processing CreateTablet for tablet 0e96fafd0e9644919d5f556114573533 (DEFAULT_TABLE table=test-workload [id=90665aeaabc34b1bbe015f8fe2ac3013]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:14:04.106920   339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e96fafd0e9644919d5f556114573533. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:04.066911 32732 tablet_service.cc:1511] Processing CreateTablet for tablet 0e96fafd0e9644919d5f556114573533 (DEFAULT_TABLE table=test-workload [id=90665aeaabc34b1bbe015f8fe2ac3013]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:14:04.111459   418 tablet_service.cc:1511] Processing CreateTablet for tablet 58c124bee20f4d039daa8d54154c0616 (DEFAULT_TABLE table=test-workload [id=90665aeaabc34b1bbe015f8fe2ac3013]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:14:04.112830   418 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58c124bee20f4d039daa8d54154c0616. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:04.113875   417 tablet_service.cc:1511] Processing CreateTablet for tablet ccc5273ee6eb48e9ad577cb60a46001a (DEFAULT_TABLE table=test-workload [id=90665aeaabc34b1bbe015f8fe2ac3013]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:14:04.115002   416 tablet_service.cc:1511] Processing CreateTablet for tablet efc64f8df3094f568e2fb0be3e56380b (DEFAULT_TABLE table=test-workload [id=90665aeaabc34b1bbe015f8fe2ac3013]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:14:04.116175   412 tablet_service.cc:1511] Processing CreateTablet for tablet 31972c45882a4ef1bd838a1790d929b4 (DEFAULT_TABLE table=test-workload [id=90665aeaabc34b1bbe015f8fe2ac3013]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:14:04.117251   415 tablet_service.cc:1511] Processing CreateTablet for tablet 4fdcc1f9d3d34a1480606d325fe3616f (DEFAULT_TABLE table=test-workload [id=90665aeaabc34b1bbe015f8fe2ac3013]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:14:04.118577   411 tablet_service.cc:1511] Processing CreateTablet for tablet c97f937160cf4068a000607700371c56 (DEFAULT_TABLE table=test-workload [id=90665aeaabc34b1bbe015f8fe2ac3013]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:14:04.119520   414 tablet_service.cc:1511] Processing CreateTablet for tablet 2af3bf69a6b44d8b9ad324f545ddf5d5 (DEFAULT_TABLE table=test-workload [id=90665aeaabc34b1bbe015f8fe2ac3013]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:14:04.120481 32732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e96fafd0e9644919d5f556114573533. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:04.121642   413 tablet_service.cc:1511] Processing CreateTablet for tablet 0e96fafd0e9644919d5f556114573533 (DEFAULT_TABLE table=test-workload [id=90665aeaabc34b1bbe015f8fe2ac3013]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:14:04.123283   469 tablet_bootstrap.cc:492] T 58c124bee20f4d039daa8d54154c0616 P c3db9c6332ea4354b25af20b8d98cde9: Bootstrap starting.
I20260709 13:14:04.132373   469 tablet_bootstrap.cc:654] T 58c124bee20f4d039daa8d54154c0616 P c3db9c6332ea4354b25af20b8d98cde9: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:04.135035   417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccc5273ee6eb48e9ad577cb60a46001a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:04.136255   415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fdcc1f9d3d34a1480606d325fe3616f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:04.137238   412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31972c45882a4ef1bd838a1790d929b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:04.139643 32729 tablet_service.cc:1511] Processing CreateTablet for tablet 6e71f9f26bcf449388fdf26ab44b79da (DEFAULT_TABLE table=test-workload [id=90665aeaabc34b1bbe015f8fe2ac3013]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:14:04.140982 32729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e71f9f26bcf449388fdf26ab44b79da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:04.142544   344 tablet_service.cc:1511] Processing CreateTablet for tablet 6e71f9f26bcf449388fdf26ab44b79da (DEFAULT_TABLE table=test-workload [id=90665aeaabc34b1bbe015f8fe2ac3013]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:14:04.143683 32728 tablet_service.cc:1511] Processing CreateTablet for tablet 42473b265d0f476b928fdcbe60fd318b (DEFAULT_TABLE table=test-workload [id=90665aeaabc34b1bbe015f8fe2ac3013]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:14:04.143509   411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c97f937160cf4068a000607700371c56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:04.144968 32728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42473b265d0f476b928fdcbe60fd318b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:04.145406   416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efc64f8df3094f568e2fb0be3e56380b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:04.145548   344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e71f9f26bcf449388fdf26ab44b79da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:04.149004   410 tablet_service.cc:1511] Processing CreateTablet for tablet 6e71f9f26bcf449388fdf26ab44b79da (DEFAULT_TABLE table=test-workload [id=90665aeaabc34b1bbe015f8fe2ac3013]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:14:04.155180   410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e71f9f26bcf449388fdf26ab44b79da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:04.157874   413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e96fafd0e9644919d5f556114573533. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:04.162060   414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2af3bf69a6b44d8b9ad324f545ddf5d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:04.191839   469 tablet_bootstrap.cc:492] T 58c124bee20f4d039daa8d54154c0616 P c3db9c6332ea4354b25af20b8d98cde9: No bootstrap required, opened a new log
I20260709 13:14:04.192523   469 ts_tablet_manager.cc:1403] T 58c124bee20f4d039daa8d54154c0616 P c3db9c6332ea4354b25af20b8d98cde9: Time spent bootstrapping tablet: real 0.070s	user 0.014s	sys 0.005s
I20260709 13:14:04.195572   469 raft_consensus.cc:359] T 58c124bee20f4d039daa8d54154c0616 P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.204802   469 raft_consensus.cc:385] T 58c124bee20f4d039daa8d54154c0616 P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:04.205202   469 raft_consensus.cc:740] T 58c124bee20f4d039daa8d54154c0616 P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3db9c6332ea4354b25af20b8d98cde9, State: Initialized, Role: FOLLOWER
I20260709 13:14:04.206144   469 consensus_queue.cc:260] T 58c124bee20f4d039daa8d54154c0616 P c3db9c6332ea4354b25af20b8d98cde9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.247613   337 tablet_service.cc:1511] Processing CreateTablet for tablet 42473b265d0f476b928fdcbe60fd318b (DEFAULT_TABLE table=test-workload [id=90665aeaabc34b1bbe015f8fe2ac3013]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:14:04.249007   337 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42473b265d0f476b928fdcbe60fd318b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:04.271730   417 tablet_service.cc:1511] Processing CreateTablet for tablet 42473b265d0f476b928fdcbe60fd318b (DEFAULT_TABLE table=test-workload [id=90665aeaabc34b1bbe015f8fe2ac3013]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:14:04.277277   417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42473b265d0f476b928fdcbe60fd318b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:04.278790   471 tablet_bootstrap.cc:492] T ccc5273ee6eb48e9ad577cb60a46001a P ccb5d7de9811449d8105001cb43ac775: Bootstrap starting.
I20260709 13:14:04.289551   472 tablet_bootstrap.cc:492] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P 371b5d0b1c9e48c79defeea5005327a6: Bootstrap starting.
I20260709 13:14:04.297536   471 tablet_bootstrap.cc:654] T ccc5273ee6eb48e9ad577cb60a46001a P ccb5d7de9811449d8105001cb43ac775: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:04.302763   469 ts_tablet_manager.cc:1434] T 58c124bee20f4d039daa8d54154c0616 P c3db9c6332ea4354b25af20b8d98cde9: Time spent starting tablet: real 0.110s	user 0.011s	sys 0.017s
I20260709 13:14:04.302901   379 heartbeater.cc:499] Master 127.23.140.126:34933 was elected leader, sending a full tablet report...
I20260709 13:14:04.313321   469 tablet_bootstrap.cc:492] T 6e71f9f26bcf449388fdf26ab44b79da P c3db9c6332ea4354b25af20b8d98cde9: Bootstrap starting.
I20260709 13:14:04.308180   472 tablet_bootstrap.cc:654] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P 371b5d0b1c9e48c79defeea5005327a6: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:04.318365   380 tablet.cc:2406] T 58c124bee20f4d039daa8d54154c0616 P c3db9c6332ea4354b25af20b8d98cde9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:14:04.322374   469 tablet_bootstrap.cc:654] T 6e71f9f26bcf449388fdf26ab44b79da P c3db9c6332ea4354b25af20b8d98cde9: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:04.323958   472 tablet_bootstrap.cc:492] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P 371b5d0b1c9e48c79defeea5005327a6: No bootstrap required, opened a new log
I20260709 13:14:04.324424   472 ts_tablet_manager.cc:1403] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P 371b5d0b1c9e48c79defeea5005327a6: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.004s
I20260709 13:14:04.327235   472 raft_consensus.cc:359] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P 371b5d0b1c9e48c79defeea5005327a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.327994   472 raft_consensus.cc:385] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P 371b5d0b1c9e48c79defeea5005327a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:04.328315   472 raft_consensus.cc:740] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P 371b5d0b1c9e48c79defeea5005327a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b5d0b1c9e48c79defeea5005327a6, State: Initialized, Role: FOLLOWER
I20260709 13:14:04.329147   472 consensus_queue.cc:260] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P 371b5d0b1c9e48c79defeea5005327a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.329699   469 tablet_bootstrap.cc:492] T 6e71f9f26bcf449388fdf26ab44b79da P c3db9c6332ea4354b25af20b8d98cde9: No bootstrap required, opened a new log
I20260709 13:14:04.330288   469 ts_tablet_manager.cc:1403] T 6e71f9f26bcf449388fdf26ab44b79da P c3db9c6332ea4354b25af20b8d98cde9: Time spent bootstrapping tablet: real 0.017s	user 0.005s	sys 0.007s
I20260709 13:14:04.331079   471 tablet_bootstrap.cc:492] T ccc5273ee6eb48e9ad577cb60a46001a P ccb5d7de9811449d8105001cb43ac775: No bootstrap required, opened a new log
I20260709 13:14:04.331780   471 ts_tablet_manager.cc:1403] T ccc5273ee6eb48e9ad577cb60a46001a P ccb5d7de9811449d8105001cb43ac775: Time spent bootstrapping tablet: real 0.053s	user 0.011s	sys 0.000s
I20260709 13:14:04.333092   469 raft_consensus.cc:359] T 6e71f9f26bcf449388fdf26ab44b79da P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.333840   469 raft_consensus.cc:385] T 6e71f9f26bcf449388fdf26ab44b79da P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:04.334139   469 raft_consensus.cc:740] T 6e71f9f26bcf449388fdf26ab44b79da P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3db9c6332ea4354b25af20b8d98cde9, State: Initialized, Role: FOLLOWER
I20260709 13:14:04.334824   469 consensus_queue.cc:260] T 6e71f9f26bcf449388fdf26ab44b79da P c3db9c6332ea4354b25af20b8d98cde9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.335971   471 raft_consensus.cc:359] T ccc5273ee6eb48e9ad577cb60a46001a P ccb5d7de9811449d8105001cb43ac775 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.336867   471 raft_consensus.cc:385] T ccc5273ee6eb48e9ad577cb60a46001a P ccb5d7de9811449d8105001cb43ac775 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:04.337222   471 raft_consensus.cc:740] T ccc5273ee6eb48e9ad577cb60a46001a P ccb5d7de9811449d8105001cb43ac775 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccb5d7de9811449d8105001cb43ac775, State: Initialized, Role: FOLLOWER
I20260709 13:14:04.338456   472 ts_tablet_manager.cc:1434] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P 371b5d0b1c9e48c79defeea5005327a6: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.008s
I20260709 13:14:04.338182   471 consensus_queue.cc:260] T ccc5273ee6eb48e9ad577cb60a46001a P ccb5d7de9811449d8105001cb43ac775 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.338734   304 heartbeater.cc:499] Master 127.23.140.126:34933 was elected leader, sending a full tablet report...
I20260709 13:14:04.339562   472 tablet_bootstrap.cc:492] T 4fdcc1f9d3d34a1480606d325fe3616f P 371b5d0b1c9e48c79defeea5005327a6: Bootstrap starting.
I20260709 13:14:04.339794   469 ts_tablet_manager.cc:1434] T 6e71f9f26bcf449388fdf26ab44b79da P c3db9c6332ea4354b25af20b8d98cde9: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:14:04.340855   469 tablet_bootstrap.cc:492] T c97f937160cf4068a000607700371c56 P c3db9c6332ea4354b25af20b8d98cde9: Bootstrap starting.
I20260709 13:14:04.347229   469 tablet_bootstrap.cc:654] T c97f937160cf4068a000607700371c56 P c3db9c6332ea4354b25af20b8d98cde9: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:04.348250   472 tablet_bootstrap.cc:654] T 4fdcc1f9d3d34a1480606d325fe3616f P 371b5d0b1c9e48c79defeea5005327a6: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:04.353076   454 heartbeater.cc:499] Master 127.23.140.126:34933 was elected leader, sending a full tablet report...
I20260709 13:14:04.353696   471 ts_tablet_manager.cc:1434] T ccc5273ee6eb48e9ad577cb60a46001a P ccb5d7de9811449d8105001cb43ac775: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.011s
I20260709 13:14:04.354746   471 tablet_bootstrap.cc:492] T c97f937160cf4068a000607700371c56 P ccb5d7de9811449d8105001cb43ac775: Bootstrap starting.
I20260709 13:14:04.361179   471 tablet_bootstrap.cc:654] T c97f937160cf4068a000607700371c56 P ccb5d7de9811449d8105001cb43ac775: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:04.364475   472 tablet_bootstrap.cc:492] T 4fdcc1f9d3d34a1480606d325fe3616f P 371b5d0b1c9e48c79defeea5005327a6: No bootstrap required, opened a new log
I20260709 13:14:04.365119   472 ts_tablet_manager.cc:1403] T 4fdcc1f9d3d34a1480606d325fe3616f P 371b5d0b1c9e48c79defeea5005327a6: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.000s
I20260709 13:14:04.368885   472 raft_consensus.cc:359] T 4fdcc1f9d3d34a1480606d325fe3616f P 371b5d0b1c9e48c79defeea5005327a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.369851   472 raft_consensus.cc:385] T 4fdcc1f9d3d34a1480606d325fe3616f P 371b5d0b1c9e48c79defeea5005327a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:04.370225   472 raft_consensus.cc:740] T 4fdcc1f9d3d34a1480606d325fe3616f P 371b5d0b1c9e48c79defeea5005327a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b5d0b1c9e48c79defeea5005327a6, State: Initialized, Role: FOLLOWER
I20260709 13:14:04.372308   472 consensus_queue.cc:260] T 4fdcc1f9d3d34a1480606d325fe3616f P 371b5d0b1c9e48c79defeea5005327a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.374171   469 tablet_bootstrap.cc:492] T c97f937160cf4068a000607700371c56 P c3db9c6332ea4354b25af20b8d98cde9: No bootstrap required, opened a new log
I20260709 13:14:04.374323   471 tablet_bootstrap.cc:492] T c97f937160cf4068a000607700371c56 P ccb5d7de9811449d8105001cb43ac775: No bootstrap required, opened a new log
I20260709 13:14:04.374549   472 ts_tablet_manager.cc:1434] T 4fdcc1f9d3d34a1480606d325fe3616f P 371b5d0b1c9e48c79defeea5005327a6: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.004s
I20260709 13:14:04.374737   469 ts_tablet_manager.cc:1403] T c97f937160cf4068a000607700371c56 P c3db9c6332ea4354b25af20b8d98cde9: Time spent bootstrapping tablet: real 0.034s	user 0.017s	sys 0.015s
I20260709 13:14:04.374897   471 ts_tablet_manager.cc:1403] T c97f937160cf4068a000607700371c56 P ccb5d7de9811449d8105001cb43ac775: Time spent bootstrapping tablet: real 0.020s	user 0.004s	sys 0.014s
I20260709 13:14:04.375761   472 tablet_bootstrap.cc:492] T 0e96fafd0e9644919d5f556114573533 P 371b5d0b1c9e48c79defeea5005327a6: Bootstrap starting.
I20260709 13:14:04.377698   469 raft_consensus.cc:359] T c97f937160cf4068a000607700371c56 P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.378427   469 raft_consensus.cc:385] T c97f937160cf4068a000607700371c56 P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:04.378717   469 raft_consensus.cc:740] T c97f937160cf4068a000607700371c56 P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3db9c6332ea4354b25af20b8d98cde9, State: Initialized, Role: FOLLOWER
I20260709 13:14:04.379469   469 consensus_queue.cc:260] T c97f937160cf4068a000607700371c56 P c3db9c6332ea4354b25af20b8d98cde9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.382685   472 tablet_bootstrap.cc:654] T 0e96fafd0e9644919d5f556114573533 P 371b5d0b1c9e48c79defeea5005327a6: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:04.382886   471 raft_consensus.cc:359] T c97f937160cf4068a000607700371c56 P ccb5d7de9811449d8105001cb43ac775 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.383625   471 raft_consensus.cc:385] T c97f937160cf4068a000607700371c56 P ccb5d7de9811449d8105001cb43ac775 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:04.383932   471 raft_consensus.cc:740] T c97f937160cf4068a000607700371c56 P ccb5d7de9811449d8105001cb43ac775 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccb5d7de9811449d8105001cb43ac775, State: Initialized, Role: FOLLOWER
I20260709 13:14:04.384701   471 consensus_queue.cc:260] T c97f937160cf4068a000607700371c56 P ccb5d7de9811449d8105001cb43ac775 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.381613   469 ts_tablet_manager.cc:1434] T c97f937160cf4068a000607700371c56 P c3db9c6332ea4354b25af20b8d98cde9: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:14:04.386646   469 tablet_bootstrap.cc:492] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9: Bootstrap starting.
I20260709 13:14:04.390580   471 ts_tablet_manager.cc:1434] T c97f937160cf4068a000607700371c56 P ccb5d7de9811449d8105001cb43ac775: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.001s
I20260709 13:14:04.391893   471 tablet_bootstrap.cc:492] T 6e71f9f26bcf449388fdf26ab44b79da P ccb5d7de9811449d8105001cb43ac775: Bootstrap starting.
I20260709 13:14:04.400282   471 tablet_bootstrap.cc:654] T 6e71f9f26bcf449388fdf26ab44b79da P ccb5d7de9811449d8105001cb43ac775: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:04.403067   469 tablet_bootstrap.cc:654] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:04.404340   472 tablet_bootstrap.cc:492] T 0e96fafd0e9644919d5f556114573533 P 371b5d0b1c9e48c79defeea5005327a6: No bootstrap required, opened a new log
I20260709 13:14:04.404902   472 ts_tablet_manager.cc:1403] T 0e96fafd0e9644919d5f556114573533 P 371b5d0b1c9e48c79defeea5005327a6: Time spent bootstrapping tablet: real 0.029s	user 0.020s	sys 0.007s
I20260709 13:14:04.405910   471 tablet_bootstrap.cc:492] T 6e71f9f26bcf449388fdf26ab44b79da P ccb5d7de9811449d8105001cb43ac775: No bootstrap required, opened a new log
I20260709 13:14:04.406423   471 ts_tablet_manager.cc:1403] T 6e71f9f26bcf449388fdf26ab44b79da P ccb5d7de9811449d8105001cb43ac775: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.003s
I20260709 13:14:04.407742   469 tablet_bootstrap.cc:492] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9: No bootstrap required, opened a new log
I20260709 13:14:04.408161   469 ts_tablet_manager.cc:1403] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.000s
I20260709 13:14:04.407975   472 raft_consensus.cc:359] T 0e96fafd0e9644919d5f556114573533 P 371b5d0b1c9e48c79defeea5005327a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.408775   472 raft_consensus.cc:385] T 0e96fafd0e9644919d5f556114573533 P 371b5d0b1c9e48c79defeea5005327a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:04.409071   472 raft_consensus.cc:740] T 0e96fafd0e9644919d5f556114573533 P 371b5d0b1c9e48c79defeea5005327a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b5d0b1c9e48c79defeea5005327a6, State: Initialized, Role: FOLLOWER
I20260709 13:14:04.409150   471 raft_consensus.cc:359] T 6e71f9f26bcf449388fdf26ab44b79da P ccb5d7de9811449d8105001cb43ac775 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.409879   471 raft_consensus.cc:385] T 6e71f9f26bcf449388fdf26ab44b79da P ccb5d7de9811449d8105001cb43ac775 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:04.410367   471 raft_consensus.cc:740] T 6e71f9f26bcf449388fdf26ab44b79da P ccb5d7de9811449d8105001cb43ac775 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccb5d7de9811449d8105001cb43ac775, State: Initialized, Role: FOLLOWER
I20260709 13:14:04.409866   472 consensus_queue.cc:260] T 0e96fafd0e9644919d5f556114573533 P 371b5d0b1c9e48c79defeea5005327a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.410557   469 raft_consensus.cc:359] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.411331   469 raft_consensus.cc:385] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:04.411116   471 consensus_queue.cc:260] T 6e71f9f26bcf449388fdf26ab44b79da P ccb5d7de9811449d8105001cb43ac775 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.411638   469 raft_consensus.cc:740] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3db9c6332ea4354b25af20b8d98cde9, State: Initialized, Role: FOLLOWER
I20260709 13:14:04.412520   472 ts_tablet_manager.cc:1434] T 0e96fafd0e9644919d5f556114573533 P 371b5d0b1c9e48c79defeea5005327a6: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:14:04.412416   469 consensus_queue.cc:260] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.413532   472 tablet_bootstrap.cc:492] T c97f937160cf4068a000607700371c56 P 371b5d0b1c9e48c79defeea5005327a6: Bootstrap starting.
I20260709 13:14:04.414901   469 ts_tablet_manager.cc:1434] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:14:04.415911   469 tablet_bootstrap.cc:492] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P c3db9c6332ea4354b25af20b8d98cde9: Bootstrap starting.
I20260709 13:14:04.418222   471 ts_tablet_manager.cc:1434] T 6e71f9f26bcf449388fdf26ab44b79da P ccb5d7de9811449d8105001cb43ac775: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:14:04.419209   471 tablet_bootstrap.cc:492] T efc64f8df3094f568e2fb0be3e56380b P ccb5d7de9811449d8105001cb43ac775: Bootstrap starting.
I20260709 13:14:04.420328   472 tablet_bootstrap.cc:654] T c97f937160cf4068a000607700371c56 P 371b5d0b1c9e48c79defeea5005327a6: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:04.422084   469 tablet_bootstrap.cc:654] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P c3db9c6332ea4354b25af20b8d98cde9: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:04.431792   472 tablet_bootstrap.cc:492] T c97f937160cf4068a000607700371c56 P 371b5d0b1c9e48c79defeea5005327a6: No bootstrap required, opened a new log
I20260709 13:14:04.432269   472 ts_tablet_manager.cc:1403] T c97f937160cf4068a000607700371c56 P 371b5d0b1c9e48c79defeea5005327a6: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 13:14:04.433632   471 tablet_bootstrap.cc:654] T efc64f8df3094f568e2fb0be3e56380b P ccb5d7de9811449d8105001cb43ac775: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:04.435141   472 raft_consensus.cc:359] T c97f937160cf4068a000607700371c56 P 371b5d0b1c9e48c79defeea5005327a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.435905   472 raft_consensus.cc:385] T c97f937160cf4068a000607700371c56 P 371b5d0b1c9e48c79defeea5005327a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:04.436192   472 raft_consensus.cc:740] T c97f937160cf4068a000607700371c56 P 371b5d0b1c9e48c79defeea5005327a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b5d0b1c9e48c79defeea5005327a6, State: Initialized, Role: FOLLOWER
I20260709 13:14:04.438321   472 consensus_queue.cc:260] T c97f937160cf4068a000607700371c56 P 371b5d0b1c9e48c79defeea5005327a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.440335   472 ts_tablet_manager.cc:1434] T c97f937160cf4068a000607700371c56 P 371b5d0b1c9e48c79defeea5005327a6: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:14:04.441262   469 tablet_bootstrap.cc:492] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P c3db9c6332ea4354b25af20b8d98cde9: No bootstrap required, opened a new log
I20260709 13:14:04.441581   472 tablet_bootstrap.cc:492] T 31972c45882a4ef1bd838a1790d929b4 P 371b5d0b1c9e48c79defeea5005327a6: Bootstrap starting.
I20260709 13:14:04.441802   469 ts_tablet_manager.cc:1403] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P c3db9c6332ea4354b25af20b8d98cde9: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.012s
I20260709 13:14:04.444756   469 raft_consensus.cc:359] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.445530   469 raft_consensus.cc:385] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:04.445870   469 raft_consensus.cc:740] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3db9c6332ea4354b25af20b8d98cde9, State: Initialized, Role: FOLLOWER
I20260709 13:14:04.446728   469 consensus_queue.cc:260] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P c3db9c6332ea4354b25af20b8d98cde9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.449419   472 tablet_bootstrap.cc:654] T 31972c45882a4ef1bd838a1790d929b4 P 371b5d0b1c9e48c79defeea5005327a6: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:04.459076   469 ts_tablet_manager.cc:1434] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P c3db9c6332ea4354b25af20b8d98cde9: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:14:04.460253   469 tablet_bootstrap.cc:492] T ccc5273ee6eb48e9ad577cb60a46001a P c3db9c6332ea4354b25af20b8d98cde9: Bootstrap starting.
I20260709 13:14:04.461089   472 tablet_bootstrap.cc:492] T 31972c45882a4ef1bd838a1790d929b4 P 371b5d0b1c9e48c79defeea5005327a6: No bootstrap required, opened a new log
I20260709 13:14:04.461669   472 ts_tablet_manager.cc:1403] T 31972c45882a4ef1bd838a1790d929b4 P 371b5d0b1c9e48c79defeea5005327a6: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.011s
I20260709 13:14:04.464599   472 raft_consensus.cc:359] T 31972c45882a4ef1bd838a1790d929b4 P 371b5d0b1c9e48c79defeea5005327a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.465378   472 raft_consensus.cc:385] T 31972c45882a4ef1bd838a1790d929b4 P 371b5d0b1c9e48c79defeea5005327a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:04.465713   472 raft_consensus.cc:740] T 31972c45882a4ef1bd838a1790d929b4 P 371b5d0b1c9e48c79defeea5005327a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b5d0b1c9e48c79defeea5005327a6, State: Initialized, Role: FOLLOWER
I20260709 13:14:04.466238   469 tablet_bootstrap.cc:654] T ccc5273ee6eb48e9ad577cb60a46001a P c3db9c6332ea4354b25af20b8d98cde9: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:04.466694   472 consensus_queue.cc:260] T 31972c45882a4ef1bd838a1790d929b4 P 371b5d0b1c9e48c79defeea5005327a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.470708   472 ts_tablet_manager.cc:1434] T 31972c45882a4ef1bd838a1790d929b4 P 371b5d0b1c9e48c79defeea5005327a6: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 13:14:04.471470   471 tablet_bootstrap.cc:492] T efc64f8df3094f568e2fb0be3e56380b P ccb5d7de9811449d8105001cb43ac775: No bootstrap required, opened a new log
I20260709 13:14:04.471782   472 tablet_bootstrap.cc:492] T ccc5273ee6eb48e9ad577cb60a46001a P 371b5d0b1c9e48c79defeea5005327a6: Bootstrap starting.
I20260709 13:14:04.471966   469 tablet_bootstrap.cc:492] T ccc5273ee6eb48e9ad577cb60a46001a P c3db9c6332ea4354b25af20b8d98cde9: No bootstrap required, opened a new log
I20260709 13:14:04.471979   471 ts_tablet_manager.cc:1403] T efc64f8df3094f568e2fb0be3e56380b P ccb5d7de9811449d8105001cb43ac775: Time spent bootstrapping tablet: real 0.053s	user 0.021s	sys 0.019s
I20260709 13:14:04.472543   469 ts_tablet_manager.cc:1403] T ccc5273ee6eb48e9ad577cb60a46001a P c3db9c6332ea4354b25af20b8d98cde9: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.001s
I20260709 13:14:04.475471   471 raft_consensus.cc:359] T efc64f8df3094f568e2fb0be3e56380b P ccb5d7de9811449d8105001cb43ac775 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.475831   469 raft_consensus.cc:359] T ccc5273ee6eb48e9ad577cb60a46001a P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.476291   471 raft_consensus.cc:385] T efc64f8df3094f568e2fb0be3e56380b P ccb5d7de9811449d8105001cb43ac775 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:04.476630   469 raft_consensus.cc:385] T ccc5273ee6eb48e9ad577cb60a46001a P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:04.476761   471 raft_consensus.cc:740] T efc64f8df3094f568e2fb0be3e56380b P ccb5d7de9811449d8105001cb43ac775 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccb5d7de9811449d8105001cb43ac775, State: Initialized, Role: FOLLOWER
I20260709 13:14:04.477053   469 raft_consensus.cc:740] T ccc5273ee6eb48e9ad577cb60a46001a P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3db9c6332ea4354b25af20b8d98cde9, State: Initialized, Role: FOLLOWER
I20260709 13:14:04.477797   471 consensus_queue.cc:260] T efc64f8df3094f568e2fb0be3e56380b P ccb5d7de9811449d8105001cb43ac775 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.477875   469 consensus_queue.cc:260] T ccc5273ee6eb48e9ad577cb60a46001a P c3db9c6332ea4354b25af20b8d98cde9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.480144   471 ts_tablet_manager.cc:1434] T efc64f8df3094f568e2fb0be3e56380b P ccb5d7de9811449d8105001cb43ac775: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:14:04.482043   471 tablet_bootstrap.cc:492] T 4fdcc1f9d3d34a1480606d325fe3616f P ccb5d7de9811449d8105001cb43ac775: Bootstrap starting.
I20260709 13:14:04.482362   469 ts_tablet_manager.cc:1434] T ccc5273ee6eb48e9ad577cb60a46001a P c3db9c6332ea4354b25af20b8d98cde9: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:14:04.483397   469 tablet_bootstrap.cc:492] T 31972c45882a4ef1bd838a1790d929b4 P c3db9c6332ea4354b25af20b8d98cde9: Bootstrap starting.
I20260709 13:14:04.483598   477 raft_consensus.cc:493] T 4fdcc1f9d3d34a1480606d325fe3616f P 371b5d0b1c9e48c79defeea5005327a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:04.484083   477 raft_consensus.cc:515] T 4fdcc1f9d3d34a1480606d325fe3616f P 371b5d0b1c9e48c79defeea5005327a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.484795   473 raft_consensus.cc:493] T ccc5273ee6eb48e9ad577cb60a46001a P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:04.485249   473 raft_consensus.cc:515] T ccc5273ee6eb48e9ad577cb60a46001a P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.487648   473 leader_election.cc:290] T ccc5273ee6eb48e9ad577cb60a46001a P c3db9c6332ea4354b25af20b8d98cde9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633), ccb5d7de9811449d8105001cb43ac775 (127.23.140.67:39377)
I20260709 13:14:04.488246   473 raft_consensus.cc:493] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:04.488677   473 raft_consensus.cc:515] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.489491   469 tablet_bootstrap.cc:654] T 31972c45882a4ef1bd838a1790d929b4 P c3db9c6332ea4354b25af20b8d98cde9: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:04.492765   472 tablet_bootstrap.cc:654] T ccc5273ee6eb48e9ad577cb60a46001a P 371b5d0b1c9e48c79defeea5005327a6: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:04.494750   477 leader_election.cc:290] T 4fdcc1f9d3d34a1480606d325fe3616f P 371b5d0b1c9e48c79defeea5005327a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3db9c6332ea4354b25af20b8d98cde9 (127.23.140.66:38883), ccb5d7de9811449d8105001cb43ac775 (127.23.140.67:39377)
I20260709 13:14:04.515497   473 leader_election.cc:290] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633), ccb5d7de9811449d8105001cb43ac775 (127.23.140.67:39377)
I20260709 13:14:04.528653   471 tablet_bootstrap.cc:654] T 4fdcc1f9d3d34a1480606d325fe3616f P ccb5d7de9811449d8105001cb43ac775: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:04.553252   473 raft_consensus.cc:493] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:04.554150   473 raft_consensus.cc:515] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.556805   473 leader_election.cc:290] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P c3db9c6332ea4354b25af20b8d98cde9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633), ccb5d7de9811449d8105001cb43ac775 (127.23.140.67:39377)
W20260709 13:14:04.572213 32693 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:04.583536   491 raft_consensus.cc:493] T 58c124bee20f4d039daa8d54154c0616 P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:04.584422   491 raft_consensus.cc:515] T 58c124bee20f4d039daa8d54154c0616 P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.589823   471 tablet_bootstrap.cc:492] T 4fdcc1f9d3d34a1480606d325fe3616f P ccb5d7de9811449d8105001cb43ac775: No bootstrap required, opened a new log
I20260709 13:14:04.590441   471 ts_tablet_manager.cc:1403] T 4fdcc1f9d3d34a1480606d325fe3616f P ccb5d7de9811449d8105001cb43ac775: Time spent bootstrapping tablet: real 0.109s	user 0.024s	sys 0.014s
I20260709 13:14:04.593539   471 raft_consensus.cc:359] T 4fdcc1f9d3d34a1480606d325fe3616f P ccb5d7de9811449d8105001cb43ac775 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.594251   471 raft_consensus.cc:385] T 4fdcc1f9d3d34a1480606d325fe3616f P ccb5d7de9811449d8105001cb43ac775 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:04.594545   471 raft_consensus.cc:740] T 4fdcc1f9d3d34a1480606d325fe3616f P ccb5d7de9811449d8105001cb43ac775 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccb5d7de9811449d8105001cb43ac775, State: Initialized, Role: FOLLOWER
I20260709 13:14:04.595481   471 consensus_queue.cc:260] T 4fdcc1f9d3d34a1480606d325fe3616f P ccb5d7de9811449d8105001cb43ac775 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.599700   471 ts_tablet_manager.cc:1434] T 4fdcc1f9d3d34a1480606d325fe3616f P ccb5d7de9811449d8105001cb43ac775: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:14:04.600796   471 tablet_bootstrap.cc:492] T 31972c45882a4ef1bd838a1790d929b4 P ccb5d7de9811449d8105001cb43ac775: Bootstrap starting.
I20260709 13:14:04.607290   471 tablet_bootstrap.cc:654] T 31972c45882a4ef1bd838a1790d929b4 P ccb5d7de9811449d8105001cb43ac775: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:04.611961   473 raft_consensus.cc:493] T c97f937160cf4068a000607700371c56 P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:04.612536   473 raft_consensus.cc:515] T c97f937160cf4068a000607700371c56 P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.614714   473 leader_election.cc:290] T c97f937160cf4068a000607700371c56 P c3db9c6332ea4354b25af20b8d98cde9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633), ccb5d7de9811449d8105001cb43ac775 (127.23.140.67:39377)
I20260709 13:14:04.621263   491 leader_election.cc:290] T 58c124bee20f4d039daa8d54154c0616 P c3db9c6332ea4354b25af20b8d98cde9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633), ccb5d7de9811449d8105001cb43ac775 (127.23.140.67:39377)
I20260709 13:14:04.621634   428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc5273ee6eb48e9ad577cb60a46001a" candidate_uuid: "c3db9c6332ea4354b25af20b8d98cde9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb5d7de9811449d8105001cb43ac775" is_pre_election: true
I20260709 13:14:04.622184   426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af3bf69a6b44d8b9ad324f545ddf5d5" candidate_uuid: "c3db9c6332ea4354b25af20b8d98cde9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb5d7de9811449d8105001cb43ac775" is_pre_election: true
I20260709 13:14:04.622462   428 raft_consensus.cc:2468] T ccc5273ee6eb48e9ad577cb60a46001a P ccb5d7de9811449d8105001cb43ac775 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3db9c6332ea4354b25af20b8d98cde9 in term 0.
I20260709 13:14:04.623751   425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f937160cf4068a000607700371c56" candidate_uuid: "c3db9c6332ea4354b25af20b8d98cde9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb5d7de9811449d8105001cb43ac775" is_pre_election: true
I20260709 13:14:04.623996   318 leader_election.cc:304] T ccc5273ee6eb48e9ad577cb60a46001a P c3db9c6332ea4354b25af20b8d98cde9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3db9c6332ea4354b25af20b8d98cde9, ccb5d7de9811449d8105001cb43ac775; no voters: 
I20260709 13:14:04.624677   425 raft_consensus.cc:2468] T c97f937160cf4068a000607700371c56 P ccb5d7de9811449d8105001cb43ac775 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3db9c6332ea4354b25af20b8d98cde9 in term 0.
W20260709 13:14:04.624979   318 leader_election.cc:343] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P c3db9c6332ea4354b25af20b8d98cde9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccb5d7de9811449d8105001cb43ac775 (127.23.140.67:39377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:04.626189   424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c124bee20f4d039daa8d54154c0616" candidate_uuid: "c3db9c6332ea4354b25af20b8d98cde9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb5d7de9811449d8105001cb43ac775" is_pre_election: true
I20260709 13:14:04.627434   471 tablet_bootstrap.cc:492] T 31972c45882a4ef1bd838a1790d929b4 P ccb5d7de9811449d8105001cb43ac775: No bootstrap required, opened a new log
I20260709 13:14:04.623769   427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fdcc1f9d3d34a1480606d325fe3616f" candidate_uuid: "c3db9c6332ea4354b25af20b8d98cde9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb5d7de9811449d8105001cb43ac775" is_pre_election: true
I20260709 13:14:04.628072   471 ts_tablet_manager.cc:1403] T 31972c45882a4ef1bd838a1790d929b4 P ccb5d7de9811449d8105001cb43ac775: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.003s
I20260709 13:14:04.628295   427 raft_consensus.cc:2468] T 4fdcc1f9d3d34a1480606d325fe3616f P ccb5d7de9811449d8105001cb43ac775 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3db9c6332ea4354b25af20b8d98cde9 in term 0.
I20260709 13:14:04.630373   318 leader_election.cc:304] T c97f937160cf4068a000607700371c56 P c3db9c6332ea4354b25af20b8d98cde9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3db9c6332ea4354b25af20b8d98cde9, ccb5d7de9811449d8105001cb43ac775; no voters: 
I20260709 13:14:04.631371   473 raft_consensus.cc:2804] T ccc5273ee6eb48e9ad577cb60a46001a P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:14:04.631556   318 leader_election.cc:343] T 58c124bee20f4d039daa8d54154c0616 P c3db9c6332ea4354b25af20b8d98cde9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccb5d7de9811449d8105001cb43ac775 (127.23.140.67:39377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:04.632369   491 raft_consensus.cc:2804] T c97f937160cf4068a000607700371c56 P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:04.631808   473 raft_consensus.cc:493] T ccc5273ee6eb48e9ad577cb60a46001a P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:04.635108   491 raft_consensus.cc:493] T c97f937160cf4068a000607700371c56 P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:04.633285   427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fdcc1f9d3d34a1480606d325fe3616f" candidate_uuid: "371b5d0b1c9e48c79defeea5005327a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb5d7de9811449d8105001cb43ac775" is_pre_election: true
I20260709 13:14:04.641278   427 raft_consensus.cc:2468] T 4fdcc1f9d3d34a1480606d325fe3616f P ccb5d7de9811449d8105001cb43ac775 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 371b5d0b1c9e48c79defeea5005327a6 in term 0.
I20260709 13:14:04.641373 32745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af3bf69a6b44d8b9ad324f545ddf5d5" candidate_uuid: "c3db9c6332ea4354b25af20b8d98cde9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b5d0b1c9e48c79defeea5005327a6" is_pre_election: true
I20260709 13:14:04.642047 32745 raft_consensus.cc:2468] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P 371b5d0b1c9e48c79defeea5005327a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3db9c6332ea4354b25af20b8d98cde9 in term 0.
I20260709 13:14:04.642203 32743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f937160cf4068a000607700371c56" candidate_uuid: "c3db9c6332ea4354b25af20b8d98cde9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b5d0b1c9e48c79defeea5005327a6" is_pre_election: true
I20260709 13:14:04.642766 32711 leader_election.cc:304] T 4fdcc1f9d3d34a1480606d325fe3616f P 371b5d0b1c9e48c79defeea5005327a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b5d0b1c9e48c79defeea5005327a6, ccb5d7de9811449d8105001cb43ac775; no voters: 
I20260709 13:14:04.643188 32743 raft_consensus.cc:2468] T c97f937160cf4068a000607700371c56 P 371b5d0b1c9e48c79defeea5005327a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3db9c6332ea4354b25af20b8d98cde9 in term 0.
I20260709 13:14:04.643397   317 leader_election.cc:304] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P c3db9c6332ea4354b25af20b8d98cde9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371b5d0b1c9e48c79defeea5005327a6, c3db9c6332ea4354b25af20b8d98cde9; no voters: ccb5d7de9811449d8105001cb43ac775
I20260709 13:14:04.641491 32744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c124bee20f4d039daa8d54154c0616" candidate_uuid: "c3db9c6332ea4354b25af20b8d98cde9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b5d0b1c9e48c79defeea5005327a6" is_pre_election: true
I20260709 13:14:04.644505   477 raft_consensus.cc:2804] T 4fdcc1f9d3d34a1480606d325fe3616f P 371b5d0b1c9e48c79defeea5005327a6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:04.644945   477 raft_consensus.cc:493] T 4fdcc1f9d3d34a1480606d325fe3616f P 371b5d0b1c9e48c79defeea5005327a6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:04.645287   477 raft_consensus.cc:3060] T 4fdcc1f9d3d34a1480606d325fe3616f P 371b5d0b1c9e48c79defeea5005327a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:04.645936   472 tablet_bootstrap.cc:492] T ccc5273ee6eb48e9ad577cb60a46001a P 371b5d0b1c9e48c79defeea5005327a6: No bootstrap required, opened a new log
I20260709 13:14:04.646140   491 raft_consensus.cc:3060] T c97f937160cf4068a000607700371c56 P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:04.646777   472 ts_tablet_manager.cc:1403] T ccc5273ee6eb48e9ad577cb60a46001a P 371b5d0b1c9e48c79defeea5005327a6: Time spent bootstrapping tablet: real 0.175s	user 0.026s	sys 0.117s
I20260709 13:14:04.649847   472 raft_consensus.cc:359] T ccc5273ee6eb48e9ad577cb60a46001a P 371b5d0b1c9e48c79defeea5005327a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.650558   472 raft_consensus.cc:385] T ccc5273ee6eb48e9ad577cb60a46001a P 371b5d0b1c9e48c79defeea5005327a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:04.650903   472 raft_consensus.cc:740] T ccc5273ee6eb48e9ad577cb60a46001a P 371b5d0b1c9e48c79defeea5005327a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b5d0b1c9e48c79defeea5005327a6, State: Initialized, Role: FOLLOWER
I20260709 13:14:04.631146   471 raft_consensus.cc:359] T 31972c45882a4ef1bd838a1790d929b4 P ccb5d7de9811449d8105001cb43ac775 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.635140   473 raft_consensus.cc:3060] T ccc5273ee6eb48e9ad577cb60a46001a P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:04.659219   471 raft_consensus.cc:385] T 31972c45882a4ef1bd838a1790d929b4 P ccb5d7de9811449d8105001cb43ac775 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:04.659698   471 raft_consensus.cc:740] T 31972c45882a4ef1bd838a1790d929b4 P ccb5d7de9811449d8105001cb43ac775 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccb5d7de9811449d8105001cb43ac775, State: Initialized, Role: FOLLOWER
I20260709 13:14:04.632572   318 leader_election.cc:304] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3db9c6332ea4354b25af20b8d98cde9, ccb5d7de9811449d8105001cb43ac775; no voters: 
I20260709 13:14:04.638736 32747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc5273ee6eb48e9ad577cb60a46001a" candidate_uuid: "c3db9c6332ea4354b25af20b8d98cde9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b5d0b1c9e48c79defeea5005327a6" is_pre_election: true
I20260709 13:14:04.639659 32746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fdcc1f9d3d34a1480606d325fe3616f" candidate_uuid: "c3db9c6332ea4354b25af20b8d98cde9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b5d0b1c9e48c79defeea5005327a6" is_pre_election: true
I20260709 13:14:04.637744   478 raft_consensus.cc:493] T 6e71f9f26bcf449388fdf26ab44b79da P ccb5d7de9811449d8105001cb43ac775 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:04.661814   478 raft_consensus.cc:515] T 6e71f9f26bcf449388fdf26ab44b79da P ccb5d7de9811449d8105001cb43ac775 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.663513   471 consensus_queue.cc:260] T 31972c45882a4ef1bd838a1790d929b4 P ccb5d7de9811449d8105001cb43ac775 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.664230   469 tablet_bootstrap.cc:492] T 31972c45882a4ef1bd838a1790d929b4 P c3db9c6332ea4354b25af20b8d98cde9: No bootstrap required, opened a new log
I20260709 13:14:04.664809   469 ts_tablet_manager.cc:1403] T 31972c45882a4ef1bd838a1790d929b4 P c3db9c6332ea4354b25af20b8d98cde9: Time spent bootstrapping tablet: real 0.182s	user 0.061s	sys 0.092s
I20260709 13:14:04.667899   472 consensus_queue.cc:260] T ccc5273ee6eb48e9ad577cb60a46001a P 371b5d0b1c9e48c79defeea5005327a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.669386 32747 raft_consensus.cc:2468] T ccc5273ee6eb48e9ad577cb60a46001a P 371b5d0b1c9e48c79defeea5005327a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3db9c6332ea4354b25af20b8d98cde9 in term 0.
I20260709 13:14:04.670332   469 raft_consensus.cc:359] T 31972c45882a4ef1bd838a1790d929b4 P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.671103   469 raft_consensus.cc:385] T 31972c45882a4ef1bd838a1790d929b4 P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:04.668347   502 raft_consensus.cc:2804] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:04.671896   502 raft_consensus.cc:493] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:04.672329   502 raft_consensus.cc:3060] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:04.673518   501 raft_consensus.cc:2804] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:04.673956   501 raft_consensus.cc:493] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:04.674289   501 raft_consensus.cc:3060] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:04.676986   318 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.67:39377, user_credentials={real_user=slave}} blocked reactor thread for 44514.5us
I20260709 13:14:04.671461   469 raft_consensus.cc:740] T 31972c45882a4ef1bd838a1790d929b4 P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3db9c6332ea4354b25af20b8d98cde9, State: Initialized, Role: FOLLOWER
I20260709 13:14:04.678548   469 consensus_queue.cc:260] T 31972c45882a4ef1bd838a1790d929b4 P c3db9c6332ea4354b25af20b8d98cde9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
W20260709 13:14:04.678908   317 leader_election.cc:343] T 58c124bee20f4d039daa8d54154c0616 P c3db9c6332ea4354b25af20b8d98cde9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:04.679386   317 leader_election.cc:304] T 58c124bee20f4d039daa8d54154c0616 P c3db9c6332ea4354b25af20b8d98cde9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3db9c6332ea4354b25af20b8d98cde9; no voters: 371b5d0b1c9e48c79defeea5005327a6, ccb5d7de9811449d8105001cb43ac775
I20260709 13:14:04.681347   471 ts_tablet_manager.cc:1434] T 31972c45882a4ef1bd838a1790d929b4 P ccb5d7de9811449d8105001cb43ac775: Time spent starting tablet: real 0.053s	user 0.010s	sys 0.001s
I20260709 13:14:04.685917   471 tablet_bootstrap.cc:492] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P ccb5d7de9811449d8105001cb43ac775: Bootstrap starting.
I20260709 13:14:04.692057   469 ts_tablet_manager.cc:1434] T 31972c45882a4ef1bd838a1790d929b4 P c3db9c6332ea4354b25af20b8d98cde9: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.004s
I20260709 13:14:04.694721   478 leader_election.cc:290] T 6e71f9f26bcf449388fdf26ab44b79da P ccb5d7de9811449d8105001cb43ac775 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633), c3db9c6332ea4354b25af20b8d98cde9 (127.23.140.66:38883)
I20260709 13:14:04.695032   502 raft_consensus.cc:515] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P c3db9c6332ea4354b25af20b8d98cde9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.696571   354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fdcc1f9d3d34a1480606d325fe3616f" candidate_uuid: "371b5d0b1c9e48c79defeea5005327a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3db9c6332ea4354b25af20b8d98cde9" is_pre_election: true
I20260709 13:14:04.697456   502 leader_election.cc:290] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P c3db9c6332ea4354b25af20b8d98cde9 [CANDIDATE]: Term 1 election: Requested vote from peers 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633), ccb5d7de9811449d8105001cb43ac775 (127.23.140.67:39377)
I20260709 13:14:04.699156 32747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af3bf69a6b44d8b9ad324f545ddf5d5" candidate_uuid: "c3db9c6332ea4354b25af20b8d98cde9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b5d0b1c9e48c79defeea5005327a6"
I20260709 13:14:04.699251   427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af3bf69a6b44d8b9ad324f545ddf5d5" candidate_uuid: "c3db9c6332ea4354b25af20b8d98cde9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb5d7de9811449d8105001cb43ac775"
I20260709 13:14:04.699836 32747 raft_consensus.cc:3060] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P 371b5d0b1c9e48c79defeea5005327a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:04.700431   469 tablet_bootstrap.cc:492] T 42473b265d0f476b928fdcbe60fd318b P c3db9c6332ea4354b25af20b8d98cde9: Bootstrap starting.
I20260709 13:14:04.707149   469 tablet_bootstrap.cc:654] T 42473b265d0f476b928fdcbe60fd318b P c3db9c6332ea4354b25af20b8d98cde9: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:04.707536 32747 raft_consensus.cc:2468] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P 371b5d0b1c9e48c79defeea5005327a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3db9c6332ea4354b25af20b8d98cde9 in term 1.
I20260709 13:14:04.696892   507 raft_consensus.cc:2749] T 58c124bee20f4d039daa8d54154c0616 P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:14:04.707835   318 leader_election.cc:343] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P c3db9c6332ea4354b25af20b8d98cde9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ccb5d7de9811449d8105001cb43ac775 (127.23.140.67:39377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:04.712435   471 tablet_bootstrap.cc:654] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P ccb5d7de9811449d8105001cb43ac775: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:04.714566   317 leader_election.cc:304] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P c3db9c6332ea4354b25af20b8d98cde9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371b5d0b1c9e48c79defeea5005327a6, c3db9c6332ea4354b25af20b8d98cde9; no voters: ccb5d7de9811449d8105001cb43ac775
I20260709 13:14:04.715561   506 raft_consensus.cc:2804] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P c3db9c6332ea4354b25af20b8d98cde9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:04.716135   506 raft_consensus.cc:697] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P c3db9c6332ea4354b25af20b8d98cde9 [term 1 LEADER]: Becoming Leader. State: Replica: c3db9c6332ea4354b25af20b8d98cde9, State: Running, Role: LEADER
I20260709 13:14:04.717165   506 consensus_queue.cc:237] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P c3db9c6332ea4354b25af20b8d98cde9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.708443   491 raft_consensus.cc:515] T c97f937160cf4068a000607700371c56 P c3db9c6332ea4354b25af20b8d98cde9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.725138 32744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f937160cf4068a000607700371c56" candidate_uuid: "c3db9c6332ea4354b25af20b8d98cde9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b5d0b1c9e48c79defeea5005327a6"
I20260709 13:14:04.725925 32744 raft_consensus.cc:3060] T c97f937160cf4068a000607700371c56 P 371b5d0b1c9e48c79defeea5005327a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:04.728300   477 raft_consensus.cc:515] T 4fdcc1f9d3d34a1480606d325fe3616f P 371b5d0b1c9e48c79defeea5005327a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.729872 32746 raft_consensus.cc:2393] T 4fdcc1f9d3d34a1480606d325fe3616f P 371b5d0b1c9e48c79defeea5005327a6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c3db9c6332ea4354b25af20b8d98cde9 in current term 1: Already voted for candidate 371b5d0b1c9e48c79defeea5005327a6 in this term.
I20260709 13:14:04.724866   473 raft_consensus.cc:515] T ccc5273ee6eb48e9ad577cb60a46001a P c3db9c6332ea4354b25af20b8d98cde9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.738147   427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc5273ee6eb48e9ad577cb60a46001a" candidate_uuid: "c3db9c6332ea4354b25af20b8d98cde9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb5d7de9811449d8105001cb43ac775"
I20260709 13:14:04.738898   427 raft_consensus.cc:3060] T ccc5273ee6eb48e9ad577cb60a46001a P ccb5d7de9811449d8105001cb43ac775 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:04.739590 32744 raft_consensus.cc:2468] T c97f937160cf4068a000607700371c56 P 371b5d0b1c9e48c79defeea5005327a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3db9c6332ea4354b25af20b8d98cde9 in term 1.
I20260709 13:14:04.757827   317 leader_election.cc:304] T c97f937160cf4068a000607700371c56 P c3db9c6332ea4354b25af20b8d98cde9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b5d0b1c9e48c79defeea5005327a6, c3db9c6332ea4354b25af20b8d98cde9; no voters: 
I20260709 13:14:04.759104   507 raft_consensus.cc:2804] T c97f937160cf4068a000607700371c56 P c3db9c6332ea4354b25af20b8d98cde9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:04.759687   507 raft_consensus.cc:697] T c97f937160cf4068a000607700371c56 P c3db9c6332ea4354b25af20b8d98cde9 [term 1 LEADER]: Becoming Leader. State: Replica: c3db9c6332ea4354b25af20b8d98cde9, State: Running, Role: LEADER
I20260709 13:14:04.759806 32642 catalog_manager.cc:5697] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P c3db9c6332ea4354b25af20b8d98cde9 reported cstate change: term changed from 0 to 1, leader changed from <none> to c3db9c6332ea4354b25af20b8d98cde9 (127.23.140.66). New cstate: current_term: 1 leader_uuid: "c3db9c6332ea4354b25af20b8d98cde9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:04.760717   507 consensus_queue.cc:237] T c97f937160cf4068a000607700371c56 P c3db9c6332ea4354b25af20b8d98cde9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.762188 32747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc5273ee6eb48e9ad577cb60a46001a" candidate_uuid: "c3db9c6332ea4354b25af20b8d98cde9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b5d0b1c9e48c79defeea5005327a6"
I20260709 13:14:04.763072 32747 raft_consensus.cc:3060] T ccc5273ee6eb48e9ad577cb60a46001a P 371b5d0b1c9e48c79defeea5005327a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:04.766151   491 leader_election.cc:290] T c97f937160cf4068a000607700371c56 P c3db9c6332ea4354b25af20b8d98cde9 [CANDIDATE]: Term 1 election: Requested vote from peers 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633), ccb5d7de9811449d8105001cb43ac775 (127.23.140.67:39377)
I20260709 13:14:04.767912   512 raft_consensus.cc:493] T 0e96fafd0e9644919d5f556114573533 P 371b5d0b1c9e48c79defeea5005327a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:04.768675   424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f937160cf4068a000607700371c56" candidate_uuid: "c3db9c6332ea4354b25af20b8d98cde9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb5d7de9811449d8105001cb43ac775"
I20260709 13:14:04.768537   512 raft_consensus.cc:515] T 0e96fafd0e9644919d5f556114573533 P 371b5d0b1c9e48c79defeea5005327a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.769510   424 raft_consensus.cc:3060] T c97f937160cf4068a000607700371c56 P ccb5d7de9811449d8105001cb43ac775 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:04.713435   501 raft_consensus.cc:515] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.775177   354 raft_consensus.cc:2393] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 371b5d0b1c9e48c79defeea5005327a6 in current term 1: Already voted for candidate c3db9c6332ea4354b25af20b8d98cde9 in this term.
I20260709 13:14:04.779763 32744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fdcc1f9d3d34a1480606d325fe3616f" candidate_uuid: "c3db9c6332ea4354b25af20b8d98cde9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b5d0b1c9e48c79defeea5005327a6"
I20260709 13:14:04.780014   354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e96fafd0e9644919d5f556114573533" candidate_uuid: "371b5d0b1c9e48c79defeea5005327a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3db9c6332ea4354b25af20b8d98cde9" is_pre_election: true
I20260709 13:14:04.780771 32744 raft_consensus.cc:2393] T 4fdcc1f9d3d34a1480606d325fe3616f P 371b5d0b1c9e48c79defeea5005327a6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c3db9c6332ea4354b25af20b8d98cde9 in current term 1: Already voted for candidate 371b5d0b1c9e48c79defeea5005327a6 in this term.
W20260709 13:14:04.781828 32713 leader_election.cc:343] T 0e96fafd0e9644919d5f556114573533 P 371b5d0b1c9e48c79defeea5005327a6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c3db9c6332ea4354b25af20b8d98cde9 (127.23.140.66:38883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:04.786011   425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fdcc1f9d3d34a1480606d325fe3616f" candidate_uuid: "371b5d0b1c9e48c79defeea5005327a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb5d7de9811449d8105001cb43ac775"
I20260709 13:14:04.786799   425 raft_consensus.cc:3060] T 4fdcc1f9d3d34a1480606d325fe3616f P ccb5d7de9811449d8105001cb43ac775 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:04.787228   501 leader_election.cc:290] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9 [CANDIDATE]: Term 1 election: Requested vote from peers 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633), ccb5d7de9811449d8105001cb43ac775 (127.23.140.67:39377)
I20260709 13:14:04.788280   471 tablet_bootstrap.cc:492] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P ccb5d7de9811449d8105001cb43ac775: No bootstrap required, opened a new log
I20260709 13:14:04.788805   471 ts_tablet_manager.cc:1403] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P ccb5d7de9811449d8105001cb43ac775: Time spent bootstrapping tablet: real 0.103s	user 0.025s	sys 0.017s
I20260709 13:14:04.788935   512 leader_election.cc:290] T 0e96fafd0e9644919d5f556114573533 P 371b5d0b1c9e48c79defeea5005327a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3db9c6332ea4354b25af20b8d98cde9 (127.23.140.66:38883), ccb5d7de9811449d8105001cb43ac775 (127.23.140.67:39377)
I20260709 13:14:04.790836   428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e96fafd0e9644919d5f556114573533" candidate_uuid: "371b5d0b1c9e48c79defeea5005327a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb5d7de9811449d8105001cb43ac775" is_pre_election: true
I20260709 13:14:04.791836   471 raft_consensus.cc:359] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P ccb5d7de9811449d8105001cb43ac775 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.792551   471 raft_consensus.cc:385] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P ccb5d7de9811449d8105001cb43ac775 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:14:04.792495 32711 leader_election.cc:343] T 0e96fafd0e9644919d5f556114573533 P 371b5d0b1c9e48c79defeea5005327a6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccb5d7de9811449d8105001cb43ac775 (127.23.140.67:39377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:04.793298 32711 leader_election.cc:304] T 0e96fafd0e9644919d5f556114573533 P 371b5d0b1c9e48c79defeea5005327a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 371b5d0b1c9e48c79defeea5005327a6; no voters: c3db9c6332ea4354b25af20b8d98cde9, ccb5d7de9811449d8105001cb43ac775
I20260709 13:14:04.793951   471 raft_consensus.cc:740] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P ccb5d7de9811449d8105001cb43ac775 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccb5d7de9811449d8105001cb43ac775, State: Initialized, Role: FOLLOWER
I20260709 13:14:04.794729   471 consensus_queue.cc:260] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P ccb5d7de9811449d8105001cb43ac775 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.797055   471 ts_tablet_manager.cc:1434] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P ccb5d7de9811449d8105001cb43ac775: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:14:04.794845   428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fdcc1f9d3d34a1480606d325fe3616f" candidate_uuid: "c3db9c6332ea4354b25af20b8d98cde9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb5d7de9811449d8105001cb43ac775"
I20260709 13:14:04.800587   354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fdcc1f9d3d34a1480606d325fe3616f" candidate_uuid: "371b5d0b1c9e48c79defeea5005327a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3db9c6332ea4354b25af20b8d98cde9"
I20260709 13:14:04.801729   425 raft_consensus.cc:2468] T 4fdcc1f9d3d34a1480606d325fe3616f P ccb5d7de9811449d8105001cb43ac775 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371b5d0b1c9e48c79defeea5005327a6 in term 1.
I20260709 13:14:04.803012 32711 leader_election.cc:304] T 4fdcc1f9d3d34a1480606d325fe3616f P 371b5d0b1c9e48c79defeea5005327a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b5d0b1c9e48c79defeea5005327a6, ccb5d7de9811449d8105001cb43ac775; no voters: 
I20260709 13:14:04.808300   471 tablet_bootstrap.cc:492] T 58c124bee20f4d039daa8d54154c0616 P ccb5d7de9811449d8105001cb43ac775: Bootstrap starting.
I20260709 13:14:04.801813   354 raft_consensus.cc:2393] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 371b5d0b1c9e48c79defeea5005327a6 in current term 1: Already voted for candidate c3db9c6332ea4354b25af20b8d98cde9 in this term.
I20260709 13:14:04.801896   512 raft_consensus.cc:2749] T 0e96fafd0e9644919d5f556114573533 P 371b5d0b1c9e48c79defeea5005327a6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:04.811250   512 raft_consensus.cc:2804] T 4fdcc1f9d3d34a1480606d325fe3616f P 371b5d0b1c9e48c79defeea5005327a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:04.811805   512 raft_consensus.cc:697] T 4fdcc1f9d3d34a1480606d325fe3616f P 371b5d0b1c9e48c79defeea5005327a6 [term 1 LEADER]: Becoming Leader. State: Replica: 371b5d0b1c9e48c79defeea5005327a6, State: Running, Role: LEADER
I20260709 13:14:04.813995   318 leader_election.cc:304] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3db9c6332ea4354b25af20b8d98cde9; no voters: 371b5d0b1c9e48c79defeea5005327a6, ccb5d7de9811449d8105001cb43ac775
I20260709 13:14:04.815091   501 raft_consensus.cc:2749] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:14:04.820518 32747 raft_consensus.cc:2468] T ccc5273ee6eb48e9ad577cb60a46001a P 371b5d0b1c9e48c79defeea5005327a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3db9c6332ea4354b25af20b8d98cde9 in term 1.
I20260709 13:14:04.812898   512 consensus_queue.cc:237] T 4fdcc1f9d3d34a1480606d325fe3616f P 371b5d0b1c9e48c79defeea5005327a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.816988   477 leader_election.cc:290] T 4fdcc1f9d3d34a1480606d325fe3616f P 371b5d0b1c9e48c79defeea5005327a6 [CANDIDATE]: Term 1 election: Requested vote from peers c3db9c6332ea4354b25af20b8d98cde9 (127.23.140.66:38883), ccb5d7de9811449d8105001cb43ac775 (127.23.140.67:39377)
I20260709 13:14:04.816812   473 leader_election.cc:290] T ccc5273ee6eb48e9ad577cb60a46001a P c3db9c6332ea4354b25af20b8d98cde9 [CANDIDATE]: Term 1 election: Requested vote from peers 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633), ccb5d7de9811449d8105001cb43ac775 (127.23.140.67:39377)
I20260709 13:14:04.829677   469 tablet_bootstrap.cc:492] T 42473b265d0f476b928fdcbe60fd318b P c3db9c6332ea4354b25af20b8d98cde9: No bootstrap required, opened a new log
I20260709 13:14:04.830510   469 ts_tablet_manager.cc:1403] T 42473b265d0f476b928fdcbe60fd318b P c3db9c6332ea4354b25af20b8d98cde9: Time spent bootstrapping tablet: real 0.130s	user 0.028s	sys 0.027s
I20260709 13:14:04.833359   424 raft_consensus.cc:2468] T c97f937160cf4068a000607700371c56 P ccb5d7de9811449d8105001cb43ac775 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3db9c6332ea4354b25af20b8d98cde9 in term 1.
I20260709 13:14:04.834103   469 raft_consensus.cc:359] T 42473b265d0f476b928fdcbe60fd318b P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.835045   469 raft_consensus.cc:385] T 42473b265d0f476b928fdcbe60fd318b P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:04.835378   469 raft_consensus.cc:740] T 42473b265d0f476b928fdcbe60fd318b P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3db9c6332ea4354b25af20b8d98cde9, State: Initialized, Role: FOLLOWER
I20260709 13:14:04.835983   427 raft_consensus.cc:2468] T ccc5273ee6eb48e9ad577cb60a46001a P ccb5d7de9811449d8105001cb43ac775 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3db9c6332ea4354b25af20b8d98cde9 in term 1.
I20260709 13:14:04.836403   469 consensus_queue.cc:260] T 42473b265d0f476b928fdcbe60fd318b P c3db9c6332ea4354b25af20b8d98cde9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.823266   471 tablet_bootstrap.cc:654] T 58c124bee20f4d039daa8d54154c0616 P ccb5d7de9811449d8105001cb43ac775: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:04.840620   469 ts_tablet_manager.cc:1434] T 42473b265d0f476b928fdcbe60fd318b P c3db9c6332ea4354b25af20b8d98cde9: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.003s
I20260709 13:14:04.841476   469 tablet_bootstrap.cc:492] T efc64f8df3094f568e2fb0be3e56380b P c3db9c6332ea4354b25af20b8d98cde9: Bootstrap starting.
I20260709 13:14:04.841328   317 leader_election.cc:304] T ccc5273ee6eb48e9ad577cb60a46001a P c3db9c6332ea4354b25af20b8d98cde9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b5d0b1c9e48c79defeea5005327a6, c3db9c6332ea4354b25af20b8d98cde9; no voters: 
I20260709 13:14:04.840024   473 raft_consensus.cc:493] T 6e71f9f26bcf449388fdf26ab44b79da P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:04.842840   473 raft_consensus.cc:515] T 6e71f9f26bcf449388fdf26ab44b79da P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.844211   507 raft_consensus.cc:2804] T ccc5273ee6eb48e9ad577cb60a46001a P c3db9c6332ea4354b25af20b8d98cde9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:04.844772   507 raft_consensus.cc:697] T ccc5273ee6eb48e9ad577cb60a46001a P c3db9c6332ea4354b25af20b8d98cde9 [term 1 LEADER]: Becoming Leader. State: Replica: c3db9c6332ea4354b25af20b8d98cde9, State: Running, Role: LEADER
I20260709 13:14:04.845458   473 leader_election.cc:290] T 6e71f9f26bcf449388fdf26ab44b79da P c3db9c6332ea4354b25af20b8d98cde9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633), ccb5d7de9811449d8105001cb43ac775 (127.23.140.67:39377)
I20260709 13:14:04.842347   472 ts_tablet_manager.cc:1434] T ccc5273ee6eb48e9ad577cb60a46001a P 371b5d0b1c9e48c79defeea5005327a6: Time spent starting tablet: real 0.195s	user 0.062s	sys 0.121s
I20260709 13:14:04.845829 32747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e71f9f26bcf449388fdf26ab44b79da" candidate_uuid: "c3db9c6332ea4354b25af20b8d98cde9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b5d0b1c9e48c79defeea5005327a6" is_pre_election: true
I20260709 13:14:04.847250   472 tablet_bootstrap.cc:492] T efc64f8df3094f568e2fb0be3e56380b P 371b5d0b1c9e48c79defeea5005327a6: Bootstrap starting.
W20260709 13:14:04.847182   317 leader_election.cc:343] T 6e71f9f26bcf449388fdf26ab44b79da P c3db9c6332ea4354b25af20b8d98cde9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:04.847929   469 tablet_bootstrap.cc:654] T efc64f8df3094f568e2fb0be3e56380b P c3db9c6332ea4354b25af20b8d98cde9: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:04.848446   507 consensus_queue.cc:237] T ccc5273ee6eb48e9ad577cb60a46001a P c3db9c6332ea4354b25af20b8d98cde9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.850893   427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e71f9f26bcf449388fdf26ab44b79da" candidate_uuid: "c3db9c6332ea4354b25af20b8d98cde9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb5d7de9811449d8105001cb43ac775" is_pre_election: true
I20260709 13:14:04.851594   427 raft_consensus.cc:2468] T 6e71f9f26bcf449388fdf26ab44b79da P ccb5d7de9811449d8105001cb43ac775 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3db9c6332ea4354b25af20b8d98cde9 in term 0.
I20260709 13:14:04.852046 32747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e71f9f26bcf449388fdf26ab44b79da" candidate_uuid: "ccb5d7de9811449d8105001cb43ac775" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b5d0b1c9e48c79defeea5005327a6" is_pre_election: true
I20260709 13:14:04.868328   472 tablet_bootstrap.cc:654] T efc64f8df3094f568e2fb0be3e56380b P 371b5d0b1c9e48c79defeea5005327a6: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:04.869069   391 leader_election.cc:343] T 6e71f9f26bcf449388fdf26ab44b79da P ccb5d7de9811449d8105001cb43ac775 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:04.871744 32644 catalog_manager.cc:5697] T 4fdcc1f9d3d34a1480606d325fe3616f P 371b5d0b1c9e48c79defeea5005327a6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65). New cstate: current_term: 1 leader_uuid: "371b5d0b1c9e48c79defeea5005327a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:04.856750   318 leader_election.cc:304] T 6e71f9f26bcf449388fdf26ab44b79da P c3db9c6332ea4354b25af20b8d98cde9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c3db9c6332ea4354b25af20b8d98cde9, ccb5d7de9811449d8105001cb43ac775; no voters: 371b5d0b1c9e48c79defeea5005327a6
I20260709 13:14:04.874984   473 raft_consensus.cc:2804] T 6e71f9f26bcf449388fdf26ab44b79da P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:04.875378   473 raft_consensus.cc:493] T 6e71f9f26bcf449388fdf26ab44b79da P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:04.875730   473 raft_consensus.cc:3060] T 6e71f9f26bcf449388fdf26ab44b79da P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:04.878933   354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e71f9f26bcf449388fdf26ab44b79da" candidate_uuid: "ccb5d7de9811449d8105001cb43ac775" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3db9c6332ea4354b25af20b8d98cde9" is_pre_election: true
I20260709 13:14:04.880236   469 tablet_bootstrap.cc:492] T efc64f8df3094f568e2fb0be3e56380b P c3db9c6332ea4354b25af20b8d98cde9: No bootstrap required, opened a new log
I20260709 13:14:04.882336   469 ts_tablet_manager.cc:1403] T efc64f8df3094f568e2fb0be3e56380b P c3db9c6332ea4354b25af20b8d98cde9: Time spent bootstrapping tablet: real 0.041s	user 0.013s	sys 0.005s
I20260709 13:14:04.885411   469 raft_consensus.cc:359] T efc64f8df3094f568e2fb0be3e56380b P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.886236   469 raft_consensus.cc:385] T efc64f8df3094f568e2fb0be3e56380b P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:04.886523   469 raft_consensus.cc:740] T efc64f8df3094f568e2fb0be3e56380b P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3db9c6332ea4354b25af20b8d98cde9, State: Initialized, Role: FOLLOWER
I20260709 13:14:04.886862   473 raft_consensus.cc:515] T 6e71f9f26bcf449388fdf26ab44b79da P c3db9c6332ea4354b25af20b8d98cde9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.887262   469 consensus_queue.cc:260] T efc64f8df3094f568e2fb0be3e56380b P c3db9c6332ea4354b25af20b8d98cde9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.888096   354 raft_consensus.cc:2393] T 6e71f9f26bcf449388fdf26ab44b79da P c3db9c6332ea4354b25af20b8d98cde9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccb5d7de9811449d8105001cb43ac775 in current term 1: Already voted for candidate c3db9c6332ea4354b25af20b8d98cde9 in this term.
I20260709 13:14:04.888121   472 tablet_bootstrap.cc:492] T efc64f8df3094f568e2fb0be3e56380b P 371b5d0b1c9e48c79defeea5005327a6: No bootstrap required, opened a new log
I20260709 13:14:04.889482   472 ts_tablet_manager.cc:1403] T efc64f8df3094f568e2fb0be3e56380b P 371b5d0b1c9e48c79defeea5005327a6: Time spent bootstrapping tablet: real 0.042s	user 0.014s	sys 0.003s
I20260709 13:14:04.889439   512 raft_consensus.cc:493] T 31972c45882a4ef1bd838a1790d929b4 P 371b5d0b1c9e48c79defeea5005327a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:04.889899   469 ts_tablet_manager.cc:1434] T efc64f8df3094f568e2fb0be3e56380b P c3db9c6332ea4354b25af20b8d98cde9: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:14:04.890239   512 raft_consensus.cc:515] T 31972c45882a4ef1bd838a1790d929b4 P 371b5d0b1c9e48c79defeea5005327a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.890911   469 tablet_bootstrap.cc:492] T 0e96fafd0e9644919d5f556114573533 P c3db9c6332ea4354b25af20b8d98cde9: Bootstrap starting.
I20260709 13:14:04.892526   512 leader_election.cc:290] T 31972c45882a4ef1bd838a1790d929b4 P 371b5d0b1c9e48c79defeea5005327a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3db9c6332ea4354b25af20b8d98cde9 (127.23.140.66:38883), ccb5d7de9811449d8105001cb43ac775 (127.23.140.67:39377)
I20260709 13:14:04.893069   472 raft_consensus.cc:359] T efc64f8df3094f568e2fb0be3e56380b P 371b5d0b1c9e48c79defeea5005327a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.893977   471 tablet_bootstrap.cc:492] T 58c124bee20f4d039daa8d54154c0616 P ccb5d7de9811449d8105001cb43ac775: No bootstrap required, opened a new log
I20260709 13:14:04.894542   471 ts_tablet_manager.cc:1403] T 58c124bee20f4d039daa8d54154c0616 P ccb5d7de9811449d8105001cb43ac775: Time spent bootstrapping tablet: real 0.087s	user 0.016s	sys 0.000s
I20260709 13:14:04.894591   427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31972c45882a4ef1bd838a1790d929b4" candidate_uuid: "371b5d0b1c9e48c79defeea5005327a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb5d7de9811449d8105001cb43ac775" is_pre_election: true
I20260709 13:14:04.896064   427 raft_consensus.cc:2468] T 31972c45882a4ef1bd838a1790d929b4 P ccb5d7de9811449d8105001cb43ac775 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 371b5d0b1c9e48c79defeea5005327a6 in term 0.
I20260709 13:14:04.896469   469 tablet_bootstrap.cc:654] T 0e96fafd0e9644919d5f556114573533 P c3db9c6332ea4354b25af20b8d98cde9: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:04.896170   394 leader_election.cc:304] T 6e71f9f26bcf449388fdf26ab44b79da P ccb5d7de9811449d8105001cb43ac775 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccb5d7de9811449d8105001cb43ac775; no voters: 371b5d0b1c9e48c79defeea5005327a6, c3db9c6332ea4354b25af20b8d98cde9
I20260709 13:14:04.897153   471 raft_consensus.cc:359] T 58c124bee20f4d039daa8d54154c0616 P ccb5d7de9811449d8105001cb43ac775 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.897419   354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31972c45882a4ef1bd838a1790d929b4" candidate_uuid: "371b5d0b1c9e48c79defeea5005327a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3db9c6332ea4354b25af20b8d98cde9" is_pre_election: true
I20260709 13:14:04.893935   472 raft_consensus.cc:385] T efc64f8df3094f568e2fb0be3e56380b P 371b5d0b1c9e48c79defeea5005327a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:04.897853   478 raft_consensus.cc:3060] T 6e71f9f26bcf449388fdf26ab44b79da P ccb5d7de9811449d8105001cb43ac775 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:04.897986   472 raft_consensus.cc:740] T efc64f8df3094f568e2fb0be3e56380b P 371b5d0b1c9e48c79defeea5005327a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b5d0b1c9e48c79defeea5005327a6, State: Initialized, Role: FOLLOWER
I20260709 13:14:04.898041   354 raft_consensus.cc:2468] T 31972c45882a4ef1bd838a1790d929b4 P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 371b5d0b1c9e48c79defeea5005327a6 in term 0.
I20260709 13:14:04.899039   472 consensus_queue.cc:260] T efc64f8df3094f568e2fb0be3e56380b P 371b5d0b1c9e48c79defeea5005327a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.899328 32713 leader_election.cc:304] T 31972c45882a4ef1bd838a1790d929b4 P 371b5d0b1c9e48c79defeea5005327a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b5d0b1c9e48c79defeea5005327a6, c3db9c6332ea4354b25af20b8d98cde9; no voters: 
I20260709 13:14:04.900576   504 raft_consensus.cc:2804] T 31972c45882a4ef1bd838a1790d929b4 P 371b5d0b1c9e48c79defeea5005327a6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:04.900944   504 raft_consensus.cc:493] T 31972c45882a4ef1bd838a1790d929b4 P 371b5d0b1c9e48c79defeea5005327a6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:04.901255   504 raft_consensus.cc:3060] T 31972c45882a4ef1bd838a1790d929b4 P 371b5d0b1c9e48c79defeea5005327a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:04.901360   472 ts_tablet_manager.cc:1434] T efc64f8df3094f568e2fb0be3e56380b P 371b5d0b1c9e48c79defeea5005327a6: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 13:14:04.902418   472 tablet_bootstrap.cc:492] T 58c124bee20f4d039daa8d54154c0616 P 371b5d0b1c9e48c79defeea5005327a6: Bootstrap starting.
I20260709 13:14:04.908550   472 tablet_bootstrap.cc:654] T 58c124bee20f4d039daa8d54154c0616 P 371b5d0b1c9e48c79defeea5005327a6: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:04.897871   471 raft_consensus.cc:385] T 58c124bee20f4d039daa8d54154c0616 P ccb5d7de9811449d8105001cb43ac775 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:04.908922   504 raft_consensus.cc:515] T 31972c45882a4ef1bd838a1790d929b4 P 371b5d0b1c9e48c79defeea5005327a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.909538   471 raft_consensus.cc:740] T 58c124bee20f4d039daa8d54154c0616 P ccb5d7de9811449d8105001cb43ac775 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccb5d7de9811449d8105001cb43ac775, State: Initialized, Role: FOLLOWER
I20260709 13:14:04.910791   471 consensus_queue.cc:260] T 58c124bee20f4d039daa8d54154c0616 P ccb5d7de9811449d8105001cb43ac775 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.912961   471 ts_tablet_manager.cc:1434] T 58c124bee20f4d039daa8d54154c0616 P ccb5d7de9811449d8105001cb43ac775: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:14:04.914783   471 tablet_bootstrap.cc:492] T 0e96fafd0e9644919d5f556114573533 P ccb5d7de9811449d8105001cb43ac775: Bootstrap starting.
I20260709 13:14:04.921458   471 tablet_bootstrap.cc:654] T 0e96fafd0e9644919d5f556114573533 P ccb5d7de9811449d8105001cb43ac775: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:04.913477   478 raft_consensus.cc:2749] T 6e71f9f26bcf449388fdf26ab44b79da P ccb5d7de9811449d8105001cb43ac775 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:04.926162   354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31972c45882a4ef1bd838a1790d929b4" candidate_uuid: "371b5d0b1c9e48c79defeea5005327a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3db9c6332ea4354b25af20b8d98cde9"
I20260709 13:14:04.927004   354 raft_consensus.cc:3060] T 31972c45882a4ef1bd838a1790d929b4 P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:04.924887   469 tablet_bootstrap.cc:492] T 0e96fafd0e9644919d5f556114573533 P c3db9c6332ea4354b25af20b8d98cde9: No bootstrap required, opened a new log
I20260709 13:14:04.927889   469 ts_tablet_manager.cc:1403] T 0e96fafd0e9644919d5f556114573533 P c3db9c6332ea4354b25af20b8d98cde9: Time spent bootstrapping tablet: real 0.037s	user 0.008s	sys 0.013s
I20260709 13:14:04.932803   469 raft_consensus.cc:359] T 0e96fafd0e9644919d5f556114573533 P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.933491   469 raft_consensus.cc:385] T 0e96fafd0e9644919d5f556114573533 P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:04.933833   469 raft_consensus.cc:740] T 0e96fafd0e9644919d5f556114573533 P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3db9c6332ea4354b25af20b8d98cde9, State: Initialized, Role: FOLLOWER
I20260709 13:14:04.934684   469 consensus_queue.cc:260] T 0e96fafd0e9644919d5f556114573533 P c3db9c6332ea4354b25af20b8d98cde9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.936793 32747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e71f9f26bcf449388fdf26ab44b79da" candidate_uuid: "c3db9c6332ea4354b25af20b8d98cde9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b5d0b1c9e48c79defeea5005327a6"
I20260709 13:14:04.937587   469 ts_tablet_manager.cc:1434] T 0e96fafd0e9644919d5f556114573533 P c3db9c6332ea4354b25af20b8d98cde9: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:14:04.937790   471 tablet_bootstrap.cc:492] T 0e96fafd0e9644919d5f556114573533 P ccb5d7de9811449d8105001cb43ac775: No bootstrap required, opened a new log
W20260709 13:14:04.938392   317 leader_election.cc:343] T 6e71f9f26bcf449388fdf26ab44b79da P c3db9c6332ea4354b25af20b8d98cde9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:04.938966   471 ts_tablet_manager.cc:1403] T 0e96fafd0e9644919d5f556114573533 P ccb5d7de9811449d8105001cb43ac775: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.003s
I20260709 13:14:04.939512   473 leader_election.cc:290] T 6e71f9f26bcf449388fdf26ab44b79da P c3db9c6332ea4354b25af20b8d98cde9 [CANDIDATE]: Term 1 election: Requested vote from peers 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633), ccb5d7de9811449d8105001cb43ac775 (127.23.140.67:39377)
I20260709 13:14:04.940922   427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e71f9f26bcf449388fdf26ab44b79da" candidate_uuid: "c3db9c6332ea4354b25af20b8d98cde9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb5d7de9811449d8105001cb43ac775"
I20260709 13:14:04.941623   471 raft_consensus.cc:359] T 0e96fafd0e9644919d5f556114573533 P ccb5d7de9811449d8105001cb43ac775 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.942291   471 raft_consensus.cc:385] T 0e96fafd0e9644919d5f556114573533 P ccb5d7de9811449d8105001cb43ac775 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:04.942528   471 raft_consensus.cc:740] T 0e96fafd0e9644919d5f556114573533 P ccb5d7de9811449d8105001cb43ac775 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccb5d7de9811449d8105001cb43ac775, State: Initialized, Role: FOLLOWER
I20260709 13:14:04.943152   471 consensus_queue.cc:260] T 0e96fafd0e9644919d5f556114573533 P ccb5d7de9811449d8105001cb43ac775 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.943864   504 leader_election.cc:290] T 31972c45882a4ef1bd838a1790d929b4 P 371b5d0b1c9e48c79defeea5005327a6 [CANDIDATE]: Term 1 election: Requested vote from peers c3db9c6332ea4354b25af20b8d98cde9 (127.23.140.66:38883), ccb5d7de9811449d8105001cb43ac775 (127.23.140.67:39377)
I20260709 13:14:04.945070   424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31972c45882a4ef1bd838a1790d929b4" candidate_uuid: "371b5d0b1c9e48c79defeea5005327a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb5d7de9811449d8105001cb43ac775"
I20260709 13:14:04.945724   424 raft_consensus.cc:3060] T 31972c45882a4ef1bd838a1790d929b4 P ccb5d7de9811449d8105001cb43ac775 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:04.945717   354 raft_consensus.cc:2468] T 31972c45882a4ef1bd838a1790d929b4 P c3db9c6332ea4354b25af20b8d98cde9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371b5d0b1c9e48c79defeea5005327a6 in term 1.
I20260709 13:14:04.948909   472 tablet_bootstrap.cc:492] T 58c124bee20f4d039daa8d54154c0616 P 371b5d0b1c9e48c79defeea5005327a6: No bootstrap required, opened a new log
I20260709 13:14:04.949265   472 ts_tablet_manager.cc:1403] T 58c124bee20f4d039daa8d54154c0616 P 371b5d0b1c9e48c79defeea5005327a6: Time spent bootstrapping tablet: real 0.047s	user 0.016s	sys 0.012s
I20260709 13:14:04.951135   472 raft_consensus.cc:359] T 58c124bee20f4d039daa8d54154c0616 P 371b5d0b1c9e48c79defeea5005327a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.951742   472 raft_consensus.cc:385] T 58c124bee20f4d039daa8d54154c0616 P 371b5d0b1c9e48c79defeea5005327a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:04.951997   472 raft_consensus.cc:740] T 58c124bee20f4d039daa8d54154c0616 P 371b5d0b1c9e48c79defeea5005327a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b5d0b1c9e48c79defeea5005327a6, State: Initialized, Role: FOLLOWER
I20260709 13:14:04.952617   472 consensus_queue.cc:260] T 58c124bee20f4d039daa8d54154c0616 P 371b5d0b1c9e48c79defeea5005327a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.953699   478 raft_consensus.cc:493] T efc64f8df3094f568e2fb0be3e56380b P ccb5d7de9811449d8105001cb43ac775 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:04.954257   472 ts_tablet_manager.cc:1434] T 58c124bee20f4d039daa8d54154c0616 P 371b5d0b1c9e48c79defeea5005327a6: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:14:04.954214   478 raft_consensus.cc:515] T efc64f8df3094f568e2fb0be3e56380b P ccb5d7de9811449d8105001cb43ac775 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.955255   472 tablet_bootstrap.cc:492] T 42473b265d0f476b928fdcbe60fd318b P 371b5d0b1c9e48c79defeea5005327a6: Bootstrap starting.
I20260709 13:14:04.956367   478 leader_election.cc:290] T efc64f8df3094f568e2fb0be3e56380b P ccb5d7de9811449d8105001cb43ac775 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633), c3db9c6332ea4354b25af20b8d98cde9 (127.23.140.66:38883)
I20260709 13:14:04.958851 32747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc64f8df3094f568e2fb0be3e56380b" candidate_uuid: "ccb5d7de9811449d8105001cb43ac775" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b5d0b1c9e48c79defeea5005327a6" is_pre_election: true
I20260709 13:14:04.959524 32747 raft_consensus.cc:2468] T efc64f8df3094f568e2fb0be3e56380b P 371b5d0b1c9e48c79defeea5005327a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccb5d7de9811449d8105001cb43ac775 in term 0.
I20260709 13:14:04.960786   391 leader_election.cc:304] T efc64f8df3094f568e2fb0be3e56380b P ccb5d7de9811449d8105001cb43ac775 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b5d0b1c9e48c79defeea5005327a6, ccb5d7de9811449d8105001cb43ac775; no voters: 
I20260709 13:14:04.961606   478 raft_consensus.cc:2804] T efc64f8df3094f568e2fb0be3e56380b P ccb5d7de9811449d8105001cb43ac775 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:04.961694   472 tablet_bootstrap.cc:654] T 42473b265d0f476b928fdcbe60fd318b P 371b5d0b1c9e48c79defeea5005327a6: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:04.962059   478 raft_consensus.cc:493] T efc64f8df3094f568e2fb0be3e56380b P ccb5d7de9811449d8105001cb43ac775 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:04.962414   478 raft_consensus.cc:3060] T efc64f8df3094f568e2fb0be3e56380b P ccb5d7de9811449d8105001cb43ac775 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:04.963452   354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc64f8df3094f568e2fb0be3e56380b" candidate_uuid: "ccb5d7de9811449d8105001cb43ac775" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3db9c6332ea4354b25af20b8d98cde9" is_pre_election: true
I20260709 13:14:04.964124   354 raft_consensus.cc:2468] T efc64f8df3094f568e2fb0be3e56380b P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccb5d7de9811449d8105001cb43ac775 in term 0.
I20260709 13:14:04.964413 32713 leader_election.cc:304] T 31972c45882a4ef1bd838a1790d929b4 P 371b5d0b1c9e48c79defeea5005327a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b5d0b1c9e48c79defeea5005327a6, c3db9c6332ea4354b25af20b8d98cde9; no voters: 
I20260709 13:14:04.964601 32642 catalog_manager.cc:5697] T c97f937160cf4068a000607700371c56 P c3db9c6332ea4354b25af20b8d98cde9 reported cstate change: term changed from 0 to 1, leader changed from <none> to c3db9c6332ea4354b25af20b8d98cde9 (127.23.140.66). New cstate: current_term: 1 leader_uuid: "c3db9c6332ea4354b25af20b8d98cde9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:04.966038   504 raft_consensus.cc:2804] T 31972c45882a4ef1bd838a1790d929b4 P 371b5d0b1c9e48c79defeea5005327a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:04.966488   424 raft_consensus.cc:2468] T 31972c45882a4ef1bd838a1790d929b4 P ccb5d7de9811449d8105001cb43ac775 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371b5d0b1c9e48c79defeea5005327a6 in term 1.
I20260709 13:14:04.966638   504 raft_consensus.cc:697] T 31972c45882a4ef1bd838a1790d929b4 P 371b5d0b1c9e48c79defeea5005327a6 [term 1 LEADER]: Becoming Leader. State: Replica: 371b5d0b1c9e48c79defeea5005327a6, State: Running, Role: LEADER
I20260709 13:14:04.968432   504 consensus_queue.cc:237] T 31972c45882a4ef1bd838a1790d929b4 P 371b5d0b1c9e48c79defeea5005327a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.966581 32642 catalog_manager.cc:5697] T ccc5273ee6eb48e9ad577cb60a46001a P c3db9c6332ea4354b25af20b8d98cde9 reported cstate change: term changed from 0 to 1, leader changed from <none> to c3db9c6332ea4354b25af20b8d98cde9 (127.23.140.66). New cstate: current_term: 1 leader_uuid: "c3db9c6332ea4354b25af20b8d98cde9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:04.967463   427 raft_consensus.cc:2468] T 6e71f9f26bcf449388fdf26ab44b79da P ccb5d7de9811449d8105001cb43ac775 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3db9c6332ea4354b25af20b8d98cde9 in term 1.
I20260709 13:14:04.973866   318 leader_election.cc:304] T 6e71f9f26bcf449388fdf26ab44b79da P c3db9c6332ea4354b25af20b8d98cde9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c3db9c6332ea4354b25af20b8d98cde9, ccb5d7de9811449d8105001cb43ac775; no voters: 371b5d0b1c9e48c79defeea5005327a6
I20260709 13:14:04.945289   471 ts_tablet_manager.cc:1434] T 0e96fafd0e9644919d5f556114573533 P ccb5d7de9811449d8105001cb43ac775: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:14:04.975327   471 tablet_bootstrap.cc:492] T 42473b265d0f476b928fdcbe60fd318b P ccb5d7de9811449d8105001cb43ac775: Bootstrap starting.
I20260709 13:14:04.973503   472 tablet_bootstrap.cc:492] T 42473b265d0f476b928fdcbe60fd318b P 371b5d0b1c9e48c79defeea5005327a6: No bootstrap required, opened a new log
I20260709 13:14:04.978509   472 ts_tablet_manager.cc:1403] T 42473b265d0f476b928fdcbe60fd318b P 371b5d0b1c9e48c79defeea5005327a6: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.000s
I20260709 13:14:04.980780   473 raft_consensus.cc:2804] T 6e71f9f26bcf449388fdf26ab44b79da P c3db9c6332ea4354b25af20b8d98cde9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:04.980906   471 tablet_bootstrap.cc:654] T 42473b265d0f476b928fdcbe60fd318b P ccb5d7de9811449d8105001cb43ac775: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:04.981382   473 raft_consensus.cc:697] T 6e71f9f26bcf449388fdf26ab44b79da P c3db9c6332ea4354b25af20b8d98cde9 [term 1 LEADER]: Becoming Leader. State: Replica: c3db9c6332ea4354b25af20b8d98cde9, State: Running, Role: LEADER
I20260709 13:14:04.981119   472 raft_consensus.cc:359] T 42473b265d0f476b928fdcbe60fd318b P 371b5d0b1c9e48c79defeea5005327a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.982016   472 raft_consensus.cc:385] T 42473b265d0f476b928fdcbe60fd318b P 371b5d0b1c9e48c79defeea5005327a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:04.982297   472 raft_consensus.cc:740] T 42473b265d0f476b928fdcbe60fd318b P 371b5d0b1c9e48c79defeea5005327a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b5d0b1c9e48c79defeea5005327a6, State: Initialized, Role: FOLLOWER
I20260709 13:14:04.982280   473 consensus_queue.cc:237] T 6e71f9f26bcf449388fdf26ab44b79da P c3db9c6332ea4354b25af20b8d98cde9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.984892   472 consensus_queue.cc:260] T 42473b265d0f476b928fdcbe60fd318b P 371b5d0b1c9e48c79defeea5005327a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:04.986662   472 ts_tablet_manager.cc:1434] T 42473b265d0f476b928fdcbe60fd318b P 371b5d0b1c9e48c79defeea5005327a6: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:14:04.987746   472 tablet_bootstrap.cc:492] T 6e71f9f26bcf449388fdf26ab44b79da P 371b5d0b1c9e48c79defeea5005327a6: Bootstrap starting.
I20260709 13:14:04.993708   472 tablet_bootstrap.cc:654] T 6e71f9f26bcf449388fdf26ab44b79da P 371b5d0b1c9e48c79defeea5005327a6: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:04.998780 32645 catalog_manager.cc:5697] T 31972c45882a4ef1bd838a1790d929b4 P 371b5d0b1c9e48c79defeea5005327a6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65). New cstate: current_term: 1 leader_uuid: "371b5d0b1c9e48c79defeea5005327a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:05.000084   471 tablet_bootstrap.cc:492] T 42473b265d0f476b928fdcbe60fd318b P ccb5d7de9811449d8105001cb43ac775: No bootstrap required, opened a new log
I20260709 13:14:05.000520   471 ts_tablet_manager.cc:1403] T 42473b265d0f476b928fdcbe60fd318b P ccb5d7de9811449d8105001cb43ac775: Time spent bootstrapping tablet: real 0.025s	user 0.004s	sys 0.019s
I20260709 13:14:05.000967   472 tablet_bootstrap.cc:492] T 6e71f9f26bcf449388fdf26ab44b79da P 371b5d0b1c9e48c79defeea5005327a6: No bootstrap required, opened a new log
I20260709 13:14:05.001420   472 ts_tablet_manager.cc:1403] T 6e71f9f26bcf449388fdf26ab44b79da P 371b5d0b1c9e48c79defeea5005327a6: Time spent bootstrapping tablet: real 0.014s	user 0.008s	sys 0.004s
I20260709 13:14:05.002912   471 raft_consensus.cc:359] T 42473b265d0f476b928fdcbe60fd318b P ccb5d7de9811449d8105001cb43ac775 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:05.003577   471 raft_consensus.cc:385] T 42473b265d0f476b928fdcbe60fd318b P ccb5d7de9811449d8105001cb43ac775 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:05.005101   471 raft_consensus.cc:740] T 42473b265d0f476b928fdcbe60fd318b P ccb5d7de9811449d8105001cb43ac775 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccb5d7de9811449d8105001cb43ac775, State: Initialized, Role: FOLLOWER
I20260709 13:14:05.003044   478 raft_consensus.cc:515] T efc64f8df3094f568e2fb0be3e56380b P ccb5d7de9811449d8105001cb43ac775 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:05.004334   472 raft_consensus.cc:359] T 6e71f9f26bcf449388fdf26ab44b79da P 371b5d0b1c9e48c79defeea5005327a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:05.005710   472 raft_consensus.cc:385] T 6e71f9f26bcf449388fdf26ab44b79da P 371b5d0b1c9e48c79defeea5005327a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:05.006093   472 raft_consensus.cc:740] T 6e71f9f26bcf449388fdf26ab44b79da P 371b5d0b1c9e48c79defeea5005327a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b5d0b1c9e48c79defeea5005327a6, State: Initialized, Role: FOLLOWER
I20260709 13:14:05.005831   471 consensus_queue.cc:260] T 42473b265d0f476b928fdcbe60fd318b P ccb5d7de9811449d8105001cb43ac775 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:05.006932   472 consensus_queue.cc:260] T 6e71f9f26bcf449388fdf26ab44b79da P 371b5d0b1c9e48c79defeea5005327a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:05.008102   471 ts_tablet_manager.cc:1434] T 42473b265d0f476b928fdcbe60fd318b P ccb5d7de9811449d8105001cb43ac775: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.006s
I20260709 13:14:05.009078   472 ts_tablet_manager.cc:1434] T 6e71f9f26bcf449388fdf26ab44b79da P 371b5d0b1c9e48c79defeea5005327a6: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:14:05.012527 32747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc64f8df3094f568e2fb0be3e56380b" candidate_uuid: "ccb5d7de9811449d8105001cb43ac775" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b5d0b1c9e48c79defeea5005327a6"
I20260709 13:14:05.013199 32747 raft_consensus.cc:3060] T efc64f8df3094f568e2fb0be3e56380b P 371b5d0b1c9e48c79defeea5005327a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:05.012704   503 raft_consensus.cc:493] T 42473b265d0f476b928fdcbe60fd318b P ccb5d7de9811449d8105001cb43ac775 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:05.013860 32644 catalog_manager.cc:5697] T 6e71f9f26bcf449388fdf26ab44b79da P c3db9c6332ea4354b25af20b8d98cde9 reported cstate change: term changed from 0 to 1, leader changed from <none> to c3db9c6332ea4354b25af20b8d98cde9 (127.23.140.66). New cstate: current_term: 1 leader_uuid: "c3db9c6332ea4354b25af20b8d98cde9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:05.014523   503 raft_consensus.cc:515] T 42473b265d0f476b928fdcbe60fd318b P ccb5d7de9811449d8105001cb43ac775 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:05.016716   503 leader_election.cc:290] T 42473b265d0f476b928fdcbe60fd318b P ccb5d7de9811449d8105001cb43ac775 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633), c3db9c6332ea4354b25af20b8d98cde9 (127.23.140.66:38883)
I20260709 13:14:05.018350   478 leader_election.cc:290] T efc64f8df3094f568e2fb0be3e56380b P ccb5d7de9811449d8105001cb43ac775 [CANDIDATE]: Term 1 election: Requested vote from peers 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633), c3db9c6332ea4354b25af20b8d98cde9 (127.23.140.66:38883)
I20260709 13:14:05.020222   353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc64f8df3094f568e2fb0be3e56380b" candidate_uuid: "ccb5d7de9811449d8105001cb43ac775" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3db9c6332ea4354b25af20b8d98cde9"
I20260709 13:14:05.020900   353 raft_consensus.cc:3060] T efc64f8df3094f568e2fb0be3e56380b P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:05.026165   354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42473b265d0f476b928fdcbe60fd318b" candidate_uuid: "ccb5d7de9811449d8105001cb43ac775" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3db9c6332ea4354b25af20b8d98cde9" is_pre_election: true
I20260709 13:14:05.026463 32744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42473b265d0f476b928fdcbe60fd318b" candidate_uuid: "ccb5d7de9811449d8105001cb43ac775" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b5d0b1c9e48c79defeea5005327a6" is_pre_election: true
I20260709 13:14:05.026867   354 raft_consensus.cc:2468] T 42473b265d0f476b928fdcbe60fd318b P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccb5d7de9811449d8105001cb43ac775 in term 0.
I20260709 13:14:05.027065 32744 raft_consensus.cc:2468] T 42473b265d0f476b928fdcbe60fd318b P 371b5d0b1c9e48c79defeea5005327a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccb5d7de9811449d8105001cb43ac775 in term 0.
I20260709 13:14:05.027137   353 raft_consensus.cc:2468] T efc64f8df3094f568e2fb0be3e56380b P c3db9c6332ea4354b25af20b8d98cde9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccb5d7de9811449d8105001cb43ac775 in term 1.
I20260709 13:14:05.027997   394 leader_election.cc:304] T 42473b265d0f476b928fdcbe60fd318b P ccb5d7de9811449d8105001cb43ac775 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3db9c6332ea4354b25af20b8d98cde9, ccb5d7de9811449d8105001cb43ac775; no voters: 
I20260709 13:14:05.028656   478 raft_consensus.cc:2804] T 42473b265d0f476b928fdcbe60fd318b P ccb5d7de9811449d8105001cb43ac775 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:05.029019   478 raft_consensus.cc:493] T 42473b265d0f476b928fdcbe60fd318b P ccb5d7de9811449d8105001cb43ac775 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:05.029351   478 raft_consensus.cc:3060] T 42473b265d0f476b928fdcbe60fd318b P ccb5d7de9811449d8105001cb43ac775 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:05.030309   394 leader_election.cc:304] T efc64f8df3094f568e2fb0be3e56380b P ccb5d7de9811449d8105001cb43ac775 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3db9c6332ea4354b25af20b8d98cde9, ccb5d7de9811449d8105001cb43ac775; no voters: 
I20260709 13:14:05.031209   503 raft_consensus.cc:2804] T efc64f8df3094f568e2fb0be3e56380b P ccb5d7de9811449d8105001cb43ac775 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:05.032797 32747 raft_consensus.cc:2468] T efc64f8df3094f568e2fb0be3e56380b P 371b5d0b1c9e48c79defeea5005327a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccb5d7de9811449d8105001cb43ac775 in term 1.
I20260709 13:14:05.037266   478 raft_consensus.cc:515] T 42473b265d0f476b928fdcbe60fd318b P ccb5d7de9811449d8105001cb43ac775 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:05.038105   503 raft_consensus.cc:697] T efc64f8df3094f568e2fb0be3e56380b P ccb5d7de9811449d8105001cb43ac775 [term 1 LEADER]: Becoming Leader. State: Replica: ccb5d7de9811449d8105001cb43ac775, State: Running, Role: LEADER
I20260709 13:14:05.039023   503 consensus_queue.cc:237] T efc64f8df3094f568e2fb0be3e56380b P ccb5d7de9811449d8105001cb43ac775 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:05.039651   478 leader_election.cc:290] T 42473b265d0f476b928fdcbe60fd318b P ccb5d7de9811449d8105001cb43ac775 [CANDIDATE]: Term 1 election: Requested vote from peers 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633), c3db9c6332ea4354b25af20b8d98cde9 (127.23.140.66:38883)
I20260709 13:14:05.040410 32747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42473b265d0f476b928fdcbe60fd318b" candidate_uuid: "ccb5d7de9811449d8105001cb43ac775" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b5d0b1c9e48c79defeea5005327a6"
I20260709 13:14:05.040673   353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42473b265d0f476b928fdcbe60fd318b" candidate_uuid: "ccb5d7de9811449d8105001cb43ac775" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3db9c6332ea4354b25af20b8d98cde9"
I20260709 13:14:05.041006 32747 raft_consensus.cc:3060] T 42473b265d0f476b928fdcbe60fd318b P 371b5d0b1c9e48c79defeea5005327a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:05.041327   353 raft_consensus.cc:3060] T 42473b265d0f476b928fdcbe60fd318b P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:05.047344   353 raft_consensus.cc:2468] T 42473b265d0f476b928fdcbe60fd318b P c3db9c6332ea4354b25af20b8d98cde9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccb5d7de9811449d8105001cb43ac775 in term 1.
I20260709 13:14:05.048035 32747 raft_consensus.cc:2468] T 42473b265d0f476b928fdcbe60fd318b P 371b5d0b1c9e48c79defeea5005327a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccb5d7de9811449d8105001cb43ac775 in term 1.
I20260709 13:14:05.048225   394 leader_election.cc:304] T 42473b265d0f476b928fdcbe60fd318b P ccb5d7de9811449d8105001cb43ac775 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3db9c6332ea4354b25af20b8d98cde9, ccb5d7de9811449d8105001cb43ac775; no voters: 
I20260709 13:14:05.049036   503 raft_consensus.cc:2804] T 42473b265d0f476b928fdcbe60fd318b P ccb5d7de9811449d8105001cb43ac775 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:05.048561 32644 catalog_manager.cc:5697] T efc64f8df3094f568e2fb0be3e56380b P ccb5d7de9811449d8105001cb43ac775 reported cstate change: term changed from 0 to 1, leader changed from <none> to ccb5d7de9811449d8105001cb43ac775 (127.23.140.67). New cstate: current_term: 1 leader_uuid: "ccb5d7de9811449d8105001cb43ac775" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:05.049504   503 raft_consensus.cc:697] T 42473b265d0f476b928fdcbe60fd318b P ccb5d7de9811449d8105001cb43ac775 [term 1 LEADER]: Becoming Leader. State: Replica: ccb5d7de9811449d8105001cb43ac775, State: Running, Role: LEADER
I20260709 13:14:05.050366   503 consensus_queue.cc:237] T 42473b265d0f476b928fdcbe60fd318b P ccb5d7de9811449d8105001cb43ac775 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:05.061378 32644 catalog_manager.cc:5697] T 42473b265d0f476b928fdcbe60fd318b P ccb5d7de9811449d8105001cb43ac775 reported cstate change: term changed from 0 to 1, leader changed from <none> to ccb5d7de9811449d8105001cb43ac775 (127.23.140.67). New cstate: current_term: 1 leader_uuid: "ccb5d7de9811449d8105001cb43ac775" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:05.143118   427 raft_consensus.cc:3060] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P ccb5d7de9811449d8105001cb43ac775 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:05.149588   473 consensus_queue.cc:1048] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P c3db9c6332ea4354b25af20b8d98cde9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:05.160058   473 consensus_queue.cc:1048] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P c3db9c6332ea4354b25af20b8d98cde9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:05.185425   473 consensus_queue.cc:1048] T c97f937160cf4068a000607700371c56 P c3db9c6332ea4354b25af20b8d98cde9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:05.190203   473 raft_consensus.cc:493] T 0e96fafd0e9644919d5f556114573533 P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:05.190630   473 raft_consensus.cc:515] T 0e96fafd0e9644919d5f556114573533 P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:05.195935   491 consensus_queue.cc:1048] T c97f937160cf4068a000607700371c56 P c3db9c6332ea4354b25af20b8d98cde9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:05.198516   473 leader_election.cc:290] T 0e96fafd0e9644919d5f556114573533 P c3db9c6332ea4354b25af20b8d98cde9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633), ccb5d7de9811449d8105001cb43ac775 (127.23.140.67:39377)
I20260709 13:14:05.199205 32747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e96fafd0e9644919d5f556114573533" candidate_uuid: "c3db9c6332ea4354b25af20b8d98cde9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b5d0b1c9e48c79defeea5005327a6" is_pre_election: true
I20260709 13:14:05.200138 32747 raft_consensus.cc:2468] T 0e96fafd0e9644919d5f556114573533 P 371b5d0b1c9e48c79defeea5005327a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3db9c6332ea4354b25af20b8d98cde9 in term 0.
I20260709 13:14:05.201031   424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e96fafd0e9644919d5f556114573533" candidate_uuid: "c3db9c6332ea4354b25af20b8d98cde9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb5d7de9811449d8105001cb43ac775" is_pre_election: true
I20260709 13:14:05.201228   317 leader_election.cc:304] T 0e96fafd0e9644919d5f556114573533 P c3db9c6332ea4354b25af20b8d98cde9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b5d0b1c9e48c79defeea5005327a6, c3db9c6332ea4354b25af20b8d98cde9; no voters: 
I20260709 13:14:05.201799   424 raft_consensus.cc:2468] T 0e96fafd0e9644919d5f556114573533 P ccb5d7de9811449d8105001cb43ac775 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3db9c6332ea4354b25af20b8d98cde9 in term 0.
I20260709 13:14:05.202495   473 raft_consensus.cc:2804] T 0e96fafd0e9644919d5f556114573533 P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:05.202913   473 raft_consensus.cc:493] T 0e96fafd0e9644919d5f556114573533 P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:05.203264   473 raft_consensus.cc:3060] T 0e96fafd0e9644919d5f556114573533 P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:05.210485   473 raft_consensus.cc:515] T 0e96fafd0e9644919d5f556114573533 P c3db9c6332ea4354b25af20b8d98cde9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:05.212136   473 leader_election.cc:290] T 0e96fafd0e9644919d5f556114573533 P c3db9c6332ea4354b25af20b8d98cde9 [CANDIDATE]: Term 1 election: Requested vote from peers 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633), ccb5d7de9811449d8105001cb43ac775 (127.23.140.67:39377)
I20260709 13:14:05.212881 32747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e96fafd0e9644919d5f556114573533" candidate_uuid: "c3db9c6332ea4354b25af20b8d98cde9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b5d0b1c9e48c79defeea5005327a6"
I20260709 13:14:05.213168   427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e96fafd0e9644919d5f556114573533" candidate_uuid: "c3db9c6332ea4354b25af20b8d98cde9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb5d7de9811449d8105001cb43ac775"
I20260709 13:14:05.213434 32747 raft_consensus.cc:3060] T 0e96fafd0e9644919d5f556114573533 P 371b5d0b1c9e48c79defeea5005327a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:05.213886   427 raft_consensus.cc:3060] T 0e96fafd0e9644919d5f556114573533 P ccb5d7de9811449d8105001cb43ac775 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:05.218639 32747 raft_consensus.cc:2468] T 0e96fafd0e9644919d5f556114573533 P 371b5d0b1c9e48c79defeea5005327a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3db9c6332ea4354b25af20b8d98cde9 in term 1.
I20260709 13:14:05.219524   427 raft_consensus.cc:2468] T 0e96fafd0e9644919d5f556114573533 P ccb5d7de9811449d8105001cb43ac775 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3db9c6332ea4354b25af20b8d98cde9 in term 1.
I20260709 13:14:05.219641   317 leader_election.cc:304] T 0e96fafd0e9644919d5f556114573533 P c3db9c6332ea4354b25af20b8d98cde9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b5d0b1c9e48c79defeea5005327a6, c3db9c6332ea4354b25af20b8d98cde9; no voters: 
I20260709 13:14:05.220413   473 raft_consensus.cc:2804] T 0e96fafd0e9644919d5f556114573533 P c3db9c6332ea4354b25af20b8d98cde9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:05.220880   473 raft_consensus.cc:697] T 0e96fafd0e9644919d5f556114573533 P c3db9c6332ea4354b25af20b8d98cde9 [term 1 LEADER]: Becoming Leader. State: Replica: c3db9c6332ea4354b25af20b8d98cde9, State: Running, Role: LEADER
I20260709 13:14:05.221527   473 consensus_queue.cc:237] T 0e96fafd0e9644919d5f556114573533 P c3db9c6332ea4354b25af20b8d98cde9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:05.228523 32644 catalog_manager.cc:5697] T 0e96fafd0e9644919d5f556114573533 P c3db9c6332ea4354b25af20b8d98cde9 reported cstate change: term changed from 0 to 1, leader changed from <none> to c3db9c6332ea4354b25af20b8d98cde9 (127.23.140.66). New cstate: current_term: 1 leader_uuid: "c3db9c6332ea4354b25af20b8d98cde9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:05.235601   473 consensus_queue.cc:1048] T ccc5273ee6eb48e9ad577cb60a46001a P c3db9c6332ea4354b25af20b8d98cde9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:05.245836   506 consensus_queue.cc:1048] T ccc5273ee6eb48e9ad577cb60a46001a P c3db9c6332ea4354b25af20b8d98cde9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:05.313638   503 raft_consensus.cc:493] T 58c124bee20f4d039daa8d54154c0616 P ccb5d7de9811449d8105001cb43ac775 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:05.314265   503 raft_consensus.cc:515] T 58c124bee20f4d039daa8d54154c0616 P ccb5d7de9811449d8105001cb43ac775 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:05.315860   503 leader_election.cc:290] T 58c124bee20f4d039daa8d54154c0616 P ccb5d7de9811449d8105001cb43ac775 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3db9c6332ea4354b25af20b8d98cde9 (127.23.140.66:38883), 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633)
I20260709 13:14:05.316759   353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c124bee20f4d039daa8d54154c0616" candidate_uuid: "ccb5d7de9811449d8105001cb43ac775" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3db9c6332ea4354b25af20b8d98cde9" is_pre_election: true
I20260709 13:14:05.316915 32747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c124bee20f4d039daa8d54154c0616" candidate_uuid: "ccb5d7de9811449d8105001cb43ac775" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b5d0b1c9e48c79defeea5005327a6" is_pre_election: true
I20260709 13:14:05.317380   353 raft_consensus.cc:2468] T 58c124bee20f4d039daa8d54154c0616 P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccb5d7de9811449d8105001cb43ac775 in term 0.
I20260709 13:14:05.317509 32747 raft_consensus.cc:2468] T 58c124bee20f4d039daa8d54154c0616 P 371b5d0b1c9e48c79defeea5005327a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccb5d7de9811449d8105001cb43ac775 in term 0.
I20260709 13:14:05.318333   394 leader_election.cc:304] T 58c124bee20f4d039daa8d54154c0616 P ccb5d7de9811449d8105001cb43ac775 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3db9c6332ea4354b25af20b8d98cde9, ccb5d7de9811449d8105001cb43ac775; no voters: 
I20260709 13:14:05.319083   503 raft_consensus.cc:2804] T 58c124bee20f4d039daa8d54154c0616 P ccb5d7de9811449d8105001cb43ac775 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:05.319425   503 raft_consensus.cc:493] T 58c124bee20f4d039daa8d54154c0616 P ccb5d7de9811449d8105001cb43ac775 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:05.319643   503 raft_consensus.cc:3060] T 58c124bee20f4d039daa8d54154c0616 P ccb5d7de9811449d8105001cb43ac775 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:05.324328   503 raft_consensus.cc:515] T 58c124bee20f4d039daa8d54154c0616 P ccb5d7de9811449d8105001cb43ac775 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:05.325843   503 leader_election.cc:290] T 58c124bee20f4d039daa8d54154c0616 P ccb5d7de9811449d8105001cb43ac775 [CANDIDATE]: Term 1 election: Requested vote from peers c3db9c6332ea4354b25af20b8d98cde9 (127.23.140.66:38883), 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633)
I20260709 13:14:05.326581   353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c124bee20f4d039daa8d54154c0616" candidate_uuid: "ccb5d7de9811449d8105001cb43ac775" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3db9c6332ea4354b25af20b8d98cde9"
I20260709 13:14:05.326766 32747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c124bee20f4d039daa8d54154c0616" candidate_uuid: "ccb5d7de9811449d8105001cb43ac775" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b5d0b1c9e48c79defeea5005327a6"
I20260709 13:14:05.327198   353 raft_consensus.cc:3060] T 58c124bee20f4d039daa8d54154c0616 P c3db9c6332ea4354b25af20b8d98cde9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:05.327294 32747 raft_consensus.cc:3060] T 58c124bee20f4d039daa8d54154c0616 P 371b5d0b1c9e48c79defeea5005327a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:05.333927 32747 raft_consensus.cc:2468] T 58c124bee20f4d039daa8d54154c0616 P 371b5d0b1c9e48c79defeea5005327a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccb5d7de9811449d8105001cb43ac775 in term 1.
I20260709 13:14:05.333931   353 raft_consensus.cc:2468] T 58c124bee20f4d039daa8d54154c0616 P c3db9c6332ea4354b25af20b8d98cde9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccb5d7de9811449d8105001cb43ac775 in term 1.
I20260709 13:14:05.335093   394 leader_election.cc:304] T 58c124bee20f4d039daa8d54154c0616 P ccb5d7de9811449d8105001cb43ac775 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3db9c6332ea4354b25af20b8d98cde9, ccb5d7de9811449d8105001cb43ac775; no voters: 
I20260709 13:14:05.335763   503 raft_consensus.cc:2804] T 58c124bee20f4d039daa8d54154c0616 P ccb5d7de9811449d8105001cb43ac775 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:05.336248   503 raft_consensus.cc:697] T 58c124bee20f4d039daa8d54154c0616 P ccb5d7de9811449d8105001cb43ac775 [term 1 LEADER]: Becoming Leader. State: Replica: ccb5d7de9811449d8105001cb43ac775, State: Running, Role: LEADER
I20260709 13:14:05.337061   503 consensus_queue.cc:237] T 58c124bee20f4d039daa8d54154c0616 P ccb5d7de9811449d8105001cb43ac775 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:05.343786 32642 catalog_manager.cc:5697] T 58c124bee20f4d039daa8d54154c0616 P ccb5d7de9811449d8105001cb43ac775 reported cstate change: term changed from 0 to 1, leader changed from <none> to ccb5d7de9811449d8105001cb43ac775 (127.23.140.67). New cstate: current_term: 1 leader_uuid: "ccb5d7de9811449d8105001cb43ac775" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:05.410235   504 consensus_queue.cc:1048] T 4fdcc1f9d3d34a1480606d325fe3616f P 371b5d0b1c9e48c79defeea5005327a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:05.420475   546 consensus_queue.cc:1048] T 4fdcc1f9d3d34a1480606d325fe3616f P 371b5d0b1c9e48c79defeea5005327a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:05.458690   503 consensus_queue.cc:1048] T 42473b265d0f476b928fdcbe60fd318b P ccb5d7de9811449d8105001cb43ac775 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:05.464964   503 consensus_queue.cc:1048] T efc64f8df3094f568e2fb0be3e56380b P ccb5d7de9811449d8105001cb43ac775 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:05.466184 32747 raft_consensus.cc:3060] T 6e71f9f26bcf449388fdf26ab44b79da P 371b5d0b1c9e48c79defeea5005327a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:05.473899   503 consensus_queue.cc:1048] T 42473b265d0f476b928fdcbe60fd318b P ccb5d7de9811449d8105001cb43ac775 [LEADER]: Connected to new peer: Peer: permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:05.476352 24113 ts_manager.cc:295] Set tserver state for 371b5d0b1c9e48c79defeea5005327a6 to MAINTENANCE_MODE
I20260709 13:14:05.477240 24113 tablet_server.cc:179] TabletServer@127.23.140.65:0 shutting down...
I20260709 13:14:05.488639   546 raft_consensus.cc:493] T 6e71f9f26bcf449388fdf26ab44b79da P 371b5d0b1c9e48c79defeea5005327a6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:05.489236   546 raft_consensus.cc:515] T 6e71f9f26bcf449388fdf26ab44b79da P 371b5d0b1c9e48c79defeea5005327a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:05.489429   506 consensus_queue.cc:1048] T 6e71f9f26bcf449388fdf26ab44b79da P c3db9c6332ea4354b25af20b8d98cde9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:05.491369   512 consensus_queue.cc:1048] T 31972c45882a4ef1bd838a1790d929b4 P 371b5d0b1c9e48c79defeea5005327a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:05.495357   546 leader_election.cc:290] T 6e71f9f26bcf449388fdf26ab44b79da P 371b5d0b1c9e48c79defeea5005327a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c3db9c6332ea4354b25af20b8d98cde9 (127.23.140.66:38883), ccb5d7de9811449d8105001cb43ac775 (127.23.140.67:39377)
I20260709 13:14:05.497118   353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e71f9f26bcf449388fdf26ab44b79da" candidate_uuid: "371b5d0b1c9e48c79defeea5005327a6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3db9c6332ea4354b25af20b8d98cde9" is_pre_election: true
I20260709 13:14:05.497963   427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e71f9f26bcf449388fdf26ab44b79da" candidate_uuid: "371b5d0b1c9e48c79defeea5005327a6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb5d7de9811449d8105001cb43ac775" is_pre_election: true
I20260709 13:14:05.502036   427 raft_consensus.cc:2468] T 6e71f9f26bcf449388fdf26ab44b79da P ccb5d7de9811449d8105001cb43ac775 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 371b5d0b1c9e48c79defeea5005327a6 in term 1.
W20260709 13:14:05.499255   391 consensus_peers.cc:597] T efc64f8df3094f568e2fb0be3e56380b P ccb5d7de9811449d8105001cb43ac775 -> Peer 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633): Couldn't send request to peer 371b5d0b1c9e48c79defeea5005327a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:05.507421 32711 leader_election.cc:304] T 6e71f9f26bcf449388fdf26ab44b79da P 371b5d0b1c9e48c79defeea5005327a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b5d0b1c9e48c79defeea5005327a6, ccb5d7de9811449d8105001cb43ac775; no voters: 
I20260709 13:14:05.508347   546 raft_consensus.cc:2804] T 6e71f9f26bcf449388fdf26ab44b79da P 371b5d0b1c9e48c79defeea5005327a6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:05.508745   546 raft_consensus.cc:493] T 6e71f9f26bcf449388fdf26ab44b79da P 371b5d0b1c9e48c79defeea5005327a6 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:05.509224   546 raft_consensus.cc:3060] T 6e71f9f26bcf449388fdf26ab44b79da P 371b5d0b1c9e48c79defeea5005327a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:05.524802   506 consensus_queue.cc:1048] T 6e71f9f26bcf449388fdf26ab44b79da P c3db9c6332ea4354b25af20b8d98cde9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:14:05.531708   317 consensus_peers.cc:597] T 6e71f9f26bcf449388fdf26ab44b79da P c3db9c6332ea4354b25af20b8d98cde9 -> Peer 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633): Couldn't send request to peer 371b5d0b1c9e48c79defeea5005327a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:05.539558   512 consensus_queue.cc:1048] T 31972c45882a4ef1bd838a1790d929b4 P 371b5d0b1c9e48c79defeea5005327a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:05.534629   546 raft_consensus.cc:515] T 6e71f9f26bcf449388fdf26ab44b79da P 371b5d0b1c9e48c79defeea5005327a6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:05.545332   354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e71f9f26bcf449388fdf26ab44b79da" candidate_uuid: "371b5d0b1c9e48c79defeea5005327a6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3db9c6332ea4354b25af20b8d98cde9"
I20260709 13:14:05.547446   546 leader_election.cc:290] T 6e71f9f26bcf449388fdf26ab44b79da P 371b5d0b1c9e48c79defeea5005327a6 [CANDIDATE]: Term 2 election: Requested vote from peers c3db9c6332ea4354b25af20b8d98cde9 (127.23.140.66:38883), ccb5d7de9811449d8105001cb43ac775 (127.23.140.67:39377)
W20260709 13:14:05.593122 32693 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:14:05.619272   427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e71f9f26bcf449388fdf26ab44b79da" candidate_uuid: "371b5d0b1c9e48c79defeea5005327a6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb5d7de9811449d8105001cb43ac775"
W20260709 13:14:05.621548   317 consensus_peers.cc:597] T c97f937160cf4068a000607700371c56 P c3db9c6332ea4354b25af20b8d98cde9 -> Peer 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633): Couldn't send request to peer 371b5d0b1c9e48c79defeea5005327a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:05.621888 32711 leader_election.cc:304] T 6e71f9f26bcf449388fdf26ab44b79da P 371b5d0b1c9e48c79defeea5005327a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 371b5d0b1c9e48c79defeea5005327a6; no voters: c3db9c6332ea4354b25af20b8d98cde9, ccb5d7de9811449d8105001cb43ac775
W20260709 13:14:05.622889   317 consensus_peers.cc:597] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P c3db9c6332ea4354b25af20b8d98cde9 -> Peer 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633): Couldn't send request to peer 371b5d0b1c9e48c79defeea5005327a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:05.627498   546 raft_consensus.cc:2749] T 6e71f9f26bcf449388fdf26ab44b79da P 371b5d0b1c9e48c79defeea5005327a6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:05.631529 24113 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:05.632656 24113 tablet_replica.cc:333] T efc64f8df3094f568e2fb0be3e56380b P 371b5d0b1c9e48c79defeea5005327a6: stopping tablet replica
W20260709 13:14:05.633567   317 consensus_peers.cc:597] T ccc5273ee6eb48e9ad577cb60a46001a P c3db9c6332ea4354b25af20b8d98cde9 -> Peer 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633): Couldn't send request to peer 371b5d0b1c9e48c79defeea5005327a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:05.635147 24113 raft_consensus.cc:2243] T efc64f8df3094f568e2fb0be3e56380b P 371b5d0b1c9e48c79defeea5005327a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:05.636066 24113 raft_consensus.cc:2272] T efc64f8df3094f568e2fb0be3e56380b P 371b5d0b1c9e48c79defeea5005327a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:05.639770   491 consensus_queue.cc:1048] T 0e96fafd0e9644919d5f556114573533 P c3db9c6332ea4354b25af20b8d98cde9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:05.641196 24113 tablet_replica.cc:333] T ccc5273ee6eb48e9ad577cb60a46001a P 371b5d0b1c9e48c79defeea5005327a6: stopping tablet replica
I20260709 13:14:05.642798 24113 raft_consensus.cc:2243] T ccc5273ee6eb48e9ad577cb60a46001a P 371b5d0b1c9e48c79defeea5005327a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:05.643934 24113 raft_consensus.cc:2272] T ccc5273ee6eb48e9ad577cb60a46001a P 371b5d0b1c9e48c79defeea5005327a6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:05.646724   317 consensus_peers.cc:597] T 0e96fafd0e9644919d5f556114573533 P c3db9c6332ea4354b25af20b8d98cde9 -> Peer 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633): Couldn't send request to peer 371b5d0b1c9e48c79defeea5005327a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:05.649439 24113 tablet_replica.cc:333] T 31972c45882a4ef1bd838a1790d929b4 P 371b5d0b1c9e48c79defeea5005327a6: stopping tablet replica
I20260709 13:14:05.650594 24113 raft_consensus.cc:2243] T 31972c45882a4ef1bd838a1790d929b4 P 371b5d0b1c9e48c79defeea5005327a6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:05.654543 24113 raft_consensus.cc:2272] T 31972c45882a4ef1bd838a1790d929b4 P 371b5d0b1c9e48c79defeea5005327a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:05.660219 24113 tablet_replica.cc:333] T 42473b265d0f476b928fdcbe60fd318b P 371b5d0b1c9e48c79defeea5005327a6: stopping tablet replica
I20260709 13:14:05.661146 24113 raft_consensus.cc:2243] T 42473b265d0f476b928fdcbe60fd318b P 371b5d0b1c9e48c79defeea5005327a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:05.662024 24113 raft_consensus.cc:2272] T 42473b265d0f476b928fdcbe60fd318b P 371b5d0b1c9e48c79defeea5005327a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:05.667795 24113 tablet_replica.cc:333] T 0e96fafd0e9644919d5f556114573533 P 371b5d0b1c9e48c79defeea5005327a6: stopping tablet replica
I20260709 13:14:05.668391 24113 raft_consensus.cc:2243] T 0e96fafd0e9644919d5f556114573533 P 371b5d0b1c9e48c79defeea5005327a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:05.668896 24113 raft_consensus.cc:2272] T 0e96fafd0e9644919d5f556114573533 P 371b5d0b1c9e48c79defeea5005327a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:05.671859 24113 tablet_replica.cc:333] T 58c124bee20f4d039daa8d54154c0616 P 371b5d0b1c9e48c79defeea5005327a6: stopping tablet replica
I20260709 13:14:05.672547 24113 raft_consensus.cc:2243] T 58c124bee20f4d039daa8d54154c0616 P 371b5d0b1c9e48c79defeea5005327a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:05.673108 24113 raft_consensus.cc:2272] T 58c124bee20f4d039daa8d54154c0616 P 371b5d0b1c9e48c79defeea5005327a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:05.675684 24113 tablet_replica.cc:333] T c97f937160cf4068a000607700371c56 P 371b5d0b1c9e48c79defeea5005327a6: stopping tablet replica
I20260709 13:14:05.676298 24113 raft_consensus.cc:2243] T c97f937160cf4068a000607700371c56 P 371b5d0b1c9e48c79defeea5005327a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:05.676862 24113 raft_consensus.cc:2272] T c97f937160cf4068a000607700371c56 P 371b5d0b1c9e48c79defeea5005327a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:05.680002 24113 tablet_replica.cc:333] T 4fdcc1f9d3d34a1480606d325fe3616f P 371b5d0b1c9e48c79defeea5005327a6: stopping tablet replica
I20260709 13:14:05.680684 24113 raft_consensus.cc:2243] T 4fdcc1f9d3d34a1480606d325fe3616f P 371b5d0b1c9e48c79defeea5005327a6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:05.682745 24113 raft_consensus.cc:2272] T 4fdcc1f9d3d34a1480606d325fe3616f P 371b5d0b1c9e48c79defeea5005327a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:05.686430 24113 tablet_replica.cc:333] T 6e71f9f26bcf449388fdf26ab44b79da P 371b5d0b1c9e48c79defeea5005327a6: stopping tablet replica
I20260709 13:14:05.686959 24113 raft_consensus.cc:2243] T 6e71f9f26bcf449388fdf26ab44b79da P 371b5d0b1c9e48c79defeea5005327a6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:05.687363 24113 raft_consensus.cc:2272] T 6e71f9f26bcf449388fdf26ab44b79da P 371b5d0b1c9e48c79defeea5005327a6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:05.689651 24113 tablet_replica.cc:333] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P 371b5d0b1c9e48c79defeea5005327a6: stopping tablet replica
I20260709 13:14:05.690119 24113 raft_consensus.cc:2243] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P 371b5d0b1c9e48c79defeea5005327a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:05.690546 24113 raft_consensus.cc:2272] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P 371b5d0b1c9e48c79defeea5005327a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:05.727624 24113 tablet_server.cc:196] TabletServer@127.23.140.65:0 shutdown complete.
I20260709 13:14:05.776250   503 consensus_queue.cc:1048] T 58c124bee20f4d039daa8d54154c0616 P ccb5d7de9811449d8105001cb43ac775 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:14:05.793255   391 consensus_peers.cc:597] T 58c124bee20f4d039daa8d54154c0616 P ccb5d7de9811449d8105001cb43ac775 -> Peer 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633): Couldn't send request to peer 371b5d0b1c9e48c79defeea5005327a6. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:41633: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:05.900820   391 consensus_peers.cc:597] T 42473b265d0f476b928fdcbe60fd318b P ccb5d7de9811449d8105001cb43ac775 -> Peer 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633): Couldn't send request to peer 371b5d0b1c9e48c79defeea5005327a6. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:41633: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:06.600356 32693 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:14:06.920296   564 raft_consensus.cc:493] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 371b5d0b1c9e48c79defeea5005327a6)
I20260709 13:14:06.920955   564 raft_consensus.cc:515] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:06.922829   564 leader_election.cc:290] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633), ccb5d7de9811449d8105001cb43ac775 (127.23.140.67:39377)
I20260709 13:14:06.924077   503 raft_consensus.cc:493] T 4fdcc1f9d3d34a1480606d325fe3616f P ccb5d7de9811449d8105001cb43ac775 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 371b5d0b1c9e48c79defeea5005327a6)
I20260709 13:14:06.924044   427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fdcc1f9d3d34a1480606d325fe3616f" candidate_uuid: "c3db9c6332ea4354b25af20b8d98cde9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccb5d7de9811449d8105001cb43ac775" is_pre_election: true
I20260709 13:14:06.925395   503 raft_consensus.cc:515] T 4fdcc1f9d3d34a1480606d325fe3616f P ccb5d7de9811449d8105001cb43ac775 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:06.926357   427 raft_consensus.cc:2468] T 4fdcc1f9d3d34a1480606d325fe3616f P ccb5d7de9811449d8105001cb43ac775 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3db9c6332ea4354b25af20b8d98cde9 in term 1.
W20260709 13:14:06.926873   317 leader_election.cc:336] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633): Network error: Client connection negotiation failed: client connection to 127.23.140.65:41633: connect: Connection refused (error 111)
I20260709 13:14:06.928105   503 leader_election.cc:290] T 4fdcc1f9d3d34a1480606d325fe3616f P ccb5d7de9811449d8105001cb43ac775 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633), c3db9c6332ea4354b25af20b8d98cde9 (127.23.140.66:38883)
I20260709 13:14:06.928493   318 leader_election.cc:304] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c3db9c6332ea4354b25af20b8d98cde9, ccb5d7de9811449d8105001cb43ac775; no voters: 371b5d0b1c9e48c79defeea5005327a6
I20260709 13:14:06.928946   354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fdcc1f9d3d34a1480606d325fe3616f" candidate_uuid: "ccb5d7de9811449d8105001cb43ac775" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c3db9c6332ea4354b25af20b8d98cde9" is_pre_election: true
I20260709 13:14:06.929416   564 raft_consensus.cc:2804] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:06.929881   564 raft_consensus.cc:493] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 371b5d0b1c9e48c79defeea5005327a6)
I20260709 13:14:06.930277   564 raft_consensus.cc:3060] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:14:06.931424   391 leader_election.cc:336] T 4fdcc1f9d3d34a1480606d325fe3616f P ccb5d7de9811449d8105001cb43ac775 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633): Network error: Client connection negotiation failed: client connection to 127.23.140.65:41633: connect: Connection refused (error 111)
I20260709 13:14:06.937011   564 raft_consensus.cc:515] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:06.938074   354 raft_consensus.cc:2393] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccb5d7de9811449d8105001cb43ac775 in current term 2: Already voted for candidate c3db9c6332ea4354b25af20b8d98cde9 in this term.
I20260709 13:14:06.938846   564 leader_election.cc:290] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9 [CANDIDATE]: Term 2 election: Requested vote from peers 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633), ccb5d7de9811449d8105001cb43ac775 (127.23.140.67:39377)
I20260709 13:14:06.940220   427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fdcc1f9d3d34a1480606d325fe3616f" candidate_uuid: "c3db9c6332ea4354b25af20b8d98cde9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccb5d7de9811449d8105001cb43ac775"
I20260709 13:14:06.940213   394 leader_election.cc:304] T 4fdcc1f9d3d34a1480606d325fe3616f P ccb5d7de9811449d8105001cb43ac775 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccb5d7de9811449d8105001cb43ac775; no voters: 371b5d0b1c9e48c79defeea5005327a6, c3db9c6332ea4354b25af20b8d98cde9
I20260709 13:14:06.941049   427 raft_consensus.cc:3060] T 4fdcc1f9d3d34a1480606d325fe3616f P ccb5d7de9811449d8105001cb43ac775 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:14:06.942987   317 leader_election.cc:336] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633): Network error: Client connection negotiation failed: client connection to 127.23.140.65:41633: connect: Connection refused (error 111)
I20260709 13:14:06.947289   427 raft_consensus.cc:2468] T 4fdcc1f9d3d34a1480606d325fe3616f P ccb5d7de9811449d8105001cb43ac775 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3db9c6332ea4354b25af20b8d98cde9 in term 2.
I20260709 13:14:06.947813   503 raft_consensus.cc:2749] T 4fdcc1f9d3d34a1480606d325fe3616f P ccb5d7de9811449d8105001cb43ac775 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:06.948701   318 leader_election.cc:304] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c3db9c6332ea4354b25af20b8d98cde9, ccb5d7de9811449d8105001cb43ac775; no voters: 371b5d0b1c9e48c79defeea5005327a6
I20260709 13:14:06.950101   564 raft_consensus.cc:2804] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:06.950697   564 raft_consensus.cc:697] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9 [term 2 LEADER]: Becoming Leader. State: Replica: c3db9c6332ea4354b25af20b8d98cde9, State: Running, Role: LEADER
I20260709 13:14:06.951922   564 consensus_queue.cc:237] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:06.959713 32642 catalog_manager.cc:5697] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9 reported cstate change: term changed from 1 to 2, leader changed from 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65) to c3db9c6332ea4354b25af20b8d98cde9 (127.23.140.66). New cstate: current_term: 2 leader_uuid: "c3db9c6332ea4354b25af20b8d98cde9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:06.981346   317 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.140.65:41633: connect: Connection refused (error 111) [suppressed 114 similar messages]
I20260709 13:14:07.041146   564 raft_consensus.cc:493] T 31972c45882a4ef1bd838a1790d929b4 P c3db9c6332ea4354b25af20b8d98cde9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 371b5d0b1c9e48c79defeea5005327a6)
I20260709 13:14:07.041792   564 raft_consensus.cc:515] T 31972c45882a4ef1bd838a1790d929b4 P c3db9c6332ea4354b25af20b8d98cde9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:07.043828   564 leader_election.cc:290] T 31972c45882a4ef1bd838a1790d929b4 P c3db9c6332ea4354b25af20b8d98cde9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633), ccb5d7de9811449d8105001cb43ac775 (127.23.140.67:39377)
I20260709 13:14:07.044543   503 raft_consensus.cc:493] T 31972c45882a4ef1bd838a1790d929b4 P ccb5d7de9811449d8105001cb43ac775 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 371b5d0b1c9e48c79defeea5005327a6)
I20260709 13:14:07.045200   427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31972c45882a4ef1bd838a1790d929b4" candidate_uuid: "c3db9c6332ea4354b25af20b8d98cde9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccb5d7de9811449d8105001cb43ac775" is_pre_election: true
I20260709 13:14:07.045193   503 raft_consensus.cc:515] T 31972c45882a4ef1bd838a1790d929b4 P ccb5d7de9811449d8105001cb43ac775 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:07.046468   427 raft_consensus.cc:2468] T 31972c45882a4ef1bd838a1790d929b4 P ccb5d7de9811449d8105001cb43ac775 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3db9c6332ea4354b25af20b8d98cde9 in term 1.
I20260709 13:14:07.047580   318 leader_election.cc:304] T 31972c45882a4ef1bd838a1790d929b4 P c3db9c6332ea4354b25af20b8d98cde9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3db9c6332ea4354b25af20b8d98cde9, ccb5d7de9811449d8105001cb43ac775; no voters: 
I20260709 13:14:07.048413   564 raft_consensus.cc:2804] T 31972c45882a4ef1bd838a1790d929b4 P c3db9c6332ea4354b25af20b8d98cde9 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:14:07.048489   317 leader_election.cc:336] T 31972c45882a4ef1bd838a1790d929b4 P c3db9c6332ea4354b25af20b8d98cde9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633): Network error: Client connection negotiation failed: client connection to 127.23.140.65:41633: connect: Connection refused (error 111)
I20260709 13:14:07.048827   564 raft_consensus.cc:493] T 31972c45882a4ef1bd838a1790d929b4 P c3db9c6332ea4354b25af20b8d98cde9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 371b5d0b1c9e48c79defeea5005327a6)
I20260709 13:14:07.048697   354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31972c45882a4ef1bd838a1790d929b4" candidate_uuid: "ccb5d7de9811449d8105001cb43ac775" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c3db9c6332ea4354b25af20b8d98cde9" is_pre_election: true
I20260709 13:14:07.049309   564 raft_consensus.cc:3060] T 31972c45882a4ef1bd838a1790d929b4 P c3db9c6332ea4354b25af20b8d98cde9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:07.049561   503 leader_election.cc:290] T 31972c45882a4ef1bd838a1790d929b4 P ccb5d7de9811449d8105001cb43ac775 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633), c3db9c6332ea4354b25af20b8d98cde9 (127.23.140.66:38883)
W20260709 13:14:07.051959   391 leader_election.cc:336] T 31972c45882a4ef1bd838a1790d929b4 P ccb5d7de9811449d8105001cb43ac775 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633): Network error: Client connection negotiation failed: client connection to 127.23.140.65:41633: connect: Connection refused (error 111)
I20260709 13:14:07.055112   564 raft_consensus.cc:515] T 31972c45882a4ef1bd838a1790d929b4 P c3db9c6332ea4354b25af20b8d98cde9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:07.056147   354 raft_consensus.cc:2393] T 31972c45882a4ef1bd838a1790d929b4 P c3db9c6332ea4354b25af20b8d98cde9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccb5d7de9811449d8105001cb43ac775 in current term 2: Already voted for candidate c3db9c6332ea4354b25af20b8d98cde9 in this term.
I20260709 13:14:07.057076   564 leader_election.cc:290] T 31972c45882a4ef1bd838a1790d929b4 P c3db9c6332ea4354b25af20b8d98cde9 [CANDIDATE]: Term 2 election: Requested vote from peers 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633), ccb5d7de9811449d8105001cb43ac775 (127.23.140.67:39377)
I20260709 13:14:07.057981   394 leader_election.cc:304] T 31972c45882a4ef1bd838a1790d929b4 P ccb5d7de9811449d8105001cb43ac775 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccb5d7de9811449d8105001cb43ac775; no voters: 371b5d0b1c9e48c79defeea5005327a6, c3db9c6332ea4354b25af20b8d98cde9
I20260709 13:14:07.058451   427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31972c45882a4ef1bd838a1790d929b4" candidate_uuid: "c3db9c6332ea4354b25af20b8d98cde9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccb5d7de9811449d8105001cb43ac775"
I20260709 13:14:07.058771   503 raft_consensus.cc:3060] T 31972c45882a4ef1bd838a1790d929b4 P ccb5d7de9811449d8105001cb43ac775 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:14:07.061025   317 leader_election.cc:336] T 31972c45882a4ef1bd838a1790d929b4 P c3db9c6332ea4354b25af20b8d98cde9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633): Network error: Client connection negotiation failed: client connection to 127.23.140.65:41633: connect: Connection refused (error 111)
I20260709 13:14:07.065464   503 raft_consensus.cc:2749] T 31972c45882a4ef1bd838a1790d929b4 P ccb5d7de9811449d8105001cb43ac775 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:07.070760   427 raft_consensus.cc:2468] T 31972c45882a4ef1bd838a1790d929b4 P ccb5d7de9811449d8105001cb43ac775 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3db9c6332ea4354b25af20b8d98cde9 in term 2.
I20260709 13:14:07.072208   318 leader_election.cc:304] T 31972c45882a4ef1bd838a1790d929b4 P c3db9c6332ea4354b25af20b8d98cde9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c3db9c6332ea4354b25af20b8d98cde9, ccb5d7de9811449d8105001cb43ac775; no voters: 371b5d0b1c9e48c79defeea5005327a6
I20260709 13:14:07.072958   564 raft_consensus.cc:2804] T 31972c45882a4ef1bd838a1790d929b4 P c3db9c6332ea4354b25af20b8d98cde9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:07.073392   564 raft_consensus.cc:697] T 31972c45882a4ef1bd838a1790d929b4 P c3db9c6332ea4354b25af20b8d98cde9 [term 2 LEADER]: Becoming Leader. State: Replica: c3db9c6332ea4354b25af20b8d98cde9, State: Running, Role: LEADER
I20260709 13:14:07.074343   564 consensus_queue.cc:237] T 31972c45882a4ef1bd838a1790d929b4 P c3db9c6332ea4354b25af20b8d98cde9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:07.081818 32642 catalog_manager.cc:5697] T 31972c45882a4ef1bd838a1790d929b4 P c3db9c6332ea4354b25af20b8d98cde9 reported cstate change: term changed from 1 to 2, leader changed from 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65) to c3db9c6332ea4354b25af20b8d98cde9 (127.23.140.66). New cstate: current_term: 2 leader_uuid: "c3db9c6332ea4354b25af20b8d98cde9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:07.389181   317 consensus_peers.cc:597] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9 -> Peer 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633): Couldn't send request to peer 371b5d0b1c9e48c79defeea5005327a6. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:41633: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:07.510847   427 raft_consensus.cc:1275] T 4fdcc1f9d3d34a1480606d325fe3616f P ccb5d7de9811449d8105001cb43ac775 [term 2 FOLLOWER]: Refusing update from remote peer c3db9c6332ea4354b25af20b8d98cde9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:07.512055   564 consensus_queue.cc:1048] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:14:07.550942   317 consensus_peers.cc:597] T 31972c45882a4ef1bd838a1790d929b4 P c3db9c6332ea4354b25af20b8d98cde9 -> Peer 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633): Couldn't send request to peer 371b5d0b1c9e48c79defeea5005327a6. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:41633: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:07.601436 32693 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:14:07.628038   427 raft_consensus.cc:1275] T 31972c45882a4ef1bd838a1790d929b4 P ccb5d7de9811449d8105001cb43ac775 [term 2 FOLLOWER]: Refusing update from remote peer c3db9c6332ea4354b25af20b8d98cde9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:07.629474   564 consensus_queue.cc:1048] T 31972c45882a4ef1bd838a1790d929b4 P c3db9c6332ea4354b25af20b8d98cde9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:14:07.883561   317 consensus_peers.cc:597] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P c3db9c6332ea4354b25af20b8d98cde9 -> Peer 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633): Couldn't send request to peer 371b5d0b1c9e48c79defeea5005327a6. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:41633: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:07.894492   317 consensus_peers.cc:597] T 6e71f9f26bcf449388fdf26ab44b79da P c3db9c6332ea4354b25af20b8d98cde9 -> Peer 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633): Couldn't send request to peer 371b5d0b1c9e48c79defeea5005327a6. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:41633: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:08.129166   317 consensus_peers.cc:597] T 0e96fafd0e9644919d5f556114573533 P c3db9c6332ea4354b25af20b8d98cde9 -> Peer 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633): Couldn't send request to peer 371b5d0b1c9e48c79defeea5005327a6. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:41633: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:08.134027   317 consensus_peers.cc:597] T c97f937160cf4068a000607700371c56 P c3db9c6332ea4354b25af20b8d98cde9 -> Peer 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633): Couldn't send request to peer 371b5d0b1c9e48c79defeea5005327a6. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:41633: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:08.242338   317 consensus_peers.cc:597] T ccc5273ee6eb48e9ad577cb60a46001a P c3db9c6332ea4354b25af20b8d98cde9 -> Peer 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633): Couldn't send request to peer 371b5d0b1c9e48c79defeea5005327a6. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:41633: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:08.283905   391 consensus_peers.cc:597] T 58c124bee20f4d039daa8d54154c0616 P ccb5d7de9811449d8105001cb43ac775 -> Peer 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633): Couldn't send request to peer 371b5d0b1c9e48c79defeea5005327a6. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:41633: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:08.335911   391 consensus_peers.cc:597] T efc64f8df3094f568e2fb0be3e56380b P ccb5d7de9811449d8105001cb43ac775 -> Peer 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633): Couldn't send request to peer 371b5d0b1c9e48c79defeea5005327a6. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:41633: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:08.412873   391 consensus_peers.cc:597] T 42473b265d0f476b928fdcbe60fd318b P ccb5d7de9811449d8105001cb43ac775 -> Peer 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633): Couldn't send request to peer 371b5d0b1c9e48c79defeea5005327a6. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:41633: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:08.602483 32693 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:14:09.582048   317 consensus_peers.cc:597] T 31972c45882a4ef1bd838a1790d929b4 P c3db9c6332ea4354b25af20b8d98cde9 -> Peer 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633): Couldn't send request to peer 371b5d0b1c9e48c79defeea5005327a6. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:41633: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:09.603502 32693 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:14:09.652570   317 consensus_peers.cc:597] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9 -> Peer 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633): Couldn't send request to peer 371b5d0b1c9e48c79defeea5005327a6. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:41633: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:10.358815   317 consensus_peers.cc:597] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P c3db9c6332ea4354b25af20b8d98cde9 -> Peer 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633): Couldn't send request to peer 371b5d0b1c9e48c79defeea5005327a6. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:41633: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:10.443118   317 consensus_peers.cc:597] T ccc5273ee6eb48e9ad577cb60a46001a P c3db9c6332ea4354b25af20b8d98cde9 -> Peer 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633): Couldn't send request to peer 371b5d0b1c9e48c79defeea5005327a6. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:41633: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:10.553026   317 consensus_peers.cc:597] T 6e71f9f26bcf449388fdf26ab44b79da P c3db9c6332ea4354b25af20b8d98cde9 -> Peer 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633): Couldn't send request to peer 371b5d0b1c9e48c79defeea5005327a6. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:41633: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:10.604579 32693 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:14:10.652797   317 consensus_peers.cc:597] T c97f937160cf4068a000607700371c56 P c3db9c6332ea4354b25af20b8d98cde9 -> Peer 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633): Couldn't send request to peer 371b5d0b1c9e48c79defeea5005327a6. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:41633: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:10.675572   391 consensus_peers.cc:597] T efc64f8df3094f568e2fb0be3e56380b P ccb5d7de9811449d8105001cb43ac775 -> Peer 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633): Couldn't send request to peer 371b5d0b1c9e48c79defeea5005327a6. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:41633: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:10.691910   391 consensus_peers.cc:597] T 42473b265d0f476b928fdcbe60fd318b P ccb5d7de9811449d8105001cb43ac775 -> Peer 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633): Couldn't send request to peer 371b5d0b1c9e48c79defeea5005327a6. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:41633: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:10.710738   391 consensus_peers.cc:597] T 58c124bee20f4d039daa8d54154c0616 P ccb5d7de9811449d8105001cb43ac775 -> Peer 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633): Couldn't send request to peer 371b5d0b1c9e48c79defeea5005327a6. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:41633: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:10.731513   317 consensus_peers.cc:597] T 0e96fafd0e9644919d5f556114573533 P c3db9c6332ea4354b25af20b8d98cde9 -> Peer 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633): Couldn't send request to peer 371b5d0b1c9e48c79defeea5005327a6. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:41633: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:14:10.758338 24113 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:10.765962   577 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:10.766966   578 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:10.769728 24113 server_base.cc:1061] running on GCE node
W20260709 13:14:10.770768   580 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:10.773470 24113 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:10.773727 24113 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:10.773973 24113 hybrid_clock.cc:648] HybridClock initialized: now 1783602850773956 us; error 0 us; skew 500 ppm
I20260709 13:14:10.774536 24113 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:10.777206 24113 webserver.cc:533] Webserver started at http://127.23.140.65:45351/ using document root <none> and password file <none>
I20260709 13:14:10.777788 24113 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:10.778002 24113 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:14:10.782220 24113 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:14:10.786444   585 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:10.787199 24113 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:14:10.787525 24113 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602598684750-24113-0/minicluster-data/ts-0-root
uuid: "371b5d0b1c9e48c79defeea5005327a6"
format_stamp: "Formatted at 2026-07-09 13:14:03 on dist-test-slave-1rs3"
I20260709 13:14:10.787916 24113 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602598684750-24113-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602598684750-24113-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602598684750-24113-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:10.798468 24113 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:10.799726 24113 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:10.801215 24113 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:10.804864   592 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 13:14:10.870025 24113 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:14:10.870301 24113 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.066s	user 0.003s	sys 0.000s
I20260709 13:14:10.870643 24113 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:14:10.877261   592 tablet_bootstrap.cc:492] T 58c124bee20f4d039daa8d54154c0616 P 371b5d0b1c9e48c79defeea5005327a6: Bootstrap starting.
I20260709 13:14:10.889310   592 tablet_bootstrap.cc:492] T 58c124bee20f4d039daa8d54154c0616 P 371b5d0b1c9e48c79defeea5005327a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:10.890123   592 tablet_bootstrap.cc:492] T 58c124bee20f4d039daa8d54154c0616 P 371b5d0b1c9e48c79defeea5005327a6: Bootstrap complete.
I20260709 13:14:10.890688   592 ts_tablet_manager.cc:1403] T 58c124bee20f4d039daa8d54154c0616 P 371b5d0b1c9e48c79defeea5005327a6: Time spent bootstrapping tablet: real 0.014s	user 0.007s	sys 0.006s
I20260709 13:14:10.892863   592 raft_consensus.cc:359] T 58c124bee20f4d039daa8d54154c0616 P 371b5d0b1c9e48c79defeea5005327a6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:10.893401   592 raft_consensus.cc:740] T 58c124bee20f4d039daa8d54154c0616 P 371b5d0b1c9e48c79defeea5005327a6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b5d0b1c9e48c79defeea5005327a6, State: Initialized, Role: FOLLOWER
I20260709 13:14:10.894100   592 consensus_queue.cc:260] T 58c124bee20f4d039daa8d54154c0616 P 371b5d0b1c9e48c79defeea5005327a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:10.896329   592 ts_tablet_manager.cc:1434] T 58c124bee20f4d039daa8d54154c0616 P 371b5d0b1c9e48c79defeea5005327a6: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.002s
I20260709 13:14:10.896996   592 tablet_bootstrap.cc:492] T 4fdcc1f9d3d34a1480606d325fe3616f P 371b5d0b1c9e48c79defeea5005327a6: Bootstrap starting.
I20260709 13:14:10.910144   592 tablet_bootstrap.cc:492] T 4fdcc1f9d3d34a1480606d325fe3616f P 371b5d0b1c9e48c79defeea5005327a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:10.911033   592 tablet_bootstrap.cc:492] T 4fdcc1f9d3d34a1480606d325fe3616f P 371b5d0b1c9e48c79defeea5005327a6: Bootstrap complete.
I20260709 13:14:10.911589   592 ts_tablet_manager.cc:1403] T 4fdcc1f9d3d34a1480606d325fe3616f P 371b5d0b1c9e48c79defeea5005327a6: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 13:14:10.913422 24113 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:14:10.913815 24113 ts_tablet_manager.cc:595] Time spent register tablets: real 0.043s	user 0.044s	sys 0.000s
I20260709 13:14:10.913548   592 raft_consensus.cc:359] T 4fdcc1f9d3d34a1480606d325fe3616f P 371b5d0b1c9e48c79defeea5005327a6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:10.914335   592 raft_consensus.cc:740] T 4fdcc1f9d3d34a1480606d325fe3616f P 371b5d0b1c9e48c79defeea5005327a6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b5d0b1c9e48c79defeea5005327a6, State: Initialized, Role: FOLLOWER
I20260709 13:14:10.915050   592 consensus_queue.cc:260] T 4fdcc1f9d3d34a1480606d325fe3616f P 371b5d0b1c9e48c79defeea5005327a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:10.916916   592 ts_tablet_manager.cc:1434] T 4fdcc1f9d3d34a1480606d325fe3616f P 371b5d0b1c9e48c79defeea5005327a6: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:14:10.917762   592 tablet_bootstrap.cc:492] T c97f937160cf4068a000607700371c56 P 371b5d0b1c9e48c79defeea5005327a6: Bootstrap starting.
I20260709 13:14:10.932292   592 tablet_bootstrap.cc:492] T c97f937160cf4068a000607700371c56 P 371b5d0b1c9e48c79defeea5005327a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:10.933357   592 tablet_bootstrap.cc:492] T c97f937160cf4068a000607700371c56 P 371b5d0b1c9e48c79defeea5005327a6: Bootstrap complete.
I20260709 13:14:10.934149   592 ts_tablet_manager.cc:1403] T c97f937160cf4068a000607700371c56 P 371b5d0b1c9e48c79defeea5005327a6: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.004s
I20260709 13:14:10.937243   592 raft_consensus.cc:359] T c97f937160cf4068a000607700371c56 P 371b5d0b1c9e48c79defeea5005327a6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:10.938092   592 raft_consensus.cc:740] T c97f937160cf4068a000607700371c56 P 371b5d0b1c9e48c79defeea5005327a6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b5d0b1c9e48c79defeea5005327a6, State: Initialized, Role: FOLLOWER
I20260709 13:14:10.939035   592 consensus_queue.cc:260] T c97f937160cf4068a000607700371c56 P 371b5d0b1c9e48c79defeea5005327a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:10.941107   592 ts_tablet_manager.cc:1434] T c97f937160cf4068a000607700371c56 P 371b5d0b1c9e48c79defeea5005327a6: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.004s
I20260709 13:14:10.941875   592 tablet_bootstrap.cc:492] T 31972c45882a4ef1bd838a1790d929b4 P 371b5d0b1c9e48c79defeea5005327a6: Bootstrap starting.
I20260709 13:14:10.954195   592 tablet_bootstrap.cc:492] T 31972c45882a4ef1bd838a1790d929b4 P 371b5d0b1c9e48c79defeea5005327a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:10.954982   592 tablet_bootstrap.cc:492] T 31972c45882a4ef1bd838a1790d929b4 P 371b5d0b1c9e48c79defeea5005327a6: Bootstrap complete.
I20260709 13:14:10.955605   592 ts_tablet_manager.cc:1403] T 31972c45882a4ef1bd838a1790d929b4 P 371b5d0b1c9e48c79defeea5005327a6: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 13:14:10.957857   592 raft_consensus.cc:359] T 31972c45882a4ef1bd838a1790d929b4 P 371b5d0b1c9e48c79defeea5005327a6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:10.958475   592 raft_consensus.cc:740] T 31972c45882a4ef1bd838a1790d929b4 P 371b5d0b1c9e48c79defeea5005327a6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b5d0b1c9e48c79defeea5005327a6, State: Initialized, Role: FOLLOWER
I20260709 13:14:10.959162   592 consensus_queue.cc:260] T 31972c45882a4ef1bd838a1790d929b4 P 371b5d0b1c9e48c79defeea5005327a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:10.960801   592 ts_tablet_manager.cc:1434] T 31972c45882a4ef1bd838a1790d929b4 P 371b5d0b1c9e48c79defeea5005327a6: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:14:10.961618   592 tablet_bootstrap.cc:492] T 42473b265d0f476b928fdcbe60fd318b P 371b5d0b1c9e48c79defeea5005327a6: Bootstrap starting.
I20260709 13:14:10.975534   592 tablet_bootstrap.cc:492] T 42473b265d0f476b928fdcbe60fd318b P 371b5d0b1c9e48c79defeea5005327a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:10.976671   592 tablet_bootstrap.cc:492] T 42473b265d0f476b928fdcbe60fd318b P 371b5d0b1c9e48c79defeea5005327a6: Bootstrap complete.
I20260709 13:14:10.976956 24113 rpc_server.cc:307] RPC server started. Bound to: 127.23.140.65:41633
I20260709 13:14:10.977139   654 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.140.65:41633 every 8 connection(s)
I20260709 13:14:10.977412   592 ts_tablet_manager.cc:1403] T 42473b265d0f476b928fdcbe60fd318b P 371b5d0b1c9e48c79defeea5005327a6: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.004s
I20260709 13:14:10.980134   592 raft_consensus.cc:359] T 42473b265d0f476b928fdcbe60fd318b P 371b5d0b1c9e48c79defeea5005327a6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:10.980996   592 raft_consensus.cc:740] T 42473b265d0f476b928fdcbe60fd318b P 371b5d0b1c9e48c79defeea5005327a6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b5d0b1c9e48c79defeea5005327a6, State: Initialized, Role: FOLLOWER
I20260709 13:14:10.982030   592 consensus_queue.cc:260] T 42473b265d0f476b928fdcbe60fd318b P 371b5d0b1c9e48c79defeea5005327a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:10.984776   592 ts_tablet_manager.cc:1434] T 42473b265d0f476b928fdcbe60fd318b P 371b5d0b1c9e48c79defeea5005327a6: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:14:10.985978   592 tablet_bootstrap.cc:492] T efc64f8df3094f568e2fb0be3e56380b P 371b5d0b1c9e48c79defeea5005327a6: Bootstrap starting.
I20260709 13:14:11.005156 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:11.008553   592 tablet_bootstrap.cc:492] T efc64f8df3094f568e2fb0be3e56380b P 371b5d0b1c9e48c79defeea5005327a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:11.011369   656 heartbeater.cc:344] Connected to a master server at 127.23.140.126:34933
I20260709 13:14:11.011912   656 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:11.012895   656 heartbeater.cc:507] Master 127.23.140.126:34933 requested a full tablet report, sending...
I20260709 13:14:11.013605   592 tablet_bootstrap.cc:492] T efc64f8df3094f568e2fb0be3e56380b P 371b5d0b1c9e48c79defeea5005327a6: Bootstrap complete.
I20260709 13:14:11.014424   592 ts_tablet_manager.cc:1403] T efc64f8df3094f568e2fb0be3e56380b P 371b5d0b1c9e48c79defeea5005327a6: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.008s
I20260709 13:14:11.016491   592 raft_consensus.cc:359] T efc64f8df3094f568e2fb0be3e56380b P 371b5d0b1c9e48c79defeea5005327a6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:11.017238   592 raft_consensus.cc:740] T efc64f8df3094f568e2fb0be3e56380b P 371b5d0b1c9e48c79defeea5005327a6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b5d0b1c9e48c79defeea5005327a6, State: Initialized, Role: FOLLOWER
I20260709 13:14:11.017992   592 consensus_queue.cc:260] T efc64f8df3094f568e2fb0be3e56380b P 371b5d0b1c9e48c79defeea5005327a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:11.020020   592 ts_tablet_manager.cc:1434] T efc64f8df3094f568e2fb0be3e56380b P 371b5d0b1c9e48c79defeea5005327a6: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:14:11.020076 32645 ts_manager.cc:194] Re-registered known tserver with Master: 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633)
I20260709 13:14:11.020857   592 tablet_bootstrap.cc:492] T ccc5273ee6eb48e9ad577cb60a46001a P 371b5d0b1c9e48c79defeea5005327a6: Bootstrap starting.
I20260709 13:14:11.029436   354 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4fdcc1f9d3d34a1480606d325fe3616f"
dest_uuid: "c3db9c6332ea4354b25af20b8d98cde9"
mode: GRACEFUL
new_leader_uuid: "ccb5d7de9811449d8105001cb43ac775"
 from {username='slave'} at 127.0.0.1:60036
I20260709 13:14:11.030218   354 raft_consensus.cc:606] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9 [term 2 LEADER]: Received request to transfer leadership to TS ccb5d7de9811449d8105001cb43ac775
I20260709 13:14:11.031777 32645 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53534
I20260709 13:14:11.033133   354 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e71f9f26bcf449388fdf26ab44b79da"
dest_uuid: "c3db9c6332ea4354b25af20b8d98cde9"
mode: GRACEFUL
new_leader_uuid: "ccb5d7de9811449d8105001cb43ac775"
 from {username='slave'} at 127.0.0.1:60036
I20260709 13:14:11.033830   354 raft_consensus.cc:606] T 6e71f9f26bcf449388fdf26ab44b79da P c3db9c6332ea4354b25af20b8d98cde9 [term 1 LEADER]: Received request to transfer leadership to TS ccb5d7de9811449d8105001cb43ac775
I20260709 13:14:11.036778   354 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c97f937160cf4068a000607700371c56"
dest_uuid: "c3db9c6332ea4354b25af20b8d98cde9"
mode: GRACEFUL
new_leader_uuid: "ccb5d7de9811449d8105001cb43ac775"
 from {username='slave'} at 127.0.0.1:60036
I20260709 13:14:11.037478   354 raft_consensus.cc:606] T c97f937160cf4068a000607700371c56 P c3db9c6332ea4354b25af20b8d98cde9 [term 1 LEADER]: Received request to transfer leadership to TS ccb5d7de9811449d8105001cb43ac775
I20260709 13:14:11.037530   656 heartbeater.cc:499] Master 127.23.140.126:34933 was elected leader, sending a full tablet report...
I20260709 13:14:11.037724   592 tablet_bootstrap.cc:492] T ccc5273ee6eb48e9ad577cb60a46001a P 371b5d0b1c9e48c79defeea5005327a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:11.038808   592 tablet_bootstrap.cc:492] T ccc5273ee6eb48e9ad577cb60a46001a P 371b5d0b1c9e48c79defeea5005327a6: Bootstrap complete.
I20260709 13:14:11.038861 24113 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:14:11.039479   592 ts_tablet_manager.cc:1403] T ccc5273ee6eb48e9ad577cb60a46001a P 371b5d0b1c9e48c79defeea5005327a6: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 13:14:11.039561 24113 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:11.040360 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:11.041981   592 raft_consensus.cc:359] T ccc5273ee6eb48e9ad577cb60a46001a P 371b5d0b1c9e48c79defeea5005327a6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:11.042716   592 raft_consensus.cc:740] T ccc5273ee6eb48e9ad577cb60a46001a P 371b5d0b1c9e48c79defeea5005327a6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b5d0b1c9e48c79defeea5005327a6, State: Initialized, Role: FOLLOWER
I20260709 13:14:11.043383   592 consensus_queue.cc:260] T ccc5273ee6eb48e9ad577cb60a46001a P 371b5d0b1c9e48c79defeea5005327a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:11.045328   592 ts_tablet_manager.cc:1434] T ccc5273ee6eb48e9ad577cb60a46001a P 371b5d0b1c9e48c79defeea5005327a6: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:14:11.046388   592 tablet_bootstrap.cc:492] T 0e96fafd0e9644919d5f556114573533 P 371b5d0b1c9e48c79defeea5005327a6: Bootstrap starting.
I20260709 13:14:11.058740   592 tablet_bootstrap.cc:492] T 0e96fafd0e9644919d5f556114573533 P 371b5d0b1c9e48c79defeea5005327a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:11.059404   592 tablet_bootstrap.cc:492] T 0e96fafd0e9644919d5f556114573533 P 371b5d0b1c9e48c79defeea5005327a6: Bootstrap complete.
I20260709 13:14:11.059937   592 ts_tablet_manager.cc:1403] T 0e96fafd0e9644919d5f556114573533 P 371b5d0b1c9e48c79defeea5005327a6: Time spent bootstrapping tablet: real 0.014s	user 0.005s	sys 0.005s
I20260709 13:14:11.061858   592 raft_consensus.cc:359] T 0e96fafd0e9644919d5f556114573533 P 371b5d0b1c9e48c79defeea5005327a6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:11.062521   592 raft_consensus.cc:740] T 0e96fafd0e9644919d5f556114573533 P 371b5d0b1c9e48c79defeea5005327a6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b5d0b1c9e48c79defeea5005327a6, State: Initialized, Role: FOLLOWER
I20260709 13:14:11.063122   592 consensus_queue.cc:260] T 0e96fafd0e9644919d5f556114573533 P 371b5d0b1c9e48c79defeea5005327a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:11.064908   592 ts_tablet_manager.cc:1434] T 0e96fafd0e9644919d5f556114573533 P 371b5d0b1c9e48c79defeea5005327a6: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:14:11.065651   592 tablet_bootstrap.cc:492] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P 371b5d0b1c9e48c79defeea5005327a6: Bootstrap starting.
I20260709 13:14:11.078930   592 tablet_bootstrap.cc:492] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P 371b5d0b1c9e48c79defeea5005327a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:11.079587   592 tablet_bootstrap.cc:492] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P 371b5d0b1c9e48c79defeea5005327a6: Bootstrap complete.
I20260709 13:14:11.080046   592 ts_tablet_manager.cc:1403] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P 371b5d0b1c9e48c79defeea5005327a6: Time spent bootstrapping tablet: real 0.015s	user 0.007s	sys 0.005s
I20260709 13:14:11.081708   592 raft_consensus.cc:359] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P 371b5d0b1c9e48c79defeea5005327a6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:11.082297   592 raft_consensus.cc:740] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P 371b5d0b1c9e48c79defeea5005327a6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b5d0b1c9e48c79defeea5005327a6, State: Initialized, Role: FOLLOWER
I20260709 13:14:11.082824   592 consensus_queue.cc:260] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P 371b5d0b1c9e48c79defeea5005327a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:11.084182   592 ts_tablet_manager.cc:1434] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P 371b5d0b1c9e48c79defeea5005327a6: Time spent starting tablet: real 0.004s	user 0.002s	sys 0.002s
I20260709 13:14:11.085011   592 tablet_bootstrap.cc:492] T 6e71f9f26bcf449388fdf26ab44b79da P 371b5d0b1c9e48c79defeea5005327a6: Bootstrap starting.
I20260709 13:14:11.097405   592 tablet_bootstrap.cc:492] T 6e71f9f26bcf449388fdf26ab44b79da P 371b5d0b1c9e48c79defeea5005327a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:11.098096   592 tablet_bootstrap.cc:492] T 6e71f9f26bcf449388fdf26ab44b79da P 371b5d0b1c9e48c79defeea5005327a6: Bootstrap complete.
I20260709 13:14:11.098604   592 ts_tablet_manager.cc:1403] T 6e71f9f26bcf449388fdf26ab44b79da P 371b5d0b1c9e48c79defeea5005327a6: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 13:14:11.100322   592 raft_consensus.cc:359] T 6e71f9f26bcf449388fdf26ab44b79da P 371b5d0b1c9e48c79defeea5005327a6 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:11.100785   592 raft_consensus.cc:740] T 6e71f9f26bcf449388fdf26ab44b79da P 371b5d0b1c9e48c79defeea5005327a6 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b5d0b1c9e48c79defeea5005327a6, State: Initialized, Role: FOLLOWER
I20260709 13:14:11.101231   592 consensus_queue.cc:260] T 6e71f9f26bcf449388fdf26ab44b79da P 371b5d0b1c9e48c79defeea5005327a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:11.102972   592 ts_tablet_manager.cc:1434] T 6e71f9f26bcf449388fdf26ab44b79da P 371b5d0b1c9e48c79defeea5005327a6: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:14:11.124078   629 raft_consensus.cc:1240] T 6e71f9f26bcf449388fdf26ab44b79da P 371b5d0b1c9e48c79defeea5005327a6 [term 2 FOLLOWER]: Rejecting Update request from peer c3db9c6332ea4354b25af20b8d98cde9 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:14:11.125442   576 consensus_queue.cc:1059] T 6e71f9f26bcf449388fdf26ab44b79da P c3db9c6332ea4354b25af20b8d98cde9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:11.126925   576 raft_consensus.cc:3055] T 6e71f9f26bcf449388fdf26ab44b79da P c3db9c6332ea4354b25af20b8d98cde9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:11.127153   576 raft_consensus.cc:740] T 6e71f9f26bcf449388fdf26ab44b79da P c3db9c6332ea4354b25af20b8d98cde9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c3db9c6332ea4354b25af20b8d98cde9, State: Running, Role: LEADER
I20260709 13:14:11.127771   576 consensus_queue.cc:260] T 6e71f9f26bcf449388fdf26ab44b79da P c3db9c6332ea4354b25af20b8d98cde9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:11.128706   576 raft_consensus.cc:3060] T 6e71f9f26bcf449388fdf26ab44b79da P c3db9c6332ea4354b25af20b8d98cde9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:11.133255   667 raft_consensus.cc:993] T c97f937160cf4068a000607700371c56 P c3db9c6332ea4354b25af20b8d98cde9: : Instructing follower ccb5d7de9811449d8105001cb43ac775 to start an election
I20260709 13:14:11.133922   668 raft_consensus.cc:1081] T c97f937160cf4068a000607700371c56 P c3db9c6332ea4354b25af20b8d98cde9 [term 1 LEADER]: Signalling peer ccb5d7de9811449d8105001cb43ac775 to start an election
I20260709 13:14:11.135906   427 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c97f937160cf4068a000607700371c56"
dest_uuid: "ccb5d7de9811449d8105001cb43ac775"
 from {username='slave'} at 127.0.0.1:49860
I20260709 13:14:11.136449   427 raft_consensus.cc:493] T c97f937160cf4068a000607700371c56 P ccb5d7de9811449d8105001cb43ac775 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:11.136781   427 raft_consensus.cc:3060] T c97f937160cf4068a000607700371c56 P ccb5d7de9811449d8105001cb43ac775 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:11.141278   427 raft_consensus.cc:515] T c97f937160cf4068a000607700371c56 P ccb5d7de9811449d8105001cb43ac775 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:11.142870   427 leader_election.cc:290] T c97f937160cf4068a000607700371c56 P ccb5d7de9811449d8105001cb43ac775 [CANDIDATE]: Term 2 election: Requested vote from peers 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633), c3db9c6332ea4354b25af20b8d98cde9 (127.23.140.66:38883)
I20260709 13:14:11.143878   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f937160cf4068a000607700371c56" candidate_uuid: "ccb5d7de9811449d8105001cb43ac775" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "371b5d0b1c9e48c79defeea5005327a6"
I20260709 13:14:11.143944   354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f937160cf4068a000607700371c56" candidate_uuid: "ccb5d7de9811449d8105001cb43ac775" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c3db9c6332ea4354b25af20b8d98cde9"
I20260709 13:14:11.144752   629 raft_consensus.cc:3060] T c97f937160cf4068a000607700371c56 P 371b5d0b1c9e48c79defeea5005327a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:11.144784   354 raft_consensus.cc:3055] T c97f937160cf4068a000607700371c56 P c3db9c6332ea4354b25af20b8d98cde9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:11.145310   354 raft_consensus.cc:740] T c97f937160cf4068a000607700371c56 P c3db9c6332ea4354b25af20b8d98cde9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c3db9c6332ea4354b25af20b8d98cde9, State: Running, Role: LEADER
I20260709 13:14:11.146257   354 consensus_queue.cc:260] T c97f937160cf4068a000607700371c56 P c3db9c6332ea4354b25af20b8d98cde9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:11.147660   354 raft_consensus.cc:3060] T c97f937160cf4068a000607700371c56 P c3db9c6332ea4354b25af20b8d98cde9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:11.153366   629 raft_consensus.cc:2468] T c97f937160cf4068a000607700371c56 P 371b5d0b1c9e48c79defeea5005327a6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccb5d7de9811449d8105001cb43ac775 in term 2.
I20260709 13:14:11.154953   391 leader_election.cc:304] T c97f937160cf4068a000607700371c56 P ccb5d7de9811449d8105001cb43ac775 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b5d0b1c9e48c79defeea5005327a6, ccb5d7de9811449d8105001cb43ac775; no voters: 
I20260709 13:14:11.155539   354 raft_consensus.cc:2468] T c97f937160cf4068a000607700371c56 P c3db9c6332ea4354b25af20b8d98cde9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccb5d7de9811449d8105001cb43ac775 in term 2.
I20260709 13:14:11.155673   503 raft_consensus.cc:2804] T c97f937160cf4068a000607700371c56 P ccb5d7de9811449d8105001cb43ac775 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:11.157025   503 raft_consensus.cc:697] T c97f937160cf4068a000607700371c56 P ccb5d7de9811449d8105001cb43ac775 [term 2 LEADER]: Becoming Leader. State: Replica: ccb5d7de9811449d8105001cb43ac775, State: Running, Role: LEADER
I20260709 13:14:11.158028   503 consensus_queue.cc:237] T c97f937160cf4068a000607700371c56 P ccb5d7de9811449d8105001cb43ac775 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:11.166262 32645 catalog_manager.cc:5697] T c97f937160cf4068a000607700371c56 P ccb5d7de9811449d8105001cb43ac775 reported cstate change: term changed from 1 to 2, leader changed from c3db9c6332ea4354b25af20b8d98cde9 (127.23.140.66) to ccb5d7de9811449d8105001cb43ac775 (127.23.140.67). New cstate: current_term: 2 leader_uuid: "ccb5d7de9811449d8105001cb43ac775" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:11.297005   629 raft_consensus.cc:3060] T 4fdcc1f9d3d34a1480606d325fe3616f P 371b5d0b1c9e48c79defeea5005327a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:11.308171   576 raft_consensus.cc:993] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9: : Instructing follower ccb5d7de9811449d8105001cb43ac775 to start an election
I20260709 13:14:11.308681   668 raft_consensus.cc:1081] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9 [term 2 LEADER]: Signalling peer ccb5d7de9811449d8105001cb43ac775 to start an election
I20260709 13:14:11.310215   427 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4fdcc1f9d3d34a1480606d325fe3616f"
dest_uuid: "ccb5d7de9811449d8105001cb43ac775"
 from {username='slave'} at 127.0.0.1:49860
I20260709 13:14:11.310669   427 raft_consensus.cc:493] T 4fdcc1f9d3d34a1480606d325fe3616f P ccb5d7de9811449d8105001cb43ac775 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:11.310948   427 raft_consensus.cc:3060] T 4fdcc1f9d3d34a1480606d325fe3616f P ccb5d7de9811449d8105001cb43ac775 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:11.315555   427 raft_consensus.cc:515] T 4fdcc1f9d3d34a1480606d325fe3616f P ccb5d7de9811449d8105001cb43ac775 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:11.317050   427 leader_election.cc:290] T 4fdcc1f9d3d34a1480606d325fe3616f P ccb5d7de9811449d8105001cb43ac775 [CANDIDATE]: Term 3 election: Requested vote from peers 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633), c3db9c6332ea4354b25af20b8d98cde9 (127.23.140.66:38883)
I20260709 13:14:11.317790   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fdcc1f9d3d34a1480606d325fe3616f" candidate_uuid: "ccb5d7de9811449d8105001cb43ac775" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "371b5d0b1c9e48c79defeea5005327a6"
I20260709 13:14:11.318082   354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fdcc1f9d3d34a1480606d325fe3616f" candidate_uuid: "ccb5d7de9811449d8105001cb43ac775" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c3db9c6332ea4354b25af20b8d98cde9"
I20260709 13:14:11.318344   629 raft_consensus.cc:3060] T 4fdcc1f9d3d34a1480606d325fe3616f P 371b5d0b1c9e48c79defeea5005327a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:11.318696   354 raft_consensus.cc:3055] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:11.319010   354 raft_consensus.cc:740] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c3db9c6332ea4354b25af20b8d98cde9, State: Running, Role: LEADER
I20260709 13:14:11.319804   354 consensus_queue.cc:260] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:11.320791   354 raft_consensus.cc:3060] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:11.323686   629 raft_consensus.cc:2468] T 4fdcc1f9d3d34a1480606d325fe3616f P 371b5d0b1c9e48c79defeea5005327a6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccb5d7de9811449d8105001cb43ac775 in term 3.
I20260709 13:14:11.324677   391 leader_election.cc:304] T 4fdcc1f9d3d34a1480606d325fe3616f P ccb5d7de9811449d8105001cb43ac775 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b5d0b1c9e48c79defeea5005327a6, ccb5d7de9811449d8105001cb43ac775; no voters: 
I20260709 13:14:11.325260   503 raft_consensus.cc:2804] T 4fdcc1f9d3d34a1480606d325fe3616f P ccb5d7de9811449d8105001cb43ac775 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:11.325766   503 raft_consensus.cc:697] T 4fdcc1f9d3d34a1480606d325fe3616f P ccb5d7de9811449d8105001cb43ac775 [term 3 LEADER]: Becoming Leader. State: Replica: ccb5d7de9811449d8105001cb43ac775, State: Running, Role: LEADER
I20260709 13:14:11.326522   503 consensus_queue.cc:237] T 4fdcc1f9d3d34a1480606d325fe3616f P ccb5d7de9811449d8105001cb43ac775 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:11.325740   354 raft_consensus.cc:2468] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccb5d7de9811449d8105001cb43ac775 in term 3.
I20260709 13:14:11.333302 32645 catalog_manager.cc:5697] T 4fdcc1f9d3d34a1480606d325fe3616f P ccb5d7de9811449d8105001cb43ac775 reported cstate change: term changed from 2 to 3, leader changed from c3db9c6332ea4354b25af20b8d98cde9 (127.23.140.66) to ccb5d7de9811449d8105001cb43ac775 (127.23.140.67). New cstate: current_term: 3 leader_uuid: "ccb5d7de9811449d8105001cb43ac775" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:11.425449   629 raft_consensus.cc:3060] T 31972c45882a4ef1bd838a1790d929b4 P 371b5d0b1c9e48c79defeea5005327a6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:14:11.605615 32693 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:14:11.698740   629 raft_consensus.cc:1275] T c97f937160cf4068a000607700371c56 P 371b5d0b1c9e48c79defeea5005327a6 [term 2 FOLLOWER]: Refusing update from remote peer ccb5d7de9811449d8105001cb43ac775: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:11.700165   669 consensus_queue.cc:1048] T c97f937160cf4068a000607700371c56 P ccb5d7de9811449d8105001cb43ac775 [LEADER]: Connected to new peer: Peer: permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:11.709281   354 raft_consensus.cc:1275] T c97f937160cf4068a000607700371c56 P c3db9c6332ea4354b25af20b8d98cde9 [term 2 FOLLOWER]: Refusing update from remote peer ccb5d7de9811449d8105001cb43ac775: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:11.710868   503 consensus_queue.cc:1048] T c97f937160cf4068a000607700371c56 P ccb5d7de9811449d8105001cb43ac775 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:11.730821   354 raft_consensus.cc:1275] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9 [term 3 FOLLOWER]: Refusing update from remote peer ccb5d7de9811449d8105001cb43ac775: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:11.731915   503 consensus_queue.cc:1048] T 4fdcc1f9d3d34a1480606d325fe3616f P ccb5d7de9811449d8105001cb43ac775 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:11.740134   629 raft_consensus.cc:1275] T 4fdcc1f9d3d34a1480606d325fe3616f P 371b5d0b1c9e48c79defeea5005327a6 [term 3 FOLLOWER]: Refusing update from remote peer ccb5d7de9811449d8105001cb43ac775: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:11.742643   669 consensus_queue.cc:1048] T 4fdcc1f9d3d34a1480606d325fe3616f P ccb5d7de9811449d8105001cb43ac775 [LEADER]: Connected to new peer: Peer: permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:12.051241 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:12.059166   354 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2af3bf69a6b44d8b9ad324f545ddf5d5"
dest_uuid: "c3db9c6332ea4354b25af20b8d98cde9"
mode: GRACEFUL
new_leader_uuid: "ccb5d7de9811449d8105001cb43ac775"
 from {username='slave'} at 127.0.0.1:60036
I20260709 13:14:12.059760   354 raft_consensus.cc:606] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P c3db9c6332ea4354b25af20b8d98cde9 [term 1 LEADER]: Received request to transfer leadership to TS ccb5d7de9811449d8105001cb43ac775
I20260709 13:14:12.071363   427 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "58c124bee20f4d039daa8d54154c0616"
dest_uuid: "ccb5d7de9811449d8105001cb43ac775"
mode: GRACEFUL
new_leader_uuid: "c3db9c6332ea4354b25af20b8d98cde9"
 from {username='slave'} at 127.0.0.1:44688
I20260709 13:14:12.071862   427 raft_consensus.cc:606] T 58c124bee20f4d039daa8d54154c0616 P ccb5d7de9811449d8105001cb43ac775 [term 1 LEADER]: Received request to transfer leadership to TS c3db9c6332ea4354b25af20b8d98cde9
I20260709 13:14:12.073038 24113 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:14:12.073516 24113 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:12.074128 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:12.249387   690 raft_consensus.cc:493] T 6e71f9f26bcf449388fdf26ab44b79da P 371b5d0b1c9e48c79defeea5005327a6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.249977   690 raft_consensus.cc:515] T 6e71f9f26bcf449388fdf26ab44b79da P 371b5d0b1c9e48c79defeea5005327a6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:12.252020   690 leader_election.cc:290] T 6e71f9f26bcf449388fdf26ab44b79da P 371b5d0b1c9e48c79defeea5005327a6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c3db9c6332ea4354b25af20b8d98cde9 (127.23.140.66:38883), ccb5d7de9811449d8105001cb43ac775 (127.23.140.67:39377)
I20260709 13:14:12.264047   427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e71f9f26bcf449388fdf26ab44b79da" candidate_uuid: "371b5d0b1c9e48c79defeea5005327a6" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb5d7de9811449d8105001cb43ac775" is_pre_election: true
I20260709 13:14:12.264297   354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e71f9f26bcf449388fdf26ab44b79da" candidate_uuid: "371b5d0b1c9e48c79defeea5005327a6" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3db9c6332ea4354b25af20b8d98cde9" is_pre_election: true
I20260709 13:14:12.265121   354 raft_consensus.cc:2410] T 6e71f9f26bcf449388fdf26ab44b79da P c3db9c6332ea4354b25af20b8d98cde9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 371b5d0b1c9e48c79defeea5005327a6 for term 3 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 13:14:12.266120   589 leader_election.cc:304] T 6e71f9f26bcf449388fdf26ab44b79da P 371b5d0b1c9e48c79defeea5005327a6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 371b5d0b1c9e48c79defeea5005327a6; no voters: c3db9c6332ea4354b25af20b8d98cde9, ccb5d7de9811449d8105001cb43ac775
I20260709 13:14:12.266799   690 raft_consensus.cc:2749] T 6e71f9f26bcf449388fdf26ab44b79da P 371b5d0b1c9e48c79defeea5005327a6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:12.325290   667 raft_consensus.cc:993] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P c3db9c6332ea4354b25af20b8d98cde9: : Instructing follower ccb5d7de9811449d8105001cb43ac775 to start an election
I20260709 13:14:12.325942   668 raft_consensus.cc:1081] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P c3db9c6332ea4354b25af20b8d98cde9 [term 1 LEADER]: Signalling peer ccb5d7de9811449d8105001cb43ac775 to start an election
I20260709 13:14:12.327314   427 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2af3bf69a6b44d8b9ad324f545ddf5d5"
dest_uuid: "ccb5d7de9811449d8105001cb43ac775"
 from {username='slave'} at 127.0.0.1:49860
I20260709 13:14:12.327701   427 raft_consensus.cc:493] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P ccb5d7de9811449d8105001cb43ac775 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:12.327943   427 raft_consensus.cc:3060] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P ccb5d7de9811449d8105001cb43ac775 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:12.333693   427 raft_consensus.cc:515] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P ccb5d7de9811449d8105001cb43ac775 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:12.335697   427 leader_election.cc:290] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P ccb5d7de9811449d8105001cb43ac775 [CANDIDATE]: Term 2 election: Requested vote from peers 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633), c3db9c6332ea4354b25af20b8d98cde9 (127.23.140.66:38883)
I20260709 13:14:12.335893   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af3bf69a6b44d8b9ad324f545ddf5d5" candidate_uuid: "ccb5d7de9811449d8105001cb43ac775" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "371b5d0b1c9e48c79defeea5005327a6"
I20260709 13:14:12.336222   354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af3bf69a6b44d8b9ad324f545ddf5d5" candidate_uuid: "ccb5d7de9811449d8105001cb43ac775" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c3db9c6332ea4354b25af20b8d98cde9"
I20260709 13:14:12.336577   629 raft_consensus.cc:3060] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P 371b5d0b1c9e48c79defeea5005327a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:12.336933   354 raft_consensus.cc:3055] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P c3db9c6332ea4354b25af20b8d98cde9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:12.337240   354 raft_consensus.cc:740] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P c3db9c6332ea4354b25af20b8d98cde9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c3db9c6332ea4354b25af20b8d98cde9, State: Running, Role: LEADER
I20260709 13:14:12.337956   354 consensus_queue.cc:260] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P c3db9c6332ea4354b25af20b8d98cde9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:12.338900   354 raft_consensus.cc:3060] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P c3db9c6332ea4354b25af20b8d98cde9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:12.341843   629 raft_consensus.cc:2468] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P 371b5d0b1c9e48c79defeea5005327a6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccb5d7de9811449d8105001cb43ac775 in term 2.
I20260709 13:14:12.342949   391 leader_election.cc:304] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P ccb5d7de9811449d8105001cb43ac775 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b5d0b1c9e48c79defeea5005327a6, ccb5d7de9811449d8105001cb43ac775; no voters: 
I20260709 13:14:12.343658   669 raft_consensus.cc:2804] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P ccb5d7de9811449d8105001cb43ac775 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:12.344055   669 raft_consensus.cc:697] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P ccb5d7de9811449d8105001cb43ac775 [term 2 LEADER]: Becoming Leader. State: Replica: ccb5d7de9811449d8105001cb43ac775, State: Running, Role: LEADER
I20260709 13:14:12.344812   354 raft_consensus.cc:2468] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P c3db9c6332ea4354b25af20b8d98cde9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccb5d7de9811449d8105001cb43ac775 in term 2.
I20260709 13:14:12.344852   669 consensus_queue.cc:237] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P ccb5d7de9811449d8105001cb43ac775 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:12.351814 32645 catalog_manager.cc:5697] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P ccb5d7de9811449d8105001cb43ac775 reported cstate change: term changed from 1 to 2, leader changed from c3db9c6332ea4354b25af20b8d98cde9 (127.23.140.66) to ccb5d7de9811449d8105001cb43ac775 (127.23.140.67). New cstate: current_term: 2 leader_uuid: "ccb5d7de9811449d8105001cb43ac775" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:12.417807   669 raft_consensus.cc:493] T 6e71f9f26bcf449388fdf26ab44b79da P ccb5d7de9811449d8105001cb43ac775 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c3db9c6332ea4354b25af20b8d98cde9)
I20260709 13:14:12.418417   669 raft_consensus.cc:515] T 6e71f9f26bcf449388fdf26ab44b79da P ccb5d7de9811449d8105001cb43ac775 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:12.420267   669 leader_election.cc:290] T 6e71f9f26bcf449388fdf26ab44b79da P ccb5d7de9811449d8105001cb43ac775 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633), c3db9c6332ea4354b25af20b8d98cde9 (127.23.140.66:38883)
I20260709 13:14:12.421427   354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e71f9f26bcf449388fdf26ab44b79da" candidate_uuid: "ccb5d7de9811449d8105001cb43ac775" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c3db9c6332ea4354b25af20b8d98cde9" is_pre_election: true
I20260709 13:14:12.421705   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e71f9f26bcf449388fdf26ab44b79da" candidate_uuid: "ccb5d7de9811449d8105001cb43ac775" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "371b5d0b1c9e48c79defeea5005327a6" is_pre_election: true
I20260709 13:14:12.422209   354 raft_consensus.cc:2468] T 6e71f9f26bcf449388fdf26ab44b79da P c3db9c6332ea4354b25af20b8d98cde9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccb5d7de9811449d8105001cb43ac775 in term 2.
I20260709 13:14:12.422489   629 raft_consensus.cc:2393] T 6e71f9f26bcf449388fdf26ab44b79da P 371b5d0b1c9e48c79defeea5005327a6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccb5d7de9811449d8105001cb43ac775 in current term 2: Already voted for candidate 371b5d0b1c9e48c79defeea5005327a6 in this term.
I20260709 13:14:12.423403   394 leader_election.cc:304] T 6e71f9f26bcf449388fdf26ab44b79da P ccb5d7de9811449d8105001cb43ac775 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3db9c6332ea4354b25af20b8d98cde9, ccb5d7de9811449d8105001cb43ac775; no voters: 
I20260709 13:14:12.424137   669 raft_consensus.cc:2804] T 6e71f9f26bcf449388fdf26ab44b79da P ccb5d7de9811449d8105001cb43ac775 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:12.424516   669 raft_consensus.cc:493] T 6e71f9f26bcf449388fdf26ab44b79da P ccb5d7de9811449d8105001cb43ac775 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c3db9c6332ea4354b25af20b8d98cde9)
I20260709 13:14:12.424852   669 raft_consensus.cc:3060] T 6e71f9f26bcf449388fdf26ab44b79da P ccb5d7de9811449d8105001cb43ac775 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:12.430694   669 raft_consensus.cc:515] T 6e71f9f26bcf449388fdf26ab44b79da P ccb5d7de9811449d8105001cb43ac775 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:12.432368   669 leader_election.cc:290] T 6e71f9f26bcf449388fdf26ab44b79da P ccb5d7de9811449d8105001cb43ac775 [CANDIDATE]: Term 2 election: Requested vote from peers 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633), c3db9c6332ea4354b25af20b8d98cde9 (127.23.140.66:38883)
I20260709 13:14:12.433045   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e71f9f26bcf449388fdf26ab44b79da" candidate_uuid: "ccb5d7de9811449d8105001cb43ac775" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "371b5d0b1c9e48c79defeea5005327a6"
I20260709 13:14:12.433288   354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e71f9f26bcf449388fdf26ab44b79da" candidate_uuid: "ccb5d7de9811449d8105001cb43ac775" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c3db9c6332ea4354b25af20b8d98cde9"
I20260709 13:14:12.433724   629 raft_consensus.cc:2393] T 6e71f9f26bcf449388fdf26ab44b79da P 371b5d0b1c9e48c79defeea5005327a6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ccb5d7de9811449d8105001cb43ac775 in current term 2: Already voted for candidate 371b5d0b1c9e48c79defeea5005327a6 in this term.
I20260709 13:14:12.438659   354 raft_consensus.cc:2468] T 6e71f9f26bcf449388fdf26ab44b79da P c3db9c6332ea4354b25af20b8d98cde9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccb5d7de9811449d8105001cb43ac775 in term 2.
I20260709 13:14:12.439652   394 leader_election.cc:304] T 6e71f9f26bcf449388fdf26ab44b79da P ccb5d7de9811449d8105001cb43ac775 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c3db9c6332ea4354b25af20b8d98cde9, ccb5d7de9811449d8105001cb43ac775; no voters: 371b5d0b1c9e48c79defeea5005327a6
I20260709 13:14:12.440303   669 raft_consensus.cc:2804] T 6e71f9f26bcf449388fdf26ab44b79da P ccb5d7de9811449d8105001cb43ac775 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:12.440719   669 raft_consensus.cc:697] T 6e71f9f26bcf449388fdf26ab44b79da P ccb5d7de9811449d8105001cb43ac775 [term 2 LEADER]: Becoming Leader. State: Replica: ccb5d7de9811449d8105001cb43ac775, State: Running, Role: LEADER
I20260709 13:14:12.441491   669 consensus_queue.cc:237] T 6e71f9f26bcf449388fdf26ab44b79da P ccb5d7de9811449d8105001cb43ac775 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:12.447858 32645 catalog_manager.cc:5697] T 6e71f9f26bcf449388fdf26ab44b79da P ccb5d7de9811449d8105001cb43ac775 reported cstate change: term changed from 1 to 2, leader changed from c3db9c6332ea4354b25af20b8d98cde9 (127.23.140.66) to ccb5d7de9811449d8105001cb43ac775 (127.23.140.67). New cstate: current_term: 2 leader_uuid: "ccb5d7de9811449d8105001cb43ac775" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:12.535373   682 raft_consensus.cc:993] T 58c124bee20f4d039daa8d54154c0616 P ccb5d7de9811449d8105001cb43ac775: : Instructing follower c3db9c6332ea4354b25af20b8d98cde9 to start an election
I20260709 13:14:12.535914   682 raft_consensus.cc:1081] T 58c124bee20f4d039daa8d54154c0616 P ccb5d7de9811449d8105001cb43ac775 [term 1 LEADER]: Signalling peer c3db9c6332ea4354b25af20b8d98cde9 to start an election
I20260709 13:14:12.537348   354 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "58c124bee20f4d039daa8d54154c0616"
dest_uuid: "c3db9c6332ea4354b25af20b8d98cde9"
 from {username='slave'} at 127.0.0.1:45684
I20260709 13:14:12.537878   354 raft_consensus.cc:493] T 58c124bee20f4d039daa8d54154c0616 P c3db9c6332ea4354b25af20b8d98cde9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:12.538182   354 raft_consensus.cc:3060] T 58c124bee20f4d039daa8d54154c0616 P c3db9c6332ea4354b25af20b8d98cde9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:12.543278   354 raft_consensus.cc:515] T 58c124bee20f4d039daa8d54154c0616 P c3db9c6332ea4354b25af20b8d98cde9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:12.544822   354 leader_election.cc:290] T 58c124bee20f4d039daa8d54154c0616 P c3db9c6332ea4354b25af20b8d98cde9 [CANDIDATE]: Term 2 election: Requested vote from peers 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633), ccb5d7de9811449d8105001cb43ac775 (127.23.140.67:39377)
I20260709 13:14:12.545857   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c124bee20f4d039daa8d54154c0616" candidate_uuid: "c3db9c6332ea4354b25af20b8d98cde9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "371b5d0b1c9e48c79defeea5005327a6"
I20260709 13:14:12.546017   427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c124bee20f4d039daa8d54154c0616" candidate_uuid: "c3db9c6332ea4354b25af20b8d98cde9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ccb5d7de9811449d8105001cb43ac775"
I20260709 13:14:12.546420   629 raft_consensus.cc:3060] T 58c124bee20f4d039daa8d54154c0616 P 371b5d0b1c9e48c79defeea5005327a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:12.546592   427 raft_consensus.cc:3055] T 58c124bee20f4d039daa8d54154c0616 P ccb5d7de9811449d8105001cb43ac775 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:12.547024   427 raft_consensus.cc:740] T 58c124bee20f4d039daa8d54154c0616 P ccb5d7de9811449d8105001cb43ac775 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ccb5d7de9811449d8105001cb43ac775, State: Running, Role: LEADER
I20260709 13:14:12.547742   427 consensus_queue.cc:260] T 58c124bee20f4d039daa8d54154c0616 P ccb5d7de9811449d8105001cb43ac775 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:12.548599   427 raft_consensus.cc:3060] T 58c124bee20f4d039daa8d54154c0616 P ccb5d7de9811449d8105001cb43ac775 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:12.551510   629 raft_consensus.cc:2468] T 58c124bee20f4d039daa8d54154c0616 P 371b5d0b1c9e48c79defeea5005327a6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3db9c6332ea4354b25af20b8d98cde9 in term 2.
I20260709 13:14:12.552659   317 leader_election.cc:304] T 58c124bee20f4d039daa8d54154c0616 P c3db9c6332ea4354b25af20b8d98cde9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b5d0b1c9e48c79defeea5005327a6, c3db9c6332ea4354b25af20b8d98cde9; no voters: 
I20260709 13:14:12.553280   427 raft_consensus.cc:2468] T 58c124bee20f4d039daa8d54154c0616 P ccb5d7de9811449d8105001cb43ac775 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3db9c6332ea4354b25af20b8d98cde9 in term 2.
I20260709 13:14:12.553597   668 raft_consensus.cc:2804] T 58c124bee20f4d039daa8d54154c0616 P c3db9c6332ea4354b25af20b8d98cde9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:12.554183   668 raft_consensus.cc:697] T 58c124bee20f4d039daa8d54154c0616 P c3db9c6332ea4354b25af20b8d98cde9 [term 2 LEADER]: Becoming Leader. State: Replica: c3db9c6332ea4354b25af20b8d98cde9, State: Running, Role: LEADER
I20260709 13:14:12.555017   668 consensus_queue.cc:237] T 58c124bee20f4d039daa8d54154c0616 P c3db9c6332ea4354b25af20b8d98cde9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:12.562016 32645 catalog_manager.cc:5697] T 58c124bee20f4d039daa8d54154c0616 P c3db9c6332ea4354b25af20b8d98cde9 reported cstate change: term changed from 1 to 2, leader changed from ccb5d7de9811449d8105001cb43ac775 (127.23.140.67) to c3db9c6332ea4354b25af20b8d98cde9 (127.23.140.66). New cstate: current_term: 2 leader_uuid: "c3db9c6332ea4354b25af20b8d98cde9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:12.606652 32693 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:14:12.776481   629 raft_consensus.cc:1275] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P 371b5d0b1c9e48c79defeea5005327a6 [term 2 FOLLOWER]: Refusing update from remote peer ccb5d7de9811449d8105001cb43ac775: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:12.777741   682 consensus_queue.cc:1048] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P ccb5d7de9811449d8105001cb43ac775 [LEADER]: Connected to new peer: Peer: permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:12.789180   354 raft_consensus.cc:1275] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P c3db9c6332ea4354b25af20b8d98cde9 [term 2 FOLLOWER]: Refusing update from remote peer ccb5d7de9811449d8105001cb43ac775: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:12.791070   669 consensus_queue.cc:1048] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P ccb5d7de9811449d8105001cb43ac775 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:12.928287   628 raft_consensus.cc:1275] T 6e71f9f26bcf449388fdf26ab44b79da P 371b5d0b1c9e48c79defeea5005327a6 [term 2 FOLLOWER]: Refusing update from remote peer ccb5d7de9811449d8105001cb43ac775: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:12.929769   682 consensus_queue.cc:1048] T 6e71f9f26bcf449388fdf26ab44b79da P ccb5d7de9811449d8105001cb43ac775 [LEADER]: Connected to new peer: Peer: permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:12.936312   427 raft_consensus.cc:1275] T 58c124bee20f4d039daa8d54154c0616 P ccb5d7de9811449d8105001cb43ac775 [term 2 FOLLOWER]: Refusing update from remote peer c3db9c6332ea4354b25af20b8d98cde9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:12.938297   668 consensus_queue.cc:1048] T 58c124bee20f4d039daa8d54154c0616 P c3db9c6332ea4354b25af20b8d98cde9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:12.940388   354 raft_consensus.cc:1275] T 6e71f9f26bcf449388fdf26ab44b79da P c3db9c6332ea4354b25af20b8d98cde9 [term 2 FOLLOWER]: Refusing update from remote peer ccb5d7de9811449d8105001cb43ac775: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:12.942328   682 consensus_queue.cc:1048] T 6e71f9f26bcf449388fdf26ab44b79da P ccb5d7de9811449d8105001cb43ac775 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:12.952955   628 raft_consensus.cc:1275] T 58c124bee20f4d039daa8d54154c0616 P 371b5d0b1c9e48c79defeea5005327a6 [term 2 FOLLOWER]: Refusing update from remote peer c3db9c6332ea4354b25af20b8d98cde9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:12.954320   710 consensus_queue.cc:1048] T 58c124bee20f4d039daa8d54154c0616 P c3db9c6332ea4354b25af20b8d98cde9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:13.082919 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:13.089708   427 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "42473b265d0f476b928fdcbe60fd318b"
dest_uuid: "ccb5d7de9811449d8105001cb43ac775"
mode: GRACEFUL
new_leader_uuid: "c3db9c6332ea4354b25af20b8d98cde9"
 from {username='slave'} at 127.0.0.1:44688
I20260709 13:14:13.090283   427 raft_consensus.cc:606] T 42473b265d0f476b928fdcbe60fd318b P ccb5d7de9811449d8105001cb43ac775 [term 1 LEADER]: Received request to transfer leadership to TS c3db9c6332ea4354b25af20b8d98cde9
I20260709 13:14:13.092495   427 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c97f937160cf4068a000607700371c56"
dest_uuid: "ccb5d7de9811449d8105001cb43ac775"
mode: GRACEFUL
new_leader_uuid: "c3db9c6332ea4354b25af20b8d98cde9"
 from {username='slave'} at 127.0.0.1:44688
I20260709 13:14:13.092965   427 raft_consensus.cc:606] T c97f937160cf4068a000607700371c56 P ccb5d7de9811449d8105001cb43ac775 [term 2 LEADER]: Received request to transfer leadership to TS c3db9c6332ea4354b25af20b8d98cde9
I20260709 13:14:13.093976 24113 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:14:13.094399 24113 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:13.094916 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:13.106550   682 raft_consensus.cc:993] T c97f937160cf4068a000607700371c56 P ccb5d7de9811449d8105001cb43ac775: : Instructing follower c3db9c6332ea4354b25af20b8d98cde9 to start an election
I20260709 13:14:13.107137   669 raft_consensus.cc:1081] T c97f937160cf4068a000607700371c56 P ccb5d7de9811449d8105001cb43ac775 [term 2 LEADER]: Signalling peer c3db9c6332ea4354b25af20b8d98cde9 to start an election
I20260709 13:14:13.108619   353 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c97f937160cf4068a000607700371c56"
dest_uuid: "c3db9c6332ea4354b25af20b8d98cde9"
 from {username='slave'} at 127.0.0.1:45684
I20260709 13:14:13.109136   353 raft_consensus.cc:493] T c97f937160cf4068a000607700371c56 P c3db9c6332ea4354b25af20b8d98cde9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:13.109457   353 raft_consensus.cc:3060] T c97f937160cf4068a000607700371c56 P c3db9c6332ea4354b25af20b8d98cde9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:13.114768   353 raft_consensus.cc:515] T c97f937160cf4068a000607700371c56 P c3db9c6332ea4354b25af20b8d98cde9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:13.116518   353 leader_election.cc:290] T c97f937160cf4068a000607700371c56 P c3db9c6332ea4354b25af20b8d98cde9 [CANDIDATE]: Term 3 election: Requested vote from peers 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633), ccb5d7de9811449d8105001cb43ac775 (127.23.140.67:39377)
I20260709 13:14:13.117342   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f937160cf4068a000607700371c56" candidate_uuid: "c3db9c6332ea4354b25af20b8d98cde9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "371b5d0b1c9e48c79defeea5005327a6"
I20260709 13:14:13.117527   427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f937160cf4068a000607700371c56" candidate_uuid: "c3db9c6332ea4354b25af20b8d98cde9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ccb5d7de9811449d8105001cb43ac775"
I20260709 13:14:13.117986   628 raft_consensus.cc:3060] T c97f937160cf4068a000607700371c56 P 371b5d0b1c9e48c79defeea5005327a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:13.118096   427 raft_consensus.cc:3055] T c97f937160cf4068a000607700371c56 P ccb5d7de9811449d8105001cb43ac775 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:13.118489   427 raft_consensus.cc:740] T c97f937160cf4068a000607700371c56 P ccb5d7de9811449d8105001cb43ac775 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ccb5d7de9811449d8105001cb43ac775, State: Running, Role: LEADER
I20260709 13:14:13.119109   427 consensus_queue.cc:260] T c97f937160cf4068a000607700371c56 P ccb5d7de9811449d8105001cb43ac775 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:13.120045   427 raft_consensus.cc:3060] T c97f937160cf4068a000607700371c56 P ccb5d7de9811449d8105001cb43ac775 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:13.123190   628 raft_consensus.cc:2468] T c97f937160cf4068a000607700371c56 P 371b5d0b1c9e48c79defeea5005327a6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3db9c6332ea4354b25af20b8d98cde9 in term 3.
I20260709 13:14:13.124218   317 leader_election.cc:304] T c97f937160cf4068a000607700371c56 P c3db9c6332ea4354b25af20b8d98cde9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b5d0b1c9e48c79defeea5005327a6, c3db9c6332ea4354b25af20b8d98cde9; no voters: 
I20260709 13:14:13.124481   427 raft_consensus.cc:2468] T c97f937160cf4068a000607700371c56 P ccb5d7de9811449d8105001cb43ac775 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3db9c6332ea4354b25af20b8d98cde9 in term 3.
I20260709 13:14:13.125015   710 raft_consensus.cc:2804] T c97f937160cf4068a000607700371c56 P c3db9c6332ea4354b25af20b8d98cde9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:13.125463   710 raft_consensus.cc:697] T c97f937160cf4068a000607700371c56 P c3db9c6332ea4354b25af20b8d98cde9 [term 3 LEADER]: Becoming Leader. State: Replica: c3db9c6332ea4354b25af20b8d98cde9, State: Running, Role: LEADER
I20260709 13:14:13.126153   710 consensus_queue.cc:237] T c97f937160cf4068a000607700371c56 P c3db9c6332ea4354b25af20b8d98cde9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:13.132632 32642 catalog_manager.cc:5697] T c97f937160cf4068a000607700371c56 P c3db9c6332ea4354b25af20b8d98cde9 reported cstate change: term changed from 2 to 3, leader changed from ccb5d7de9811449d8105001cb43ac775 (127.23.140.67) to c3db9c6332ea4354b25af20b8d98cde9 (127.23.140.66). New cstate: current_term: 3 leader_uuid: "c3db9c6332ea4354b25af20b8d98cde9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:13.334329   682 raft_consensus.cc:993] T 42473b265d0f476b928fdcbe60fd318b P ccb5d7de9811449d8105001cb43ac775: : Instructing follower c3db9c6332ea4354b25af20b8d98cde9 to start an election
I20260709 13:14:13.334800   669 raft_consensus.cc:1081] T 42473b265d0f476b928fdcbe60fd318b P ccb5d7de9811449d8105001cb43ac775 [term 1 LEADER]: Signalling peer c3db9c6332ea4354b25af20b8d98cde9 to start an election
I20260709 13:14:13.336328   353 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "42473b265d0f476b928fdcbe60fd318b"
dest_uuid: "c3db9c6332ea4354b25af20b8d98cde9"
 from {username='slave'} at 127.0.0.1:45684
I20260709 13:14:13.336827   353 raft_consensus.cc:493] T 42473b265d0f476b928fdcbe60fd318b P c3db9c6332ea4354b25af20b8d98cde9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:13.337141   353 raft_consensus.cc:3060] T 42473b265d0f476b928fdcbe60fd318b P c3db9c6332ea4354b25af20b8d98cde9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:13.342317   353 raft_consensus.cc:515] T 42473b265d0f476b928fdcbe60fd318b P c3db9c6332ea4354b25af20b8d98cde9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:13.343948   353 leader_election.cc:290] T 42473b265d0f476b928fdcbe60fd318b P c3db9c6332ea4354b25af20b8d98cde9 [CANDIDATE]: Term 2 election: Requested vote from peers 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633), ccb5d7de9811449d8105001cb43ac775 (127.23.140.67:39377)
I20260709 13:14:13.344722   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42473b265d0f476b928fdcbe60fd318b" candidate_uuid: "c3db9c6332ea4354b25af20b8d98cde9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "371b5d0b1c9e48c79defeea5005327a6"
I20260709 13:14:13.344970   427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42473b265d0f476b928fdcbe60fd318b" candidate_uuid: "c3db9c6332ea4354b25af20b8d98cde9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ccb5d7de9811449d8105001cb43ac775"
I20260709 13:14:13.345402   628 raft_consensus.cc:3060] T 42473b265d0f476b928fdcbe60fd318b P 371b5d0b1c9e48c79defeea5005327a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:13.345672   427 raft_consensus.cc:3055] T 42473b265d0f476b928fdcbe60fd318b P ccb5d7de9811449d8105001cb43ac775 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:13.346045   427 raft_consensus.cc:740] T 42473b265d0f476b928fdcbe60fd318b P ccb5d7de9811449d8105001cb43ac775 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ccb5d7de9811449d8105001cb43ac775, State: Running, Role: LEADER
I20260709 13:14:13.346794   427 consensus_queue.cc:260] T 42473b265d0f476b928fdcbe60fd318b P ccb5d7de9811449d8105001cb43ac775 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:13.347741   427 raft_consensus.cc:3060] T 42473b265d0f476b928fdcbe60fd318b P ccb5d7de9811449d8105001cb43ac775 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:13.350677   628 raft_consensus.cc:2468] T 42473b265d0f476b928fdcbe60fd318b P 371b5d0b1c9e48c79defeea5005327a6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3db9c6332ea4354b25af20b8d98cde9 in term 2.
I20260709 13:14:13.351838   317 leader_election.cc:304] T 42473b265d0f476b928fdcbe60fd318b P c3db9c6332ea4354b25af20b8d98cde9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b5d0b1c9e48c79defeea5005327a6, c3db9c6332ea4354b25af20b8d98cde9; no voters: 
I20260709 13:14:13.352262   427 raft_consensus.cc:2468] T 42473b265d0f476b928fdcbe60fd318b P ccb5d7de9811449d8105001cb43ac775 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3db9c6332ea4354b25af20b8d98cde9 in term 2.
I20260709 13:14:13.352511   710 raft_consensus.cc:2804] T 42473b265d0f476b928fdcbe60fd318b P c3db9c6332ea4354b25af20b8d98cde9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:13.353065   710 raft_consensus.cc:697] T 42473b265d0f476b928fdcbe60fd318b P c3db9c6332ea4354b25af20b8d98cde9 [term 2 LEADER]: Becoming Leader. State: Replica: c3db9c6332ea4354b25af20b8d98cde9, State: Running, Role: LEADER
I20260709 13:14:13.353930   710 consensus_queue.cc:237] T 42473b265d0f476b928fdcbe60fd318b P c3db9c6332ea4354b25af20b8d98cde9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:13.360493 32642 catalog_manager.cc:5697] T 42473b265d0f476b928fdcbe60fd318b P c3db9c6332ea4354b25af20b8d98cde9 reported cstate change: term changed from 1 to 2, leader changed from ccb5d7de9811449d8105001cb43ac775 (127.23.140.67) to c3db9c6332ea4354b25af20b8d98cde9 (127.23.140.66). New cstate: current_term: 2 leader_uuid: "c3db9c6332ea4354b25af20b8d98cde9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:13.573853   427 raft_consensus.cc:1275] T c97f937160cf4068a000607700371c56 P ccb5d7de9811449d8105001cb43ac775 [term 3 FOLLOWER]: Refusing update from remote peer c3db9c6332ea4354b25af20b8d98cde9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:13.575037   710 consensus_queue.cc:1048] T c97f937160cf4068a000607700371c56 P c3db9c6332ea4354b25af20b8d98cde9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:13.583659   628 raft_consensus.cc:1275] T c97f937160cf4068a000607700371c56 P 371b5d0b1c9e48c79defeea5005327a6 [term 3 FOLLOWER]: Refusing update from remote peer c3db9c6332ea4354b25af20b8d98cde9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:13.586108   667 consensus_queue.cc:1048] T c97f937160cf4068a000607700371c56 P c3db9c6332ea4354b25af20b8d98cde9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:14:13.607554 32693 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:14:13.747972   427 raft_consensus.cc:1275] T 42473b265d0f476b928fdcbe60fd318b P ccb5d7de9811449d8105001cb43ac775 [term 2 FOLLOWER]: Refusing update from remote peer c3db9c6332ea4354b25af20b8d98cde9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:13.749334   668 consensus_queue.cc:1048] T 42473b265d0f476b928fdcbe60fd318b P c3db9c6332ea4354b25af20b8d98cde9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:13.758293   628 raft_consensus.cc:1275] T 42473b265d0f476b928fdcbe60fd318b P 371b5d0b1c9e48c79defeea5005327a6 [term 2 FOLLOWER]: Refusing update from remote peer c3db9c6332ea4354b25af20b8d98cde9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:13.759856   667 consensus_queue.cc:1048] T 42473b265d0f476b928fdcbe60fd318b P c3db9c6332ea4354b25af20b8d98cde9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:14.100816 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:14.108349   353 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e96fafd0e9644919d5f556114573533"
dest_uuid: "c3db9c6332ea4354b25af20b8d98cde9"
mode: GRACEFUL
new_leader_uuid: "ccb5d7de9811449d8105001cb43ac775"
 from {username='slave'} at 127.0.0.1:60036
I20260709 13:14:14.108981   353 raft_consensus.cc:606] T 0e96fafd0e9644919d5f556114573533 P c3db9c6332ea4354b25af20b8d98cde9 [term 1 LEADER]: Received request to transfer leadership to TS ccb5d7de9811449d8105001cb43ac775
I20260709 13:14:14.111830   353 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "58c124bee20f4d039daa8d54154c0616"
dest_uuid: "c3db9c6332ea4354b25af20b8d98cde9"
mode: GRACEFUL
new_leader_uuid: "ccb5d7de9811449d8105001cb43ac775"
 from {username='slave'} at 127.0.0.1:60036
I20260709 13:14:14.112322   353 raft_consensus.cc:606] T 58c124bee20f4d039daa8d54154c0616 P c3db9c6332ea4354b25af20b8d98cde9 [term 2 LEADER]: Received request to transfer leadership to TS ccb5d7de9811449d8105001cb43ac775
I20260709 13:14:14.113294 24113 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:14:14.113798 24113 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:14.114344 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:14.240062   710 raft_consensus.cc:993] T 0e96fafd0e9644919d5f556114573533 P c3db9c6332ea4354b25af20b8d98cde9: : Instructing follower ccb5d7de9811449d8105001cb43ac775 to start an election
I20260709 13:14:14.240509   668 raft_consensus.cc:1081] T 0e96fafd0e9644919d5f556114573533 P c3db9c6332ea4354b25af20b8d98cde9 [term 1 LEADER]: Signalling peer ccb5d7de9811449d8105001cb43ac775 to start an election
I20260709 13:14:14.242034   427 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e96fafd0e9644919d5f556114573533"
dest_uuid: "ccb5d7de9811449d8105001cb43ac775"
 from {username='slave'} at 127.0.0.1:49860
I20260709 13:14:14.242509   427 raft_consensus.cc:493] T 0e96fafd0e9644919d5f556114573533 P ccb5d7de9811449d8105001cb43ac775 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:14.242795   427 raft_consensus.cc:3060] T 0e96fafd0e9644919d5f556114573533 P ccb5d7de9811449d8105001cb43ac775 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:14.247745   427 raft_consensus.cc:515] T 0e96fafd0e9644919d5f556114573533 P ccb5d7de9811449d8105001cb43ac775 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:14.249038   427 leader_election.cc:290] T 0e96fafd0e9644919d5f556114573533 P ccb5d7de9811449d8105001cb43ac775 [CANDIDATE]: Term 2 election: Requested vote from peers 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633), c3db9c6332ea4354b25af20b8d98cde9 (127.23.140.66:38883)
I20260709 13:14:14.249807   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e96fafd0e9644919d5f556114573533" candidate_uuid: "ccb5d7de9811449d8105001cb43ac775" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "371b5d0b1c9e48c79defeea5005327a6"
I20260709 13:14:14.250069   353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e96fafd0e9644919d5f556114573533" candidate_uuid: "ccb5d7de9811449d8105001cb43ac775" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c3db9c6332ea4354b25af20b8d98cde9"
I20260709 13:14:14.250465   629 raft_consensus.cc:3060] T 0e96fafd0e9644919d5f556114573533 P 371b5d0b1c9e48c79defeea5005327a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:14.250628   353 raft_consensus.cc:3055] T 0e96fafd0e9644919d5f556114573533 P c3db9c6332ea4354b25af20b8d98cde9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:14.251012   353 raft_consensus.cc:740] T 0e96fafd0e9644919d5f556114573533 P c3db9c6332ea4354b25af20b8d98cde9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c3db9c6332ea4354b25af20b8d98cde9, State: Running, Role: LEADER
I20260709 13:14:14.251858   353 consensus_queue.cc:260] T 0e96fafd0e9644919d5f556114573533 P c3db9c6332ea4354b25af20b8d98cde9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:14.253088   353 raft_consensus.cc:3060] T 0e96fafd0e9644919d5f556114573533 P c3db9c6332ea4354b25af20b8d98cde9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:14.257556   629 raft_consensus.cc:2468] T 0e96fafd0e9644919d5f556114573533 P 371b5d0b1c9e48c79defeea5005327a6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccb5d7de9811449d8105001cb43ac775 in term 2.
I20260709 13:14:14.258692   391 leader_election.cc:304] T 0e96fafd0e9644919d5f556114573533 P ccb5d7de9811449d8105001cb43ac775 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b5d0b1c9e48c79defeea5005327a6, ccb5d7de9811449d8105001cb43ac775; no voters: 
I20260709 13:14:14.259841   353 raft_consensus.cc:2468] T 0e96fafd0e9644919d5f556114573533 P c3db9c6332ea4354b25af20b8d98cde9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccb5d7de9811449d8105001cb43ac775 in term 2.
I20260709 13:14:14.260175   669 raft_consensus.cc:2804] T 0e96fafd0e9644919d5f556114573533 P ccb5d7de9811449d8105001cb43ac775 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:14.261734   669 raft_consensus.cc:697] T 0e96fafd0e9644919d5f556114573533 P ccb5d7de9811449d8105001cb43ac775 [term 2 LEADER]: Becoming Leader. State: Replica: ccb5d7de9811449d8105001cb43ac775, State: Running, Role: LEADER
I20260709 13:14:14.262563   669 consensus_queue.cc:237] T 0e96fafd0e9644919d5f556114573533 P ccb5d7de9811449d8105001cb43ac775 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:14.269089 32642 catalog_manager.cc:5697] T 0e96fafd0e9644919d5f556114573533 P ccb5d7de9811449d8105001cb43ac775 reported cstate change: term changed from 1 to 2, leader changed from c3db9c6332ea4354b25af20b8d98cde9 (127.23.140.66) to ccb5d7de9811449d8105001cb43ac775 (127.23.140.67). New cstate: current_term: 2 leader_uuid: "ccb5d7de9811449d8105001cb43ac775" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:14.571736   710 raft_consensus.cc:993] T 58c124bee20f4d039daa8d54154c0616 P c3db9c6332ea4354b25af20b8d98cde9: : Instructing follower ccb5d7de9811449d8105001cb43ac775 to start an election
I20260709 13:14:14.572280   668 raft_consensus.cc:1081] T 58c124bee20f4d039daa8d54154c0616 P c3db9c6332ea4354b25af20b8d98cde9 [term 2 LEADER]: Signalling peer ccb5d7de9811449d8105001cb43ac775 to start an election
I20260709 13:14:14.573643   427 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "58c124bee20f4d039daa8d54154c0616"
dest_uuid: "ccb5d7de9811449d8105001cb43ac775"
 from {username='slave'} at 127.0.0.1:49860
I20260709 13:14:14.574131   427 raft_consensus.cc:493] T 58c124bee20f4d039daa8d54154c0616 P ccb5d7de9811449d8105001cb43ac775 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:14.574409   427 raft_consensus.cc:3060] T 58c124bee20f4d039daa8d54154c0616 P ccb5d7de9811449d8105001cb43ac775 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:14.579442   427 raft_consensus.cc:515] T 58c124bee20f4d039daa8d54154c0616 P ccb5d7de9811449d8105001cb43ac775 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:14.580978   427 leader_election.cc:290] T 58c124bee20f4d039daa8d54154c0616 P ccb5d7de9811449d8105001cb43ac775 [CANDIDATE]: Term 3 election: Requested vote from peers c3db9c6332ea4354b25af20b8d98cde9 (127.23.140.66:38883), 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633)
I20260709 13:14:14.581665   353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c124bee20f4d039daa8d54154c0616" candidate_uuid: "ccb5d7de9811449d8105001cb43ac775" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c3db9c6332ea4354b25af20b8d98cde9"
I20260709 13:14:14.581939   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c124bee20f4d039daa8d54154c0616" candidate_uuid: "ccb5d7de9811449d8105001cb43ac775" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "371b5d0b1c9e48c79defeea5005327a6"
I20260709 13:14:14.582324   353 raft_consensus.cc:3055] T 58c124bee20f4d039daa8d54154c0616 P c3db9c6332ea4354b25af20b8d98cde9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:14.582638   629 raft_consensus.cc:3060] T 58c124bee20f4d039daa8d54154c0616 P 371b5d0b1c9e48c79defeea5005327a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:14.582746   353 raft_consensus.cc:740] T 58c124bee20f4d039daa8d54154c0616 P c3db9c6332ea4354b25af20b8d98cde9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c3db9c6332ea4354b25af20b8d98cde9, State: Running, Role: LEADER
I20260709 13:14:14.583750   353 consensus_queue.cc:260] T 58c124bee20f4d039daa8d54154c0616 P c3db9c6332ea4354b25af20b8d98cde9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:14.584988   353 raft_consensus.cc:3060] T 58c124bee20f4d039daa8d54154c0616 P c3db9c6332ea4354b25af20b8d98cde9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:14.589031   629 raft_consensus.cc:2468] T 58c124bee20f4d039daa8d54154c0616 P 371b5d0b1c9e48c79defeea5005327a6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccb5d7de9811449d8105001cb43ac775 in term 3.
I20260709 13:14:14.589754   353 raft_consensus.cc:2468] T 58c124bee20f4d039daa8d54154c0616 P c3db9c6332ea4354b25af20b8d98cde9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccb5d7de9811449d8105001cb43ac775 in term 3.
I20260709 13:14:14.590415   391 leader_election.cc:304] T 58c124bee20f4d039daa8d54154c0616 P ccb5d7de9811449d8105001cb43ac775 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b5d0b1c9e48c79defeea5005327a6, ccb5d7de9811449d8105001cb43ac775; no voters: 
I20260709 13:14:14.591478   669 raft_consensus.cc:2804] T 58c124bee20f4d039daa8d54154c0616 P ccb5d7de9811449d8105001cb43ac775 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:14.592231   669 raft_consensus.cc:697] T 58c124bee20f4d039daa8d54154c0616 P ccb5d7de9811449d8105001cb43ac775 [term 3 LEADER]: Becoming Leader. State: Replica: ccb5d7de9811449d8105001cb43ac775, State: Running, Role: LEADER
I20260709 13:14:14.593011   669 consensus_queue.cc:237] T 58c124bee20f4d039daa8d54154c0616 P ccb5d7de9811449d8105001cb43ac775 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:14.599649 32642 catalog_manager.cc:5697] T 58c124bee20f4d039daa8d54154c0616 P ccb5d7de9811449d8105001cb43ac775 reported cstate change: term changed from 2 to 3, leader changed from c3db9c6332ea4354b25af20b8d98cde9 (127.23.140.66) to ccb5d7de9811449d8105001cb43ac775 (127.23.140.67). New cstate: current_term: 3 leader_uuid: "ccb5d7de9811449d8105001cb43ac775" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } health_report { overall_health: HEALTHY } } }
W20260709 13:14:14.608379 32693 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:14:14.832965   353 raft_consensus.cc:1275] T 0e96fafd0e9644919d5f556114573533 P c3db9c6332ea4354b25af20b8d98cde9 [term 2 FOLLOWER]: Refusing update from remote peer ccb5d7de9811449d8105001cb43ac775: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:14.834336   669 consensus_queue.cc:1048] T 0e96fafd0e9644919d5f556114573533 P ccb5d7de9811449d8105001cb43ac775 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:14.845379   629 raft_consensus.cc:1275] T 0e96fafd0e9644919d5f556114573533 P 371b5d0b1c9e48c79defeea5005327a6 [term 2 FOLLOWER]: Refusing update from remote peer ccb5d7de9811449d8105001cb43ac775: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:14.848042   725 consensus_queue.cc:1048] T 0e96fafd0e9644919d5f556114573533 P ccb5d7de9811449d8105001cb43ac775 [LEADER]: Connected to new peer: Peer: permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:15.121173 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:15.128561   427 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4fdcc1f9d3d34a1480606d325fe3616f"
dest_uuid: "ccb5d7de9811449d8105001cb43ac775"
mode: GRACEFUL
new_leader_uuid: "c3db9c6332ea4354b25af20b8d98cde9"
 from {username='slave'} at 127.0.0.1:44688
I20260709 13:14:15.129091   427 raft_consensus.cc:606] T 4fdcc1f9d3d34a1480606d325fe3616f P ccb5d7de9811449d8105001cb43ac775 [term 3 LEADER]: Received request to transfer leadership to TS c3db9c6332ea4354b25af20b8d98cde9
I20260709 13:14:15.131498   427 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "58c124bee20f4d039daa8d54154c0616"
dest_uuid: "ccb5d7de9811449d8105001cb43ac775"
mode: GRACEFUL
new_leader_uuid: "c3db9c6332ea4354b25af20b8d98cde9"
 from {username='slave'} at 127.0.0.1:44688
I20260709 13:14:15.131948   427 raft_consensus.cc:606] T 58c124bee20f4d039daa8d54154c0616 P ccb5d7de9811449d8105001cb43ac775 [term 3 LEADER]: Received request to transfer leadership to TS c3db9c6332ea4354b25af20b8d98cde9
I20260709 13:14:15.132910 24113 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:14:15.133374 24113 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:15.133965 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:15.141636   353 raft_consensus.cc:1275] T 58c124bee20f4d039daa8d54154c0616 P c3db9c6332ea4354b25af20b8d98cde9 [term 3 FOLLOWER]: Refusing update from remote peer ccb5d7de9811449d8105001cb43ac775: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:15.143244   735 consensus_queue.cc:1048] T 58c124bee20f4d039daa8d54154c0616 P ccb5d7de9811449d8105001cb43ac775 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:15.149233   669 raft_consensus.cc:993] T 58c124bee20f4d039daa8d54154c0616 P ccb5d7de9811449d8105001cb43ac775: : Instructing follower c3db9c6332ea4354b25af20b8d98cde9 to start an election
I20260709 13:14:15.149690   725 raft_consensus.cc:1081] T 58c124bee20f4d039daa8d54154c0616 P ccb5d7de9811449d8105001cb43ac775 [term 3 LEADER]: Signalling peer c3db9c6332ea4354b25af20b8d98cde9 to start an election
I20260709 13:14:15.151355   354 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "58c124bee20f4d039daa8d54154c0616"
dest_uuid: "c3db9c6332ea4354b25af20b8d98cde9"
 from {username='slave'} at 127.0.0.1:45684
I20260709 13:14:15.152127   354 raft_consensus.cc:493] T 58c124bee20f4d039daa8d54154c0616 P c3db9c6332ea4354b25af20b8d98cde9 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:15.152475   354 raft_consensus.cc:3060] T 58c124bee20f4d039daa8d54154c0616 P c3db9c6332ea4354b25af20b8d98cde9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:15.155160   629 raft_consensus.cc:1275] T 58c124bee20f4d039daa8d54154c0616 P 371b5d0b1c9e48c79defeea5005327a6 [term 3 FOLLOWER]: Refusing update from remote peer ccb5d7de9811449d8105001cb43ac775: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:15.158277   725 consensus_queue.cc:1048] T 58c124bee20f4d039daa8d54154c0616 P ccb5d7de9811449d8105001cb43ac775 [LEADER]: Connected to new peer: Peer: permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:15.161975   354 raft_consensus.cc:515] T 58c124bee20f4d039daa8d54154c0616 P c3db9c6332ea4354b25af20b8d98cde9 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:15.169344   354 leader_election.cc:290] T 58c124bee20f4d039daa8d54154c0616 P c3db9c6332ea4354b25af20b8d98cde9 [CANDIDATE]: Term 4 election: Requested vote from peers 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633), ccb5d7de9811449d8105001cb43ac775 (127.23.140.67:39377)
I20260709 13:14:15.170727   427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c124bee20f4d039daa8d54154c0616" candidate_uuid: "c3db9c6332ea4354b25af20b8d98cde9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ccb5d7de9811449d8105001cb43ac775"
I20260709 13:14:15.171203   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c124bee20f4d039daa8d54154c0616" candidate_uuid: "c3db9c6332ea4354b25af20b8d98cde9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "371b5d0b1c9e48c79defeea5005327a6"
I20260709 13:14:15.171394   427 raft_consensus.cc:3055] T 58c124bee20f4d039daa8d54154c0616 P ccb5d7de9811449d8105001cb43ac775 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:15.171754   427 raft_consensus.cc:740] T 58c124bee20f4d039daa8d54154c0616 P ccb5d7de9811449d8105001cb43ac775 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ccb5d7de9811449d8105001cb43ac775, State: Running, Role: LEADER
I20260709 13:14:15.172580   629 raft_consensus.cc:3060] T 58c124bee20f4d039daa8d54154c0616 P 371b5d0b1c9e48c79defeea5005327a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:15.172456   427 consensus_queue.cc:260] T 58c124bee20f4d039daa8d54154c0616 P ccb5d7de9811449d8105001cb43ac775 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:15.173712   427 raft_consensus.cc:3060] T 58c124bee20f4d039daa8d54154c0616 P ccb5d7de9811449d8105001cb43ac775 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:15.179628   629 raft_consensus.cc:2468] T 58c124bee20f4d039daa8d54154c0616 P 371b5d0b1c9e48c79defeea5005327a6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3db9c6332ea4354b25af20b8d98cde9 in term 4.
I20260709 13:14:15.180243   427 raft_consensus.cc:2468] T 58c124bee20f4d039daa8d54154c0616 P ccb5d7de9811449d8105001cb43ac775 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3db9c6332ea4354b25af20b8d98cde9 in term 4.
I20260709 13:14:15.180810   317 leader_election.cc:304] T 58c124bee20f4d039daa8d54154c0616 P c3db9c6332ea4354b25af20b8d98cde9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b5d0b1c9e48c79defeea5005327a6, c3db9c6332ea4354b25af20b8d98cde9; no voters: 
I20260709 13:14:15.181562   668 raft_consensus.cc:2804] T 58c124bee20f4d039daa8d54154c0616 P c3db9c6332ea4354b25af20b8d98cde9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:15.182421   668 raft_consensus.cc:697] T 58c124bee20f4d039daa8d54154c0616 P c3db9c6332ea4354b25af20b8d98cde9 [term 4 LEADER]: Becoming Leader. State: Replica: c3db9c6332ea4354b25af20b8d98cde9, State: Running, Role: LEADER
I20260709 13:14:15.183099   668 consensus_queue.cc:237] T 58c124bee20f4d039daa8d54154c0616 P c3db9c6332ea4354b25af20b8d98cde9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:15.188771 32644 catalog_manager.cc:5697] T 58c124bee20f4d039daa8d54154c0616 P c3db9c6332ea4354b25af20b8d98cde9 reported cstate change: term changed from 3 to 4, leader changed from ccb5d7de9811449d8105001cb43ac775 (127.23.140.67) to c3db9c6332ea4354b25af20b8d98cde9 (127.23.140.66). New cstate: current_term: 4 leader_uuid: "c3db9c6332ea4354b25af20b8d98cde9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:15.587013   725 raft_consensus.cc:993] T 4fdcc1f9d3d34a1480606d325fe3616f P ccb5d7de9811449d8105001cb43ac775: : Instructing follower c3db9c6332ea4354b25af20b8d98cde9 to start an election
I20260709 13:14:15.587531   669 raft_consensus.cc:1081] T 4fdcc1f9d3d34a1480606d325fe3616f P ccb5d7de9811449d8105001cb43ac775 [term 3 LEADER]: Signalling peer c3db9c6332ea4354b25af20b8d98cde9 to start an election
I20260709 13:14:15.588927   354 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4fdcc1f9d3d34a1480606d325fe3616f"
dest_uuid: "c3db9c6332ea4354b25af20b8d98cde9"
 from {username='slave'} at 127.0.0.1:45684
I20260709 13:14:15.589391   354 raft_consensus.cc:493] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:15.589674   354 raft_consensus.cc:3060] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:15.594388   354 raft_consensus.cc:515] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:15.595861   354 leader_election.cc:290] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9 [CANDIDATE]: Term 4 election: Requested vote from peers 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633), ccb5d7de9811449d8105001cb43ac775 (127.23.140.67:39377)
I20260709 13:14:15.596765   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fdcc1f9d3d34a1480606d325fe3616f" candidate_uuid: "c3db9c6332ea4354b25af20b8d98cde9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "371b5d0b1c9e48c79defeea5005327a6"
I20260709 13:14:15.596848   427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fdcc1f9d3d34a1480606d325fe3616f" candidate_uuid: "c3db9c6332ea4354b25af20b8d98cde9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ccb5d7de9811449d8105001cb43ac775"
I20260709 13:14:15.597404   629 raft_consensus.cc:3060] T 4fdcc1f9d3d34a1480606d325fe3616f P 371b5d0b1c9e48c79defeea5005327a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:15.597553   427 raft_consensus.cc:3055] T 4fdcc1f9d3d34a1480606d325fe3616f P ccb5d7de9811449d8105001cb43ac775 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:15.597983   427 raft_consensus.cc:740] T 4fdcc1f9d3d34a1480606d325fe3616f P ccb5d7de9811449d8105001cb43ac775 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ccb5d7de9811449d8105001cb43ac775, State: Running, Role: LEADER
I20260709 13:14:15.598651   427 consensus_queue.cc:260] T 4fdcc1f9d3d34a1480606d325fe3616f P ccb5d7de9811449d8105001cb43ac775 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
I20260709 13:14:15.599516   427 raft_consensus.cc:3060] T 4fdcc1f9d3d34a1480606d325fe3616f P ccb5d7de9811449d8105001cb43ac775 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:15.601974   629 raft_consensus.cc:2468] T 4fdcc1f9d3d34a1480606d325fe3616f P 371b5d0b1c9e48c79defeea5005327a6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3db9c6332ea4354b25af20b8d98cde9 in term 4.
I20260709 13:14:15.603016   317 leader_election.cc:304] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b5d0b1c9e48c79defeea5005327a6, c3db9c6332ea4354b25af20b8d98cde9; no voters: 
I20260709 13:14:15.603639   668 raft_consensus.cc:2804] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:15.603909   427 raft_consensus.cc:2468] T 4fdcc1f9d3d34a1480606d325fe3616f P ccb5d7de9811449d8105001cb43ac775 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3db9c6332ea4354b25af20b8d98cde9 in term 4.
I20260709 13:14:15.604136   668 raft_consensus.cc:697] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9 [term 4 LEADER]: Becoming Leader. State: Replica: c3db9c6332ea4354b25af20b8d98cde9, State: Running, Role: LEADER
I20260709 13:14:15.605355   668 consensus_queue.cc:237] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } }
W20260709 13:14:15.609469 32693 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:14:15.609921   629 raft_consensus.cc:1275] T 58c124bee20f4d039daa8d54154c0616 P 371b5d0b1c9e48c79defeea5005327a6 [term 4 FOLLOWER]: Refusing update from remote peer c3db9c6332ea4354b25af20b8d98cde9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:15.611377   668 consensus_queue.cc:1048] T 58c124bee20f4d039daa8d54154c0616 P c3db9c6332ea4354b25af20b8d98cde9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:15.613705 32644 catalog_manager.cc:5697] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9 reported cstate change: term changed from 3 to 4, leader changed from ccb5d7de9811449d8105001cb43ac775 (127.23.140.67) to c3db9c6332ea4354b25af20b8d98cde9 (127.23.140.66). New cstate: current_term: 4 leader_uuid: "c3db9c6332ea4354b25af20b8d98cde9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3db9c6332ea4354b25af20b8d98cde9" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:15.623361   427 raft_consensus.cc:1275] T 58c124bee20f4d039daa8d54154c0616 P ccb5d7de9811449d8105001cb43ac775 [term 4 FOLLOWER]: Refusing update from remote peer c3db9c6332ea4354b25af20b8d98cde9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:15.624729   748 consensus_queue.cc:1048] T 58c124bee20f4d039daa8d54154c0616 P c3db9c6332ea4354b25af20b8d98cde9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:16.140184 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:16.141894   427 raft_consensus.cc:1275] T 4fdcc1f9d3d34a1480606d325fe3616f P ccb5d7de9811449d8105001cb43ac775 [term 4 FOLLOWER]: Refusing update from remote peer c3db9c6332ea4354b25af20b8d98cde9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:16.144156   668 consensus_queue.cc:1048] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccb5d7de9811449d8105001cb43ac775" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 39377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:16.165117   629 raft_consensus.cc:1275] T 4fdcc1f9d3d34a1480606d325fe3616f P 371b5d0b1c9e48c79defeea5005327a6 [term 4 FOLLOWER]: Refusing update from remote peer c3db9c6332ea4354b25af20b8d98cde9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:16.167349   748 consensus_queue.cc:1048] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "371b5d0b1c9e48c79defeea5005327a6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:16.194185 24113 tablet_server.cc:179] TabletServer@127.23.140.65:41633 shutting down...
I20260709 13:14:16.221120 24113 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:16.223456 24113 tablet_replica.cc:333] stopping tablet replica
W20260709 13:14:16.224341   317 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 83 similar messages]
I20260709 13:14:16.224735 24113 raft_consensus.cc:2243] T 6e71f9f26bcf449388fdf26ab44b79da P 371b5d0b1c9e48c79defeea5005327a6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:16.225734 24113 raft_consensus.cc:2272] T 6e71f9f26bcf449388fdf26ab44b79da P 371b5d0b1c9e48c79defeea5005327a6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:16.228672   317 consensus_peers.cc:597] T c97f937160cf4068a000607700371c56 P c3db9c6332ea4354b25af20b8d98cde9 -> Peer 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633): Couldn't send request to peer 371b5d0b1c9e48c79defeea5005327a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:16.229861 24113 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:16.230641 24113 raft_consensus.cc:2243] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P 371b5d0b1c9e48c79defeea5005327a6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:16.231159 24113 raft_consensus.cc:2272] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P 371b5d0b1c9e48c79defeea5005327a6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:16.233847 24113 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:16.234488 24113 raft_consensus.cc:2243] T ccc5273ee6eb48e9ad577cb60a46001a P 371b5d0b1c9e48c79defeea5005327a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:16.234974 24113 raft_consensus.cc:2272] T ccc5273ee6eb48e9ad577cb60a46001a P 371b5d0b1c9e48c79defeea5005327a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:16.237437 24113 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:16.238179 24113 raft_consensus.cc:2243] T efc64f8df3094f568e2fb0be3e56380b P 371b5d0b1c9e48c79defeea5005327a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:16.238710 24113 raft_consensus.cc:2272] T efc64f8df3094f568e2fb0be3e56380b P 371b5d0b1c9e48c79defeea5005327a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:16.241602 24113 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:16.242216 24113 raft_consensus.cc:2243] T 58c124bee20f4d039daa8d54154c0616 P 371b5d0b1c9e48c79defeea5005327a6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:16.242820 24113 raft_consensus.cc:2272] T 58c124bee20f4d039daa8d54154c0616 P 371b5d0b1c9e48c79defeea5005327a6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:16.246230 24113 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:16.247000 24113 raft_consensus.cc:2243] T c97f937160cf4068a000607700371c56 P 371b5d0b1c9e48c79defeea5005327a6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:16.247604 24113 raft_consensus.cc:2272] T c97f937160cf4068a000607700371c56 P 371b5d0b1c9e48c79defeea5005327a6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:16.251158 24113 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:16.251945 24113 raft_consensus.cc:2243] T 4fdcc1f9d3d34a1480606d325fe3616f P 371b5d0b1c9e48c79defeea5005327a6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:16.252540 24113 raft_consensus.cc:2272] T 4fdcc1f9d3d34a1480606d325fe3616f P 371b5d0b1c9e48c79defeea5005327a6 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:16.253618   391 consensus_peers.cc:597] T 0e96fafd0e9644919d5f556114573533 P ccb5d7de9811449d8105001cb43ac775 -> Peer 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633): Couldn't send request to peer 371b5d0b1c9e48c79defeea5005327a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:16.255708 24113 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:16.256331 24113 raft_consensus.cc:2243] T 0e96fafd0e9644919d5f556114573533 P 371b5d0b1c9e48c79defeea5005327a6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:16.256829 24113 raft_consensus.cc:2272] T 0e96fafd0e9644919d5f556114573533 P 371b5d0b1c9e48c79defeea5005327a6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:16.259370 24113 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:16.259881 24113 raft_consensus.cc:2243] T 42473b265d0f476b928fdcbe60fd318b P 371b5d0b1c9e48c79defeea5005327a6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:16.260386 24113 raft_consensus.cc:2272] T 42473b265d0f476b928fdcbe60fd318b P 371b5d0b1c9e48c79defeea5005327a6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:16.262914 24113 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:16.263460 24113 raft_consensus.cc:2243] T 31972c45882a4ef1bd838a1790d929b4 P 371b5d0b1c9e48c79defeea5005327a6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:16.263923 24113 raft_consensus.cc:2272] T 31972c45882a4ef1bd838a1790d929b4 P 371b5d0b1c9e48c79defeea5005327a6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:16.271332   391 consensus_peers.cc:597] T 6e71f9f26bcf449388fdf26ab44b79da P ccb5d7de9811449d8105001cb43ac775 -> Peer 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633): Couldn't send request to peer 371b5d0b1c9e48c79defeea5005327a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:16.272897   391 consensus_peers.cc:597] T efc64f8df3094f568e2fb0be3e56380b P ccb5d7de9811449d8105001cb43ac775 -> Peer 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633): Couldn't send request to peer 371b5d0b1c9e48c79defeea5005327a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:16.302013 24113 tablet_server.cc:196] TabletServer@127.23.140.65:41633 shutdown complete.
I20260709 13:14:16.333789 24113 tablet_server.cc:179] TabletServer@127.23.140.66:0 shutting down...
I20260709 13:14:16.360383 24113 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:16.361277 24113 tablet_replica.cc:333] T efc64f8df3094f568e2fb0be3e56380b P c3db9c6332ea4354b25af20b8d98cde9: stopping tablet replica
I20260709 13:14:16.362444 24113 raft_consensus.cc:2243] T efc64f8df3094f568e2fb0be3e56380b P c3db9c6332ea4354b25af20b8d98cde9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:16.362947 24113 raft_consensus.cc:2272] T efc64f8df3094f568e2fb0be3e56380b P c3db9c6332ea4354b25af20b8d98cde9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:16.365411 24113 tablet_replica.cc:333] T 0e96fafd0e9644919d5f556114573533 P c3db9c6332ea4354b25af20b8d98cde9: stopping tablet replica
I20260709 13:14:16.366163 24113 raft_consensus.cc:2243] T 0e96fafd0e9644919d5f556114573533 P c3db9c6332ea4354b25af20b8d98cde9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:16.366670 24113 raft_consensus.cc:2272] T 0e96fafd0e9644919d5f556114573533 P c3db9c6332ea4354b25af20b8d98cde9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:16.368947 24113 tablet_replica.cc:333] T 42473b265d0f476b928fdcbe60fd318b P c3db9c6332ea4354b25af20b8d98cde9: stopping tablet replica
I20260709 13:14:16.369580 24113 raft_consensus.cc:2243] T 42473b265d0f476b928fdcbe60fd318b P c3db9c6332ea4354b25af20b8d98cde9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:16.370482 24113 raft_consensus.cc:2272] T 42473b265d0f476b928fdcbe60fd318b P c3db9c6332ea4354b25af20b8d98cde9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:16.373004 24113 tablet_replica.cc:333] T 31972c45882a4ef1bd838a1790d929b4 P c3db9c6332ea4354b25af20b8d98cde9: stopping tablet replica
I20260709 13:14:16.373633 24113 raft_consensus.cc:2243] T 31972c45882a4ef1bd838a1790d929b4 P c3db9c6332ea4354b25af20b8d98cde9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:16.374539 24113 raft_consensus.cc:2272] T 31972c45882a4ef1bd838a1790d929b4 P c3db9c6332ea4354b25af20b8d98cde9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:16.376839 24113 tablet_replica.cc:333] T ccc5273ee6eb48e9ad577cb60a46001a P c3db9c6332ea4354b25af20b8d98cde9: stopping tablet replica
I20260709 13:14:16.377362 24113 raft_consensus.cc:2243] T ccc5273ee6eb48e9ad577cb60a46001a P c3db9c6332ea4354b25af20b8d98cde9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:16.378280 24113 raft_consensus.cc:2272] T ccc5273ee6eb48e9ad577cb60a46001a P c3db9c6332ea4354b25af20b8d98cde9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:16.380463 24113 tablet_replica.cc:333] T 6e71f9f26bcf449388fdf26ab44b79da P c3db9c6332ea4354b25af20b8d98cde9: stopping tablet replica
I20260709 13:14:16.381014 24113 raft_consensus.cc:2243] T 6e71f9f26bcf449388fdf26ab44b79da P c3db9c6332ea4354b25af20b8d98cde9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:16.381548 24113 raft_consensus.cc:2272] T 6e71f9f26bcf449388fdf26ab44b79da P c3db9c6332ea4354b25af20b8d98cde9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:16.383836 24113 tablet_replica.cc:333] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P c3db9c6332ea4354b25af20b8d98cde9: stopping tablet replica
I20260709 13:14:16.384333 24113 raft_consensus.cc:2243] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P c3db9c6332ea4354b25af20b8d98cde9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:16.384809 24113 raft_consensus.cc:2272] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P c3db9c6332ea4354b25af20b8d98cde9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:16.387113 24113 tablet_replica.cc:333] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9: stopping tablet replica
I20260709 13:14:16.387647 24113 raft_consensus.cc:2243] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:14:16.388464 24113 raft_consensus.cc:2272] T 4fdcc1f9d3d34a1480606d325fe3616f P c3db9c6332ea4354b25af20b8d98cde9 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:16.391463 24113 tablet_replica.cc:333] T c97f937160cf4068a000607700371c56 P c3db9c6332ea4354b25af20b8d98cde9: stopping tablet replica
I20260709 13:14:16.391984 24113 raft_consensus.cc:2243] T c97f937160cf4068a000607700371c56 P c3db9c6332ea4354b25af20b8d98cde9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:16.392866 24113 raft_consensus.cc:2272] T c97f937160cf4068a000607700371c56 P c3db9c6332ea4354b25af20b8d98cde9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:16.395298 24113 tablet_replica.cc:333] T 58c124bee20f4d039daa8d54154c0616 P c3db9c6332ea4354b25af20b8d98cde9: stopping tablet replica
I20260709 13:14:16.395835 24113 raft_consensus.cc:2243] T 58c124bee20f4d039daa8d54154c0616 P c3db9c6332ea4354b25af20b8d98cde9 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:14:16.396637 24113 raft_consensus.cc:2272] T 58c124bee20f4d039daa8d54154c0616 P c3db9c6332ea4354b25af20b8d98cde9 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:16.433285 24113 tablet_server.cc:196] TabletServer@127.23.140.66:0 shutdown complete.
I20260709 13:14:16.462131 24113 tablet_server.cc:179] TabletServer@127.23.140.67:0 shutting down...
W20260709 13:14:16.466846   391 consensus_peers.cc:597] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P ccb5d7de9811449d8105001cb43ac775 -> Peer 371b5d0b1c9e48c79defeea5005327a6 (127.23.140.65:41633): Couldn't send request to peer 371b5d0b1c9e48c79defeea5005327a6. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:41633: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:16.475176   394 consensus_peers.cc:597] T 6e71f9f26bcf449388fdf26ab44b79da P ccb5d7de9811449d8105001cb43ac775 -> Peer c3db9c6332ea4354b25af20b8d98cde9 (127.23.140.66:38883): Couldn't send request to peer c3db9c6332ea4354b25af20b8d98cde9. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.66:38883: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:16.495616 24113 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:16.496469 24113 tablet_replica.cc:333] T 42473b265d0f476b928fdcbe60fd318b P ccb5d7de9811449d8105001cb43ac775: stopping tablet replica
I20260709 13:14:16.497189 24113 raft_consensus.cc:2243] T 42473b265d0f476b928fdcbe60fd318b P ccb5d7de9811449d8105001cb43ac775 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:16.497799 24113 raft_consensus.cc:2272] T 42473b265d0f476b928fdcbe60fd318b P ccb5d7de9811449d8105001cb43ac775 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:16.500255 24113 tablet_replica.cc:333] T 0e96fafd0e9644919d5f556114573533 P ccb5d7de9811449d8105001cb43ac775: stopping tablet replica
I20260709 13:14:16.500891 24113 raft_consensus.cc:2243] T 0e96fafd0e9644919d5f556114573533 P ccb5d7de9811449d8105001cb43ac775 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:16.501854 24113 raft_consensus.cc:2272] T 0e96fafd0e9644919d5f556114573533 P ccb5d7de9811449d8105001cb43ac775 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:16.503965 24113 tablet_replica.cc:333] T 4fdcc1f9d3d34a1480606d325fe3616f P ccb5d7de9811449d8105001cb43ac775: stopping tablet replica
I20260709 13:14:16.504469 24113 raft_consensus.cc:2243] T 4fdcc1f9d3d34a1480606d325fe3616f P ccb5d7de9811449d8105001cb43ac775 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:16.504905 24113 raft_consensus.cc:2272] T 4fdcc1f9d3d34a1480606d325fe3616f P ccb5d7de9811449d8105001cb43ac775 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:16.508275 24113 tablet_replica.cc:333] T 31972c45882a4ef1bd838a1790d929b4 P ccb5d7de9811449d8105001cb43ac775: stopping tablet replica
I20260709 13:14:16.508908 24113 raft_consensus.cc:2243] T 31972c45882a4ef1bd838a1790d929b4 P ccb5d7de9811449d8105001cb43ac775 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:16.509439 24113 raft_consensus.cc:2272] T 31972c45882a4ef1bd838a1790d929b4 P ccb5d7de9811449d8105001cb43ac775 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:16.511407 24113 tablet_replica.cc:333] T efc64f8df3094f568e2fb0be3e56380b P ccb5d7de9811449d8105001cb43ac775: stopping tablet replica
I20260709 13:14:16.511935 24113 raft_consensus.cc:2243] T efc64f8df3094f568e2fb0be3e56380b P ccb5d7de9811449d8105001cb43ac775 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:16.512768 24113 raft_consensus.cc:2272] T efc64f8df3094f568e2fb0be3e56380b P ccb5d7de9811449d8105001cb43ac775 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:16.514904 24113 tablet_replica.cc:333] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P ccb5d7de9811449d8105001cb43ac775: stopping tablet replica
I20260709 13:14:16.515427 24113 raft_consensus.cc:2243] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P ccb5d7de9811449d8105001cb43ac775 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:16.516296 24113 raft_consensus.cc:2272] T 2af3bf69a6b44d8b9ad324f545ddf5d5 P ccb5d7de9811449d8105001cb43ac775 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:16.518543 24113 tablet_replica.cc:333] T 6e71f9f26bcf449388fdf26ab44b79da P ccb5d7de9811449d8105001cb43ac775: stopping tablet replica
I20260709 13:14:16.519112 24113 raft_consensus.cc:2243] T 6e71f9f26bcf449388fdf26ab44b79da P ccb5d7de9811449d8105001cb43ac775 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:16.520004 24113 raft_consensus.cc:2272] T 6e71f9f26bcf449388fdf26ab44b79da P ccb5d7de9811449d8105001cb43ac775 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:16.522257 24113 tablet_replica.cc:333] T 58c124bee20f4d039daa8d54154c0616 P ccb5d7de9811449d8105001cb43ac775: stopping tablet replica
I20260709 13:14:16.522827 24113 raft_consensus.cc:2243] T 58c124bee20f4d039daa8d54154c0616 P ccb5d7de9811449d8105001cb43ac775 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:16.523294 24113 raft_consensus.cc:2272] T 58c124bee20f4d039daa8d54154c0616 P ccb5d7de9811449d8105001cb43ac775 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:16.525842 24113 tablet_replica.cc:333] T c97f937160cf4068a000607700371c56 P ccb5d7de9811449d8105001cb43ac775: stopping tablet replica
I20260709 13:14:16.526347 24113 raft_consensus.cc:2243] T c97f937160cf4068a000607700371c56 P ccb5d7de9811449d8105001cb43ac775 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:16.526849 24113 raft_consensus.cc:2272] T c97f937160cf4068a000607700371c56 P ccb5d7de9811449d8105001cb43ac775 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:16.529022 24113 tablet_replica.cc:333] T ccc5273ee6eb48e9ad577cb60a46001a P ccb5d7de9811449d8105001cb43ac775: stopping tablet replica
I20260709 13:14:16.529496 24113 raft_consensus.cc:2243] T ccc5273ee6eb48e9ad577cb60a46001a P ccb5d7de9811449d8105001cb43ac775 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:16.529978 24113 raft_consensus.cc:2272] T ccc5273ee6eb48e9ad577cb60a46001a P ccb5d7de9811449d8105001cb43ac775 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:16.566354 24113 tablet_server.cc:196] TabletServer@127.23.140.67:0 shutdown complete.
I20260709 13:14:16.592272 24113 master.cc:562] Master@127.23.140.126:34933 shutting down...
W20260709 13:14:16.612249 32693 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:14:16.617120 24113 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 6e1d1a89bc3f472dbac96104fecbc4d5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:16.617816 24113 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 6e1d1a89bc3f472dbac96104fecbc4d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:16.618157 24113 tablet_replica.cc:333] T 00000000000000000000000000000000 P 6e1d1a89bc3f472dbac96104fecbc4d5: stopping tablet replica
I20260709 13:14:16.639477 24113 master.cc:584] Master@127.23.140.126:34933 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (13238 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:14:16.685336 24113 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.23.140.126:34355
I20260709 13:14:16.686534 24113 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:16.692441   761 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:16.693316   764 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:16.692539   762 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:16.693850 24113 server_base.cc:1061] running on GCE node
I20260709 13:14:16.694845 24113 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:16.695020 24113 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:16.695134 24113 hybrid_clock.cc:648] HybridClock initialized: now 1783602856695123 us; error 0 us; skew 500 ppm
I20260709 13:14:16.695588 24113 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:16.698042 24113 webserver.cc:533] Webserver started at http://127.23.140.126:42671/ using document root <none> and password file <none>
I20260709 13:14:16.698508 24113 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:16.698658 24113 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:16.698851 24113 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:16.699977 24113 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602598684750-24113-0/minicluster-data/master-0-root/instance:
uuid: "ad52ddf7e7024b99ae92e692fa7b09b6"
format_stamp: "Formatted at 2026-07-09 13:14:16 on dist-test-slave-1rs3"
I20260709 13:14:16.704589 24113 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:14:16.707844   769 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:16.708591 24113 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:14:16.708868 24113 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602598684750-24113-0/minicluster-data/master-0-root
uuid: "ad52ddf7e7024b99ae92e692fa7b09b6"
format_stamp: "Formatted at 2026-07-09 13:14:16 on dist-test-slave-1rs3"
I20260709 13:14:16.709106 24113 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602598684750-24113-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602598684750-24113-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602598684750-24113-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:16.724514 24113 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:16.725670 24113 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:16.763912 24113 rpc_server.cc:307] RPC server started. Bound to: 127.23.140.126:34355
I20260709 13:14:16.764035   820 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.140.126:34355 every 8 connection(s)
I20260709 13:14:16.767935   821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:16.779248   821 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ad52ddf7e7024b99ae92e692fa7b09b6: Bootstrap starting.
I20260709 13:14:16.784761   821 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ad52ddf7e7024b99ae92e692fa7b09b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:16.789125   821 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ad52ddf7e7024b99ae92e692fa7b09b6: No bootstrap required, opened a new log
I20260709 13:14:16.791358   821 raft_consensus.cc:359] T 00000000000000000000000000000000 P ad52ddf7e7024b99ae92e692fa7b09b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad52ddf7e7024b99ae92e692fa7b09b6" member_type: VOTER }
I20260709 13:14:16.791729   821 raft_consensus.cc:385] T 00000000000000000000000000000000 P ad52ddf7e7024b99ae92e692fa7b09b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:16.792006   821 raft_consensus.cc:740] T 00000000000000000000000000000000 P ad52ddf7e7024b99ae92e692fa7b09b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad52ddf7e7024b99ae92e692fa7b09b6, State: Initialized, Role: FOLLOWER
I20260709 13:14:16.792554   821 consensus_queue.cc:260] T 00000000000000000000000000000000 P ad52ddf7e7024b99ae92e692fa7b09b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad52ddf7e7024b99ae92e692fa7b09b6" member_type: VOTER }
I20260709 13:14:16.793048   821 raft_consensus.cc:399] T 00000000000000000000000000000000 P ad52ddf7e7024b99ae92e692fa7b09b6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:14:16.793280   821 raft_consensus.cc:493] T 00000000000000000000000000000000 P ad52ddf7e7024b99ae92e692fa7b09b6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:14:16.793538   821 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ad52ddf7e7024b99ae92e692fa7b09b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:16.798286   821 raft_consensus.cc:515] T 00000000000000000000000000000000 P ad52ddf7e7024b99ae92e692fa7b09b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad52ddf7e7024b99ae92e692fa7b09b6" member_type: VOTER }
I20260709 13:14:16.798779   821 leader_election.cc:304] T 00000000000000000000000000000000 P ad52ddf7e7024b99ae92e692fa7b09b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ad52ddf7e7024b99ae92e692fa7b09b6; no voters: 
I20260709 13:14:16.799896   821 leader_election.cc:290] T 00000000000000000000000000000000 P ad52ddf7e7024b99ae92e692fa7b09b6 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:14:16.800340   824 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ad52ddf7e7024b99ae92e692fa7b09b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:16.801694   824 raft_consensus.cc:697] T 00000000000000000000000000000000 P ad52ddf7e7024b99ae92e692fa7b09b6 [term 1 LEADER]: Becoming Leader. State: Replica: ad52ddf7e7024b99ae92e692fa7b09b6, State: Running, Role: LEADER
I20260709 13:14:16.802413   824 consensus_queue.cc:237] T 00000000000000000000000000000000 P ad52ddf7e7024b99ae92e692fa7b09b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad52ddf7e7024b99ae92e692fa7b09b6" member_type: VOTER }
I20260709 13:14:16.802873   821 sys_catalog.cc:565] T 00000000000000000000000000000000 P ad52ddf7e7024b99ae92e692fa7b09b6 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:14:16.807389   826 sys_catalog.cc:455] T 00000000000000000000000000000000 P ad52ddf7e7024b99ae92e692fa7b09b6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ad52ddf7e7024b99ae92e692fa7b09b6. Latest consensus state: current_term: 1 leader_uuid: "ad52ddf7e7024b99ae92e692fa7b09b6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad52ddf7e7024b99ae92e692fa7b09b6" member_type: VOTER } }
I20260709 13:14:16.807472   825 sys_catalog.cc:455] T 00000000000000000000000000000000 P ad52ddf7e7024b99ae92e692fa7b09b6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ad52ddf7e7024b99ae92e692fa7b09b6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad52ddf7e7024b99ae92e692fa7b09b6" member_type: VOTER } }
I20260709 13:14:16.808350   826 sys_catalog.cc:458] T 00000000000000000000000000000000 P ad52ddf7e7024b99ae92e692fa7b09b6 [sys.catalog]: This master's current role is: LEADER
I20260709 13:14:16.808419   825 sys_catalog.cc:458] T 00000000000000000000000000000000 P ad52ddf7e7024b99ae92e692fa7b09b6 [sys.catalog]: This master's current role is: LEADER
I20260709 13:14:16.811331   832 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:14:16.816170   832 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:14:16.820111 24113 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:14:16.825122   832 catalog_manager.cc:1383] Generated new cluster ID: 0bef9d5475a14af5afadcdc89ffbb3ec
I20260709 13:14:16.825385   832 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:14:16.843713   832 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:14:16.845024   832 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:14:16.863654   832 catalog_manager.cc:6070] T 00000000000000000000000000000000 P ad52ddf7e7024b99ae92e692fa7b09b6: Generated new TSK 0
I20260709 13:14:16.864259   832 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:14:16.886842 24113 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:16.892823   842 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:16.893985   843 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:16.898154   845 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:16.898245 24113 server_base.cc:1061] running on GCE node
I20260709 13:14:16.899544 24113 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:16.899782 24113 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:16.899955 24113 hybrid_clock.cc:648] HybridClock initialized: now 1783602856899938 us; error 0 us; skew 500 ppm
I20260709 13:14:16.900512 24113 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:16.903051 24113 webserver.cc:533] Webserver started at http://127.23.140.65:34511/ using document root <none> and password file <none>
I20260709 13:14:16.903550 24113 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:16.903769 24113 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:16.904038 24113 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:16.905236 24113 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602598684750-24113-0/minicluster-data/ts-0-root/instance:
uuid: "61f6499bd59f483d803e6ec8310a59f6"
format_stamp: "Formatted at 2026-07-09 13:14:16 on dist-test-slave-1rs3"
I20260709 13:14:16.909953 24113 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:14:16.913403   850 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:16.914497 24113 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:14:16.914804 24113 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602598684750-24113-0/minicluster-data/ts-0-root
uuid: "61f6499bd59f483d803e6ec8310a59f6"
format_stamp: "Formatted at 2026-07-09 13:14:16 on dist-test-slave-1rs3"
I20260709 13:14:16.915094 24113 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602598684750-24113-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602598684750-24113-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602598684750-24113-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:16.951774 24113 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:16.953022 24113 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:16.954557 24113 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:16.956764 24113 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:16.956981 24113 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:16.957222 24113 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:16.957417 24113 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:16.997601 24113 rpc_server.cc:307] RPC server started. Bound to: 127.23.140.65:40703
I20260709 13:14:16.997695   912 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.140.65:40703 every 8 connection(s)
I20260709 13:14:17.002946 24113 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:17.009791   917 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:17.012490   918 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:17.015849 24113 server_base.cc:1061] running on GCE node
W20260709 13:14:17.016247   920 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:17.017104   913 heartbeater.cc:344] Connected to a master server at 127.23.140.126:34355
I20260709 13:14:17.017520   913 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:17.017505 24113 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:17.018045 24113 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:17.018258 24113 hybrid_clock.cc:648] HybridClock initialized: now 1783602857018230 us; error 0 us; skew 500 ppm
I20260709 13:14:17.018689   913 heartbeater.cc:507] Master 127.23.140.126:34355 requested a full tablet report, sending...
I20260709 13:14:17.019043 24113 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:17.021030   786 ts_manager.cc:194] Registered new tserver with Master: 61f6499bd59f483d803e6ec8310a59f6 (127.23.140.65:40703)
I20260709 13:14:17.021930 24113 webserver.cc:533] Webserver started at http://127.23.140.66:36581/ using document root <none> and password file <none>
I20260709 13:14:17.022454 24113 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:17.022658 24113 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:17.022920 24113 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:17.023139   786 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46738
I20260709 13:14:17.024165 24113 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602598684750-24113-0/minicluster-data/ts-1-root/instance:
uuid: "879436de3e4347fab8aabd74b4e3b16a"
format_stamp: "Formatted at 2026-07-09 13:14:17 on dist-test-slave-1rs3"
I20260709 13:14:17.028626 24113 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 13:14:17.032015   925 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:17.032745 24113 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:14:17.033044 24113 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602598684750-24113-0/minicluster-data/ts-1-root
uuid: "879436de3e4347fab8aabd74b4e3b16a"
format_stamp: "Formatted at 2026-07-09 13:14:17 on dist-test-slave-1rs3"
I20260709 13:14:17.033308 24113 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602598684750-24113-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602598684750-24113-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602598684750-24113-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:17.054116 24113 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:17.055333 24113 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:17.057075 24113 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:17.059337 24113 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:17.059578 24113 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:17.059823 24113 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:17.059991 24113 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:17.099360 24113 rpc_server.cc:307] RPC server started. Bound to: 127.23.140.66:35213
I20260709 13:14:17.099483   987 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.140.66:35213 every 8 connection(s)
I20260709 13:14:17.104568 24113 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:17.112735   991 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:17.114715   992 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:17.118873 24113 server_base.cc:1061] running on GCE node
W20260709 13:14:17.119194   994 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:17.119910   988 heartbeater.cc:344] Connected to a master server at 127.23.140.126:34355
I20260709 13:14:17.120362   988 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:17.120422 24113 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:17.120783 24113 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:17.120990 24113 hybrid_clock.cc:648] HybridClock initialized: now 1783602857120968 us; error 0 us; skew 500 ppm
I20260709 13:14:17.121259   988 heartbeater.cc:507] Master 127.23.140.126:34355 requested a full tablet report, sending...
I20260709 13:14:17.121721 24113 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:17.123450   786 ts_manager.cc:194] Registered new tserver with Master: 879436de3e4347fab8aabd74b4e3b16a (127.23.140.66:35213)
I20260709 13:14:17.124866 24113 webserver.cc:533] Webserver started at http://127.23.140.67:45655/ using document root <none> and password file <none>
I20260709 13:14:17.125027   786 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46754
I20260709 13:14:17.125558 24113 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:17.125876 24113 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:17.126245 24113 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:17.127585 24113 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602598684750-24113-0/minicluster-data/ts-2-root/instance:
uuid: "f4f72ff07bec49f78a46a271be825b10"
format_stamp: "Formatted at 2026-07-09 13:14:17 on dist-test-slave-1rs3"
I20260709 13:14:17.133019 24113 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:14:17.136559   999 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:17.137391 24113 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:14:17.137722 24113 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602598684750-24113-0/minicluster-data/ts-2-root
uuid: "f4f72ff07bec49f78a46a271be825b10"
format_stamp: "Formatted at 2026-07-09 13:14:17 on dist-test-slave-1rs3"
I20260709 13:14:17.138116 24113 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602598684750-24113-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602598684750-24113-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602598684750-24113-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:17.150420 24113 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:17.151763 24113 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:17.153344 24113 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:17.155898 24113 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:17.156140 24113 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:17.156409 24113 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:17.156602 24113 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:17.199584 24113 rpc_server.cc:307] RPC server started. Bound to: 127.23.140.67:37427
I20260709 13:14:17.199687  1061 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.140.67:37427 every 8 connection(s)
I20260709 13:14:17.215034  1062 heartbeater.cc:344] Connected to a master server at 127.23.140.126:34355
I20260709 13:14:17.215504  1062 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:17.216313  1062 heartbeater.cc:507] Master 127.23.140.126:34355 requested a full tablet report, sending...
I20260709 13:14:17.218199   786 ts_manager.cc:194] Registered new tserver with Master: f4f72ff07bec49f78a46a271be825b10 (127.23.140.67:37427)
I20260709 13:14:17.219278 24113 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016020976s
I20260709 13:14:17.219544   786 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46770
I20260709 13:14:17.244592   786 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46784:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:14:17.246869   786 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:14:17.302649   953 tablet_service.cc:1511] Processing CreateTablet for tablet a596ccef936042d5a8539eb0376fbcee (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=fe632b69bc74467bae7102f2cbca1511]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:14:17.303125   952 tablet_service.cc:1511] Processing CreateTablet for tablet 9f67e58e67d041a1b17ba18d95127114 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=fe632b69bc74467bae7102f2cbca1511]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:14:17.304212   953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a596ccef936042d5a8539eb0376fbcee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:17.303891  1027 tablet_service.cc:1511] Processing CreateTablet for tablet a596ccef936042d5a8539eb0376fbcee (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=fe632b69bc74467bae7102f2cbca1511]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:14:17.305315  1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a596ccef936042d5a8539eb0376fbcee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:17.305619  1026 tablet_service.cc:1511] Processing CreateTablet for tablet 9f67e58e67d041a1b17ba18d95127114 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=fe632b69bc74467bae7102f2cbca1511]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:14:17.306543   878 tablet_service.cc:1511] Processing CreateTablet for tablet a596ccef936042d5a8539eb0376fbcee (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=fe632b69bc74467bae7102f2cbca1511]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:14:17.306960  1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f67e58e67d041a1b17ba18d95127114. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:17.307868   878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a596ccef936042d5a8539eb0376fbcee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:17.309846   952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f67e58e67d041a1b17ba18d95127114. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:17.305328   877 tablet_service.cc:1511] Processing CreateTablet for tablet 9f67e58e67d041a1b17ba18d95127114 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=fe632b69bc74467bae7102f2cbca1511]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:14:17.311362   877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f67e58e67d041a1b17ba18d95127114. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:17.351107  1078 tablet_bootstrap.cc:492] T a596ccef936042d5a8539eb0376fbcee P 61f6499bd59f483d803e6ec8310a59f6: Bootstrap starting.
I20260709 13:14:17.352205  1077 tablet_bootstrap.cc:492] T 9f67e58e67d041a1b17ba18d95127114 P f4f72ff07bec49f78a46a271be825b10: Bootstrap starting.
I20260709 13:14:17.354360  1079 tablet_bootstrap.cc:492] T a596ccef936042d5a8539eb0376fbcee P 879436de3e4347fab8aabd74b4e3b16a: Bootstrap starting.
I20260709 13:14:17.358148  1078 tablet_bootstrap.cc:654] T a596ccef936042d5a8539eb0376fbcee P 61f6499bd59f483d803e6ec8310a59f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.360076  1077 tablet_bootstrap.cc:654] T 9f67e58e67d041a1b17ba18d95127114 P f4f72ff07bec49f78a46a271be825b10: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.360486  1079 tablet_bootstrap.cc:654] T a596ccef936042d5a8539eb0376fbcee P 879436de3e4347fab8aabd74b4e3b16a: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.370913  1077 tablet_bootstrap.cc:492] T 9f67e58e67d041a1b17ba18d95127114 P f4f72ff07bec49f78a46a271be825b10: No bootstrap required, opened a new log
I20260709 13:14:17.371043  1078 tablet_bootstrap.cc:492] T a596ccef936042d5a8539eb0376fbcee P 61f6499bd59f483d803e6ec8310a59f6: No bootstrap required, opened a new log
I20260709 13:14:17.371100  1079 tablet_bootstrap.cc:492] T a596ccef936042d5a8539eb0376fbcee P 879436de3e4347fab8aabd74b4e3b16a: No bootstrap required, opened a new log
I20260709 13:14:17.371369  1077 ts_tablet_manager.cc:1403] T 9f67e58e67d041a1b17ba18d95127114 P f4f72ff07bec49f78a46a271be825b10: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.003s
I20260709 13:14:17.371673  1078 ts_tablet_manager.cc:1403] T a596ccef936042d5a8539eb0376fbcee P 61f6499bd59f483d803e6ec8310a59f6: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.005s
I20260709 13:14:17.371733  1079 ts_tablet_manager.cc:1403] T a596ccef936042d5a8539eb0376fbcee P 879436de3e4347fab8aabd74b4e3b16a: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.007s
I20260709 13:14:17.373903  1077 raft_consensus.cc:359] T 9f67e58e67d041a1b17ba18d95127114 P f4f72ff07bec49f78a46a271be825b10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61f6499bd59f483d803e6ec8310a59f6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 40703 } } peers { permanent_uuid: "879436de3e4347fab8aabd74b4e3b16a" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 35213 } } peers { permanent_uuid: "f4f72ff07bec49f78a46a271be825b10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 37427 } }
I20260709 13:14:17.374526  1077 raft_consensus.cc:385] T 9f67e58e67d041a1b17ba18d95127114 P f4f72ff07bec49f78a46a271be825b10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.374775  1077 raft_consensus.cc:740] T 9f67e58e67d041a1b17ba18d95127114 P f4f72ff07bec49f78a46a271be825b10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4f72ff07bec49f78a46a271be825b10, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.374897  1078 raft_consensus.cc:359] T a596ccef936042d5a8539eb0376fbcee P 61f6499bd59f483d803e6ec8310a59f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61f6499bd59f483d803e6ec8310a59f6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 40703 } } peers { permanent_uuid: "f4f72ff07bec49f78a46a271be825b10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 37427 } } peers { permanent_uuid: "879436de3e4347fab8aabd74b4e3b16a" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 35213 } }
I20260709 13:14:17.375126  1079 raft_consensus.cc:359] T a596ccef936042d5a8539eb0376fbcee P 879436de3e4347fab8aabd74b4e3b16a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61f6499bd59f483d803e6ec8310a59f6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 40703 } } peers { permanent_uuid: "f4f72ff07bec49f78a46a271be825b10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 37427 } } peers { permanent_uuid: "879436de3e4347fab8aabd74b4e3b16a" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 35213 } }
I20260709 13:14:17.375711  1078 raft_consensus.cc:385] T a596ccef936042d5a8539eb0376fbcee P 61f6499bd59f483d803e6ec8310a59f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.375443  1077 consensus_queue.cc:260] T 9f67e58e67d041a1b17ba18d95127114 P f4f72ff07bec49f78a46a271be825b10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61f6499bd59f483d803e6ec8310a59f6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 40703 } } peers { permanent_uuid: "879436de3e4347fab8aabd74b4e3b16a" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 35213 } } peers { permanent_uuid: "f4f72ff07bec49f78a46a271be825b10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 37427 } }
I20260709 13:14:17.375929  1079 raft_consensus.cc:385] T a596ccef936042d5a8539eb0376fbcee P 879436de3e4347fab8aabd74b4e3b16a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.376076  1078 raft_consensus.cc:740] T a596ccef936042d5a8539eb0376fbcee P 61f6499bd59f483d803e6ec8310a59f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61f6499bd59f483d803e6ec8310a59f6, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.376318  1079 raft_consensus.cc:740] T a596ccef936042d5a8539eb0376fbcee P 879436de3e4347fab8aabd74b4e3b16a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879436de3e4347fab8aabd74b4e3b16a, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.376888  1078 consensus_queue.cc:260] T a596ccef936042d5a8539eb0376fbcee P 61f6499bd59f483d803e6ec8310a59f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61f6499bd59f483d803e6ec8310a59f6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 40703 } } peers { permanent_uuid: "f4f72ff07bec49f78a46a271be825b10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 37427 } } peers { permanent_uuid: "879436de3e4347fab8aabd74b4e3b16a" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 35213 } }
I20260709 13:14:17.377162  1079 consensus_queue.cc:260] T a596ccef936042d5a8539eb0376fbcee P 879436de3e4347fab8aabd74b4e3b16a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61f6499bd59f483d803e6ec8310a59f6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 40703 } } peers { permanent_uuid: "f4f72ff07bec49f78a46a271be825b10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 37427 } } peers { permanent_uuid: "879436de3e4347fab8aabd74b4e3b16a" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 35213 } }
I20260709 13:14:17.379009  1062 heartbeater.cc:499] Master 127.23.140.126:34355 was elected leader, sending a full tablet report...
I20260709 13:14:17.382861  1077 ts_tablet_manager.cc:1434] T 9f67e58e67d041a1b17ba18d95127114 P f4f72ff07bec49f78a46a271be825b10: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.003s
I20260709 13:14:17.383862  1077 tablet_bootstrap.cc:492] T a596ccef936042d5a8539eb0376fbcee P f4f72ff07bec49f78a46a271be825b10: Bootstrap starting.
I20260709 13:14:17.384310  1079 ts_tablet_manager.cc:1434] T a596ccef936042d5a8539eb0376fbcee P 879436de3e4347fab8aabd74b4e3b16a: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.003s
I20260709 13:14:17.385303   988 heartbeater.cc:499] Master 127.23.140.126:34355 was elected leader, sending a full tablet report...
I20260709 13:14:17.390524  1077 tablet_bootstrap.cc:654] T a596ccef936042d5a8539eb0376fbcee P f4f72ff07bec49f78a46a271be825b10: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.393762  1079 tablet_bootstrap.cc:492] T 9f67e58e67d041a1b17ba18d95127114 P 879436de3e4347fab8aabd74b4e3b16a: Bootstrap starting.
I20260709 13:14:17.403551   913 heartbeater.cc:499] Master 127.23.140.126:34355 was elected leader, sending a full tablet report...
I20260709 13:14:17.404091  1078 ts_tablet_manager.cc:1434] T a596ccef936042d5a8539eb0376fbcee P 61f6499bd59f483d803e6ec8310a59f6: Time spent starting tablet: real 0.032s	user 0.018s	sys 0.015s
I20260709 13:14:17.405222  1078 tablet_bootstrap.cc:492] T 9f67e58e67d041a1b17ba18d95127114 P 61f6499bd59f483d803e6ec8310a59f6: Bootstrap starting.
I20260709 13:14:17.406917  1079 tablet_bootstrap.cc:654] T 9f67e58e67d041a1b17ba18d95127114 P 879436de3e4347fab8aabd74b4e3b16a: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.411846  1078 tablet_bootstrap.cc:654] T 9f67e58e67d041a1b17ba18d95127114 P 61f6499bd59f483d803e6ec8310a59f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.412897  1077 tablet_bootstrap.cc:492] T a596ccef936042d5a8539eb0376fbcee P f4f72ff07bec49f78a46a271be825b10: No bootstrap required, opened a new log
I20260709 13:14:17.413483  1077 ts_tablet_manager.cc:1403] T a596ccef936042d5a8539eb0376fbcee P f4f72ff07bec49f78a46a271be825b10: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.013s
I20260709 13:14:17.414681  1079 tablet_bootstrap.cc:492] T 9f67e58e67d041a1b17ba18d95127114 P 879436de3e4347fab8aabd74b4e3b16a: No bootstrap required, opened a new log
I20260709 13:14:17.415342  1079 ts_tablet_manager.cc:1403] T 9f67e58e67d041a1b17ba18d95127114 P 879436de3e4347fab8aabd74b4e3b16a: Time spent bootstrapping tablet: real 0.022s	user 0.008s	sys 0.006s
I20260709 13:14:17.416563  1077 raft_consensus.cc:359] T a596ccef936042d5a8539eb0376fbcee P f4f72ff07bec49f78a46a271be825b10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61f6499bd59f483d803e6ec8310a59f6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 40703 } } peers { permanent_uuid: "f4f72ff07bec49f78a46a271be825b10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 37427 } } peers { permanent_uuid: "879436de3e4347fab8aabd74b4e3b16a" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 35213 } }
I20260709 13:14:17.417390  1077 raft_consensus.cc:385] T a596ccef936042d5a8539eb0376fbcee P f4f72ff07bec49f78a46a271be825b10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.417764  1077 raft_consensus.cc:740] T a596ccef936042d5a8539eb0376fbcee P f4f72ff07bec49f78a46a271be825b10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4f72ff07bec49f78a46a271be825b10, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.418730  1077 consensus_queue.cc:260] T a596ccef936042d5a8539eb0376fbcee P f4f72ff07bec49f78a46a271be825b10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61f6499bd59f483d803e6ec8310a59f6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 40703 } } peers { permanent_uuid: "f4f72ff07bec49f78a46a271be825b10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 37427 } } peers { permanent_uuid: "879436de3e4347fab8aabd74b4e3b16a" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 35213 } }
I20260709 13:14:17.419139  1079 raft_consensus.cc:359] T 9f67e58e67d041a1b17ba18d95127114 P 879436de3e4347fab8aabd74b4e3b16a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61f6499bd59f483d803e6ec8310a59f6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 40703 } } peers { permanent_uuid: "879436de3e4347fab8aabd74b4e3b16a" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 35213 } } peers { permanent_uuid: "f4f72ff07bec49f78a46a271be825b10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 37427 } }
I20260709 13:14:17.420234  1079 raft_consensus.cc:385] T 9f67e58e67d041a1b17ba18d95127114 P 879436de3e4347fab8aabd74b4e3b16a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.420675  1079 raft_consensus.cc:740] T 9f67e58e67d041a1b17ba18d95127114 P 879436de3e4347fab8aabd74b4e3b16a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879436de3e4347fab8aabd74b4e3b16a, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.411756  1083 raft_consensus.cc:493] T 9f67e58e67d041a1b17ba18d95127114 P f4f72ff07bec49f78a46a271be825b10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.421821  1079 consensus_queue.cc:260] T 9f67e58e67d041a1b17ba18d95127114 P 879436de3e4347fab8aabd74b4e3b16a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61f6499bd59f483d803e6ec8310a59f6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 40703 } } peers { permanent_uuid: "879436de3e4347fab8aabd74b4e3b16a" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 35213 } } peers { permanent_uuid: "f4f72ff07bec49f78a46a271be825b10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 37427 } }
I20260709 13:14:17.421815  1083 raft_consensus.cc:515] T 9f67e58e67d041a1b17ba18d95127114 P f4f72ff07bec49f78a46a271be825b10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61f6499bd59f483d803e6ec8310a59f6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 40703 } } peers { permanent_uuid: "879436de3e4347fab8aabd74b4e3b16a" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 35213 } } peers { permanent_uuid: "f4f72ff07bec49f78a46a271be825b10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 37427 } }
I20260709 13:14:17.423826  1078 tablet_bootstrap.cc:492] T 9f67e58e67d041a1b17ba18d95127114 P 61f6499bd59f483d803e6ec8310a59f6: No bootstrap required, opened a new log
I20260709 13:14:17.424384  1078 ts_tablet_manager.cc:1403] T 9f67e58e67d041a1b17ba18d95127114 P 61f6499bd59f483d803e6ec8310a59f6: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.008s
I20260709 13:14:17.425550  1083 leader_election.cc:290] T 9f67e58e67d041a1b17ba18d95127114 P f4f72ff07bec49f78a46a271be825b10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61f6499bd59f483d803e6ec8310a59f6 (127.23.140.65:40703), 879436de3e4347fab8aabd74b4e3b16a (127.23.140.66:35213)
I20260709 13:14:17.428107  1078 raft_consensus.cc:359] T 9f67e58e67d041a1b17ba18d95127114 P 61f6499bd59f483d803e6ec8310a59f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61f6499bd59f483d803e6ec8310a59f6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 40703 } } peers { permanent_uuid: "879436de3e4347fab8aabd74b4e3b16a" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 35213 } } peers { permanent_uuid: "f4f72ff07bec49f78a46a271be825b10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 37427 } }
I20260709 13:14:17.428901  1078 raft_consensus.cc:385] T 9f67e58e67d041a1b17ba18d95127114 P 61f6499bd59f483d803e6ec8310a59f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.429244  1078 raft_consensus.cc:740] T 9f67e58e67d041a1b17ba18d95127114 P 61f6499bd59f483d803e6ec8310a59f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61f6499bd59f483d803e6ec8310a59f6, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.429395  1079 ts_tablet_manager.cc:1434] T 9f67e58e67d041a1b17ba18d95127114 P 879436de3e4347fab8aabd74b4e3b16a: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:14:17.430255  1078 consensus_queue.cc:260] T 9f67e58e67d041a1b17ba18d95127114 P 61f6499bd59f483d803e6ec8310a59f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61f6499bd59f483d803e6ec8310a59f6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 40703 } } peers { permanent_uuid: "879436de3e4347fab8aabd74b4e3b16a" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 35213 } } peers { permanent_uuid: "f4f72ff07bec49f78a46a271be825b10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 37427 } }
I20260709 13:14:17.434603  1078 ts_tablet_manager.cc:1434] T 9f67e58e67d041a1b17ba18d95127114 P 61f6499bd59f483d803e6ec8310a59f6: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:14:17.439502  1077 ts_tablet_manager.cc:1434] T a596ccef936042d5a8539eb0376fbcee P f4f72ff07bec49f78a46a271be825b10: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.004s
I20260709 13:14:17.445313   888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f67e58e67d041a1b17ba18d95127114" candidate_uuid: "f4f72ff07bec49f78a46a271be825b10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61f6499bd59f483d803e6ec8310a59f6" is_pre_election: true
I20260709 13:14:17.446077   888 raft_consensus.cc:2468] T 9f67e58e67d041a1b17ba18d95127114 P 61f6499bd59f483d803e6ec8310a59f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4f72ff07bec49f78a46a271be825b10 in term 0.
I20260709 13:14:17.447487  1002 leader_election.cc:304] T 9f67e58e67d041a1b17ba18d95127114 P f4f72ff07bec49f78a46a271be825b10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61f6499bd59f483d803e6ec8310a59f6, f4f72ff07bec49f78a46a271be825b10; no voters: 
I20260709 13:14:17.448275  1083 raft_consensus.cc:2804] T 9f67e58e67d041a1b17ba18d95127114 P f4f72ff07bec49f78a46a271be825b10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:17.448693  1083 raft_consensus.cc:493] T 9f67e58e67d041a1b17ba18d95127114 P f4f72ff07bec49f78a46a271be825b10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:17.449116  1083 raft_consensus.cc:3060] T 9f67e58e67d041a1b17ba18d95127114 P f4f72ff07bec49f78a46a271be825b10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.449399   963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f67e58e67d041a1b17ba18d95127114" candidate_uuid: "f4f72ff07bec49f78a46a271be825b10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879436de3e4347fab8aabd74b4e3b16a" is_pre_election: true
I20260709 13:14:17.450145   963 raft_consensus.cc:2468] T 9f67e58e67d041a1b17ba18d95127114 P 879436de3e4347fab8aabd74b4e3b16a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4f72ff07bec49f78a46a271be825b10 in term 0.
I20260709 13:14:17.454685  1083 raft_consensus.cc:515] T 9f67e58e67d041a1b17ba18d95127114 P f4f72ff07bec49f78a46a271be825b10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61f6499bd59f483d803e6ec8310a59f6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 40703 } } peers { permanent_uuid: "879436de3e4347fab8aabd74b4e3b16a" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 35213 } } peers { permanent_uuid: "f4f72ff07bec49f78a46a271be825b10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 37427 } }
I20260709 13:14:17.456255  1083 leader_election.cc:290] T 9f67e58e67d041a1b17ba18d95127114 P f4f72ff07bec49f78a46a271be825b10 [CANDIDATE]: Term 1 election: Requested vote from peers 61f6499bd59f483d803e6ec8310a59f6 (127.23.140.65:40703), 879436de3e4347fab8aabd74b4e3b16a (127.23.140.66:35213)
I20260709 13:14:17.457104   888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f67e58e67d041a1b17ba18d95127114" candidate_uuid: "f4f72ff07bec49f78a46a271be825b10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61f6499bd59f483d803e6ec8310a59f6"
I20260709 13:14:17.457356   963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f67e58e67d041a1b17ba18d95127114" candidate_uuid: "f4f72ff07bec49f78a46a271be825b10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879436de3e4347fab8aabd74b4e3b16a"
I20260709 13:14:17.457703   888 raft_consensus.cc:3060] T 9f67e58e67d041a1b17ba18d95127114 P 61f6499bd59f483d803e6ec8310a59f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.458439   963 raft_consensus.cc:3060] T 9f67e58e67d041a1b17ba18d95127114 P 879436de3e4347fab8aabd74b4e3b16a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.465916   888 raft_consensus.cc:2468] T 9f67e58e67d041a1b17ba18d95127114 P 61f6499bd59f483d803e6ec8310a59f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4f72ff07bec49f78a46a271be825b10 in term 1.
I20260709 13:14:17.466063   963 raft_consensus.cc:2468] T 9f67e58e67d041a1b17ba18d95127114 P 879436de3e4347fab8aabd74b4e3b16a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4f72ff07bec49f78a46a271be825b10 in term 1.
I20260709 13:14:17.467132  1002 leader_election.cc:304] T 9f67e58e67d041a1b17ba18d95127114 P f4f72ff07bec49f78a46a271be825b10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61f6499bd59f483d803e6ec8310a59f6, f4f72ff07bec49f78a46a271be825b10; no voters: 
I20260709 13:14:17.467720  1083 raft_consensus.cc:2804] T 9f67e58e67d041a1b17ba18d95127114 P f4f72ff07bec49f78a46a271be825b10 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:17.468146  1083 raft_consensus.cc:697] T 9f67e58e67d041a1b17ba18d95127114 P f4f72ff07bec49f78a46a271be825b10 [term 1 LEADER]: Becoming Leader. State: Replica: f4f72ff07bec49f78a46a271be825b10, State: Running, Role: LEADER
I20260709 13:14:17.468845  1083 consensus_queue.cc:237] T 9f67e58e67d041a1b17ba18d95127114 P f4f72ff07bec49f78a46a271be825b10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61f6499bd59f483d803e6ec8310a59f6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 40703 } } peers { permanent_uuid: "879436de3e4347fab8aabd74b4e3b16a" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 35213 } } peers { permanent_uuid: "f4f72ff07bec49f78a46a271be825b10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 37427 } }
I20260709 13:14:17.476658   784 catalog_manager.cc:5697] T 9f67e58e67d041a1b17ba18d95127114 P f4f72ff07bec49f78a46a271be825b10 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4f72ff07bec49f78a46a271be825b10 (127.23.140.67). New cstate: current_term: 1 leader_uuid: "f4f72ff07bec49f78a46a271be825b10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61f6499bd59f483d803e6ec8310a59f6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 40703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "879436de3e4347fab8aabd74b4e3b16a" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 35213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4f72ff07bec49f78a46a271be825b10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 37427 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:17.574918  1084 raft_consensus.cc:493] T a596ccef936042d5a8539eb0376fbcee P 61f6499bd59f483d803e6ec8310a59f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.575503  1084 raft_consensus.cc:515] T a596ccef936042d5a8539eb0376fbcee P 61f6499bd59f483d803e6ec8310a59f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61f6499bd59f483d803e6ec8310a59f6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 40703 } } peers { permanent_uuid: "f4f72ff07bec49f78a46a271be825b10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 37427 } } peers { permanent_uuid: "879436de3e4347fab8aabd74b4e3b16a" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 35213 } }
I20260709 13:14:17.577595  1084 leader_election.cc:290] T a596ccef936042d5a8539eb0376fbcee P 61f6499bd59f483d803e6ec8310a59f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4f72ff07bec49f78a46a271be825b10 (127.23.140.67:37427), 879436de3e4347fab8aabd74b4e3b16a (127.23.140.66:35213)
I20260709 13:14:17.587836  1037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a596ccef936042d5a8539eb0376fbcee" candidate_uuid: "61f6499bd59f483d803e6ec8310a59f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4f72ff07bec49f78a46a271be825b10" is_pre_election: true
I20260709 13:14:17.588639  1037 raft_consensus.cc:2468] T a596ccef936042d5a8539eb0376fbcee P f4f72ff07bec49f78a46a271be825b10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61f6499bd59f483d803e6ec8310a59f6 in term 0.
I20260709 13:14:17.588788   963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a596ccef936042d5a8539eb0376fbcee" candidate_uuid: "61f6499bd59f483d803e6ec8310a59f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879436de3e4347fab8aabd74b4e3b16a" is_pre_election: true
I20260709 13:14:17.589468   963 raft_consensus.cc:2468] T a596ccef936042d5a8539eb0376fbcee P 879436de3e4347fab8aabd74b4e3b16a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61f6499bd59f483d803e6ec8310a59f6 in term 0.
I20260709 13:14:17.589654   851 leader_election.cc:304] T a596ccef936042d5a8539eb0376fbcee P 61f6499bd59f483d803e6ec8310a59f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61f6499bd59f483d803e6ec8310a59f6, f4f72ff07bec49f78a46a271be825b10; no voters: 
I20260709 13:14:17.590600  1084 raft_consensus.cc:2804] T a596ccef936042d5a8539eb0376fbcee P 61f6499bd59f483d803e6ec8310a59f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:17.590952  1084 raft_consensus.cc:493] T a596ccef936042d5a8539eb0376fbcee P 61f6499bd59f483d803e6ec8310a59f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:17.591173  1084 raft_consensus.cc:3060] T a596ccef936042d5a8539eb0376fbcee P 61f6499bd59f483d803e6ec8310a59f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.596395  1084 raft_consensus.cc:515] T a596ccef936042d5a8539eb0376fbcee P 61f6499bd59f483d803e6ec8310a59f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61f6499bd59f483d803e6ec8310a59f6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 40703 } } peers { permanent_uuid: "f4f72ff07bec49f78a46a271be825b10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 37427 } } peers { permanent_uuid: "879436de3e4347fab8aabd74b4e3b16a" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 35213 } }
I20260709 13:14:17.598076  1084 leader_election.cc:290] T a596ccef936042d5a8539eb0376fbcee P 61f6499bd59f483d803e6ec8310a59f6 [CANDIDATE]: Term 1 election: Requested vote from peers f4f72ff07bec49f78a46a271be825b10 (127.23.140.67:37427), 879436de3e4347fab8aabd74b4e3b16a (127.23.140.66:35213)
I20260709 13:14:17.598897  1037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a596ccef936042d5a8539eb0376fbcee" candidate_uuid: "61f6499bd59f483d803e6ec8310a59f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4f72ff07bec49f78a46a271be825b10"
I20260709 13:14:17.599143   963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a596ccef936042d5a8539eb0376fbcee" candidate_uuid: "61f6499bd59f483d803e6ec8310a59f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879436de3e4347fab8aabd74b4e3b16a"
I20260709 13:14:17.599551  1037 raft_consensus.cc:3060] T a596ccef936042d5a8539eb0376fbcee P f4f72ff07bec49f78a46a271be825b10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.599682   963 raft_consensus.cc:3060] T a596ccef936042d5a8539eb0376fbcee P 879436de3e4347fab8aabd74b4e3b16a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.606871   963 raft_consensus.cc:2468] T a596ccef936042d5a8539eb0376fbcee P 879436de3e4347fab8aabd74b4e3b16a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61f6499bd59f483d803e6ec8310a59f6 in term 1.
I20260709 13:14:17.606871  1037 raft_consensus.cc:2468] T a596ccef936042d5a8539eb0376fbcee P f4f72ff07bec49f78a46a271be825b10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61f6499bd59f483d803e6ec8310a59f6 in term 1.
I20260709 13:14:17.608184   853 leader_election.cc:304] T a596ccef936042d5a8539eb0376fbcee P 61f6499bd59f483d803e6ec8310a59f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61f6499bd59f483d803e6ec8310a59f6, 879436de3e4347fab8aabd74b4e3b16a; no voters: 
I20260709 13:14:17.608870  1084 raft_consensus.cc:2804] T a596ccef936042d5a8539eb0376fbcee P 61f6499bd59f483d803e6ec8310a59f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:17.609973  1084 raft_consensus.cc:697] T a596ccef936042d5a8539eb0376fbcee P 61f6499bd59f483d803e6ec8310a59f6 [term 1 LEADER]: Becoming Leader. State: Replica: 61f6499bd59f483d803e6ec8310a59f6, State: Running, Role: LEADER
I20260709 13:14:17.610755  1084 consensus_queue.cc:237] T a596ccef936042d5a8539eb0376fbcee P 61f6499bd59f483d803e6ec8310a59f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61f6499bd59f483d803e6ec8310a59f6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 40703 } } peers { permanent_uuid: "f4f72ff07bec49f78a46a271be825b10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 37427 } } peers { permanent_uuid: "879436de3e4347fab8aabd74b4e3b16a" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 35213 } }
I20260709 13:14:17.617308   784 catalog_manager.cc:5697] T a596ccef936042d5a8539eb0376fbcee P 61f6499bd59f483d803e6ec8310a59f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61f6499bd59f483d803e6ec8310a59f6 (127.23.140.65). New cstate: current_term: 1 leader_uuid: "61f6499bd59f483d803e6ec8310a59f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61f6499bd59f483d803e6ec8310a59f6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 40703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4f72ff07bec49f78a46a271be825b10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 37427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "879436de3e4347fab8aabd74b4e3b16a" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 35213 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:17.697134   784 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40936:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:14:17.699165   784 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:14:17.722321   877 tablet_service.cc:1511] Processing CreateTablet for tablet 3b87f9943cce4bdd9e4723fe01bea331 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=9af827373d9c49e2bd4662f9a9ed70ff]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:14:17.723627   877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b87f9943cce4bdd9e4723fe01bea331. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:17.723668   952 tablet_service.cc:1511] Processing CreateTablet for tablet 3b87f9943cce4bdd9e4723fe01bea331 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=9af827373d9c49e2bd4662f9a9ed70ff]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:14:17.724973   952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b87f9943cce4bdd9e4723fe01bea331. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:17.726366   878 tablet_service.cc:1511] Processing CreateTablet for tablet 8b21d8f2d5d443eeb9003f0690fdf52b (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=9af827373d9c49e2bd4662f9a9ed70ff]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:14:17.727574   878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b21d8f2d5d443eeb9003f0690fdf52b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:17.727397   953 tablet_service.cc:1511] Processing CreateTablet for tablet 8b21d8f2d5d443eeb9003f0690fdf52b (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=9af827373d9c49e2bd4662f9a9ed70ff]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:14:17.728611   953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b21d8f2d5d443eeb9003f0690fdf52b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:17.731909  1027 tablet_service.cc:1511] Processing CreateTablet for tablet 8b21d8f2d5d443eeb9003f0690fdf52b (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=9af827373d9c49e2bd4662f9a9ed70ff]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:14:17.732877  1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b21d8f2d5d443eeb9003f0690fdf52b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:17.734736  1026 tablet_service.cc:1511] Processing CreateTablet for tablet 3b87f9943cce4bdd9e4723fe01bea331 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=9af827373d9c49e2bd4662f9a9ed70ff]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:14:17.735980  1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b87f9943cce4bdd9e4723fe01bea331. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:17.747768  1079 tablet_bootstrap.cc:492] T 8b21d8f2d5d443eeb9003f0690fdf52b P 879436de3e4347fab8aabd74b4e3b16a: Bootstrap starting.
I20260709 13:14:17.749115  1077 tablet_bootstrap.cc:492] T 8b21d8f2d5d443eeb9003f0690fdf52b P f4f72ff07bec49f78a46a271be825b10: Bootstrap starting.
I20260709 13:14:17.754947  1079 tablet_bootstrap.cc:654] T 8b21d8f2d5d443eeb9003f0690fdf52b P 879436de3e4347fab8aabd74b4e3b16a: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.756634  1077 tablet_bootstrap.cc:654] T 8b21d8f2d5d443eeb9003f0690fdf52b P f4f72ff07bec49f78a46a271be825b10: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.764945  1078 tablet_bootstrap.cc:492] T 8b21d8f2d5d443eeb9003f0690fdf52b P 61f6499bd59f483d803e6ec8310a59f6: Bootstrap starting.
I20260709 13:14:17.766144  1077 tablet_bootstrap.cc:492] T 8b21d8f2d5d443eeb9003f0690fdf52b P f4f72ff07bec49f78a46a271be825b10: No bootstrap required, opened a new log
I20260709 13:14:17.767931  1077 ts_tablet_manager.cc:1403] T 8b21d8f2d5d443eeb9003f0690fdf52b P f4f72ff07bec49f78a46a271be825b10: Time spent bootstrapping tablet: real 0.019s	user 0.006s	sys 0.007s
I20260709 13:14:17.772179  1078 tablet_bootstrap.cc:654] T 8b21d8f2d5d443eeb9003f0690fdf52b P 61f6499bd59f483d803e6ec8310a59f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.771747  1077 raft_consensus.cc:359] T 8b21d8f2d5d443eeb9003f0690fdf52b P f4f72ff07bec49f78a46a271be825b10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61f6499bd59f483d803e6ec8310a59f6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 40703 } } peers { permanent_uuid: "879436de3e4347fab8aabd74b4e3b16a" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 35213 } } peers { permanent_uuid: "f4f72ff07bec49f78a46a271be825b10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 37427 } }
I20260709 13:14:17.772697  1077 raft_consensus.cc:385] T 8b21d8f2d5d443eeb9003f0690fdf52b P f4f72ff07bec49f78a46a271be825b10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.773056  1077 raft_consensus.cc:740] T 8b21d8f2d5d443eeb9003f0690fdf52b P f4f72ff07bec49f78a46a271be825b10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4f72ff07bec49f78a46a271be825b10, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.773344  1079 tablet_bootstrap.cc:492] T 8b21d8f2d5d443eeb9003f0690fdf52b P 879436de3e4347fab8aabd74b4e3b16a: No bootstrap required, opened a new log
I20260709 13:14:17.773918  1079 ts_tablet_manager.cc:1403] T 8b21d8f2d5d443eeb9003f0690fdf52b P 879436de3e4347fab8aabd74b4e3b16a: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.010s
I20260709 13:14:17.773924  1077 consensus_queue.cc:260] T 8b21d8f2d5d443eeb9003f0690fdf52b P f4f72ff07bec49f78a46a271be825b10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61f6499bd59f483d803e6ec8310a59f6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 40703 } } peers { permanent_uuid: "879436de3e4347fab8aabd74b4e3b16a" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 35213 } } peers { permanent_uuid: "f4f72ff07bec49f78a46a271be825b10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 37427 } }
I20260709 13:14:17.776746  1077 ts_tablet_manager.cc:1434] T 8b21d8f2d5d443eeb9003f0690fdf52b P f4f72ff07bec49f78a46a271be825b10: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:14:17.777002  1079 raft_consensus.cc:359] T 8b21d8f2d5d443eeb9003f0690fdf52b P 879436de3e4347fab8aabd74b4e3b16a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61f6499bd59f483d803e6ec8310a59f6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 40703 } } peers { permanent_uuid: "879436de3e4347fab8aabd74b4e3b16a" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 35213 } } peers { permanent_uuid: "f4f72ff07bec49f78a46a271be825b10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 37427 } }
I20260709 13:14:17.777880  1079 raft_consensus.cc:385] T 8b21d8f2d5d443eeb9003f0690fdf52b P 879436de3e4347fab8aabd74b4e3b16a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.778133  1077 tablet_bootstrap.cc:492] T 3b87f9943cce4bdd9e4723fe01bea331 P f4f72ff07bec49f78a46a271be825b10: Bootstrap starting.
I20260709 13:14:17.778292  1079 raft_consensus.cc:740] T 8b21d8f2d5d443eeb9003f0690fdf52b P 879436de3e4347fab8aabd74b4e3b16a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879436de3e4347fab8aabd74b4e3b16a, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.780707  1079 consensus_queue.cc:260] T 8b21d8f2d5d443eeb9003f0690fdf52b P 879436de3e4347fab8aabd74b4e3b16a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61f6499bd59f483d803e6ec8310a59f6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 40703 } } peers { permanent_uuid: "879436de3e4347fab8aabd74b4e3b16a" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 35213 } } peers { permanent_uuid: "f4f72ff07bec49f78a46a271be825b10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 37427 } }
I20260709 13:14:17.783620  1078 tablet_bootstrap.cc:492] T 8b21d8f2d5d443eeb9003f0690fdf52b P 61f6499bd59f483d803e6ec8310a59f6: No bootstrap required, opened a new log
I20260709 13:14:17.784278  1078 ts_tablet_manager.cc:1403] T 8b21d8f2d5d443eeb9003f0690fdf52b P 61f6499bd59f483d803e6ec8310a59f6: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.004s
I20260709 13:14:17.786170  1077 tablet_bootstrap.cc:654] T 3b87f9943cce4bdd9e4723fe01bea331 P f4f72ff07bec49f78a46a271be825b10: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.787170  1079 ts_tablet_manager.cc:1434] T 8b21d8f2d5d443eeb9003f0690fdf52b P 879436de3e4347fab8aabd74b4e3b16a: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:14:17.787498  1078 raft_consensus.cc:359] T 8b21d8f2d5d443eeb9003f0690fdf52b P 61f6499bd59f483d803e6ec8310a59f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61f6499bd59f483d803e6ec8310a59f6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 40703 } } peers { permanent_uuid: "879436de3e4347fab8aabd74b4e3b16a" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 35213 } } peers { permanent_uuid: "f4f72ff07bec49f78a46a271be825b10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 37427 } }
I20260709 13:14:17.788296  1079 tablet_bootstrap.cc:492] T 3b87f9943cce4bdd9e4723fe01bea331 P 879436de3e4347fab8aabd74b4e3b16a: Bootstrap starting.
I20260709 13:14:17.788352  1078 raft_consensus.cc:385] T 8b21d8f2d5d443eeb9003f0690fdf52b P 61f6499bd59f483d803e6ec8310a59f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.792858  1078 raft_consensus.cc:740] T 8b21d8f2d5d443eeb9003f0690fdf52b P 61f6499bd59f483d803e6ec8310a59f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61f6499bd59f483d803e6ec8310a59f6, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.793828  1078 consensus_queue.cc:260] T 8b21d8f2d5d443eeb9003f0690fdf52b P 61f6499bd59f483d803e6ec8310a59f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61f6499bd59f483d803e6ec8310a59f6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 40703 } } peers { permanent_uuid: "879436de3e4347fab8aabd74b4e3b16a" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 35213 } } peers { permanent_uuid: "f4f72ff07bec49f78a46a271be825b10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 37427 } }
I20260709 13:14:17.794910  1077 tablet_bootstrap.cc:492] T 3b87f9943cce4bdd9e4723fe01bea331 P f4f72ff07bec49f78a46a271be825b10: No bootstrap required, opened a new log
I20260709 13:14:17.795459  1077 ts_tablet_manager.cc:1403] T 3b87f9943cce4bdd9e4723fe01bea331 P f4f72ff07bec49f78a46a271be825b10: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 13:14:17.796492  1079 tablet_bootstrap.cc:654] T 3b87f9943cce4bdd9e4723fe01bea331 P 879436de3e4347fab8aabd74b4e3b16a: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.798069  1078 ts_tablet_manager.cc:1434] T 8b21d8f2d5d443eeb9003f0690fdf52b P 61f6499bd59f483d803e6ec8310a59f6: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.004s
I20260709 13:14:17.798472  1077 raft_consensus.cc:359] T 3b87f9943cce4bdd9e4723fe01bea331 P f4f72ff07bec49f78a46a271be825b10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61f6499bd59f483d803e6ec8310a59f6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 40703 } } peers { permanent_uuid: "879436de3e4347fab8aabd74b4e3b16a" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 35213 } } peers { permanent_uuid: "f4f72ff07bec49f78a46a271be825b10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 37427 } }
I20260709 13:14:17.799335  1078 tablet_bootstrap.cc:492] T 3b87f9943cce4bdd9e4723fe01bea331 P 61f6499bd59f483d803e6ec8310a59f6: Bootstrap starting.
I20260709 13:14:17.799321  1077 raft_consensus.cc:385] T 3b87f9943cce4bdd9e4723fe01bea331 P f4f72ff07bec49f78a46a271be825b10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.800347  1077 raft_consensus.cc:740] T 3b87f9943cce4bdd9e4723fe01bea331 P f4f72ff07bec49f78a46a271be825b10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4f72ff07bec49f78a46a271be825b10, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.801292  1077 consensus_queue.cc:260] T 3b87f9943cce4bdd9e4723fe01bea331 P f4f72ff07bec49f78a46a271be825b10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61f6499bd59f483d803e6ec8310a59f6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 40703 } } peers { permanent_uuid: "879436de3e4347fab8aabd74b4e3b16a" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 35213 } } peers { permanent_uuid: "f4f72ff07bec49f78a46a271be825b10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 37427 } }
I20260709 13:14:17.803145  1079 tablet_bootstrap.cc:492] T 3b87f9943cce4bdd9e4723fe01bea331 P 879436de3e4347fab8aabd74b4e3b16a: No bootstrap required, opened a new log
I20260709 13:14:17.803575  1077 ts_tablet_manager.cc:1434] T 3b87f9943cce4bdd9e4723fe01bea331 P f4f72ff07bec49f78a46a271be825b10: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:14:17.803696  1079 ts_tablet_manager.cc:1403] T 3b87f9943cce4bdd9e4723fe01bea331 P 879436de3e4347fab8aabd74b4e3b16a: Time spent bootstrapping tablet: real 0.016s	user 0.005s	sys 0.007s
I20260709 13:14:17.806780  1079 raft_consensus.cc:359] T 3b87f9943cce4bdd9e4723fe01bea331 P 879436de3e4347fab8aabd74b4e3b16a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61f6499bd59f483d803e6ec8310a59f6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 40703 } } peers { permanent_uuid: "879436de3e4347fab8aabd74b4e3b16a" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 35213 } } peers { permanent_uuid: "f4f72ff07bec49f78a46a271be825b10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 37427 } }
I20260709 13:14:17.807488  1079 raft_consensus.cc:385] T 3b87f9943cce4bdd9e4723fe01bea331 P 879436de3e4347fab8aabd74b4e3b16a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.807770  1079 raft_consensus.cc:740] T 3b87f9943cce4bdd9e4723fe01bea331 P 879436de3e4347fab8aabd74b4e3b16a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879436de3e4347fab8aabd74b4e3b16a, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.808694  1079 consensus_queue.cc:260] T 3b87f9943cce4bdd9e4723fe01bea331 P 879436de3e4347fab8aabd74b4e3b16a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61f6499bd59f483d803e6ec8310a59f6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 40703 } } peers { permanent_uuid: "879436de3e4347fab8aabd74b4e3b16a" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 35213 } } peers { permanent_uuid: "f4f72ff07bec49f78a46a271be825b10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 37427 } }
I20260709 13:14:17.809887  1078 tablet_bootstrap.cc:654] T 3b87f9943cce4bdd9e4723fe01bea331 P 61f6499bd59f483d803e6ec8310a59f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.812798  1079 ts_tablet_manager.cc:1434] T 3b87f9943cce4bdd9e4723fe01bea331 P 879436de3e4347fab8aabd74b4e3b16a: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
W20260709 13:14:17.816327   834 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:17.817525  1078 tablet_bootstrap.cc:492] T 3b87f9943cce4bdd9e4723fe01bea331 P 61f6499bd59f483d803e6ec8310a59f6: No bootstrap required, opened a new log
I20260709 13:14:17.818158  1078 ts_tablet_manager.cc:1403] T 3b87f9943cce4bdd9e4723fe01bea331 P 61f6499bd59f483d803e6ec8310a59f6: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.002s
I20260709 13:14:17.821100  1078 raft_consensus.cc:359] T 3b87f9943cce4bdd9e4723fe01bea331 P 61f6499bd59f483d803e6ec8310a59f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61f6499bd59f483d803e6ec8310a59f6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 40703 } } peers { permanent_uuid: "879436de3e4347fab8aabd74b4e3b16a" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 35213 } } peers { permanent_uuid: "f4f72ff07bec49f78a46a271be825b10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 37427 } }
I20260709 13:14:17.821862  1078 raft_consensus.cc:385] T 3b87f9943cce4bdd9e4723fe01bea331 P 61f6499bd59f483d803e6ec8310a59f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.822153  1078 raft_consensus.cc:740] T 3b87f9943cce4bdd9e4723fe01bea331 P 61f6499bd59f483d803e6ec8310a59f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61f6499bd59f483d803e6ec8310a59f6, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.822885  1078 consensus_queue.cc:260] T 3b87f9943cce4bdd9e4723fe01bea331 P 61f6499bd59f483d803e6ec8310a59f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61f6499bd59f483d803e6ec8310a59f6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 40703 } } peers { permanent_uuid: "879436de3e4347fab8aabd74b4e3b16a" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 35213 } } peers { permanent_uuid: "f4f72ff07bec49f78a46a271be825b10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 37427 } }
I20260709 13:14:17.826377  1078 ts_tablet_manager.cc:1434] T 3b87f9943cce4bdd9e4723fe01bea331 P 61f6499bd59f483d803e6ec8310a59f6: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:14:17.891470  1084 raft_consensus.cc:493] T 8b21d8f2d5d443eeb9003f0690fdf52b P 61f6499bd59f483d803e6ec8310a59f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.891950  1084 raft_consensus.cc:515] T 8b21d8f2d5d443eeb9003f0690fdf52b P 61f6499bd59f483d803e6ec8310a59f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61f6499bd59f483d803e6ec8310a59f6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 40703 } } peers { permanent_uuid: "879436de3e4347fab8aabd74b4e3b16a" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 35213 } } peers { permanent_uuid: "f4f72ff07bec49f78a46a271be825b10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 37427 } }
I20260709 13:14:17.893826  1084 leader_election.cc:290] T 8b21d8f2d5d443eeb9003f0690fdf52b P 61f6499bd59f483d803e6ec8310a59f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 879436de3e4347fab8aabd74b4e3b16a (127.23.140.66:35213), f4f72ff07bec49f78a46a271be825b10 (127.23.140.67:37427)
I20260709 13:14:17.894558   963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b21d8f2d5d443eeb9003f0690fdf52b" candidate_uuid: "61f6499bd59f483d803e6ec8310a59f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879436de3e4347fab8aabd74b4e3b16a" is_pre_election: true
I20260709 13:14:17.894881  1037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b21d8f2d5d443eeb9003f0690fdf52b" candidate_uuid: "61f6499bd59f483d803e6ec8310a59f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4f72ff07bec49f78a46a271be825b10" is_pre_election: true
I20260709 13:14:17.895287   963 raft_consensus.cc:2468] T 8b21d8f2d5d443eeb9003f0690fdf52b P 879436de3e4347fab8aabd74b4e3b16a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61f6499bd59f483d803e6ec8310a59f6 in term 0.
I20260709 13:14:17.895507  1037 raft_consensus.cc:2468] T 8b21d8f2d5d443eeb9003f0690fdf52b P f4f72ff07bec49f78a46a271be825b10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61f6499bd59f483d803e6ec8310a59f6 in term 0.
I20260709 13:14:17.896384   853 leader_election.cc:304] T 8b21d8f2d5d443eeb9003f0690fdf52b P 61f6499bd59f483d803e6ec8310a59f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61f6499bd59f483d803e6ec8310a59f6, 879436de3e4347fab8aabd74b4e3b16a; no voters: 
I20260709 13:14:17.897038  1084 raft_consensus.cc:2804] T 8b21d8f2d5d443eeb9003f0690fdf52b P 61f6499bd59f483d803e6ec8310a59f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:17.897410  1084 raft_consensus.cc:493] T 8b21d8f2d5d443eeb9003f0690fdf52b P 61f6499bd59f483d803e6ec8310a59f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:17.897681  1084 raft_consensus.cc:3060] T 8b21d8f2d5d443eeb9003f0690fdf52b P 61f6499bd59f483d803e6ec8310a59f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.903067  1084 raft_consensus.cc:515] T 8b21d8f2d5d443eeb9003f0690fdf52b P 61f6499bd59f483d803e6ec8310a59f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61f6499bd59f483d803e6ec8310a59f6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 40703 } } peers { permanent_uuid: "879436de3e4347fab8aabd74b4e3b16a" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 35213 } } peers { permanent_uuid: "f4f72ff07bec49f78a46a271be825b10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 37427 } }
I20260709 13:14:17.904726  1084 leader_election.cc:290] T 8b21d8f2d5d443eeb9003f0690fdf52b P 61f6499bd59f483d803e6ec8310a59f6 [CANDIDATE]: Term 1 election: Requested vote from peers 879436de3e4347fab8aabd74b4e3b16a (127.23.140.66:35213), f4f72ff07bec49f78a46a271be825b10 (127.23.140.67:37427)
I20260709 13:14:17.905437   963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b21d8f2d5d443eeb9003f0690fdf52b" candidate_uuid: "61f6499bd59f483d803e6ec8310a59f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879436de3e4347fab8aabd74b4e3b16a"
I20260709 13:14:17.905715  1037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b21d8f2d5d443eeb9003f0690fdf52b" candidate_uuid: "61f6499bd59f483d803e6ec8310a59f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4f72ff07bec49f78a46a271be825b10"
I20260709 13:14:17.906085   963 raft_consensus.cc:3060] T 8b21d8f2d5d443eeb9003f0690fdf52b P 879436de3e4347fab8aabd74b4e3b16a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.906322  1037 raft_consensus.cc:3060] T 8b21d8f2d5d443eeb9003f0690fdf52b P f4f72ff07bec49f78a46a271be825b10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.913086  1037 raft_consensus.cc:2468] T 8b21d8f2d5d443eeb9003f0690fdf52b P f4f72ff07bec49f78a46a271be825b10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61f6499bd59f483d803e6ec8310a59f6 in term 1.
I20260709 13:14:17.913086   963 raft_consensus.cc:2468] T 8b21d8f2d5d443eeb9003f0690fdf52b P 879436de3e4347fab8aabd74b4e3b16a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61f6499bd59f483d803e6ec8310a59f6 in term 1.
I20260709 13:14:17.914287   851 leader_election.cc:304] T 8b21d8f2d5d443eeb9003f0690fdf52b P 61f6499bd59f483d803e6ec8310a59f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61f6499bd59f483d803e6ec8310a59f6, f4f72ff07bec49f78a46a271be825b10; no voters: 
I20260709 13:14:17.914986  1084 raft_consensus.cc:2804] T 8b21d8f2d5d443eeb9003f0690fdf52b P 61f6499bd59f483d803e6ec8310a59f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:17.915375  1084 raft_consensus.cc:697] T 8b21d8f2d5d443eeb9003f0690fdf52b P 61f6499bd59f483d803e6ec8310a59f6 [term 1 LEADER]: Becoming Leader. State: Replica: 61f6499bd59f483d803e6ec8310a59f6, State: Running, Role: LEADER
I20260709 13:14:17.916121  1084 consensus_queue.cc:237] T 8b21d8f2d5d443eeb9003f0690fdf52b P 61f6499bd59f483d803e6ec8310a59f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61f6499bd59f483d803e6ec8310a59f6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 40703 } } peers { permanent_uuid: "879436de3e4347fab8aabd74b4e3b16a" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 35213 } } peers { permanent_uuid: "f4f72ff07bec49f78a46a271be825b10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 37427 } }
I20260709 13:14:17.922422   786 catalog_manager.cc:5697] T 8b21d8f2d5d443eeb9003f0690fdf52b P 61f6499bd59f483d803e6ec8310a59f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61f6499bd59f483d803e6ec8310a59f6 (127.23.140.65). New cstate: current_term: 1 leader_uuid: "61f6499bd59f483d803e6ec8310a59f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61f6499bd59f483d803e6ec8310a59f6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 40703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "879436de3e4347fab8aabd74b4e3b16a" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 35213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4f72ff07bec49f78a46a271be825b10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 37427 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:17.925050  1083 consensus_queue.cc:1048] T 9f67e58e67d041a1b17ba18d95127114 P f4f72ff07bec49f78a46a271be825b10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "879436de3e4347fab8aabd74b4e3b16a" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 35213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:17.942941  1083 consensus_queue.cc:1048] T 9f67e58e67d041a1b17ba18d95127114 P f4f72ff07bec49f78a46a271be825b10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61f6499bd59f483d803e6ec8310a59f6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 40703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:17.952292  1089 raft_consensus.cc:493] T 3b87f9943cce4bdd9e4723fe01bea331 P f4f72ff07bec49f78a46a271be825b10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.952853  1089 raft_consensus.cc:515] T 3b87f9943cce4bdd9e4723fe01bea331 P f4f72ff07bec49f78a46a271be825b10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61f6499bd59f483d803e6ec8310a59f6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 40703 } } peers { permanent_uuid: "879436de3e4347fab8aabd74b4e3b16a" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 35213 } } peers { permanent_uuid: "f4f72ff07bec49f78a46a271be825b10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 37427 } }
I20260709 13:14:17.955026  1089 leader_election.cc:290] T 3b87f9943cce4bdd9e4723fe01bea331 P f4f72ff07bec49f78a46a271be825b10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61f6499bd59f483d803e6ec8310a59f6 (127.23.140.65:40703), 879436de3e4347fab8aabd74b4e3b16a (127.23.140.66:35213)
I20260709 13:14:17.955581   888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b87f9943cce4bdd9e4723fe01bea331" candidate_uuid: "f4f72ff07bec49f78a46a271be825b10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61f6499bd59f483d803e6ec8310a59f6" is_pre_election: true
I20260709 13:14:17.956080   963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b87f9943cce4bdd9e4723fe01bea331" candidate_uuid: "f4f72ff07bec49f78a46a271be825b10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879436de3e4347fab8aabd74b4e3b16a" is_pre_election: true
I20260709 13:14:17.956262   888 raft_consensus.cc:2468] T 3b87f9943cce4bdd9e4723fe01bea331 P 61f6499bd59f483d803e6ec8310a59f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4f72ff07bec49f78a46a271be825b10 in term 0.
I20260709 13:14:17.956727   963 raft_consensus.cc:2468] T 3b87f9943cce4bdd9e4723fe01bea331 P 879436de3e4347fab8aabd74b4e3b16a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4f72ff07bec49f78a46a271be825b10 in term 0.
I20260709 13:14:17.957708  1002 leader_election.cc:304] T 3b87f9943cce4bdd9e4723fe01bea331 P f4f72ff07bec49f78a46a271be825b10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 879436de3e4347fab8aabd74b4e3b16a, f4f72ff07bec49f78a46a271be825b10; no voters: 
I20260709 13:14:17.958406  1089 raft_consensus.cc:2804] T 3b87f9943cce4bdd9e4723fe01bea331 P f4f72ff07bec49f78a46a271be825b10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:17.958755  1089 raft_consensus.cc:493] T 3b87f9943cce4bdd9e4723fe01bea331 P f4f72ff07bec49f78a46a271be825b10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:17.959081  1089 raft_consensus.cc:3060] T 3b87f9943cce4bdd9e4723fe01bea331 P f4f72ff07bec49f78a46a271be825b10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.964273  1089 raft_consensus.cc:515] T 3b87f9943cce4bdd9e4723fe01bea331 P f4f72ff07bec49f78a46a271be825b10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61f6499bd59f483d803e6ec8310a59f6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 40703 } } peers { permanent_uuid: "879436de3e4347fab8aabd74b4e3b16a" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 35213 } } peers { permanent_uuid: "f4f72ff07bec49f78a46a271be825b10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 37427 } }
I20260709 13:14:17.965876  1089 leader_election.cc:290] T 3b87f9943cce4bdd9e4723fe01bea331 P f4f72ff07bec49f78a46a271be825b10 [CANDIDATE]: Term 1 election: Requested vote from peers 61f6499bd59f483d803e6ec8310a59f6 (127.23.140.65:40703), 879436de3e4347fab8aabd74b4e3b16a (127.23.140.66:35213)
I20260709 13:14:17.966557   888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b87f9943cce4bdd9e4723fe01bea331" candidate_uuid: "f4f72ff07bec49f78a46a271be825b10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61f6499bd59f483d803e6ec8310a59f6"
I20260709 13:14:17.966861   963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b87f9943cce4bdd9e4723fe01bea331" candidate_uuid: "f4f72ff07bec49f78a46a271be825b10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879436de3e4347fab8aabd74b4e3b16a"
I20260709 13:14:17.967180   888 raft_consensus.cc:3060] T 3b87f9943cce4bdd9e4723fe01bea331 P 61f6499bd59f483d803e6ec8310a59f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.967433   963 raft_consensus.cc:3060] T 3b87f9943cce4bdd9e4723fe01bea331 P 879436de3e4347fab8aabd74b4e3b16a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.974058   888 raft_consensus.cc:2468] T 3b87f9943cce4bdd9e4723fe01bea331 P 61f6499bd59f483d803e6ec8310a59f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4f72ff07bec49f78a46a271be825b10 in term 1.
I20260709 13:14:17.974058   963 raft_consensus.cc:2468] T 3b87f9943cce4bdd9e4723fe01bea331 P 879436de3e4347fab8aabd74b4e3b16a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4f72ff07bec49f78a46a271be825b10 in term 1.
I20260709 13:14:17.975266  1002 leader_election.cc:304] T 3b87f9943cce4bdd9e4723fe01bea331 P f4f72ff07bec49f78a46a271be825b10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 879436de3e4347fab8aabd74b4e3b16a, f4f72ff07bec49f78a46a271be825b10; no voters: 
I20260709 13:14:17.975849  1089 raft_consensus.cc:2804] T 3b87f9943cce4bdd9e4723fe01bea331 P f4f72ff07bec49f78a46a271be825b10 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:17.976263  1089 raft_consensus.cc:697] T 3b87f9943cce4bdd9e4723fe01bea331 P f4f72ff07bec49f78a46a271be825b10 [term 1 LEADER]: Becoming Leader. State: Replica: f4f72ff07bec49f78a46a271be825b10, State: Running, Role: LEADER
I20260709 13:14:17.977063  1089 consensus_queue.cc:237] T 3b87f9943cce4bdd9e4723fe01bea331 P f4f72ff07bec49f78a46a271be825b10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61f6499bd59f483d803e6ec8310a59f6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 40703 } } peers { permanent_uuid: "879436de3e4347fab8aabd74b4e3b16a" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 35213 } } peers { permanent_uuid: "f4f72ff07bec49f78a46a271be825b10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 37427 } }
I20260709 13:14:17.983600   786 catalog_manager.cc:5697] T 3b87f9943cce4bdd9e4723fe01bea331 P f4f72ff07bec49f78a46a271be825b10 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4f72ff07bec49f78a46a271be825b10 (127.23.140.67). New cstate: current_term: 1 leader_uuid: "f4f72ff07bec49f78a46a271be825b10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61f6499bd59f483d803e6ec8310a59f6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 40703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "879436de3e4347fab8aabd74b4e3b16a" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 35213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4f72ff07bec49f78a46a271be825b10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 37427 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:18.062264  1037 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f67e58e67d041a1b17ba18d95127114"
dest_uuid: "f4f72ff07bec49f78a46a271be825b10"
mode: GRACEFUL
new_leader_uuid: "879436de3e4347fab8aabd74b4e3b16a"
 from {username='slave'} at 127.0.0.1:51712
I20260709 13:14:18.062875  1037 raft_consensus.cc:606] T 9f67e58e67d041a1b17ba18d95127114 P f4f72ff07bec49f78a46a271be825b10 [term 1 LEADER]: Received request to transfer leadership to TS 879436de3e4347fab8aabd74b4e3b16a
I20260709 13:14:18.067997  1037 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b87f9943cce4bdd9e4723fe01bea331"
dest_uuid: "f4f72ff07bec49f78a46a271be825b10"
mode: GRACEFUL
new_leader_uuid: "61f6499bd59f483d803e6ec8310a59f6"
 from {username='slave'} at 127.0.0.1:51712
I20260709 13:14:18.068477  1037 raft_consensus.cc:606] T 3b87f9943cce4bdd9e4723fe01bea331 P f4f72ff07bec49f78a46a271be825b10 [term 1 LEADER]: Received request to transfer leadership to TS 61f6499bd59f483d803e6ec8310a59f6
I20260709 13:14:18.148353  1084 consensus_queue.cc:1048] T a596ccef936042d5a8539eb0376fbcee P 61f6499bd59f483d803e6ec8310a59f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "879436de3e4347fab8aabd74b4e3b16a" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 35213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:18.159380  1084 consensus_queue.cc:1048] T a596ccef936042d5a8539eb0376fbcee P 61f6499bd59f483d803e6ec8310a59f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4f72ff07bec49f78a46a271be825b10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 37427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:18.328450  1117 consensus_queue.cc:1048] T 8b21d8f2d5d443eeb9003f0690fdf52b P 61f6499bd59f483d803e6ec8310a59f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "879436de3e4347fab8aabd74b4e3b16a" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 35213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:18.338366  1117 consensus_queue.cc:1048] T 8b21d8f2d5d443eeb9003f0690fdf52b P 61f6499bd59f483d803e6ec8310a59f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4f72ff07bec49f78a46a271be825b10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 37427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:18.430430  1111 raft_consensus.cc:993] T 9f67e58e67d041a1b17ba18d95127114 P f4f72ff07bec49f78a46a271be825b10: : Instructing follower 879436de3e4347fab8aabd74b4e3b16a to start an election
I20260709 13:14:18.430876  1089 raft_consensus.cc:1081] T 9f67e58e67d041a1b17ba18d95127114 P f4f72ff07bec49f78a46a271be825b10 [term 1 LEADER]: Signalling peer 879436de3e4347fab8aabd74b4e3b16a to start an election
I20260709 13:14:18.432147   963 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f67e58e67d041a1b17ba18d95127114"
dest_uuid: "879436de3e4347fab8aabd74b4e3b16a"
 from {username='slave'} at 127.0.0.1:49322
I20260709 13:14:18.432641   963 raft_consensus.cc:493] T 9f67e58e67d041a1b17ba18d95127114 P 879436de3e4347fab8aabd74b4e3b16a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:18.432951   963 raft_consensus.cc:3060] T 9f67e58e67d041a1b17ba18d95127114 P 879436de3e4347fab8aabd74b4e3b16a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:18.437953   963 raft_consensus.cc:515] T 9f67e58e67d041a1b17ba18d95127114 P 879436de3e4347fab8aabd74b4e3b16a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61f6499bd59f483d803e6ec8310a59f6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 40703 } } peers { permanent_uuid: "879436de3e4347fab8aabd74b4e3b16a" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 35213 } } peers { permanent_uuid: "f4f72ff07bec49f78a46a271be825b10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 37427 } }
I20260709 13:14:18.440054   963 leader_election.cc:290] T 9f67e58e67d041a1b17ba18d95127114 P 879436de3e4347fab8aabd74b4e3b16a [CANDIDATE]: Term 2 election: Requested vote from peers 61f6499bd59f483d803e6ec8310a59f6 (127.23.140.65:40703), f4f72ff07bec49f78a46a271be825b10 (127.23.140.67:37427)
I20260709 13:14:18.446120  1089 consensus_queue.cc:1048] T 3b87f9943cce4bdd9e4723fe01bea331 P f4f72ff07bec49f78a46a271be825b10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "879436de3e4347fab8aabd74b4e3b16a" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 35213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:18.452548  1037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f67e58e67d041a1b17ba18d95127114" candidate_uuid: "879436de3e4347fab8aabd74b4e3b16a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f4f72ff07bec49f78a46a271be825b10"
I20260709 13:14:18.453392   888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f67e58e67d041a1b17ba18d95127114" candidate_uuid: "879436de3e4347fab8aabd74b4e3b16a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "61f6499bd59f483d803e6ec8310a59f6"
I20260709 13:14:18.453781  1037 raft_consensus.cc:3055] T 9f67e58e67d041a1b17ba18d95127114 P f4f72ff07bec49f78a46a271be825b10 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:18.454116   888 raft_consensus.cc:3060] T 9f67e58e67d041a1b17ba18d95127114 P 61f6499bd59f483d803e6ec8310a59f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:18.454173  1037 raft_consensus.cc:740] T 9f67e58e67d041a1b17ba18d95127114 P f4f72ff07bec49f78a46a271be825b10 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f4f72ff07bec49f78a46a271be825b10, State: Running, Role: LEADER
I20260709 13:14:18.455262  1037 consensus_queue.cc:260] T 9f67e58e67d041a1b17ba18d95127114 P f4f72ff07bec49f78a46a271be825b10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61f6499bd59f483d803e6ec8310a59f6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 40703 } } peers { permanent_uuid: "879436de3e4347fab8aabd74b4e3b16a" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 35213 } } peers { permanent_uuid: "f4f72ff07bec49f78a46a271be825b10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 37427 } }
I20260709 13:14:18.456763  1037 raft_consensus.cc:3060] T 9f67e58e67d041a1b17ba18d95127114 P f4f72ff07bec49f78a46a271be825b10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:18.461452   888 raft_consensus.cc:2468] T 9f67e58e67d041a1b17ba18d95127114 P 61f6499bd59f483d803e6ec8310a59f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879436de3e4347fab8aabd74b4e3b16a in term 2.
I20260709 13:14:18.464164  1037 raft_consensus.cc:2468] T 9f67e58e67d041a1b17ba18d95127114 P f4f72ff07bec49f78a46a271be825b10 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879436de3e4347fab8aabd74b4e3b16a in term 2.
I20260709 13:14:18.465361   928 leader_election.cc:304] T 9f67e58e67d041a1b17ba18d95127114 P 879436de3e4347fab8aabd74b4e3b16a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61f6499bd59f483d803e6ec8310a59f6, 879436de3e4347fab8aabd74b4e3b16a; no voters: 
I20260709 13:14:18.466220  1085 raft_consensus.cc:2804] T 9f67e58e67d041a1b17ba18d95127114 P 879436de3e4347fab8aabd74b4e3b16a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:18.466660  1089 consensus_queue.cc:1048] T 3b87f9943cce4bdd9e4723fe01bea331 P f4f72ff07bec49f78a46a271be825b10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61f6499bd59f483d803e6ec8310a59f6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 40703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:18.467622  1085 raft_consensus.cc:697] T 9f67e58e67d041a1b17ba18d95127114 P 879436de3e4347fab8aabd74b4e3b16a [term 2 LEADER]: Becoming Leader. State: Replica: 879436de3e4347fab8aabd74b4e3b16a, State: Running, Role: LEADER
I20260709 13:14:18.468544  1085 consensus_queue.cc:237] T 9f67e58e67d041a1b17ba18d95127114 P 879436de3e4347fab8aabd74b4e3b16a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61f6499bd59f483d803e6ec8310a59f6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 40703 } } peers { permanent_uuid: "879436de3e4347fab8aabd74b4e3b16a" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 35213 } } peers { permanent_uuid: "f4f72ff07bec49f78a46a271be825b10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 37427 } }
I20260709 13:14:18.474588  1111 raft_consensus.cc:993] T 3b87f9943cce4bdd9e4723fe01bea331 P f4f72ff07bec49f78a46a271be825b10: : Instructing follower 61f6499bd59f483d803e6ec8310a59f6 to start an election
I20260709 13:14:18.475080  1089 raft_consensus.cc:1081] T 3b87f9943cce4bdd9e4723fe01bea331 P f4f72ff07bec49f78a46a271be825b10 [term 1 LEADER]: Signalling peer 61f6499bd59f483d803e6ec8310a59f6 to start an election
I20260709 13:14:18.476716   888 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b87f9943cce4bdd9e4723fe01bea331"
dest_uuid: "61f6499bd59f483d803e6ec8310a59f6"
 from {username='slave'} at 127.0.0.1:37930
I20260709 13:14:18.476385   784 catalog_manager.cc:5697] T 9f67e58e67d041a1b17ba18d95127114 P 879436de3e4347fab8aabd74b4e3b16a reported cstate change: term changed from 1 to 2, leader changed from f4f72ff07bec49f78a46a271be825b10 (127.23.140.67) to 879436de3e4347fab8aabd74b4e3b16a (127.23.140.66). New cstate: current_term: 2 leader_uuid: "879436de3e4347fab8aabd74b4e3b16a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61f6499bd59f483d803e6ec8310a59f6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 40703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "879436de3e4347fab8aabd74b4e3b16a" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 35213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4f72ff07bec49f78a46a271be825b10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 37427 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:18.477347   888 raft_consensus.cc:493] T 3b87f9943cce4bdd9e4723fe01bea331 P 61f6499bd59f483d803e6ec8310a59f6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:18.477743   888 raft_consensus.cc:3060] T 3b87f9943cce4bdd9e4723fe01bea331 P 61f6499bd59f483d803e6ec8310a59f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:18.483268   888 raft_consensus.cc:515] T 3b87f9943cce4bdd9e4723fe01bea331 P 61f6499bd59f483d803e6ec8310a59f6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61f6499bd59f483d803e6ec8310a59f6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 40703 } } peers { permanent_uuid: "879436de3e4347fab8aabd74b4e3b16a" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 35213 } } peers { permanent_uuid: "f4f72ff07bec49f78a46a271be825b10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 37427 } }
I20260709 13:14:18.486282   888 leader_election.cc:290] T 3b87f9943cce4bdd9e4723fe01bea331 P 61f6499bd59f483d803e6ec8310a59f6 [CANDIDATE]: Term 2 election: Requested vote from peers 879436de3e4347fab8aabd74b4e3b16a (127.23.140.66:35213), f4f72ff07bec49f78a46a271be825b10 (127.23.140.67:37427)
I20260709 13:14:18.486336   963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b87f9943cce4bdd9e4723fe01bea331" candidate_uuid: "61f6499bd59f483d803e6ec8310a59f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "879436de3e4347fab8aabd74b4e3b16a"
I20260709 13:14:18.487097   963 raft_consensus.cc:3060] T 3b87f9943cce4bdd9e4723fe01bea331 P 879436de3e4347fab8aabd74b4e3b16a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:18.490001  1037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b87f9943cce4bdd9e4723fe01bea331" candidate_uuid: "61f6499bd59f483d803e6ec8310a59f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f4f72ff07bec49f78a46a271be825b10"
I20260709 13:14:18.490531  1037 raft_consensus.cc:3055] T 3b87f9943cce4bdd9e4723fe01bea331 P f4f72ff07bec49f78a46a271be825b10 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:18.490780  1037 raft_consensus.cc:740] T 3b87f9943cce4bdd9e4723fe01bea331 P f4f72ff07bec49f78a46a271be825b10 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f4f72ff07bec49f78a46a271be825b10, State: Running, Role: LEADER
I20260709 13:14:18.491493  1037 consensus_queue.cc:260] T 3b87f9943cce4bdd9e4723fe01bea331 P f4f72ff07bec49f78a46a271be825b10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61f6499bd59f483d803e6ec8310a59f6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 40703 } } peers { permanent_uuid: "879436de3e4347fab8aabd74b4e3b16a" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 35213 } } peers { permanent_uuid: "f4f72ff07bec49f78a46a271be825b10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 37427 } }
I20260709 13:14:18.492488   963 raft_consensus.cc:2468] T 3b87f9943cce4bdd9e4723fe01bea331 P 879436de3e4347fab8aabd74b4e3b16a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61f6499bd59f483d803e6ec8310a59f6 in term 2.
I20260709 13:14:18.492717  1037 raft_consensus.cc:3060] T 3b87f9943cce4bdd9e4723fe01bea331 P f4f72ff07bec49f78a46a271be825b10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:18.493652   853 leader_election.cc:304] T 3b87f9943cce4bdd9e4723fe01bea331 P 61f6499bd59f483d803e6ec8310a59f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61f6499bd59f483d803e6ec8310a59f6, 879436de3e4347fab8aabd74b4e3b16a; no voters: 
I20260709 13:14:18.494449  1117 raft_consensus.cc:2804] T 3b87f9943cce4bdd9e4723fe01bea331 P 61f6499bd59f483d803e6ec8310a59f6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:18.494961  1117 raft_consensus.cc:697] T 3b87f9943cce4bdd9e4723fe01bea331 P 61f6499bd59f483d803e6ec8310a59f6 [term 2 LEADER]: Becoming Leader. State: Replica: 61f6499bd59f483d803e6ec8310a59f6, State: Running, Role: LEADER
I20260709 13:14:18.495741  1117 consensus_queue.cc:237] T 3b87f9943cce4bdd9e4723fe01bea331 P 61f6499bd59f483d803e6ec8310a59f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61f6499bd59f483d803e6ec8310a59f6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 40703 } } peers { permanent_uuid: "879436de3e4347fab8aabd74b4e3b16a" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 35213 } } peers { permanent_uuid: "f4f72ff07bec49f78a46a271be825b10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 37427 } }
I20260709 13:14:18.499718  1037 raft_consensus.cc:2468] T 3b87f9943cce4bdd9e4723fe01bea331 P f4f72ff07bec49f78a46a271be825b10 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61f6499bd59f483d803e6ec8310a59f6 in term 2.
I20260709 13:14:18.502234   786 catalog_manager.cc:5697] T 3b87f9943cce4bdd9e4723fe01bea331 P 61f6499bd59f483d803e6ec8310a59f6 reported cstate change: term changed from 1 to 2, leader changed from f4f72ff07bec49f78a46a271be825b10 (127.23.140.67) to 61f6499bd59f483d803e6ec8310a59f6 (127.23.140.65). New cstate: current_term: 2 leader_uuid: "61f6499bd59f483d803e6ec8310a59f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61f6499bd59f483d803e6ec8310a59f6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 40703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "879436de3e4347fab8aabd74b4e3b16a" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 35213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4f72ff07bec49f78a46a271be825b10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 37427 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:18.788275 24113 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:14:18.789825 24113 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:14:18.790205 24113 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:14:18.800798   888 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b87f9943cce4bdd9e4723fe01bea331"
dest_uuid: "61f6499bd59f483d803e6ec8310a59f6"
mode: GRACEFUL
new_leader_uuid: "f4f72ff07bec49f78a46a271be825b10"
 from {username='slave'} at 127.0.0.1:49816
I20260709 13:14:18.801282   888 raft_consensus.cc:606] T 3b87f9943cce4bdd9e4723fe01bea331 P 61f6499bd59f483d803e6ec8310a59f6 [term 2 LEADER]: Received request to transfer leadership to TS f4f72ff07bec49f78a46a271be825b10
I20260709 13:14:18.802507 24113 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:14:18.930575   888 raft_consensus.cc:1275] T 9f67e58e67d041a1b17ba18d95127114 P 61f6499bd59f483d803e6ec8310a59f6 [term 2 FOLLOWER]: Refusing update from remote peer 879436de3e4347fab8aabd74b4e3b16a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:18.931977  1085 consensus_queue.cc:1048] T 9f67e58e67d041a1b17ba18d95127114 P 879436de3e4347fab8aabd74b4e3b16a [LEADER]: Connected to new peer: Peer: permanent_uuid: "61f6499bd59f483d803e6ec8310a59f6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 40703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:18.939162  1037 raft_consensus.cc:1275] T 9f67e58e67d041a1b17ba18d95127114 P f4f72ff07bec49f78a46a271be825b10 [term 2 FOLLOWER]: Refusing update from remote peer 879436de3e4347fab8aabd74b4e3b16a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:18.940780  1085 consensus_queue.cc:1048] T 9f67e58e67d041a1b17ba18d95127114 P 879436de3e4347fab8aabd74b4e3b16a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4f72ff07bec49f78a46a271be825b10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 37427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:18.957252   963 raft_consensus.cc:1275] T 3b87f9943cce4bdd9e4723fe01bea331 P 879436de3e4347fab8aabd74b4e3b16a [term 2 FOLLOWER]: Refusing update from remote peer 61f6499bd59f483d803e6ec8310a59f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:18.958583  1117 consensus_queue.cc:1048] T 3b87f9943cce4bdd9e4723fe01bea331 P 61f6499bd59f483d803e6ec8310a59f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "879436de3e4347fab8aabd74b4e3b16a" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 35213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:18.965442  1037 raft_consensus.cc:1275] T 3b87f9943cce4bdd9e4723fe01bea331 P f4f72ff07bec49f78a46a271be825b10 [term 2 FOLLOWER]: Refusing update from remote peer 61f6499bd59f483d803e6ec8310a59f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:18.967607  1094 consensus_queue.cc:1048] T 3b87f9943cce4bdd9e4723fe01bea331 P 61f6499bd59f483d803e6ec8310a59f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4f72ff07bec49f78a46a271be825b10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 37427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:18.974954  1084 raft_consensus.cc:993] T 3b87f9943cce4bdd9e4723fe01bea331 P 61f6499bd59f483d803e6ec8310a59f6: : Instructing follower f4f72ff07bec49f78a46a271be825b10 to start an election
I20260709 13:14:18.975399  1094 raft_consensus.cc:1081] T 3b87f9943cce4bdd9e4723fe01bea331 P 61f6499bd59f483d803e6ec8310a59f6 [term 2 LEADER]: Signalling peer f4f72ff07bec49f78a46a271be825b10 to start an election
I20260709 13:14:18.977108  1037 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b87f9943cce4bdd9e4723fe01bea331"
dest_uuid: "f4f72ff07bec49f78a46a271be825b10"
 from {username='slave'} at 127.0.0.1:55802
I20260709 13:14:18.977778  1037 raft_consensus.cc:493] T 3b87f9943cce4bdd9e4723fe01bea331 P f4f72ff07bec49f78a46a271be825b10 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:18.978211  1037 raft_consensus.cc:3060] T 3b87f9943cce4bdd9e4723fe01bea331 P f4f72ff07bec49f78a46a271be825b10 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:18.983618  1037 raft_consensus.cc:515] T 3b87f9943cce4bdd9e4723fe01bea331 P f4f72ff07bec49f78a46a271be825b10 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61f6499bd59f483d803e6ec8310a59f6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 40703 } } peers { permanent_uuid: "879436de3e4347fab8aabd74b4e3b16a" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 35213 } } peers { permanent_uuid: "f4f72ff07bec49f78a46a271be825b10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 37427 } }
I20260709 13:14:18.985224  1037 leader_election.cc:290] T 3b87f9943cce4bdd9e4723fe01bea331 P f4f72ff07bec49f78a46a271be825b10 [CANDIDATE]: Term 3 election: Requested vote from peers 61f6499bd59f483d803e6ec8310a59f6 (127.23.140.65:40703), 879436de3e4347fab8aabd74b4e3b16a (127.23.140.66:35213)
I20260709 13:14:18.985944   888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b87f9943cce4bdd9e4723fe01bea331" candidate_uuid: "f4f72ff07bec49f78a46a271be825b10" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "61f6499bd59f483d803e6ec8310a59f6"
I20260709 13:14:18.986166   963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b87f9943cce4bdd9e4723fe01bea331" candidate_uuid: "f4f72ff07bec49f78a46a271be825b10" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "879436de3e4347fab8aabd74b4e3b16a"
I20260709 13:14:18.986515   888 raft_consensus.cc:3055] T 3b87f9943cce4bdd9e4723fe01bea331 P 61f6499bd59f483d803e6ec8310a59f6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:18.986776   963 raft_consensus.cc:3060] T 3b87f9943cce4bdd9e4723fe01bea331 P 879436de3e4347fab8aabd74b4e3b16a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:18.986896   888 raft_consensus.cc:740] T 3b87f9943cce4bdd9e4723fe01bea331 P 61f6499bd59f483d803e6ec8310a59f6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 61f6499bd59f483d803e6ec8310a59f6, State: Running, Role: LEADER
I20260709 13:14:18.987843   888 consensus_queue.cc:260] T 3b87f9943cce4bdd9e4723fe01bea331 P 61f6499bd59f483d803e6ec8310a59f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61f6499bd59f483d803e6ec8310a59f6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 40703 } } peers { permanent_uuid: "879436de3e4347fab8aabd74b4e3b16a" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 35213 } } peers { permanent_uuid: "f4f72ff07bec49f78a46a271be825b10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 37427 } }
I20260709 13:14:18.988796   888 raft_consensus.cc:3060] T 3b87f9943cce4bdd9e4723fe01bea331 P 61f6499bd59f483d803e6ec8310a59f6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:18.992038   963 raft_consensus.cc:2468] T 3b87f9943cce4bdd9e4723fe01bea331 P 879436de3e4347fab8aabd74b4e3b16a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4f72ff07bec49f78a46a271be825b10 in term 3.
I20260709 13:14:18.993079  1002 leader_election.cc:304] T 3b87f9943cce4bdd9e4723fe01bea331 P f4f72ff07bec49f78a46a271be825b10 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 879436de3e4347fab8aabd74b4e3b16a, f4f72ff07bec49f78a46a271be825b10; no voters: 
I20260709 13:14:18.993927  1111 raft_consensus.cc:2804] T 3b87f9943cce4bdd9e4723fe01bea331 P f4f72ff07bec49f78a46a271be825b10 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:18.994026   888 raft_consensus.cc:2468] T 3b87f9943cce4bdd9e4723fe01bea331 P 61f6499bd59f483d803e6ec8310a59f6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4f72ff07bec49f78a46a271be825b10 in term 3.
I20260709 13:14:18.994930  1111 raft_consensus.cc:697] T 3b87f9943cce4bdd9e4723fe01bea331 P f4f72ff07bec49f78a46a271be825b10 [term 3 LEADER]: Becoming Leader. State: Replica: f4f72ff07bec49f78a46a271be825b10, State: Running, Role: LEADER
I20260709 13:14:18.995685  1111 consensus_queue.cc:237] T 3b87f9943cce4bdd9e4723fe01bea331 P f4f72ff07bec49f78a46a271be825b10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61f6499bd59f483d803e6ec8310a59f6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 40703 } } peers { permanent_uuid: "879436de3e4347fab8aabd74b4e3b16a" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 35213 } } peers { permanent_uuid: "f4f72ff07bec49f78a46a271be825b10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 37427 } }
I20260709 13:14:19.001835   786 catalog_manager.cc:5697] T 3b87f9943cce4bdd9e4723fe01bea331 P f4f72ff07bec49f78a46a271be825b10 reported cstate change: term changed from 2 to 3, leader changed from 61f6499bd59f483d803e6ec8310a59f6 (127.23.140.65) to f4f72ff07bec49f78a46a271be825b10 (127.23.140.67). New cstate: current_term: 3 leader_uuid: "f4f72ff07bec49f78a46a271be825b10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61f6499bd59f483d803e6ec8310a59f6" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 40703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "879436de3e4347fab8aabd74b4e3b16a" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 35213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4f72ff07bec49f78a46a271be825b10" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 37427 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:19.146607 24113 tablet_server.cc:179] TabletServer@127.23.140.65:0 shutting down...
I20260709 13:14:19.167492 24113 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:19.168121 24113 tablet_replica.cc:333] T 3b87f9943cce4bdd9e4723fe01bea331 P 61f6499bd59f483d803e6ec8310a59f6: stopping tablet replica
I20260709 13:14:19.168676 24113 raft_consensus.cc:2243] T 3b87f9943cce4bdd9e4723fe01bea331 P 61f6499bd59f483d803e6ec8310a59f6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:19.169138 24113 raft_consensus.cc:2272] T 3b87f9943cce4bdd9e4723fe01bea331 P 61f6499bd59f483d803e6ec8310a59f6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:19.171526 24113 tablet_replica.cc:333] T 8b21d8f2d5d443eeb9003f0690fdf52b P 61f6499bd59f483d803e6ec8310a59f6: stopping tablet replica
I20260709 13:14:19.172052 24113 raft_consensus.cc:2243] T 8b21d8f2d5d443eeb9003f0690fdf52b P 61f6499bd59f483d803e6ec8310a59f6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:19.172822 24113 raft_consensus.cc:2272] T 8b21d8f2d5d443eeb9003f0690fdf52b P 61f6499bd59f483d803e6ec8310a59f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:19.175022 24113 tablet_replica.cc:333] T 9f67e58e67d041a1b17ba18d95127114 P 61f6499bd59f483d803e6ec8310a59f6: stopping tablet replica
I20260709 13:14:19.175535 24113 raft_consensus.cc:2243] T 9f67e58e67d041a1b17ba18d95127114 P 61f6499bd59f483d803e6ec8310a59f6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:19.175981 24113 raft_consensus.cc:2272] T 9f67e58e67d041a1b17ba18d95127114 P 61f6499bd59f483d803e6ec8310a59f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:19.178486 24113 tablet_replica.cc:333] T a596ccef936042d5a8539eb0376fbcee P 61f6499bd59f483d803e6ec8310a59f6: stopping tablet replica
I20260709 13:14:19.178977 24113 raft_consensus.cc:2243] T a596ccef936042d5a8539eb0376fbcee P 61f6499bd59f483d803e6ec8310a59f6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:19.179780 24113 raft_consensus.cc:2272] T a596ccef936042d5a8539eb0376fbcee P 61f6499bd59f483d803e6ec8310a59f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:19.193710 24113 tablet_server.cc:196] TabletServer@127.23.140.65:0 shutdown complete.
I20260709 13:14:19.205170 24113 tablet_server.cc:179] TabletServer@127.23.140.66:0 shutting down...
I20260709 13:14:19.223712 24113 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:19.224371 24113 tablet_replica.cc:333] T 3b87f9943cce4bdd9e4723fe01bea331 P 879436de3e4347fab8aabd74b4e3b16a: stopping tablet replica
I20260709 13:14:19.224957 24113 raft_consensus.cc:2243] T 3b87f9943cce4bdd9e4723fe01bea331 P 879436de3e4347fab8aabd74b4e3b16a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:19.225405 24113 raft_consensus.cc:2272] T 3b87f9943cce4bdd9e4723fe01bea331 P 879436de3e4347fab8aabd74b4e3b16a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:19.227603 24113 tablet_replica.cc:333] T 8b21d8f2d5d443eeb9003f0690fdf52b P 879436de3e4347fab8aabd74b4e3b16a: stopping tablet replica
I20260709 13:14:19.228094 24113 raft_consensus.cc:2243] T 8b21d8f2d5d443eeb9003f0690fdf52b P 879436de3e4347fab8aabd74b4e3b16a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:19.228490 24113 raft_consensus.cc:2272] T 8b21d8f2d5d443eeb9003f0690fdf52b P 879436de3e4347fab8aabd74b4e3b16a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:19.230593 24113 tablet_replica.cc:333] T 9f67e58e67d041a1b17ba18d95127114 P 879436de3e4347fab8aabd74b4e3b16a: stopping tablet replica
I20260709 13:14:19.231070 24113 raft_consensus.cc:2243] T 9f67e58e67d041a1b17ba18d95127114 P 879436de3e4347fab8aabd74b4e3b16a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:19.231850 24113 raft_consensus.cc:2272] T 9f67e58e67d041a1b17ba18d95127114 P 879436de3e4347fab8aabd74b4e3b16a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:19.233933 24113 tablet_replica.cc:333] T a596ccef936042d5a8539eb0376fbcee P 879436de3e4347fab8aabd74b4e3b16a: stopping tablet replica
I20260709 13:14:19.234457 24113 raft_consensus.cc:2243] T a596ccef936042d5a8539eb0376fbcee P 879436de3e4347fab8aabd74b4e3b16a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:19.234865 24113 raft_consensus.cc:2272] T a596ccef936042d5a8539eb0376fbcee P 879436de3e4347fab8aabd74b4e3b16a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:19.257112 24113 tablet_server.cc:196] TabletServer@127.23.140.66:0 shutdown complete.
I20260709 13:14:19.268502 24113 tablet_server.cc:179] TabletServer@127.23.140.67:0 shutting down...
I20260709 13:14:19.285684 24113 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:19.286399 24113 tablet_replica.cc:333] T 3b87f9943cce4bdd9e4723fe01bea331 P f4f72ff07bec49f78a46a271be825b10: stopping tablet replica
I20260709 13:14:19.286964 24113 raft_consensus.cc:2243] T 3b87f9943cce4bdd9e4723fe01bea331 P f4f72ff07bec49f78a46a271be825b10 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:19.287632 24113 pending_rounds.cc:70] T 3b87f9943cce4bdd9e4723fe01bea331 P f4f72ff07bec49f78a46a271be825b10: Trying to abort 1 pending ops.
I20260709 13:14:19.287809 24113 pending_rounds.cc:77] T 3b87f9943cce4bdd9e4723fe01bea331 P f4f72ff07bec49f78a46a271be825b10: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305637310453600256 op_type: NO_OP noop_request { }
I20260709 13:14:19.288138 24113 raft_consensus.cc:2889] T 3b87f9943cce4bdd9e4723fe01bea331 P f4f72ff07bec49f78a46a271be825b10 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:14:19.288476 24113 raft_consensus.cc:2272] T 3b87f9943cce4bdd9e4723fe01bea331 P f4f72ff07bec49f78a46a271be825b10 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:19.290588 24113 tablet_replica.cc:333] T 8b21d8f2d5d443eeb9003f0690fdf52b P f4f72ff07bec49f78a46a271be825b10: stopping tablet replica
I20260709 13:14:19.291121 24113 raft_consensus.cc:2243] T 8b21d8f2d5d443eeb9003f0690fdf52b P f4f72ff07bec49f78a46a271be825b10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:19.291527 24113 raft_consensus.cc:2272] T 8b21d8f2d5d443eeb9003f0690fdf52b P f4f72ff07bec49f78a46a271be825b10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:19.293617 24113 tablet_replica.cc:333] T a596ccef936042d5a8539eb0376fbcee P f4f72ff07bec49f78a46a271be825b10: stopping tablet replica
I20260709 13:14:19.294193 24113 raft_consensus.cc:2243] T a596ccef936042d5a8539eb0376fbcee P f4f72ff07bec49f78a46a271be825b10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:19.294587 24113 raft_consensus.cc:2272] T a596ccef936042d5a8539eb0376fbcee P f4f72ff07bec49f78a46a271be825b10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:19.296285 24113 tablet_replica.cc:333] T 9f67e58e67d041a1b17ba18d95127114 P f4f72ff07bec49f78a46a271be825b10: stopping tablet replica
I20260709 13:14:19.296743 24113 raft_consensus.cc:2243] T 9f67e58e67d041a1b17ba18d95127114 P f4f72ff07bec49f78a46a271be825b10 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:19.297143 24113 raft_consensus.cc:2272] T 9f67e58e67d041a1b17ba18d95127114 P f4f72ff07bec49f78a46a271be825b10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:19.310027 24113 tablet_server.cc:196] TabletServer@127.23.140.67:0 shutdown complete.
I20260709 13:14:19.321478 24113 master.cc:562] Master@127.23.140.126:34355 shutting down...
I20260709 13:14:19.336268 24113 raft_consensus.cc:2243] T 00000000000000000000000000000000 P ad52ddf7e7024b99ae92e692fa7b09b6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:19.336778 24113 raft_consensus.cc:2272] T 00000000000000000000000000000000 P ad52ddf7e7024b99ae92e692fa7b09b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:19.337035 24113 tablet_replica.cc:333] T 00000000000000000000000000000000 P ad52ddf7e7024b99ae92e692fa7b09b6: stopping tablet replica
I20260709 13:14:19.355291 24113 master.cc:584] Master@127.23.140.126:34355 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2697 ms)
[----------] 6 tests from LeaderRebalancerTest (260534 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:14:19.383257 24113 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.23.140.126:38967
I20260709 13:14:19.384341 24113 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:19.389453  1131 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:19.389523  1132 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:19.390561  1134 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:19.392417 24113 server_base.cc:1061] running on GCE node
I20260709 13:14:19.393201 24113 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:19.393386 24113 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:19.393581 24113 hybrid_clock.cc:648] HybridClock initialized: now 1783602859393561 us; error 0 us; skew 500 ppm
I20260709 13:14:19.394122 24113 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:19.396267 24113 webserver.cc:533] Webserver started at http://127.23.140.126:34275/ using document root <none> and password file <none>
I20260709 13:14:19.396683 24113 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:19.396838 24113 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:19.397032 24113 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:19.398125 24113 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602598684750-24113-0/minicluster-data/master-0-root/instance:
uuid: "2aba176642564658a9700187a3b3d6f0"
format_stamp: "Formatted at 2026-07-09 13:14:19 on dist-test-slave-1rs3"
I20260709 13:14:19.402292 24113 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:14:19.405395  1139 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:19.406163 24113 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:14:19.406461 24113 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602598684750-24113-0/minicluster-data/master-0-root
uuid: "2aba176642564658a9700187a3b3d6f0"
format_stamp: "Formatted at 2026-07-09 13:14:19 on dist-test-slave-1rs3"
I20260709 13:14:19.406694 24113 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602598684750-24113-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602598684750-24113-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602598684750-24113-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:19.423669 24113 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:19.424676 24113 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:19.459071 24113 rpc_server.cc:307] RPC server started. Bound to: 127.23.140.126:38967
I20260709 13:14:19.459193  1190 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.140.126:38967 every 8 connection(s)
I20260709 13:14:19.462975  1191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:19.474426  1191 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2aba176642564658a9700187a3b3d6f0: Bootstrap starting.
I20260709 13:14:19.479206  1191 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2aba176642564658a9700187a3b3d6f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:19.483197  1191 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2aba176642564658a9700187a3b3d6f0: No bootstrap required, opened a new log
I20260709 13:14:19.485092  1191 raft_consensus.cc:359] T 00000000000000000000000000000000 P 2aba176642564658a9700187a3b3d6f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2aba176642564658a9700187a3b3d6f0" member_type: VOTER }
I20260709 13:14:19.485455  1191 raft_consensus.cc:385] T 00000000000000000000000000000000 P 2aba176642564658a9700187a3b3d6f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:19.485621  1191 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2aba176642564658a9700187a3b3d6f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2aba176642564658a9700187a3b3d6f0, State: Initialized, Role: FOLLOWER
I20260709 13:14:19.486182  1191 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2aba176642564658a9700187a3b3d6f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2aba176642564658a9700187a3b3d6f0" member_type: VOTER }
I20260709 13:14:19.486588  1191 raft_consensus.cc:399] T 00000000000000000000000000000000 P 2aba176642564658a9700187a3b3d6f0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:14:19.486773  1191 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2aba176642564658a9700187a3b3d6f0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:14:19.486968  1191 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2aba176642564658a9700187a3b3d6f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:19.491343  1191 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2aba176642564658a9700187a3b3d6f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2aba176642564658a9700187a3b3d6f0" member_type: VOTER }
I20260709 13:14:19.491767  1191 leader_election.cc:304] T 00000000000000000000000000000000 P 2aba176642564658a9700187a3b3d6f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2aba176642564658a9700187a3b3d6f0; no voters: 
I20260709 13:14:19.492877  1191 leader_election.cc:290] T 00000000000000000000000000000000 P 2aba176642564658a9700187a3b3d6f0 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:14:19.493207  1194 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 2aba176642564658a9700187a3b3d6f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:19.494588  1194 raft_consensus.cc:697] T 00000000000000000000000000000000 P 2aba176642564658a9700187a3b3d6f0 [term 1 LEADER]: Becoming Leader. State: Replica: 2aba176642564658a9700187a3b3d6f0, State: Running, Role: LEADER
I20260709 13:14:19.495162  1194 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2aba176642564658a9700187a3b3d6f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2aba176642564658a9700187a3b3d6f0" member_type: VOTER }
I20260709 13:14:19.495671  1191 sys_catalog.cc:565] T 00000000000000000000000000000000 P 2aba176642564658a9700187a3b3d6f0 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:14:19.498473  1196 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2aba176642564658a9700187a3b3d6f0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2aba176642564658a9700187a3b3d6f0. Latest consensus state: current_term: 1 leader_uuid: "2aba176642564658a9700187a3b3d6f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2aba176642564658a9700187a3b3d6f0" member_type: VOTER } }
I20260709 13:14:19.498425  1195 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2aba176642564658a9700187a3b3d6f0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2aba176642564658a9700187a3b3d6f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2aba176642564658a9700187a3b3d6f0" member_type: VOTER } }
I20260709 13:14:19.499253  1196 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2aba176642564658a9700187a3b3d6f0 [sys.catalog]: This master's current role is: LEADER
I20260709 13:14:19.499402  1195 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2aba176642564658a9700187a3b3d6f0 [sys.catalog]: This master's current role is: LEADER
I20260709 13:14:19.502753  1200 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:14:19.510479  1200 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:14:19.511437 24113 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:14:19.519208  1200 catalog_manager.cc:1383] Generated new cluster ID: 05af83f857a54ae4a6af4872cd71d75a
I20260709 13:14:19.519572  1200 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:14:19.531190  1200 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:14:19.532486  1200 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:14:19.548421  1200 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 2aba176642564658a9700187a3b3d6f0: Generated new TSK 0
I20260709 13:14:19.549057  1200 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:14:19.579504 24113 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:19.585891  1212 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:19.587427  1213 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:19.589078 24113 server_base.cc:1061] running on GCE node
W20260709 13:14:19.589233  1215 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:19.590338 24113 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:19.590541 24113 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:19.590674 24113 hybrid_clock.cc:648] HybridClock initialized: now 1783602859590662 us; error 0 us; skew 500 ppm
I20260709 13:14:19.591166 24113 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:19.593531 24113 webserver.cc:533] Webserver started at http://127.23.140.65:40089/ using document root <none> and password file <none>
I20260709 13:14:19.594094 24113 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:19.594280 24113 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:19.594511 24113 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:19.595638 24113 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602598684750-24113-0/minicluster-data/ts-0-root/instance:
uuid: "e4f6eab2337842428ba2670421465839"
format_stamp: "Formatted at 2026-07-09 13:14:19 on dist-test-slave-1rs3"
I20260709 13:14:19.600538 24113 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:14:19.604417  1220 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:19.605249 24113 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:14:19.605582 24113 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602598684750-24113-0/minicluster-data/ts-0-root
uuid: "e4f6eab2337842428ba2670421465839"
format_stamp: "Formatted at 2026-07-09 13:14:19 on dist-test-slave-1rs3"
I20260709 13:14:19.605981 24113 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602598684750-24113-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602598684750-24113-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602598684750-24113-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:19.620033 24113 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:19.621110 24113 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:19.622500 24113 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:19.624753 24113 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:19.624920 24113 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:19.625239 24113 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:19.625387 24113 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:19.663717 24113 rpc_server.cc:307] RPC server started. Bound to: 127.23.140.65:45009
I20260709 13:14:19.663820  1282 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.140.65:45009 every 8 connection(s)
I20260709 13:14:19.668608 24113 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:19.675931  1288 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:19.675800  1287 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:19.679989  1290 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:19.683233  1283 heartbeater.cc:344] Connected to a master server at 127.23.140.126:38967
I20260709 13:14:19.683722  1283 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:19.684439 24113 server_base.cc:1061] running on GCE node
I20260709 13:14:19.684687  1283 heartbeater.cc:507] Master 127.23.140.126:38967 requested a full tablet report, sending...
I20260709 13:14:19.685442 24113 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:19.685801 24113 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:19.686039 24113 hybrid_clock.cc:648] HybridClock initialized: now 1783602859686015 us; error 0 us; skew 500 ppm
I20260709 13:14:19.686718 24113 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:19.687057  1156 ts_manager.cc:194] Registered new tserver with Master: e4f6eab2337842428ba2670421465839 (127.23.140.65:45009)
I20260709 13:14:19.689384  1156 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48226
I20260709 13:14:19.689390 24113 webserver.cc:533] Webserver started at http://127.23.140.66:45801/ using document root <none> and password file <none>
I20260709 13:14:19.690153 24113 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:19.690407 24113 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:19.690750 24113 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:19.692292 24113 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602598684750-24113-0/minicluster-data/ts-1-root/instance:
uuid: "0bf9692a81414cfab64ee45b5393d57e"
format_stamp: "Formatted at 2026-07-09 13:14:19 on dist-test-slave-1rs3"
I20260709 13:14:19.696897 24113 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:14:19.700460  1295 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:19.701282 24113 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:14:19.701613 24113 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602598684750-24113-0/minicluster-data/ts-1-root
uuid: "0bf9692a81414cfab64ee45b5393d57e"
format_stamp: "Formatted at 2026-07-09 13:14:19 on dist-test-slave-1rs3"
I20260709 13:14:19.701960 24113 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602598684750-24113-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602598684750-24113-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602598684750-24113-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:19.719411 24113 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:19.720495 24113 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:19.721989 24113 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:19.724218 24113 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:19.724421 24113 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:19.724686 24113 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:19.724845 24113 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:19.762552 24113 rpc_server.cc:307] RPC server started. Bound to: 127.23.140.66:38395
I20260709 13:14:19.762753  1357 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.140.66:38395 every 8 connection(s)
I20260709 13:14:19.767361 24113 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:19.774252  1361 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:19.776643  1362 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:19.778239 24113 server_base.cc:1061] running on GCE node
W20260709 13:14:19.778421  1364 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:19.779752 24113 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:19.780084 24113 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:19.780329 24113 hybrid_clock.cc:648] HybridClock initialized: now 1783602859780310 us; error 0 us; skew 500 ppm
I20260709 13:14:19.780827  1358 heartbeater.cc:344] Connected to a master server at 127.23.140.126:38967
I20260709 13:14:19.781105 24113 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:19.781276  1358 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:19.782217  1358 heartbeater.cc:507] Master 127.23.140.126:38967 requested a full tablet report, sending...
I20260709 13:14:19.784246 24113 webserver.cc:533] Webserver started at http://127.23.140.67:39183/ using document root <none> and password file <none>
I20260709 13:14:19.784767  1156 ts_manager.cc:194] Registered new tserver with Master: 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66:38395)
I20260709 13:14:19.785007 24113 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:19.785341 24113 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:19.785679 24113 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:19.786849  1156 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48240
I20260709 13:14:19.787242 24113 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602598684750-24113-0/minicluster-data/ts-2-root/instance:
uuid: "40837fdefb66404b93c3e3876da432f7"
format_stamp: "Formatted at 2026-07-09 13:14:19 on dist-test-slave-1rs3"
I20260709 13:14:19.792284 24113 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:14:19.795470  1369 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:19.796303 24113 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:14:19.796643 24113 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602598684750-24113-0/minicluster-data/ts-2-root
uuid: "40837fdefb66404b93c3e3876da432f7"
format_stamp: "Formatted at 2026-07-09 13:14:19 on dist-test-slave-1rs3"
I20260709 13:14:19.796952 24113 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602598684750-24113-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602598684750-24113-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602598684750-24113-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:19.816639 24113 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:19.817704 24113 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:19.819279 24113 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:19.821689 24113 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:19.821962 24113 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:19.822247 24113 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:19.822449 24113 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:19.864254 24113 rpc_server.cc:307] RPC server started. Bound to: 127.23.140.67:43689
I20260709 13:14:19.864349  1431 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.140.67:43689 every 8 connection(s)
I20260709 13:14:19.880923  1432 heartbeater.cc:344] Connected to a master server at 127.23.140.126:38967
I20260709 13:14:19.881357  1432 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:19.882189  1432 heartbeater.cc:507] Master 127.23.140.126:38967 requested a full tablet report, sending...
I20260709 13:14:19.884071  1156 ts_manager.cc:194] Registered new tserver with Master: 40837fdefb66404b93c3e3876da432f7 (127.23.140.67:43689)
I20260709 13:14:19.884868 24113 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01710095s
I20260709 13:14:19.885492  1156 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48246
I20260709 13:14:19.910085  1156 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48250:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:14:19.912640  1156 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:14:19.972240  1322 tablet_service.cc:1511] Processing CreateTablet for tablet 275bc525ace541a89e9b89c5bdda27db (DEFAULT_TABLE table=test-workload [id=635caa6fbf9e4d9eabdc88251f9e2002]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:14:19.974100  1322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 275bc525ace541a89e9b89c5bdda27db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:19.976966  1321 tablet_service.cc:1511] Processing CreateTablet for tablet 6c40fe2ece564243aa8dc5b1fae8ecd8 (DEFAULT_TABLE table=test-workload [id=635caa6fbf9e4d9eabdc88251f9e2002]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:14:19.978423  1321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c40fe2ece564243aa8dc5b1fae8ecd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:19.979214  1323 tablet_service.cc:1511] Processing CreateTablet for tablet 8b27a5294d34450aaff6336d315361c6 (DEFAULT_TABLE table=test-workload [id=635caa6fbf9e4d9eabdc88251f9e2002]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:14:19.980547  1323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b27a5294d34450aaff6336d315361c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:19.995308  1248 tablet_service.cc:1511] Processing CreateTablet for tablet 8b27a5294d34450aaff6336d315361c6 (DEFAULT_TABLE table=test-workload [id=635caa6fbf9e4d9eabdc88251f9e2002]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:14:19.996847  1248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b27a5294d34450aaff6336d315361c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:19.996646  1246 tablet_service.cc:1511] Processing CreateTablet for tablet 6c40fe2ece564243aa8dc5b1fae8ecd8 (DEFAULT_TABLE table=test-workload [id=635caa6fbf9e4d9eabdc88251f9e2002]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:14:19.998066  1246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c40fe2ece564243aa8dc5b1fae8ecd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:19.998800  1247 tablet_service.cc:1511] Processing CreateTablet for tablet 275bc525ace541a89e9b89c5bdda27db (DEFAULT_TABLE table=test-workload [id=635caa6fbf9e4d9eabdc88251f9e2002]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:14:20.000108  1247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 275bc525ace541a89e9b89c5bdda27db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:20.004918  1245 tablet_service.cc:1511] Processing CreateTablet for tablet 7dff7291733e401c805ffe3d5829f7f5 (DEFAULT_TABLE table=test-workload [id=635caa6fbf9e4d9eabdc88251f9e2002]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:14:20.006394  1245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dff7291733e401c805ffe3d5829f7f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:20.007400  1397 tablet_service.cc:1511] Processing CreateTablet for tablet 8b27a5294d34450aaff6336d315361c6 (DEFAULT_TABLE table=test-workload [id=635caa6fbf9e4d9eabdc88251f9e2002]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:14:20.008728  1397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b27a5294d34450aaff6336d315361c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:20.010126  1395 tablet_service.cc:1511] Processing CreateTablet for tablet 6c40fe2ece564243aa8dc5b1fae8ecd8 (DEFAULT_TABLE table=test-workload [id=635caa6fbf9e4d9eabdc88251f9e2002]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:14:20.011569  1395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c40fe2ece564243aa8dc5b1fae8ecd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:20.014909  1396 tablet_service.cc:1511] Processing CreateTablet for tablet 275bc525ace541a89e9b89c5bdda27db (DEFAULT_TABLE table=test-workload [id=635caa6fbf9e4d9eabdc88251f9e2002]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:14:20.016584  1396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 275bc525ace541a89e9b89c5bdda27db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:20.020601  1322 tablet_service.cc:1511] Processing CreateTablet for tablet 7dff7291733e401c805ffe3d5829f7f5 (DEFAULT_TABLE table=test-workload [id=635caa6fbf9e4d9eabdc88251f9e2002]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:14:20.021734  1447 tablet_bootstrap.cc:492] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 0bf9692a81414cfab64ee45b5393d57e: Bootstrap starting.
I20260709 13:14:20.024322  1322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dff7291733e401c805ffe3d5829f7f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:20.025030  1394 tablet_service.cc:1511] Processing CreateTablet for tablet 7dff7291733e401c805ffe3d5829f7f5 (DEFAULT_TABLE table=test-workload [id=635caa6fbf9e4d9eabdc88251f9e2002]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:14:20.026366  1394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dff7291733e401c805ffe3d5829f7f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:20.031493  1447 tablet_bootstrap.cc:654] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 0bf9692a81414cfab64ee45b5393d57e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:20.041213  1244 tablet_service.cc:1511] Processing CreateTablet for tablet 05040be4aa904a3bb6bad07412e196eb (DEFAULT_TABLE table=test-workload [id=635caa6fbf9e4d9eabdc88251f9e2002]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:14:20.042698  1244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05040be4aa904a3bb6bad07412e196eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:20.043844  1321 tablet_service.cc:1511] Processing CreateTablet for tablet 05040be4aa904a3bb6bad07412e196eb (DEFAULT_TABLE table=test-workload [id=635caa6fbf9e4d9eabdc88251f9e2002]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:14:20.045159  1321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05040be4aa904a3bb6bad07412e196eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:20.046310  1393 tablet_service.cc:1511] Processing CreateTablet for tablet 05040be4aa904a3bb6bad07412e196eb (DEFAULT_TABLE table=test-workload [id=635caa6fbf9e4d9eabdc88251f9e2002]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:14:20.047619  1393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05040be4aa904a3bb6bad07412e196eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:20.048591  1243 tablet_service.cc:1511] Processing CreateTablet for tablet f2cb95dd66b44bb7ad3bdb0f8970a24e (DEFAULT_TABLE table=test-workload [id=635caa6fbf9e4d9eabdc88251f9e2002]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:14:20.049916  1243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2cb95dd66b44bb7ad3bdb0f8970a24e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:20.059118  1320 tablet_service.cc:1511] Processing CreateTablet for tablet f2cb95dd66b44bb7ad3bdb0f8970a24e (DEFAULT_TABLE table=test-workload [id=635caa6fbf9e4d9eabdc88251f9e2002]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:14:20.060745  1320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2cb95dd66b44bb7ad3bdb0f8970a24e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:20.063381  1448 tablet_bootstrap.cc:492] T 8b27a5294d34450aaff6336d315361c6 P 40837fdefb66404b93c3e3876da432f7: Bootstrap starting.
I20260709 13:14:20.069269  1449 tablet_bootstrap.cc:492] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P e4f6eab2337842428ba2670421465839: Bootstrap starting.
I20260709 13:14:20.074883  1394 tablet_service.cc:1511] Processing CreateTablet for tablet f2cb95dd66b44bb7ad3bdb0f8970a24e (DEFAULT_TABLE table=test-workload [id=635caa6fbf9e4d9eabdc88251f9e2002]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:14:20.079286  1245 tablet_service.cc:1511] Processing CreateTablet for tablet 82a1d9ee89c045d6ac3220d347e06972 (DEFAULT_TABLE table=test-workload [id=635caa6fbf9e4d9eabdc88251f9e2002]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:14:20.080657  1245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82a1d9ee89c045d6ac3220d347e06972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:20.080547  1447 tablet_bootstrap.cc:492] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 0bf9692a81414cfab64ee45b5393d57e: No bootstrap required, opened a new log
I20260709 13:14:20.083817  1397 tablet_service.cc:1511] Processing CreateTablet for tablet 82a1d9ee89c045d6ac3220d347e06972 (DEFAULT_TABLE table=test-workload [id=635caa6fbf9e4d9eabdc88251f9e2002]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:14:20.085121  1397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82a1d9ee89c045d6ac3220d347e06972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:20.083666  1447 ts_tablet_manager.cc:1403] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 0bf9692a81414cfab64ee45b5393d57e: Time spent bootstrapping tablet: real 0.062s	user 0.013s	sys 0.003s
I20260709 13:14:20.088210  1246 tablet_service.cc:1511] Processing CreateTablet for tablet b20386846aee4ca5b9458883519bf06d (DEFAULT_TABLE table=test-workload [id=635caa6fbf9e4d9eabdc88251f9e2002]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:14:20.089550  1246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b20386846aee4ca5b9458883519bf06d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:20.090082  1323 tablet_service.cc:1511] Processing CreateTablet for tablet 82a1d9ee89c045d6ac3220d347e06972 (DEFAULT_TABLE table=test-workload [id=635caa6fbf9e4d9eabdc88251f9e2002]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:14:20.092448  1323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82a1d9ee89c045d6ac3220d347e06972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:20.096505  1448 tablet_bootstrap.cc:654] T 8b27a5294d34450aaff6336d315361c6 P 40837fdefb66404b93c3e3876da432f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:20.097677  1394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2cb95dd66b44bb7ad3bdb0f8970a24e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:20.100773  1321 tablet_service.cc:1511] Processing CreateTablet for tablet b20386846aee4ca5b9458883519bf06d (DEFAULT_TABLE table=test-workload [id=635caa6fbf9e4d9eabdc88251f9e2002]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:14:20.102169  1321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b20386846aee4ca5b9458883519bf06d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:20.089118  1447 raft_consensus.cc:359] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.103762  1447 raft_consensus.cc:385] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:20.104791  1447 raft_consensus.cc:740] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bf9692a81414cfab64ee45b5393d57e, State: Initialized, Role: FOLLOWER
I20260709 13:14:20.105808  1447 consensus_queue.cc:260] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 0bf9692a81414cfab64ee45b5393d57e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.123322  1397 tablet_service.cc:1511] Processing CreateTablet for tablet b20386846aee4ca5b9458883519bf06d (DEFAULT_TABLE table=test-workload [id=635caa6fbf9e4d9eabdc88251f9e2002]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:14:20.124975  1246 tablet_service.cc:1511] Processing CreateTablet for tablet 6d5b91e9a24a45ae90e730ae96c73317 (DEFAULT_TABLE table=test-workload [id=635caa6fbf9e4d9eabdc88251f9e2002]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:14:20.125886  1397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b20386846aee4ca5b9458883519bf06d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:20.124975  1322 tablet_service.cc:1511] Processing CreateTablet for tablet 6d5b91e9a24a45ae90e730ae96c73317 (DEFAULT_TABLE table=test-workload [id=635caa6fbf9e4d9eabdc88251f9e2002]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:14:20.127596  1322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d5b91e9a24a45ae90e730ae96c73317. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:20.131804  1449 tablet_bootstrap.cc:654] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P e4f6eab2337842428ba2670421465839: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:20.126339  1246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d5b91e9a24a45ae90e730ae96c73317. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:20.142386  1447 ts_tablet_manager.cc:1434] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 0bf9692a81414cfab64ee45b5393d57e: Time spent starting tablet: real 0.056s	user 0.012s	sys 0.008s
I20260709 13:14:20.143237  1358 heartbeater.cc:499] Master 127.23.140.126:38967 was elected leader, sending a full tablet report...
I20260709 13:14:20.150202  1452 raft_consensus.cc:493] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.150669  1452 raft_consensus.cc:515] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.153334  1452 leader_election.cc:290] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 0bf9692a81414cfab64ee45b5393d57e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4f6eab2337842428ba2670421465839 (127.23.140.65:45009), 40837fdefb66404b93c3e3876da432f7 (127.23.140.67:43689)
I20260709 13:14:20.164041  1447 tablet_bootstrap.cc:492] T 275bc525ace541a89e9b89c5bdda27db P 0bf9692a81414cfab64ee45b5393d57e: Bootstrap starting.
I20260709 13:14:20.173146  1448 tablet_bootstrap.cc:492] T 8b27a5294d34450aaff6336d315361c6 P 40837fdefb66404b93c3e3876da432f7: No bootstrap required, opened a new log
I20260709 13:14:20.173902  1448 ts_tablet_manager.cc:1403] T 8b27a5294d34450aaff6336d315361c6 P 40837fdefb66404b93c3e3876da432f7: Time spent bootstrapping tablet: real 0.111s	user 0.013s	sys 0.012s
I20260709 13:14:20.175081  1407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40fe2ece564243aa8dc5b1fae8ecd8" candidate_uuid: "0bf9692a81414cfab64ee45b5393d57e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40837fdefb66404b93c3e3876da432f7" is_pre_election: true
W20260709 13:14:20.176980  1299 leader_election.cc:343] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 0bf9692a81414cfab64ee45b5393d57e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40837fdefb66404b93c3e3876da432f7 (127.23.140.67:43689): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:20.177917  1447 tablet_bootstrap.cc:654] T 275bc525ace541a89e9b89c5bdda27db P 0bf9692a81414cfab64ee45b5393d57e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:20.181730  1448 raft_consensus.cc:359] T 8b27a5294d34450aaff6336d315361c6 P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.183786  1448 raft_consensus.cc:385] T 8b27a5294d34450aaff6336d315361c6 P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:20.184077  1448 raft_consensus.cc:740] T 8b27a5294d34450aaff6336d315361c6 P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40837fdefb66404b93c3e3876da432f7, State: Initialized, Role: FOLLOWER
I20260709 13:14:20.185525  1396 tablet_service.cc:1511] Processing CreateTablet for tablet 6d5b91e9a24a45ae90e730ae96c73317 (DEFAULT_TABLE table=test-workload [id=635caa6fbf9e4d9eabdc88251f9e2002]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:14:20.187316  1396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d5b91e9a24a45ae90e730ae96c73317. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:20.191879  1448 consensus_queue.cc:260] T 8b27a5294d34450aaff6336d315361c6 P 40837fdefb66404b93c3e3876da432f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.212560  1447 tablet_bootstrap.cc:492] T 275bc525ace541a89e9b89c5bdda27db P 0bf9692a81414cfab64ee45b5393d57e: No bootstrap required, opened a new log
I20260709 13:14:20.212133  1258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40fe2ece564243aa8dc5b1fae8ecd8" candidate_uuid: "0bf9692a81414cfab64ee45b5393d57e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f6eab2337842428ba2670421465839" is_pre_election: true
I20260709 13:14:20.214160  1447 ts_tablet_manager.cc:1403] T 275bc525ace541a89e9b89c5bdda27db P 0bf9692a81414cfab64ee45b5393d57e: Time spent bootstrapping tablet: real 0.050s	user 0.012s	sys 0.008s
I20260709 13:14:20.217489  1447 raft_consensus.cc:359] T 275bc525ace541a89e9b89c5bdda27db P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.218250  1447 raft_consensus.cc:385] T 275bc525ace541a89e9b89c5bdda27db P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:20.218613  1447 raft_consensus.cc:740] T 275bc525ace541a89e9b89c5bdda27db P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bf9692a81414cfab64ee45b5393d57e, State: Initialized, Role: FOLLOWER
W20260709 13:14:20.218833  1297 leader_election.cc:343] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 0bf9692a81414cfab64ee45b5393d57e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4f6eab2337842428ba2670421465839 (127.23.140.65:45009): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:20.219589  1297 leader_election.cc:304] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 0bf9692a81414cfab64ee45b5393d57e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0bf9692a81414cfab64ee45b5393d57e; no voters: 40837fdefb66404b93c3e3876da432f7, e4f6eab2337842428ba2670421465839
I20260709 13:14:20.219527  1447 consensus_queue.cc:260] T 275bc525ace541a89e9b89c5bdda27db P 0bf9692a81414cfab64ee45b5393d57e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.221665  1453 raft_consensus.cc:2749] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:20.223105  1447 ts_tablet_manager.cc:1434] T 275bc525ace541a89e9b89c5bdda27db P 0bf9692a81414cfab64ee45b5393d57e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:14:20.223117  1432 heartbeater.cc:499] Master 127.23.140.126:38967 was elected leader, sending a full tablet report...
I20260709 13:14:20.223877  1449 tablet_bootstrap.cc:492] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P e4f6eab2337842428ba2670421465839: No bootstrap required, opened a new log
I20260709 13:14:20.224326  1447 tablet_bootstrap.cc:492] T 05040be4aa904a3bb6bad07412e196eb P 0bf9692a81414cfab64ee45b5393d57e: Bootstrap starting.
I20260709 13:14:20.224382  1449 ts_tablet_manager.cc:1403] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P e4f6eab2337842428ba2670421465839: Time spent bootstrapping tablet: real 0.155s	user 0.014s	sys 0.026s
I20260709 13:14:20.227582  1449 raft_consensus.cc:359] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.228279  1449 raft_consensus.cc:385] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:20.228574  1449 raft_consensus.cc:740] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4f6eab2337842428ba2670421465839, State: Initialized, Role: FOLLOWER
I20260709 13:14:20.229220  1449 consensus_queue.cc:260] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P e4f6eab2337842428ba2670421465839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.230540  1447 tablet_bootstrap.cc:654] T 05040be4aa904a3bb6bad07412e196eb P 0bf9692a81414cfab64ee45b5393d57e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:20.232076  1448 ts_tablet_manager.cc:1434] T 8b27a5294d34450aaff6336d315361c6 P 40837fdefb66404b93c3e3876da432f7: Time spent starting tablet: real 0.058s	user 0.015s	sys 0.007s
I20260709 13:14:20.233222  1448 tablet_bootstrap.cc:492] T 7dff7291733e401c805ffe3d5829f7f5 P 40837fdefb66404b93c3e3876da432f7: Bootstrap starting.
I20260709 13:14:20.244809  1448 tablet_bootstrap.cc:654] T 7dff7291733e401c805ffe3d5829f7f5 P 40837fdefb66404b93c3e3876da432f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:20.279582  1283 heartbeater.cc:499] Master 127.23.140.126:38967 was elected leader, sending a full tablet report...
I20260709 13:14:20.280066  1449 ts_tablet_manager.cc:1434] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P e4f6eab2337842428ba2670421465839: Time spent starting tablet: real 0.055s	user 0.021s	sys 0.028s
I20260709 13:14:20.280223  1447 tablet_bootstrap.cc:492] T 05040be4aa904a3bb6bad07412e196eb P 0bf9692a81414cfab64ee45b5393d57e: No bootstrap required, opened a new log
I20260709 13:14:20.280941  1447 ts_tablet_manager.cc:1403] T 05040be4aa904a3bb6bad07412e196eb P 0bf9692a81414cfab64ee45b5393d57e: Time spent bootstrapping tablet: real 0.057s	user 0.016s	sys 0.038s
I20260709 13:14:20.281448  1449 tablet_bootstrap.cc:492] T 7dff7291733e401c805ffe3d5829f7f5 P e4f6eab2337842428ba2670421465839: Bootstrap starting.
I20260709 13:14:20.282472  1448 tablet_bootstrap.cc:492] T 7dff7291733e401c805ffe3d5829f7f5 P 40837fdefb66404b93c3e3876da432f7: No bootstrap required, opened a new log
I20260709 13:14:20.282998  1448 ts_tablet_manager.cc:1403] T 7dff7291733e401c805ffe3d5829f7f5 P 40837fdefb66404b93c3e3876da432f7: Time spent bootstrapping tablet: real 0.050s	user 0.019s	sys 0.024s
I20260709 13:14:20.283975  1447 raft_consensus.cc:359] T 05040be4aa904a3bb6bad07412e196eb P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.284754  1447 raft_consensus.cc:385] T 05040be4aa904a3bb6bad07412e196eb P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:20.285048  1447 raft_consensus.cc:740] T 05040be4aa904a3bb6bad07412e196eb P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bf9692a81414cfab64ee45b5393d57e, State: Initialized, Role: FOLLOWER
I20260709 13:14:20.285740  1448 raft_consensus.cc:359] T 7dff7291733e401c805ffe3d5829f7f5 P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.285853  1447 consensus_queue.cc:260] T 05040be4aa904a3bb6bad07412e196eb P 0bf9692a81414cfab64ee45b5393d57e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.286618  1448 raft_consensus.cc:385] T 7dff7291733e401c805ffe3d5829f7f5 P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:20.286935  1448 raft_consensus.cc:740] T 7dff7291733e401c805ffe3d5829f7f5 P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40837fdefb66404b93c3e3876da432f7, State: Initialized, Role: FOLLOWER
I20260709 13:14:20.287801  1448 consensus_queue.cc:260] T 7dff7291733e401c805ffe3d5829f7f5 P 40837fdefb66404b93c3e3876da432f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.288184  1447 ts_tablet_manager.cc:1434] T 05040be4aa904a3bb6bad07412e196eb P 0bf9692a81414cfab64ee45b5393d57e: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:14:20.288337  1449 tablet_bootstrap.cc:654] T 7dff7291733e401c805ffe3d5829f7f5 P e4f6eab2337842428ba2670421465839: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:20.289336  1447 tablet_bootstrap.cc:492] T 8b27a5294d34450aaff6336d315361c6 P 0bf9692a81414cfab64ee45b5393d57e: Bootstrap starting.
I20260709 13:14:20.292764  1448 ts_tablet_manager.cc:1434] T 7dff7291733e401c805ffe3d5829f7f5 P 40837fdefb66404b93c3e3876da432f7: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:14:20.293902  1448 tablet_bootstrap.cc:492] T 05040be4aa904a3bb6bad07412e196eb P 40837fdefb66404b93c3e3876da432f7: Bootstrap starting.
I20260709 13:14:20.295912  1447 tablet_bootstrap.cc:654] T 8b27a5294d34450aaff6336d315361c6 P 0bf9692a81414cfab64ee45b5393d57e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:20.300880  1448 tablet_bootstrap.cc:654] T 05040be4aa904a3bb6bad07412e196eb P 40837fdefb66404b93c3e3876da432f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:20.307876  1457 raft_consensus.cc:493] T 8b27a5294d34450aaff6336d315361c6 P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.308607  1457 raft_consensus.cc:515] T 8b27a5294d34450aaff6336d315361c6 P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.318997  1449 tablet_bootstrap.cc:492] T 7dff7291733e401c805ffe3d5829f7f5 P e4f6eab2337842428ba2670421465839: No bootstrap required, opened a new log
I20260709 13:14:20.319728  1449 ts_tablet_manager.cc:1403] T 7dff7291733e401c805ffe3d5829f7f5 P e4f6eab2337842428ba2670421465839: Time spent bootstrapping tablet: real 0.039s	user 0.008s	sys 0.009s
I20260709 13:14:20.322784  1449 raft_consensus.cc:359] T 7dff7291733e401c805ffe3d5829f7f5 P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.323714  1449 raft_consensus.cc:385] T 7dff7291733e401c805ffe3d5829f7f5 P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:20.324064  1449 raft_consensus.cc:740] T 7dff7291733e401c805ffe3d5829f7f5 P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4f6eab2337842428ba2670421465839, State: Initialized, Role: FOLLOWER
I20260709 13:14:20.324851  1449 consensus_queue.cc:260] T 7dff7291733e401c805ffe3d5829f7f5 P e4f6eab2337842428ba2670421465839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.327435  1449 ts_tablet_manager.cc:1434] T 7dff7291733e401c805ffe3d5829f7f5 P e4f6eab2337842428ba2670421465839: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 13:14:20.328465  1449 tablet_bootstrap.cc:492] T b20386846aee4ca5b9458883519bf06d P e4f6eab2337842428ba2670421465839: Bootstrap starting.
I20260709 13:14:20.329995  1457 leader_election.cc:290] T 8b27a5294d34450aaff6336d315361c6 P 40837fdefb66404b93c3e3876da432f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66:38395), e4f6eab2337842428ba2670421465839 (127.23.140.65:45009)
I20260709 13:14:20.334635  1449 tablet_bootstrap.cc:654] T b20386846aee4ca5b9458883519bf06d P e4f6eab2337842428ba2670421465839: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:20.334550  1333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b27a5294d34450aaff6336d315361c6" candidate_uuid: "40837fdefb66404b93c3e3876da432f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bf9692a81414cfab64ee45b5393d57e" is_pre_election: true
W20260709 13:14:20.336927  1370 leader_election.cc:343] T 8b27a5294d34450aaff6336d315361c6 P 40837fdefb66404b93c3e3876da432f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66:38395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:20.342320  1447 tablet_bootstrap.cc:492] T 8b27a5294d34450aaff6336d315361c6 P 0bf9692a81414cfab64ee45b5393d57e: No bootstrap required, opened a new log
I20260709 13:14:20.343052  1447 ts_tablet_manager.cc:1403] T 8b27a5294d34450aaff6336d315361c6 P 0bf9692a81414cfab64ee45b5393d57e: Time spent bootstrapping tablet: real 0.054s	user 0.022s	sys 0.028s
I20260709 13:14:20.344097  1448 tablet_bootstrap.cc:492] T 05040be4aa904a3bb6bad07412e196eb P 40837fdefb66404b93c3e3876da432f7: No bootstrap required, opened a new log
I20260709 13:14:20.344833  1448 ts_tablet_manager.cc:1403] T 05040be4aa904a3bb6bad07412e196eb P 40837fdefb66404b93c3e3876da432f7: Time spent bootstrapping tablet: real 0.051s	user 0.010s	sys 0.003s
I20260709 13:14:20.350569  1447 raft_consensus.cc:359] T 8b27a5294d34450aaff6336d315361c6 P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.352316  1447 raft_consensus.cc:385] T 8b27a5294d34450aaff6336d315361c6 P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:20.353245  1447 raft_consensus.cc:740] T 8b27a5294d34450aaff6336d315361c6 P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bf9692a81414cfab64ee45b5393d57e, State: Initialized, Role: FOLLOWER
I20260709 13:14:20.354064  1447 consensus_queue.cc:260] T 8b27a5294d34450aaff6336d315361c6 P 0bf9692a81414cfab64ee45b5393d57e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.354598  1258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b27a5294d34450aaff6336d315361c6" candidate_uuid: "40837fdefb66404b93c3e3876da432f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f6eab2337842428ba2670421465839" is_pre_election: true
I20260709 13:14:20.355254  1448 raft_consensus.cc:359] T 05040be4aa904a3bb6bad07412e196eb P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.355967  1448 raft_consensus.cc:385] T 05040be4aa904a3bb6bad07412e196eb P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:20.356261  1448 raft_consensus.cc:740] T 05040be4aa904a3bb6bad07412e196eb P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40837fdefb66404b93c3e3876da432f7, State: Initialized, Role: FOLLOWER
I20260709 13:14:20.356473  1447 ts_tablet_manager.cc:1434] T 8b27a5294d34450aaff6336d315361c6 P 0bf9692a81414cfab64ee45b5393d57e: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
W20260709 13:14:20.356485  1371 leader_election.cc:343] T 8b27a5294d34450aaff6336d315361c6 P 40837fdefb66404b93c3e3876da432f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4f6eab2337842428ba2670421465839 (127.23.140.65:45009): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:20.357125  1448 consensus_queue.cc:260] T 05040be4aa904a3bb6bad07412e196eb P 40837fdefb66404b93c3e3876da432f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.359437  1448 ts_tablet_manager.cc:1434] T 05040be4aa904a3bb6bad07412e196eb P 40837fdefb66404b93c3e3876da432f7: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 13:14:20.360469  1448 tablet_bootstrap.cc:492] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 40837fdefb66404b93c3e3876da432f7: Bootstrap starting.
I20260709 13:14:20.362340  1449 tablet_bootstrap.cc:492] T b20386846aee4ca5b9458883519bf06d P e4f6eab2337842428ba2670421465839: No bootstrap required, opened a new log
I20260709 13:14:20.362906  1449 ts_tablet_manager.cc:1403] T b20386846aee4ca5b9458883519bf06d P e4f6eab2337842428ba2670421465839: Time spent bootstrapping tablet: real 0.035s	user 0.017s	sys 0.009s
I20260709 13:14:20.366161  1449 raft_consensus.cc:359] T b20386846aee4ca5b9458883519bf06d P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.366791  1448 tablet_bootstrap.cc:654] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 40837fdefb66404b93c3e3876da432f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:20.366966  1449 raft_consensus.cc:385] T b20386846aee4ca5b9458883519bf06d P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:20.367419  1449 raft_consensus.cc:740] T b20386846aee4ca5b9458883519bf06d P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4f6eab2337842428ba2670421465839, State: Initialized, Role: FOLLOWER
I20260709 13:14:20.357610  1447 tablet_bootstrap.cc:492] T 7dff7291733e401c805ffe3d5829f7f5 P 0bf9692a81414cfab64ee45b5393d57e: Bootstrap starting.
I20260709 13:14:20.368233  1449 consensus_queue.cc:260] T b20386846aee4ca5b9458883519bf06d P e4f6eab2337842428ba2670421465839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.357725  1371 leader_election.cc:304] T 8b27a5294d34450aaff6336d315361c6 P 40837fdefb66404b93c3e3876da432f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40837fdefb66404b93c3e3876da432f7; no voters: 0bf9692a81414cfab64ee45b5393d57e, e4f6eab2337842428ba2670421465839
I20260709 13:14:20.371011  1457 raft_consensus.cc:2749] T 8b27a5294d34450aaff6336d315361c6 P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:20.371978  1449 ts_tablet_manager.cc:1434] T b20386846aee4ca5b9458883519bf06d P e4f6eab2337842428ba2670421465839: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:14:20.373057  1449 tablet_bootstrap.cc:492] T f2cb95dd66b44bb7ad3bdb0f8970a24e P e4f6eab2337842428ba2670421465839: Bootstrap starting.
I20260709 13:14:20.375821  1447 tablet_bootstrap.cc:654] T 7dff7291733e401c805ffe3d5829f7f5 P 0bf9692a81414cfab64ee45b5393d57e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:20.379866  1449 tablet_bootstrap.cc:654] T f2cb95dd66b44bb7ad3bdb0f8970a24e P e4f6eab2337842428ba2670421465839: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:20.393235  1449 tablet_bootstrap.cc:492] T f2cb95dd66b44bb7ad3bdb0f8970a24e P e4f6eab2337842428ba2670421465839: No bootstrap required, opened a new log
I20260709 13:14:20.393930  1449 ts_tablet_manager.cc:1403] T f2cb95dd66b44bb7ad3bdb0f8970a24e P e4f6eab2337842428ba2670421465839: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.003s
I20260709 13:14:20.395797  1448 tablet_bootstrap.cc:492] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 40837fdefb66404b93c3e3876da432f7: No bootstrap required, opened a new log
I20260709 13:14:20.396391  1448 ts_tablet_manager.cc:1403] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 40837fdefb66404b93c3e3876da432f7: Time spent bootstrapping tablet: real 0.036s	user 0.008s	sys 0.017s
I20260709 13:14:20.397086  1449 raft_consensus.cc:359] T f2cb95dd66b44bb7ad3bdb0f8970a24e P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.397900  1449 raft_consensus.cc:385] T f2cb95dd66b44bb7ad3bdb0f8970a24e P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:20.398180  1449 raft_consensus.cc:740] T f2cb95dd66b44bb7ad3bdb0f8970a24e P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4f6eab2337842428ba2670421465839, State: Initialized, Role: FOLLOWER
I20260709 13:14:20.398367  1447 tablet_bootstrap.cc:492] T 7dff7291733e401c805ffe3d5829f7f5 P 0bf9692a81414cfab64ee45b5393d57e: No bootstrap required, opened a new log
I20260709 13:14:20.399091  1447 ts_tablet_manager.cc:1403] T 7dff7291733e401c805ffe3d5829f7f5 P 0bf9692a81414cfab64ee45b5393d57e: Time spent bootstrapping tablet: real 0.042s	user 0.018s	sys 0.009s
I20260709 13:14:20.398998  1449 consensus_queue.cc:260] T f2cb95dd66b44bb7ad3bdb0f8970a24e P e4f6eab2337842428ba2670421465839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.399453  1448 raft_consensus.cc:359] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.400218  1448 raft_consensus.cc:385] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:20.400498  1448 raft_consensus.cc:740] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40837fdefb66404b93c3e3876da432f7, State: Initialized, Role: FOLLOWER
I20260709 13:14:20.401283  1448 consensus_queue.cc:260] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 40837fdefb66404b93c3e3876da432f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.401880  1447 raft_consensus.cc:359] T 7dff7291733e401c805ffe3d5829f7f5 P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.402887  1447 raft_consensus.cc:385] T 7dff7291733e401c805ffe3d5829f7f5 P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:20.403278  1447 raft_consensus.cc:740] T 7dff7291733e401c805ffe3d5829f7f5 P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bf9692a81414cfab64ee45b5393d57e, State: Initialized, Role: FOLLOWER
I20260709 13:14:20.403507  1449 ts_tablet_manager.cc:1434] T f2cb95dd66b44bb7ad3bdb0f8970a24e P e4f6eab2337842428ba2670421465839: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:14:20.404145  1447 consensus_queue.cc:260] T 7dff7291733e401c805ffe3d5829f7f5 P 0bf9692a81414cfab64ee45b5393d57e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.404660  1449 tablet_bootstrap.cc:492] T 275bc525ace541a89e9b89c5bdda27db P e4f6eab2337842428ba2670421465839: Bootstrap starting.
I20260709 13:14:20.406659  1447 ts_tablet_manager.cc:1434] T 7dff7291733e401c805ffe3d5829f7f5 P 0bf9692a81414cfab64ee45b5393d57e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:14:20.406831  1448 ts_tablet_manager.cc:1434] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 40837fdefb66404b93c3e3876da432f7: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:14:20.407887  1447 tablet_bootstrap.cc:492] T f2cb95dd66b44bb7ad3bdb0f8970a24e P 0bf9692a81414cfab64ee45b5393d57e: Bootstrap starting.
I20260709 13:14:20.414435  1447 tablet_bootstrap.cc:654] T f2cb95dd66b44bb7ad3bdb0f8970a24e P 0bf9692a81414cfab64ee45b5393d57e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:20.414714  1449 tablet_bootstrap.cc:654] T 275bc525ace541a89e9b89c5bdda27db P e4f6eab2337842428ba2670421465839: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:20.407943  1448 tablet_bootstrap.cc:492] T 82a1d9ee89c045d6ac3220d347e06972 P 40837fdefb66404b93c3e3876da432f7: Bootstrap starting.
I20260709 13:14:20.420151  1452 raft_consensus.cc:493] T 7dff7291733e401c805ffe3d5829f7f5 P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.420868  1452 raft_consensus.cc:515] T 7dff7291733e401c805ffe3d5829f7f5 P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.423118  1452 leader_election.cc:290] T 7dff7291733e401c805ffe3d5829f7f5 P 0bf9692a81414cfab64ee45b5393d57e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4f6eab2337842428ba2670421465839 (127.23.140.65:45009), 40837fdefb66404b93c3e3876da432f7 (127.23.140.67:43689)
I20260709 13:14:20.423290  1448 tablet_bootstrap.cc:654] T 82a1d9ee89c045d6ac3220d347e06972 P 40837fdefb66404b93c3e3876da432f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:20.425320  1407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dff7291733e401c805ffe3d5829f7f5" candidate_uuid: "0bf9692a81414cfab64ee45b5393d57e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40837fdefb66404b93c3e3876da432f7" is_pre_election: true
I20260709 13:14:20.426033  1407 raft_consensus.cc:2468] T 7dff7291733e401c805ffe3d5829f7f5 P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0bf9692a81414cfab64ee45b5393d57e in term 0.
I20260709 13:14:20.426875  1449 tablet_bootstrap.cc:492] T 275bc525ace541a89e9b89c5bdda27db P e4f6eab2337842428ba2670421465839: No bootstrap required, opened a new log
I20260709 13:14:20.427443  1449 ts_tablet_manager.cc:1403] T 275bc525ace541a89e9b89c5bdda27db P e4f6eab2337842428ba2670421465839: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.007s
I20260709 13:14:20.427732  1299 leader_election.cc:304] T 7dff7291733e401c805ffe3d5829f7f5 P 0bf9692a81414cfab64ee45b5393d57e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bf9692a81414cfab64ee45b5393d57e, 40837fdefb66404b93c3e3876da432f7; no voters: 
I20260709 13:14:20.429382  1447 tablet_bootstrap.cc:492] T f2cb95dd66b44bb7ad3bdb0f8970a24e P 0bf9692a81414cfab64ee45b5393d57e: No bootstrap required, opened a new log
I20260709 13:14:20.429983  1447 ts_tablet_manager.cc:1403] T f2cb95dd66b44bb7ad3bdb0f8970a24e P 0bf9692a81414cfab64ee45b5393d57e: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.005s
I20260709 13:14:20.430182  1258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dff7291733e401c805ffe3d5829f7f5" candidate_uuid: "0bf9692a81414cfab64ee45b5393d57e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f6eab2337842428ba2670421465839" is_pre_election: true
I20260709 13:14:20.430852  1258 raft_consensus.cc:2468] T 7dff7291733e401c805ffe3d5829f7f5 P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0bf9692a81414cfab64ee45b5393d57e in term 0.
I20260709 13:14:20.430658  1449 raft_consensus.cc:359] T 275bc525ace541a89e9b89c5bdda27db P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.431643  1449 raft_consensus.cc:385] T 275bc525ace541a89e9b89c5bdda27db P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:20.431988  1449 raft_consensus.cc:740] T 275bc525ace541a89e9b89c5bdda27db P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4f6eab2337842428ba2670421465839, State: Initialized, Role: FOLLOWER
I20260709 13:14:20.432965  1449 consensus_queue.cc:260] T 275bc525ace541a89e9b89c5bdda27db P e4f6eab2337842428ba2670421465839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.433813  1447 raft_consensus.cc:359] T f2cb95dd66b44bb7ad3bdb0f8970a24e P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.434620  1447 raft_consensus.cc:385] T f2cb95dd66b44bb7ad3bdb0f8970a24e P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:20.434953  1447 raft_consensus.cc:740] T f2cb95dd66b44bb7ad3bdb0f8970a24e P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bf9692a81414cfab64ee45b5393d57e, State: Initialized, Role: FOLLOWER
I20260709 13:14:20.435473  1449 ts_tablet_manager.cc:1434] T 275bc525ace541a89e9b89c5bdda27db P e4f6eab2337842428ba2670421465839: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:14:20.435842  1447 consensus_queue.cc:260] T f2cb95dd66b44bb7ad3bdb0f8970a24e P 0bf9692a81414cfab64ee45b5393d57e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.436491  1449 tablet_bootstrap.cc:492] T 05040be4aa904a3bb6bad07412e196eb P e4f6eab2337842428ba2670421465839: Bootstrap starting.
I20260709 13:14:20.437134  1453 raft_consensus.cc:2804] T 7dff7291733e401c805ffe3d5829f7f5 P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:20.437808  1453 raft_consensus.cc:493] T 7dff7291733e401c805ffe3d5829f7f5 P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:20.438261  1453 raft_consensus.cc:3060] T 7dff7291733e401c805ffe3d5829f7f5 P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:20.438548  1447 ts_tablet_manager.cc:1434] T f2cb95dd66b44bb7ad3bdb0f8970a24e P 0bf9692a81414cfab64ee45b5393d57e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:14:20.439721  1447 tablet_bootstrap.cc:492] T 82a1d9ee89c045d6ac3220d347e06972 P 0bf9692a81414cfab64ee45b5393d57e: Bootstrap starting.
I20260709 13:14:20.443861  1449 tablet_bootstrap.cc:654] T 05040be4aa904a3bb6bad07412e196eb P e4f6eab2337842428ba2670421465839: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:20.446563  1447 tablet_bootstrap.cc:654] T 82a1d9ee89c045d6ac3220d347e06972 P 0bf9692a81414cfab64ee45b5393d57e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:20.460927  1447 tablet_bootstrap.cc:492] T 82a1d9ee89c045d6ac3220d347e06972 P 0bf9692a81414cfab64ee45b5393d57e: No bootstrap required, opened a new log
I20260709 13:14:20.461702  1447 ts_tablet_manager.cc:1403] T 82a1d9ee89c045d6ac3220d347e06972 P 0bf9692a81414cfab64ee45b5393d57e: Time spent bootstrapping tablet: real 0.022s	user 0.019s	sys 0.001s
I20260709 13:14:20.462987  1453 raft_consensus.cc:515] T 7dff7291733e401c805ffe3d5829f7f5 P 0bf9692a81414cfab64ee45b5393d57e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.465652  1447 raft_consensus.cc:359] T 82a1d9ee89c045d6ac3220d347e06972 P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.466784  1447 raft_consensus.cc:385] T 82a1d9ee89c045d6ac3220d347e06972 P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:20.466830  1258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dff7291733e401c805ffe3d5829f7f5" candidate_uuid: "0bf9692a81414cfab64ee45b5393d57e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f6eab2337842428ba2670421465839"
I20260709 13:14:20.467337  1447 raft_consensus.cc:740] T 82a1d9ee89c045d6ac3220d347e06972 P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bf9692a81414cfab64ee45b5393d57e, State: Initialized, Role: FOLLOWER
I20260709 13:14:20.467787  1258 raft_consensus.cc:3060] T 7dff7291733e401c805ffe3d5829f7f5 P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:20.468626  1447 consensus_queue.cc:260] T 82a1d9ee89c045d6ac3220d347e06972 P 0bf9692a81414cfab64ee45b5393d57e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.471830  1447 ts_tablet_manager.cc:1434] T 82a1d9ee89c045d6ac3220d347e06972 P 0bf9692a81414cfab64ee45b5393d57e: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.002s
I20260709 13:14:20.473167  1447 tablet_bootstrap.cc:492] T 6d5b91e9a24a45ae90e730ae96c73317 P 0bf9692a81414cfab64ee45b5393d57e: Bootstrap starting.
I20260709 13:14:20.482448  1447 tablet_bootstrap.cc:654] T 6d5b91e9a24a45ae90e730ae96c73317 P 0bf9692a81414cfab64ee45b5393d57e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:20.488791  1258 raft_consensus.cc:2468] T 7dff7291733e401c805ffe3d5829f7f5 P e4f6eab2337842428ba2670421465839 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bf9692a81414cfab64ee45b5393d57e in term 1.
I20260709 13:14:20.492587  1407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dff7291733e401c805ffe3d5829f7f5" candidate_uuid: "0bf9692a81414cfab64ee45b5393d57e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40837fdefb66404b93c3e3876da432f7"
I20260709 13:14:20.493481  1407 raft_consensus.cc:3060] T 7dff7291733e401c805ffe3d5829f7f5 P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:20.495463  1447 tablet_bootstrap.cc:492] T 6d5b91e9a24a45ae90e730ae96c73317 P 0bf9692a81414cfab64ee45b5393d57e: No bootstrap required, opened a new log
I20260709 13:14:20.496178  1447 ts_tablet_manager.cc:1403] T 6d5b91e9a24a45ae90e730ae96c73317 P 0bf9692a81414cfab64ee45b5393d57e: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.010s
I20260709 13:14:20.497877  1452 raft_consensus.cc:493] T 275bc525ace541a89e9b89c5bdda27db P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.498588  1452 raft_consensus.cc:515] T 275bc525ace541a89e9b89c5bdda27db P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.500744  1447 raft_consensus.cc:359] T 6d5b91e9a24a45ae90e730ae96c73317 P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.501791  1447 raft_consensus.cc:385] T 6d5b91e9a24a45ae90e730ae96c73317 P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:20.502213  1447 raft_consensus.cc:740] T 6d5b91e9a24a45ae90e730ae96c73317 P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bf9692a81414cfab64ee45b5393d57e, State: Initialized, Role: FOLLOWER
I20260709 13:14:20.502400  1257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275bc525ace541a89e9b89c5bdda27db" candidate_uuid: "0bf9692a81414cfab64ee45b5393d57e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f6eab2337842428ba2670421465839" is_pre_election: true
I20260709 13:14:20.503350  1257 raft_consensus.cc:2468] T 275bc525ace541a89e9b89c5bdda27db P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0bf9692a81414cfab64ee45b5393d57e in term 0.
I20260709 13:14:20.503518  1447 consensus_queue.cc:260] T 6d5b91e9a24a45ae90e730ae96c73317 P 0bf9692a81414cfab64ee45b5393d57e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.505125  1452 leader_election.cc:290] T 275bc525ace541a89e9b89c5bdda27db P 0bf9692a81414cfab64ee45b5393d57e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4f6eab2337842428ba2670421465839 (127.23.140.65:45009), 40837fdefb66404b93c3e3876da432f7 (127.23.140.67:43689)
W20260709 13:14:20.506992  1204 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:20.507755  1406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275bc525ace541a89e9b89c5bdda27db" candidate_uuid: "0bf9692a81414cfab64ee45b5393d57e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40837fdefb66404b93c3e3876da432f7" is_pre_election: true
I20260709 13:14:20.507797  1459 raft_consensus.cc:493] T f2cb95dd66b44bb7ad3bdb0f8970a24e P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.509944  1459 raft_consensus.cc:515] T f2cb95dd66b44bb7ad3bdb0f8970a24e P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.515146  1297 leader_election.cc:304] T 275bc525ace541a89e9b89c5bdda27db P 0bf9692a81414cfab64ee45b5393d57e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bf9692a81414cfab64ee45b5393d57e, e4f6eab2337842428ba2670421465839; no voters: 
W20260709 13:14:20.519145  1299 leader_election.cc:343] T 275bc525ace541a89e9b89c5bdda27db P 0bf9692a81414cfab64ee45b5393d57e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40837fdefb66404b93c3e3876da432f7 (127.23.140.67:43689): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:20.528098  1452 raft_consensus.cc:2804] T 275bc525ace541a89e9b89c5bdda27db P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:20.528756  1452 raft_consensus.cc:493] T 275bc525ace541a89e9b89c5bdda27db P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:20.529192  1452 raft_consensus.cc:3060] T 275bc525ace541a89e9b89c5bdda27db P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:20.521401  1459 leader_election.cc:290] T f2cb95dd66b44bb7ad3bdb0f8970a24e P e4f6eab2337842428ba2670421465839 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66:38395), 40837fdefb66404b93c3e3876da432f7 (127.23.140.67:43689)
I20260709 13:14:20.562386  1453 leader_election.cc:290] T 7dff7291733e401c805ffe3d5829f7f5 P 0bf9692a81414cfab64ee45b5393d57e [CANDIDATE]: Term 1 election: Requested vote from peers e4f6eab2337842428ba2670421465839 (127.23.140.65:45009), 40837fdefb66404b93c3e3876da432f7 (127.23.140.67:43689)
I20260709 13:14:20.565356  1297 leader_election.cc:304] T 7dff7291733e401c805ffe3d5829f7f5 P 0bf9692a81414cfab64ee45b5393d57e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bf9692a81414cfab64ee45b5393d57e, e4f6eab2337842428ba2670421465839; no voters: 
I20260709 13:14:20.567921  1453 raft_consensus.cc:2804] T 7dff7291733e401c805ffe3d5829f7f5 P 0bf9692a81414cfab64ee45b5393d57e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:20.568607  1453 raft_consensus.cc:697] T 7dff7291733e401c805ffe3d5829f7f5 P 0bf9692a81414cfab64ee45b5393d57e [term 1 LEADER]: Becoming Leader. State: Replica: 0bf9692a81414cfab64ee45b5393d57e, State: Running, Role: LEADER
I20260709 13:14:20.569721  1453 consensus_queue.cc:237] T 7dff7291733e401c805ffe3d5829f7f5 P 0bf9692a81414cfab64ee45b5393d57e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.592986  1459 raft_consensus.cc:493] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.593854  1459 raft_consensus.cc:515] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.596695  1459 leader_election.cc:290] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P e4f6eab2337842428ba2670421465839 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66:38395), 40837fdefb66404b93c3e3876da432f7 (127.23.140.67:43689)
I20260709 13:14:20.604660  1448 tablet_bootstrap.cc:492] T 82a1d9ee89c045d6ac3220d347e06972 P 40837fdefb66404b93c3e3876da432f7: No bootstrap required, opened a new log
I20260709 13:14:20.605280  1448 ts_tablet_manager.cc:1403] T 82a1d9ee89c045d6ac3220d347e06972 P 40837fdefb66404b93c3e3876da432f7: Time spent bootstrapping tablet: real 0.198s	user 0.058s	sys 0.109s
I20260709 13:14:20.604686  1407 raft_consensus.cc:2468] T 7dff7291733e401c805ffe3d5829f7f5 P 40837fdefb66404b93c3e3876da432f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bf9692a81414cfab64ee45b5393d57e in term 1.
I20260709 13:14:20.606490  1449 tablet_bootstrap.cc:492] T 05040be4aa904a3bb6bad07412e196eb P e4f6eab2337842428ba2670421465839: No bootstrap required, opened a new log
I20260709 13:14:20.607426  1449 ts_tablet_manager.cc:1403] T 05040be4aa904a3bb6bad07412e196eb P e4f6eab2337842428ba2670421465839: Time spent bootstrapping tablet: real 0.171s	user 0.049s	sys 0.113s
I20260709 13:14:20.608373  1448 raft_consensus.cc:359] T 82a1d9ee89c045d6ac3220d347e06972 P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.609216  1448 raft_consensus.cc:385] T 82a1d9ee89c045d6ac3220d347e06972 P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:20.609520  1448 raft_consensus.cc:740] T 82a1d9ee89c045d6ac3220d347e06972 P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40837fdefb66404b93c3e3876da432f7, State: Initialized, Role: FOLLOWER
I20260709 13:14:20.610452  1448 consensus_queue.cc:260] T 82a1d9ee89c045d6ac3220d347e06972 P 40837fdefb66404b93c3e3876da432f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.611351  1449 raft_consensus.cc:359] T 05040be4aa904a3bb6bad07412e196eb P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.612337  1449 raft_consensus.cc:385] T 05040be4aa904a3bb6bad07412e196eb P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:20.612708  1449 raft_consensus.cc:740] T 05040be4aa904a3bb6bad07412e196eb P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4f6eab2337842428ba2670421465839, State: Initialized, Role: FOLLOWER
I20260709 13:14:20.613619  1449 consensus_queue.cc:260] T 05040be4aa904a3bb6bad07412e196eb P e4f6eab2337842428ba2670421465839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.616653  1449 ts_tablet_manager.cc:1434] T 05040be4aa904a3bb6bad07412e196eb P e4f6eab2337842428ba2670421465839: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:14:20.618247  1459 raft_consensus.cc:493] T b20386846aee4ca5b9458883519bf06d P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.618721  1459 raft_consensus.cc:515] T b20386846aee4ca5b9458883519bf06d P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.621304  1449 tablet_bootstrap.cc:492] T 8b27a5294d34450aaff6336d315361c6 P e4f6eab2337842428ba2670421465839: Bootstrap starting.
I20260709 13:14:20.624591  1448 ts_tablet_manager.cc:1434] T 82a1d9ee89c045d6ac3220d347e06972 P 40837fdefb66404b93c3e3876da432f7: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.001s
I20260709 13:14:20.631522  1449 tablet_bootstrap.cc:654] T 8b27a5294d34450aaff6336d315361c6 P e4f6eab2337842428ba2670421465839: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:20.633921  1448 tablet_bootstrap.cc:492] T 275bc525ace541a89e9b89c5bdda27db P 40837fdefb66404b93c3e3876da432f7: Bootstrap starting.
I20260709 13:14:20.629528  1459 leader_election.cc:290] T b20386846aee4ca5b9458883519bf06d P e4f6eab2337842428ba2670421465839 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66:38395), 40837fdefb66404b93c3e3876da432f7 (127.23.140.67:43689)
I20260709 13:14:20.642702  1448 tablet_bootstrap.cc:654] T 275bc525ace541a89e9b89c5bdda27db P 40837fdefb66404b93c3e3876da432f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:20.643545  1452 raft_consensus.cc:515] T 275bc525ace541a89e9b89c5bdda27db P 0bf9692a81414cfab64ee45b5393d57e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.645632  1449 tablet_bootstrap.cc:492] T 8b27a5294d34450aaff6336d315361c6 P e4f6eab2337842428ba2670421465839: No bootstrap required, opened a new log
I20260709 13:14:20.646360  1449 ts_tablet_manager.cc:1403] T 8b27a5294d34450aaff6336d315361c6 P e4f6eab2337842428ba2670421465839: Time spent bootstrapping tablet: real 0.029s	user 0.023s	sys 0.001s
I20260709 13:14:20.650306  1449 raft_consensus.cc:359] T 8b27a5294d34450aaff6336d315361c6 P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.651245  1449 raft_consensus.cc:385] T 8b27a5294d34450aaff6336d315361c6 P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:20.651614  1449 raft_consensus.cc:740] T 8b27a5294d34450aaff6336d315361c6 P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4f6eab2337842428ba2670421465839, State: Initialized, Role: FOLLOWER
I20260709 13:14:20.652829  1449 consensus_queue.cc:260] T 8b27a5294d34450aaff6336d315361c6 P e4f6eab2337842428ba2670421465839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.654908  1448 tablet_bootstrap.cc:492] T 275bc525ace541a89e9b89c5bdda27db P 40837fdefb66404b93c3e3876da432f7: No bootstrap required, opened a new log
I20260709 13:14:20.655471  1448 ts_tablet_manager.cc:1403] T 275bc525ace541a89e9b89c5bdda27db P 40837fdefb66404b93c3e3876da432f7: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.008s
I20260709 13:14:20.655965  1449 ts_tablet_manager.cc:1434] T 8b27a5294d34450aaff6336d315361c6 P e4f6eab2337842428ba2670421465839: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 13:14:20.656906  1453 raft_consensus.cc:493] T 05040be4aa904a3bb6bad07412e196eb P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.657290  1449 tablet_bootstrap.cc:492] T 82a1d9ee89c045d6ac3220d347e06972 P e4f6eab2337842428ba2670421465839: Bootstrap starting.
I20260709 13:14:20.659723  1154 catalog_manager.cc:5697] T 7dff7291733e401c805ffe3d5829f7f5 P 0bf9692a81414cfab64ee45b5393d57e reported cstate change: term changed from 0 to 1, leader changed from <none> to 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66). New cstate: current_term: 1 leader_uuid: "0bf9692a81414cfab64ee45b5393d57e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:20.663458  1457 raft_consensus.cc:493] T 05040be4aa904a3bb6bad07412e196eb P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.664016  1457 raft_consensus.cc:515] T 05040be4aa904a3bb6bad07412e196eb P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.665722  1448 raft_consensus.cc:359] T 275bc525ace541a89e9b89c5bdda27db P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.666499  1448 raft_consensus.cc:385] T 275bc525ace541a89e9b89c5bdda27db P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:20.666788  1448 raft_consensus.cc:740] T 275bc525ace541a89e9b89c5bdda27db P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40837fdefb66404b93c3e3876da432f7, State: Initialized, Role: FOLLOWER
I20260709 13:14:20.666973  1258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05040be4aa904a3bb6bad07412e196eb" candidate_uuid: "40837fdefb66404b93c3e3876da432f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f6eab2337842428ba2670421465839" is_pre_election: true
I20260709 13:14:20.667858  1449 tablet_bootstrap.cc:654] T 82a1d9ee89c045d6ac3220d347e06972 P e4f6eab2337842428ba2670421465839: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:20.669109  1457 leader_election.cc:290] T 05040be4aa904a3bb6bad07412e196eb P 40837fdefb66404b93c3e3876da432f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4f6eab2337842428ba2670421465839 (127.23.140.65:45009), 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66:38395)
I20260709 13:14:20.669834  1457 raft_consensus.cc:493] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.670312  1457 raft_consensus.cc:515] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.670423  1448 consensus_queue.cc:260] T 275bc525ace541a89e9b89c5bdda27db P 40837fdefb66404b93c3e3876da432f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.672765  1448 ts_tablet_manager.cc:1434] T 275bc525ace541a89e9b89c5bdda27db P 40837fdefb66404b93c3e3876da432f7: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.003s
I20260709 13:14:20.674525  1257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40fe2ece564243aa8dc5b1fae8ecd8" candidate_uuid: "40837fdefb66404b93c3e3876da432f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f6eab2337842428ba2670421465839" is_pre_election: true
I20260709 13:14:20.675393  1257 raft_consensus.cc:2468] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40837fdefb66404b93c3e3876da432f7 in term 0.
I20260709 13:14:20.673635  1333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05040be4aa904a3bb6bad07412e196eb" candidate_uuid: "40837fdefb66404b93c3e3876da432f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bf9692a81414cfab64ee45b5393d57e" is_pre_election: true
I20260709 13:14:20.677739  1371 leader_election.cc:304] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 40837fdefb66404b93c3e3876da432f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40837fdefb66404b93c3e3876da432f7, e4f6eab2337842428ba2670421465839; no voters: 
I20260709 13:14:20.667734  1258 raft_consensus.cc:2468] T 05040be4aa904a3bb6bad07412e196eb P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40837fdefb66404b93c3e3876da432f7 in term 0.
I20260709 13:14:20.680367  1486 raft_consensus.cc:2804] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:20.680830  1371 leader_election.cc:304] T 05040be4aa904a3bb6bad07412e196eb P 40837fdefb66404b93c3e3876da432f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40837fdefb66404b93c3e3876da432f7, e4f6eab2337842428ba2670421465839; no voters: 
I20260709 13:14:20.682679  1448 tablet_bootstrap.cc:492] T b20386846aee4ca5b9458883519bf06d P 40837fdefb66404b93c3e3876da432f7: Bootstrap starting.
I20260709 13:14:20.684756  1449 tablet_bootstrap.cc:492] T 82a1d9ee89c045d6ac3220d347e06972 P e4f6eab2337842428ba2670421465839: No bootstrap required, opened a new log
I20260709 13:14:20.680751  1486 raft_consensus.cc:493] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:20.685423  1449 ts_tablet_manager.cc:1403] T 82a1d9ee89c045d6ac3220d347e06972 P e4f6eab2337842428ba2670421465839: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.015s
I20260709 13:14:20.685362  1332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40fe2ece564243aa8dc5b1fae8ecd8" candidate_uuid: "40837fdefb66404b93c3e3876da432f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bf9692a81414cfab64ee45b5393d57e" is_pre_election: true
I20260709 13:14:20.685567  1486 raft_consensus.cc:3060] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:20.686430  1332 raft_consensus.cc:2468] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40837fdefb66404b93c3e3876da432f7 in term 0.
I20260709 13:14:20.688328  1457 leader_election.cc:290] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 40837fdefb66404b93c3e3876da432f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4f6eab2337842428ba2670421465839 (127.23.140.65:45009), 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66:38395)
I20260709 13:14:20.689535  1449 raft_consensus.cc:359] T 82a1d9ee89c045d6ac3220d347e06972 P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.690513  1449 raft_consensus.cc:385] T 82a1d9ee89c045d6ac3220d347e06972 P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:20.690851  1449 raft_consensus.cc:740] T 82a1d9ee89c045d6ac3220d347e06972 P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4f6eab2337842428ba2670421465839, State: Initialized, Role: FOLLOWER
I20260709 13:14:20.691628  1457 raft_consensus.cc:2804] T 05040be4aa904a3bb6bad07412e196eb P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:20.692124  1457 raft_consensus.cc:493] T 05040be4aa904a3bb6bad07412e196eb P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:20.691777  1449 consensus_queue.cc:260] T 82a1d9ee89c045d6ac3220d347e06972 P e4f6eab2337842428ba2670421465839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.692476  1457 raft_consensus.cc:3060] T 05040be4aa904a3bb6bad07412e196eb P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:20.694996  1449 ts_tablet_manager.cc:1434] T 82a1d9ee89c045d6ac3220d347e06972 P e4f6eab2337842428ba2670421465839: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:14:20.696240  1449 tablet_bootstrap.cc:492] T 6d5b91e9a24a45ae90e730ae96c73317 P e4f6eab2337842428ba2670421465839: Bootstrap starting.
I20260709 13:14:20.657407  1453 raft_consensus.cc:515] T 05040be4aa904a3bb6bad07412e196eb P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.697686  1333 raft_consensus.cc:2468] T 05040be4aa904a3bb6bad07412e196eb P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40837fdefb66404b93c3e3876da432f7 in term 0.
I20260709 13:14:20.704341  1449 tablet_bootstrap.cc:654] T 6d5b91e9a24a45ae90e730ae96c73317 P e4f6eab2337842428ba2670421465839: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:20.708310  1447 ts_tablet_manager.cc:1434] T 6d5b91e9a24a45ae90e730ae96c73317 P 0bf9692a81414cfab64ee45b5393d57e: Time spent starting tablet: real 0.211s	user 0.077s	sys 0.121s
I20260709 13:14:20.709156  1258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275bc525ace541a89e9b89c5bdda27db" candidate_uuid: "0bf9692a81414cfab64ee45b5393d57e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f6eab2337842428ba2670421465839"
I20260709 13:14:20.709853  1258 raft_consensus.cc:3060] T 275bc525ace541a89e9b89c5bdda27db P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:20.709925  1447 tablet_bootstrap.cc:492] T b20386846aee4ca5b9458883519bf06d P 0bf9692a81414cfab64ee45b5393d57e: Bootstrap starting.
I20260709 13:14:20.710381  1448 tablet_bootstrap.cc:654] T b20386846aee4ca5b9458883519bf06d P 40837fdefb66404b93c3e3876da432f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:20.716238  1449 tablet_bootstrap.cc:492] T 6d5b91e9a24a45ae90e730ae96c73317 P e4f6eab2337842428ba2670421465839: No bootstrap required, opened a new log
I20260709 13:14:20.716693  1449 ts_tablet_manager.cc:1403] T 6d5b91e9a24a45ae90e730ae96c73317 P e4f6eab2337842428ba2670421465839: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.003s
I20260709 13:14:20.716450  1486 raft_consensus.cc:515] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 40837fdefb66404b93c3e3876da432f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.718340  1447 tablet_bootstrap.cc:654] T b20386846aee4ca5b9458883519bf06d P 0bf9692a81414cfab64ee45b5393d57e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:20.719468  1449 raft_consensus.cc:359] T 6d5b91e9a24a45ae90e730ae96c73317 P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.720175  1449 raft_consensus.cc:385] T 6d5b91e9a24a45ae90e730ae96c73317 P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:20.720440  1449 raft_consensus.cc:740] T 6d5b91e9a24a45ae90e730ae96c73317 P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4f6eab2337842428ba2670421465839, State: Initialized, Role: FOLLOWER
I20260709 13:14:20.721383  1257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40fe2ece564243aa8dc5b1fae8ecd8" candidate_uuid: "40837fdefb66404b93c3e3876da432f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f6eab2337842428ba2670421465839"
I20260709 13:14:20.722124  1257 raft_consensus.cc:3060] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:20.721596  1449 consensus_queue.cc:260] T 6d5b91e9a24a45ae90e730ae96c73317 P e4f6eab2337842428ba2670421465839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.722378  1486 leader_election.cc:290] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 40837fdefb66404b93c3e3876da432f7 [CANDIDATE]: Term 1 election: Requested vote from peers e4f6eab2337842428ba2670421465839 (127.23.140.65:45009), 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66:38395)
I20260709 13:14:20.723006  1486 raft_consensus.cc:493] T 82a1d9ee89c045d6ac3220d347e06972 P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.723428  1486 raft_consensus.cc:515] T 82a1d9ee89c045d6ac3220d347e06972 P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.724501  1449 ts_tablet_manager.cc:1434] T 6d5b91e9a24a45ae90e730ae96c73317 P e4f6eab2337842428ba2670421465839: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:14:20.726888  1256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a1d9ee89c045d6ac3220d347e06972" candidate_uuid: "40837fdefb66404b93c3e3876da432f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f6eab2337842428ba2670421465839" is_pre_election: true
I20260709 13:14:20.727836  1256 raft_consensus.cc:2468] T 82a1d9ee89c045d6ac3220d347e06972 P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40837fdefb66404b93c3e3876da432f7 in term 0.
I20260709 13:14:20.728533  1448 tablet_bootstrap.cc:492] T b20386846aee4ca5b9458883519bf06d P 40837fdefb66404b93c3e3876da432f7: No bootstrap required, opened a new log
I20260709 13:14:20.729058  1448 ts_tablet_manager.cc:1403] T b20386846aee4ca5b9458883519bf06d P 40837fdefb66404b93c3e3876da432f7: Time spent bootstrapping tablet: real 0.047s	user 0.012s	sys 0.000s
I20260709 13:14:20.729331  1371 leader_election.cc:304] T 82a1d9ee89c045d6ac3220d347e06972 P 40837fdefb66404b93c3e3876da432f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40837fdefb66404b93c3e3876da432f7, e4f6eab2337842428ba2670421465839; no voters: 
I20260709 13:14:20.727011  1333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40fe2ece564243aa8dc5b1fae8ecd8" candidate_uuid: "40837fdefb66404b93c3e3876da432f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bf9692a81414cfab64ee45b5393d57e"
I20260709 13:14:20.730357  1333 raft_consensus.cc:3060] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:20.731488  1447 tablet_bootstrap.cc:492] T b20386846aee4ca5b9458883519bf06d P 0bf9692a81414cfab64ee45b5393d57e: No bootstrap required, opened a new log
I20260709 13:14:20.732031  1447 ts_tablet_manager.cc:1403] T b20386846aee4ca5b9458883519bf06d P 0bf9692a81414cfab64ee45b5393d57e: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.003s
I20260709 13:14:20.732106  1257 raft_consensus.cc:2468] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P e4f6eab2337842428ba2670421465839 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40837fdefb66404b93c3e3876da432f7 in term 1.
I20260709 13:14:20.733785  1371 leader_election.cc:304] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 40837fdefb66404b93c3e3876da432f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40837fdefb66404b93c3e3876da432f7, e4f6eab2337842428ba2670421465839; no voters: 
I20260709 13:14:20.735155  1447 raft_consensus.cc:359] T b20386846aee4ca5b9458883519bf06d P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.735618  1486 leader_election.cc:290] T 82a1d9ee89c045d6ac3220d347e06972 P 40837fdefb66404b93c3e3876da432f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4f6eab2337842428ba2670421465839 (127.23.140.65:45009), 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66:38395)
I20260709 13:14:20.735950  1447 raft_consensus.cc:385] T b20386846aee4ca5b9458883519bf06d P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:20.736230  1486 raft_consensus.cc:2804] T 82a1d9ee89c045d6ac3220d347e06972 P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:20.736392  1447 raft_consensus.cc:740] T b20386846aee4ca5b9458883519bf06d P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bf9692a81414cfab64ee45b5393d57e, State: Initialized, Role: FOLLOWER
I20260709 13:14:20.736708  1486 raft_consensus.cc:493] T 82a1d9ee89c045d6ac3220d347e06972 P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:20.736824  1332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a1d9ee89c045d6ac3220d347e06972" candidate_uuid: "40837fdefb66404b93c3e3876da432f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bf9692a81414cfab64ee45b5393d57e" is_pre_election: true
I20260709 13:14:20.737131  1486 raft_consensus.cc:3060] T 82a1d9ee89c045d6ac3220d347e06972 P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:20.737612  1332 raft_consensus.cc:2468] T 82a1d9ee89c045d6ac3220d347e06972 P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40837fdefb66404b93c3e3876da432f7 in term 0.
I20260709 13:14:20.737676  1447 consensus_queue.cc:260] T b20386846aee4ca5b9458883519bf06d P 0bf9692a81414cfab64ee45b5393d57e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.738179  1333 raft_consensus.cc:2468] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 0bf9692a81414cfab64ee45b5393d57e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40837fdefb66404b93c3e3876da432f7 in term 1.
I20260709 13:14:20.739699  1447 ts_tablet_manager.cc:1434] T b20386846aee4ca5b9458883519bf06d P 0bf9692a81414cfab64ee45b5393d57e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:14:20.732050  1448 raft_consensus.cc:359] T b20386846aee4ca5b9458883519bf06d P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.740635  1448 raft_consensus.cc:385] T b20386846aee4ca5b9458883519bf06d P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:20.741006  1448 raft_consensus.cc:740] T b20386846aee4ca5b9458883519bf06d P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40837fdefb66404b93c3e3876da432f7, State: Initialized, Role: FOLLOWER
I20260709 13:14:20.741883  1448 consensus_queue.cc:260] T b20386846aee4ca5b9458883519bf06d P 40837fdefb66404b93c3e3876da432f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.744557  1448 ts_tablet_manager.cc:1434] T b20386846aee4ca5b9458883519bf06d P 40837fdefb66404b93c3e3876da432f7: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.002s
I20260709 13:14:20.745663  1448 tablet_bootstrap.cc:492] T f2cb95dd66b44bb7ad3bdb0f8970a24e P 40837fdefb66404b93c3e3876da432f7: Bootstrap starting.
I20260709 13:14:20.748862  1480 raft_consensus.cc:493] T 6d5b91e9a24a45ae90e730ae96c73317 P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.749481  1480 raft_consensus.cc:515] T 6d5b91e9a24a45ae90e730ae96c73317 P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.749822  1486 raft_consensus.cc:515] T 82a1d9ee89c045d6ac3220d347e06972 P 40837fdefb66404b93c3e3876da432f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.752063  1448 tablet_bootstrap.cc:654] T f2cb95dd66b44bb7ad3bdb0f8970a24e P 40837fdefb66404b93c3e3876da432f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:20.752223  1333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2cb95dd66b44bb7ad3bdb0f8970a24e" candidate_uuid: "e4f6eab2337842428ba2670421465839" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bf9692a81414cfab64ee45b5393d57e" is_pre_election: true
I20260709 13:14:20.752485  1486 leader_election.cc:290] T 82a1d9ee89c045d6ac3220d347e06972 P 40837fdefb66404b93c3e3876da432f7 [CANDIDATE]: Term 1 election: Requested vote from peers e4f6eab2337842428ba2670421465839 (127.23.140.65:45009), 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66:38395)
I20260709 13:14:20.752909  1333 raft_consensus.cc:2468] T f2cb95dd66b44bb7ad3bdb0f8970a24e P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4f6eab2337842428ba2670421465839 in term 0.
I20260709 13:14:20.753386  1486 raft_consensus.cc:2804] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 40837fdefb66404b93c3e3876da432f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:20.754010  1486 raft_consensus.cc:697] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 40837fdefb66404b93c3e3876da432f7 [term 1 LEADER]: Becoming Leader. State: Replica: 40837fdefb66404b93c3e3876da432f7, State: Running, Role: LEADER
I20260709 13:14:20.754839  1333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a1d9ee89c045d6ac3220d347e06972" candidate_uuid: "40837fdefb66404b93c3e3876da432f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bf9692a81414cfab64ee45b5393d57e"
I20260709 13:14:20.755656  1333 raft_consensus.cc:3060] T 82a1d9ee89c045d6ac3220d347e06972 P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:20.755105  1486 consensus_queue.cc:237] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 40837fdefb66404b93c3e3876da432f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.763741  1448 tablet_bootstrap.cc:492] T f2cb95dd66b44bb7ad3bdb0f8970a24e P 40837fdefb66404b93c3e3876da432f7: No bootstrap required, opened a new log
I20260709 13:14:20.763906  1332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40fe2ece564243aa8dc5b1fae8ecd8" candidate_uuid: "e4f6eab2337842428ba2670421465839" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bf9692a81414cfab64ee45b5393d57e" is_pre_election: true
I20260709 13:14:20.764282  1448 ts_tablet_manager.cc:1403] T f2cb95dd66b44bb7ad3bdb0f8970a24e P 40837fdefb66404b93c3e3876da432f7: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 13:14:20.764708  1332 raft_consensus.cc:2393] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 0bf9692a81414cfab64ee45b5393d57e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4f6eab2337842428ba2670421465839 in current term 1: Already voted for candidate 40837fdefb66404b93c3e3876da432f7 in this term.
W20260709 13:14:20.766119  1223 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.23.140.126:38967, user_credentials={real_user=slave}} blocked reactor thread for 47954.4us
I20260709 13:14:20.769676  1453 leader_election.cc:290] T 05040be4aa904a3bb6bad07412e196eb P 0bf9692a81414cfab64ee45b5393d57e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4f6eab2337842428ba2670421465839 (127.23.140.65:45009), 40837fdefb66404b93c3e3876da432f7 (127.23.140.67:43689)
I20260709 13:14:20.770987  1452 leader_election.cc:290] T 275bc525ace541a89e9b89c5bdda27db P 0bf9692a81414cfab64ee45b5393d57e [CANDIDATE]: Term 1 election: Requested vote from peers e4f6eab2337842428ba2670421465839 (127.23.140.65:45009), 40837fdefb66404b93c3e3876da432f7 (127.23.140.67:43689)
I20260709 13:14:20.771840  1332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b20386846aee4ca5b9458883519bf06d" candidate_uuid: "e4f6eab2337842428ba2670421465839" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bf9692a81414cfab64ee45b5393d57e" is_pre_election: true
I20260709 13:14:20.772549  1332 raft_consensus.cc:2468] T b20386846aee4ca5b9458883519bf06d P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4f6eab2337842428ba2670421465839 in term 0.
I20260709 13:14:20.773782  1221 leader_election.cc:304] T f2cb95dd66b44bb7ad3bdb0f8970a24e P e4f6eab2337842428ba2670421465839 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bf9692a81414cfab64ee45b5393d57e, e4f6eab2337842428ba2670421465839; no voters: 
I20260709 13:14:20.776060  1221 leader_election.cc:304] T b20386846aee4ca5b9458883519bf06d P e4f6eab2337842428ba2670421465839 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bf9692a81414cfab64ee45b5393d57e, e4f6eab2337842428ba2670421465839; no voters: 
I20260709 13:14:20.776830  1459 raft_consensus.cc:2804] T f2cb95dd66b44bb7ad3bdb0f8970a24e P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:20.777184  1459 raft_consensus.cc:493] T f2cb95dd66b44bb7ad3bdb0f8970a24e P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:20.777530  1459 raft_consensus.cc:3060] T f2cb95dd66b44bb7ad3bdb0f8970a24e P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:20.777900  1448 raft_consensus.cc:359] T f2cb95dd66b44bb7ad3bdb0f8970a24e P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.778617  1448 raft_consensus.cc:385] T f2cb95dd66b44bb7ad3bdb0f8970a24e P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:20.778891  1448 raft_consensus.cc:740] T f2cb95dd66b44bb7ad3bdb0f8970a24e P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40837fdefb66404b93c3e3876da432f7, State: Initialized, Role: FOLLOWER
I20260709 13:14:20.779692  1448 consensus_queue.cc:260] T f2cb95dd66b44bb7ad3bdb0f8970a24e P 40837fdefb66404b93c3e3876da432f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.782984  1479 raft_consensus.cc:2804] T b20386846aee4ca5b9458883519bf06d P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:20.783581  1479 raft_consensus.cc:493] T b20386846aee4ca5b9458883519bf06d P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:20.784096  1479 raft_consensus.cc:3060] T b20386846aee4ca5b9458883519bf06d P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:20.792281  1256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5b91e9a24a45ae90e730ae96c73317" candidate_uuid: "0bf9692a81414cfab64ee45b5393d57e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f6eab2337842428ba2670421465839" is_pre_election: true
I20260709 13:14:20.793320  1256 raft_consensus.cc:2468] T 6d5b91e9a24a45ae90e730ae96c73317 P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0bf9692a81414cfab64ee45b5393d57e in term 0.
I20260709 13:14:20.799672  1452 raft_consensus.cc:493] T 8b27a5294d34450aaff6336d315361c6 P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.800432  1452 raft_consensus.cc:515] T 8b27a5294d34450aaff6336d315361c6 P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.806960  1297 leader_election.cc:304] T 6d5b91e9a24a45ae90e730ae96c73317 P 0bf9692a81414cfab64ee45b5393d57e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bf9692a81414cfab64ee45b5393d57e, e4f6eab2337842428ba2670421465839; no voters: 
I20260709 13:14:20.808540  1480 leader_election.cc:290] T 6d5b91e9a24a45ae90e730ae96c73317 P 0bf9692a81414cfab64ee45b5393d57e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4f6eab2337842428ba2670421465839 (127.23.140.65:45009), 40837fdefb66404b93c3e3876da432f7 (127.23.140.67:43689)
I20260709 13:14:20.808537  1453 raft_consensus.cc:2804] T 6d5b91e9a24a45ae90e730ae96c73317 P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:20.809305  1453 raft_consensus.cc:493] T 6d5b91e9a24a45ae90e730ae96c73317 P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:20.809835  1453 raft_consensus.cc:3060] T 6d5b91e9a24a45ae90e730ae96c73317 P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:20.810002  1258 raft_consensus.cc:2468] T 275bc525ace541a89e9b89c5bdda27db P e4f6eab2337842428ba2670421465839 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bf9692a81414cfab64ee45b5393d57e in term 1.
I20260709 13:14:20.817135  1406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275bc525ace541a89e9b89c5bdda27db" candidate_uuid: "0bf9692a81414cfab64ee45b5393d57e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40837fdefb66404b93c3e3876da432f7"
I20260709 13:14:20.817744  1406 raft_consensus.cc:3060] T 275bc525ace541a89e9b89c5bdda27db P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:20.819522  1333 raft_consensus.cc:2468] T 82a1d9ee89c045d6ac3220d347e06972 P 0bf9692a81414cfab64ee45b5393d57e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40837fdefb66404b93c3e3876da432f7 in term 1.
I20260709 13:14:20.816314  1407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05040be4aa904a3bb6bad07412e196eb" candidate_uuid: "0bf9692a81414cfab64ee45b5393d57e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40837fdefb66404b93c3e3876da432f7" is_pre_election: true
I20260709 13:14:20.817665  1297 leader_election.cc:304] T 275bc525ace541a89e9b89c5bdda27db P 0bf9692a81414cfab64ee45b5393d57e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bf9692a81414cfab64ee45b5393d57e, e4f6eab2337842428ba2670421465839; no voters: 
I20260709 13:14:20.820909  1452 leader_election.cc:290] T 8b27a5294d34450aaff6336d315361c6 P 0bf9692a81414cfab64ee45b5393d57e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4f6eab2337842428ba2670421465839 (127.23.140.65:45009), 40837fdefb66404b93c3e3876da432f7 (127.23.140.67:43689)
I20260709 13:14:20.809165  1257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05040be4aa904a3bb6bad07412e196eb" candidate_uuid: "0bf9692a81414cfab64ee45b5393d57e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f6eab2337842428ba2670421465839" is_pre_election: true
I20260709 13:14:20.813889  1448 ts_tablet_manager.cc:1434] T f2cb95dd66b44bb7ad3bdb0f8970a24e P 40837fdefb66404b93c3e3876da432f7: Time spent starting tablet: real 0.049s	user 0.011s	sys 0.013s
I20260709 13:14:20.830531  1448 tablet_bootstrap.cc:492] T 6d5b91e9a24a45ae90e730ae96c73317 P 40837fdefb66404b93c3e3876da432f7: Bootstrap starting.
I20260709 13:14:20.828152  1479 raft_consensus.cc:515] T b20386846aee4ca5b9458883519bf06d P e4f6eab2337842428ba2670421465839 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.831955  1452 raft_consensus.cc:2804] T 275bc525ace541a89e9b89c5bdda27db P 0bf9692a81414cfab64ee45b5393d57e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:20.833086  1452 raft_consensus.cc:697] T 275bc525ace541a89e9b89c5bdda27db P 0bf9692a81414cfab64ee45b5393d57e [term 1 LEADER]: Becoming Leader. State: Replica: 0bf9692a81414cfab64ee45b5393d57e, State: Running, Role: LEADER
I20260709 13:14:20.831632  1257 raft_consensus.cc:2468] T 05040be4aa904a3bb6bad07412e196eb P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0bf9692a81414cfab64ee45b5393d57e in term 0.
I20260709 13:14:20.833719  1258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b27a5294d34450aaff6336d315361c6" candidate_uuid: "0bf9692a81414cfab64ee45b5393d57e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f6eab2337842428ba2670421465839" is_pre_election: true
I20260709 13:14:20.833834  1370 leader_election.cc:304] T 82a1d9ee89c045d6ac3220d347e06972 P 40837fdefb66404b93c3e3876da432f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bf9692a81414cfab64ee45b5393d57e, 40837fdefb66404b93c3e3876da432f7; no voters: 
I20260709 13:14:20.834499  1258 raft_consensus.cc:2468] T 8b27a5294d34450aaff6336d315361c6 P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0bf9692a81414cfab64ee45b5393d57e in term 0.
I20260709 13:14:20.835081  1490 raft_consensus.cc:2804] T 82a1d9ee89c045d6ac3220d347e06972 P 40837fdefb66404b93c3e3876da432f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:20.835601  1490 raft_consensus.cc:697] T 82a1d9ee89c045d6ac3220d347e06972 P 40837fdefb66404b93c3e3876da432f7 [term 1 LEADER]: Becoming Leader. State: Replica: 40837fdefb66404b93c3e3876da432f7, State: Running, Role: LEADER
I20260709 13:14:20.835995  1297 leader_election.cc:304] T 05040be4aa904a3bb6bad07412e196eb P 0bf9692a81414cfab64ee45b5393d57e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bf9692a81414cfab64ee45b5393d57e, e4f6eab2337842428ba2670421465839; no voters: 
I20260709 13:14:20.836354  1406 raft_consensus.cc:2468] T 275bc525ace541a89e9b89c5bdda27db P 40837fdefb66404b93c3e3876da432f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bf9692a81414cfab64ee45b5393d57e in term 1.
I20260709 13:14:20.836427  1490 consensus_queue.cc:237] T 82a1d9ee89c045d6ac3220d347e06972 P 40837fdefb66404b93c3e3876da432f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.838466  1448 tablet_bootstrap.cc:654] T 6d5b91e9a24a45ae90e730ae96c73317 P 40837fdefb66404b93c3e3876da432f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:20.838454  1480 raft_consensus.cc:2804] T 05040be4aa904a3bb6bad07412e196eb P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:14:20.832839  1371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.140.65:45009, user_credentials={real_user=slave}} blocked reactor thread for 99182us
I20260709 13:14:20.838882  1297 leader_election.cc:304] T 8b27a5294d34450aaff6336d315361c6 P 0bf9692a81414cfab64ee45b5393d57e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bf9692a81414cfab64ee45b5393d57e, e4f6eab2337842428ba2670421465839; no voters: 
I20260709 13:14:20.840574  1480 raft_consensus.cc:493] T 05040be4aa904a3bb6bad07412e196eb P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:20.842605  1480 raft_consensus.cc:3060] T 05040be4aa904a3bb6bad07412e196eb P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:20.842825  1475 raft_consensus.cc:2804] T 8b27a5294d34450aaff6336d315361c6 P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:20.843264  1475 raft_consensus.cc:493] T 8b27a5294d34450aaff6336d315361c6 P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:20.843580  1475 raft_consensus.cc:3060] T 8b27a5294d34450aaff6336d315361c6 P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:20.838258  1453 raft_consensus.cc:515] T 6d5b91e9a24a45ae90e730ae96c73317 P 0bf9692a81414cfab64ee45b5393d57e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.841850  1452 consensus_queue.cc:237] T 275bc525ace541a89e9b89c5bdda27db P 0bf9692a81414cfab64ee45b5393d57e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.846232  1405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2cb95dd66b44bb7ad3bdb0f8970a24e" candidate_uuid: "e4f6eab2337842428ba2670421465839" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40837fdefb66404b93c3e3876da432f7" is_pre_election: true
I20260709 13:14:20.846552  1453 leader_election.cc:290] T 6d5b91e9a24a45ae90e730ae96c73317 P 0bf9692a81414cfab64ee45b5393d57e [CANDIDATE]: Term 1 election: Requested vote from peers e4f6eab2337842428ba2670421465839 (127.23.140.65:45009), 40837fdefb66404b93c3e3876da432f7 (127.23.140.67:43689)
I20260709 13:14:20.846947  1405 raft_consensus.cc:2468] T f2cb95dd66b44bb7ad3bdb0f8970a24e P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4f6eab2337842428ba2670421465839 in term 0.
I20260709 13:14:20.841118  1459 raft_consensus.cc:515] T f2cb95dd66b44bb7ad3bdb0f8970a24e P e4f6eab2337842428ba2670421465839 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.848415  1405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40fe2ece564243aa8dc5b1fae8ecd8" candidate_uuid: "e4f6eab2337842428ba2670421465839" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40837fdefb66404b93c3e3876da432f7" is_pre_election: true
I20260709 13:14:20.849104  1459 leader_election.cc:290] T f2cb95dd66b44bb7ad3bdb0f8970a24e P e4f6eab2337842428ba2670421465839 [CANDIDATE]: Term 1 election: Requested vote from peers 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66:38395), 40837fdefb66404b93c3e3876da432f7 (127.23.140.67:43689)
I20260709 13:14:20.850133  1405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b20386846aee4ca5b9458883519bf06d" candidate_uuid: "e4f6eab2337842428ba2670421465839" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40837fdefb66404b93c3e3876da432f7" is_pre_election: true
I20260709 13:14:20.850464  1332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2cb95dd66b44bb7ad3bdb0f8970a24e" candidate_uuid: "e4f6eab2337842428ba2670421465839" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bf9692a81414cfab64ee45b5393d57e"
I20260709 13:14:20.850793  1405 raft_consensus.cc:2468] T b20386846aee4ca5b9458883519bf06d P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4f6eab2337842428ba2670421465839 in term 0.
I20260709 13:14:20.851066  1332 raft_consensus.cc:3060] T f2cb95dd66b44bb7ad3bdb0f8970a24e P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:20.845363  1494 raft_consensus.cc:493] T 8b27a5294d34450aaff6336d315361c6 P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.844657  1479 leader_election.cc:290] T b20386846aee4ca5b9458883519bf06d P e4f6eab2337842428ba2670421465839 [CANDIDATE]: Term 1 election: Requested vote from peers 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66:38395), 40837fdefb66404b93c3e3876da432f7 (127.23.140.67:43689)
I20260709 13:14:20.857055  1333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b20386846aee4ca5b9458883519bf06d" candidate_uuid: "e4f6eab2337842428ba2670421465839" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bf9692a81414cfab64ee45b5393d57e"
I20260709 13:14:20.857937  1333 raft_consensus.cc:3060] T b20386846aee4ca5b9458883519bf06d P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:20.842629  1406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5b91e9a24a45ae90e730ae96c73317" candidate_uuid: "0bf9692a81414cfab64ee45b5393d57e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40837fdefb66404b93c3e3876da432f7" is_pre_election: true
I20260709 13:14:20.868932  1258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5b91e9a24a45ae90e730ae96c73317" candidate_uuid: "0bf9692a81414cfab64ee45b5393d57e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f6eab2337842428ba2670421465839"
I20260709 13:14:20.876235  1258 raft_consensus.cc:3060] T 6d5b91e9a24a45ae90e730ae96c73317 P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:20.882902  1257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a1d9ee89c045d6ac3220d347e06972" candidate_uuid: "40837fdefb66404b93c3e3876da432f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f6eab2337842428ba2670421465839"
I20260709 13:14:20.883622  1257 raft_consensus.cc:3060] T 82a1d9ee89c045d6ac3220d347e06972 P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:20.883571  1224 leader_election.cc:304] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P e4f6eab2337842428ba2670421465839 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4f6eab2337842428ba2670421465839; no voters: 0bf9692a81414cfab64ee45b5393d57e, 40837fdefb66404b93c3e3876da432f7
I20260709 13:14:20.887036  1479 raft_consensus.cc:2749] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P e4f6eab2337842428ba2670421465839 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:20.887910  1406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b27a5294d34450aaff6336d315361c6" candidate_uuid: "0bf9692a81414cfab64ee45b5393d57e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40837fdefb66404b93c3e3876da432f7" is_pre_election: true
I20260709 13:14:20.888067  1405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5b91e9a24a45ae90e730ae96c73317" candidate_uuid: "0bf9692a81414cfab64ee45b5393d57e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40837fdefb66404b93c3e3876da432f7"
I20260709 13:14:20.888583  1406 raft_consensus.cc:2468] T 8b27a5294d34450aaff6336d315361c6 P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0bf9692a81414cfab64ee45b5393d57e in term 0.
W20260709 13:14:20.887079  1299 leader_election.cc:343] T 6d5b91e9a24a45ae90e730ae96c73317 P 0bf9692a81414cfab64ee45b5393d57e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40837fdefb66404b93c3e3876da432f7 (127.23.140.67:43689): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:20.889961  1457 raft_consensus.cc:515] T 05040be4aa904a3bb6bad07412e196eb P 40837fdefb66404b93c3e3876da432f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.891130  1407 raft_consensus.cc:2393] T 05040be4aa904a3bb6bad07412e196eb P 40837fdefb66404b93c3e3876da432f7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0bf9692a81414cfab64ee45b5393d57e in current term 1: Already voted for candidate 40837fdefb66404b93c3e3876da432f7 in this term.
I20260709 13:14:20.892843  1475 raft_consensus.cc:515] T 8b27a5294d34450aaff6336d315361c6 P 0bf9692a81414cfab64ee45b5393d57e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.895502  1257 raft_consensus.cc:2468] T 82a1d9ee89c045d6ac3220d347e06972 P e4f6eab2337842428ba2670421465839 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40837fdefb66404b93c3e3876da432f7 in term 1.
I20260709 13:14:20.900379  1332 raft_consensus.cc:2468] T f2cb95dd66b44bb7ad3bdb0f8970a24e P 0bf9692a81414cfab64ee45b5393d57e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4f6eab2337842428ba2670421465839 in term 1.
I20260709 13:14:20.901692  1475 leader_election.cc:290] T 8b27a5294d34450aaff6336d315361c6 P 0bf9692a81414cfab64ee45b5393d57e [CANDIDATE]: Term 1 election: Requested vote from peers e4f6eab2337842428ba2670421465839 (127.23.140.65:45009), 40837fdefb66404b93c3e3876da432f7 (127.23.140.67:43689)
I20260709 13:14:20.900534  1331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05040be4aa904a3bb6bad07412e196eb" candidate_uuid: "40837fdefb66404b93c3e3876da432f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bf9692a81414cfab64ee45b5393d57e"
I20260709 13:14:20.901410  1257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b27a5294d34450aaff6336d315361c6" candidate_uuid: "0bf9692a81414cfab64ee45b5393d57e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f6eab2337842428ba2670421465839"
I20260709 13:14:20.881371  1480 raft_consensus.cc:515] T 05040be4aa904a3bb6bad07412e196eb P 0bf9692a81414cfab64ee45b5393d57e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.904443  1457 leader_election.cc:290] T 05040be4aa904a3bb6bad07412e196eb P 40837fdefb66404b93c3e3876da432f7 [CANDIDATE]: Term 1 election: Requested vote from peers e4f6eab2337842428ba2670421465839 (127.23.140.65:45009), 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66:38395)
I20260709 13:14:20.853574  1494 raft_consensus.cc:515] T 8b27a5294d34450aaff6336d315361c6 P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.924574  1407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b20386846aee4ca5b9458883519bf06d" candidate_uuid: "e4f6eab2337842428ba2670421465839" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40837fdefb66404b93c3e3876da432f7"
I20260709 13:14:20.925316  1407 raft_consensus.cc:3060] T b20386846aee4ca5b9458883519bf06d P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:20.925414  1331 raft_consensus.cc:2393] T 05040be4aa904a3bb6bad07412e196eb P 0bf9692a81414cfab64ee45b5393d57e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 40837fdefb66404b93c3e3876da432f7 in current term 1: Already voted for candidate 0bf9692a81414cfab64ee45b5393d57e in this term.
I20260709 13:14:20.926175  1494 leader_election.cc:290] T 8b27a5294d34450aaff6336d315361c6 P e4f6eab2337842428ba2670421465839 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66:38395), 40837fdefb66404b93c3e3876da432f7 (127.23.140.67:43689)
I20260709 13:14:20.927139  1257 raft_consensus.cc:3060] T 8b27a5294d34450aaff6336d315361c6 P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:20.924767  1256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05040be4aa904a3bb6bad07412e196eb" candidate_uuid: "40837fdefb66404b93c3e3876da432f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f6eab2337842428ba2670421465839"
I20260709 13:14:20.930054  1256 raft_consensus.cc:3060] T 05040be4aa904a3bb6bad07412e196eb P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:20.923389  1221 leader_election.cc:304] T f2cb95dd66b44bb7ad3bdb0f8970a24e P e4f6eab2337842428ba2670421465839 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bf9692a81414cfab64ee45b5393d57e, e4f6eab2337842428ba2670421465839; no voters: 
I20260709 13:14:20.933313  1494 raft_consensus.cc:2804] T f2cb95dd66b44bb7ad3bdb0f8970a24e P e4f6eab2337842428ba2670421465839 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:20.934056  1494 raft_consensus.cc:697] T f2cb95dd66b44bb7ad3bdb0f8970a24e P e4f6eab2337842428ba2670421465839 [term 1 LEADER]: Becoming Leader. State: Replica: e4f6eab2337842428ba2670421465839, State: Running, Role: LEADER
I20260709 13:14:20.934262  1331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b27a5294d34450aaff6336d315361c6" candidate_uuid: "e4f6eab2337842428ba2670421465839" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bf9692a81414cfab64ee45b5393d57e" is_pre_election: true
I20260709 13:14:20.935168  1331 raft_consensus.cc:2393] T 8b27a5294d34450aaff6336d315361c6 P 0bf9692a81414cfab64ee45b5393d57e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4f6eab2337842428ba2670421465839 in current term 1: Already voted for candidate 0bf9692a81414cfab64ee45b5393d57e in this term.
I20260709 13:14:20.934971  1494 consensus_queue.cc:237] T f2cb95dd66b44bb7ad3bdb0f8970a24e P e4f6eab2337842428ba2670421465839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.939083  1406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2cb95dd66b44bb7ad3bdb0f8970a24e" candidate_uuid: "e4f6eab2337842428ba2670421465839" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40837fdefb66404b93c3e3876da432f7"
I20260709 13:14:20.939762  1406 raft_consensus.cc:3060] T f2cb95dd66b44bb7ad3bdb0f8970a24e P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:20.939333  1257 raft_consensus.cc:2468] T 8b27a5294d34450aaff6336d315361c6 P e4f6eab2337842428ba2670421465839 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bf9692a81414cfab64ee45b5393d57e in term 1.
I20260709 13:14:20.942266  1297 leader_election.cc:304] T 8b27a5294d34450aaff6336d315361c6 P 0bf9692a81414cfab64ee45b5393d57e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bf9692a81414cfab64ee45b5393d57e, e4f6eab2337842428ba2670421465839; no voters: 
I20260709 13:14:20.943244  1452 raft_consensus.cc:2804] T 8b27a5294d34450aaff6336d315361c6 P 0bf9692a81414cfab64ee45b5393d57e [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:14:20.947096  1299 leader_election.cc:343] T 6d5b91e9a24a45ae90e730ae96c73317 P 0bf9692a81414cfab64ee45b5393d57e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 40837fdefb66404b93c3e3876da432f7 (127.23.140.67:43689): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:20.948031  1480 leader_election.cc:290] T 05040be4aa904a3bb6bad07412e196eb P 0bf9692a81414cfab64ee45b5393d57e [CANDIDATE]: Term 1 election: Requested vote from peers e4f6eab2337842428ba2670421465839 (127.23.140.65:45009), 40837fdefb66404b93c3e3876da432f7 (127.23.140.67:43689)
I20260709 13:14:20.950472  1405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b27a5294d34450aaff6336d315361c6" candidate_uuid: "0bf9692a81414cfab64ee45b5393d57e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40837fdefb66404b93c3e3876da432f7"
I20260709 13:14:20.950876  1404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05040be4aa904a3bb6bad07412e196eb" candidate_uuid: "0bf9692a81414cfab64ee45b5393d57e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40837fdefb66404b93c3e3876da432f7"
I20260709 13:14:20.951350  1405 raft_consensus.cc:3060] T 8b27a5294d34450aaff6336d315361c6 P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:20.951720  1404 raft_consensus.cc:2393] T 05040be4aa904a3bb6bad07412e196eb P 40837fdefb66404b93c3e3876da432f7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0bf9692a81414cfab64ee45b5393d57e in current term 1: Already voted for candidate 40837fdefb66404b93c3e3876da432f7 in this term.
I20260709 13:14:20.952195  1256 raft_consensus.cc:2468] T 05040be4aa904a3bb6bad07412e196eb P e4f6eab2337842428ba2670421465839 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40837fdefb66404b93c3e3876da432f7 in term 1.
I20260709 13:14:20.953357  1371 leader_election.cc:304] T 05040be4aa904a3bb6bad07412e196eb P 40837fdefb66404b93c3e3876da432f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40837fdefb66404b93c3e3876da432f7, e4f6eab2337842428ba2670421465839; no voters: 0bf9692a81414cfab64ee45b5393d57e
I20260709 13:14:20.910061  1333 raft_consensus.cc:2468] T b20386846aee4ca5b9458883519bf06d P 0bf9692a81414cfab64ee45b5393d57e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4f6eab2337842428ba2670421465839 in term 1.
I20260709 13:14:20.954752  1490 raft_consensus.cc:2804] T 05040be4aa904a3bb6bad07412e196eb P 40837fdefb66404b93c3e3876da432f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:20.954670  1403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b27a5294d34450aaff6336d315361c6" candidate_uuid: "e4f6eab2337842428ba2670421465839" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40837fdefb66404b93c3e3876da432f7" is_pre_election: true
I20260709 13:14:20.955360  1221 leader_election.cc:304] T b20386846aee4ca5b9458883519bf06d P e4f6eab2337842428ba2670421465839 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bf9692a81414cfab64ee45b5393d57e, e4f6eab2337842428ba2670421465839; no voters: 
I20260709 13:14:20.956254  1479 raft_consensus.cc:2804] T b20386846aee4ca5b9458883519bf06d P e4f6eab2337842428ba2670421465839 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:20.956645  1224 leader_election.cc:304] T 8b27a5294d34450aaff6336d315361c6 P e4f6eab2337842428ba2670421465839 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4f6eab2337842428ba2670421465839; no voters: 0bf9692a81414cfab64ee45b5393d57e, 40837fdefb66404b93c3e3876da432f7
I20260709 13:14:20.956866  1479 raft_consensus.cc:697] T b20386846aee4ca5b9458883519bf06d P e4f6eab2337842428ba2670421465839 [term 1 LEADER]: Becoming Leader. State: Replica: e4f6eab2337842428ba2670421465839, State: Running, Role: LEADER
I20260709 13:14:20.958216  1479 consensus_queue.cc:237] T b20386846aee4ca5b9458883519bf06d P e4f6eab2337842428ba2670421465839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.961624  1448 tablet_bootstrap.cc:492] T 6d5b91e9a24a45ae90e730ae96c73317 P 40837fdefb66404b93c3e3876da432f7: No bootstrap required, opened a new log
I20260709 13:14:20.962275  1448 ts_tablet_manager.cc:1403] T 6d5b91e9a24a45ae90e730ae96c73317 P 40837fdefb66404b93c3e3876da432f7: Time spent bootstrapping tablet: real 0.132s	user 0.012s	sys 0.011s
I20260709 13:14:20.962886  1459 raft_consensus.cc:2749] T 8b27a5294d34450aaff6336d315361c6 P e4f6eab2337842428ba2670421465839 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:20.946206  1452 raft_consensus.cc:697] T 8b27a5294d34450aaff6336d315361c6 P 0bf9692a81414cfab64ee45b5393d57e [term 1 LEADER]: Becoming Leader. State: Replica: 0bf9692a81414cfab64ee45b5393d57e, State: Running, Role: LEADER
I20260709 13:14:20.969736  1448 raft_consensus.cc:359] T 6d5b91e9a24a45ae90e730ae96c73317 P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.970875  1448 raft_consensus.cc:385] T 6d5b91e9a24a45ae90e730ae96c73317 P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:20.971118  1448 raft_consensus.cc:740] T 6d5b91e9a24a45ae90e730ae96c73317 P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40837fdefb66404b93c3e3876da432f7, State: Initialized, Role: FOLLOWER
I20260709 13:14:20.966001  1490 raft_consensus.cc:697] T 05040be4aa904a3bb6bad07412e196eb P 40837fdefb66404b93c3e3876da432f7 [term 1 LEADER]: Becoming Leader. State: Replica: 40837fdefb66404b93c3e3876da432f7, State: Running, Role: LEADER
I20260709 13:14:20.967636  1257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05040be4aa904a3bb6bad07412e196eb" candidate_uuid: "0bf9692a81414cfab64ee45b5393d57e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f6eab2337842428ba2670421465839"
I20260709 13:14:20.972728  1257 raft_consensus.cc:2393] T 05040be4aa904a3bb6bad07412e196eb P e4f6eab2337842428ba2670421465839 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0bf9692a81414cfab64ee45b5393d57e in current term 1: Already voted for candidate 40837fdefb66404b93c3e3876da432f7 in this term.
I20260709 13:14:20.972851  1490 consensus_queue.cc:237] T 05040be4aa904a3bb6bad07412e196eb P 40837fdefb66404b93c3e3876da432f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.974185  1297 leader_election.cc:304] T 05040be4aa904a3bb6bad07412e196eb P 0bf9692a81414cfab64ee45b5393d57e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0bf9692a81414cfab64ee45b5393d57e; no voters: 40837fdefb66404b93c3e3876da432f7, e4f6eab2337842428ba2670421465839
I20260709 13:14:20.975159  1475 raft_consensus.cc:2749] T 05040be4aa904a3bb6bad07412e196eb P 0bf9692a81414cfab64ee45b5393d57e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:14:20.972352  1452 consensus_queue.cc:237] T 8b27a5294d34450aaff6336d315361c6 P 0bf9692a81414cfab64ee45b5393d57e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.977735  1405 raft_consensus.cc:2468] T 8b27a5294d34450aaff6336d315361c6 P 40837fdefb66404b93c3e3876da432f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bf9692a81414cfab64ee45b5393d57e in term 1.
I20260709 13:14:20.978974  1406 raft_consensus.cc:2468] T f2cb95dd66b44bb7ad3bdb0f8970a24e P 40837fdefb66404b93c3e3876da432f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4f6eab2337842428ba2670421465839 in term 1.
I20260709 13:14:20.983126  1407 raft_consensus.cc:2468] T b20386846aee4ca5b9458883519bf06d P 40837fdefb66404b93c3e3876da432f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4f6eab2337842428ba2670421465839 in term 1.
I20260709 13:14:20.980445  1448 consensus_queue.cc:260] T 6d5b91e9a24a45ae90e730ae96c73317 P 40837fdefb66404b93c3e3876da432f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:20.985917  1448 ts_tablet_manager.cc:1434] T 6d5b91e9a24a45ae90e730ae96c73317 P 40837fdefb66404b93c3e3876da432f7: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260709 13:14:20.989377  1258 raft_consensus.cc:2468] T 6d5b91e9a24a45ae90e730ae96c73317 P e4f6eab2337842428ba2670421465839 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bf9692a81414cfab64ee45b5393d57e in term 1.
I20260709 13:14:20.990661  1297 leader_election.cc:304] T 6d5b91e9a24a45ae90e730ae96c73317 P 0bf9692a81414cfab64ee45b5393d57e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0bf9692a81414cfab64ee45b5393d57e, e4f6eab2337842428ba2670421465839; no voters: 40837fdefb66404b93c3e3876da432f7
I20260709 13:14:20.991592  1452 raft_consensus.cc:2804] T 6d5b91e9a24a45ae90e730ae96c73317 P 0bf9692a81414cfab64ee45b5393d57e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:20.992080  1452 raft_consensus.cc:697] T 6d5b91e9a24a45ae90e730ae96c73317 P 0bf9692a81414cfab64ee45b5393d57e [term 1 LEADER]: Becoming Leader. State: Replica: 0bf9692a81414cfab64ee45b5393d57e, State: Running, Role: LEADER
I20260709 13:14:20.991986  1156 catalog_manager.cc:5697] T f2cb95dd66b44bb7ad3bdb0f8970a24e P e4f6eab2337842428ba2670421465839 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4f6eab2337842428ba2670421465839 (127.23.140.65). New cstate: current_term: 1 leader_uuid: "e4f6eab2337842428ba2670421465839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:20.993206  1452 consensus_queue.cc:237] T 6d5b91e9a24a45ae90e730ae96c73317 P 0bf9692a81414cfab64ee45b5393d57e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:21.002338  1154 catalog_manager.cc:5697] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 40837fdefb66404b93c3e3876da432f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40837fdefb66404b93c3e3876da432f7 (127.23.140.67). New cstate: current_term: 1 leader_uuid: "40837fdefb66404b93c3e3876da432f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:21.003760  1154 catalog_manager.cc:5697] T 82a1d9ee89c045d6ac3220d347e06972 P 40837fdefb66404b93c3e3876da432f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40837fdefb66404b93c3e3876da432f7 (127.23.140.67). New cstate: current_term: 1 leader_uuid: "40837fdefb66404b93c3e3876da432f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:21.013368  1156 catalog_manager.cc:5697] T b20386846aee4ca5b9458883519bf06d P e4f6eab2337842428ba2670421465839 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4f6eab2337842428ba2670421465839 (127.23.140.65). New cstate: current_term: 1 leader_uuid: "e4f6eab2337842428ba2670421465839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:21.016593  1490 raft_consensus.cc:493] T 6d5b91e9a24a45ae90e730ae96c73317 P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:21.017171  1490 raft_consensus.cc:515] T 6d5b91e9a24a45ae90e730ae96c73317 P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:21.019392  1490 leader_election.cc:290] T 6d5b91e9a24a45ae90e730ae96c73317 P 40837fdefb66404b93c3e3876da432f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4f6eab2337842428ba2670421465839 (127.23.140.65:45009), 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66:38395)
I20260709 13:14:21.020567  1333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5b91e9a24a45ae90e730ae96c73317" candidate_uuid: "40837fdefb66404b93c3e3876da432f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bf9692a81414cfab64ee45b5393d57e" is_pre_election: true
I20260709 13:14:21.020639  1258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5b91e9a24a45ae90e730ae96c73317" candidate_uuid: "40837fdefb66404b93c3e3876da432f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f6eab2337842428ba2670421465839" is_pre_election: true
I20260709 13:14:21.021891  1258 raft_consensus.cc:2393] T 6d5b91e9a24a45ae90e730ae96c73317 P e4f6eab2337842428ba2670421465839 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40837fdefb66404b93c3e3876da432f7 in current term 1: Already voted for candidate 0bf9692a81414cfab64ee45b5393d57e in this term.
I20260709 13:14:21.023030  1371 leader_election.cc:304] T 6d5b91e9a24a45ae90e730ae96c73317 P 40837fdefb66404b93c3e3876da432f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40837fdefb66404b93c3e3876da432f7; no voters: 0bf9692a81414cfab64ee45b5393d57e, e4f6eab2337842428ba2670421465839
I20260709 13:14:21.023310  1155 catalog_manager.cc:5697] T 8b27a5294d34450aaff6336d315361c6 P 0bf9692a81414cfab64ee45b5393d57e reported cstate change: term changed from 0 to 1, leader changed from <none> to 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66). New cstate: current_term: 1 leader_uuid: "0bf9692a81414cfab64ee45b5393d57e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:21.023880  1490 raft_consensus.cc:3060] T 6d5b91e9a24a45ae90e730ae96c73317 P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:21.025149  1155 catalog_manager.cc:5697] T 275bc525ace541a89e9b89c5bdda27db P 0bf9692a81414cfab64ee45b5393d57e reported cstate change: term changed from 0 to 1, leader changed from <none> to 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66). New cstate: current_term: 1 leader_uuid: "0bf9692a81414cfab64ee45b5393d57e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:21.032583  1490 raft_consensus.cc:2749] T 6d5b91e9a24a45ae90e730ae96c73317 P 40837fdefb66404b93c3e3876da432f7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:21.034122  1154 catalog_manager.cc:5697] T 05040be4aa904a3bb6bad07412e196eb P 40837fdefb66404b93c3e3876da432f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40837fdefb66404b93c3e3876da432f7 (127.23.140.67). New cstate: current_term: 1 leader_uuid: "40837fdefb66404b93c3e3876da432f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:21.042599  1155 catalog_manager.cc:5697] T 6d5b91e9a24a45ae90e730ae96c73317 P 0bf9692a81414cfab64ee45b5393d57e reported cstate change: term changed from 0 to 1, leader changed from <none> to 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66). New cstate: current_term: 1 leader_uuid: "0bf9692a81414cfab64ee45b5393d57e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:21.064165  1452 consensus_queue.cc:1048] T 7dff7291733e401c805ffe3d5829f7f5 P 0bf9692a81414cfab64ee45b5393d57e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:21.075969  1480 consensus_queue.cc:1048] T 7dff7291733e401c805ffe3d5829f7f5 P 0bf9692a81414cfab64ee45b5393d57e [LEADER]: Connected to new peer: Peer: permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:21.156250  1331 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b27a5294d34450aaff6336d315361c6"
dest_uuid: "0bf9692a81414cfab64ee45b5393d57e"
mode: GRACEFUL
new_leader_uuid: "e4f6eab2337842428ba2670421465839"
 from {username='slave'} at 127.0.0.1:51518
I20260709 13:14:21.156962  1331 raft_consensus.cc:606] T 8b27a5294d34450aaff6336d315361c6 P 0bf9692a81414cfab64ee45b5393d57e [term 1 LEADER]: Received request to transfer leadership to TS e4f6eab2337842428ba2670421465839
I20260709 13:14:21.158078  1490 consensus_queue.cc:1048] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 40837fdefb66404b93c3e3876da432f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:21.163235  1333 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "275bc525ace541a89e9b89c5bdda27db"
dest_uuid: "0bf9692a81414cfab64ee45b5393d57e"
mode: GRACEFUL
new_leader_uuid: "e4f6eab2337842428ba2670421465839"
 from {username='slave'} at 127.0.0.1:51518
I20260709 13:14:21.163761  1333 raft_consensus.cc:606] T 275bc525ace541a89e9b89c5bdda27db P 0bf9692a81414cfab64ee45b5393d57e [term 1 LEADER]: Received request to transfer leadership to TS e4f6eab2337842428ba2670421465839
I20260709 13:14:21.171990  1490 consensus_queue.cc:1048] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 40837fdefb66404b93c3e3876da432f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:21.187461  1406 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c40fe2ece564243aa8dc5b1fae8ecd8"
dest_uuid: "40837fdefb66404b93c3e3876da432f7"
mode: GRACEFUL
new_leader_uuid: "e4f6eab2337842428ba2670421465839"
 from {username='slave'} at 127.0.0.1:42018
I20260709 13:14:21.188050  1406 raft_consensus.cc:606] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 40837fdefb66404b93c3e3876da432f7 [term 1 LEADER]: Received request to transfer leadership to TS e4f6eab2337842428ba2670421465839
I20260709 13:14:21.193413  1333 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7dff7291733e401c805ffe3d5829f7f5"
dest_uuid: "0bf9692a81414cfab64ee45b5393d57e"
mode: GRACEFUL
new_leader_uuid: "e4f6eab2337842428ba2670421465839"
 from {username='slave'} at 127.0.0.1:51518
I20260709 13:14:21.194020  1333 raft_consensus.cc:606] T 7dff7291733e401c805ffe3d5829f7f5 P 0bf9692a81414cfab64ee45b5393d57e [term 1 LEADER]: Received request to transfer leadership to TS e4f6eab2337842428ba2670421465839
I20260709 13:14:21.198896  1406 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05040be4aa904a3bb6bad07412e196eb"
dest_uuid: "40837fdefb66404b93c3e3876da432f7"
mode: GRACEFUL
new_leader_uuid: "0bf9692a81414cfab64ee45b5393d57e"
 from {username='slave'} at 127.0.0.1:42018
I20260709 13:14:21.199363  1406 raft_consensus.cc:606] T 05040be4aa904a3bb6bad07412e196eb P 40837fdefb66404b93c3e3876da432f7 [term 1 LEADER]: Received request to transfer leadership to TS 0bf9692a81414cfab64ee45b5393d57e
I20260709 13:14:21.212605  1258 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f2cb95dd66b44bb7ad3bdb0f8970a24e"
dest_uuid: "e4f6eab2337842428ba2670421465839"
mode: GRACEFUL
new_leader_uuid: "0bf9692a81414cfab64ee45b5393d57e"
 from {username='slave'} at 127.0.0.1:46668
I20260709 13:14:21.213122  1258 raft_consensus.cc:606] T f2cb95dd66b44bb7ad3bdb0f8970a24e P e4f6eab2337842428ba2670421465839 [term 1 LEADER]: Received request to transfer leadership to TS 0bf9692a81414cfab64ee45b5393d57e
I20260709 13:14:21.218509  1406 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82a1d9ee89c045d6ac3220d347e06972"
dest_uuid: "40837fdefb66404b93c3e3876da432f7"
mode: GRACEFUL
new_leader_uuid: "0bf9692a81414cfab64ee45b5393d57e"
 from {username='slave'} at 127.0.0.1:42018
I20260709 13:14:21.218976  1406 raft_consensus.cc:606] T 82a1d9ee89c045d6ac3220d347e06972 P 40837fdefb66404b93c3e3876da432f7 [term 1 LEADER]: Received request to transfer leadership to TS 0bf9692a81414cfab64ee45b5393d57e
I20260709 13:14:21.224164  1258 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b20386846aee4ca5b9458883519bf06d"
dest_uuid: "e4f6eab2337842428ba2670421465839"
mode: GRACEFUL
new_leader_uuid: "0bf9692a81414cfab64ee45b5393d57e"
 from {username='slave'} at 127.0.0.1:46668
I20260709 13:14:21.224629  1258 raft_consensus.cc:606] T b20386846aee4ca5b9458883519bf06d P e4f6eab2337842428ba2670421465839 [term 1 LEADER]: Received request to transfer leadership to TS 0bf9692a81414cfab64ee45b5393d57e
I20260709 13:14:21.229825  1333 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d5b91e9a24a45ae90e730ae96c73317"
dest_uuid: "0bf9692a81414cfab64ee45b5393d57e"
mode: GRACEFUL
new_leader_uuid: "40837fdefb66404b93c3e3876da432f7"
 from {username='slave'} at 127.0.0.1:51518
I20260709 13:14:21.230283  1333 raft_consensus.cc:606] T 6d5b91e9a24a45ae90e730ae96c73317 P 0bf9692a81414cfab64ee45b5393d57e [term 1 LEADER]: Received request to transfer leadership to TS 40837fdefb66404b93c3e3876da432f7
I20260709 13:14:21.336833  1490 consensus_queue.cc:1048] T 82a1d9ee89c045d6ac3220d347e06972 P 40837fdefb66404b93c3e3876da432f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:21.343555  1484 raft_consensus.cc:993] T 82a1d9ee89c045d6ac3220d347e06972 P 40837fdefb66404b93c3e3876da432f7: : Instructing follower 0bf9692a81414cfab64ee45b5393d57e to start an election
I20260709 13:14:21.344031  1493 raft_consensus.cc:1081] T 82a1d9ee89c045d6ac3220d347e06972 P 40837fdefb66404b93c3e3876da432f7 [term 1 LEADER]: Signalling peer 0bf9692a81414cfab64ee45b5393d57e to start an election
I20260709 13:14:21.345825  1331 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82a1d9ee89c045d6ac3220d347e06972"
dest_uuid: "0bf9692a81414cfab64ee45b5393d57e"
 from {username='slave'} at 127.0.0.1:51510
I20260709 13:14:21.346396  1331 raft_consensus.cc:493] T 82a1d9ee89c045d6ac3220d347e06972 P 0bf9692a81414cfab64ee45b5393d57e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:21.346781  1331 raft_consensus.cc:3060] T 82a1d9ee89c045d6ac3220d347e06972 P 0bf9692a81414cfab64ee45b5393d57e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:21.350080  1484 consensus_queue.cc:1048] T 82a1d9ee89c045d6ac3220d347e06972 P 40837fdefb66404b93c3e3876da432f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:21.354940  1331 raft_consensus.cc:515] T 82a1d9ee89c045d6ac3220d347e06972 P 0bf9692a81414cfab64ee45b5393d57e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:21.357944  1258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a1d9ee89c045d6ac3220d347e06972" candidate_uuid: "0bf9692a81414cfab64ee45b5393d57e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4f6eab2337842428ba2670421465839"
I20260709 13:14:21.358632  1258 raft_consensus.cc:3060] T 82a1d9ee89c045d6ac3220d347e06972 P e4f6eab2337842428ba2670421465839 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:21.363972  1452 consensus_queue.cc:1048] T 275bc525ace541a89e9b89c5bdda27db P 0bf9692a81414cfab64ee45b5393d57e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:21.365375  1331 leader_election.cc:290] T 82a1d9ee89c045d6ac3220d347e06972 P 0bf9692a81414cfab64ee45b5393d57e [CANDIDATE]: Term 2 election: Requested vote from peers e4f6eab2337842428ba2670421465839 (127.23.140.65:45009), 40837fdefb66404b93c3e3876da432f7 (127.23.140.67:43689)
I20260709 13:14:21.366367  1258 raft_consensus.cc:2468] T 82a1d9ee89c045d6ac3220d347e06972 P e4f6eab2337842428ba2670421465839 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bf9692a81414cfab64ee45b5393d57e in term 2.
I20260709 13:14:21.366602  1406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a1d9ee89c045d6ac3220d347e06972" candidate_uuid: "0bf9692a81414cfab64ee45b5393d57e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40837fdefb66404b93c3e3876da432f7"
I20260709 13:14:21.367353  1406 raft_consensus.cc:3055] T 82a1d9ee89c045d6ac3220d347e06972 P 40837fdefb66404b93c3e3876da432f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:21.367673  1406 raft_consensus.cc:740] T 82a1d9ee89c045d6ac3220d347e06972 P 40837fdefb66404b93c3e3876da432f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 40837fdefb66404b93c3e3876da432f7, State: Running, Role: LEADER
I20260709 13:14:21.368495  1406 consensus_queue.cc:260] T 82a1d9ee89c045d6ac3220d347e06972 P 40837fdefb66404b93c3e3876da432f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:21.368837  1297 leader_election.cc:304] T 82a1d9ee89c045d6ac3220d347e06972 P 0bf9692a81414cfab64ee45b5393d57e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bf9692a81414cfab64ee45b5393d57e, e4f6eab2337842428ba2670421465839; no voters: 
I20260709 13:14:21.369963  1452 raft_consensus.cc:2804] T 82a1d9ee89c045d6ac3220d347e06972 P 0bf9692a81414cfab64ee45b5393d57e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:21.369905  1406 raft_consensus.cc:3060] T 82a1d9ee89c045d6ac3220d347e06972 P 40837fdefb66404b93c3e3876da432f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:21.370573  1452 raft_consensus.cc:697] T 82a1d9ee89c045d6ac3220d347e06972 P 0bf9692a81414cfab64ee45b5393d57e [term 2 LEADER]: Becoming Leader. State: Replica: 0bf9692a81414cfab64ee45b5393d57e, State: Running, Role: LEADER
I20260709 13:14:21.371441  1452 consensus_queue.cc:237] T 82a1d9ee89c045d6ac3220d347e06972 P 0bf9692a81414cfab64ee45b5393d57e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:21.373473  1480 raft_consensus.cc:993] T 275bc525ace541a89e9b89c5bdda27db P 0bf9692a81414cfab64ee45b5393d57e: : Instructing follower e4f6eab2337842428ba2670421465839 to start an election
I20260709 13:14:21.374003  1480 raft_consensus.cc:1081] T 275bc525ace541a89e9b89c5bdda27db P 0bf9692a81414cfab64ee45b5393d57e [term 1 LEADER]: Signalling peer e4f6eab2337842428ba2670421465839 to start an election
I20260709 13:14:21.376405  1494 consensus_queue.cc:1048] T b20386846aee4ca5b9458883519bf06d P e4f6eab2337842428ba2670421465839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:21.380688  1258 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "275bc525ace541a89e9b89c5bdda27db"
dest_uuid: "e4f6eab2337842428ba2670421465839"
 from {username='slave'} at 127.0.0.1:46648
I20260709 13:14:21.381243  1258 raft_consensus.cc:493] T 275bc525ace541a89e9b89c5bdda27db P e4f6eab2337842428ba2670421465839 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:21.381603  1258 raft_consensus.cc:3060] T 275bc525ace541a89e9b89c5bdda27db P e4f6eab2337842428ba2670421465839 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:21.383309  1156 catalog_manager.cc:5697] T 82a1d9ee89c045d6ac3220d347e06972 P 0bf9692a81414cfab64ee45b5393d57e reported cstate change: term changed from 1 to 2, leader changed from 40837fdefb66404b93c3e3876da432f7 (127.23.140.67) to 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66). New cstate: current_term: 2 leader_uuid: "0bf9692a81414cfab64ee45b5393d57e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:21.386731  1480 consensus_queue.cc:1048] T 275bc525ace541a89e9b89c5bdda27db P 0bf9692a81414cfab64ee45b5393d57e [LEADER]: Connected to new peer: Peer: permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:21.389267  1258 raft_consensus.cc:515] T 275bc525ace541a89e9b89c5bdda27db P e4f6eab2337842428ba2670421465839 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:21.392079  1258 leader_election.cc:290] T 275bc525ace541a89e9b89c5bdda27db P e4f6eab2337842428ba2670421465839 [CANDIDATE]: Term 2 election: Requested vote from peers 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66:38395), 40837fdefb66404b93c3e3876da432f7 (127.23.140.67:43689)
I20260709 13:14:21.394282  1331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275bc525ace541a89e9b89c5bdda27db" candidate_uuid: "e4f6eab2337842428ba2670421465839" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0bf9692a81414cfab64ee45b5393d57e"
I20260709 13:14:21.394856  1331 raft_consensus.cc:3055] T 275bc525ace541a89e9b89c5bdda27db P 0bf9692a81414cfab64ee45b5393d57e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:21.395174  1331 raft_consensus.cc:740] T 275bc525ace541a89e9b89c5bdda27db P 0bf9692a81414cfab64ee45b5393d57e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0bf9692a81414cfab64ee45b5393d57e, State: Running, Role: LEADER
I20260709 13:14:21.396111  1331 consensus_queue.cc:260] T 275bc525ace541a89e9b89c5bdda27db P 0bf9692a81414cfab64ee45b5393d57e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:21.397218  1331 raft_consensus.cc:3060] T 275bc525ace541a89e9b89c5bdda27db P 0bf9692a81414cfab64ee45b5393d57e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:21.403247  1406 raft_consensus.cc:2468] T 82a1d9ee89c045d6ac3220d347e06972 P 40837fdefb66404b93c3e3876da432f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bf9692a81414cfab64ee45b5393d57e in term 2.
I20260709 13:14:21.403820  1459 consensus_queue.cc:1048] T b20386846aee4ca5b9458883519bf06d P e4f6eab2337842428ba2670421465839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:21.395123  1405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275bc525ace541a89e9b89c5bdda27db" candidate_uuid: "e4f6eab2337842428ba2670421465839" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40837fdefb66404b93c3e3876da432f7"
I20260709 13:14:21.410195  1452 consensus_queue.cc:1048] T 6d5b91e9a24a45ae90e730ae96c73317 P 0bf9692a81414cfab64ee45b5393d57e [LEADER]: Connected to new peer: Peer: permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:21.410985  1405 raft_consensus.cc:3060] T 275bc525ace541a89e9b89c5bdda27db P 40837fdefb66404b93c3e3876da432f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:21.416550  1459 consensus_queue.cc:1048] T f2cb95dd66b44bb7ad3bdb0f8970a24e P e4f6eab2337842428ba2670421465839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:21.419247  1331 raft_consensus.cc:2468] T 275bc525ace541a89e9b89c5bdda27db P 0bf9692a81414cfab64ee45b5393d57e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4f6eab2337842428ba2670421465839 in term 2.
I20260709 13:14:21.425622  1452 consensus_queue.cc:1048] T 8b27a5294d34450aaff6336d315361c6 P 0bf9692a81414cfab64ee45b5393d57e [LEADER]: Connected to new peer: Peer: permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:21.428716  1405 raft_consensus.cc:2468] T 275bc525ace541a89e9b89c5bdda27db P 40837fdefb66404b93c3e3876da432f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4f6eab2337842428ba2670421465839 in term 2.
I20260709 13:14:21.430848  1221 leader_election.cc:304] T 275bc525ace541a89e9b89c5bdda27db P e4f6eab2337842428ba2670421465839 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bf9692a81414cfab64ee45b5393d57e, e4f6eab2337842428ba2670421465839; no voters: 
I20260709 13:14:21.432548  1459 raft_consensus.cc:2804] T 275bc525ace541a89e9b89c5bdda27db P e4f6eab2337842428ba2670421465839 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:21.433063  1459 raft_consensus.cc:697] T 275bc525ace541a89e9b89c5bdda27db P e4f6eab2337842428ba2670421465839 [term 2 LEADER]: Becoming Leader. State: Replica: e4f6eab2337842428ba2670421465839, State: Running, Role: LEADER
I20260709 13:14:21.433905  1459 consensus_queue.cc:237] T 275bc525ace541a89e9b89c5bdda27db P e4f6eab2337842428ba2670421465839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:21.434753  1480 consensus_queue.cc:1048] T 6d5b91e9a24a45ae90e730ae96c73317 P 0bf9692a81414cfab64ee45b5393d57e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:21.435168  1494 raft_consensus.cc:993] T b20386846aee4ca5b9458883519bf06d P e4f6eab2337842428ba2670421465839: : Instructing follower 0bf9692a81414cfab64ee45b5393d57e to start an election
I20260709 13:14:21.435655  1494 raft_consensus.cc:1081] T b20386846aee4ca5b9458883519bf06d P e4f6eab2337842428ba2670421465839 [term 1 LEADER]: Signalling peer 0bf9692a81414cfab64ee45b5393d57e to start an election
I20260709 13:14:21.442214  1331 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b20386846aee4ca5b9458883519bf06d"
dest_uuid: "0bf9692a81414cfab64ee45b5393d57e"
 from {username='slave'} at 127.0.0.1:51514
I20260709 13:14:21.442806  1331 raft_consensus.cc:493] T b20386846aee4ca5b9458883519bf06d P 0bf9692a81414cfab64ee45b5393d57e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:21.443194  1331 raft_consensus.cc:3060] T b20386846aee4ca5b9458883519bf06d P 0bf9692a81414cfab64ee45b5393d57e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:21.448696  1452 raft_consensus.cc:993] T 6d5b91e9a24a45ae90e730ae96c73317 P 0bf9692a81414cfab64ee45b5393d57e: : Instructing follower 40837fdefb66404b93c3e3876da432f7 to start an election
I20260709 13:14:21.449183  1452 raft_consensus.cc:1081] T 6d5b91e9a24a45ae90e730ae96c73317 P 0bf9692a81414cfab64ee45b5393d57e [term 1 LEADER]: Signalling peer 40837fdefb66404b93c3e3876da432f7 to start an election
I20260709 13:14:21.457270  1403 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6d5b91e9a24a45ae90e730ae96c73317"
dest_uuid: "40837fdefb66404b93c3e3876da432f7"
 from {username='slave'} at 127.0.0.1:42004
I20260709 13:14:21.458966  1403 raft_consensus.cc:493] T 6d5b91e9a24a45ae90e730ae96c73317 P 40837fdefb66404b93c3e3876da432f7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:21.459386  1403 raft_consensus.cc:3060] T 6d5b91e9a24a45ae90e730ae96c73317 P 40837fdefb66404b93c3e3876da432f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:21.462697  1453 consensus_queue.cc:1048] T 8b27a5294d34450aaff6336d315361c6 P 0bf9692a81414cfab64ee45b5393d57e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:21.446215  1155 catalog_manager.cc:5697] T 275bc525ace541a89e9b89c5bdda27db P e4f6eab2337842428ba2670421465839 reported cstate change: term changed from 1 to 2, leader changed from 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66) to e4f6eab2337842428ba2670421465839 (127.23.140.65). New cstate: current_term: 2 leader_uuid: "e4f6eab2337842428ba2670421465839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:21.464593  1493 consensus_queue.cc:1048] T 05040be4aa904a3bb6bad07412e196eb P 40837fdefb66404b93c3e3876da432f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:21.470327  1479 consensus_queue.cc:1048] T f2cb95dd66b44bb7ad3bdb0f8970a24e P e4f6eab2337842428ba2670421465839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:21.478561  1331 raft_consensus.cc:515] T b20386846aee4ca5b9458883519bf06d P 0bf9692a81414cfab64ee45b5393d57e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:21.481436  1453 raft_consensus.cc:993] T 8b27a5294d34450aaff6336d315361c6 P 0bf9692a81414cfab64ee45b5393d57e: : Instructing follower e4f6eab2337842428ba2670421465839 to start an election
I20260709 13:14:21.481977  1453 raft_consensus.cc:1081] T 8b27a5294d34450aaff6336d315361c6 P 0bf9692a81414cfab64ee45b5393d57e [term 1 LEADER]: Signalling peer e4f6eab2337842428ba2670421465839 to start an election
I20260709 13:14:21.484014  1256 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b27a5294d34450aaff6336d315361c6"
dest_uuid: "e4f6eab2337842428ba2670421465839"
 from {username='slave'} at 127.0.0.1:46648
I20260709 13:14:21.483863  1403 raft_consensus.cc:515] T 6d5b91e9a24a45ae90e730ae96c73317 P 40837fdefb66404b93c3e3876da432f7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:21.484609  1256 raft_consensus.cc:493] T 8b27a5294d34450aaff6336d315361c6 P e4f6eab2337842428ba2670421465839 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:21.485023  1256 raft_consensus.cc:3060] T 8b27a5294d34450aaff6336d315361c6 P e4f6eab2337842428ba2670421465839 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:21.490105  1493 consensus_queue.cc:1048] T 05040be4aa904a3bb6bad07412e196eb P 40837fdefb66404b93c3e3876da432f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:21.494292  1494 raft_consensus.cc:993] T f2cb95dd66b44bb7ad3bdb0f8970a24e P e4f6eab2337842428ba2670421465839: : Instructing follower 0bf9692a81414cfab64ee45b5393d57e to start an election
I20260709 13:14:21.494743  1459 raft_consensus.cc:1081] T f2cb95dd66b44bb7ad3bdb0f8970a24e P e4f6eab2337842428ba2670421465839 [term 1 LEADER]: Signalling peer 0bf9692a81414cfab64ee45b5393d57e to start an election
I20260709 13:14:21.496713  1333 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f2cb95dd66b44bb7ad3bdb0f8970a24e"
dest_uuid: "0bf9692a81414cfab64ee45b5393d57e"
 from {username='slave'} at 127.0.0.1:51514
I20260709 13:14:21.497287  1333 raft_consensus.cc:493] T f2cb95dd66b44bb7ad3bdb0f8970a24e P 0bf9692a81414cfab64ee45b5393d57e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:21.497661  1333 raft_consensus.cc:3060] T f2cb95dd66b44bb7ad3bdb0f8970a24e P 0bf9692a81414cfab64ee45b5393d57e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:21.498855  1403 leader_election.cc:290] T 6d5b91e9a24a45ae90e730ae96c73317 P 40837fdefb66404b93c3e3876da432f7 [CANDIDATE]: Term 2 election: Requested vote from peers e4f6eab2337842428ba2670421465839 (127.23.140.65:45009), 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66:38395)
I20260709 13:14:21.498886  1258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5b91e9a24a45ae90e730ae96c73317" candidate_uuid: "40837fdefb66404b93c3e3876da432f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4f6eab2337842428ba2670421465839"
I20260709 13:14:21.500402  1258 raft_consensus.cc:3060] T 6d5b91e9a24a45ae90e730ae96c73317 P e4f6eab2337842428ba2670421465839 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:21.502218  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5b91e9a24a45ae90e730ae96c73317" candidate_uuid: "40837fdefb66404b93c3e3876da432f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0bf9692a81414cfab64ee45b5393d57e"
I20260709 13:14:21.502892  1330 raft_consensus.cc:3055] T 6d5b91e9a24a45ae90e730ae96c73317 P 0bf9692a81414cfab64ee45b5393d57e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:21.503268  1330 raft_consensus.cc:740] T 6d5b91e9a24a45ae90e730ae96c73317 P 0bf9692a81414cfab64ee45b5393d57e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0bf9692a81414cfab64ee45b5393d57e, State: Running, Role: LEADER
I20260709 13:14:21.504346  1330 consensus_queue.cc:260] T 6d5b91e9a24a45ae90e730ae96c73317 P 0bf9692a81414cfab64ee45b5393d57e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:21.506421  1333 raft_consensus.cc:515] T f2cb95dd66b44bb7ad3bdb0f8970a24e P 0bf9692a81414cfab64ee45b5393d57e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:21.511020  1256 raft_consensus.cc:515] T 8b27a5294d34450aaff6336d315361c6 P e4f6eab2337842428ba2670421465839 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:21.514123  1256 leader_election.cc:290] T 8b27a5294d34450aaff6336d315361c6 P e4f6eab2337842428ba2670421465839 [CANDIDATE]: Term 2 election: Requested vote from peers 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66:38395), 40837fdefb66404b93c3e3876da432f7 (127.23.140.67:43689)
I20260709 13:14:21.514762  1332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b27a5294d34450aaff6336d315361c6" candidate_uuid: "e4f6eab2337842428ba2670421465839" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0bf9692a81414cfab64ee45b5393d57e"
I20260709 13:14:21.515373  1332 raft_consensus.cc:3055] T 8b27a5294d34450aaff6336d315361c6 P 0bf9692a81414cfab64ee45b5393d57e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:21.515672  1332 raft_consensus.cc:740] T 8b27a5294d34450aaff6336d315361c6 P 0bf9692a81414cfab64ee45b5393d57e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0bf9692a81414cfab64ee45b5393d57e, State: Running, Role: LEADER
I20260709 13:14:21.516562  1332 consensus_queue.cc:260] T 8b27a5294d34450aaff6336d315361c6 P 0bf9692a81414cfab64ee45b5393d57e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:21.517665  1258 raft_consensus.cc:2468] T 6d5b91e9a24a45ae90e730ae96c73317 P e4f6eab2337842428ba2670421465839 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40837fdefb66404b93c3e3876da432f7 in term 2.
I20260709 13:14:21.518033  1332 raft_consensus.cc:3060] T 8b27a5294d34450aaff6336d315361c6 P 0bf9692a81414cfab64ee45b5393d57e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:21.518227  1490 raft_consensus.cc:993] T 05040be4aa904a3bb6bad07412e196eb P 40837fdefb66404b93c3e3876da432f7: : Instructing follower 0bf9692a81414cfab64ee45b5393d57e to start an election
I20260709 13:14:21.518771  1490 raft_consensus.cc:1081] T 05040be4aa904a3bb6bad07412e196eb P 40837fdefb66404b93c3e3876da432f7 [term 1 LEADER]: Signalling peer 0bf9692a81414cfab64ee45b5393d57e to start an election
I20260709 13:14:21.519169  1371 leader_election.cc:304] T 6d5b91e9a24a45ae90e730ae96c73317 P 40837fdefb66404b93c3e3876da432f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40837fdefb66404b93c3e3876da432f7, e4f6eab2337842428ba2670421465839; no voters: 
I20260709 13:14:21.520102  1493 raft_consensus.cc:2804] T 6d5b91e9a24a45ae90e730ae96c73317 P 40837fdefb66404b93c3e3876da432f7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:21.520251  1403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b27a5294d34450aaff6336d315361c6" candidate_uuid: "e4f6eab2337842428ba2670421465839" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40837fdefb66404b93c3e3876da432f7"
I20260709 13:14:21.520601  1493 raft_consensus.cc:697] T 6d5b91e9a24a45ae90e730ae96c73317 P 40837fdefb66404b93c3e3876da432f7 [term 2 LEADER]: Becoming Leader. State: Replica: 40837fdefb66404b93c3e3876da432f7, State: Running, Role: LEADER
I20260709 13:14:21.520903  1403 raft_consensus.cc:3060] T 8b27a5294d34450aaff6336d315361c6 P 40837fdefb66404b93c3e3876da432f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:21.521482  1493 consensus_queue.cc:237] T 6d5b91e9a24a45ae90e730ae96c73317 P 40837fdefb66404b93c3e3876da432f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:21.525731  1329 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "05040be4aa904a3bb6bad07412e196eb"
dest_uuid: "0bf9692a81414cfab64ee45b5393d57e"
 from {username='slave'} at 127.0.0.1:51510
I20260709 13:14:21.525918  1332 raft_consensus.cc:2468] T 8b27a5294d34450aaff6336d315361c6 P 0bf9692a81414cfab64ee45b5393d57e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4f6eab2337842428ba2670421465839 in term 2.
I20260709 13:14:21.526458  1329 raft_consensus.cc:493] T 05040be4aa904a3bb6bad07412e196eb P 0bf9692a81414cfab64ee45b5393d57e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:21.526847  1329 raft_consensus.cc:3060] T 05040be4aa904a3bb6bad07412e196eb P 0bf9692a81414cfab64ee45b5393d57e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:21.527172  1221 leader_election.cc:304] T 8b27a5294d34450aaff6336d315361c6 P e4f6eab2337842428ba2670421465839 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bf9692a81414cfab64ee45b5393d57e, e4f6eab2337842428ba2670421465839; no voters: 
I20260709 13:14:21.529166  1330 raft_consensus.cc:3060] T 6d5b91e9a24a45ae90e730ae96c73317 P 0bf9692a81414cfab64ee45b5393d57e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:21.529953  1494 raft_consensus.cc:2804] T 8b27a5294d34450aaff6336d315361c6 P e4f6eab2337842428ba2670421465839 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:21.532773  1494 raft_consensus.cc:697] T 8b27a5294d34450aaff6336d315361c6 P e4f6eab2337842428ba2670421465839 [term 2 LEADER]: Becoming Leader. State: Replica: e4f6eab2337842428ba2670421465839, State: Running, Role: LEADER
I20260709 13:14:21.533622  1494 consensus_queue.cc:237] T 8b27a5294d34450aaff6336d315361c6 P e4f6eab2337842428ba2670421465839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:21.530038  1403 raft_consensus.cc:2468] T 8b27a5294d34450aaff6336d315361c6 P 40837fdefb66404b93c3e3876da432f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4f6eab2337842428ba2670421465839 in term 2.
I20260709 13:14:21.536691  1329 raft_consensus.cc:515] T 05040be4aa904a3bb6bad07412e196eb P 0bf9692a81414cfab64ee45b5393d57e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:21.552902  1333 leader_election.cc:290] T f2cb95dd66b44bb7ad3bdb0f8970a24e P 0bf9692a81414cfab64ee45b5393d57e [CANDIDATE]: Term 2 election: Requested vote from peers e4f6eab2337842428ba2670421465839 (127.23.140.65:45009), 40837fdefb66404b93c3e3876da432f7 (127.23.140.67:43689)
I20260709 13:14:21.555418  1256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b20386846aee4ca5b9458883519bf06d" candidate_uuid: "0bf9692a81414cfab64ee45b5393d57e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4f6eab2337842428ba2670421465839"
I20260709 13:14:21.556350  1256 raft_consensus.cc:3055] T b20386846aee4ca5b9458883519bf06d P e4f6eab2337842428ba2670421465839 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:21.556792  1256 raft_consensus.cc:740] T b20386846aee4ca5b9458883519bf06d P e4f6eab2337842428ba2670421465839 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4f6eab2337842428ba2670421465839, State: Running, Role: LEADER
I20260709 13:14:21.558213  1258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2cb95dd66b44bb7ad3bdb0f8970a24e" candidate_uuid: "0bf9692a81414cfab64ee45b5393d57e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4f6eab2337842428ba2670421465839"
I20260709 13:14:21.552093  1155 catalog_manager.cc:5697] T 8b27a5294d34450aaff6336d315361c6 P e4f6eab2337842428ba2670421465839 reported cstate change: term changed from 1 to 2, leader changed from 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66) to e4f6eab2337842428ba2670421465839 (127.23.140.65). New cstate: current_term: 2 leader_uuid: "e4f6eab2337842428ba2670421465839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:21.559096  1258 raft_consensus.cc:3055] T f2cb95dd66b44bb7ad3bdb0f8970a24e P e4f6eab2337842428ba2670421465839 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:21.559594  1258 raft_consensus.cc:740] T f2cb95dd66b44bb7ad3bdb0f8970a24e P e4f6eab2337842428ba2670421465839 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4f6eab2337842428ba2670421465839, State: Running, Role: LEADER
I20260709 13:14:21.560717  1258 consensus_queue.cc:260] T f2cb95dd66b44bb7ad3bdb0f8970a24e P e4f6eab2337842428ba2670421465839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:21.562279  1257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05040be4aa904a3bb6bad07412e196eb" candidate_uuid: "0bf9692a81414cfab64ee45b5393d57e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4f6eab2337842428ba2670421465839"
I20260709 13:14:21.566422  1330 raft_consensus.cc:2468] T 6d5b91e9a24a45ae90e730ae96c73317 P 0bf9692a81414cfab64ee45b5393d57e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40837fdefb66404b93c3e3876da432f7 in term 2.
I20260709 13:14:21.566632  1257 raft_consensus.cc:3060] T 05040be4aa904a3bb6bad07412e196eb P e4f6eab2337842428ba2670421465839 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:21.569154  1258 raft_consensus.cc:3060] T f2cb95dd66b44bb7ad3bdb0f8970a24e P e4f6eab2337842428ba2670421465839 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:21.574926  1257 raft_consensus.cc:2468] T 05040be4aa904a3bb6bad07412e196eb P e4f6eab2337842428ba2670421465839 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bf9692a81414cfab64ee45b5393d57e in term 2.
I20260709 13:14:21.562844  1329 leader_election.cc:290] T 05040be4aa904a3bb6bad07412e196eb P 0bf9692a81414cfab64ee45b5393d57e [CANDIDATE]: Term 2 election: Requested vote from peers e4f6eab2337842428ba2670421465839 (127.23.140.65:45009), 40837fdefb66404b93c3e3876da432f7 (127.23.140.67:43689)
I20260709 13:14:21.563908  1403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2cb95dd66b44bb7ad3bdb0f8970a24e" candidate_uuid: "0bf9692a81414cfab64ee45b5393d57e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40837fdefb66404b93c3e3876da432f7"
I20260709 13:14:21.576311  1297 leader_election.cc:304] T 05040be4aa904a3bb6bad07412e196eb P 0bf9692a81414cfab64ee45b5393d57e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bf9692a81414cfab64ee45b5393d57e, e4f6eab2337842428ba2670421465839; no voters: 
I20260709 13:14:21.576865  1403 raft_consensus.cc:3060] T f2cb95dd66b44bb7ad3bdb0f8970a24e P 40837fdefb66404b93c3e3876da432f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:21.577239  1452 raft_consensus.cc:2804] T 05040be4aa904a3bb6bad07412e196eb P 0bf9692a81414cfab64ee45b5393d57e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:21.577386  1331 leader_election.cc:290] T b20386846aee4ca5b9458883519bf06d P 0bf9692a81414cfab64ee45b5393d57e [CANDIDATE]: Term 2 election: Requested vote from peers e4f6eab2337842428ba2670421465839 (127.23.140.65:45009), 40837fdefb66404b93c3e3876da432f7 (127.23.140.67:43689)
I20260709 13:14:21.577908  1452 raft_consensus.cc:697] T 05040be4aa904a3bb6bad07412e196eb P 0bf9692a81414cfab64ee45b5393d57e [term 2 LEADER]: Becoming Leader. State: Replica: 0bf9692a81414cfab64ee45b5393d57e, State: Running, Role: LEADER
I20260709 13:14:21.565448  1256 consensus_queue.cc:260] T b20386846aee4ca5b9458883519bf06d P e4f6eab2337842428ba2670421465839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:21.578760  1452 consensus_queue.cc:237] T 05040be4aa904a3bb6bad07412e196eb P 0bf9692a81414cfab64ee45b5393d57e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:21.579275  1256 raft_consensus.cc:3060] T b20386846aee4ca5b9458883519bf06d P e4f6eab2337842428ba2670421465839 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:21.582120  1406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b20386846aee4ca5b9458883519bf06d" candidate_uuid: "0bf9692a81414cfab64ee45b5393d57e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40837fdefb66404b93c3e3876da432f7"
I20260709 13:14:21.582758  1406 raft_consensus.cc:3060] T b20386846aee4ca5b9458883519bf06d P 40837fdefb66404b93c3e3876da432f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:21.586481  1256 raft_consensus.cc:2468] T b20386846aee4ca5b9458883519bf06d P e4f6eab2337842428ba2670421465839 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bf9692a81414cfab64ee45b5393d57e in term 2.
I20260709 13:14:21.564374  1407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05040be4aa904a3bb6bad07412e196eb" candidate_uuid: "0bf9692a81414cfab64ee45b5393d57e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40837fdefb66404b93c3e3876da432f7"
I20260709 13:14:21.588054  1407 raft_consensus.cc:3055] T 05040be4aa904a3bb6bad07412e196eb P 40837fdefb66404b93c3e3876da432f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:21.588400  1407 raft_consensus.cc:740] T 05040be4aa904a3bb6bad07412e196eb P 40837fdefb66404b93c3e3876da432f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 40837fdefb66404b93c3e3876da432f7, State: Running, Role: LEADER
I20260709 13:14:21.588780  1297 leader_election.cc:304] T b20386846aee4ca5b9458883519bf06d P 0bf9692a81414cfab64ee45b5393d57e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bf9692a81414cfab64ee45b5393d57e, e4f6eab2337842428ba2670421465839; no voters: 
I20260709 13:14:21.589227  1453 raft_consensus.cc:993] T 7dff7291733e401c805ffe3d5829f7f5 P 0bf9692a81414cfab64ee45b5393d57e: : Instructing follower e4f6eab2337842428ba2670421465839 to start an election
I20260709 13:14:21.589232  1407 consensus_queue.cc:260] T 05040be4aa904a3bb6bad07412e196eb P 40837fdefb66404b93c3e3876da432f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:21.587352  1258 raft_consensus.cc:2468] T f2cb95dd66b44bb7ad3bdb0f8970a24e P e4f6eab2337842428ba2670421465839 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bf9692a81414cfab64ee45b5393d57e in term 2.
I20260709 13:14:21.590184  1453 raft_consensus.cc:2804] T b20386846aee4ca5b9458883519bf06d P 0bf9692a81414cfab64ee45b5393d57e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:21.590634  1407 raft_consensus.cc:3060] T 05040be4aa904a3bb6bad07412e196eb P 40837fdefb66404b93c3e3876da432f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:21.590801  1475 raft_consensus.cc:1081] T 7dff7291733e401c805ffe3d5829f7f5 P 0bf9692a81414cfab64ee45b5393d57e [term 1 LEADER]: Signalling peer e4f6eab2337842428ba2670421465839 to start an election
I20260709 13:14:21.591013  1403 raft_consensus.cc:2468] T f2cb95dd66b44bb7ad3bdb0f8970a24e P 40837fdefb66404b93c3e3876da432f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bf9692a81414cfab64ee45b5393d57e in term 2.
I20260709 13:14:21.592312  1299 leader_election.cc:304] T f2cb95dd66b44bb7ad3bdb0f8970a24e P 0bf9692a81414cfab64ee45b5393d57e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bf9692a81414cfab64ee45b5393d57e, 40837fdefb66404b93c3e3876da432f7; no voters: 
I20260709 13:14:21.591936  1155 catalog_manager.cc:5697] T 05040be4aa904a3bb6bad07412e196eb P 0bf9692a81414cfab64ee45b5393d57e reported cstate change: term changed from 1 to 2, leader changed from 40837fdefb66404b93c3e3876da432f7 (127.23.140.67) to 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66). New cstate: current_term: 2 leader_uuid: "0bf9692a81414cfab64ee45b5393d57e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:21.574729  1153 catalog_manager.cc:5697] T 6d5b91e9a24a45ae90e730ae96c73317 P 40837fdefb66404b93c3e3876da432f7 reported cstate change: term changed from 1 to 2, leader changed from 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66) to 40837fdefb66404b93c3e3876da432f7 (127.23.140.67). New cstate: current_term: 2 leader_uuid: "40837fdefb66404b93c3e3876da432f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:21.593494  1480 raft_consensus.cc:2804] T f2cb95dd66b44bb7ad3bdb0f8970a24e P 0bf9692a81414cfab64ee45b5393d57e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:21.594033  1480 raft_consensus.cc:697] T f2cb95dd66b44bb7ad3bdb0f8970a24e P 0bf9692a81414cfab64ee45b5393d57e [term 2 LEADER]: Becoming Leader. State: Replica: 0bf9692a81414cfab64ee45b5393d57e, State: Running, Role: LEADER
I20260709 13:14:21.594892  1480 consensus_queue.cc:237] T f2cb95dd66b44bb7ad3bdb0f8970a24e P 0bf9692a81414cfab64ee45b5393d57e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:21.597003  1406 raft_consensus.cc:2468] T b20386846aee4ca5b9458883519bf06d P 40837fdefb66404b93c3e3876da432f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bf9692a81414cfab64ee45b5393d57e in term 2.
I20260709 13:14:21.590688  1453 raft_consensus.cc:697] T b20386846aee4ca5b9458883519bf06d P 0bf9692a81414cfab64ee45b5393d57e [term 2 LEADER]: Becoming Leader. State: Replica: 0bf9692a81414cfab64ee45b5393d57e, State: Running, Role: LEADER
I20260709 13:14:21.601136  1407 raft_consensus.cc:2468] T 05040be4aa904a3bb6bad07412e196eb P 40837fdefb66404b93c3e3876da432f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bf9692a81414cfab64ee45b5393d57e in term 2.
I20260709 13:14:21.601336  1453 consensus_queue.cc:237] T b20386846aee4ca5b9458883519bf06d P 0bf9692a81414cfab64ee45b5393d57e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:21.605633  1258 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7dff7291733e401c805ffe3d5829f7f5"
dest_uuid: "e4f6eab2337842428ba2670421465839"
 from {username='slave'} at 127.0.0.1:46648
I20260709 13:14:21.606328  1258 raft_consensus.cc:493] T 7dff7291733e401c805ffe3d5829f7f5 P e4f6eab2337842428ba2670421465839 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:21.606659  1258 raft_consensus.cc:3060] T 7dff7291733e401c805ffe3d5829f7f5 P e4f6eab2337842428ba2670421465839 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:21.610806  1153 catalog_manager.cc:5697] T b20386846aee4ca5b9458883519bf06d P 0bf9692a81414cfab64ee45b5393d57e reported cstate change: term changed from 1 to 2, leader changed from e4f6eab2337842428ba2670421465839 (127.23.140.65) to 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66). New cstate: current_term: 2 leader_uuid: "0bf9692a81414cfab64ee45b5393d57e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:21.612743  1153 catalog_manager.cc:5697] T f2cb95dd66b44bb7ad3bdb0f8970a24e P 0bf9692a81414cfab64ee45b5393d57e reported cstate change: term changed from 1 to 2, leader changed from e4f6eab2337842428ba2670421465839 (127.23.140.65) to 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66). New cstate: current_term: 2 leader_uuid: "0bf9692a81414cfab64ee45b5393d57e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:21.614367  1258 raft_consensus.cc:515] T 7dff7291733e401c805ffe3d5829f7f5 P e4f6eab2337842428ba2670421465839 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:21.616580  1258 leader_election.cc:290] T 7dff7291733e401c805ffe3d5829f7f5 P e4f6eab2337842428ba2670421465839 [CANDIDATE]: Term 2 election: Requested vote from peers 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66:38395), 40837fdefb66404b93c3e3876da432f7 (127.23.140.67:43689)
I20260709 13:14:21.617405  1329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dff7291733e401c805ffe3d5829f7f5" candidate_uuid: "e4f6eab2337842428ba2670421465839" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0bf9692a81414cfab64ee45b5393d57e"
I20260709 13:14:21.617813  1407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dff7291733e401c805ffe3d5829f7f5" candidate_uuid: "e4f6eab2337842428ba2670421465839" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40837fdefb66404b93c3e3876da432f7"
I20260709 13:14:21.618083  1329 raft_consensus.cc:3055] T 7dff7291733e401c805ffe3d5829f7f5 P 0bf9692a81414cfab64ee45b5393d57e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:21.618443  1407 raft_consensus.cc:3060] T 7dff7291733e401c805ffe3d5829f7f5 P 40837fdefb66404b93c3e3876da432f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:21.618445  1329 raft_consensus.cc:740] T 7dff7291733e401c805ffe3d5829f7f5 P 0bf9692a81414cfab64ee45b5393d57e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0bf9692a81414cfab64ee45b5393d57e, State: Running, Role: LEADER
I20260709 13:14:21.619516  1329 consensus_queue.cc:260] T 7dff7291733e401c805ffe3d5829f7f5 P 0bf9692a81414cfab64ee45b5393d57e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:21.620839  1329 raft_consensus.cc:3060] T 7dff7291733e401c805ffe3d5829f7f5 P 0bf9692a81414cfab64ee45b5393d57e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:21.625187  1407 raft_consensus.cc:2468] T 7dff7291733e401c805ffe3d5829f7f5 P 40837fdefb66404b93c3e3876da432f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4f6eab2337842428ba2670421465839 in term 2.
I20260709 13:14:21.626508  1224 leader_election.cc:304] T 7dff7291733e401c805ffe3d5829f7f5 P e4f6eab2337842428ba2670421465839 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40837fdefb66404b93c3e3876da432f7, e4f6eab2337842428ba2670421465839; no voters: 
I20260709 13:14:21.626565  1329 raft_consensus.cc:2468] T 7dff7291733e401c805ffe3d5829f7f5 P 0bf9692a81414cfab64ee45b5393d57e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4f6eab2337842428ba2670421465839 in term 2.
I20260709 13:14:21.627326  1494 raft_consensus.cc:2804] T 7dff7291733e401c805ffe3d5829f7f5 P e4f6eab2337842428ba2670421465839 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:21.627756  1494 raft_consensus.cc:697] T 7dff7291733e401c805ffe3d5829f7f5 P e4f6eab2337842428ba2670421465839 [term 2 LEADER]: Becoming Leader. State: Replica: e4f6eab2337842428ba2670421465839, State: Running, Role: LEADER
I20260709 13:14:21.628556  1494 consensus_queue.cc:237] T 7dff7291733e401c805ffe3d5829f7f5 P e4f6eab2337842428ba2670421465839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:21.635037  1153 catalog_manager.cc:5697] T 7dff7291733e401c805ffe3d5829f7f5 P e4f6eab2337842428ba2670421465839 reported cstate change: term changed from 1 to 2, leader changed from 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66) to e4f6eab2337842428ba2670421465839 (127.23.140.65). New cstate: current_term: 2 leader_uuid: "e4f6eab2337842428ba2670421465839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:21.716401  1484 raft_consensus.cc:993] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 40837fdefb66404b93c3e3876da432f7: : Instructing follower e4f6eab2337842428ba2670421465839 to start an election
I20260709 13:14:21.716902  1490 raft_consensus.cc:1081] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 40837fdefb66404b93c3e3876da432f7 [term 1 LEADER]: Signalling peer e4f6eab2337842428ba2670421465839 to start an election
I20260709 13:14:21.718400  1258 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6c40fe2ece564243aa8dc5b1fae8ecd8"
dest_uuid: "e4f6eab2337842428ba2670421465839"
 from {username='slave'} at 127.0.0.1:46664
I20260709 13:14:21.718988  1258 raft_consensus.cc:493] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P e4f6eab2337842428ba2670421465839 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:21.719376  1258 raft_consensus.cc:3060] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P e4f6eab2337842428ba2670421465839 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:21.724439  1258 raft_consensus.cc:515] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P e4f6eab2337842428ba2670421465839 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:21.726104  1258 leader_election.cc:290] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P e4f6eab2337842428ba2670421465839 [CANDIDATE]: Term 2 election: Requested vote from peers 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66:38395), 40837fdefb66404b93c3e3876da432f7 (127.23.140.67:43689)
I20260709 13:14:21.726841  1329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40fe2ece564243aa8dc5b1fae8ecd8" candidate_uuid: "e4f6eab2337842428ba2670421465839" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0bf9692a81414cfab64ee45b5393d57e"
I20260709 13:14:21.727149  1407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40fe2ece564243aa8dc5b1fae8ecd8" candidate_uuid: "e4f6eab2337842428ba2670421465839" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40837fdefb66404b93c3e3876da432f7"
I20260709 13:14:21.727501  1329 raft_consensus.cc:3060] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 0bf9692a81414cfab64ee45b5393d57e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:21.727784  1407 raft_consensus.cc:3055] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 40837fdefb66404b93c3e3876da432f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:21.728097  1407 raft_consensus.cc:740] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 40837fdefb66404b93c3e3876da432f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 40837fdefb66404b93c3e3876da432f7, State: Running, Role: LEADER
I20260709 13:14:21.728811  1407 consensus_queue.cc:260] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 40837fdefb66404b93c3e3876da432f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:21.729724  1407 raft_consensus.cc:3060] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 40837fdefb66404b93c3e3876da432f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:21.732456  1329 raft_consensus.cc:2468] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 0bf9692a81414cfab64ee45b5393d57e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4f6eab2337842428ba2670421465839 in term 2.
I20260709 13:14:21.733590  1221 leader_election.cc:304] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P e4f6eab2337842428ba2670421465839 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bf9692a81414cfab64ee45b5393d57e, e4f6eab2337842428ba2670421465839; no voters: 
I20260709 13:14:21.734318  1494 raft_consensus.cc:2804] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P e4f6eab2337842428ba2670421465839 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:21.734567  1407 raft_consensus.cc:2468] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 40837fdefb66404b93c3e3876da432f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4f6eab2337842428ba2670421465839 in term 2.
I20260709 13:14:21.734706  1494 raft_consensus.cc:697] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P e4f6eab2337842428ba2670421465839 [term 2 LEADER]: Becoming Leader. State: Replica: e4f6eab2337842428ba2670421465839, State: Running, Role: LEADER
I20260709 13:14:21.735663  1494 consensus_queue.cc:237] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P e4f6eab2337842428ba2670421465839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:21.741608  1153 catalog_manager.cc:5697] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P e4f6eab2337842428ba2670421465839 reported cstate change: term changed from 1 to 2, leader changed from 40837fdefb66404b93c3e3876da432f7 (127.23.140.67) to e4f6eab2337842428ba2670421465839 (127.23.140.65). New cstate: current_term: 2 leader_uuid: "e4f6eab2337842428ba2670421465839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:21.808588  1258 raft_consensus.cc:1275] T 82a1d9ee89c045d6ac3220d347e06972 P e4f6eab2337842428ba2670421465839 [term 2 FOLLOWER]: Refusing update from remote peer 0bf9692a81414cfab64ee45b5393d57e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:21.809926  1452 consensus_queue.cc:1048] T 82a1d9ee89c045d6ac3220d347e06972 P 0bf9692a81414cfab64ee45b5393d57e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:21.818048  1407 raft_consensus.cc:1275] T 82a1d9ee89c045d6ac3220d347e06972 P 40837fdefb66404b93c3e3876da432f7 [term 2 FOLLOWER]: Refusing update from remote peer 0bf9692a81414cfab64ee45b5393d57e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:21.819729  1480 consensus_queue.cc:1048] T 82a1d9ee89c045d6ac3220d347e06972 P 0bf9692a81414cfab64ee45b5393d57e [LEADER]: Connected to new peer: Peer: permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:21.890728  1329 raft_consensus.cc:1275] T 275bc525ace541a89e9b89c5bdda27db P 0bf9692a81414cfab64ee45b5393d57e [term 2 FOLLOWER]: Refusing update from remote peer e4f6eab2337842428ba2670421465839: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:21.892056  1494 consensus_queue.cc:1048] T 275bc525ace541a89e9b89c5bdda27db P e4f6eab2337842428ba2670421465839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:21.899935  1407 raft_consensus.cc:1275] T 275bc525ace541a89e9b89c5bdda27db P 40837fdefb66404b93c3e3876da432f7 [term 2 FOLLOWER]: Refusing update from remote peer e4f6eab2337842428ba2670421465839: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:21.901659  1494 consensus_queue.cc:1048] T 275bc525ace541a89e9b89c5bdda27db P e4f6eab2337842428ba2670421465839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:21.928208  1329 raft_consensus.cc:1275] T 8b27a5294d34450aaff6336d315361c6 P 0bf9692a81414cfab64ee45b5393d57e [term 2 FOLLOWER]: Refusing update from remote peer e4f6eab2337842428ba2670421465839: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:21.929554  1494 consensus_queue.cc:1048] T 8b27a5294d34450aaff6336d315361c6 P e4f6eab2337842428ba2670421465839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:21.937701  1407 raft_consensus.cc:1275] T 8b27a5294d34450aaff6336d315361c6 P 40837fdefb66404b93c3e3876da432f7 [term 2 FOLLOWER]: Refusing update from remote peer e4f6eab2337842428ba2670421465839: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:21.940964  1459 consensus_queue.cc:1048] T 8b27a5294d34450aaff6336d315361c6 P e4f6eab2337842428ba2670421465839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:21.967180  1407 raft_consensus.cc:1275] T 05040be4aa904a3bb6bad07412e196eb P 40837fdefb66404b93c3e3876da432f7 [term 2 FOLLOWER]: Refusing update from remote peer 0bf9692a81414cfab64ee45b5393d57e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:21.968497  1480 consensus_queue.cc:1048] T 05040be4aa904a3bb6bad07412e196eb P 0bf9692a81414cfab64ee45b5393d57e [LEADER]: Connected to new peer: Peer: permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:21.976578  1258 raft_consensus.cc:1275] T 05040be4aa904a3bb6bad07412e196eb P e4f6eab2337842428ba2670421465839 [term 2 FOLLOWER]: Refusing update from remote peer 0bf9692a81414cfab64ee45b5393d57e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:21.978194  1480 consensus_queue.cc:1048] T 05040be4aa904a3bb6bad07412e196eb P 0bf9692a81414cfab64ee45b5393d57e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:22.042564  1258 raft_consensus.cc:1275] T 6d5b91e9a24a45ae90e730ae96c73317 P e4f6eab2337842428ba2670421465839 [term 2 FOLLOWER]: Refusing update from remote peer 40837fdefb66404b93c3e3876da432f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:22.044123  1490 consensus_queue.cc:1048] T 6d5b91e9a24a45ae90e730ae96c73317 P 40837fdefb66404b93c3e3876da432f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:22.050206  1407 raft_consensus.cc:1275] T f2cb95dd66b44bb7ad3bdb0f8970a24e P 40837fdefb66404b93c3e3876da432f7 [term 2 FOLLOWER]: Refusing update from remote peer 0bf9692a81414cfab64ee45b5393d57e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:22.052390  1329 raft_consensus.cc:1275] T 6d5b91e9a24a45ae90e730ae96c73317 P 0bf9692a81414cfab64ee45b5393d57e [term 2 FOLLOWER]: Refusing update from remote peer 40837fdefb66404b93c3e3876da432f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:22.054023  1484 consensus_queue.cc:1048] T 6d5b91e9a24a45ae90e730ae96c73317 P 40837fdefb66404b93c3e3876da432f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:22.054812  1453 consensus_queue.cc:1048] T f2cb95dd66b44bb7ad3bdb0f8970a24e P 0bf9692a81414cfab64ee45b5393d57e [LEADER]: Connected to new peer: Peer: permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:22.065356  1258 raft_consensus.cc:1275] T f2cb95dd66b44bb7ad3bdb0f8970a24e P e4f6eab2337842428ba2670421465839 [term 2 FOLLOWER]: Refusing update from remote peer 0bf9692a81414cfab64ee45b5393d57e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:22.066895  1475 consensus_queue.cc:1048] T f2cb95dd66b44bb7ad3bdb0f8970a24e P 0bf9692a81414cfab64ee45b5393d57e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:22.084187  1407 raft_consensus.cc:1275] T b20386846aee4ca5b9458883519bf06d P 40837fdefb66404b93c3e3876da432f7 [term 2 FOLLOWER]: Refusing update from remote peer 0bf9692a81414cfab64ee45b5393d57e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:22.085687  1475 consensus_queue.cc:1048] T b20386846aee4ca5b9458883519bf06d P 0bf9692a81414cfab64ee45b5393d57e [LEADER]: Connected to new peer: Peer: permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:22.093957  1258 raft_consensus.cc:1275] T b20386846aee4ca5b9458883519bf06d P e4f6eab2337842428ba2670421465839 [term 2 FOLLOWER]: Refusing update from remote peer 0bf9692a81414cfab64ee45b5393d57e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:22.095393  1475 consensus_queue.cc:1048] T b20386846aee4ca5b9458883519bf06d P 0bf9692a81414cfab64ee45b5393d57e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:22.211992  1329 raft_consensus.cc:1275] T 7dff7291733e401c805ffe3d5829f7f5 P 0bf9692a81414cfab64ee45b5393d57e [term 2 FOLLOWER]: Refusing update from remote peer e4f6eab2337842428ba2670421465839: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:22.213232  1459 consensus_queue.cc:1048] T 7dff7291733e401c805ffe3d5829f7f5 P e4f6eab2337842428ba2670421465839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:22.221793  1407 raft_consensus.cc:1275] T 7dff7291733e401c805ffe3d5829f7f5 P 40837fdefb66404b93c3e3876da432f7 [term 2 FOLLOWER]: Refusing update from remote peer e4f6eab2337842428ba2670421465839: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:22.223119  1459 consensus_queue.cc:1048] T 7dff7291733e401c805ffe3d5829f7f5 P e4f6eab2337842428ba2670421465839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:22.250674  1407 raft_consensus.cc:1275] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 40837fdefb66404b93c3e3876da432f7 [term 2 FOLLOWER]: Refusing update from remote peer e4f6eab2337842428ba2670421465839: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:22.251945  1459 consensus_queue.cc:1048] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P e4f6eab2337842428ba2670421465839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:22.260461  1329 raft_consensus.cc:1275] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 0bf9692a81414cfab64ee45b5393d57e [term 2 FOLLOWER]: Refusing update from remote peer e4f6eab2337842428ba2670421465839: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:22.262131  1479 consensus_queue.cc:1048] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P e4f6eab2337842428ba2670421465839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:24.256966  1153 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48260:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:14:24.259095  1153 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:14:24.305658  1246 tablet_service.cc:1511] Processing CreateTablet for tablet fc60f59313bc4507bdf418cf4654ee3b (DEFAULT_TABLE table=soft_deleted_table [id=11b3bc1519bb4e9eb0f6fe4798b92314]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:14:24.306931  1321 tablet_service.cc:1511] Processing CreateTablet for tablet fc60f59313bc4507bdf418cf4654ee3b (DEFAULT_TABLE table=soft_deleted_table [id=11b3bc1519bb4e9eb0f6fe4798b92314]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:14:24.308277  1321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc60f59313bc4507bdf418cf4654ee3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:24.308027  1396 tablet_service.cc:1511] Processing CreateTablet for tablet fc60f59313bc4507bdf418cf4654ee3b (DEFAULT_TABLE table=soft_deleted_table [id=11b3bc1519bb4e9eb0f6fe4798b92314]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:14:24.306988  1246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc60f59313bc4507bdf418cf4654ee3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:24.309306  1396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc60f59313bc4507bdf418cf4654ee3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:24.311935  1245 tablet_service.cc:1511] Processing CreateTablet for tablet aa6cc96673d4456da12d920cea7aa471 (DEFAULT_TABLE table=soft_deleted_table [id=11b3bc1519bb4e9eb0f6fe4798b92314]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:14:24.312054  1323 tablet_service.cc:1511] Processing CreateTablet for tablet aa6cc96673d4456da12d920cea7aa471 (DEFAULT_TABLE table=soft_deleted_table [id=11b3bc1519bb4e9eb0f6fe4798b92314]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:14:24.313377  1245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa6cc96673d4456da12d920cea7aa471. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:24.313463  1323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa6cc96673d4456da12d920cea7aa471. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:24.316828  1244 tablet_service.cc:1511] Processing CreateTablet for tablet d214f889325043f2a8a06bb04a45783c (DEFAULT_TABLE table=soft_deleted_table [id=11b3bc1519bb4e9eb0f6fe4798b92314]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:14:24.313181  1394 tablet_service.cc:1511] Processing CreateTablet for tablet aa6cc96673d4456da12d920cea7aa471 (DEFAULT_TABLE table=soft_deleted_table [id=11b3bc1519bb4e9eb0f6fe4798b92314]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:14:24.318138  1244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d214f889325043f2a8a06bb04a45783c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:24.318480  1394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa6cc96673d4456da12d920cea7aa471. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:24.328996  1322 tablet_service.cc:1511] Processing CreateTablet for tablet d214f889325043f2a8a06bb04a45783c (DEFAULT_TABLE table=soft_deleted_table [id=11b3bc1519bb4e9eb0f6fe4798b92314]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:14:24.330453  1322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d214f889325043f2a8a06bb04a45783c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:24.338996  1397 tablet_service.cc:1511] Processing CreateTablet for tablet d214f889325043f2a8a06bb04a45783c (DEFAULT_TABLE table=soft_deleted_table [id=11b3bc1519bb4e9eb0f6fe4798b92314]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:14:24.340332  1397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d214f889325043f2a8a06bb04a45783c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:24.342478  1395 tablet_service.cc:1511] Processing CreateTablet for tablet 500933c30a944235930b2ae50569922a (DEFAULT_TABLE table=soft_deleted_table [id=11b3bc1519bb4e9eb0f6fe4798b92314]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:14:24.343787  1395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 500933c30a944235930b2ae50569922a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:24.344183  1320 tablet_service.cc:1511] Processing CreateTablet for tablet 500933c30a944235930b2ae50569922a (DEFAULT_TABLE table=soft_deleted_table [id=11b3bc1519bb4e9eb0f6fe4798b92314]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:14:24.345443  1320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 500933c30a944235930b2ae50569922a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:24.351305  1248 tablet_service.cc:1511] Processing CreateTablet for tablet 500933c30a944235930b2ae50569922a (DEFAULT_TABLE table=soft_deleted_table [id=11b3bc1519bb4e9eb0f6fe4798b92314]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:14:24.352718  1248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 500933c30a944235930b2ae50569922a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:24.359596  1247 tablet_service.cc:1511] Processing CreateTablet for tablet eeda95d1ada94d01aab3427f00d32570 (DEFAULT_TABLE table=soft_deleted_table [id=11b3bc1519bb4e9eb0f6fe4798b92314]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:14:24.360982  1247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eeda95d1ada94d01aab3427f00d32570. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:24.362268  1321 tablet_service.cc:1511] Processing CreateTablet for tablet eeda95d1ada94d01aab3427f00d32570 (DEFAULT_TABLE table=soft_deleted_table [id=11b3bc1519bb4e9eb0f6fe4798b92314]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:14:24.363375  1393 tablet_service.cc:1511] Processing CreateTablet for tablet eeda95d1ada94d01aab3427f00d32570 (DEFAULT_TABLE table=soft_deleted_table [id=11b3bc1519bb4e9eb0f6fe4798b92314]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:14:24.364148  1321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eeda95d1ada94d01aab3427f00d32570. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:24.364676  1393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eeda95d1ada94d01aab3427f00d32570. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:24.369817  1546 tablet_bootstrap.cc:492] T fc60f59313bc4507bdf418cf4654ee3b P 0bf9692a81414cfab64ee45b5393d57e: Bootstrap starting.
I20260709 13:14:24.376009  1546 tablet_bootstrap.cc:654] T fc60f59313bc4507bdf418cf4654ee3b P 0bf9692a81414cfab64ee45b5393d57e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:24.380810  1243 tablet_service.cc:1511] Processing CreateTablet for tablet 02592ff6032f4ca6855608f5508444f6 (DEFAULT_TABLE table=soft_deleted_table [id=11b3bc1519bb4e9eb0f6fe4798b92314]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:14:24.384637  1319 tablet_service.cc:1511] Processing CreateTablet for tablet 02592ff6032f4ca6855608f5508444f6 (DEFAULT_TABLE table=soft_deleted_table [id=11b3bc1519bb4e9eb0f6fe4798b92314]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:14:24.400635  1394 tablet_service.cc:1511] Processing CreateTablet for tablet 02592ff6032f4ca6855608f5508444f6 (DEFAULT_TABLE table=soft_deleted_table [id=11b3bc1519bb4e9eb0f6fe4798b92314]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:14:24.404117  1243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02592ff6032f4ca6855608f5508444f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:24.404136  1319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02592ff6032f4ca6855608f5508444f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:24.406812  1394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02592ff6032f4ca6855608f5508444f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:24.422355  1245 tablet_service.cc:1511] Processing CreateTablet for tablet 3a13635e2d594fb0bd31ac4039d4d2e0 (DEFAULT_TABLE table=soft_deleted_table [id=11b3bc1519bb4e9eb0f6fe4798b92314]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:14:24.424113  1245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a13635e2d594fb0bd31ac4039d4d2e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:24.433033  1320 tablet_service.cc:1511] Processing CreateTablet for tablet 3a13635e2d594fb0bd31ac4039d4d2e0 (DEFAULT_TABLE table=soft_deleted_table [id=11b3bc1519bb4e9eb0f6fe4798b92314]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:14:24.434716  1320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a13635e2d594fb0bd31ac4039d4d2e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:24.439013  1394 tablet_service.cc:1511] Processing CreateTablet for tablet 3a13635e2d594fb0bd31ac4039d4d2e0 (DEFAULT_TABLE table=soft_deleted_table [id=11b3bc1519bb4e9eb0f6fe4798b92314]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:14:24.441174  1396 tablet_service.cc:1511] Processing CreateTablet for tablet f7e4806e46494317a05058762da8a72e (DEFAULT_TABLE table=soft_deleted_table [id=11b3bc1519bb4e9eb0f6fe4798b92314]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:14:24.442921  1396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7e4806e46494317a05058762da8a72e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:24.444058  1322 tablet_service.cc:1511] Processing CreateTablet for tablet f7e4806e46494317a05058762da8a72e (DEFAULT_TABLE table=soft_deleted_table [id=11b3bc1519bb4e9eb0f6fe4798b92314]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:14:24.442601  1248 tablet_service.cc:1511] Processing CreateTablet for tablet f7e4806e46494317a05058762da8a72e (DEFAULT_TABLE table=soft_deleted_table [id=11b3bc1519bb4e9eb0f6fe4798b92314]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:14:24.445494  1248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7e4806e46494317a05058762da8a72e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:24.446359  1548 tablet_bootstrap.cc:492] T fc60f59313bc4507bdf418cf4654ee3b P 40837fdefb66404b93c3e3876da432f7: Bootstrap starting.
I20260709 13:14:24.446426  1547 tablet_bootstrap.cc:492] T d214f889325043f2a8a06bb04a45783c P e4f6eab2337842428ba2670421465839: Bootstrap starting.
I20260709 13:14:24.451134  1244 tablet_service.cc:1511] Processing CreateTablet for tablet f67b7f39bd9042a0bd72e32fbc31391d (DEFAULT_TABLE table=soft_deleted_table [id=11b3bc1519bb4e9eb0f6fe4798b92314]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:14:24.451346  1321 tablet_service.cc:1511] Processing CreateTablet for tablet f67b7f39bd9042a0bd72e32fbc31391d (DEFAULT_TABLE table=soft_deleted_table [id=11b3bc1519bb4e9eb0f6fe4798b92314]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:14:24.452361  1244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f67b7f39bd9042a0bd72e32fbc31391d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:24.446442  1322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7e4806e46494317a05058762da8a72e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:24.455880  1397 tablet_service.cc:1511] Processing CreateTablet for tablet f67b7f39bd9042a0bd72e32fbc31391d (DEFAULT_TABLE table=soft_deleted_table [id=11b3bc1519bb4e9eb0f6fe4798b92314]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:14:24.457227  1397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f67b7f39bd9042a0bd72e32fbc31391d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:24.458096  1394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a13635e2d594fb0bd31ac4039d4d2e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:24.458570  1321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f67b7f39bd9042a0bd72e32fbc31391d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:24.458859  1548 tablet_bootstrap.cc:654] T fc60f59313bc4507bdf418cf4654ee3b P 40837fdefb66404b93c3e3876da432f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:24.472972  1547 tablet_bootstrap.cc:654] T d214f889325043f2a8a06bb04a45783c P e4f6eab2337842428ba2670421465839: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:24.476290  1546 tablet_bootstrap.cc:492] T fc60f59313bc4507bdf418cf4654ee3b P 0bf9692a81414cfab64ee45b5393d57e: No bootstrap required, opened a new log
I20260709 13:14:24.476886  1546 ts_tablet_manager.cc:1403] T fc60f59313bc4507bdf418cf4654ee3b P 0bf9692a81414cfab64ee45b5393d57e: Time spent bootstrapping tablet: real 0.119s	user 0.015s	sys 0.000s
I20260709 13:14:24.479959  1546 raft_consensus.cc:359] T fc60f59313bc4507bdf418cf4654ee3b P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.480687  1546 raft_consensus.cc:385] T fc60f59313bc4507bdf418cf4654ee3b P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:24.480985  1546 raft_consensus.cc:740] T fc60f59313bc4507bdf418cf4654ee3b P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bf9692a81414cfab64ee45b5393d57e, State: Initialized, Role: FOLLOWER
I20260709 13:14:24.481724  1546 consensus_queue.cc:260] T fc60f59313bc4507bdf418cf4654ee3b P 0bf9692a81414cfab64ee45b5393d57e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.484382  1546 ts_tablet_manager.cc:1434] T fc60f59313bc4507bdf418cf4654ee3b P 0bf9692a81414cfab64ee45b5393d57e: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.008s
I20260709 13:14:24.484853  1548 tablet_bootstrap.cc:492] T fc60f59313bc4507bdf418cf4654ee3b P 40837fdefb66404b93c3e3876da432f7: No bootstrap required, opened a new log
I20260709 13:14:24.485329  1546 tablet_bootstrap.cc:492] T aa6cc96673d4456da12d920cea7aa471 P 0bf9692a81414cfab64ee45b5393d57e: Bootstrap starting.
I20260709 13:14:24.485462  1548 ts_tablet_manager.cc:1403] T fc60f59313bc4507bdf418cf4654ee3b P 40837fdefb66404b93c3e3876da432f7: Time spent bootstrapping tablet: real 0.039s	user 0.008s	sys 0.005s
I20260709 13:14:24.488590  1548 raft_consensus.cc:359] T fc60f59313bc4507bdf418cf4654ee3b P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.489326  1548 raft_consensus.cc:385] T fc60f59313bc4507bdf418cf4654ee3b P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:24.489658  1548 raft_consensus.cc:740] T fc60f59313bc4507bdf418cf4654ee3b P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40837fdefb66404b93c3e3876da432f7, State: Initialized, Role: FOLLOWER
I20260709 13:14:24.490577  1548 consensus_queue.cc:260] T fc60f59313bc4507bdf418cf4654ee3b P 40837fdefb66404b93c3e3876da432f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.491845  1546 tablet_bootstrap.cc:654] T aa6cc96673d4456da12d920cea7aa471 P 0bf9692a81414cfab64ee45b5393d57e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:24.499323  1548 ts_tablet_manager.cc:1434] T fc60f59313bc4507bdf418cf4654ee3b P 40837fdefb66404b93c3e3876da432f7: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:14:24.503509  1546 tablet_bootstrap.cc:492] T aa6cc96673d4456da12d920cea7aa471 P 0bf9692a81414cfab64ee45b5393d57e: No bootstrap required, opened a new log
I20260709 13:14:24.504163  1546 ts_tablet_manager.cc:1403] T aa6cc96673d4456da12d920cea7aa471 P 0bf9692a81414cfab64ee45b5393d57e: Time spent bootstrapping tablet: real 0.019s	user 0.006s	sys 0.012s
I20260709 13:14:24.507120  1546 raft_consensus.cc:359] T aa6cc96673d4456da12d920cea7aa471 P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.507786  1548 tablet_bootstrap.cc:492] T aa6cc96673d4456da12d920cea7aa471 P 40837fdefb66404b93c3e3876da432f7: Bootstrap starting.
I20260709 13:14:24.508018  1546 raft_consensus.cc:385] T aa6cc96673d4456da12d920cea7aa471 P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:24.508499  1546 raft_consensus.cc:740] T aa6cc96673d4456da12d920cea7aa471 P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bf9692a81414cfab64ee45b5393d57e, State: Initialized, Role: FOLLOWER
I20260709 13:14:24.509325  1546 consensus_queue.cc:260] T aa6cc96673d4456da12d920cea7aa471 P 0bf9692a81414cfab64ee45b5393d57e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.511889  1546 ts_tablet_manager.cc:1434] T aa6cc96673d4456da12d920cea7aa471 P 0bf9692a81414cfab64ee45b5393d57e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:14:24.512904  1546 tablet_bootstrap.cc:492] T 500933c30a944235930b2ae50569922a P 0bf9692a81414cfab64ee45b5393d57e: Bootstrap starting.
I20260709 13:14:24.517727  1548 tablet_bootstrap.cc:654] T aa6cc96673d4456da12d920cea7aa471 P 40837fdefb66404b93c3e3876da432f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:24.520701  1547 tablet_bootstrap.cc:492] T d214f889325043f2a8a06bb04a45783c P e4f6eab2337842428ba2670421465839: No bootstrap required, opened a new log
I20260709 13:14:24.521319  1547 ts_tablet_manager.cc:1403] T d214f889325043f2a8a06bb04a45783c P e4f6eab2337842428ba2670421465839: Time spent bootstrapping tablet: real 0.075s	user 0.003s	sys 0.009s
I20260709 13:14:24.523763  1546 tablet_bootstrap.cc:654] T 500933c30a944235930b2ae50569922a P 0bf9692a81414cfab64ee45b5393d57e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:24.525013  1475 raft_consensus.cc:493] T aa6cc96673d4456da12d920cea7aa471 P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:24.525534  1475 raft_consensus.cc:515] T aa6cc96673d4456da12d920cea7aa471 P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.527776  1475 leader_election.cc:290] T aa6cc96673d4456da12d920cea7aa471 P 0bf9692a81414cfab64ee45b5393d57e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4f6eab2337842428ba2670421465839 (127.23.140.65:45009), 40837fdefb66404b93c3e3876da432f7 (127.23.140.67:43689)
I20260709 13:14:24.529309  1258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6cc96673d4456da12d920cea7aa471" candidate_uuid: "0bf9692a81414cfab64ee45b5393d57e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f6eab2337842428ba2670421465839" is_pre_election: true
I20260709 13:14:24.529969  1548 tablet_bootstrap.cc:492] T aa6cc96673d4456da12d920cea7aa471 P 40837fdefb66404b93c3e3876da432f7: No bootstrap required, opened a new log
I20260709 13:14:24.531770  1548 ts_tablet_manager.cc:1403] T aa6cc96673d4456da12d920cea7aa471 P 40837fdefb66404b93c3e3876da432f7: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.004s
W20260709 13:14:24.532348  1297 leader_election.cc:343] T aa6cc96673d4456da12d920cea7aa471 P 0bf9692a81414cfab64ee45b5393d57e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4f6eab2337842428ba2670421465839 (127.23.140.65:45009): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:24.530894  1407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6cc96673d4456da12d920cea7aa471" candidate_uuid: "0bf9692a81414cfab64ee45b5393d57e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40837fdefb66404b93c3e3876da432f7" is_pre_election: true
I20260709 13:14:24.535777  1548 raft_consensus.cc:359] T aa6cc96673d4456da12d920cea7aa471 P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.536588  1548 raft_consensus.cc:385] T aa6cc96673d4456da12d920cea7aa471 P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:24.536954  1548 raft_consensus.cc:740] T aa6cc96673d4456da12d920cea7aa471 P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40837fdefb66404b93c3e3876da432f7, State: Initialized, Role: FOLLOWER
I20260709 13:14:24.525245  1547 raft_consensus.cc:359] T d214f889325043f2a8a06bb04a45783c P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.537917  1548 consensus_queue.cc:260] T aa6cc96673d4456da12d920cea7aa471 P 40837fdefb66404b93c3e3876da432f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.537940  1547 raft_consensus.cc:385] T d214f889325043f2a8a06bb04a45783c P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:24.538817  1407 raft_consensus.cc:2468] T aa6cc96673d4456da12d920cea7aa471 P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0bf9692a81414cfab64ee45b5393d57e in term 0.
I20260709 13:14:24.539309  1547 raft_consensus.cc:740] T d214f889325043f2a8a06bb04a45783c P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4f6eab2337842428ba2670421465839, State: Initialized, Role: FOLLOWER
I20260709 13:14:24.540174  1547 consensus_queue.cc:260] T d214f889325043f2a8a06bb04a45783c P e4f6eab2337842428ba2670421465839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.542078  1299 leader_election.cc:304] T aa6cc96673d4456da12d920cea7aa471 P 0bf9692a81414cfab64ee45b5393d57e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0bf9692a81414cfab64ee45b5393d57e, 40837fdefb66404b93c3e3876da432f7; no voters: e4f6eab2337842428ba2670421465839
I20260709 13:14:24.543027  1548 ts_tablet_manager.cc:1434] T aa6cc96673d4456da12d920cea7aa471 P 40837fdefb66404b93c3e3876da432f7: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.004s
I20260709 13:14:24.543617  1475 raft_consensus.cc:2804] T aa6cc96673d4456da12d920cea7aa471 P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:24.544019  1475 raft_consensus.cc:493] T aa6cc96673d4456da12d920cea7aa471 P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:24.544327  1475 raft_consensus.cc:3060] T aa6cc96673d4456da12d920cea7aa471 P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:24.544860  1547 ts_tablet_manager.cc:1434] T d214f889325043f2a8a06bb04a45783c P e4f6eab2337842428ba2670421465839: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.003s
I20260709 13:14:24.545948  1547 tablet_bootstrap.cc:492] T eeda95d1ada94d01aab3427f00d32570 P e4f6eab2337842428ba2670421465839: Bootstrap starting.
I20260709 13:14:24.551599  1548 tablet_bootstrap.cc:492] T d214f889325043f2a8a06bb04a45783c P 40837fdefb66404b93c3e3876da432f7: Bootstrap starting.
I20260709 13:14:24.559087  1548 tablet_bootstrap.cc:654] T d214f889325043f2a8a06bb04a45783c P 40837fdefb66404b93c3e3876da432f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:24.563867  1547 tablet_bootstrap.cc:654] T eeda95d1ada94d01aab3427f00d32570 P e4f6eab2337842428ba2670421465839: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:24.566462  1475 raft_consensus.cc:515] T aa6cc96673d4456da12d920cea7aa471 P 0bf9692a81414cfab64ee45b5393d57e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.568388  1546 tablet_bootstrap.cc:492] T 500933c30a944235930b2ae50569922a P 0bf9692a81414cfab64ee45b5393d57e: No bootstrap required, opened a new log
I20260709 13:14:24.568977  1546 ts_tablet_manager.cc:1403] T 500933c30a944235930b2ae50569922a P 0bf9692a81414cfab64ee45b5393d57e: Time spent bootstrapping tablet: real 0.056s	user 0.012s	sys 0.004s
I20260709 13:14:24.569527  1258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6cc96673d4456da12d920cea7aa471" candidate_uuid: "0bf9692a81414cfab64ee45b5393d57e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f6eab2337842428ba2670421465839"
W20260709 13:14:24.571008  1297 leader_election.cc:343] T aa6cc96673d4456da12d920cea7aa471 P 0bf9692a81414cfab64ee45b5393d57e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e4f6eab2337842428ba2670421465839 (127.23.140.65:45009): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:24.572033  1546 raft_consensus.cc:359] T 500933c30a944235930b2ae50569922a P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.572832  1546 raft_consensus.cc:385] T 500933c30a944235930b2ae50569922a P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:24.573119  1546 raft_consensus.cc:740] T 500933c30a944235930b2ae50569922a P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bf9692a81414cfab64ee45b5393d57e, State: Initialized, Role: FOLLOWER
I20260709 13:14:24.573182  1407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6cc96673d4456da12d920cea7aa471" candidate_uuid: "0bf9692a81414cfab64ee45b5393d57e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40837fdefb66404b93c3e3876da432f7"
I20260709 13:14:24.573823  1407 raft_consensus.cc:3060] T aa6cc96673d4456da12d920cea7aa471 P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:24.574162  1546 consensus_queue.cc:260] T 500933c30a944235930b2ae50569922a P 0bf9692a81414cfab64ee45b5393d57e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.577428  1548 tablet_bootstrap.cc:492] T d214f889325043f2a8a06bb04a45783c P 40837fdefb66404b93c3e3876da432f7: No bootstrap required, opened a new log
I20260709 13:14:24.578138  1548 ts_tablet_manager.cc:1403] T d214f889325043f2a8a06bb04a45783c P 40837fdefb66404b93c3e3876da432f7: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.004s
I20260709 13:14:24.581048  1407 raft_consensus.cc:2468] T aa6cc96673d4456da12d920cea7aa471 P 40837fdefb66404b93c3e3876da432f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bf9692a81414cfab64ee45b5393d57e in term 1.
I20260709 13:14:24.582527  1475 leader_election.cc:290] T aa6cc96673d4456da12d920cea7aa471 P 0bf9692a81414cfab64ee45b5393d57e [CANDIDATE]: Term 1 election: Requested vote from peers e4f6eab2337842428ba2670421465839 (127.23.140.65:45009), 40837fdefb66404b93c3e3876da432f7 (127.23.140.67:43689)
I20260709 13:14:24.582356  1299 leader_election.cc:304] T aa6cc96673d4456da12d920cea7aa471 P 0bf9692a81414cfab64ee45b5393d57e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0bf9692a81414cfab64ee45b5393d57e, 40837fdefb66404b93c3e3876da432f7; no voters: e4f6eab2337842428ba2670421465839
I20260709 13:14:24.583565  1475 raft_consensus.cc:2804] T aa6cc96673d4456da12d920cea7aa471 P 0bf9692a81414cfab64ee45b5393d57e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:24.583881  1546 ts_tablet_manager.cc:1434] T 500933c30a944235930b2ae50569922a P 0bf9692a81414cfab64ee45b5393d57e: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.001s
I20260709 13:14:24.584072  1475 raft_consensus.cc:697] T aa6cc96673d4456da12d920cea7aa471 P 0bf9692a81414cfab64ee45b5393d57e [term 1 LEADER]: Becoming Leader. State: Replica: 0bf9692a81414cfab64ee45b5393d57e, State: Running, Role: LEADER
I20260709 13:14:24.582300  1548 raft_consensus.cc:359] T d214f889325043f2a8a06bb04a45783c P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.586011  1546 tablet_bootstrap.cc:492] T d214f889325043f2a8a06bb04a45783c P 0bf9692a81414cfab64ee45b5393d57e: Bootstrap starting.
I20260709 13:14:24.585932  1548 raft_consensus.cc:385] T d214f889325043f2a8a06bb04a45783c P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:24.585897  1475 consensus_queue.cc:237] T aa6cc96673d4456da12d920cea7aa471 P 0bf9692a81414cfab64ee45b5393d57e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.586573  1548 raft_consensus.cc:740] T d214f889325043f2a8a06bb04a45783c P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40837fdefb66404b93c3e3876da432f7, State: Initialized, Role: FOLLOWER
I20260709 13:14:24.587168  1547 tablet_bootstrap.cc:492] T eeda95d1ada94d01aab3427f00d32570 P e4f6eab2337842428ba2670421465839: No bootstrap required, opened a new log
I20260709 13:14:24.587745  1547 ts_tablet_manager.cc:1403] T eeda95d1ada94d01aab3427f00d32570 P e4f6eab2337842428ba2670421465839: Time spent bootstrapping tablet: real 0.042s	user 0.026s	sys 0.003s
I20260709 13:14:24.587549  1548 consensus_queue.cc:260] T d214f889325043f2a8a06bb04a45783c P 40837fdefb66404b93c3e3876da432f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.590281  1548 ts_tablet_manager.cc:1434] T d214f889325043f2a8a06bb04a45783c P 40837fdefb66404b93c3e3876da432f7: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.001s
I20260709 13:14:24.591334  1548 tablet_bootstrap.cc:492] T eeda95d1ada94d01aab3427f00d32570 P 40837fdefb66404b93c3e3876da432f7: Bootstrap starting.
I20260709 13:14:24.591069  1547 raft_consensus.cc:359] T eeda95d1ada94d01aab3427f00d32570 P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.591951  1547 raft_consensus.cc:385] T eeda95d1ada94d01aab3427f00d32570 P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:24.592307  1547 raft_consensus.cc:740] T eeda95d1ada94d01aab3427f00d32570 P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4f6eab2337842428ba2670421465839, State: Initialized, Role: FOLLOWER
I20260709 13:14:24.593245  1546 tablet_bootstrap.cc:654] T d214f889325043f2a8a06bb04a45783c P 0bf9692a81414cfab64ee45b5393d57e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:24.593132  1547 consensus_queue.cc:260] T eeda95d1ada94d01aab3427f00d32570 P e4f6eab2337842428ba2670421465839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.595695  1547 ts_tablet_manager.cc:1434] T eeda95d1ada94d01aab3427f00d32570 P e4f6eab2337842428ba2670421465839: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:14:24.596885  1547 tablet_bootstrap.cc:492] T fc60f59313bc4507bdf418cf4654ee3b P e4f6eab2337842428ba2670421465839: Bootstrap starting.
W20260709 13:14:24.598629  1204 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:24.601931  1548 tablet_bootstrap.cc:654] T eeda95d1ada94d01aab3427f00d32570 P 40837fdefb66404b93c3e3876da432f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:24.604797  1547 tablet_bootstrap.cc:654] T fc60f59313bc4507bdf418cf4654ee3b P e4f6eab2337842428ba2670421465839: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:24.614293  1548 tablet_bootstrap.cc:492] T eeda95d1ada94d01aab3427f00d32570 P 40837fdefb66404b93c3e3876da432f7: No bootstrap required, opened a new log
I20260709 13:14:24.614805  1548 ts_tablet_manager.cc:1403] T eeda95d1ada94d01aab3427f00d32570 P 40837fdefb66404b93c3e3876da432f7: Time spent bootstrapping tablet: real 0.024s	user 0.007s	sys 0.009s
I20260709 13:14:24.615624  1547 tablet_bootstrap.cc:492] T fc60f59313bc4507bdf418cf4654ee3b P e4f6eab2337842428ba2670421465839: No bootstrap required, opened a new log
I20260709 13:14:24.616255  1547 ts_tablet_manager.cc:1403] T fc60f59313bc4507bdf418cf4654ee3b P e4f6eab2337842428ba2670421465839: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.000s
I20260709 13:14:24.617863  1548 raft_consensus.cc:359] T eeda95d1ada94d01aab3427f00d32570 P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.618652  1548 raft_consensus.cc:385] T eeda95d1ada94d01aab3427f00d32570 P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:24.618961  1548 raft_consensus.cc:740] T eeda95d1ada94d01aab3427f00d32570 P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40837fdefb66404b93c3e3876da432f7, State: Initialized, Role: FOLLOWER
I20260709 13:14:24.619949  1547 raft_consensus.cc:359] T fc60f59313bc4507bdf418cf4654ee3b P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.620024  1548 consensus_queue.cc:260] T eeda95d1ada94d01aab3427f00d32570 P 40837fdefb66404b93c3e3876da432f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.620918  1547 raft_consensus.cc:385] T fc60f59313bc4507bdf418cf4654ee3b P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:24.621294  1547 raft_consensus.cc:740] T fc60f59313bc4507bdf418cf4654ee3b P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4f6eab2337842428ba2670421465839, State: Initialized, Role: FOLLOWER
I20260709 13:14:24.618849  1534 raft_consensus.cc:493] T fc60f59313bc4507bdf418cf4654ee3b P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:24.622093  1534 raft_consensus.cc:515] T fc60f59313bc4507bdf418cf4654ee3b P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.622501  1547 consensus_queue.cc:260] T fc60f59313bc4507bdf418cf4654ee3b P e4f6eab2337842428ba2670421465839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.625977  1547 ts_tablet_manager.cc:1434] T fc60f59313bc4507bdf418cf4654ee3b P e4f6eab2337842428ba2670421465839: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:14:24.626495  1329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc60f59313bc4507bdf418cf4654ee3b" candidate_uuid: "40837fdefb66404b93c3e3876da432f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bf9692a81414cfab64ee45b5393d57e" is_pre_election: true
I20260709 13:14:24.627214  1329 raft_consensus.cc:2468] T fc60f59313bc4507bdf418cf4654ee3b P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40837fdefb66404b93c3e3876da432f7 in term 0.
I20260709 13:14:24.627478  1547 tablet_bootstrap.cc:492] T aa6cc96673d4456da12d920cea7aa471 P e4f6eab2337842428ba2670421465839: Bootstrap starting.
I20260709 13:14:24.629962  1548 ts_tablet_manager.cc:1434] T eeda95d1ada94d01aab3427f00d32570 P 40837fdefb66404b93c3e3876da432f7: Time spent starting tablet: real 0.015s	user 0.013s	sys 0.002s
I20260709 13:14:24.629839  1370 leader_election.cc:304] T fc60f59313bc4507bdf418cf4654ee3b P 40837fdefb66404b93c3e3876da432f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bf9692a81414cfab64ee45b5393d57e, 40837fdefb66404b93c3e3876da432f7; no voters: 
I20260709 13:14:24.631049  1534 leader_election.cc:290] T fc60f59313bc4507bdf418cf4654ee3b P 40837fdefb66404b93c3e3876da432f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4f6eab2337842428ba2670421465839 (127.23.140.65:45009), 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66:38395)
I20260709 13:14:24.631263  1548 tablet_bootstrap.cc:492] T 500933c30a944235930b2ae50569922a P 40837fdefb66404b93c3e3876da432f7: Bootstrap starting.
I20260709 13:14:24.631762  1534 raft_consensus.cc:2804] T fc60f59313bc4507bdf418cf4654ee3b P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:24.632241  1534 raft_consensus.cc:493] T fc60f59313bc4507bdf418cf4654ee3b P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:24.632709  1534 raft_consensus.cc:3060] T fc60f59313bc4507bdf418cf4654ee3b P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:24.635161  1258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc60f59313bc4507bdf418cf4654ee3b" candidate_uuid: "40837fdefb66404b93c3e3876da432f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f6eab2337842428ba2670421465839" is_pre_election: true
I20260709 13:14:24.635509  1547 tablet_bootstrap.cc:654] T aa6cc96673d4456da12d920cea7aa471 P e4f6eab2337842428ba2670421465839: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:24.636082  1258 raft_consensus.cc:2468] T fc60f59313bc4507bdf418cf4654ee3b P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40837fdefb66404b93c3e3876da432f7 in term 0.
I20260709 13:14:24.638866  1548 tablet_bootstrap.cc:654] T 500933c30a944235930b2ae50569922a P 40837fdefb66404b93c3e3876da432f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:24.648528  1547 tablet_bootstrap.cc:492] T aa6cc96673d4456da12d920cea7aa471 P e4f6eab2337842428ba2670421465839: No bootstrap required, opened a new log
I20260709 13:14:24.649217  1547 ts_tablet_manager.cc:1403] T aa6cc96673d4456da12d920cea7aa471 P e4f6eab2337842428ba2670421465839: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.004s
I20260709 13:14:24.651445  1548 tablet_bootstrap.cc:492] T 500933c30a944235930b2ae50569922a P 40837fdefb66404b93c3e3876da432f7: No bootstrap required, opened a new log
I20260709 13:14:24.652040  1548 ts_tablet_manager.cc:1403] T 500933c30a944235930b2ae50569922a P 40837fdefb66404b93c3e3876da432f7: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.004s
I20260709 13:14:24.652842  1547 raft_consensus.cc:359] T aa6cc96673d4456da12d920cea7aa471 P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.653676  1547 raft_consensus.cc:385] T aa6cc96673d4456da12d920cea7aa471 P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:24.654067  1547 raft_consensus.cc:740] T aa6cc96673d4456da12d920cea7aa471 P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4f6eab2337842428ba2670421465839, State: Initialized, Role: FOLLOWER
I20260709 13:14:24.654927  1547 consensus_queue.cc:260] T aa6cc96673d4456da12d920cea7aa471 P e4f6eab2337842428ba2670421465839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.656478  1548 raft_consensus.cc:359] T 500933c30a944235930b2ae50569922a P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.657501  1548 raft_consensus.cc:385] T 500933c30a944235930b2ae50569922a P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:24.658042  1548 raft_consensus.cc:740] T 500933c30a944235930b2ae50569922a P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40837fdefb66404b93c3e3876da432f7, State: Initialized, Role: FOLLOWER
I20260709 13:14:24.658918  1548 consensus_queue.cc:260] T 500933c30a944235930b2ae50569922a P 40837fdefb66404b93c3e3876da432f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.659651  1547 ts_tablet_manager.cc:1434] T aa6cc96673d4456da12d920cea7aa471 P e4f6eab2337842428ba2670421465839: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.003s
I20260709 13:14:24.661190  1547 tablet_bootstrap.cc:492] T 500933c30a944235930b2ae50569922a P e4f6eab2337842428ba2670421465839: Bootstrap starting.
I20260709 13:14:24.661424  1548 ts_tablet_manager.cc:1434] T 500933c30a944235930b2ae50569922a P 40837fdefb66404b93c3e3876da432f7: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:14:24.662499  1548 tablet_bootstrap.cc:492] T 02592ff6032f4ca6855608f5508444f6 P 40837fdefb66404b93c3e3876da432f7: Bootstrap starting.
I20260709 13:14:24.668085  1547 tablet_bootstrap.cc:654] T 500933c30a944235930b2ae50569922a P e4f6eab2337842428ba2670421465839: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:24.668926  1548 tablet_bootstrap.cc:654] T 02592ff6032f4ca6855608f5508444f6 P 40837fdefb66404b93c3e3876da432f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:24.680662  1547 tablet_bootstrap.cc:492] T 500933c30a944235930b2ae50569922a P e4f6eab2337842428ba2670421465839: No bootstrap required, opened a new log
I20260709 13:14:24.681475  1547 ts_tablet_manager.cc:1403] T 500933c30a944235930b2ae50569922a P e4f6eab2337842428ba2670421465839: Time spent bootstrapping tablet: real 0.021s	user 0.018s	sys 0.001s
I20260709 13:14:24.685180  1547 raft_consensus.cc:359] T 500933c30a944235930b2ae50569922a P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.686523  1547 raft_consensus.cc:385] T 500933c30a944235930b2ae50569922a P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:24.686878  1547 raft_consensus.cc:740] T 500933c30a944235930b2ae50569922a P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4f6eab2337842428ba2670421465839, State: Initialized, Role: FOLLOWER
I20260709 13:14:24.687819  1547 consensus_queue.cc:260] T 500933c30a944235930b2ae50569922a P e4f6eab2337842428ba2670421465839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.690214  1547 ts_tablet_manager.cc:1434] T 500933c30a944235930b2ae50569922a P e4f6eab2337842428ba2670421465839: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:14:24.691233  1547 tablet_bootstrap.cc:492] T 02592ff6032f4ca6855608f5508444f6 P e4f6eab2337842428ba2670421465839: Bootstrap starting.
I20260709 13:14:24.693713  1534 raft_consensus.cc:515] T fc60f59313bc4507bdf418cf4654ee3b P 40837fdefb66404b93c3e3876da432f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.695212  1155 catalog_manager.cc:5697] T aa6cc96673d4456da12d920cea7aa471 P 0bf9692a81414cfab64ee45b5393d57e reported cstate change: term changed from 0 to 1, leader changed from <none> to 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66). New cstate: current_term: 1 leader_uuid: "0bf9692a81414cfab64ee45b5393d57e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:24.698678  1547 tablet_bootstrap.cc:654] T 02592ff6032f4ca6855608f5508444f6 P e4f6eab2337842428ba2670421465839: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:24.701934  1258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc60f59313bc4507bdf418cf4654ee3b" candidate_uuid: "40837fdefb66404b93c3e3876da432f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f6eab2337842428ba2670421465839"
I20260709 13:14:24.702582  1258 raft_consensus.cc:3060] T fc60f59313bc4507bdf418cf4654ee3b P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:24.708981  1548 tablet_bootstrap.cc:492] T 02592ff6032f4ca6855608f5508444f6 P 40837fdefb66404b93c3e3876da432f7: No bootstrap required, opened a new log
I20260709 13:14:24.709784  1548 ts_tablet_manager.cc:1403] T 02592ff6032f4ca6855608f5508444f6 P 40837fdefb66404b93c3e3876da432f7: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.004s
I20260709 13:14:24.718572  1548 raft_consensus.cc:359] T 02592ff6032f4ca6855608f5508444f6 P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.719627  1548 raft_consensus.cc:385] T 02592ff6032f4ca6855608f5508444f6 P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:24.720006  1548 raft_consensus.cc:740] T 02592ff6032f4ca6855608f5508444f6 P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40837fdefb66404b93c3e3876da432f7, State: Initialized, Role: FOLLOWER
I20260709 13:14:24.721012  1548 consensus_queue.cc:260] T 02592ff6032f4ca6855608f5508444f6 P 40837fdefb66404b93c3e3876da432f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.724916  1548 ts_tablet_manager.cc:1434] T 02592ff6032f4ca6855608f5508444f6 P 40837fdefb66404b93c3e3876da432f7: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 13:14:24.729122  1329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc60f59313bc4507bdf418cf4654ee3b" candidate_uuid: "40837fdefb66404b93c3e3876da432f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bf9692a81414cfab64ee45b5393d57e"
I20260709 13:14:24.730060  1329 raft_consensus.cc:3060] T fc60f59313bc4507bdf418cf4654ee3b P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:24.733320  1548 tablet_bootstrap.cc:492] T f7e4806e46494317a05058762da8a72e P 40837fdefb66404b93c3e3876da432f7: Bootstrap starting.
I20260709 13:14:24.739441  1547 tablet_bootstrap.cc:492] T 02592ff6032f4ca6855608f5508444f6 P e4f6eab2337842428ba2670421465839: No bootstrap required, opened a new log
I20260709 13:14:24.740062  1547 ts_tablet_manager.cc:1403] T 02592ff6032f4ca6855608f5508444f6 P e4f6eab2337842428ba2670421465839: Time spent bootstrapping tablet: real 0.049s	user 0.031s	sys 0.009s
I20260709 13:14:24.742048  1548 tablet_bootstrap.cc:654] T f7e4806e46494317a05058762da8a72e P 40837fdefb66404b93c3e3876da432f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:24.743180  1547 raft_consensus.cc:359] T 02592ff6032f4ca6855608f5508444f6 P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.743973  1547 raft_consensus.cc:385] T 02592ff6032f4ca6855608f5508444f6 P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:24.743884  1494 raft_consensus.cc:493] T aa6cc96673d4456da12d920cea7aa471 P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:24.744544  1547 raft_consensus.cc:740] T 02592ff6032f4ca6855608f5508444f6 P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4f6eab2337842428ba2670421465839, State: Initialized, Role: FOLLOWER
I20260709 13:14:24.744865  1494 raft_consensus.cc:515] T aa6cc96673d4456da12d920cea7aa471 P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.745658  1547 consensus_queue.cc:260] T 02592ff6032f4ca6855608f5508444f6 P e4f6eab2337842428ba2670421465839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.748746  1331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6cc96673d4456da12d920cea7aa471" candidate_uuid: "e4f6eab2337842428ba2670421465839" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bf9692a81414cfab64ee45b5393d57e" is_pre_election: true
I20260709 13:14:24.750743  1407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6cc96673d4456da12d920cea7aa471" candidate_uuid: "e4f6eab2337842428ba2670421465839" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40837fdefb66404b93c3e3876da432f7" is_pre_election: true
I20260709 13:14:24.751997  1407 raft_consensus.cc:2393] T aa6cc96673d4456da12d920cea7aa471 P 40837fdefb66404b93c3e3876da432f7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4f6eab2337842428ba2670421465839 in current term 1: Already voted for candidate 0bf9692a81414cfab64ee45b5393d57e in this term.
I20260709 13:14:24.753547  1547 ts_tablet_manager.cc:1434] T 02592ff6032f4ca6855608f5508444f6 P e4f6eab2337842428ba2670421465839: Time spent starting tablet: real 0.013s	user 0.013s	sys 0.000s
I20260709 13:14:24.754160  1224 leader_election.cc:304] T aa6cc96673d4456da12d920cea7aa471 P e4f6eab2337842428ba2670421465839 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4f6eab2337842428ba2670421465839; no voters: 0bf9692a81414cfab64ee45b5393d57e, 40837fdefb66404b93c3e3876da432f7
I20260709 13:14:24.755009  1547 tablet_bootstrap.cc:492] T 3a13635e2d594fb0bd31ac4039d4d2e0 P e4f6eab2337842428ba2670421465839: Bootstrap starting.
I20260709 13:14:24.755440  1494 leader_election.cc:290] T aa6cc96673d4456da12d920cea7aa471 P e4f6eab2337842428ba2670421465839 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66:38395), 40837fdefb66404b93c3e3876da432f7 (127.23.140.67:43689)
I20260709 13:14:24.756613  1494 raft_consensus.cc:3060] T aa6cc96673d4456da12d920cea7aa471 P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:24.760326  1548 tablet_bootstrap.cc:492] T f7e4806e46494317a05058762da8a72e P 40837fdefb66404b93c3e3876da432f7: No bootstrap required, opened a new log
I20260709 13:14:24.760903  1548 ts_tablet_manager.cc:1403] T f7e4806e46494317a05058762da8a72e P 40837fdefb66404b93c3e3876da432f7: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.004s
I20260709 13:14:24.763521  1547 tablet_bootstrap.cc:654] T 3a13635e2d594fb0bd31ac4039d4d2e0 P e4f6eab2337842428ba2670421465839: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:24.764012  1548 raft_consensus.cc:359] T f7e4806e46494317a05058762da8a72e P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.764806  1548 raft_consensus.cc:385] T f7e4806e46494317a05058762da8a72e P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:24.765103  1548 raft_consensus.cc:740] T f7e4806e46494317a05058762da8a72e P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40837fdefb66404b93c3e3876da432f7, State: Initialized, Role: FOLLOWER
I20260709 13:14:24.765991  1548 consensus_queue.cc:260] T f7e4806e46494317a05058762da8a72e P 40837fdefb66404b93c3e3876da432f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.769205  1548 ts_tablet_manager.cc:1434] T f7e4806e46494317a05058762da8a72e P 40837fdefb66404b93c3e3876da432f7: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:14:24.770126  1561 raft_consensus.cc:493] T d214f889325043f2a8a06bb04a45783c P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:24.770622  1561 raft_consensus.cc:515] T d214f889325043f2a8a06bb04a45783c P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.773032  1561 leader_election.cc:290] T d214f889325043f2a8a06bb04a45783c P 40837fdefb66404b93c3e3876da432f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4f6eab2337842428ba2670421465839 (127.23.140.65:45009), 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66:38395)
I20260709 13:14:24.775036  1257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d214f889325043f2a8a06bb04a45783c" candidate_uuid: "40837fdefb66404b93c3e3876da432f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f6eab2337842428ba2670421465839" is_pre_election: true
I20260709 13:14:24.775715  1257 raft_consensus.cc:2468] T d214f889325043f2a8a06bb04a45783c P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40837fdefb66404b93c3e3876da432f7 in term 0.
I20260709 13:14:24.776465  1547 tablet_bootstrap.cc:492] T 3a13635e2d594fb0bd31ac4039d4d2e0 P e4f6eab2337842428ba2670421465839: No bootstrap required, opened a new log
I20260709 13:14:24.776993  1547 ts_tablet_manager.cc:1403] T 3a13635e2d594fb0bd31ac4039d4d2e0 P e4f6eab2337842428ba2670421465839: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.006s
I20260709 13:14:24.777338  1331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d214f889325043f2a8a06bb04a45783c" candidate_uuid: "40837fdefb66404b93c3e3876da432f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bf9692a81414cfab64ee45b5393d57e" is_pre_election: true
W20260709 13:14:24.779019  1370 leader_election.cc:343] T d214f889325043f2a8a06bb04a45783c P 40837fdefb66404b93c3e3876da432f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66:38395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:24.779990  1547 raft_consensus.cc:359] T 3a13635e2d594fb0bd31ac4039d4d2e0 P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.780006  1371 leader_election.cc:304] T d214f889325043f2a8a06bb04a45783c P 40837fdefb66404b93c3e3876da432f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40837fdefb66404b93c3e3876da432f7, e4f6eab2337842428ba2670421465839; no voters: 0bf9692a81414cfab64ee45b5393d57e
I20260709 13:14:24.780856  1547 raft_consensus.cc:385] T 3a13635e2d594fb0bd31ac4039d4d2e0 P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:24.781672  1561 raft_consensus.cc:2804] T d214f889325043f2a8a06bb04a45783c P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:24.781212  1547 raft_consensus.cc:740] T 3a13635e2d594fb0bd31ac4039d4d2e0 P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4f6eab2337842428ba2670421465839, State: Initialized, Role: FOLLOWER
I20260709 13:14:24.782124  1561 raft_consensus.cc:493] T d214f889325043f2a8a06bb04a45783c P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:24.782508  1561 raft_consensus.cc:3060] T d214f889325043f2a8a06bb04a45783c P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:24.782742  1547 consensus_queue.cc:260] T 3a13635e2d594fb0bd31ac4039d4d2e0 P e4f6eab2337842428ba2670421465839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.785709  1547 ts_tablet_manager.cc:1434] T 3a13635e2d594fb0bd31ac4039d4d2e0 P e4f6eab2337842428ba2670421465839: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.005s
I20260709 13:14:24.786785  1547 tablet_bootstrap.cc:492] T f67b7f39bd9042a0bd72e32fbc31391d P e4f6eab2337842428ba2670421465839: Bootstrap starting.
I20260709 13:14:24.786590  1258 raft_consensus.cc:2468] T fc60f59313bc4507bdf418cf4654ee3b P e4f6eab2337842428ba2670421465839 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40837fdefb66404b93c3e3876da432f7 in term 1.
I20260709 13:14:24.788550  1371 leader_election.cc:304] T fc60f59313bc4507bdf418cf4654ee3b P 40837fdefb66404b93c3e3876da432f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40837fdefb66404b93c3e3876da432f7, e4f6eab2337842428ba2670421465839; no voters: 
I20260709 13:14:24.790135  1561 raft_consensus.cc:515] T d214f889325043f2a8a06bb04a45783c P 40837fdefb66404b93c3e3876da432f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.792399  1548 tablet_bootstrap.cc:492] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 40837fdefb66404b93c3e3876da432f7: Bootstrap starting.
I20260709 13:14:24.793964  1547 tablet_bootstrap.cc:654] T f67b7f39bd9042a0bd72e32fbc31391d P e4f6eab2337842428ba2670421465839: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:24.798574  1534 leader_election.cc:290] T fc60f59313bc4507bdf418cf4654ee3b P 40837fdefb66404b93c3e3876da432f7 [CANDIDATE]: Term 1 election: Requested vote from peers e4f6eab2337842428ba2670421465839 (127.23.140.65:45009), 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66:38395)
I20260709 13:14:24.799948  1331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d214f889325043f2a8a06bb04a45783c" candidate_uuid: "40837fdefb66404b93c3e3876da432f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bf9692a81414cfab64ee45b5393d57e"
I20260709 13:14:24.800127  1569 raft_consensus.cc:493] T 3a13635e2d594fb0bd31ac4039d4d2e0 P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:24.806190  1569 raft_consensus.cc:515] T 3a13635e2d594fb0bd31ac4039d4d2e0 P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
W20260709 13:14:24.807062  1370 leader_election.cc:343] T d214f889325043f2a8a06bb04a45783c P 40837fdefb66404b93c3e3876da432f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66:38395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:24.806111  1534 raft_consensus.cc:2804] T fc60f59313bc4507bdf418cf4654ee3b P 40837fdefb66404b93c3e3876da432f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:24.808473  1569 leader_election.cc:290] T 3a13635e2d594fb0bd31ac4039d4d2e0 P e4f6eab2337842428ba2670421465839 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66:38395), 40837fdefb66404b93c3e3876da432f7 (127.23.140.67:43689)
I20260709 13:14:24.808570  1534 raft_consensus.cc:697] T fc60f59313bc4507bdf418cf4654ee3b P 40837fdefb66404b93c3e3876da432f7 [term 1 LEADER]: Becoming Leader. State: Replica: 40837fdefb66404b93c3e3876da432f7, State: Running, Role: LEADER
I20260709 13:14:24.802610  1546 tablet_bootstrap.cc:492] T d214f889325043f2a8a06bb04a45783c P 0bf9692a81414cfab64ee45b5393d57e: No bootstrap required, opened a new log
I20260709 13:14:24.809986  1546 ts_tablet_manager.cc:1403] T d214f889325043f2a8a06bb04a45783c P 0bf9692a81414cfab64ee45b5393d57e: Time spent bootstrapping tablet: real 0.224s	user 0.079s	sys 0.109s
I20260709 13:14:24.810086  1407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a13635e2d594fb0bd31ac4039d4d2e0" candidate_uuid: "e4f6eab2337842428ba2670421465839" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40837fdefb66404b93c3e3876da432f7" is_pre_election: true
I20260709 13:14:24.811551  1331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a13635e2d594fb0bd31ac4039d4d2e0" candidate_uuid: "e4f6eab2337842428ba2670421465839" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bf9692a81414cfab64ee45b5393d57e" is_pre_election: true
I20260709 13:14:24.812548  1546 raft_consensus.cc:359] T d214f889325043f2a8a06bb04a45783c P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
W20260709 13:14:24.813086  1224 leader_election.cc:343] T 3a13635e2d594fb0bd31ac4039d4d2e0 P e4f6eab2337842428ba2670421465839 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40837fdefb66404b93c3e3876da432f7 (127.23.140.67:43689): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:24.813210  1329 raft_consensus.cc:2468] T fc60f59313bc4507bdf418cf4654ee3b P 0bf9692a81414cfab64ee45b5393d57e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40837fdefb66404b93c3e3876da432f7 in term 1.
W20260709 13:14:24.814060  1221 leader_election.cc:343] T 3a13635e2d594fb0bd31ac4039d4d2e0 P e4f6eab2337842428ba2670421465839 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66:38395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:24.814628  1221 leader_election.cc:304] T 3a13635e2d594fb0bd31ac4039d4d2e0 P e4f6eab2337842428ba2670421465839 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4f6eab2337842428ba2670421465839; no voters: 0bf9692a81414cfab64ee45b5393d57e, 40837fdefb66404b93c3e3876da432f7
I20260709 13:14:24.809507  1534 consensus_queue.cc:237] T fc60f59313bc4507bdf418cf4654ee3b P 40837fdefb66404b93c3e3876da432f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.804072  1561 leader_election.cc:290] T d214f889325043f2a8a06bb04a45783c P 40837fdefb66404b93c3e3876da432f7 [CANDIDATE]: Term 1 election: Requested vote from peers e4f6eab2337842428ba2670421465839 (127.23.140.65:45009), 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66:38395)
I20260709 13:14:24.803519  1548 tablet_bootstrap.cc:654] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 40837fdefb66404b93c3e3876da432f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:24.817237  1258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d214f889325043f2a8a06bb04a45783c" candidate_uuid: "40837fdefb66404b93c3e3876da432f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f6eab2337842428ba2670421465839"
I20260709 13:14:24.817862  1258 raft_consensus.cc:3060] T d214f889325043f2a8a06bb04a45783c P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:24.818020  1547 tablet_bootstrap.cc:492] T f67b7f39bd9042a0bd72e32fbc31391d P e4f6eab2337842428ba2670421465839: No bootstrap required, opened a new log
I20260709 13:14:24.818554  1547 ts_tablet_manager.cc:1403] T f67b7f39bd9042a0bd72e32fbc31391d P e4f6eab2337842428ba2670421465839: Time spent bootstrapping tablet: real 0.032s	user 0.007s	sys 0.010s
I20260709 13:14:24.818845  1573 raft_consensus.cc:2749] T 3a13635e2d594fb0bd31ac4039d4d2e0 P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:24.813319  1546 raft_consensus.cc:385] T d214f889325043f2a8a06bb04a45783c P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:24.819674  1546 raft_consensus.cc:740] T d214f889325043f2a8a06bb04a45783c P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bf9692a81414cfab64ee45b5393d57e, State: Initialized, Role: FOLLOWER
I20260709 13:14:24.820935  1546 consensus_queue.cc:260] T d214f889325043f2a8a06bb04a45783c P 0bf9692a81414cfab64ee45b5393d57e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.821460  1547 raft_consensus.cc:359] T f67b7f39bd9042a0bd72e32fbc31391d P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.822139  1547 raft_consensus.cc:385] T f67b7f39bd9042a0bd72e32fbc31391d P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:24.822394  1547 raft_consensus.cc:740] T f67b7f39bd9042a0bd72e32fbc31391d P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4f6eab2337842428ba2670421465839, State: Initialized, Role: FOLLOWER
I20260709 13:14:24.823307  1546 ts_tablet_manager.cc:1434] T d214f889325043f2a8a06bb04a45783c P 0bf9692a81414cfab64ee45b5393d57e: Time spent starting tablet: real 0.013s	user 0.001s	sys 0.005s
I20260709 13:14:24.823031  1547 consensus_queue.cc:260] T f67b7f39bd9042a0bd72e32fbc31391d P e4f6eab2337842428ba2670421465839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.825567  1547 ts_tablet_manager.cc:1434] T f67b7f39bd9042a0bd72e32fbc31391d P e4f6eab2337842428ba2670421465839: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:14:24.826155  1494 raft_consensus.cc:2749] T aa6cc96673d4456da12d920cea7aa471 P e4f6eab2337842428ba2670421465839 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:24.826704  1547 tablet_bootstrap.cc:492] T f7e4806e46494317a05058762da8a72e P e4f6eab2337842428ba2670421465839: Bootstrap starting.
I20260709 13:14:24.831333  1258 raft_consensus.cc:2468] T d214f889325043f2a8a06bb04a45783c P e4f6eab2337842428ba2670421465839 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40837fdefb66404b93c3e3876da432f7 in term 1.
I20260709 13:14:24.832604  1371 leader_election.cc:304] T d214f889325043f2a8a06bb04a45783c P 40837fdefb66404b93c3e3876da432f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40837fdefb66404b93c3e3876da432f7, e4f6eab2337842428ba2670421465839; no voters: 0bf9692a81414cfab64ee45b5393d57e
I20260709 13:14:24.833279  1546 tablet_bootstrap.cc:492] T 02592ff6032f4ca6855608f5508444f6 P 0bf9692a81414cfab64ee45b5393d57e: Bootstrap starting.
I20260709 13:14:24.833500  1561 raft_consensus.cc:2804] T d214f889325043f2a8a06bb04a45783c P 40837fdefb66404b93c3e3876da432f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:24.834903  1561 raft_consensus.cc:697] T d214f889325043f2a8a06bb04a45783c P 40837fdefb66404b93c3e3876da432f7 [term 1 LEADER]: Becoming Leader. State: Replica: 40837fdefb66404b93c3e3876da432f7, State: Running, Role: LEADER
I20260709 13:14:24.835775  1561 consensus_queue.cc:237] T d214f889325043f2a8a06bb04a45783c P 40837fdefb66404b93c3e3876da432f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.833711  1547 tablet_bootstrap.cc:654] T f7e4806e46494317a05058762da8a72e P e4f6eab2337842428ba2670421465839: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:24.843855  1548 tablet_bootstrap.cc:492] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 40837fdefb66404b93c3e3876da432f7: No bootstrap required, opened a new log
I20260709 13:14:24.844365  1548 ts_tablet_manager.cc:1403] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 40837fdefb66404b93c3e3876da432f7: Time spent bootstrapping tablet: real 0.052s	user 0.009s	sys 0.007s
I20260709 13:14:24.846529  1547 tablet_bootstrap.cc:492] T f7e4806e46494317a05058762da8a72e P e4f6eab2337842428ba2670421465839: No bootstrap required, opened a new log
I20260709 13:14:24.847084  1547 ts_tablet_manager.cc:1403] T f7e4806e46494317a05058762da8a72e P e4f6eab2337842428ba2670421465839: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.004s
I20260709 13:14:24.847203  1494 raft_consensus.cc:493] T 500933c30a944235930b2ae50569922a P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:24.847064  1548 raft_consensus.cc:359] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.848035  1548 raft_consensus.cc:385] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:24.848042  1494 raft_consensus.cc:515] T 500933c30a944235930b2ae50569922a P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.848558  1548 raft_consensus.cc:740] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40837fdefb66404b93c3e3876da432f7, State: Initialized, Role: FOLLOWER
I20260709 13:14:24.849283  1534 raft_consensus.cc:493] T f7e4806e46494317a05058762da8a72e P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:24.849313  1548 consensus_queue.cc:260] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 40837fdefb66404b93c3e3876da432f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.851253  1534 raft_consensus.cc:515] T f7e4806e46494317a05058762da8a72e P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.851748  1329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "500933c30a944235930b2ae50569922a" candidate_uuid: "e4f6eab2337842428ba2670421465839" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bf9692a81414cfab64ee45b5393d57e" is_pre_election: true
I20260709 13:14:24.852397  1329 raft_consensus.cc:2468] T 500933c30a944235930b2ae50569922a P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4f6eab2337842428ba2670421465839 in term 0.
I20260709 13:14:24.852658  1548 ts_tablet_manager.cc:1434] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 40837fdefb66404b93c3e3876da432f7: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:14:24.853426  1407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "500933c30a944235930b2ae50569922a" candidate_uuid: "e4f6eab2337842428ba2670421465839" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40837fdefb66404b93c3e3876da432f7" is_pre_election: true
I20260709 13:14:24.853710  1548 tablet_bootstrap.cc:492] T f67b7f39bd9042a0bd72e32fbc31391d P 40837fdefb66404b93c3e3876da432f7: Bootstrap starting.
I20260709 13:14:24.853626  1221 leader_election.cc:304] T 500933c30a944235930b2ae50569922a P e4f6eab2337842428ba2670421465839 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bf9692a81414cfab64ee45b5393d57e, e4f6eab2337842428ba2670421465839; no voters: 
I20260709 13:14:24.854050  1494 leader_election.cc:290] T 500933c30a944235930b2ae50569922a P e4f6eab2337842428ba2670421465839 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66:38395), 40837fdefb66404b93c3e3876da432f7 (127.23.140.67:43689)
I20260709 13:14:24.854550  1573 raft_consensus.cc:2804] T 500933c30a944235930b2ae50569922a P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:24.854750  1407 raft_consensus.cc:2468] T 500933c30a944235930b2ae50569922a P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4f6eab2337842428ba2670421465839 in term 0.
I20260709 13:14:24.854923  1573 raft_consensus.cc:493] T 500933c30a944235930b2ae50569922a P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:24.854977  1534 leader_election.cc:290] T f7e4806e46494317a05058762da8a72e P 40837fdefb66404b93c3e3876da432f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4f6eab2337842428ba2670421465839 (127.23.140.65:45009), 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66:38395)
I20260709 13:14:24.855396  1573 raft_consensus.cc:3060] T 500933c30a944235930b2ae50569922a P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:24.855785  1329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7e4806e46494317a05058762da8a72e" candidate_uuid: "40837fdefb66404b93c3e3876da432f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bf9692a81414cfab64ee45b5393d57e" is_pre_election: true
I20260709 13:14:24.855829  1258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7e4806e46494317a05058762da8a72e" candidate_uuid: "40837fdefb66404b93c3e3876da432f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f6eab2337842428ba2670421465839" is_pre_election: true
W20260709 13:14:24.857156  1370 leader_election.cc:343] T f7e4806e46494317a05058762da8a72e P 40837fdefb66404b93c3e3876da432f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66:38395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:24.858707  1155 catalog_manager.cc:5697] T fc60f59313bc4507bdf418cf4654ee3b P 40837fdefb66404b93c3e3876da432f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40837fdefb66404b93c3e3876da432f7 (127.23.140.67). New cstate: current_term: 1 leader_uuid: "40837fdefb66404b93c3e3876da432f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:24.850291  1546 tablet_bootstrap.cc:654] T 02592ff6032f4ca6855608f5508444f6 P 0bf9692a81414cfab64ee45b5393d57e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:24.860391  1155 catalog_manager.cc:5697] T d214f889325043f2a8a06bb04a45783c P 40837fdefb66404b93c3e3876da432f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40837fdefb66404b93c3e3876da432f7 (127.23.140.67). New cstate: current_term: 1 leader_uuid: "40837fdefb66404b93c3e3876da432f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:24.850407  1547 raft_consensus.cc:359] T f7e4806e46494317a05058762da8a72e P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.862013  1547 raft_consensus.cc:385] T f7e4806e46494317a05058762da8a72e P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:24.862366  1547 raft_consensus.cc:740] T f7e4806e46494317a05058762da8a72e P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4f6eab2337842428ba2670421465839, State: Initialized, Role: FOLLOWER
I20260709 13:14:24.863052  1573 raft_consensus.cc:515] T 500933c30a944235930b2ae50569922a P e4f6eab2337842428ba2670421465839 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.865025  1573 leader_election.cc:290] T 500933c30a944235930b2ae50569922a P e4f6eab2337842428ba2670421465839 [CANDIDATE]: Term 1 election: Requested vote from peers 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66:38395), 40837fdefb66404b93c3e3876da432f7 (127.23.140.67:43689)
I20260709 13:14:24.866565  1547 consensus_queue.cc:260] T f7e4806e46494317a05058762da8a72e P e4f6eab2337842428ba2670421465839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.866911  1329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "500933c30a944235930b2ae50569922a" candidate_uuid: "e4f6eab2337842428ba2670421465839" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bf9692a81414cfab64ee45b5393d57e"
I20260709 13:14:24.867523  1329 raft_consensus.cc:3060] T 500933c30a944235930b2ae50569922a P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:24.868448  1546 tablet_bootstrap.cc:492] T 02592ff6032f4ca6855608f5508444f6 P 0bf9692a81414cfab64ee45b5393d57e: No bootstrap required, opened a new log
I20260709 13:14:24.869009  1546 ts_tablet_manager.cc:1403] T 02592ff6032f4ca6855608f5508444f6 P 0bf9692a81414cfab64ee45b5393d57e: Time spent bootstrapping tablet: real 0.036s	user 0.008s	sys 0.004s
I20260709 13:14:24.871464  1548 tablet_bootstrap.cc:654] T f67b7f39bd9042a0bd72e32fbc31391d P 40837fdefb66404b93c3e3876da432f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:24.876673  1546 raft_consensus.cc:359] T 02592ff6032f4ca6855608f5508444f6 P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.877413  1546 raft_consensus.cc:385] T 02592ff6032f4ca6855608f5508444f6 P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:24.877739  1546 raft_consensus.cc:740] T 02592ff6032f4ca6855608f5508444f6 P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bf9692a81414cfab64ee45b5393d57e, State: Initialized, Role: FOLLOWER
I20260709 13:14:24.878535  1546 consensus_queue.cc:260] T 02592ff6032f4ca6855608f5508444f6 P 0bf9692a81414cfab64ee45b5393d57e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.867537  1258 raft_consensus.cc:2468] T f7e4806e46494317a05058762da8a72e P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40837fdefb66404b93c3e3876da432f7 in term 0.
I20260709 13:14:24.881054  1546 ts_tablet_manager.cc:1434] T 02592ff6032f4ca6855608f5508444f6 P 0bf9692a81414cfab64ee45b5393d57e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:14:24.881453  1371 leader_election.cc:304] T f7e4806e46494317a05058762da8a72e P 40837fdefb66404b93c3e3876da432f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40837fdefb66404b93c3e3876da432f7, e4f6eab2337842428ba2670421465839; no voters: 0bf9692a81414cfab64ee45b5393d57e
I20260709 13:14:24.882252  1407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "500933c30a944235930b2ae50569922a" candidate_uuid: "e4f6eab2337842428ba2670421465839" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40837fdefb66404b93c3e3876da432f7"
I20260709 13:14:24.882766  1534 raft_consensus.cc:2804] T f7e4806e46494317a05058762da8a72e P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:24.883050  1407 raft_consensus.cc:3060] T 500933c30a944235930b2ae50569922a P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:24.883224  1534 raft_consensus.cc:493] T f7e4806e46494317a05058762da8a72e P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:24.883697  1534 raft_consensus.cc:3060] T f7e4806e46494317a05058762da8a72e P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:24.884843  1547 ts_tablet_manager.cc:1434] T f7e4806e46494317a05058762da8a72e P e4f6eab2337842428ba2670421465839: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.000s
I20260709 13:14:24.888502  1329 raft_consensus.cc:2468] T 500933c30a944235930b2ae50569922a P 0bf9692a81414cfab64ee45b5393d57e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4f6eab2337842428ba2670421465839 in term 1.
I20260709 13:14:24.889878  1221 leader_election.cc:304] T 500933c30a944235930b2ae50569922a P e4f6eab2337842428ba2670421465839 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bf9692a81414cfab64ee45b5393d57e, e4f6eab2337842428ba2670421465839; no voters: 
I20260709 13:14:24.890897  1475 raft_consensus.cc:493] T d214f889325043f2a8a06bb04a45783c P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:24.891278  1546 tablet_bootstrap.cc:492] T eeda95d1ada94d01aab3427f00d32570 P 0bf9692a81414cfab64ee45b5393d57e: Bootstrap starting.
I20260709 13:14:24.891631  1494 raft_consensus.cc:2804] T 500933c30a944235930b2ae50569922a P e4f6eab2337842428ba2670421465839 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:24.891417  1534 raft_consensus.cc:515] T f7e4806e46494317a05058762da8a72e P 40837fdefb66404b93c3e3876da432f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.892168  1494 raft_consensus.cc:697] T 500933c30a944235930b2ae50569922a P e4f6eab2337842428ba2670421465839 [term 1 LEADER]: Becoming Leader. State: Replica: e4f6eab2337842428ba2670421465839, State: Running, Role: LEADER
I20260709 13:14:24.893074  1494 consensus_queue.cc:237] T 500933c30a944235930b2ae50569922a P e4f6eab2337842428ba2670421465839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.895659  1534 leader_election.cc:290] T f7e4806e46494317a05058762da8a72e P 40837fdefb66404b93c3e3876da432f7 [CANDIDATE]: Term 1 election: Requested vote from peers e4f6eab2337842428ba2670421465839 (127.23.140.65:45009), 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66:38395)
I20260709 13:14:24.896355  1331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7e4806e46494317a05058762da8a72e" candidate_uuid: "40837fdefb66404b93c3e3876da432f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bf9692a81414cfab64ee45b5393d57e"
I20260709 13:14:24.896875  1258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7e4806e46494317a05058762da8a72e" candidate_uuid: "40837fdefb66404b93c3e3876da432f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f6eab2337842428ba2670421465839"
I20260709 13:14:24.891465  1475 raft_consensus.cc:515] T d214f889325043f2a8a06bb04a45783c P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.897495  1258 raft_consensus.cc:3060] T f7e4806e46494317a05058762da8a72e P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:24.898667  1546 tablet_bootstrap.cc:654] T eeda95d1ada94d01aab3427f00d32570 P 0bf9692a81414cfab64ee45b5393d57e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:24.899716  1475 leader_election.cc:290] T d214f889325043f2a8a06bb04a45783c P 0bf9692a81414cfab64ee45b5393d57e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4f6eab2337842428ba2670421465839 (127.23.140.65:45009), 40837fdefb66404b93c3e3876da432f7 (127.23.140.67:43689)
I20260709 13:14:24.900764  1257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d214f889325043f2a8a06bb04a45783c" candidate_uuid: "0bf9692a81414cfab64ee45b5393d57e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f6eab2337842428ba2670421465839" is_pre_election: true
I20260709 13:14:24.901520  1257 raft_consensus.cc:2393] T d214f889325043f2a8a06bb04a45783c P e4f6eab2337842428ba2670421465839 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0bf9692a81414cfab64ee45b5393d57e in current term 1: Already voted for candidate 40837fdefb66404b93c3e3876da432f7 in this term.
I20260709 13:14:24.902456  1406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d214f889325043f2a8a06bb04a45783c" candidate_uuid: "0bf9692a81414cfab64ee45b5393d57e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40837fdefb66404b93c3e3876da432f7" is_pre_election: true
W20260709 13:14:24.903620  1370 leader_election.cc:343] T f7e4806e46494317a05058762da8a72e P 40837fdefb66404b93c3e3876da432f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66:38395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:24.905799  1297 leader_election.cc:304] T d214f889325043f2a8a06bb04a45783c P 0bf9692a81414cfab64ee45b5393d57e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0bf9692a81414cfab64ee45b5393d57e; no voters: 40837fdefb66404b93c3e3876da432f7, e4f6eab2337842428ba2670421465839
I20260709 13:14:24.906298  1258 raft_consensus.cc:2468] T f7e4806e46494317a05058762da8a72e P e4f6eab2337842428ba2670421465839 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40837fdefb66404b93c3e3876da432f7 in term 1.
I20260709 13:14:24.907114  1475 raft_consensus.cc:3060] T d214f889325043f2a8a06bb04a45783c P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:24.907450  1371 leader_election.cc:304] T f7e4806e46494317a05058762da8a72e P 40837fdefb66404b93c3e3876da432f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40837fdefb66404b93c3e3876da432f7, e4f6eab2337842428ba2670421465839; no voters: 0bf9692a81414cfab64ee45b5393d57e
I20260709 13:14:24.908802  1534 raft_consensus.cc:2804] T f7e4806e46494317a05058762da8a72e P 40837fdefb66404b93c3e3876da432f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:24.909317  1534 raft_consensus.cc:697] T f7e4806e46494317a05058762da8a72e P 40837fdefb66404b93c3e3876da432f7 [term 1 LEADER]: Becoming Leader. State: Replica: 40837fdefb66404b93c3e3876da432f7, State: Running, Role: LEADER
I20260709 13:14:24.910163  1534 consensus_queue.cc:237] T f7e4806e46494317a05058762da8a72e P 40837fdefb66404b93c3e3876da432f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.918725  1475 raft_consensus.cc:2749] T d214f889325043f2a8a06bb04a45783c P 0bf9692a81414cfab64ee45b5393d57e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:24.922251  1546 tablet_bootstrap.cc:492] T eeda95d1ada94d01aab3427f00d32570 P 0bf9692a81414cfab64ee45b5393d57e: No bootstrap required, opened a new log
I20260709 13:14:24.922756  1546 ts_tablet_manager.cc:1403] T eeda95d1ada94d01aab3427f00d32570 P 0bf9692a81414cfab64ee45b5393d57e: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.009s
I20260709 13:14:24.925736  1407 raft_consensus.cc:2468] T 500933c30a944235930b2ae50569922a P 40837fdefb66404b93c3e3876da432f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4f6eab2337842428ba2670421465839 in term 1.
I20260709 13:14:24.925942  1546 raft_consensus.cc:359] T eeda95d1ada94d01aab3427f00d32570 P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.928666  1546 raft_consensus.cc:385] T eeda95d1ada94d01aab3427f00d32570 P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:24.928923  1573 raft_consensus.cc:493] T 02592ff6032f4ca6855608f5508444f6 P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:24.928985  1546 raft_consensus.cc:740] T eeda95d1ada94d01aab3427f00d32570 P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bf9692a81414cfab64ee45b5393d57e, State: Initialized, Role: FOLLOWER
I20260709 13:14:24.929464  1573 raft_consensus.cc:515] T 02592ff6032f4ca6855608f5508444f6 P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.930223  1546 consensus_queue.cc:260] T eeda95d1ada94d01aab3427f00d32570 P 0bf9692a81414cfab64ee45b5393d57e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.931741  1573 leader_election.cc:290] T 02592ff6032f4ca6855608f5508444f6 P e4f6eab2337842428ba2670421465839 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66:38395), 40837fdefb66404b93c3e3876da432f7 (127.23.140.67:43689)
I20260709 13:14:24.933032  1546 ts_tablet_manager.cc:1434] T eeda95d1ada94d01aab3427f00d32570 P 0bf9692a81414cfab64ee45b5393d57e: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.005s
I20260709 13:14:24.933514  1407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02592ff6032f4ca6855608f5508444f6" candidate_uuid: "e4f6eab2337842428ba2670421465839" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40837fdefb66404b93c3e3876da432f7" is_pre_election: true
I20260709 13:14:24.934140  1407 raft_consensus.cc:2468] T 02592ff6032f4ca6855608f5508444f6 P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4f6eab2337842428ba2670421465839 in term 0.
I20260709 13:14:24.934195  1546 tablet_bootstrap.cc:492] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 0bf9692a81414cfab64ee45b5393d57e: Bootstrap starting.
I20260709 13:14:24.934548  1329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02592ff6032f4ca6855608f5508444f6" candidate_uuid: "e4f6eab2337842428ba2670421465839" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bf9692a81414cfab64ee45b5393d57e" is_pre_election: true
I20260709 13:14:24.935267  1329 raft_consensus.cc:2468] T 02592ff6032f4ca6855608f5508444f6 P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4f6eab2337842428ba2670421465839 in term 0.
I20260709 13:14:24.936269  1548 tablet_bootstrap.cc:492] T f67b7f39bd9042a0bd72e32fbc31391d P 40837fdefb66404b93c3e3876da432f7: No bootstrap required, opened a new log
I20260709 13:14:24.936808  1548 ts_tablet_manager.cc:1403] T f67b7f39bd9042a0bd72e32fbc31391d P 40837fdefb66404b93c3e3876da432f7: Time spent bootstrapping tablet: real 0.083s	user 0.013s	sys 0.017s
I20260709 13:14:24.937455  1221 leader_election.cc:304] T 02592ff6032f4ca6855608f5508444f6 P e4f6eab2337842428ba2670421465839 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bf9692a81414cfab64ee45b5393d57e, e4f6eab2337842428ba2670421465839; no voters: 
I20260709 13:14:24.939499  1548 raft_consensus.cc:359] T f67b7f39bd9042a0bd72e32fbc31391d P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.940223  1548 raft_consensus.cc:385] T f67b7f39bd9042a0bd72e32fbc31391d P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:24.940490  1548 raft_consensus.cc:740] T f67b7f39bd9042a0bd72e32fbc31391d P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40837fdefb66404b93c3e3876da432f7, State: Initialized, Role: FOLLOWER
I20260709 13:14:24.941478  1546 tablet_bootstrap.cc:654] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 0bf9692a81414cfab64ee45b5393d57e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:24.941154  1548 consensus_queue.cc:260] T f67b7f39bd9042a0bd72e32fbc31391d P 40837fdefb66404b93c3e3876da432f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.942118  1534 raft_consensus.cc:493] T eeda95d1ada94d01aab3427f00d32570 P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:24.942603  1534 raft_consensus.cc:515] T eeda95d1ada94d01aab3427f00d32570 P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.943908  1548 ts_tablet_manager.cc:1434] T f67b7f39bd9042a0bd72e32fbc31391d P 40837fdefb66404b93c3e3876da432f7: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:14:24.944608  1534 leader_election.cc:290] T eeda95d1ada94d01aab3427f00d32570 P 40837fdefb66404b93c3e3876da432f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4f6eab2337842428ba2670421465839 (127.23.140.65:45009), 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66:38395)
I20260709 13:14:24.945269  1258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda95d1ada94d01aab3427f00d32570" candidate_uuid: "40837fdefb66404b93c3e3876da432f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f6eab2337842428ba2670421465839" is_pre_election: true
I20260709 13:14:24.946028  1258 raft_consensus.cc:2468] T eeda95d1ada94d01aab3427f00d32570 P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40837fdefb66404b93c3e3876da432f7 in term 0.
I20260709 13:14:24.947198  1329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda95d1ada94d01aab3427f00d32570" candidate_uuid: "40837fdefb66404b93c3e3876da432f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bf9692a81414cfab64ee45b5393d57e" is_pre_election: true
I20260709 13:14:24.947779  1329 raft_consensus.cc:2468] T eeda95d1ada94d01aab3427f00d32570 P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40837fdefb66404b93c3e3876da432f7 in term 0.
I20260709 13:14:24.947556  1371 leader_election.cc:304] T eeda95d1ada94d01aab3427f00d32570 P 40837fdefb66404b93c3e3876da432f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40837fdefb66404b93c3e3876da432f7, e4f6eab2337842428ba2670421465839; no voters: 
I20260709 13:14:24.948814  1534 raft_consensus.cc:2804] T eeda95d1ada94d01aab3427f00d32570 P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:24.949298  1534 raft_consensus.cc:493] T eeda95d1ada94d01aab3427f00d32570 P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:24.949728  1534 raft_consensus.cc:3060] T eeda95d1ada94d01aab3427f00d32570 P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:24.951153  1154 catalog_manager.cc:5697] T f7e4806e46494317a05058762da8a72e P 40837fdefb66404b93c3e3876da432f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40837fdefb66404b93c3e3876da432f7 (127.23.140.67). New cstate: current_term: 1 leader_uuid: "40837fdefb66404b93c3e3876da432f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:24.957954  1156 catalog_manager.cc:5697] T 500933c30a944235930b2ae50569922a P e4f6eab2337842428ba2670421465839 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4f6eab2337842428ba2670421465839 (127.23.140.65). New cstate: current_term: 1 leader_uuid: "e4f6eab2337842428ba2670421465839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:24.961040  1534 raft_consensus.cc:515] T eeda95d1ada94d01aab3427f00d32570 P 40837fdefb66404b93c3e3876da432f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.962536  1573 raft_consensus.cc:2804] T 02592ff6032f4ca6855608f5508444f6 P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:24.962975  1573 raft_consensus.cc:493] T 02592ff6032f4ca6855608f5508444f6 P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:24.963290  1573 raft_consensus.cc:3060] T 02592ff6032f4ca6855608f5508444f6 P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:24.964574  1534 leader_election.cc:290] T eeda95d1ada94d01aab3427f00d32570 P 40837fdefb66404b93c3e3876da432f7 [CANDIDATE]: Term 1 election: Requested vote from peers e4f6eab2337842428ba2670421465839 (127.23.140.65:45009), 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66:38395)
I20260709 13:14:24.964605  1258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda95d1ada94d01aab3427f00d32570" candidate_uuid: "40837fdefb66404b93c3e3876da432f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f6eab2337842428ba2670421465839"
I20260709 13:14:24.965509  1258 raft_consensus.cc:3060] T eeda95d1ada94d01aab3427f00d32570 P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:24.967108  1329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda95d1ada94d01aab3427f00d32570" candidate_uuid: "40837fdefb66404b93c3e3876da432f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bf9692a81414cfab64ee45b5393d57e"
I20260709 13:14:24.967730  1329 raft_consensus.cc:3060] T eeda95d1ada94d01aab3427f00d32570 P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:24.972350  1258 raft_consensus.cc:2468] T eeda95d1ada94d01aab3427f00d32570 P e4f6eab2337842428ba2670421465839 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40837fdefb66404b93c3e3876da432f7 in term 1.
I20260709 13:14:24.973593  1371 leader_election.cc:304] T eeda95d1ada94d01aab3427f00d32570 P 40837fdefb66404b93c3e3876da432f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40837fdefb66404b93c3e3876da432f7, e4f6eab2337842428ba2670421465839; no voters: 
I20260709 13:14:24.974419  1561 raft_consensus.cc:2804] T eeda95d1ada94d01aab3427f00d32570 P 40837fdefb66404b93c3e3876da432f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:24.974913  1561 raft_consensus.cc:697] T eeda95d1ada94d01aab3427f00d32570 P 40837fdefb66404b93c3e3876da432f7 [term 1 LEADER]: Becoming Leader. State: Replica: 40837fdefb66404b93c3e3876da432f7, State: Running, Role: LEADER
I20260709 13:14:24.975720  1561 consensus_queue.cc:237] T eeda95d1ada94d01aab3427f00d32570 P 40837fdefb66404b93c3e3876da432f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.980705  1573 raft_consensus.cc:515] T 02592ff6032f4ca6855608f5508444f6 P e4f6eab2337842428ba2670421465839 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.982661  1329 raft_consensus.cc:2468] T eeda95d1ada94d01aab3427f00d32570 P 0bf9692a81414cfab64ee45b5393d57e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40837fdefb66404b93c3e3876da432f7 in term 1.
I20260709 13:14:24.983963  1573 leader_election.cc:290] T 02592ff6032f4ca6855608f5508444f6 P e4f6eab2337842428ba2670421465839 [CANDIDATE]: Term 1 election: Requested vote from peers 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66:38395), 40837fdefb66404b93c3e3876da432f7 (127.23.140.67:43689)
I20260709 13:14:24.984663  1331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02592ff6032f4ca6855608f5508444f6" candidate_uuid: "e4f6eab2337842428ba2670421465839" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bf9692a81414cfab64ee45b5393d57e"
I20260709 13:14:24.985353  1331 raft_consensus.cc:3060] T 02592ff6032f4ca6855608f5508444f6 P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:24.985874  1407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02592ff6032f4ca6855608f5508444f6" candidate_uuid: "e4f6eab2337842428ba2670421465839" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40837fdefb66404b93c3e3876da432f7"
I20260709 13:14:24.986446  1407 raft_consensus.cc:3060] T 02592ff6032f4ca6855608f5508444f6 P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:24.987519  1546 tablet_bootstrap.cc:492] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 0bf9692a81414cfab64ee45b5393d57e: No bootstrap required, opened a new log
I20260709 13:14:24.988090  1546 ts_tablet_manager.cc:1403] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 0bf9692a81414cfab64ee45b5393d57e: Time spent bootstrapping tablet: real 0.054s	user 0.008s	sys 0.043s
I20260709 13:14:24.988523  1571 raft_consensus.cc:493] T f67b7f39bd9042a0bd72e32fbc31391d P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:24.989015  1571 raft_consensus.cc:515] T f67b7f39bd9042a0bd72e32fbc31391d P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.991359  1571 leader_election.cc:290] T f67b7f39bd9042a0bd72e32fbc31391d P 40837fdefb66404b93c3e3876da432f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4f6eab2337842428ba2670421465839 (127.23.140.65:45009), 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66:38395)
I20260709 13:14:24.991912  1571 raft_consensus.cc:493] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:24.992460  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f67b7f39bd9042a0bd72e32fbc31391d" candidate_uuid: "40837fdefb66404b93c3e3876da432f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bf9692a81414cfab64ee45b5393d57e" is_pre_election: true
I20260709 13:14:24.992405  1571 raft_consensus.cc:515] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:24.994756  1571 leader_election.cc:290] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 40837fdefb66404b93c3e3876da432f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4f6eab2337842428ba2670421465839 (127.23.140.65:45009), 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66:38395)
I20260709 13:14:24.995419  1257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a13635e2d594fb0bd31ac4039d4d2e0" candidate_uuid: "40837fdefb66404b93c3e3876da432f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f6eab2337842428ba2670421465839" is_pre_election: true
I20260709 13:14:24.995865  1333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a13635e2d594fb0bd31ac4039d4d2e0" candidate_uuid: "40837fdefb66404b93c3e3876da432f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bf9692a81414cfab64ee45b5393d57e" is_pre_election: true
I20260709 13:14:24.996114  1257 raft_consensus.cc:2468] T 3a13635e2d594fb0bd31ac4039d4d2e0 P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40837fdefb66404b93c3e3876da432f7 in term 0.
I20260709 13:14:24.997394  1371 leader_election.cc:304] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 40837fdefb66404b93c3e3876da432f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40837fdefb66404b93c3e3876da432f7, e4f6eab2337842428ba2670421465839; no voters: 
I20260709 13:14:24.997857  1331 raft_consensus.cc:2468] T 02592ff6032f4ca6855608f5508444f6 P 0bf9692a81414cfab64ee45b5393d57e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4f6eab2337842428ba2670421465839 in term 1.
I20260709 13:14:24.998462  1258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f67b7f39bd9042a0bd72e32fbc31391d" candidate_uuid: "40837fdefb66404b93c3e3876da432f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f6eab2337842428ba2670421465839" is_pre_election: true
I20260709 13:14:24.999164  1221 leader_election.cc:304] T 02592ff6032f4ca6855608f5508444f6 P e4f6eab2337842428ba2670421465839 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bf9692a81414cfab64ee45b5393d57e, e4f6eab2337842428ba2670421465839; no voters: 
I20260709 13:14:24.999519  1258 raft_consensus.cc:2468] T f67b7f39bd9042a0bd72e32fbc31391d P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40837fdefb66404b93c3e3876da432f7 in term 0.
I20260709 13:14:24.999061  1546 raft_consensus.cc:359] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:25.000453  1546 raft_consensus.cc:385] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:25.000617  1371 leader_election.cc:304] T f67b7f39bd9042a0bd72e32fbc31391d P 40837fdefb66404b93c3e3876da432f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40837fdefb66404b93c3e3876da432f7, e4f6eab2337842428ba2670421465839; no voters: 
I20260709 13:14:25.001511  1571 raft_consensus.cc:2804] T f67b7f39bd9042a0bd72e32fbc31391d P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:25.001950  1571 raft_consensus.cc:493] T f67b7f39bd9042a0bd72e32fbc31391d P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:25.002310  1571 raft_consensus.cc:3060] T f67b7f39bd9042a0bd72e32fbc31391d P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:25.000967  1546 raft_consensus.cc:740] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bf9692a81414cfab64ee45b5393d57e, State: Initialized, Role: FOLLOWER
W20260709 13:14:25.004853  1370 leader_election.cc:343] T f67b7f39bd9042a0bd72e32fbc31391d P 40837fdefb66404b93c3e3876da432f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66:38395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:25.005198  1546 consensus_queue.cc:260] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 0bf9692a81414cfab64ee45b5393d57e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
W20260709 13:14:25.006057  1370 leader_election.cc:343] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 40837fdefb66404b93c3e3876da432f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66:38395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:25.006942  1573 raft_consensus.cc:2804] T 02592ff6032f4ca6855608f5508444f6 P e4f6eab2337842428ba2670421465839 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:25.008416  1573 raft_consensus.cc:697] T 02592ff6032f4ca6855608f5508444f6 P e4f6eab2337842428ba2670421465839 [term 1 LEADER]: Becoming Leader. State: Replica: e4f6eab2337842428ba2670421465839, State: Running, Role: LEADER
I20260709 13:14:25.008595  1546 ts_tablet_manager.cc:1434] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 0bf9692a81414cfab64ee45b5393d57e: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.002s
I20260709 13:14:25.009836  1546 tablet_bootstrap.cc:492] T f7e4806e46494317a05058762da8a72e P 0bf9692a81414cfab64ee45b5393d57e: Bootstrap starting.
I20260709 13:14:25.009351  1154 catalog_manager.cc:5697] T eeda95d1ada94d01aab3427f00d32570 P 40837fdefb66404b93c3e3876da432f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40837fdefb66404b93c3e3876da432f7 (127.23.140.67). New cstate: current_term: 1 leader_uuid: "40837fdefb66404b93c3e3876da432f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:25.010725  1571 raft_consensus.cc:515] T f67b7f39bd9042a0bd72e32fbc31391d P 40837fdefb66404b93c3e3876da432f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:25.012658  1407 raft_consensus.cc:2468] T 02592ff6032f4ca6855608f5508444f6 P 40837fdefb66404b93c3e3876da432f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4f6eab2337842428ba2670421465839 in term 1.
I20260709 13:14:24.999161  1534 raft_consensus.cc:2804] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:25.013927  1534 raft_consensus.cc:493] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:25.014281  1534 raft_consensus.cc:3060] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 40837fdefb66404b93c3e3876da432f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:25.015730  1571 leader_election.cc:290] T f67b7f39bd9042a0bd72e32fbc31391d P 40837fdefb66404b93c3e3876da432f7 [CANDIDATE]: Term 1 election: Requested vote from peers e4f6eab2337842428ba2670421465839 (127.23.140.65:45009), 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66:38395)
I20260709 13:14:25.016420  1258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f67b7f39bd9042a0bd72e32fbc31391d" candidate_uuid: "40837fdefb66404b93c3e3876da432f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f6eab2337842428ba2670421465839"
I20260709 13:14:25.017233  1258 raft_consensus.cc:3060] T f67b7f39bd9042a0bd72e32fbc31391d P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:25.017601  1331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f67b7f39bd9042a0bd72e32fbc31391d" candidate_uuid: "40837fdefb66404b93c3e3876da432f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bf9692a81414cfab64ee45b5393d57e"
I20260709 13:14:25.009328  1573 consensus_queue.cc:237] T 02592ff6032f4ca6855608f5508444f6 P e4f6eab2337842428ba2670421465839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:25.016615  1546 tablet_bootstrap.cc:654] T f7e4806e46494317a05058762da8a72e P 0bf9692a81414cfab64ee45b5393d57e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:25.021790  1534 raft_consensus.cc:515] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 40837fdefb66404b93c3e3876da432f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
W20260709 13:14:25.020165  1370 leader_election.cc:343] T f67b7f39bd9042a0bd72e32fbc31391d P 40837fdefb66404b93c3e3876da432f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66:38395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:25.024768  1257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a13635e2d594fb0bd31ac4039d4d2e0" candidate_uuid: "40837fdefb66404b93c3e3876da432f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f6eab2337842428ba2670421465839"
I20260709 13:14:25.025358  1257 raft_consensus.cc:3060] T 3a13635e2d594fb0bd31ac4039d4d2e0 P e4f6eab2337842428ba2670421465839 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:25.029357  1258 raft_consensus.cc:2468] T f67b7f39bd9042a0bd72e32fbc31391d P e4f6eab2337842428ba2670421465839 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40837fdefb66404b93c3e3876da432f7 in term 1.
I20260709 13:14:25.034889  1534 leader_election.cc:290] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 40837fdefb66404b93c3e3876da432f7 [CANDIDATE]: Term 1 election: Requested vote from peers e4f6eab2337842428ba2670421465839 (127.23.140.65:45009), 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66:38395)
I20260709 13:14:25.035987  1331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a13635e2d594fb0bd31ac4039d4d2e0" candidate_uuid: "40837fdefb66404b93c3e3876da432f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bf9692a81414cfab64ee45b5393d57e"
I20260709 13:14:25.033246  1156 catalog_manager.cc:5697] T 02592ff6032f4ca6855608f5508444f6 P e4f6eab2337842428ba2670421465839 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4f6eab2337842428ba2670421465839 (127.23.140.65). New cstate: current_term: 1 leader_uuid: "e4f6eab2337842428ba2670421465839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:25.036674  1331 raft_consensus.cc:3060] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:25.039404  1546 tablet_bootstrap.cc:492] T f7e4806e46494317a05058762da8a72e P 0bf9692a81414cfab64ee45b5393d57e: No bootstrap required, opened a new log
I20260709 13:14:25.039964  1546 ts_tablet_manager.cc:1403] T f7e4806e46494317a05058762da8a72e P 0bf9692a81414cfab64ee45b5393d57e: Time spent bootstrapping tablet: real 0.030s	user 0.008s	sys 0.013s
I20260709 13:14:25.042809  1546 raft_consensus.cc:359] T f7e4806e46494317a05058762da8a72e P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:25.043550  1546 raft_consensus.cc:385] T f7e4806e46494317a05058762da8a72e P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:25.043870  1546 raft_consensus.cc:740] T f7e4806e46494317a05058762da8a72e P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bf9692a81414cfab64ee45b5393d57e, State: Initialized, Role: FOLLOWER
I20260709 13:14:25.044574  1331 raft_consensus.cc:2468] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 0bf9692a81414cfab64ee45b5393d57e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40837fdefb66404b93c3e3876da432f7 in term 1.
I20260709 13:14:25.045365  1371 leader_election.cc:304] T f67b7f39bd9042a0bd72e32fbc31391d P 40837fdefb66404b93c3e3876da432f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40837fdefb66404b93c3e3876da432f7, e4f6eab2337842428ba2670421465839; no voters: 0bf9692a81414cfab64ee45b5393d57e
I20260709 13:14:25.045853  1370 leader_election.cc:304] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 40837fdefb66404b93c3e3876da432f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bf9692a81414cfab64ee45b5393d57e, 40837fdefb66404b93c3e3876da432f7; no voters: 
I20260709 13:14:25.044566  1546 consensus_queue.cc:260] T f7e4806e46494317a05058762da8a72e P 0bf9692a81414cfab64ee45b5393d57e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:25.047561  1534 raft_consensus.cc:2804] T f67b7f39bd9042a0bd72e32fbc31391d P 40837fdefb66404b93c3e3876da432f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:25.048086  1534 raft_consensus.cc:697] T f67b7f39bd9042a0bd72e32fbc31391d P 40837fdefb66404b93c3e3876da432f7 [term 1 LEADER]: Becoming Leader. State: Replica: 40837fdefb66404b93c3e3876da432f7, State: Running, Role: LEADER
I20260709 13:14:25.048868  1534 consensus_queue.cc:237] T f67b7f39bd9042a0bd72e32fbc31391d P 40837fdefb66404b93c3e3876da432f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:25.049567  1571 raft_consensus.cc:2804] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 40837fdefb66404b93c3e3876da432f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:25.049130  1257 raft_consensus.cc:2468] T 3a13635e2d594fb0bd31ac4039d4d2e0 P e4f6eab2337842428ba2670421465839 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40837fdefb66404b93c3e3876da432f7 in term 1.
I20260709 13:14:25.050092  1571 raft_consensus.cc:697] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 40837fdefb66404b93c3e3876da432f7 [term 1 LEADER]: Becoming Leader. State: Replica: 40837fdefb66404b93c3e3876da432f7, State: Running, Role: LEADER
I20260709 13:14:25.050930  1571 consensus_queue.cc:237] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 40837fdefb66404b93c3e3876da432f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:25.052265  1546 ts_tablet_manager.cc:1434] T f7e4806e46494317a05058762da8a72e P 0bf9692a81414cfab64ee45b5393d57e: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:14:25.053333  1546 tablet_bootstrap.cc:492] T f67b7f39bd9042a0bd72e32fbc31391d P 0bf9692a81414cfab64ee45b5393d57e: Bootstrap starting.
I20260709 13:14:25.059221  1546 tablet_bootstrap.cc:654] T f67b7f39bd9042a0bd72e32fbc31391d P 0bf9692a81414cfab64ee45b5393d57e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:25.062770  1156 catalog_manager.cc:5697] T f67b7f39bd9042a0bd72e32fbc31391d P 40837fdefb66404b93c3e3876da432f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40837fdefb66404b93c3e3876da432f7 (127.23.140.67). New cstate: current_term: 1 leader_uuid: "40837fdefb66404b93c3e3876da432f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:25.064486  1156 catalog_manager.cc:5697] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 40837fdefb66404b93c3e3876da432f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40837fdefb66404b93c3e3876da432f7 (127.23.140.67). New cstate: current_term: 1 leader_uuid: "40837fdefb66404b93c3e3876da432f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:25.065056  1546 tablet_bootstrap.cc:492] T f67b7f39bd9042a0bd72e32fbc31391d P 0bf9692a81414cfab64ee45b5393d57e: No bootstrap required, opened a new log
I20260709 13:14:25.065538  1546 ts_tablet_manager.cc:1403] T f67b7f39bd9042a0bd72e32fbc31391d P 0bf9692a81414cfab64ee45b5393d57e: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 13:14:25.067474  1546 raft_consensus.cc:359] T f67b7f39bd9042a0bd72e32fbc31391d P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:25.067979  1546 raft_consensus.cc:385] T f67b7f39bd9042a0bd72e32fbc31391d P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:25.068202  1546 raft_consensus.cc:740] T f67b7f39bd9042a0bd72e32fbc31391d P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bf9692a81414cfab64ee45b5393d57e, State: Initialized, Role: FOLLOWER
I20260709 13:14:25.068780  1546 consensus_queue.cc:260] T f67b7f39bd9042a0bd72e32fbc31391d P 0bf9692a81414cfab64ee45b5393d57e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:25.070744  1546 ts_tablet_manager.cc:1434] T f67b7f39bd9042a0bd72e32fbc31391d P 0bf9692a81414cfab64ee45b5393d57e: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:14:25.072574  1475 consensus_queue.cc:1048] T aa6cc96673d4456da12d920cea7aa471 P 0bf9692a81414cfab64ee45b5393d57e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:25.088752  1475 consensus_queue.cc:1048] T aa6cc96673d4456da12d920cea7aa471 P 0bf9692a81414cfab64ee45b5393d57e [LEADER]: Connected to new peer: Peer: permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:25.100034  1406 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc60f59313bc4507bdf418cf4654ee3b"
dest_uuid: "40837fdefb66404b93c3e3876da432f7"
mode: GRACEFUL
new_leader_uuid: "e4f6eab2337842428ba2670421465839"
 from {username='slave'} at 127.0.0.1:42018
I20260709 13:14:25.100663  1406 raft_consensus.cc:606] T fc60f59313bc4507bdf418cf4654ee3b P 40837fdefb66404b93c3e3876da432f7 [term 1 LEADER]: Received request to transfer leadership to TS e4f6eab2337842428ba2670421465839
I20260709 13:14:25.107648  1331 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa6cc96673d4456da12d920cea7aa471"
dest_uuid: "0bf9692a81414cfab64ee45b5393d57e"
mode: GRACEFUL
new_leader_uuid: "e4f6eab2337842428ba2670421465839"
 from {username='slave'} at 127.0.0.1:51518
I20260709 13:14:25.108331  1331 raft_consensus.cc:606] T aa6cc96673d4456da12d920cea7aa471 P 0bf9692a81414cfab64ee45b5393d57e [term 1 LEADER]: Received request to transfer leadership to TS e4f6eab2337842428ba2670421465839
I20260709 13:14:25.113966  1407 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d214f889325043f2a8a06bb04a45783c"
dest_uuid: "40837fdefb66404b93c3e3876da432f7"
mode: GRACEFUL
new_leader_uuid: "e4f6eab2337842428ba2670421465839"
 from {username='slave'} at 127.0.0.1:42018
I20260709 13:14:25.114544  1407 raft_consensus.cc:606] T d214f889325043f2a8a06bb04a45783c P 40837fdefb66404b93c3e3876da432f7 [term 1 LEADER]: Received request to transfer leadership to TS e4f6eab2337842428ba2670421465839
I20260709 13:14:25.121810  1407 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eeda95d1ada94d01aab3427f00d32570"
dest_uuid: "40837fdefb66404b93c3e3876da432f7"
mode: GRACEFUL
new_leader_uuid: "0bf9692a81414cfab64ee45b5393d57e"
 from {username='slave'} at 127.0.0.1:42018
I20260709 13:14:25.122298  1407 raft_consensus.cc:606] T eeda95d1ada94d01aab3427f00d32570 P 40837fdefb66404b93c3e3876da432f7 [term 1 LEADER]: Received request to transfer leadership to TS 0bf9692a81414cfab64ee45b5393d57e
I20260709 13:14:25.126963  1257 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02592ff6032f4ca6855608f5508444f6"
dest_uuid: "e4f6eab2337842428ba2670421465839"
mode: GRACEFUL
new_leader_uuid: "0bf9692a81414cfab64ee45b5393d57e"
 from {username='slave'} at 127.0.0.1:46668
I20260709 13:14:25.127504  1257 raft_consensus.cc:606] T 02592ff6032f4ca6855608f5508444f6 P e4f6eab2337842428ba2670421465839 [term 1 LEADER]: Received request to transfer leadership to TS 0bf9692a81414cfab64ee45b5393d57e
I20260709 13:14:25.132699  1407 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a13635e2d594fb0bd31ac4039d4d2e0"
dest_uuid: "40837fdefb66404b93c3e3876da432f7"
mode: GRACEFUL
new_leader_uuid: "0bf9692a81414cfab64ee45b5393d57e"
 from {username='slave'} at 127.0.0.1:42018
I20260709 13:14:25.133210  1407 raft_consensus.cc:606] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 40837fdefb66404b93c3e3876da432f7 [term 1 LEADER]: Received request to transfer leadership to TS 0bf9692a81414cfab64ee45b5393d57e
I20260709 13:14:25.138235  1407 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7e4806e46494317a05058762da8a72e"
dest_uuid: "40837fdefb66404b93c3e3876da432f7"
mode: GRACEFUL
new_leader_uuid: "0bf9692a81414cfab64ee45b5393d57e"
 from {username='slave'} at 127.0.0.1:42018
I20260709 13:14:25.138746  1407 raft_consensus.cc:606] T f7e4806e46494317a05058762da8a72e P 40837fdefb66404b93c3e3876da432f7 [term 1 LEADER]: Received request to transfer leadership to TS 0bf9692a81414cfab64ee45b5393d57e
I20260709 13:14:25.254266  1475 raft_consensus.cc:493] T f7e4806e46494317a05058762da8a72e P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:25.254729  1475 raft_consensus.cc:515] T f7e4806e46494317a05058762da8a72e P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:25.256453  1475 leader_election.cc:290] T f7e4806e46494317a05058762da8a72e P 0bf9692a81414cfab64ee45b5393d57e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4f6eab2337842428ba2670421465839 (127.23.140.65:45009), 40837fdefb66404b93c3e3876da432f7 (127.23.140.67:43689)
I20260709 13:14:25.257290  1257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7e4806e46494317a05058762da8a72e" candidate_uuid: "0bf9692a81414cfab64ee45b5393d57e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f6eab2337842428ba2670421465839" is_pre_election: true
I20260709 13:14:25.257544  1407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7e4806e46494317a05058762da8a72e" candidate_uuid: "0bf9692a81414cfab64ee45b5393d57e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40837fdefb66404b93c3e3876da432f7" is_pre_election: true
I20260709 13:14:25.258114  1257 raft_consensus.cc:2393] T f7e4806e46494317a05058762da8a72e P e4f6eab2337842428ba2670421465839 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0bf9692a81414cfab64ee45b5393d57e in current term 1: Already voted for candidate 40837fdefb66404b93c3e3876da432f7 in this term.
I20260709 13:14:25.259163  1297 leader_election.cc:304] T f7e4806e46494317a05058762da8a72e P 0bf9692a81414cfab64ee45b5393d57e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0bf9692a81414cfab64ee45b5393d57e; no voters: 40837fdefb66404b93c3e3876da432f7, e4f6eab2337842428ba2670421465839
I20260709 13:14:25.259886  1475 raft_consensus.cc:3060] T f7e4806e46494317a05058762da8a72e P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:25.264711  1475 raft_consensus.cc:2749] T f7e4806e46494317a05058762da8a72e P 0bf9692a81414cfab64ee45b5393d57e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:25.296434  1534 consensus_queue.cc:1048] T f7e4806e46494317a05058762da8a72e P 40837fdefb66404b93c3e3876da432f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:25.302475  1534 consensus_queue.cc:1048] T d214f889325043f2a8a06bb04a45783c P 40837fdefb66404b93c3e3876da432f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:25.307657  1475 raft_consensus.cc:493] T f67b7f39bd9042a0bd72e32fbc31391d P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:25.308187  1475 raft_consensus.cc:515] T f67b7f39bd9042a0bd72e32fbc31391d P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:25.309242  1534 consensus_queue.cc:1048] T f7e4806e46494317a05058762da8a72e P 40837fdefb66404b93c3e3876da432f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:25.310205  1475 leader_election.cc:290] T f67b7f39bd9042a0bd72e32fbc31391d P 0bf9692a81414cfab64ee45b5393d57e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4f6eab2337842428ba2670421465839 (127.23.140.65:45009), 40837fdefb66404b93c3e3876da432f7 (127.23.140.67:43689)
I20260709 13:14:25.312004  1258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f67b7f39bd9042a0bd72e32fbc31391d" candidate_uuid: "0bf9692a81414cfab64ee45b5393d57e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f6eab2337842428ba2670421465839" is_pre_election: true
I20260709 13:14:25.312723  1258 raft_consensus.cc:2393] T f67b7f39bd9042a0bd72e32fbc31391d P e4f6eab2337842428ba2670421465839 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0bf9692a81414cfab64ee45b5393d57e in current term 1: Already voted for candidate 40837fdefb66404b93c3e3876da432f7 in this term.
I20260709 13:14:25.320595  1407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f67b7f39bd9042a0bd72e32fbc31391d" candidate_uuid: "0bf9692a81414cfab64ee45b5393d57e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40837fdefb66404b93c3e3876da432f7" is_pre_election: true
I20260709 13:14:25.322338  1299 leader_election.cc:304] T f67b7f39bd9042a0bd72e32fbc31391d P 0bf9692a81414cfab64ee45b5393d57e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0bf9692a81414cfab64ee45b5393d57e; no voters: 40837fdefb66404b93c3e3876da432f7, e4f6eab2337842428ba2670421465839
I20260709 13:14:25.323112  1475 raft_consensus.cc:3060] T f67b7f39bd9042a0bd72e32fbc31391d P 0bf9692a81414cfab64ee45b5393d57e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:25.324505  1534 consensus_queue.cc:1048] T fc60f59313bc4507bdf418cf4654ee3b P 40837fdefb66404b93c3e3876da432f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:25.341112  1475 raft_consensus.cc:2749] T f67b7f39bd9042a0bd72e32fbc31391d P 0bf9692a81414cfab64ee45b5393d57e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:25.348958  1571 consensus_queue.cc:1048] T d214f889325043f2a8a06bb04a45783c P 40837fdefb66404b93c3e3876da432f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:25.362943  1571 raft_consensus.cc:993] T f7e4806e46494317a05058762da8a72e P 40837fdefb66404b93c3e3876da432f7: : Instructing follower 0bf9692a81414cfab64ee45b5393d57e to start an election
I20260709 13:14:25.363897  1600 raft_consensus.cc:1081] T f7e4806e46494317a05058762da8a72e P 40837fdefb66404b93c3e3876da432f7 [term 1 LEADER]: Signalling peer 0bf9692a81414cfab64ee45b5393d57e to start an election
I20260709 13:14:25.371053  1330 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f7e4806e46494317a05058762da8a72e"
dest_uuid: "0bf9692a81414cfab64ee45b5393d57e"
 from {username='slave'} at 127.0.0.1:51510
I20260709 13:14:25.371646  1330 raft_consensus.cc:493] T f7e4806e46494317a05058762da8a72e P 0bf9692a81414cfab64ee45b5393d57e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:25.372036  1330 raft_consensus.cc:3060] T f7e4806e46494317a05058762da8a72e P 0bf9692a81414cfab64ee45b5393d57e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:25.377770  1330 raft_consensus.cc:515] T f7e4806e46494317a05058762da8a72e P 0bf9692a81414cfab64ee45b5393d57e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:25.379526  1600 consensus_queue.cc:1048] T fc60f59313bc4507bdf418cf4654ee3b P 40837fdefb66404b93c3e3876da432f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:25.385030  1330 leader_election.cc:290] T f7e4806e46494317a05058762da8a72e P 0bf9692a81414cfab64ee45b5393d57e [CANDIDATE]: Term 2 election: Requested vote from peers e4f6eab2337842428ba2670421465839 (127.23.140.65:45009), 40837fdefb66404b93c3e3876da432f7 (127.23.140.67:43689)
I20260709 13:14:25.386287  1256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7e4806e46494317a05058762da8a72e" candidate_uuid: "0bf9692a81414cfab64ee45b5393d57e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4f6eab2337842428ba2670421465839"
I20260709 13:14:25.387125  1256 raft_consensus.cc:3060] T f7e4806e46494317a05058762da8a72e P e4f6eab2337842428ba2670421465839 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:25.388319  1407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7e4806e46494317a05058762da8a72e" candidate_uuid: "0bf9692a81414cfab64ee45b5393d57e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40837fdefb66404b93c3e3876da432f7"
I20260709 13:14:25.388939  1407 raft_consensus.cc:3055] T f7e4806e46494317a05058762da8a72e P 40837fdefb66404b93c3e3876da432f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:25.389393  1407 raft_consensus.cc:740] T f7e4806e46494317a05058762da8a72e P 40837fdefb66404b93c3e3876da432f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 40837fdefb66404b93c3e3876da432f7, State: Running, Role: LEADER
I20260709 13:14:25.390844  1407 consensus_queue.cc:260] T f7e4806e46494317a05058762da8a72e P 40837fdefb66404b93c3e3876da432f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:25.393760  1407 raft_consensus.cc:3060] T f7e4806e46494317a05058762da8a72e P 40837fdefb66404b93c3e3876da432f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:25.394965  1256 raft_consensus.cc:2468] T f7e4806e46494317a05058762da8a72e P e4f6eab2337842428ba2670421465839 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bf9692a81414cfab64ee45b5393d57e in term 2.
I20260709 13:14:25.396026  1297 leader_election.cc:304] T f7e4806e46494317a05058762da8a72e P 0bf9692a81414cfab64ee45b5393d57e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bf9692a81414cfab64ee45b5393d57e, e4f6eab2337842428ba2670421465839; no voters: 
I20260709 13:14:25.396927  1475 raft_consensus.cc:2804] T f7e4806e46494317a05058762da8a72e P 0bf9692a81414cfab64ee45b5393d57e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:25.397423  1475 raft_consensus.cc:697] T f7e4806e46494317a05058762da8a72e P 0bf9692a81414cfab64ee45b5393d57e [term 2 LEADER]: Becoming Leader. State: Replica: 0bf9692a81414cfab64ee45b5393d57e, State: Running, Role: LEADER
I20260709 13:14:25.398458  1601 raft_consensus.cc:993] T d214f889325043f2a8a06bb04a45783c P 40837fdefb66404b93c3e3876da432f7: : Instructing follower e4f6eab2337842428ba2670421465839 to start an election
I20260709 13:14:25.398254  1475 consensus_queue.cc:237] T f7e4806e46494317a05058762da8a72e P 0bf9692a81414cfab64ee45b5393d57e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:25.398933  1601 raft_consensus.cc:1081] T d214f889325043f2a8a06bb04a45783c P 40837fdefb66404b93c3e3876da432f7 [term 1 LEADER]: Signalling peer e4f6eab2337842428ba2670421465839 to start an election
I20260709 13:14:25.400904  1257 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d214f889325043f2a8a06bb04a45783c"
dest_uuid: "e4f6eab2337842428ba2670421465839"
 from {username='slave'} at 127.0.0.1:46664
I20260709 13:14:25.401512  1257 raft_consensus.cc:493] T d214f889325043f2a8a06bb04a45783c P e4f6eab2337842428ba2670421465839 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:25.401954  1257 raft_consensus.cc:3060] T d214f889325043f2a8a06bb04a45783c P e4f6eab2337842428ba2670421465839 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:25.402977  1561 raft_consensus.cc:993] T fc60f59313bc4507bdf418cf4654ee3b P 40837fdefb66404b93c3e3876da432f7: : Instructing follower e4f6eab2337842428ba2670421465839 to start an election
I20260709 13:14:25.403741  1561 raft_consensus.cc:1081] T fc60f59313bc4507bdf418cf4654ee3b P 40837fdefb66404b93c3e3876da432f7 [term 1 LEADER]: Signalling peer e4f6eab2337842428ba2670421465839 to start an election
I20260709 13:14:25.404393  1407 raft_consensus.cc:2468] T f7e4806e46494317a05058762da8a72e P 40837fdefb66404b93c3e3876da432f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bf9692a81414cfab64ee45b5393d57e in term 2.
I20260709 13:14:25.406237  1256 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fc60f59313bc4507bdf418cf4654ee3b"
dest_uuid: "e4f6eab2337842428ba2670421465839"
 from {username='slave'} at 127.0.0.1:46664
I20260709 13:14:25.406898  1256 raft_consensus.cc:493] T fc60f59313bc4507bdf418cf4654ee3b P e4f6eab2337842428ba2670421465839 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:25.407370  1256 raft_consensus.cc:3060] T fc60f59313bc4507bdf418cf4654ee3b P e4f6eab2337842428ba2670421465839 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:25.408921  1154 catalog_manager.cc:5697] T f7e4806e46494317a05058762da8a72e P 0bf9692a81414cfab64ee45b5393d57e reported cstate change: term changed from 1 to 2, leader changed from 40837fdefb66404b93c3e3876da432f7 (127.23.140.67) to 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66). New cstate: current_term: 2 leader_uuid: "0bf9692a81414cfab64ee45b5393d57e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:25.412150  1257 raft_consensus.cc:515] T d214f889325043f2a8a06bb04a45783c P e4f6eab2337842428ba2670421465839 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:25.414479  1256 raft_consensus.cc:515] T fc60f59313bc4507bdf418cf4654ee3b P e4f6eab2337842428ba2670421465839 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:25.415208  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d214f889325043f2a8a06bb04a45783c" candidate_uuid: "e4f6eab2337842428ba2670421465839" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0bf9692a81414cfab64ee45b5393d57e"
I20260709 13:14:25.415828  1330 raft_consensus.cc:3060] T d214f889325043f2a8a06bb04a45783c P 0bf9692a81414cfab64ee45b5393d57e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:25.416585  1256 leader_election.cc:290] T fc60f59313bc4507bdf418cf4654ee3b P e4f6eab2337842428ba2670421465839 [CANDIDATE]: Term 2 election: Requested vote from peers 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66:38395), 40837fdefb66404b93c3e3876da432f7 (127.23.140.67:43689)
I20260709 13:14:25.418203  1257 leader_election.cc:290] T d214f889325043f2a8a06bb04a45783c P e4f6eab2337842428ba2670421465839 [CANDIDATE]: Term 2 election: Requested vote from peers 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66:38395), 40837fdefb66404b93c3e3876da432f7 (127.23.140.67:43689)
I20260709 13:14:25.419582  1333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc60f59313bc4507bdf418cf4654ee3b" candidate_uuid: "e4f6eab2337842428ba2670421465839" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0bf9692a81414cfab64ee45b5393d57e"
I20260709 13:14:25.420166  1333 raft_consensus.cc:3060] T fc60f59313bc4507bdf418cf4654ee3b P 0bf9692a81414cfab64ee45b5393d57e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:25.421005  1406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d214f889325043f2a8a06bb04a45783c" candidate_uuid: "e4f6eab2337842428ba2670421465839" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40837fdefb66404b93c3e3876da432f7"
I20260709 13:14:25.421633  1406 raft_consensus.cc:3055] T d214f889325043f2a8a06bb04a45783c P 40837fdefb66404b93c3e3876da432f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:25.421916  1406 raft_consensus.cc:740] T d214f889325043f2a8a06bb04a45783c P 40837fdefb66404b93c3e3876da432f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 40837fdefb66404b93c3e3876da432f7, State: Running, Role: LEADER
I20260709 13:14:25.422065  1407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc60f59313bc4507bdf418cf4654ee3b" candidate_uuid: "e4f6eab2337842428ba2670421465839" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40837fdefb66404b93c3e3876da432f7"
I20260709 13:14:25.422628  1407 raft_consensus.cc:3055] T fc60f59313bc4507bdf418cf4654ee3b P 40837fdefb66404b93c3e3876da432f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:25.422565  1406 consensus_queue.cc:260] T d214f889325043f2a8a06bb04a45783c P 40837fdefb66404b93c3e3876da432f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:25.423898  1406 raft_consensus.cc:3060] T d214f889325043f2a8a06bb04a45783c P 40837fdefb66404b93c3e3876da432f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:25.427361  1333 raft_consensus.cc:2468] T fc60f59313bc4507bdf418cf4654ee3b P 0bf9692a81414cfab64ee45b5393d57e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4f6eab2337842428ba2670421465839 in term 2.
I20260709 13:14:25.427634  1330 raft_consensus.cc:2468] T d214f889325043f2a8a06bb04a45783c P 0bf9692a81414cfab64ee45b5393d57e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4f6eab2337842428ba2670421465839 in term 2.
I20260709 13:14:25.423032  1407 raft_consensus.cc:740] T fc60f59313bc4507bdf418cf4654ee3b P 40837fdefb66404b93c3e3876da432f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 40837fdefb66404b93c3e3876da432f7, State: Running, Role: LEADER
I20260709 13:14:25.428786  1407 consensus_queue.cc:260] T fc60f59313bc4507bdf418cf4654ee3b P 40837fdefb66404b93c3e3876da432f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:25.428996  1221 leader_election.cc:304] T fc60f59313bc4507bdf418cf4654ee3b P e4f6eab2337842428ba2670421465839 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bf9692a81414cfab64ee45b5393d57e, e4f6eab2337842428ba2670421465839; no voters: 
I20260709 13:14:25.429625  1407 raft_consensus.cc:3060] T fc60f59313bc4507bdf418cf4654ee3b P 40837fdefb66404b93c3e3876da432f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:25.429992  1406 raft_consensus.cc:2468] T d214f889325043f2a8a06bb04a45783c P 40837fdefb66404b93c3e3876da432f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4f6eab2337842428ba2670421465839 in term 2.
I20260709 13:14:25.430366  1221 leader_election.cc:304] T d214f889325043f2a8a06bb04a45783c P e4f6eab2337842428ba2670421465839 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bf9692a81414cfab64ee45b5393d57e, e4f6eab2337842428ba2670421465839; no voters: 
I20260709 13:14:25.430776  1494 raft_consensus.cc:2804] T fc60f59313bc4507bdf418cf4654ee3b P e4f6eab2337842428ba2670421465839 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:25.431209  1573 raft_consensus.cc:2804] T d214f889325043f2a8a06bb04a45783c P e4f6eab2337842428ba2670421465839 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:25.438562  1407 raft_consensus.cc:2468] T fc60f59313bc4507bdf418cf4654ee3b P 40837fdefb66404b93c3e3876da432f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4f6eab2337842428ba2670421465839 in term 2.
I20260709 13:14:25.447582  1573 raft_consensus.cc:697] T d214f889325043f2a8a06bb04a45783c P e4f6eab2337842428ba2670421465839 [term 2 LEADER]: Becoming Leader. State: Replica: e4f6eab2337842428ba2670421465839, State: Running, Role: LEADER
I20260709 13:14:25.448871  1605 consensus_queue.cc:1048] T 500933c30a944235930b2ae50569922a P e4f6eab2337842428ba2670421465839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:25.450050  1573 consensus_queue.cc:237] T d214f889325043f2a8a06bb04a45783c P e4f6eab2337842428ba2670421465839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:25.454622  1494 raft_consensus.cc:697] T fc60f59313bc4507bdf418cf4654ee3b P e4f6eab2337842428ba2670421465839 [term 2 LEADER]: Becoming Leader. State: Replica: e4f6eab2337842428ba2670421465839, State: Running, Role: LEADER
I20260709 13:14:25.455817  1494 consensus_queue.cc:237] T fc60f59313bc4507bdf418cf4654ee3b P e4f6eab2337842428ba2670421465839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:25.456089  1604 consensus_queue.cc:1048] T 500933c30a944235930b2ae50569922a P e4f6eab2337842428ba2670421465839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:25.456243  1561 consensus_queue.cc:1048] T eeda95d1ada94d01aab3427f00d32570 P 40837fdefb66404b93c3e3876da432f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:25.466904  1154 catalog_manager.cc:5697] T fc60f59313bc4507bdf418cf4654ee3b P e4f6eab2337842428ba2670421465839 reported cstate change: term changed from 1 to 2, leader changed from 40837fdefb66404b93c3e3876da432f7 (127.23.140.67) to e4f6eab2337842428ba2670421465839 (127.23.140.65). New cstate: current_term: 2 leader_uuid: "e4f6eab2337842428ba2670421465839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:25.482335  1601 consensus_queue.cc:1048] T eeda95d1ada94d01aab3427f00d32570 P 40837fdefb66404b93c3e3876da432f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:25.485284  1494 consensus_queue.cc:1048] T 02592ff6032f4ca6855608f5508444f6 P e4f6eab2337842428ba2670421465839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:25.486646  1156 catalog_manager.cc:5697] T d214f889325043f2a8a06bb04a45783c P e4f6eab2337842428ba2670421465839 reported cstate change: term changed from 1 to 2, leader changed from 40837fdefb66404b93c3e3876da432f7 (127.23.140.67) to e4f6eab2337842428ba2670421465839 (127.23.140.65). New cstate: current_term: 2 leader_uuid: "e4f6eab2337842428ba2670421465839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:25.497892  1561 raft_consensus.cc:993] T eeda95d1ada94d01aab3427f00d32570 P 40837fdefb66404b93c3e3876da432f7: : Instructing follower 0bf9692a81414cfab64ee45b5393d57e to start an election
I20260709 13:14:25.498461  1561 raft_consensus.cc:1081] T eeda95d1ada94d01aab3427f00d32570 P 40837fdefb66404b93c3e3876da432f7 [term 1 LEADER]: Signalling peer 0bf9692a81414cfab64ee45b5393d57e to start an election
I20260709 13:14:25.499401  1606 consensus_queue.cc:1048] T 02592ff6032f4ca6855608f5508444f6 P e4f6eab2337842428ba2670421465839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:25.500437  1330 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eeda95d1ada94d01aab3427f00d32570"
dest_uuid: "0bf9692a81414cfab64ee45b5393d57e"
 from {username='slave'} at 127.0.0.1:51510
I20260709 13:14:25.500993  1330 raft_consensus.cc:493] T eeda95d1ada94d01aab3427f00d32570 P 0bf9692a81414cfab64ee45b5393d57e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:25.501312  1330 raft_consensus.cc:3060] T eeda95d1ada94d01aab3427f00d32570 P 0bf9692a81414cfab64ee45b5393d57e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:25.508901  1330 raft_consensus.cc:515] T eeda95d1ada94d01aab3427f00d32570 P 0bf9692a81414cfab64ee45b5393d57e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:25.511531  1330 leader_election.cc:290] T eeda95d1ada94d01aab3427f00d32570 P 0bf9692a81414cfab64ee45b5393d57e [CANDIDATE]: Term 2 election: Requested vote from peers e4f6eab2337842428ba2670421465839 (127.23.140.65:45009), 40837fdefb66404b93c3e3876da432f7 (127.23.140.67:43689)
I20260709 13:14:25.513407  1407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda95d1ada94d01aab3427f00d32570" candidate_uuid: "0bf9692a81414cfab64ee45b5393d57e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40837fdefb66404b93c3e3876da432f7"
I20260709 13:14:25.514068  1407 raft_consensus.cc:3055] T eeda95d1ada94d01aab3427f00d32570 P 40837fdefb66404b93c3e3876da432f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:25.514353  1407 raft_consensus.cc:740] T eeda95d1ada94d01aab3427f00d32570 P 40837fdefb66404b93c3e3876da432f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 40837fdefb66404b93c3e3876da432f7, State: Running, Role: LEADER
I20260709 13:14:25.513159  1257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda95d1ada94d01aab3427f00d32570" candidate_uuid: "0bf9692a81414cfab64ee45b5393d57e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4f6eab2337842428ba2670421465839"
I20260709 13:14:25.515079  1407 consensus_queue.cc:260] T eeda95d1ada94d01aab3427f00d32570 P 40837fdefb66404b93c3e3876da432f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:25.515753  1257 raft_consensus.cc:3060] T eeda95d1ada94d01aab3427f00d32570 P e4f6eab2337842428ba2670421465839 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:25.516358  1407 raft_consensus.cc:3060] T eeda95d1ada94d01aab3427f00d32570 P 40837fdefb66404b93c3e3876da432f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:25.522950  1257 raft_consensus.cc:2468] T eeda95d1ada94d01aab3427f00d32570 P e4f6eab2337842428ba2670421465839 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bf9692a81414cfab64ee45b5393d57e in term 2.
I20260709 13:14:25.530756  1407 raft_consensus.cc:2468] T eeda95d1ada94d01aab3427f00d32570 P 40837fdefb66404b93c3e3876da432f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bf9692a81414cfab64ee45b5393d57e in term 2.
I20260709 13:14:25.532467  1297 leader_election.cc:304] T eeda95d1ada94d01aab3427f00d32570 P 0bf9692a81414cfab64ee45b5393d57e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bf9692a81414cfab64ee45b5393d57e, e4f6eab2337842428ba2670421465839; no voters: 
I20260709 13:14:25.533401  1475 raft_consensus.cc:2804] T eeda95d1ada94d01aab3427f00d32570 P 0bf9692a81414cfab64ee45b5393d57e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:25.533913  1475 raft_consensus.cc:697] T eeda95d1ada94d01aab3427f00d32570 P 0bf9692a81414cfab64ee45b5393d57e [term 2 LEADER]: Becoming Leader. State: Replica: 0bf9692a81414cfab64ee45b5393d57e, State: Running, Role: LEADER
I20260709 13:14:25.534762  1475 consensus_queue.cc:237] T eeda95d1ada94d01aab3427f00d32570 P 0bf9692a81414cfab64ee45b5393d57e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:25.535518  1606 raft_consensus.cc:993] T 02592ff6032f4ca6855608f5508444f6 P e4f6eab2337842428ba2670421465839: : Instructing follower 0bf9692a81414cfab64ee45b5393d57e to start an election
I20260709 13:14:25.536022  1606 raft_consensus.cc:1081] T 02592ff6032f4ca6855608f5508444f6 P e4f6eab2337842428ba2670421465839 [term 1 LEADER]: Signalling peer 0bf9692a81414cfab64ee45b5393d57e to start an election
I20260709 13:14:25.538038  1333 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "02592ff6032f4ca6855608f5508444f6"
dest_uuid: "0bf9692a81414cfab64ee45b5393d57e"
 from {username='slave'} at 127.0.0.1:51514
I20260709 13:14:25.539362  1333 raft_consensus.cc:493] T 02592ff6032f4ca6855608f5508444f6 P 0bf9692a81414cfab64ee45b5393d57e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:25.539748  1333 raft_consensus.cc:3060] T 02592ff6032f4ca6855608f5508444f6 P 0bf9692a81414cfab64ee45b5393d57e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:25.545225  1333 raft_consensus.cc:515] T 02592ff6032f4ca6855608f5508444f6 P 0bf9692a81414cfab64ee45b5393d57e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:25.547463  1333 leader_election.cc:290] T 02592ff6032f4ca6855608f5508444f6 P 0bf9692a81414cfab64ee45b5393d57e [CANDIDATE]: Term 2 election: Requested vote from peers e4f6eab2337842428ba2670421465839 (127.23.140.65:45009), 40837fdefb66404b93c3e3876da432f7 (127.23.140.67:43689)
I20260709 13:14:25.547778  1257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02592ff6032f4ca6855608f5508444f6" candidate_uuid: "0bf9692a81414cfab64ee45b5393d57e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4f6eab2337842428ba2670421465839"
I20260709 13:14:25.548018  1407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02592ff6032f4ca6855608f5508444f6" candidate_uuid: "0bf9692a81414cfab64ee45b5393d57e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40837fdefb66404b93c3e3876da432f7"
I20260709 13:14:25.548483  1257 raft_consensus.cc:3055] T 02592ff6032f4ca6855608f5508444f6 P e4f6eab2337842428ba2670421465839 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:25.548646  1407 raft_consensus.cc:3060] T 02592ff6032f4ca6855608f5508444f6 P 40837fdefb66404b93c3e3876da432f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:25.548856  1257 raft_consensus.cc:740] T 02592ff6032f4ca6855608f5508444f6 P e4f6eab2337842428ba2670421465839 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4f6eab2337842428ba2670421465839, State: Running, Role: LEADER
I20260709 13:14:25.549777  1257 consensus_queue.cc:260] T 02592ff6032f4ca6855608f5508444f6 P e4f6eab2337842428ba2670421465839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:25.551024  1257 raft_consensus.cc:3060] T 02592ff6032f4ca6855608f5508444f6 P e4f6eab2337842428ba2670421465839 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:25.551858  1154 catalog_manager.cc:5697] T eeda95d1ada94d01aab3427f00d32570 P 0bf9692a81414cfab64ee45b5393d57e reported cstate change: term changed from 1 to 2, leader changed from 40837fdefb66404b93c3e3876da432f7 (127.23.140.67) to 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66). New cstate: current_term: 2 leader_uuid: "0bf9692a81414cfab64ee45b5393d57e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:25.553710  1407 raft_consensus.cc:2468] T 02592ff6032f4ca6855608f5508444f6 P 40837fdefb66404b93c3e3876da432f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bf9692a81414cfab64ee45b5393d57e in term 2.
I20260709 13:14:25.555092  1299 leader_election.cc:304] T 02592ff6032f4ca6855608f5508444f6 P 0bf9692a81414cfab64ee45b5393d57e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bf9692a81414cfab64ee45b5393d57e, 40837fdefb66404b93c3e3876da432f7; no voters: 
I20260709 13:14:25.555874  1475 raft_consensus.cc:2804] T 02592ff6032f4ca6855608f5508444f6 P 0bf9692a81414cfab64ee45b5393d57e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:25.556317  1475 raft_consensus.cc:697] T 02592ff6032f4ca6855608f5508444f6 P 0bf9692a81414cfab64ee45b5393d57e [term 2 LEADER]: Becoming Leader. State: Replica: 0bf9692a81414cfab64ee45b5393d57e, State: Running, Role: LEADER
I20260709 13:14:25.557039  1475 consensus_queue.cc:237] T 02592ff6032f4ca6855608f5508444f6 P 0bf9692a81414cfab64ee45b5393d57e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:25.558300  1561 consensus_queue.cc:1048] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 40837fdefb66404b93c3e3876da432f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:25.559587  1257 raft_consensus.cc:2468] T 02592ff6032f4ca6855608f5508444f6 P e4f6eab2337842428ba2670421465839 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bf9692a81414cfab64ee45b5393d57e in term 2.
I20260709 13:14:25.565573  1601 raft_consensus.cc:993] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 40837fdefb66404b93c3e3876da432f7: : Instructing follower 0bf9692a81414cfab64ee45b5393d57e to start an election
I20260709 13:14:25.566048  1600 raft_consensus.cc:1081] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 40837fdefb66404b93c3e3876da432f7 [term 1 LEADER]: Signalling peer 0bf9692a81414cfab64ee45b5393d57e to start an election
I20260709 13:14:25.567732  1330 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3a13635e2d594fb0bd31ac4039d4d2e0"
dest_uuid: "0bf9692a81414cfab64ee45b5393d57e"
 from {username='slave'} at 127.0.0.1:51510
I20260709 13:14:25.568279  1330 raft_consensus.cc:493] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 0bf9692a81414cfab64ee45b5393d57e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:25.568616  1330 raft_consensus.cc:3060] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 0bf9692a81414cfab64ee45b5393d57e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:25.570485  1154 catalog_manager.cc:5697] T 02592ff6032f4ca6855608f5508444f6 P 0bf9692a81414cfab64ee45b5393d57e reported cstate change: term changed from 1 to 2, leader changed from e4f6eab2337842428ba2670421465839 (127.23.140.65) to 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66). New cstate: current_term: 2 leader_uuid: "0bf9692a81414cfab64ee45b5393d57e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:25.572474  1571 consensus_queue.cc:1048] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 40837fdefb66404b93c3e3876da432f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:25.576108  1330 raft_consensus.cc:515] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 0bf9692a81414cfab64ee45b5393d57e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:25.578752  1330 leader_election.cc:290] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 0bf9692a81414cfab64ee45b5393d57e [CANDIDATE]: Term 2 election: Requested vote from peers e4f6eab2337842428ba2670421465839 (127.23.140.65:45009), 40837fdefb66404b93c3e3876da432f7 (127.23.140.67:43689)
I20260709 13:14:25.579326  1258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a13635e2d594fb0bd31ac4039d4d2e0" candidate_uuid: "0bf9692a81414cfab64ee45b5393d57e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4f6eab2337842428ba2670421465839"
I20260709 13:14:25.580243  1333 raft_consensus.cc:1240] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 0bf9692a81414cfab64ee45b5393d57e [term 2 FOLLOWER]: Rejecting Update request from peer 40837fdefb66404b93c3e3876da432f7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:25.580562  1601 consensus_queue.cc:1048] T f67b7f39bd9042a0bd72e32fbc31391d P 40837fdefb66404b93c3e3876da432f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:25.580617  1407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a13635e2d594fb0bd31ac4039d4d2e0" candidate_uuid: "0bf9692a81414cfab64ee45b5393d57e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40837fdefb66404b93c3e3876da432f7"
I20260709 13:14:25.582382  1407 raft_consensus.cc:3055] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 40837fdefb66404b93c3e3876da432f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:25.582671  1407 raft_consensus.cc:740] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 40837fdefb66404b93c3e3876da432f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 40837fdefb66404b93c3e3876da432f7, State: Running, Role: LEADER
I20260709 13:14:25.583411  1407 consensus_queue.cc:260] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 40837fdefb66404b93c3e3876da432f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:25.584165  1601 consensus_queue.cc:1059] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 40837fdefb66404b93c3e3876da432f7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:25.585326  1407 raft_consensus.cc:3060] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 40837fdefb66404b93c3e3876da432f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:25.593261  1600 consensus_queue.cc:1048] T f67b7f39bd9042a0bd72e32fbc31391d P 40837fdefb66404b93c3e3876da432f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:25.594259  1407 raft_consensus.cc:2468] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 40837fdefb66404b93c3e3876da432f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bf9692a81414cfab64ee45b5393d57e in term 2.
I20260709 13:14:25.595854  1299 leader_election.cc:304] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 0bf9692a81414cfab64ee45b5393d57e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0bf9692a81414cfab64ee45b5393d57e, 40837fdefb66404b93c3e3876da432f7; no voters: e4f6eab2337842428ba2670421465839
I20260709 13:14:25.596939  1475 raft_consensus.cc:2804] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 0bf9692a81414cfab64ee45b5393d57e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:25.597388  1475 raft_consensus.cc:697] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 0bf9692a81414cfab64ee45b5393d57e [term 2 LEADER]: Becoming Leader. State: Replica: 0bf9692a81414cfab64ee45b5393d57e, State: Running, Role: LEADER
I20260709 13:14:25.598070  1475 consensus_queue.cc:237] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 0bf9692a81414cfab64ee45b5393d57e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:25.605952  1154 catalog_manager.cc:5697] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 0bf9692a81414cfab64ee45b5393d57e reported cstate change: term changed from 1 to 2, leader changed from 40837fdefb66404b93c3e3876da432f7 (127.23.140.67) to 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66). New cstate: current_term: 2 leader_uuid: "0bf9692a81414cfab64ee45b5393d57e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:25.608283  1555 raft_consensus.cc:993] T aa6cc96673d4456da12d920cea7aa471 P 0bf9692a81414cfab64ee45b5393d57e: : Instructing follower e4f6eab2337842428ba2670421465839 to start an election
I20260709 13:14:25.608776  1555 raft_consensus.cc:1081] T aa6cc96673d4456da12d920cea7aa471 P 0bf9692a81414cfab64ee45b5393d57e [term 1 LEADER]: Signalling peer e4f6eab2337842428ba2670421465839 to start an election
I20260709 13:14:25.610734  1258 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aa6cc96673d4456da12d920cea7aa471"
dest_uuid: "e4f6eab2337842428ba2670421465839"
 from {username='slave'} at 127.0.0.1:46648
I20260709 13:14:25.611270  1258 raft_consensus.cc:493] T aa6cc96673d4456da12d920cea7aa471 P e4f6eab2337842428ba2670421465839 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:25.611675  1258 raft_consensus.cc:3060] T aa6cc96673d4456da12d920cea7aa471 P e4f6eab2337842428ba2670421465839 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:25.626824  1258 raft_consensus.cc:515] T aa6cc96673d4456da12d920cea7aa471 P e4f6eab2337842428ba2670421465839 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:25.629017  1333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6cc96673d4456da12d920cea7aa471" candidate_uuid: "e4f6eab2337842428ba2670421465839" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0bf9692a81414cfab64ee45b5393d57e"
I20260709 13:14:25.629578  1333 raft_consensus.cc:3055] T aa6cc96673d4456da12d920cea7aa471 P 0bf9692a81414cfab64ee45b5393d57e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:25.629995  1333 raft_consensus.cc:740] T aa6cc96673d4456da12d920cea7aa471 P 0bf9692a81414cfab64ee45b5393d57e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0bf9692a81414cfab64ee45b5393d57e, State: Running, Role: LEADER
I20260709 13:14:25.630743  1333 consensus_queue.cc:260] T aa6cc96673d4456da12d920cea7aa471 P 0bf9692a81414cfab64ee45b5393d57e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:25.631300  1258 leader_election.cc:290] T aa6cc96673d4456da12d920cea7aa471 P e4f6eab2337842428ba2670421465839 [CANDIDATE]: Term 2 election: Requested vote from peers 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66:38395), 40837fdefb66404b93c3e3876da432f7 (127.23.140.67:43689)
I20260709 13:14:25.631641  1333 raft_consensus.cc:3060] T aa6cc96673d4456da12d920cea7aa471 P 0bf9692a81414cfab64ee45b5393d57e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:25.630800  1407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6cc96673d4456da12d920cea7aa471" candidate_uuid: "e4f6eab2337842428ba2670421465839" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40837fdefb66404b93c3e3876da432f7"
I20260709 13:14:25.632223  1407 raft_consensus.cc:3060] T aa6cc96673d4456da12d920cea7aa471 P 40837fdefb66404b93c3e3876da432f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:25.636940  1333 raft_consensus.cc:2468] T aa6cc96673d4456da12d920cea7aa471 P 0bf9692a81414cfab64ee45b5393d57e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4f6eab2337842428ba2670421465839 in term 2.
I20260709 13:14:25.638118  1221 leader_election.cc:304] T aa6cc96673d4456da12d920cea7aa471 P e4f6eab2337842428ba2670421465839 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bf9692a81414cfab64ee45b5393d57e, e4f6eab2337842428ba2670421465839; no voters: 
I20260709 13:14:25.638630  1407 raft_consensus.cc:2468] T aa6cc96673d4456da12d920cea7aa471 P 40837fdefb66404b93c3e3876da432f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4f6eab2337842428ba2670421465839 in term 2.
I20260709 13:14:25.638934  1606 raft_consensus.cc:2804] T aa6cc96673d4456da12d920cea7aa471 P e4f6eab2337842428ba2670421465839 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:25.639488  1606 raft_consensus.cc:697] T aa6cc96673d4456da12d920cea7aa471 P e4f6eab2337842428ba2670421465839 [term 2 LEADER]: Becoming Leader. State: Replica: e4f6eab2337842428ba2670421465839, State: Running, Role: LEADER
I20260709 13:14:25.640232  1606 consensus_queue.cc:237] T aa6cc96673d4456da12d920cea7aa471 P e4f6eab2337842428ba2670421465839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:25.646162  1156 catalog_manager.cc:5697] T aa6cc96673d4456da12d920cea7aa471 P e4f6eab2337842428ba2670421465839 reported cstate change: term changed from 1 to 2, leader changed from 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66) to e4f6eab2337842428ba2670421465839 (127.23.140.65). New cstate: current_term: 2 leader_uuid: "e4f6eab2337842428ba2670421465839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:25.856346  1258 raft_consensus.cc:1275] T f7e4806e46494317a05058762da8a72e P e4f6eab2337842428ba2670421465839 [term 2 FOLLOWER]: Refusing update from remote peer 0bf9692a81414cfab64ee45b5393d57e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:25.858103  1475 consensus_queue.cc:1048] T f7e4806e46494317a05058762da8a72e P 0bf9692a81414cfab64ee45b5393d57e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:25.871124  1407 raft_consensus.cc:1275] T f7e4806e46494317a05058762da8a72e P 40837fdefb66404b93c3e3876da432f7 [term 2 FOLLOWER]: Refusing update from remote peer 0bf9692a81414cfab64ee45b5393d57e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:25.873955  1475 consensus_queue.cc:1048] T f7e4806e46494317a05058762da8a72e P 0bf9692a81414cfab64ee45b5393d57e [LEADER]: Connected to new peer: Peer: permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:25.960918  1333 raft_consensus.cc:1275] T fc60f59313bc4507bdf418cf4654ee3b P 0bf9692a81414cfab64ee45b5393d57e [term 2 FOLLOWER]: Refusing update from remote peer e4f6eab2337842428ba2670421465839: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:25.962169  1494 consensus_queue.cc:1048] T fc60f59313bc4507bdf418cf4654ee3b P e4f6eab2337842428ba2670421465839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:25.966964  1258 raft_consensus.cc:1275] T eeda95d1ada94d01aab3427f00d32570 P e4f6eab2337842428ba2670421465839 [term 2 FOLLOWER]: Refusing update from remote peer 0bf9692a81414cfab64ee45b5393d57e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:25.968546  1555 consensus_queue.cc:1048] T eeda95d1ada94d01aab3427f00d32570 P 0bf9692a81414cfab64ee45b5393d57e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:25.977350  1407 raft_consensus.cc:1275] T fc60f59313bc4507bdf418cf4654ee3b P 40837fdefb66404b93c3e3876da432f7 [term 2 FOLLOWER]: Refusing update from remote peer e4f6eab2337842428ba2670421465839: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:25.979053  1604 consensus_queue.cc:1048] T fc60f59313bc4507bdf418cf4654ee3b P e4f6eab2337842428ba2670421465839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:25.983078  1406 raft_consensus.cc:1275] T eeda95d1ada94d01aab3427f00d32570 P 40837fdefb66404b93c3e3876da432f7 [term 2 FOLLOWER]: Refusing update from remote peer 0bf9692a81414cfab64ee45b5393d57e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:25.990386  1619 consensus_queue.cc:1048] T eeda95d1ada94d01aab3427f00d32570 P 0bf9692a81414cfab64ee45b5393d57e [LEADER]: Connected to new peer: Peer: permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:26.012778  1406 raft_consensus.cc:1275] T 02592ff6032f4ca6855608f5508444f6 P 40837fdefb66404b93c3e3876da432f7 [term 2 FOLLOWER]: Refusing update from remote peer 0bf9692a81414cfab64ee45b5393d57e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:26.012840  1257 raft_consensus.cc:1275] T 02592ff6032f4ca6855608f5508444f6 P e4f6eab2337842428ba2670421465839 [term 2 FOLLOWER]: Refusing update from remote peer 0bf9692a81414cfab64ee45b5393d57e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:26.014938  1555 consensus_queue.cc:1048] T 02592ff6032f4ca6855608f5508444f6 P 0bf9692a81414cfab64ee45b5393d57e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:26.015688  1475 consensus_queue.cc:1048] T 02592ff6032f4ca6855608f5508444f6 P 0bf9692a81414cfab64ee45b5393d57e [LEADER]: Connected to new peer: Peer: permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:26.019083  1258 raft_consensus.cc:3060] T 3a13635e2d594fb0bd31ac4039d4d2e0 P e4f6eab2337842428ba2670421465839 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:26.024889  1333 raft_consensus.cc:1275] T d214f889325043f2a8a06bb04a45783c P 0bf9692a81414cfab64ee45b5393d57e [term 2 FOLLOWER]: Refusing update from remote peer e4f6eab2337842428ba2670421465839: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:26.026467  1494 consensus_queue.cc:1048] T d214f889325043f2a8a06bb04a45783c P e4f6eab2337842428ba2670421465839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:26.032405  1258 raft_consensus.cc:1275] T 3a13635e2d594fb0bd31ac4039d4d2e0 P e4f6eab2337842428ba2670421465839 [term 2 FOLLOWER]: Refusing update from remote peer 0bf9692a81414cfab64ee45b5393d57e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:26.035306  1619 consensus_queue.cc:1048] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 0bf9692a81414cfab64ee45b5393d57e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:26.052055  1406 raft_consensus.cc:1275] T d214f889325043f2a8a06bb04a45783c P 40837fdefb66404b93c3e3876da432f7 [term 2 FOLLOWER]: Refusing update from remote peer e4f6eab2337842428ba2670421465839: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:26.053714  1494 consensus_queue.cc:1048] T d214f889325043f2a8a06bb04a45783c P e4f6eab2337842428ba2670421465839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:26.055294  1406 raft_consensus.cc:1275] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 40837fdefb66404b93c3e3876da432f7 [term 2 FOLLOWER]: Refusing update from remote peer 0bf9692a81414cfab64ee45b5393d57e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:26.056679  1475 consensus_queue.cc:1048] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 0bf9692a81414cfab64ee45b5393d57e [LEADER]: Connected to new peer: Peer: permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:26.088758  1407 raft_consensus.cc:1275] T aa6cc96673d4456da12d920cea7aa471 P 40837fdefb66404b93c3e3876da432f7 [term 2 FOLLOWER]: Refusing update from remote peer e4f6eab2337842428ba2670421465839: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:26.090211  1494 consensus_queue.cc:1048] T aa6cc96673d4456da12d920cea7aa471 P e4f6eab2337842428ba2670421465839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:26.101276  1330 raft_consensus.cc:1275] T aa6cc96673d4456da12d920cea7aa471 P 0bf9692a81414cfab64ee45b5393d57e [term 2 FOLLOWER]: Refusing update from remote peer e4f6eab2337842428ba2670421465839: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:26.103377  1606 consensus_queue.cc:1048] T aa6cc96673d4456da12d920cea7aa471 P e4f6eab2337842428ba2670421465839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:28.144903  1154 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48260:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:14:28.165638  1154 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48260:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:14:28.187429 24113 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:14:28.279481  1657 tablet.cc:1724] T d214f889325043f2a8a06bb04a45783c P e4f6eab2337842428ba2670421465839: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:28.305384  1659 tablet.cc:1724] T d214f889325043f2a8a06bb04a45783c P 0bf9692a81414cfab64ee45b5393d57e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:28.316085  1661 tablet.cc:1724] T 500933c30a944235930b2ae50569922a P e4f6eab2337842428ba2670421465839: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:14:28.324573  1284 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:d214f889325043f2a8a06bb04a45783c)
W20260709 13:14:28.337119  1284 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:d214f889325043f2a8a06bb04a45783c)
W20260709 13:14:28.338158  1284 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:d214f889325043f2a8a06bb04a45783c)
I20260709 13:14:28.327910  1663 tablet.cc:1724] T 500933c30a944235930b2ae50569922a P 0bf9692a81414cfab64ee45b5393d57e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:28.460266  1659 tablet.cc:1724] T 02592ff6032f4ca6855608f5508444f6 P 0bf9692a81414cfab64ee45b5393d57e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:28.472321  1661 tablet.cc:1724] T fc60f59313bc4507bdf418cf4654ee3b P e4f6eab2337842428ba2670421465839: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:28.482002  1667 tablet.cc:1724] T fc60f59313bc4507bdf418cf4654ee3b P 0bf9692a81414cfab64ee45b5393d57e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:14:28.514091  1644 log.cc:927] Time spent T 3a13635e2d594fb0bd31ac4039d4d2e0 P 0bf9692a81414cfab64ee45b5393d57e: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
W20260709 13:14:28.542860  1664 log.cc:927] Time spent T eeda95d1ada94d01aab3427f00d32570 P e4f6eab2337842428ba2670421465839: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:14:28.607419  1257 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa6cc96673d4456da12d920cea7aa471"
dest_uuid: "e4f6eab2337842428ba2670421465839"
mode: GRACEFUL
new_leader_uuid: "40837fdefb66404b93c3e3876da432f7"
 from {username='slave'} at 127.0.0.1:49656
I20260709 13:14:28.607553  1657 tablet.cc:1724] T aa6cc96673d4456da12d920cea7aa471 P e4f6eab2337842428ba2670421465839: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:28.615245  1677 tablet.cc:1724] T eeda95d1ada94d01aab3427f00d32570 P 0bf9692a81414cfab64ee45b5393d57e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:14:28.628072  1674 log.cc:927] Time spent T f7e4806e46494317a05058762da8a72e P 40837fdefb66404b93c3e3876da432f7: Append to log took a long time: real 0.127s	user 0.002s	sys 0.000s
I20260709 13:14:28.636080  1678 tablet.cc:1724] T eeda95d1ada94d01aab3427f00d32570 P 40837fdefb66404b93c3e3876da432f7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:28.654690  1663 tablet.cc:1724] T f7e4806e46494317a05058762da8a72e P 0bf9692a81414cfab64ee45b5393d57e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:28.660873  1661 tablet.cc:1724] T f7e4806e46494317a05058762da8a72e P e4f6eab2337842428ba2670421465839: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:28.692399  1685 tablet.cc:1724] T aa6cc96673d4456da12d920cea7aa471 P 40837fdefb66404b93c3e3876da432f7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:28.697234  1257 raft_consensus.cc:606] T aa6cc96673d4456da12d920cea7aa471 P e4f6eab2337842428ba2670421465839 [term 2 LEADER]: Received request to transfer leadership to TS 40837fdefb66404b93c3e3876da432f7
I20260709 13:14:28.702702  1675 tablet.cc:1724] T 02592ff6032f4ca6855608f5508444f6 P 40837fdefb66404b93c3e3876da432f7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:28.733062  1659 tablet.cc:1724] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 0bf9692a81414cfab64ee45b5393d57e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:28.733925  1692 tablet.cc:1724] T 02592ff6032f4ca6855608f5508444f6 P e4f6eab2337842428ba2670421465839: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:28.752312  1663 tablet.cc:1724] T aa6cc96673d4456da12d920cea7aa471 P 0bf9692a81414cfab64ee45b5393d57e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:14:28.758999  1688 log.cc:927] Time spent T 3a13635e2d594fb0bd31ac4039d4d2e0 P e4f6eab2337842428ba2670421465839: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:14:28.768328  1675 tablet.cc:1724] T d214f889325043f2a8a06bb04a45783c P 40837fdefb66404b93c3e3876da432f7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:28.722584  1657 tablet.cc:1724] T eeda95d1ada94d01aab3427f00d32570 P e4f6eab2337842428ba2670421465839: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:14:28.772979  1370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.66:38395, user_credentials={real_user=slave}} blocked reactor thread for 49159.5us
I20260709 13:14:28.781044  1685 tablet.cc:1724] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 40837fdefb66404b93c3e3876da432f7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:28.794412  1693 tablet.cc:1724] T fc60f59313bc4507bdf418cf4654ee3b P 40837fdefb66404b93c3e3876da432f7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:28.807711  1621 raft_consensus.cc:993] T aa6cc96673d4456da12d920cea7aa471 P e4f6eab2337842428ba2670421465839: : Instructing follower 40837fdefb66404b93c3e3876da432f7 to start an election
I20260709 13:14:28.808324  1621 raft_consensus.cc:1081] T aa6cc96673d4456da12d920cea7aa471 P e4f6eab2337842428ba2670421465839 [term 2 LEADER]: Signalling peer 40837fdefb66404b93c3e3876da432f7 to start an election
I20260709 13:14:28.818751  1407 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aa6cc96673d4456da12d920cea7aa471"
dest_uuid: "40837fdefb66404b93c3e3876da432f7"
 from {username='slave'} at 127.0.0.1:42006
I20260709 13:14:28.819370  1407 raft_consensus.cc:493] T aa6cc96673d4456da12d920cea7aa471 P 40837fdefb66404b93c3e3876da432f7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:28.819710  1407 raft_consensus.cc:3060] T aa6cc96673d4456da12d920cea7aa471 P 40837fdefb66404b93c3e3876da432f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:28.822811  1657 tablet.cc:1724] T 3a13635e2d594fb0bd31ac4039d4d2e0 P e4f6eab2337842428ba2670421465839: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:28.824112  1678 tablet.cc:1724] T f7e4806e46494317a05058762da8a72e P 40837fdefb66404b93c3e3876da432f7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:28.826258  1675 tablet.cc:1724] T 500933c30a944235930b2ae50569922a P 40837fdefb66404b93c3e3876da432f7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:28.837106  1407 raft_consensus.cc:515] T aa6cc96673d4456da12d920cea7aa471 P 40837fdefb66404b93c3e3876da432f7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
W20260709 13:14:28.839772  1371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:45009, user_credentials={real_user=slave}} blocked reactor thread for 64616us
I20260709 13:14:28.842430  1255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6cc96673d4456da12d920cea7aa471" candidate_uuid: "40837fdefb66404b93c3e3876da432f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "e4f6eab2337842428ba2670421465839"
I20260709 13:14:28.843330  1255 raft_consensus.cc:3055] T aa6cc96673d4456da12d920cea7aa471 P e4f6eab2337842428ba2670421465839 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:28.843798  1255 raft_consensus.cc:740] T aa6cc96673d4456da12d920cea7aa471 P e4f6eab2337842428ba2670421465839 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e4f6eab2337842428ba2670421465839, State: Running, Role: LEADER
I20260709 13:14:28.844066  1693 tablet.cc:1724] T f67b7f39bd9042a0bd72e32fbc31391d P 40837fdefb66404b93c3e3876da432f7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:28.845438  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6cc96673d4456da12d920cea7aa471" candidate_uuid: "40837fdefb66404b93c3e3876da432f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "0bf9692a81414cfab64ee45b5393d57e"
I20260709 13:14:28.846170  1407 leader_election.cc:290] T aa6cc96673d4456da12d920cea7aa471 P 40837fdefb66404b93c3e3876da432f7 [CANDIDATE]: Term 3 election: Requested vote from peers e4f6eab2337842428ba2670421465839 (127.23.140.65:45009), 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66:38395)
I20260709 13:14:28.846727  1330 raft_consensus.cc:3060] T aa6cc96673d4456da12d920cea7aa471 P 0bf9692a81414cfab64ee45b5393d57e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:28.857398  1659 tablet.cc:1724] T f67b7f39bd9042a0bd72e32fbc31391d P 0bf9692a81414cfab64ee45b5393d57e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:28.854775  1255 consensus_queue.cc:260] T aa6cc96673d4456da12d920cea7aa471 P e4f6eab2337842428ba2670421465839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:28.864295  1255 raft_consensus.cc:3060] T aa6cc96673d4456da12d920cea7aa471 P e4f6eab2337842428ba2670421465839 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:28.866050  1330 raft_consensus.cc:2468] T aa6cc96673d4456da12d920cea7aa471 P 0bf9692a81414cfab64ee45b5393d57e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40837fdefb66404b93c3e3876da432f7 in term 3.
I20260709 13:14:28.867821  1370 leader_election.cc:304] T aa6cc96673d4456da12d920cea7aa471 P 40837fdefb66404b93c3e3876da432f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bf9692a81414cfab64ee45b5393d57e, 40837fdefb66404b93c3e3876da432f7; no voters: 
I20260709 13:14:28.868788  1694 raft_consensus.cc:2804] T aa6cc96673d4456da12d920cea7aa471 P 40837fdefb66404b93c3e3876da432f7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:28.869280  1694 raft_consensus.cc:697] T aa6cc96673d4456da12d920cea7aa471 P 40837fdefb66404b93c3e3876da432f7 [term 3 LEADER]: Becoming Leader. State: Replica: 40837fdefb66404b93c3e3876da432f7, State: Running, Role: LEADER
I20260709 13:14:28.870370  1694 consensus_queue.cc:237] T aa6cc96673d4456da12d920cea7aa471 P 40837fdefb66404b93c3e3876da432f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:28.898792  1155 catalog_manager.cc:5697] T aa6cc96673d4456da12d920cea7aa471 P 40837fdefb66404b93c3e3876da432f7 reported cstate change: term changed from 2 to 3, leader changed from e4f6eab2337842428ba2670421465839 (127.23.140.65) to 40837fdefb66404b93c3e3876da432f7 (127.23.140.67). New cstate: current_term: 3 leader_uuid: "40837fdefb66404b93c3e3876da432f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:28.906518  1330 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7e4806e46494317a05058762da8a72e"
dest_uuid: "0bf9692a81414cfab64ee45b5393d57e"
mode: GRACEFUL
new_leader_uuid: "40837fdefb66404b93c3e3876da432f7"
 from {username='slave'} at 127.0.0.1:46968
I20260709 13:14:28.907244  1330 raft_consensus.cc:606] T f7e4806e46494317a05058762da8a72e P 0bf9692a81414cfab64ee45b5393d57e [term 2 LEADER]: Received request to transfer leadership to TS 40837fdefb66404b93c3e3876da432f7
I20260709 13:14:28.910182  1661 tablet.cc:1724] T f67b7f39bd9042a0bd72e32fbc31391d P e4f6eab2337842428ba2670421465839: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:28.911787 24113 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:14:28.914327 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:28.922942  1255 raft_consensus.cc:2468] T aa6cc96673d4456da12d920cea7aa471 P e4f6eab2337842428ba2670421465839 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40837fdefb66404b93c3e3876da432f7 in term 3.
I20260709 13:14:28.927707  1255 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c40fe2ece564243aa8dc5b1fae8ecd8"
dest_uuid: "e4f6eab2337842428ba2670421465839"
mode: GRACEFUL
new_leader_uuid: "40837fdefb66404b93c3e3876da432f7"
 from {username='slave'} at 127.0.0.1:49656
I20260709 13:14:28.928349  1255 raft_consensus.cc:606] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P e4f6eab2337842428ba2670421465839 [term 2 LEADER]: Received request to transfer leadership to TS 40837fdefb66404b93c3e3876da432f7
I20260709 13:14:28.931223  1330 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b20386846aee4ca5b9458883519bf06d"
dest_uuid: "0bf9692a81414cfab64ee45b5393d57e"
mode: GRACEFUL
new_leader_uuid: "40837fdefb66404b93c3e3876da432f7"
 from {username='slave'} at 127.0.0.1:46968
I20260709 13:14:28.931824  1330 raft_consensus.cc:606] T b20386846aee4ca5b9458883519bf06d P 0bf9692a81414cfab64ee45b5393d57e [term 2 LEADER]: Received request to transfer leadership to TS 40837fdefb66404b93c3e3876da432f7
I20260709 13:14:28.926225  1156 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 2aba176642564658a9700187a3b3d6f0: soft_deleted_table [id=11b3bc1519bb4e9eb0f6fe4798b92314] alter complete (version 1)
I20260709 13:14:28.933099 24113 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:14:28.933678 24113 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:28.978459  1686 raft_consensus.cc:993] T b20386846aee4ca5b9458883519bf06d P 0bf9692a81414cfab64ee45b5393d57e: : Instructing follower 40837fdefb66404b93c3e3876da432f7 to start an election
I20260709 13:14:28.978972  1619 raft_consensus.cc:1081] T b20386846aee4ca5b9458883519bf06d P 0bf9692a81414cfab64ee45b5393d57e [term 2 LEADER]: Signalling peer 40837fdefb66404b93c3e3876da432f7 to start an election
I20260709 13:14:28.980538  1407 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b20386846aee4ca5b9458883519bf06d"
dest_uuid: "40837fdefb66404b93c3e3876da432f7"
 from {username='slave'} at 127.0.0.1:42004
I20260709 13:14:28.980926  1407 raft_consensus.cc:493] T b20386846aee4ca5b9458883519bf06d P 40837fdefb66404b93c3e3876da432f7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:28.981137  1407 raft_consensus.cc:3060] T b20386846aee4ca5b9458883519bf06d P 40837fdefb66404b93c3e3876da432f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:28.985538  1407 raft_consensus.cc:515] T b20386846aee4ca5b9458883519bf06d P 40837fdefb66404b93c3e3876da432f7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:28.987025  1407 leader_election.cc:290] T b20386846aee4ca5b9458883519bf06d P 40837fdefb66404b93c3e3876da432f7 [CANDIDATE]: Term 3 election: Requested vote from peers e4f6eab2337842428ba2670421465839 (127.23.140.65:45009), 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66:38395)
I20260709 13:14:28.987861  1255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b20386846aee4ca5b9458883519bf06d" candidate_uuid: "40837fdefb66404b93c3e3876da432f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e4f6eab2337842428ba2670421465839"
I20260709 13:14:28.988186  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b20386846aee4ca5b9458883519bf06d" candidate_uuid: "40837fdefb66404b93c3e3876da432f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0bf9692a81414cfab64ee45b5393d57e"
I20260709 13:14:28.988494  1255 raft_consensus.cc:3060] T b20386846aee4ca5b9458883519bf06d P e4f6eab2337842428ba2670421465839 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:28.988775  1330 raft_consensus.cc:3055] T b20386846aee4ca5b9458883519bf06d P 0bf9692a81414cfab64ee45b5393d57e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:28.989084  1330 raft_consensus.cc:740] T b20386846aee4ca5b9458883519bf06d P 0bf9692a81414cfab64ee45b5393d57e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0bf9692a81414cfab64ee45b5393d57e, State: Running, Role: LEADER
I20260709 13:14:28.989847  1330 consensus_queue.cc:260] T b20386846aee4ca5b9458883519bf06d P 0bf9692a81414cfab64ee45b5393d57e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:28.990837  1330 raft_consensus.cc:3060] T b20386846aee4ca5b9458883519bf06d P 0bf9692a81414cfab64ee45b5393d57e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:28.993541  1255 raft_consensus.cc:2468] T b20386846aee4ca5b9458883519bf06d P e4f6eab2337842428ba2670421465839 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40837fdefb66404b93c3e3876da432f7 in term 3.
I20260709 13:14:28.994791  1371 leader_election.cc:304] T b20386846aee4ca5b9458883519bf06d P 40837fdefb66404b93c3e3876da432f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40837fdefb66404b93c3e3876da432f7, e4f6eab2337842428ba2670421465839; no voters: 
I20260709 13:14:28.995572  1694 raft_consensus.cc:2804] T b20386846aee4ca5b9458883519bf06d P 40837fdefb66404b93c3e3876da432f7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:28.995934  1330 raft_consensus.cc:2468] T b20386846aee4ca5b9458883519bf06d P 0bf9692a81414cfab64ee45b5393d57e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40837fdefb66404b93c3e3876da432f7 in term 3.
I20260709 13:14:28.995992  1694 raft_consensus.cc:697] T b20386846aee4ca5b9458883519bf06d P 40837fdefb66404b93c3e3876da432f7 [term 3 LEADER]: Becoming Leader. State: Replica: 40837fdefb66404b93c3e3876da432f7, State: Running, Role: LEADER
I20260709 13:14:28.997140  1694 consensus_queue.cc:237] T b20386846aee4ca5b9458883519bf06d P 40837fdefb66404b93c3e3876da432f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:29.004558  1154 catalog_manager.cc:5697] T b20386846aee4ca5b9458883519bf06d P 40837fdefb66404b93c3e3876da432f7 reported cstate change: term changed from 2 to 3, leader changed from 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66) to 40837fdefb66404b93c3e3876da432f7 (127.23.140.67). New cstate: current_term: 3 leader_uuid: "40837fdefb66404b93c3e3876da432f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:29.254091  1686 raft_consensus.cc:993] T f7e4806e46494317a05058762da8a72e P 0bf9692a81414cfab64ee45b5393d57e: : Instructing follower 40837fdefb66404b93c3e3876da432f7 to start an election
I20260709 13:14:29.254527  1686 raft_consensus.cc:1081] T f7e4806e46494317a05058762da8a72e P 0bf9692a81414cfab64ee45b5393d57e [term 2 LEADER]: Signalling peer 40837fdefb66404b93c3e3876da432f7 to start an election
I20260709 13:14:29.255861  1407 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f7e4806e46494317a05058762da8a72e"
dest_uuid: "40837fdefb66404b93c3e3876da432f7"
 from {username='slave'} at 127.0.0.1:42004
I20260709 13:14:29.256317  1407 raft_consensus.cc:493] T f7e4806e46494317a05058762da8a72e P 40837fdefb66404b93c3e3876da432f7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:29.256534  1407 raft_consensus.cc:3060] T f7e4806e46494317a05058762da8a72e P 40837fdefb66404b93c3e3876da432f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:29.262723  1407 raft_consensus.cc:515] T f7e4806e46494317a05058762da8a72e P 40837fdefb66404b93c3e3876da432f7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:29.264051  1407 leader_election.cc:290] T f7e4806e46494317a05058762da8a72e P 40837fdefb66404b93c3e3876da432f7 [CANDIDATE]: Term 3 election: Requested vote from peers e4f6eab2337842428ba2670421465839 (127.23.140.65:45009), 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66:38395)
I20260709 13:14:29.264914  1255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7e4806e46494317a05058762da8a72e" candidate_uuid: "40837fdefb66404b93c3e3876da432f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "e4f6eab2337842428ba2670421465839"
I20260709 13:14:29.265115  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7e4806e46494317a05058762da8a72e" candidate_uuid: "40837fdefb66404b93c3e3876da432f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "0bf9692a81414cfab64ee45b5393d57e"
I20260709 13:14:29.265491  1255 raft_consensus.cc:3060] T f7e4806e46494317a05058762da8a72e P e4f6eab2337842428ba2670421465839 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:29.265692  1330 raft_consensus.cc:3055] T f7e4806e46494317a05058762da8a72e P 0bf9692a81414cfab64ee45b5393d57e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:29.266073  1330 raft_consensus.cc:740] T f7e4806e46494317a05058762da8a72e P 0bf9692a81414cfab64ee45b5393d57e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0bf9692a81414cfab64ee45b5393d57e, State: Running, Role: LEADER
I20260709 13:14:29.266862  1330 consensus_queue.cc:260] T f7e4806e46494317a05058762da8a72e P 0bf9692a81414cfab64ee45b5393d57e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:29.267798  1330 raft_consensus.cc:3060] T f7e4806e46494317a05058762da8a72e P 0bf9692a81414cfab64ee45b5393d57e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:29.270802  1255 raft_consensus.cc:2468] T f7e4806e46494317a05058762da8a72e P e4f6eab2337842428ba2670421465839 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40837fdefb66404b93c3e3876da432f7 in term 3.
I20260709 13:14:29.271808  1371 leader_election.cc:304] T f7e4806e46494317a05058762da8a72e P 40837fdefb66404b93c3e3876da432f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40837fdefb66404b93c3e3876da432f7, e4f6eab2337842428ba2670421465839; no voters: 
I20260709 13:14:29.272513  1694 raft_consensus.cc:2804] T f7e4806e46494317a05058762da8a72e P 40837fdefb66404b93c3e3876da432f7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:29.272917  1330 raft_consensus.cc:2468] T f7e4806e46494317a05058762da8a72e P 0bf9692a81414cfab64ee45b5393d57e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40837fdefb66404b93c3e3876da432f7 in term 3.
I20260709 13:14:29.273027  1694 raft_consensus.cc:697] T f7e4806e46494317a05058762da8a72e P 40837fdefb66404b93c3e3876da432f7 [term 3 LEADER]: Becoming Leader. State: Replica: 40837fdefb66404b93c3e3876da432f7, State: Running, Role: LEADER
I20260709 13:14:29.274061  1694 consensus_queue.cc:237] T f7e4806e46494317a05058762da8a72e P 40837fdefb66404b93c3e3876da432f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:29.280153  1154 catalog_manager.cc:5697] T f7e4806e46494317a05058762da8a72e P 40837fdefb66404b93c3e3876da432f7 reported cstate change: term changed from 2 to 3, leader changed from 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66) to 40837fdefb66404b93c3e3876da432f7 (127.23.140.67). New cstate: current_term: 3 leader_uuid: "40837fdefb66404b93c3e3876da432f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:29.387876  1330 raft_consensus.cc:1275] T aa6cc96673d4456da12d920cea7aa471 P 0bf9692a81414cfab64ee45b5393d57e [term 3 FOLLOWER]: Refusing update from remote peer 40837fdefb66404b93c3e3876da432f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:14:29.389101  1694 consensus_queue.cc:1048] T aa6cc96673d4456da12d920cea7aa471 P 40837fdefb66404b93c3e3876da432f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:29.391516  1255 raft_consensus.cc:1275] T aa6cc96673d4456da12d920cea7aa471 P e4f6eab2337842428ba2670421465839 [term 3 FOLLOWER]: Refusing update from remote peer 40837fdefb66404b93c3e3876da432f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:14:29.392843  1697 consensus_queue.cc:1048] T aa6cc96673d4456da12d920cea7aa471 P 40837fdefb66404b93c3e3876da432f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:29.417248  1662 raft_consensus.cc:993] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P e4f6eab2337842428ba2670421465839: : Instructing follower 40837fdefb66404b93c3e3876da432f7 to start an election
I20260709 13:14:29.417781  1662 raft_consensus.cc:1081] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P e4f6eab2337842428ba2670421465839 [term 2 LEADER]: Signalling peer 40837fdefb66404b93c3e3876da432f7 to start an election
I20260709 13:14:29.419258  1401 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6c40fe2ece564243aa8dc5b1fae8ecd8"
dest_uuid: "40837fdefb66404b93c3e3876da432f7"
 from {username='slave'} at 127.0.0.1:42006
I20260709 13:14:29.419811  1401 raft_consensus.cc:493] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 40837fdefb66404b93c3e3876da432f7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:29.420114  1401 raft_consensus.cc:3060] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 40837fdefb66404b93c3e3876da432f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:29.425290  1255 raft_consensus.cc:1275] T b20386846aee4ca5b9458883519bf06d P e4f6eab2337842428ba2670421465839 [term 3 FOLLOWER]: Refusing update from remote peer 40837fdefb66404b93c3e3876da432f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:29.425495  1401 raft_consensus.cc:515] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 40837fdefb66404b93c3e3876da432f7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:29.426589  1705 consensus_queue.cc:1048] T b20386846aee4ca5b9458883519bf06d P 40837fdefb66404b93c3e3876da432f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:29.428025  1255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40fe2ece564243aa8dc5b1fae8ecd8" candidate_uuid: "40837fdefb66404b93c3e3876da432f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e4f6eab2337842428ba2670421465839"
I20260709 13:14:29.428174  1401 leader_election.cc:290] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 40837fdefb66404b93c3e3876da432f7 [CANDIDATE]: Term 3 election: Requested vote from peers e4f6eab2337842428ba2670421465839 (127.23.140.65:45009), 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66:38395)
I20260709 13:14:29.428381  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40fe2ece564243aa8dc5b1fae8ecd8" candidate_uuid: "40837fdefb66404b93c3e3876da432f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0bf9692a81414cfab64ee45b5393d57e"
I20260709 13:14:29.428740  1255 raft_consensus.cc:3055] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P e4f6eab2337842428ba2670421465839 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:29.429039  1330 raft_consensus.cc:3060] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 0bf9692a81414cfab64ee45b5393d57e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:29.429165  1255 raft_consensus.cc:740] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P e4f6eab2337842428ba2670421465839 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e4f6eab2337842428ba2670421465839, State: Running, Role: LEADER
I20260709 13:14:29.430084  1255 consensus_queue.cc:260] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P e4f6eab2337842428ba2670421465839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:29.431025  1255 raft_consensus.cc:3060] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P e4f6eab2337842428ba2670421465839 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:29.434031  1330 raft_consensus.cc:2468] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 0bf9692a81414cfab64ee45b5393d57e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40837fdefb66404b93c3e3876da432f7 in term 3.
I20260709 13:14:29.435680  1370 leader_election.cc:304] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 40837fdefb66404b93c3e3876da432f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bf9692a81414cfab64ee45b5393d57e, 40837fdefb66404b93c3e3876da432f7; no voters: 
I20260709 13:14:29.436524  1705 raft_consensus.cc:2804] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 40837fdefb66404b93c3e3876da432f7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:29.436947  1705 raft_consensus.cc:697] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 40837fdefb66404b93c3e3876da432f7 [term 3 LEADER]: Becoming Leader. State: Replica: 40837fdefb66404b93c3e3876da432f7, State: Running, Role: LEADER
I20260709 13:14:29.436937  1255 raft_consensus.cc:2468] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P e4f6eab2337842428ba2670421465839 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40837fdefb66404b93c3e3876da432f7 in term 3.
I20260709 13:14:29.438009  1705 consensus_queue.cc:237] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 40837fdefb66404b93c3e3876da432f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } }
I20260709 13:14:29.445643  1330 raft_consensus.cc:1275] T b20386846aee4ca5b9458883519bf06d P 0bf9692a81414cfab64ee45b5393d57e [term 3 FOLLOWER]: Refusing update from remote peer 40837fdefb66404b93c3e3876da432f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:29.450100  1694 consensus_queue.cc:1048] T b20386846aee4ca5b9458883519bf06d P 40837fdefb66404b93c3e3876da432f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:29.463054  1155 catalog_manager.cc:5697] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 40837fdefb66404b93c3e3876da432f7 reported cstate change: term changed from 2 to 3, leader changed from e4f6eab2337842428ba2670421465839 (127.23.140.65) to 40837fdefb66404b93c3e3876da432f7 (127.23.140.67). New cstate: current_term: 3 leader_uuid: "40837fdefb66404b93c3e3876da432f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40837fdefb66404b93c3e3876da432f7" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 43689 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:29.658100  1256 raft_consensus.cc:1275] T f7e4806e46494317a05058762da8a72e P e4f6eab2337842428ba2670421465839 [term 3 FOLLOWER]: Refusing update from remote peer 40837fdefb66404b93c3e3876da432f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:14:29.659457  1694 consensus_queue.cc:1048] T f7e4806e46494317a05058762da8a72e P 40837fdefb66404b93c3e3876da432f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:29.663141  1330 raft_consensus.cc:1275] T f7e4806e46494317a05058762da8a72e P 0bf9692a81414cfab64ee45b5393d57e [term 3 FOLLOWER]: Refusing update from remote peer 40837fdefb66404b93c3e3876da432f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:14:29.666507  1705 consensus_queue.cc:1048] T f7e4806e46494317a05058762da8a72e P 40837fdefb66404b93c3e3876da432f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:29.840916  1256 raft_consensus.cc:1275] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P e4f6eab2337842428ba2670421465839 [term 3 FOLLOWER]: Refusing update from remote peer 40837fdefb66404b93c3e3876da432f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:29.842357  1705 consensus_queue.cc:1048] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 40837fdefb66404b93c3e3876da432f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f6eab2337842428ba2670421465839" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 45009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:29.851785  1330 raft_consensus.cc:1275] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 0bf9692a81414cfab64ee45b5393d57e [term 3 FOLLOWER]: Refusing update from remote peer 40837fdefb66404b93c3e3876da432f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:29.855403  1694 consensus_queue.cc:1048] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 40837fdefb66404b93c3e3876da432f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bf9692a81414cfab64ee45b5393d57e" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:29.987264 24113 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:14:29.992292 24113 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:14:29.992791 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:29.998557 24113 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:14:29.998932 24113 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:31.033216 24113 tablet_server.cc:179] TabletServer@127.23.140.65:0 shutting down...
I20260709 13:14:31.062515 24113 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:31.063258 24113 tablet_replica.cc:333] T f7e4806e46494317a05058762da8a72e P e4f6eab2337842428ba2670421465839: stopping tablet replica
I20260709 13:14:31.064091 24113 raft_consensus.cc:2243] T f7e4806e46494317a05058762da8a72e P e4f6eab2337842428ba2670421465839 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:31.064587 24113 raft_consensus.cc:2272] T f7e4806e46494317a05058762da8a72e P e4f6eab2337842428ba2670421465839 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:31.064628  1371 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 5 similar messages]
I20260709 13:14:31.067199 24113 tablet_replica.cc:333] T 02592ff6032f4ca6855608f5508444f6 P e4f6eab2337842428ba2670421465839: stopping tablet replica
W20260709 13:14:31.067780  1371 consensus_peers.cc:597] T f67b7f39bd9042a0bd72e32fbc31391d P 40837fdefb66404b93c3e3876da432f7 -> Peer e4f6eab2337842428ba2670421465839 (127.23.140.65:45009): Couldn't send request to peer e4f6eab2337842428ba2670421465839. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:31.068111 24113 raft_consensus.cc:2243] T 02592ff6032f4ca6855608f5508444f6 P e4f6eab2337842428ba2670421465839 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:31.068635 24113 raft_consensus.cc:2272] T 02592ff6032f4ca6855608f5508444f6 P e4f6eab2337842428ba2670421465839 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:31.070668 24113 tablet_replica.cc:333] T aa6cc96673d4456da12d920cea7aa471 P e4f6eab2337842428ba2670421465839: stopping tablet replica
I20260709 13:14:31.071354 24113 raft_consensus.cc:2243] T aa6cc96673d4456da12d920cea7aa471 P e4f6eab2337842428ba2670421465839 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:31.071774 24113 raft_consensus.cc:2272] T aa6cc96673d4456da12d920cea7aa471 P e4f6eab2337842428ba2670421465839 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:31.073709 24113 tablet_replica.cc:333] T fc60f59313bc4507bdf418cf4654ee3b P e4f6eab2337842428ba2670421465839: stopping tablet replica
I20260709 13:14:31.074404 24113 raft_consensus.cc:2243] T fc60f59313bc4507bdf418cf4654ee3b P e4f6eab2337842428ba2670421465839 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:31.075182 24113 raft_consensus.cc:2272] T fc60f59313bc4507bdf418cf4654ee3b P e4f6eab2337842428ba2670421465839 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:31.077152 24113 tablet_replica.cc:333] T 6d5b91e9a24a45ae90e730ae96c73317 P e4f6eab2337842428ba2670421465839: stopping tablet replica
I20260709 13:14:31.077700 24113 raft_consensus.cc:2243] T 6d5b91e9a24a45ae90e730ae96c73317 P e4f6eab2337842428ba2670421465839 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:31.078169 24113 raft_consensus.cc:2272] T 6d5b91e9a24a45ae90e730ae96c73317 P e4f6eab2337842428ba2670421465839 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:31.080789 24113 tablet_replica.cc:333] T 275bc525ace541a89e9b89c5bdda27db P e4f6eab2337842428ba2670421465839: stopping tablet replica
I20260709 13:14:31.081614 24113 raft_consensus.cc:2243] T 275bc525ace541a89e9b89c5bdda27db P e4f6eab2337842428ba2670421465839 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:31.082676 24113 raft_consensus.cc:2272] T 275bc525ace541a89e9b89c5bdda27db P e4f6eab2337842428ba2670421465839 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:31.084472 24113 tablet_replica.cc:333] T f67b7f39bd9042a0bd72e32fbc31391d P e4f6eab2337842428ba2670421465839: stopping tablet replica
I20260709 13:14:31.085054 24113 raft_consensus.cc:2243] T f67b7f39bd9042a0bd72e32fbc31391d P e4f6eab2337842428ba2670421465839 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:31.085474 24113 raft_consensus.cc:2272] T f67b7f39bd9042a0bd72e32fbc31391d P e4f6eab2337842428ba2670421465839 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:31.087769 24113 tablet_replica.cc:333] T f2cb95dd66b44bb7ad3bdb0f8970a24e P e4f6eab2337842428ba2670421465839: stopping tablet replica
I20260709 13:14:31.088447 24113 raft_consensus.cc:2243] T f2cb95dd66b44bb7ad3bdb0f8970a24e P e4f6eab2337842428ba2670421465839 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:31.088878 24113 raft_consensus.cc:2272] T f2cb95dd66b44bb7ad3bdb0f8970a24e P e4f6eab2337842428ba2670421465839 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:31.090708 24113 tablet_replica.cc:333] T 8b27a5294d34450aaff6336d315361c6 P e4f6eab2337842428ba2670421465839: stopping tablet replica
I20260709 13:14:31.091197 24113 raft_consensus.cc:2243] T 8b27a5294d34450aaff6336d315361c6 P e4f6eab2337842428ba2670421465839 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:31.091956 24113 raft_consensus.cc:2272] T 8b27a5294d34450aaff6336d315361c6 P e4f6eab2337842428ba2670421465839 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:31.094529 24113 tablet_replica.cc:333] T 500933c30a944235930b2ae50569922a P e4f6eab2337842428ba2670421465839: stopping tablet replica
I20260709 13:14:31.095211 24113 raft_consensus.cc:2243] T 500933c30a944235930b2ae50569922a P e4f6eab2337842428ba2670421465839 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:31.096228 24113 raft_consensus.cc:2272] T 500933c30a944235930b2ae50569922a P e4f6eab2337842428ba2670421465839 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:31.098757 24113 tablet_replica.cc:333] T d214f889325043f2a8a06bb04a45783c P e4f6eab2337842428ba2670421465839: stopping tablet replica
W20260709 13:14:31.098999  1371 consensus_peers.cc:597] T 6d5b91e9a24a45ae90e730ae96c73317 P 40837fdefb66404b93c3e3876da432f7 -> Peer e4f6eab2337842428ba2670421465839 (127.23.140.65:45009): Couldn't send request to peer e4f6eab2337842428ba2670421465839. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:31.099344 24113 raft_consensus.cc:2243] T d214f889325043f2a8a06bb04a45783c P e4f6eab2337842428ba2670421465839 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:31.100198 24113 raft_consensus.cc:2272] T d214f889325043f2a8a06bb04a45783c P e4f6eab2337842428ba2670421465839 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:31.102242 24113 tablet_replica.cc:333] T 05040be4aa904a3bb6bad07412e196eb P e4f6eab2337842428ba2670421465839: stopping tablet replica
I20260709 13:14:31.102811 24113 raft_consensus.cc:2243] T 05040be4aa904a3bb6bad07412e196eb P e4f6eab2337842428ba2670421465839 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:31.103276 24113 raft_consensus.cc:2272] T 05040be4aa904a3bb6bad07412e196eb P e4f6eab2337842428ba2670421465839 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:31.105281 24113 tablet_replica.cc:333] T 3a13635e2d594fb0bd31ac4039d4d2e0 P e4f6eab2337842428ba2670421465839: stopping tablet replica
I20260709 13:14:31.105819 24113 raft_consensus.cc:2243] T 3a13635e2d594fb0bd31ac4039d4d2e0 P e4f6eab2337842428ba2670421465839 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:31.106236 24113 raft_consensus.cc:2272] T 3a13635e2d594fb0bd31ac4039d4d2e0 P e4f6eab2337842428ba2670421465839 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:31.108078 24113 tablet_replica.cc:333] T b20386846aee4ca5b9458883519bf06d P e4f6eab2337842428ba2670421465839: stopping tablet replica
I20260709 13:14:31.108664 24113 raft_consensus.cc:2243] T b20386846aee4ca5b9458883519bf06d P e4f6eab2337842428ba2670421465839 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:31.109200 24113 raft_consensus.cc:2272] T b20386846aee4ca5b9458883519bf06d P e4f6eab2337842428ba2670421465839 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:31.111835 24113 tablet_replica.cc:333] T 82a1d9ee89c045d6ac3220d347e06972 P e4f6eab2337842428ba2670421465839: stopping tablet replica
I20260709 13:14:31.112466 24113 raft_consensus.cc:2243] T 82a1d9ee89c045d6ac3220d347e06972 P e4f6eab2337842428ba2670421465839 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:31.113018 24113 raft_consensus.cc:2272] T 82a1d9ee89c045d6ac3220d347e06972 P e4f6eab2337842428ba2670421465839 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:31.113345  1371 consensus_peers.cc:597] T f7e4806e46494317a05058762da8a72e P 40837fdefb66404b93c3e3876da432f7 -> Peer e4f6eab2337842428ba2670421465839 (127.23.140.65:45009): Couldn't send request to peer e4f6eab2337842428ba2670421465839. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:31.115520 24113 tablet_replica.cc:333] T 7dff7291733e401c805ffe3d5829f7f5 P e4f6eab2337842428ba2670421465839: stopping tablet replica
I20260709 13:14:31.116169 24113 raft_consensus.cc:2243] T 7dff7291733e401c805ffe3d5829f7f5 P e4f6eab2337842428ba2670421465839 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:31.116956 24113 raft_consensus.cc:2272] T 7dff7291733e401c805ffe3d5829f7f5 P e4f6eab2337842428ba2670421465839 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:31.118945 24113 tablet_replica.cc:333] T eeda95d1ada94d01aab3427f00d32570 P e4f6eab2337842428ba2670421465839: stopping tablet replica
I20260709 13:14:31.119421 24113 raft_consensus.cc:2243] T eeda95d1ada94d01aab3427f00d32570 P e4f6eab2337842428ba2670421465839 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:31.119829 24113 raft_consensus.cc:2272] T eeda95d1ada94d01aab3427f00d32570 P e4f6eab2337842428ba2670421465839 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:31.121627 24113 tablet_replica.cc:333] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P e4f6eab2337842428ba2670421465839: stopping tablet replica
I20260709 13:14:31.122080 24113 raft_consensus.cc:2243] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P e4f6eab2337842428ba2670421465839 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:31.122467 24113 raft_consensus.cc:2272] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P e4f6eab2337842428ba2670421465839 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:31.162949 24113 tablet_server.cc:196] TabletServer@127.23.140.65:0 shutdown complete.
W20260709 13:14:31.196461  1297 consensus_peers.cc:597] T f2cb95dd66b44bb7ad3bdb0f8970a24e P 0bf9692a81414cfab64ee45b5393d57e -> Peer e4f6eab2337842428ba2670421465839 (127.23.140.65:45009): Couldn't send request to peer e4f6eab2337842428ba2670421465839. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:45009: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:31.199450 24113 tablet_server.cc:179] TabletServer@127.23.140.66:0 shutting down...
I20260709 13:14:31.233657 24113 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:31.234591 24113 tablet_replica.cc:333] T f7e4806e46494317a05058762da8a72e P 0bf9692a81414cfab64ee45b5393d57e: stopping tablet replica
I20260709 13:14:31.235668 24113 raft_consensus.cc:2243] T f7e4806e46494317a05058762da8a72e P 0bf9692a81414cfab64ee45b5393d57e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:31.236104 24113 raft_consensus.cc:2272] T f7e4806e46494317a05058762da8a72e P 0bf9692a81414cfab64ee45b5393d57e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:31.238178 24113 tablet_replica.cc:333] T eeda95d1ada94d01aab3427f00d32570 P 0bf9692a81414cfab64ee45b5393d57e: stopping tablet replica
I20260709 13:14:31.238698 24113 raft_consensus.cc:2243] T eeda95d1ada94d01aab3427f00d32570 P 0bf9692a81414cfab64ee45b5393d57e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:31.239368 24113 raft_consensus.cc:2272] T eeda95d1ada94d01aab3427f00d32570 P 0bf9692a81414cfab64ee45b5393d57e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:31.241321 24113 tablet_replica.cc:333] T 02592ff6032f4ca6855608f5508444f6 P 0bf9692a81414cfab64ee45b5393d57e: stopping tablet replica
I20260709 13:14:31.241909 24113 raft_consensus.cc:2243] T 02592ff6032f4ca6855608f5508444f6 P 0bf9692a81414cfab64ee45b5393d57e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:31.242679 24113 raft_consensus.cc:2272] T 02592ff6032f4ca6855608f5508444f6 P 0bf9692a81414cfab64ee45b5393d57e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:31.244652 24113 tablet_replica.cc:333] T aa6cc96673d4456da12d920cea7aa471 P 0bf9692a81414cfab64ee45b5393d57e: stopping tablet replica
I20260709 13:14:31.245131 24113 raft_consensus.cc:2243] T aa6cc96673d4456da12d920cea7aa471 P 0bf9692a81414cfab64ee45b5393d57e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:31.245548 24113 raft_consensus.cc:2272] T aa6cc96673d4456da12d920cea7aa471 P 0bf9692a81414cfab64ee45b5393d57e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:31.247679 24113 tablet_replica.cc:333] T 275bc525ace541a89e9b89c5bdda27db P 0bf9692a81414cfab64ee45b5393d57e: stopping tablet replica
I20260709 13:14:31.248185 24113 raft_consensus.cc:2243] T 275bc525ace541a89e9b89c5bdda27db P 0bf9692a81414cfab64ee45b5393d57e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:31.248580 24113 raft_consensus.cc:2272] T 275bc525ace541a89e9b89c5bdda27db P 0bf9692a81414cfab64ee45b5393d57e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:31.250598 24113 tablet_replica.cc:333] T 6d5b91e9a24a45ae90e730ae96c73317 P 0bf9692a81414cfab64ee45b5393d57e: stopping tablet replica
I20260709 13:14:31.251097 24113 raft_consensus.cc:2243] T 6d5b91e9a24a45ae90e730ae96c73317 P 0bf9692a81414cfab64ee45b5393d57e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:31.251453 24113 raft_consensus.cc:2272] T 6d5b91e9a24a45ae90e730ae96c73317 P 0bf9692a81414cfab64ee45b5393d57e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:31.253293 24113 tablet_replica.cc:333] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 0bf9692a81414cfab64ee45b5393d57e: stopping tablet replica
I20260709 13:14:31.253741 24113 raft_consensus.cc:2243] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 0bf9692a81414cfab64ee45b5393d57e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:31.254513 24113 raft_consensus.cc:2272] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 0bf9692a81414cfab64ee45b5393d57e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:31.256333 24113 tablet_replica.cc:333] T b20386846aee4ca5b9458883519bf06d P 0bf9692a81414cfab64ee45b5393d57e: stopping tablet replica
I20260709 13:14:31.256816 24113 raft_consensus.cc:2243] T b20386846aee4ca5b9458883519bf06d P 0bf9692a81414cfab64ee45b5393d57e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:31.257159 24113 raft_consensus.cc:2272] T b20386846aee4ca5b9458883519bf06d P 0bf9692a81414cfab64ee45b5393d57e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:31.259331 24113 tablet_replica.cc:333] T d214f889325043f2a8a06bb04a45783c P 0bf9692a81414cfab64ee45b5393d57e: stopping tablet replica
I20260709 13:14:31.259883 24113 raft_consensus.cc:2243] T d214f889325043f2a8a06bb04a45783c P 0bf9692a81414cfab64ee45b5393d57e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:31.260306 24113 raft_consensus.cc:2272] T d214f889325043f2a8a06bb04a45783c P 0bf9692a81414cfab64ee45b5393d57e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:31.262270 24113 tablet_replica.cc:333] T 500933c30a944235930b2ae50569922a P 0bf9692a81414cfab64ee45b5393d57e: stopping tablet replica
I20260709 13:14:31.262805 24113 raft_consensus.cc:2243] T 500933c30a944235930b2ae50569922a P 0bf9692a81414cfab64ee45b5393d57e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:31.263216 24113 raft_consensus.cc:2272] T 500933c30a944235930b2ae50569922a P 0bf9692a81414cfab64ee45b5393d57e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:31.265161 24113 tablet_replica.cc:333] T 05040be4aa904a3bb6bad07412e196eb P 0bf9692a81414cfab64ee45b5393d57e: stopping tablet replica
I20260709 13:14:31.265628 24113 raft_consensus.cc:2243] T 05040be4aa904a3bb6bad07412e196eb P 0bf9692a81414cfab64ee45b5393d57e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:31.266456 24113 raft_consensus.cc:2272] T 05040be4aa904a3bb6bad07412e196eb P 0bf9692a81414cfab64ee45b5393d57e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:31.268460 24113 tablet_replica.cc:333] T 8b27a5294d34450aaff6336d315361c6 P 0bf9692a81414cfab64ee45b5393d57e: stopping tablet replica
I20260709 13:14:31.268955 24113 raft_consensus.cc:2243] T 8b27a5294d34450aaff6336d315361c6 P 0bf9692a81414cfab64ee45b5393d57e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:31.269366 24113 raft_consensus.cc:2272] T 8b27a5294d34450aaff6336d315361c6 P 0bf9692a81414cfab64ee45b5393d57e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:31.271260 24113 tablet_replica.cc:333] T fc60f59313bc4507bdf418cf4654ee3b P 0bf9692a81414cfab64ee45b5393d57e: stopping tablet replica
I20260709 13:14:31.271730 24113 raft_consensus.cc:2243] T fc60f59313bc4507bdf418cf4654ee3b P 0bf9692a81414cfab64ee45b5393d57e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:31.272111 24113 raft_consensus.cc:2272] T fc60f59313bc4507bdf418cf4654ee3b P 0bf9692a81414cfab64ee45b5393d57e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:31.274012 24113 tablet_replica.cc:333] T 82a1d9ee89c045d6ac3220d347e06972 P 0bf9692a81414cfab64ee45b5393d57e: stopping tablet replica
I20260709 13:14:31.274456 24113 raft_consensus.cc:2243] T 82a1d9ee89c045d6ac3220d347e06972 P 0bf9692a81414cfab64ee45b5393d57e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:31.275200 24113 raft_consensus.cc:2272] T 82a1d9ee89c045d6ac3220d347e06972 P 0bf9692a81414cfab64ee45b5393d57e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:31.277642 24113 tablet_replica.cc:333] T 7dff7291733e401c805ffe3d5829f7f5 P 0bf9692a81414cfab64ee45b5393d57e: stopping tablet replica
I20260709 13:14:31.278384 24113 raft_consensus.cc:2243] T 7dff7291733e401c805ffe3d5829f7f5 P 0bf9692a81414cfab64ee45b5393d57e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:31.278927 24113 raft_consensus.cc:2272] T 7dff7291733e401c805ffe3d5829f7f5 P 0bf9692a81414cfab64ee45b5393d57e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:31.280413  1370 consensus_peers.cc:597] T f7e4806e46494317a05058762da8a72e P 40837fdefb66404b93c3e3876da432f7 -> Peer 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66:38395): Couldn't send request to peer 0bf9692a81414cfab64ee45b5393d57e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:31.281661 24113 tablet_replica.cc:333] T f67b7f39bd9042a0bd72e32fbc31391d P 0bf9692a81414cfab64ee45b5393d57e: stopping tablet replica
I20260709 13:14:31.282352 24113 raft_consensus.cc:2243] T f67b7f39bd9042a0bd72e32fbc31391d P 0bf9692a81414cfab64ee45b5393d57e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:31.282811 24113 raft_consensus.cc:2272] T f67b7f39bd9042a0bd72e32fbc31391d P 0bf9692a81414cfab64ee45b5393d57e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:31.285285 24113 tablet_replica.cc:333] T f2cb95dd66b44bb7ad3bdb0f8970a24e P 0bf9692a81414cfab64ee45b5393d57e: stopping tablet replica
I20260709 13:14:31.285908 24113 raft_consensus.cc:2243] T f2cb95dd66b44bb7ad3bdb0f8970a24e P 0bf9692a81414cfab64ee45b5393d57e [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:14:31.285936  1371 consensus_peers.cc:597] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 40837fdefb66404b93c3e3876da432f7 -> Peer e4f6eab2337842428ba2670421465839 (127.23.140.65:45009): Couldn't send request to peer e4f6eab2337842428ba2670421465839. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:45009: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:31.286727 24113 raft_consensus.cc:2272] T f2cb95dd66b44bb7ad3bdb0f8970a24e P 0bf9692a81414cfab64ee45b5393d57e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:31.288801 24113 tablet_replica.cc:333] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 0bf9692a81414cfab64ee45b5393d57e: stopping tablet replica
I20260709 13:14:31.289294 24113 raft_consensus.cc:2243] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 0bf9692a81414cfab64ee45b5393d57e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:31.289729 24113 raft_consensus.cc:2272] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 0bf9692a81414cfab64ee45b5393d57e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:31.329452 24113 tablet_server.cc:196] TabletServer@127.23.140.66:0 shutdown complete.
I20260709 13:14:31.363866 24113 tablet_server.cc:179] TabletServer@127.23.140.67:0 shutting down...
W20260709 13:14:31.364770  1370 consensus_peers.cc:597] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 40837fdefb66404b93c3e3876da432f7 -> Peer 0bf9692a81414cfab64ee45b5393d57e (127.23.140.66:38395): Couldn't send request to peer 0bf9692a81414cfab64ee45b5393d57e. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.66:38395: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:31.389709  1371 consensus_peers.cc:597] T aa6cc96673d4456da12d920cea7aa471 P 40837fdefb66404b93c3e3876da432f7 -> Peer e4f6eab2337842428ba2670421465839 (127.23.140.65:45009): Couldn't send request to peer e4f6eab2337842428ba2670421465839. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:45009: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:31.399788  1371 consensus_peers.cc:597] T b20386846aee4ca5b9458883519bf06d P 40837fdefb66404b93c3e3876da432f7 -> Peer e4f6eab2337842428ba2670421465839 (127.23.140.65:45009): Couldn't send request to peer e4f6eab2337842428ba2670421465839. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:45009: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:31.402038 24113 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:31.402860 24113 tablet_replica.cc:333] T f7e4806e46494317a05058762da8a72e P 40837fdefb66404b93c3e3876da432f7: stopping tablet replica
I20260709 13:14:31.403678 24113 raft_consensus.cc:2243] T f7e4806e46494317a05058762da8a72e P 40837fdefb66404b93c3e3876da432f7 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:31.404410 24113 raft_consensus.cc:2272] T f7e4806e46494317a05058762da8a72e P 40837fdefb66404b93c3e3876da432f7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:31.406373 24113 tablet_replica.cc:333] T 02592ff6032f4ca6855608f5508444f6 P 40837fdefb66404b93c3e3876da432f7: stopping tablet replica
I20260709 13:14:31.406888 24113 raft_consensus.cc:2243] T 02592ff6032f4ca6855608f5508444f6 P 40837fdefb66404b93c3e3876da432f7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:31.407413 24113 raft_consensus.cc:2272] T 02592ff6032f4ca6855608f5508444f6 P 40837fdefb66404b93c3e3876da432f7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:31.409610 24113 tablet_replica.cc:333] T eeda95d1ada94d01aab3427f00d32570 P 40837fdefb66404b93c3e3876da432f7: stopping tablet replica
I20260709 13:14:31.410158 24113 raft_consensus.cc:2243] T eeda95d1ada94d01aab3427f00d32570 P 40837fdefb66404b93c3e3876da432f7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:31.410609 24113 raft_consensus.cc:2272] T eeda95d1ada94d01aab3427f00d32570 P 40837fdefb66404b93c3e3876da432f7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:31.412375 24113 tablet_replica.cc:333] T aa6cc96673d4456da12d920cea7aa471 P 40837fdefb66404b93c3e3876da432f7: stopping tablet replica
I20260709 13:14:31.412911 24113 raft_consensus.cc:2243] T aa6cc96673d4456da12d920cea7aa471 P 40837fdefb66404b93c3e3876da432f7 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:31.413641 24113 raft_consensus.cc:2272] T aa6cc96673d4456da12d920cea7aa471 P 40837fdefb66404b93c3e3876da432f7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:31.415556 24113 tablet_replica.cc:333] T 275bc525ace541a89e9b89c5bdda27db P 40837fdefb66404b93c3e3876da432f7: stopping tablet replica
I20260709 13:14:31.416111 24113 raft_consensus.cc:2243] T 275bc525ace541a89e9b89c5bdda27db P 40837fdefb66404b93c3e3876da432f7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:31.416606 24113 raft_consensus.cc:2272] T 275bc525ace541a89e9b89c5bdda27db P 40837fdefb66404b93c3e3876da432f7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:31.418673 24113 tablet_replica.cc:333] T 6d5b91e9a24a45ae90e730ae96c73317 P 40837fdefb66404b93c3e3876da432f7: stopping tablet replica
I20260709 13:14:31.419237 24113 raft_consensus.cc:2243] T 6d5b91e9a24a45ae90e730ae96c73317 P 40837fdefb66404b93c3e3876da432f7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:31.420017 24113 raft_consensus.cc:2272] T 6d5b91e9a24a45ae90e730ae96c73317 P 40837fdefb66404b93c3e3876da432f7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:31.422065 24113 tablet_replica.cc:333] T f67b7f39bd9042a0bd72e32fbc31391d P 40837fdefb66404b93c3e3876da432f7: stopping tablet replica
I20260709 13:14:31.422608 24113 raft_consensus.cc:2243] T f67b7f39bd9042a0bd72e32fbc31391d P 40837fdefb66404b93c3e3876da432f7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:31.423245 24113 raft_consensus.cc:2272] T f67b7f39bd9042a0bd72e32fbc31391d P 40837fdefb66404b93c3e3876da432f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:31.425205 24113 tablet_replica.cc:333] T f2cb95dd66b44bb7ad3bdb0f8970a24e P 40837fdefb66404b93c3e3876da432f7: stopping tablet replica
I20260709 13:14:31.425906 24113 raft_consensus.cc:2243] T f2cb95dd66b44bb7ad3bdb0f8970a24e P 40837fdefb66404b93c3e3876da432f7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:31.426381 24113 raft_consensus.cc:2272] T f2cb95dd66b44bb7ad3bdb0f8970a24e P 40837fdefb66404b93c3e3876da432f7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:31.428407 24113 tablet_replica.cc:333] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 40837fdefb66404b93c3e3876da432f7: stopping tablet replica
I20260709 13:14:31.428994 24113 raft_consensus.cc:2243] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 40837fdefb66404b93c3e3876da432f7 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:31.429842 24113 raft_consensus.cc:2272] T 6c40fe2ece564243aa8dc5b1fae8ecd8 P 40837fdefb66404b93c3e3876da432f7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:31.431852 24113 tablet_replica.cc:333] T fc60f59313bc4507bdf418cf4654ee3b P 40837fdefb66404b93c3e3876da432f7: stopping tablet replica
I20260709 13:14:31.432474 24113 raft_consensus.cc:2243] T fc60f59313bc4507bdf418cf4654ee3b P 40837fdefb66404b93c3e3876da432f7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:31.432942 24113 raft_consensus.cc:2272] T fc60f59313bc4507bdf418cf4654ee3b P 40837fdefb66404b93c3e3876da432f7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:31.434913 24113 tablet_replica.cc:333] T 7dff7291733e401c805ffe3d5829f7f5 P 40837fdefb66404b93c3e3876da432f7: stopping tablet replica
I20260709 13:14:31.435618 24113 raft_consensus.cc:2243] T 7dff7291733e401c805ffe3d5829f7f5 P 40837fdefb66404b93c3e3876da432f7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:31.436120 24113 raft_consensus.cc:2272] T 7dff7291733e401c805ffe3d5829f7f5 P 40837fdefb66404b93c3e3876da432f7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:31.438403 24113 tablet_replica.cc:333] T 82a1d9ee89c045d6ac3220d347e06972 P 40837fdefb66404b93c3e3876da432f7: stopping tablet replica
I20260709 13:14:31.438957 24113 raft_consensus.cc:2243] T 82a1d9ee89c045d6ac3220d347e06972 P 40837fdefb66404b93c3e3876da432f7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:31.439450 24113 raft_consensus.cc:2272] T 82a1d9ee89c045d6ac3220d347e06972 P 40837fdefb66404b93c3e3876da432f7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:31.441524 24113 tablet_replica.cc:333] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 40837fdefb66404b93c3e3876da432f7: stopping tablet replica
I20260709 13:14:31.442075 24113 raft_consensus.cc:2243] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 40837fdefb66404b93c3e3876da432f7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:31.442524 24113 raft_consensus.cc:2272] T 3a13635e2d594fb0bd31ac4039d4d2e0 P 40837fdefb66404b93c3e3876da432f7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:31.444775 24113 tablet_replica.cc:333] T b20386846aee4ca5b9458883519bf06d P 40837fdefb66404b93c3e3876da432f7: stopping tablet replica
I20260709 13:14:31.445339 24113 raft_consensus.cc:2243] T b20386846aee4ca5b9458883519bf06d P 40837fdefb66404b93c3e3876da432f7 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:31.446200 24113 raft_consensus.cc:2272] T b20386846aee4ca5b9458883519bf06d P 40837fdefb66404b93c3e3876da432f7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:31.448199 24113 tablet_replica.cc:333] T 500933c30a944235930b2ae50569922a P 40837fdefb66404b93c3e3876da432f7: stopping tablet replica
I20260709 13:14:31.448743 24113 raft_consensus.cc:2243] T 500933c30a944235930b2ae50569922a P 40837fdefb66404b93c3e3876da432f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:31.449186 24113 raft_consensus.cc:2272] T 500933c30a944235930b2ae50569922a P 40837fdefb66404b93c3e3876da432f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:31.451164 24113 tablet_replica.cc:333] T d214f889325043f2a8a06bb04a45783c P 40837fdefb66404b93c3e3876da432f7: stopping tablet replica
I20260709 13:14:31.451670 24113 raft_consensus.cc:2243] T d214f889325043f2a8a06bb04a45783c P 40837fdefb66404b93c3e3876da432f7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:31.452122 24113 raft_consensus.cc:2272] T d214f889325043f2a8a06bb04a45783c P 40837fdefb66404b93c3e3876da432f7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:31.453927 24113 tablet_replica.cc:333] T 05040be4aa904a3bb6bad07412e196eb P 40837fdefb66404b93c3e3876da432f7: stopping tablet replica
I20260709 13:14:31.454450 24113 raft_consensus.cc:2243] T 05040be4aa904a3bb6bad07412e196eb P 40837fdefb66404b93c3e3876da432f7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:31.454900 24113 raft_consensus.cc:2272] T 05040be4aa904a3bb6bad07412e196eb P 40837fdefb66404b93c3e3876da432f7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:31.456929 24113 tablet_replica.cc:333] T 8b27a5294d34450aaff6336d315361c6 P 40837fdefb66404b93c3e3876da432f7: stopping tablet replica
I20260709 13:14:31.457408 24113 raft_consensus.cc:2243] T 8b27a5294d34450aaff6336d315361c6 P 40837fdefb66404b93c3e3876da432f7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:31.457878 24113 raft_consensus.cc:2272] T 8b27a5294d34450aaff6336d315361c6 P 40837fdefb66404b93c3e3876da432f7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:31.498214 24113 tablet_server.cc:196] TabletServer@127.23.140.67:0 shutdown complete.
I20260709 13:14:31.531729 24113 master.cc:562] Master@127.23.140.126:38967 shutting down...
I20260709 13:14:31.553722 24113 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 2aba176642564658a9700187a3b3d6f0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:31.554284 24113 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 2aba176642564658a9700187a3b3d6f0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:31.554556 24113 tablet_replica.cc:333] T 00000000000000000000000000000000 P 2aba176642564658a9700187a3b3d6f0: stopping tablet replica
I20260709 13:14:31.575376 24113 master.cc:584] Master@127.23.140.126:38967 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (12247 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:14:31.630558 24113 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.23.140.126:41811
I20260709 13:14:31.631637 24113 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:31.637724  1721 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:31.637837  1722 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:31.638515  1724 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:31.639354 24113 server_base.cc:1061] running on GCE node
I20260709 13:14:31.640269 24113 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:31.640460 24113 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:31.640574 24113 hybrid_clock.cc:648] HybridClock initialized: now 1783602871640563 us; error 0 us; skew 500 ppm
I20260709 13:14:31.641007 24113 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:31.643620 24113 webserver.cc:533] Webserver started at http://127.23.140.126:37235/ using document root <none> and password file <none>
I20260709 13:14:31.644078 24113 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:31.644241 24113 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:31.644454 24113 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:31.645454 24113 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602598684750-24113-0/minicluster-data/master-0-root/instance:
uuid: "def666c72a25488f80473d75cdada3a6"
format_stamp: "Formatted at 2026-07-09 13:14:31 on dist-test-slave-1rs3"
I20260709 13:14:31.650401 24113 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.002s
I20260709 13:14:31.653714  1729 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:31.654524 24113 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:14:31.654769 24113 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602598684750-24113-0/minicluster-data/master-0-root
uuid: "def666c72a25488f80473d75cdada3a6"
format_stamp: "Formatted at 2026-07-09 13:14:31 on dist-test-slave-1rs3"
I20260709 13:14:31.655004 24113 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602598684750-24113-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602598684750-24113-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602598684750-24113-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:31.675352 24113 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:31.676538 24113 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:31.713534 24113 rpc_server.cc:307] RPC server started. Bound to: 127.23.140.126:41811
I20260709 13:14:31.713646  1780 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.140.126:41811 every 8 connection(s)
I20260709 13:14:31.717454  1781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:31.727960  1781 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P def666c72a25488f80473d75cdada3a6: Bootstrap starting.
I20260709 13:14:31.732865  1781 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P def666c72a25488f80473d75cdada3a6: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:31.737094  1781 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P def666c72a25488f80473d75cdada3a6: No bootstrap required, opened a new log
I20260709 13:14:31.739308  1781 raft_consensus.cc:359] T 00000000000000000000000000000000 P def666c72a25488f80473d75cdada3a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "def666c72a25488f80473d75cdada3a6" member_type: VOTER }
I20260709 13:14:31.739704  1781 raft_consensus.cc:385] T 00000000000000000000000000000000 P def666c72a25488f80473d75cdada3a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:31.739943  1781 raft_consensus.cc:740] T 00000000000000000000000000000000 P def666c72a25488f80473d75cdada3a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: def666c72a25488f80473d75cdada3a6, State: Initialized, Role: FOLLOWER
I20260709 13:14:31.740496  1781 consensus_queue.cc:260] T 00000000000000000000000000000000 P def666c72a25488f80473d75cdada3a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "def666c72a25488f80473d75cdada3a6" member_type: VOTER }
I20260709 13:14:31.740957  1781 raft_consensus.cc:399] T 00000000000000000000000000000000 P def666c72a25488f80473d75cdada3a6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:14:31.741175  1781 raft_consensus.cc:493] T 00000000000000000000000000000000 P def666c72a25488f80473d75cdada3a6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:14:31.741451  1781 raft_consensus.cc:3060] T 00000000000000000000000000000000 P def666c72a25488f80473d75cdada3a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:31.746111  1781 raft_consensus.cc:515] T 00000000000000000000000000000000 P def666c72a25488f80473d75cdada3a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "def666c72a25488f80473d75cdada3a6" member_type: VOTER }
I20260709 13:14:31.746661  1781 leader_election.cc:304] T 00000000000000000000000000000000 P def666c72a25488f80473d75cdada3a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: def666c72a25488f80473d75cdada3a6; no voters: 
I20260709 13:14:31.747735  1781 leader_election.cc:290] T 00000000000000000000000000000000 P def666c72a25488f80473d75cdada3a6 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:14:31.748071  1784 raft_consensus.cc:2804] T 00000000000000000000000000000000 P def666c72a25488f80473d75cdada3a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:31.749480  1784 raft_consensus.cc:697] T 00000000000000000000000000000000 P def666c72a25488f80473d75cdada3a6 [term 1 LEADER]: Becoming Leader. State: Replica: def666c72a25488f80473d75cdada3a6, State: Running, Role: LEADER
I20260709 13:14:31.750113  1784 consensus_queue.cc:237] T 00000000000000000000000000000000 P def666c72a25488f80473d75cdada3a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "def666c72a25488f80473d75cdada3a6" member_type: VOTER }
I20260709 13:14:31.750671  1781 sys_catalog.cc:565] T 00000000000000000000000000000000 P def666c72a25488f80473d75cdada3a6 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:14:31.754415  1785 sys_catalog.cc:455] T 00000000000000000000000000000000 P def666c72a25488f80473d75cdada3a6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "def666c72a25488f80473d75cdada3a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "def666c72a25488f80473d75cdada3a6" member_type: VOTER } }
I20260709 13:14:31.755271  1786 sys_catalog.cc:455] T 00000000000000000000000000000000 P def666c72a25488f80473d75cdada3a6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader def666c72a25488f80473d75cdada3a6. Latest consensus state: current_term: 1 leader_uuid: "def666c72a25488f80473d75cdada3a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "def666c72a25488f80473d75cdada3a6" member_type: VOTER } }
I20260709 13:14:31.755848  1785 sys_catalog.cc:458] T 00000000000000000000000000000000 P def666c72a25488f80473d75cdada3a6 [sys.catalog]: This master's current role is: LEADER
I20260709 13:14:31.755848  1786 sys_catalog.cc:458] T 00000000000000000000000000000000 P def666c72a25488f80473d75cdada3a6 [sys.catalog]: This master's current role is: LEADER
I20260709 13:14:31.758222  1791 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:14:31.763052  1791 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:14:31.766462 24113 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:14:31.771984  1791 catalog_manager.cc:1383] Generated new cluster ID: eb54775b3fc9428b8a65ecec7bf6d408
I20260709 13:14:31.772256  1791 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:14:31.785544  1791 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:14:31.786775  1791 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:14:31.800171  1791 catalog_manager.cc:6070] T 00000000000000000000000000000000 P def666c72a25488f80473d75cdada3a6: Generated new TSK 0
I20260709 13:14:31.800820  1791 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:14:31.833957 24113 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:31.840080  1802 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:31.841245  1803 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:31.842890  1805 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:31.843122 24113 server_base.cc:1061] running on GCE node
I20260709 13:14:31.844210 24113 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:31.844421 24113 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:31.844614 24113 hybrid_clock.cc:648] HybridClock initialized: now 1783602871844598 us; error 0 us; skew 500 ppm
I20260709 13:14:31.845168 24113 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:31.847667 24113 webserver.cc:533] Webserver started at http://127.23.140.65:39089/ using document root <none> and password file <none>
I20260709 13:14:31.848147 24113 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:31.848306 24113 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:31.848616 24113 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:31.849713 24113 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602598684750-24113-0/minicluster-data/ts-0-root/instance:
uuid: "efd77f14978b4b49880b1a39abc66987"
format_stamp: "Formatted at 2026-07-09 13:14:31 on dist-test-slave-1rs3"
I20260709 13:14:31.854494 24113 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:14:31.857914  1810 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:31.858599 24113 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:14:31.858906 24113 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602598684750-24113-0/minicluster-data/ts-0-root
uuid: "efd77f14978b4b49880b1a39abc66987"
format_stamp: "Formatted at 2026-07-09 13:14:31 on dist-test-slave-1rs3"
I20260709 13:14:31.859144 24113 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602598684750-24113-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602598684750-24113-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602598684750-24113-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:31.871407 24113 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:31.872625 24113 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:31.874058 24113 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:31.876204 24113 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:31.876415 24113 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:31.876658 24113 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:31.876844 24113 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:31.917224 24113 rpc_server.cc:307] RPC server started. Bound to: 127.23.140.65:41453
I20260709 13:14:31.917327  1872 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.140.65:41453 every 8 connection(s)
I20260709 13:14:31.922302 24113 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:31.931298  1878 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:31.932327  1877 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:31.936617  1873 heartbeater.cc:344] Connected to a master server at 127.23.140.126:41811
W20260709 13:14:31.936726  1880 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:31.937126  1873 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:31.937399 24113 server_base.cc:1061] running on GCE node
I20260709 13:14:31.938169  1873 heartbeater.cc:507] Master 127.23.140.126:41811 requested a full tablet report, sending...
I20260709 13:14:31.938664 24113 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:31.938953 24113 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:31.939157 24113 hybrid_clock.cc:648] HybridClock initialized: now 1783602871939137 us; error 0 us; skew 500 ppm
I20260709 13:14:31.939906 24113 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:31.940593  1746 ts_manager.cc:194] Registered new tserver with Master: efd77f14978b4b49880b1a39abc66987 (127.23.140.65:41453)
I20260709 13:14:31.942467 24113 webserver.cc:533] Webserver started at http://127.23.140.66:34737/ using document root <none> and password file <none>
I20260709 13:14:31.942847  1746 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36526
I20260709 13:14:31.942994 24113 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:31.943336 24113 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:31.943615 24113 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:31.945155 24113 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602598684750-24113-0/minicluster-data/ts-1-root/instance:
uuid: "cfdfd9c3b64347f997e5d181c39fddcd"
format_stamp: "Formatted at 2026-07-09 13:14:31 on dist-test-slave-1rs3"
I20260709 13:14:31.949599 24113 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.001s
I20260709 13:14:31.953009  1885 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:31.953826 24113 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:14:31.954089 24113 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602598684750-24113-0/minicluster-data/ts-1-root
uuid: "cfdfd9c3b64347f997e5d181c39fddcd"
format_stamp: "Formatted at 2026-07-09 13:14:31 on dist-test-slave-1rs3"
I20260709 13:14:31.954334 24113 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602598684750-24113-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602598684750-24113-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602598684750-24113-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:31.971948 24113 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:31.973098 24113 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:31.974691 24113 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:31.976852 24113 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:31.977069 24113 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:31.977322 24113 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:31.977495 24113 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:32.016916 24113 rpc_server.cc:307] RPC server started. Bound to: 127.23.140.66:43351
I20260709 13:14:32.017042  1947 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.140.66:43351 every 8 connection(s)
I20260709 13:14:32.021931 24113 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:32.029605  1951 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:32.033126  1952 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:32.033897  1948 heartbeater.cc:344] Connected to a master server at 127.23.140.126:41811
I20260709 13:14:32.034545  1948 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:32.035717  1948 heartbeater.cc:507] Master 127.23.140.126:41811 requested a full tablet report, sending...
W20260709 13:14:32.035943  1954 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:32.036804 24113 server_base.cc:1061] running on GCE node
I20260709 13:14:32.037979 24113 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:32.038240 24113 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:32.038232  1746 ts_manager.cc:194] Registered new tserver with Master: cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66:43351)
I20260709 13:14:32.038722 24113 hybrid_clock.cc:648] HybridClock initialized: now 1783602872038701 us; error 0 us; skew 500 ppm
I20260709 13:14:32.039543 24113 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:32.040251  1746 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36528
I20260709 13:14:32.042328 24113 webserver.cc:533] Webserver started at http://127.23.140.67:37985/ using document root <none> and password file <none>
I20260709 13:14:32.043025 24113 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:32.043210 24113 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:32.043435 24113 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:32.044557 24113 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602598684750-24113-0/minicluster-data/ts-2-root/instance:
uuid: "4cfc2f643a0a46888b750e0ab7b7fde6"
format_stamp: "Formatted at 2026-07-09 13:14:32 on dist-test-slave-1rs3"
I20260709 13:14:32.048974 24113 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 13:14:32.052209  1959 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:32.053089 24113 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:14:32.053370 24113 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602598684750-24113-0/minicluster-data/ts-2-root
uuid: "4cfc2f643a0a46888b750e0ab7b7fde6"
format_stamp: "Formatted at 2026-07-09 13:14:32 on dist-test-slave-1rs3"
I20260709 13:14:32.053612 24113 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602598684750-24113-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602598684750-24113-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskBYx3Tp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602598684750-24113-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:32.086916 24113 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:32.088124 24113 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:32.089535 24113 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:32.091744 24113 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:32.091958 24113 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:32.092236 24113 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:32.092396 24113 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:32.131564 24113 rpc_server.cc:307] RPC server started. Bound to: 127.23.140.67:33709
I20260709 13:14:32.131675  2021 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.140.67:33709 every 8 connection(s)
I20260709 13:14:32.144968  2022 heartbeater.cc:344] Connected to a master server at 127.23.140.126:41811
I20260709 13:14:32.145388  2022 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:32.146068  2022 heartbeater.cc:507] Master 127.23.140.126:41811 requested a full tablet report, sending...
I20260709 13:14:32.147897  1746 ts_manager.cc:194] Registered new tserver with Master: 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67:33709)
I20260709 13:14:32.148401 24113 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013561016s
I20260709 13:14:32.149641  1746 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36538
I20260709 13:14:32.174707  1746 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36548:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:14:32.177300  1746 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:14:32.245357  1987 tablet_service.cc:1511] Processing CreateTablet for tablet 6b8eac6adeda4c8a9e8e4142a9b86feb (DEFAULT_TABLE table=test-workload [id=ee147dd1beed4b2182ca6782408c28eb]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:14:32.247177  1987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b8eac6adeda4c8a9e8e4142a9b86feb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.251588  1986 tablet_service.cc:1511] Processing CreateTablet for tablet b06ca2d520f7457692822190ac2a8f32 (DEFAULT_TABLE table=test-workload [id=ee147dd1beed4b2182ca6782408c28eb]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:14:32.253158  1986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b06ca2d520f7457692822190ac2a8f32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.260486  1985 tablet_service.cc:1511] Processing CreateTablet for tablet 3454c9475988492d863379ed4177d7c3 (DEFAULT_TABLE table=test-workload [id=ee147dd1beed4b2182ca6782408c28eb]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:14:32.262341  1985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3454c9475988492d863379ed4177d7c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.267468  1984 tablet_service.cc:1511] Processing CreateTablet for tablet b16576d7015c475fb71585c29048e5a9 (DEFAULT_TABLE table=test-workload [id=ee147dd1beed4b2182ca6782408c28eb]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:14:32.268968  1984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b16576d7015c475fb71585c29048e5a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.272575  1983 tablet_service.cc:1511] Processing CreateTablet for tablet fe7a5d3b676046eba775b5d39c4c1cd9 (DEFAULT_TABLE table=test-workload [id=ee147dd1beed4b2182ca6782408c28eb]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:14:32.274078  1983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe7a5d3b676046eba775b5d39c4c1cd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.274966  1838 tablet_service.cc:1511] Processing CreateTablet for tablet 6b8eac6adeda4c8a9e8e4142a9b86feb (DEFAULT_TABLE table=test-workload [id=ee147dd1beed4b2182ca6782408c28eb]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:14:32.275578  1909 tablet_service.cc:1511] Processing CreateTablet for tablet fe7a5d3b676046eba775b5d39c4c1cd9 (DEFAULT_TABLE table=test-workload [id=ee147dd1beed4b2182ca6782408c28eb]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:14:32.276417  1838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b8eac6adeda4c8a9e8e4142a9b86feb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.276180  1912 tablet_service.cc:1511] Processing CreateTablet for tablet b06ca2d520f7457692822190ac2a8f32 (DEFAULT_TABLE table=test-workload [id=ee147dd1beed4b2182ca6782408c28eb]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:14:32.276968  1909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe7a5d3b676046eba775b5d39c4c1cd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.277573  1912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b06ca2d520f7457692822190ac2a8f32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.286708  1908 tablet_service.cc:1511] Processing CreateTablet for tablet 2f141c8bf4624551b8906e0469e6c4d8 (DEFAULT_TABLE table=test-workload [id=ee147dd1beed4b2182ca6782408c28eb]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:14:32.288107  1908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f141c8bf4624551b8906e0469e6c4d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.278997  1834 tablet_service.cc:1511] Processing CreateTablet for tablet fe7a5d3b676046eba775b5d39c4c1cd9 (DEFAULT_TABLE table=test-workload [id=ee147dd1beed4b2182ca6782408c28eb]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:14:32.279078  1837 tablet_service.cc:1511] Processing CreateTablet for tablet b06ca2d520f7457692822190ac2a8f32 (DEFAULT_TABLE table=test-workload [id=ee147dd1beed4b2182ca6782408c28eb]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:14:32.280059  1836 tablet_service.cc:1511] Processing CreateTablet for tablet 3454c9475988492d863379ed4177d7c3 (DEFAULT_TABLE table=test-workload [id=ee147dd1beed4b2182ca6782408c28eb]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:14:32.280859  1911 tablet_service.cc:1511] Processing CreateTablet for tablet 3454c9475988492d863379ed4177d7c3 (DEFAULT_TABLE table=test-workload [id=ee147dd1beed4b2182ca6782408c28eb]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:14:32.283056  1910 tablet_service.cc:1511] Processing CreateTablet for tablet b16576d7015c475fb71585c29048e5a9 (DEFAULT_TABLE table=test-workload [id=ee147dd1beed4b2182ca6782408c28eb]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:14:32.284587  1833 tablet_service.cc:1511] Processing CreateTablet for tablet 2f141c8bf4624551b8906e0469e6c4d8 (DEFAULT_TABLE table=test-workload [id=ee147dd1beed4b2182ca6782408c28eb]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:14:32.285550  1913 tablet_service.cc:1511] Processing CreateTablet for tablet 6b8eac6adeda4c8a9e8e4142a9b86feb (DEFAULT_TABLE table=test-workload [id=ee147dd1beed4b2182ca6782408c28eb]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:14:32.274983  1835 tablet_service.cc:1511] Processing CreateTablet for tablet b16576d7015c475fb71585c29048e5a9 (DEFAULT_TABLE table=test-workload [id=ee147dd1beed4b2182ca6782408c28eb]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:14:32.289740  1834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe7a5d3b676046eba775b5d39c4c1cd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.298151  1836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3454c9475988492d863379ed4177d7c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.302132  1837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b06ca2d520f7457692822190ac2a8f32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.291798  1911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3454c9475988492d863379ed4177d7c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.304858  1982 tablet_service.cc:1511] Processing CreateTablet for tablet 2f141c8bf4624551b8906e0469e6c4d8 (DEFAULT_TABLE table=test-workload [id=ee147dd1beed4b2182ca6782408c28eb]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:14:32.306244  1982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f141c8bf4624551b8906e0469e6c4d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.308395  1910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b16576d7015c475fb71585c29048e5a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.308151  1907 tablet_service.cc:1511] Processing CreateTablet for tablet aaaceebb1e1c4a61968762f9b4b32dea (DEFAULT_TABLE table=test-workload [id=ee147dd1beed4b2182ca6782408c28eb]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:14:32.309544  1907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaaceebb1e1c4a61968762f9b4b32dea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.309705  1833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f141c8bf4624551b8906e0469e6c4d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.311841  1832 tablet_service.cc:1511] Processing CreateTablet for tablet aaaceebb1e1c4a61968762f9b4b32dea (DEFAULT_TABLE table=test-workload [id=ee147dd1beed4b2182ca6782408c28eb]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:14:32.313199  1832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaaceebb1e1c4a61968762f9b4b32dea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.316028  1981 tablet_service.cc:1511] Processing CreateTablet for tablet aaaceebb1e1c4a61968762f9b4b32dea (DEFAULT_TABLE table=test-workload [id=ee147dd1beed4b2182ca6782408c28eb]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:14:32.317061  1913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b8eac6adeda4c8a9e8e4142a9b86feb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.317401  1981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaaceebb1e1c4a61968762f9b4b32dea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.318151  1835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b16576d7015c475fb71585c29048e5a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.319020  1906 tablet_service.cc:1511] Processing CreateTablet for tablet afd1f7dbbeee4d218895cf5a8e54efd3 (DEFAULT_TABLE table=test-workload [id=ee147dd1beed4b2182ca6782408c28eb]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:14:32.320324  1906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afd1f7dbbeee4d218895cf5a8e54efd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.321707  1831 tablet_service.cc:1511] Processing CreateTablet for tablet afd1f7dbbeee4d218895cf5a8e54efd3 (DEFAULT_TABLE table=test-workload [id=ee147dd1beed4b2182ca6782408c28eb]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:14:32.322988  1831 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afd1f7dbbeee4d218895cf5a8e54efd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.327239  1905 tablet_service.cc:1511] Processing CreateTablet for tablet 849c6495f30e45caa73c1f4be5c2d65c (DEFAULT_TABLE table=test-workload [id=ee147dd1beed4b2182ca6782408c28eb]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:14:32.327876  1830 tablet_service.cc:1511] Processing CreateTablet for tablet 849c6495f30e45caa73c1f4be5c2d65c (DEFAULT_TABLE table=test-workload [id=ee147dd1beed4b2182ca6782408c28eb]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:14:32.328629  1905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 849c6495f30e45caa73c1f4be5c2d65c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.329120  1830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 849c6495f30e45caa73c1f4be5c2d65c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.351577  1980 tablet_service.cc:1511] Processing CreateTablet for tablet afd1f7dbbeee4d218895cf5a8e54efd3 (DEFAULT_TABLE table=test-workload [id=ee147dd1beed4b2182ca6782408c28eb]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:14:32.353106  1980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afd1f7dbbeee4d218895cf5a8e54efd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.354954  1979 tablet_service.cc:1511] Processing CreateTablet for tablet 849c6495f30e45caa73c1f4be5c2d65c (DEFAULT_TABLE table=test-workload [id=ee147dd1beed4b2182ca6782408c28eb]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:14:32.356416  1979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 849c6495f30e45caa73c1f4be5c2d65c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.403115  2037 tablet_bootstrap.cc:492] T 6b8eac6adeda4c8a9e8e4142a9b86feb P efd77f14978b4b49880b1a39abc66987: Bootstrap starting.
I20260709 13:14:32.410032  2039 tablet_bootstrap.cc:492] T b16576d7015c475fb71585c29048e5a9 P 4cfc2f643a0a46888b750e0ab7b7fde6: Bootstrap starting.
I20260709 13:14:32.412901  2037 tablet_bootstrap.cc:654] T 6b8eac6adeda4c8a9e8e4142a9b86feb P efd77f14978b4b49880b1a39abc66987: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:32.414886  2038 tablet_bootstrap.cc:492] T fe7a5d3b676046eba775b5d39c4c1cd9 P cfdfd9c3b64347f997e5d181c39fddcd: Bootstrap starting.
I20260709 13:14:32.439177  2039 tablet_bootstrap.cc:654] T b16576d7015c475fb71585c29048e5a9 P 4cfc2f643a0a46888b750e0ab7b7fde6: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:32.452544  2038 tablet_bootstrap.cc:654] T fe7a5d3b676046eba775b5d39c4c1cd9 P cfdfd9c3b64347f997e5d181c39fddcd: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:32.459008  2037 tablet_bootstrap.cc:492] T 6b8eac6adeda4c8a9e8e4142a9b86feb P efd77f14978b4b49880b1a39abc66987: No bootstrap required, opened a new log
I20260709 13:14:32.459671  2037 ts_tablet_manager.cc:1403] T 6b8eac6adeda4c8a9e8e4142a9b86feb P efd77f14978b4b49880b1a39abc66987: Time spent bootstrapping tablet: real 0.057s	user 0.014s	sys 0.022s
I20260709 13:14:32.462603  2039 tablet_bootstrap.cc:492] T b16576d7015c475fb71585c29048e5a9 P 4cfc2f643a0a46888b750e0ab7b7fde6: No bootstrap required, opened a new log
I20260709 13:14:32.463084  2039 ts_tablet_manager.cc:1403] T b16576d7015c475fb71585c29048e5a9 P 4cfc2f643a0a46888b750e0ab7b7fde6: Time spent bootstrapping tablet: real 0.053s	user 0.008s	sys 0.010s
I20260709 13:14:32.463272  2038 tablet_bootstrap.cc:492] T fe7a5d3b676046eba775b5d39c4c1cd9 P cfdfd9c3b64347f997e5d181c39fddcd: No bootstrap required, opened a new log
I20260709 13:14:32.463358  2037 raft_consensus.cc:359] T 6b8eac6adeda4c8a9e8e4142a9b86feb P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } }
I20260709 13:14:32.463928  2038 ts_tablet_manager.cc:1403] T fe7a5d3b676046eba775b5d39c4c1cd9 P cfdfd9c3b64347f997e5d181c39fddcd: Time spent bootstrapping tablet: real 0.049s	user 0.008s	sys 0.004s
I20260709 13:14:32.464272  2037 raft_consensus.cc:385] T 6b8eac6adeda4c8a9e8e4142a9b86feb P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:32.464604  2037 raft_consensus.cc:740] T 6b8eac6adeda4c8a9e8e4142a9b86feb P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efd77f14978b4b49880b1a39abc66987, State: Initialized, Role: FOLLOWER
I20260709 13:14:32.465420  2039 raft_consensus.cc:359] T b16576d7015c475fb71585c29048e5a9 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:32.465376  2037 consensus_queue.cc:260] T 6b8eac6adeda4c8a9e8e4142a9b86feb P efd77f14978b4b49880b1a39abc66987 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } }
I20260709 13:14:32.466146  2039 raft_consensus.cc:385] T b16576d7015c475fb71585c29048e5a9 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:32.466500  2039 raft_consensus.cc:740] T b16576d7015c475fb71585c29048e5a9 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cfc2f643a0a46888b750e0ab7b7fde6, State: Initialized, Role: FOLLOWER
I20260709 13:14:32.467044  2038 raft_consensus.cc:359] T fe7a5d3b676046eba775b5d39c4c1cd9 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:32.467218  2039 consensus_queue.cc:260] T b16576d7015c475fb71585c29048e5a9 P 4cfc2f643a0a46888b750e0ab7b7fde6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:32.467689  1873 heartbeater.cc:499] Master 127.23.140.126:41811 was elected leader, sending a full tablet report...
I20260709 13:14:32.467824  2038 raft_consensus.cc:385] T fe7a5d3b676046eba775b5d39c4c1cd9 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:32.468205  2038 raft_consensus.cc:740] T fe7a5d3b676046eba775b5d39c4c1cd9 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfdfd9c3b64347f997e5d181c39fddcd, State: Initialized, Role: FOLLOWER
I20260709 13:14:32.468957  2037 ts_tablet_manager.cc:1434] T 6b8eac6adeda4c8a9e8e4142a9b86feb P efd77f14978b4b49880b1a39abc66987: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:14:32.469069  2038 consensus_queue.cc:260] T fe7a5d3b676046eba775b5d39c4c1cd9 P cfdfd9c3b64347f997e5d181c39fddcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:32.470142  2037 tablet_bootstrap.cc:492] T afd1f7dbbeee4d218895cf5a8e54efd3 P efd77f14978b4b49880b1a39abc66987: Bootstrap starting.
I20260709 13:14:32.474635  1948 heartbeater.cc:499] Master 127.23.140.126:41811 was elected leader, sending a full tablet report...
I20260709 13:14:32.476989  2038 ts_tablet_manager.cc:1434] T fe7a5d3b676046eba775b5d39c4c1cd9 P cfdfd9c3b64347f997e5d181c39fddcd: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 13:14:32.478061  2038 tablet_bootstrap.cc:492] T b06ca2d520f7457692822190ac2a8f32 P cfdfd9c3b64347f997e5d181c39fddcd: Bootstrap starting.
I20260709 13:14:32.484325  2038 tablet_bootstrap.cc:654] T b06ca2d520f7457692822190ac2a8f32 P cfdfd9c3b64347f997e5d181c39fddcd: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:32.486750  2037 tablet_bootstrap.cc:654] T afd1f7dbbeee4d218895cf5a8e54efd3 P efd77f14978b4b49880b1a39abc66987: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:32.488083  2022 heartbeater.cc:499] Master 127.23.140.126:41811 was elected leader, sending a full tablet report...
I20260709 13:14:32.488646  2039 ts_tablet_manager.cc:1434] T b16576d7015c475fb71585c29048e5a9 P 4cfc2f643a0a46888b750e0ab7b7fde6: Time spent starting tablet: real 0.025s	user 0.014s	sys 0.012s
I20260709 13:14:32.489699  2039 tablet_bootstrap.cc:492] T b06ca2d520f7457692822190ac2a8f32 P 4cfc2f643a0a46888b750e0ab7b7fde6: Bootstrap starting.
I20260709 13:14:32.496078  2039 tablet_bootstrap.cc:654] T b06ca2d520f7457692822190ac2a8f32 P 4cfc2f643a0a46888b750e0ab7b7fde6: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:32.501106  2037 tablet_bootstrap.cc:492] T afd1f7dbbeee4d218895cf5a8e54efd3 P efd77f14978b4b49880b1a39abc66987: No bootstrap required, opened a new log
I20260709 13:14:32.501468  2038 tablet_bootstrap.cc:492] T b06ca2d520f7457692822190ac2a8f32 P cfdfd9c3b64347f997e5d181c39fddcd: No bootstrap required, opened a new log
I20260709 13:14:32.501606  2037 ts_tablet_manager.cc:1403] T afd1f7dbbeee4d218895cf5a8e54efd3 P efd77f14978b4b49880b1a39abc66987: Time spent bootstrapping tablet: real 0.032s	user 0.020s	sys 0.000s
I20260709 13:14:32.502048  2038 ts_tablet_manager.cc:1403] T b06ca2d520f7457692822190ac2a8f32 P cfdfd9c3b64347f997e5d181c39fddcd: Time spent bootstrapping tablet: real 0.024s	user 0.007s	sys 0.004s
I20260709 13:14:32.504704  2037 raft_consensus.cc:359] T afd1f7dbbeee4d218895cf5a8e54efd3 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:32.504925  2038 raft_consensus.cc:359] T b06ca2d520f7457692822190ac2a8f32 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:32.505446  2037 raft_consensus.cc:385] T afd1f7dbbeee4d218895cf5a8e54efd3 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:32.505618  2038 raft_consensus.cc:385] T b06ca2d520f7457692822190ac2a8f32 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:32.505808  2037 raft_consensus.cc:740] T afd1f7dbbeee4d218895cf5a8e54efd3 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efd77f14978b4b49880b1a39abc66987, State: Initialized, Role: FOLLOWER
I20260709 13:14:32.506002  2038 raft_consensus.cc:740] T b06ca2d520f7457692822190ac2a8f32 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfdfd9c3b64347f997e5d181c39fddcd, State: Initialized, Role: FOLLOWER
I20260709 13:14:32.506683  2037 consensus_queue.cc:260] T afd1f7dbbeee4d218895cf5a8e54efd3 P efd77f14978b4b49880b1a39abc66987 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:32.506801  2038 consensus_queue.cc:260] T b06ca2d520f7457692822190ac2a8f32 P cfdfd9c3b64347f997e5d181c39fddcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:32.509063  2037 ts_tablet_manager.cc:1434] T afd1f7dbbeee4d218895cf5a8e54efd3 P efd77f14978b4b49880b1a39abc66987: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:14:32.510032  2037 tablet_bootstrap.cc:492] T 3454c9475988492d863379ed4177d7c3 P efd77f14978b4b49880b1a39abc66987: Bootstrap starting.
I20260709 13:14:32.509064  2038 ts_tablet_manager.cc:1434] T b06ca2d520f7457692822190ac2a8f32 P cfdfd9c3b64347f997e5d181c39fddcd: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:14:32.514426  2038 tablet_bootstrap.cc:492] T 6b8eac6adeda4c8a9e8e4142a9b86feb P cfdfd9c3b64347f997e5d181c39fddcd: Bootstrap starting.
I20260709 13:14:32.516072  2039 tablet_bootstrap.cc:492] T b06ca2d520f7457692822190ac2a8f32 P 4cfc2f643a0a46888b750e0ab7b7fde6: No bootstrap required, opened a new log
I20260709 13:14:32.516301  2037 tablet_bootstrap.cc:654] T 3454c9475988492d863379ed4177d7c3 P efd77f14978b4b49880b1a39abc66987: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:32.516603  2039 ts_tablet_manager.cc:1403] T b06ca2d520f7457692822190ac2a8f32 P 4cfc2f643a0a46888b750e0ab7b7fde6: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.008s
I20260709 13:14:32.519670  2039 raft_consensus.cc:359] T b06ca2d520f7457692822190ac2a8f32 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:32.520401  2039 raft_consensus.cc:385] T b06ca2d520f7457692822190ac2a8f32 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:32.520695  2039 raft_consensus.cc:740] T b06ca2d520f7457692822190ac2a8f32 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cfc2f643a0a46888b750e0ab7b7fde6, State: Initialized, Role: FOLLOWER
I20260709 13:14:32.521066  2038 tablet_bootstrap.cc:654] T 6b8eac6adeda4c8a9e8e4142a9b86feb P cfdfd9c3b64347f997e5d181c39fddcd: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:32.521521  2039 consensus_queue.cc:260] T b06ca2d520f7457692822190ac2a8f32 P 4cfc2f643a0a46888b750e0ab7b7fde6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:32.524067  2039 ts_tablet_manager.cc:1434] T b06ca2d520f7457692822190ac2a8f32 P 4cfc2f643a0a46888b750e0ab7b7fde6: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:14:32.525089  2039 tablet_bootstrap.cc:492] T 6b8eac6adeda4c8a9e8e4142a9b86feb P 4cfc2f643a0a46888b750e0ab7b7fde6: Bootstrap starting.
I20260709 13:14:32.531183  2039 tablet_bootstrap.cc:654] T 6b8eac6adeda4c8a9e8e4142a9b86feb P 4cfc2f643a0a46888b750e0ab7b7fde6: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:32.547137  2039 tablet_bootstrap.cc:492] T 6b8eac6adeda4c8a9e8e4142a9b86feb P 4cfc2f643a0a46888b750e0ab7b7fde6: No bootstrap required, opened a new log
I20260709 13:14:32.547329  2038 tablet_bootstrap.cc:492] T 6b8eac6adeda4c8a9e8e4142a9b86feb P cfdfd9c3b64347f997e5d181c39fddcd: No bootstrap required, opened a new log
I20260709 13:14:32.547652  2039 ts_tablet_manager.cc:1403] T 6b8eac6adeda4c8a9e8e4142a9b86feb P 4cfc2f643a0a46888b750e0ab7b7fde6: Time spent bootstrapping tablet: real 0.023s	user 0.006s	sys 0.005s
I20260709 13:14:32.547883  2038 ts_tablet_manager.cc:1403] T 6b8eac6adeda4c8a9e8e4142a9b86feb P cfdfd9c3b64347f997e5d181c39fddcd: Time spent bootstrapping tablet: real 0.034s	user 0.019s	sys 0.012s
I20260709 13:14:32.548130  2037 tablet_bootstrap.cc:492] T 3454c9475988492d863379ed4177d7c3 P efd77f14978b4b49880b1a39abc66987: No bootstrap required, opened a new log
I20260709 13:14:32.548648  2037 ts_tablet_manager.cc:1403] T 3454c9475988492d863379ed4177d7c3 P efd77f14978b4b49880b1a39abc66987: Time spent bootstrapping tablet: real 0.039s	user 0.009s	sys 0.022s
I20260709 13:14:32.550498  2038 raft_consensus.cc:359] T 6b8eac6adeda4c8a9e8e4142a9b86feb P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } }
I20260709 13:14:32.551083  2038 raft_consensus.cc:385] T 6b8eac6adeda4c8a9e8e4142a9b86feb P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:32.550981  2039 raft_consensus.cc:359] T 6b8eac6adeda4c8a9e8e4142a9b86feb P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } }
I20260709 13:14:32.551514  2038 raft_consensus.cc:740] T 6b8eac6adeda4c8a9e8e4142a9b86feb P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfdfd9c3b64347f997e5d181c39fddcd, State: Initialized, Role: FOLLOWER
I20260709 13:14:32.551388  2037 raft_consensus.cc:359] T 3454c9475988492d863379ed4177d7c3 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:32.551959  2039 raft_consensus.cc:385] T 6b8eac6adeda4c8a9e8e4142a9b86feb P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:32.552290  2037 raft_consensus.cc:385] T 3454c9475988492d863379ed4177d7c3 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:32.552326  2039 raft_consensus.cc:740] T 6b8eac6adeda4c8a9e8e4142a9b86feb P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cfc2f643a0a46888b750e0ab7b7fde6, State: Initialized, Role: FOLLOWER
I20260709 13:14:32.552755  2037 raft_consensus.cc:740] T 3454c9475988492d863379ed4177d7c3 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efd77f14978b4b49880b1a39abc66987, State: Initialized, Role: FOLLOWER
I20260709 13:14:32.552557  2038 consensus_queue.cc:260] T 6b8eac6adeda4c8a9e8e4142a9b86feb P cfdfd9c3b64347f997e5d181c39fddcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } }
I20260709 13:14:32.553453  2039 consensus_queue.cc:260] T 6b8eac6adeda4c8a9e8e4142a9b86feb P 4cfc2f643a0a46888b750e0ab7b7fde6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } }
I20260709 13:14:32.554903  2038 ts_tablet_manager.cc:1434] T 6b8eac6adeda4c8a9e8e4142a9b86feb P cfdfd9c3b64347f997e5d181c39fddcd: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:14:32.555800  2039 ts_tablet_manager.cc:1434] T 6b8eac6adeda4c8a9e8e4142a9b86feb P 4cfc2f643a0a46888b750e0ab7b7fde6: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.003s
I20260709 13:14:32.556062  2038 tablet_bootstrap.cc:492] T 2f141c8bf4624551b8906e0469e6c4d8 P cfdfd9c3b64347f997e5d181c39fddcd: Bootstrap starting.
I20260709 13:14:32.556896  2039 tablet_bootstrap.cc:492] T aaaceebb1e1c4a61968762f9b4b32dea P 4cfc2f643a0a46888b750e0ab7b7fde6: Bootstrap starting.
I20260709 13:14:32.553741  2037 consensus_queue.cc:260] T 3454c9475988492d863379ed4177d7c3 P efd77f14978b4b49880b1a39abc66987 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:32.562223  2037 ts_tablet_manager.cc:1434] T 3454c9475988492d863379ed4177d7c3 P efd77f14978b4b49880b1a39abc66987: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.004s
I20260709 13:14:32.563186  2037 tablet_bootstrap.cc:492] T b06ca2d520f7457692822190ac2a8f32 P efd77f14978b4b49880b1a39abc66987: Bootstrap starting.
I20260709 13:14:32.563295  2038 tablet_bootstrap.cc:654] T 2f141c8bf4624551b8906e0469e6c4d8 P cfdfd9c3b64347f997e5d181c39fddcd: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:32.563858  2039 tablet_bootstrap.cc:654] T aaaceebb1e1c4a61968762f9b4b32dea P 4cfc2f643a0a46888b750e0ab7b7fde6: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:32.571238  2037 tablet_bootstrap.cc:654] T b06ca2d520f7457692822190ac2a8f32 P efd77f14978b4b49880b1a39abc66987: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:32.575555  2038 tablet_bootstrap.cc:492] T 2f141c8bf4624551b8906e0469e6c4d8 P cfdfd9c3b64347f997e5d181c39fddcd: No bootstrap required, opened a new log
I20260709 13:14:32.576020  2038 ts_tablet_manager.cc:1403] T 2f141c8bf4624551b8906e0469e6c4d8 P cfdfd9c3b64347f997e5d181c39fddcd: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.008s
I20260709 13:14:32.578914  2038 raft_consensus.cc:359] T 2f141c8bf4624551b8906e0469e6c4d8 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:32.579644  2038 raft_consensus.cc:385] T 2f141c8bf4624551b8906e0469e6c4d8 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:32.579938  2038 raft_consensus.cc:740] T 2f141c8bf4624551b8906e0469e6c4d8 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfdfd9c3b64347f997e5d181c39fddcd, State: Initialized, Role: FOLLOWER
I20260709 13:14:32.580623  2038 consensus_queue.cc:260] T 2f141c8bf4624551b8906e0469e6c4d8 P cfdfd9c3b64347f997e5d181c39fddcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:32.583382  2039 tablet_bootstrap.cc:492] T aaaceebb1e1c4a61968762f9b4b32dea P 4cfc2f643a0a46888b750e0ab7b7fde6: No bootstrap required, opened a new log
I20260709 13:14:32.583607  2038 ts_tablet_manager.cc:1434] T 2f141c8bf4624551b8906e0469e6c4d8 P cfdfd9c3b64347f997e5d181c39fddcd: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:14:32.583920  2039 ts_tablet_manager.cc:1403] T aaaceebb1e1c4a61968762f9b4b32dea P 4cfc2f643a0a46888b750e0ab7b7fde6: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.005s
I20260709 13:14:32.584149  2037 tablet_bootstrap.cc:492] T b06ca2d520f7457692822190ac2a8f32 P efd77f14978b4b49880b1a39abc66987: No bootstrap required, opened a new log
I20260709 13:14:32.584651  2038 tablet_bootstrap.cc:492] T 3454c9475988492d863379ed4177d7c3 P cfdfd9c3b64347f997e5d181c39fddcd: Bootstrap starting.
I20260709 13:14:32.584656  2037 ts_tablet_manager.cc:1403] T b06ca2d520f7457692822190ac2a8f32 P efd77f14978b4b49880b1a39abc66987: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.002s
I20260709 13:14:32.586920  2039 raft_consensus.cc:359] T aaaceebb1e1c4a61968762f9b4b32dea P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:32.587631  2039 raft_consensus.cc:385] T aaaceebb1e1c4a61968762f9b4b32dea P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:32.587963  2039 raft_consensus.cc:740] T aaaceebb1e1c4a61968762f9b4b32dea P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cfc2f643a0a46888b750e0ab7b7fde6, State: Initialized, Role: FOLLOWER
I20260709 13:14:32.587767  2037 raft_consensus.cc:359] T b06ca2d520f7457692822190ac2a8f32 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:32.588683  2037 raft_consensus.cc:385] T b06ca2d520f7457692822190ac2a8f32 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:32.589012  2037 raft_consensus.cc:740] T b06ca2d520f7457692822190ac2a8f32 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efd77f14978b4b49880b1a39abc66987, State: Initialized, Role: FOLLOWER
I20260709 13:14:32.588816  2039 consensus_queue.cc:260] T aaaceebb1e1c4a61968762f9b4b32dea P 4cfc2f643a0a46888b750e0ab7b7fde6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:32.589982  2037 consensus_queue.cc:260] T b06ca2d520f7457692822190ac2a8f32 P efd77f14978b4b49880b1a39abc66987 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:32.590751  2044 raft_consensus.cc:493] T b16576d7015c475fb71585c29048e5a9 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:32.591253  2044 raft_consensus.cc:515] T b16576d7015c475fb71585c29048e5a9 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:32.591745  2038 tablet_bootstrap.cc:654] T 3454c9475988492d863379ed4177d7c3 P cfdfd9c3b64347f997e5d181c39fddcd: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:32.594184  2037 ts_tablet_manager.cc:1434] T b06ca2d520f7457692822190ac2a8f32 P efd77f14978b4b49880b1a39abc66987: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:14:32.595433  2037 tablet_bootstrap.cc:492] T 2f141c8bf4624551b8906e0469e6c4d8 P efd77f14978b4b49880b1a39abc66987: Bootstrap starting.
I20260709 13:14:32.604058  2037 tablet_bootstrap.cc:654] T 2f141c8bf4624551b8906e0469e6c4d8 P efd77f14978b4b49880b1a39abc66987: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:32.604168  2044 leader_election.cc:290] T b16576d7015c475fb71585c29048e5a9 P 4cfc2f643a0a46888b750e0ab7b7fde6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efd77f14978b4b49880b1a39abc66987 (127.23.140.65:41453), cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66:43351)
I20260709 13:14:32.610275  1923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16576d7015c475fb71585c29048e5a9" candidate_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" is_pre_election: true
W20260709 13:14:32.612607  1963 leader_election.cc:343] T b16576d7015c475fb71585c29048e5a9 P 4cfc2f643a0a46888b750e0ab7b7fde6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66:43351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:32.614740  2038 tablet_bootstrap.cc:492] T 3454c9475988492d863379ed4177d7c3 P cfdfd9c3b64347f997e5d181c39fddcd: No bootstrap required, opened a new log
I20260709 13:14:32.615371  2038 ts_tablet_manager.cc:1403] T 3454c9475988492d863379ed4177d7c3 P cfdfd9c3b64347f997e5d181c39fddcd: Time spent bootstrapping tablet: real 0.031s	user 0.018s	sys 0.012s
I20260709 13:14:32.618021  2039 ts_tablet_manager.cc:1434] T aaaceebb1e1c4a61968762f9b4b32dea P 4cfc2f643a0a46888b750e0ab7b7fde6: Time spent starting tablet: real 0.034s	user 0.009s	sys 0.000s
I20260709 13:14:32.618438  2038 raft_consensus.cc:359] T 3454c9475988492d863379ed4177d7c3 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:32.619289  2038 raft_consensus.cc:385] T 3454c9475988492d863379ed4177d7c3 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:32.619628  2038 raft_consensus.cc:740] T 3454c9475988492d863379ed4177d7c3 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfdfd9c3b64347f997e5d181c39fddcd, State: Initialized, Role: FOLLOWER
I20260709 13:14:32.620548  2038 consensus_queue.cc:260] T 3454c9475988492d863379ed4177d7c3 P cfdfd9c3b64347f997e5d181c39fddcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:32.623469  2045 raft_consensus.cc:493] T b06ca2d520f7457692822190ac2a8f32 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:32.623942  2045 raft_consensus.cc:515] T b06ca2d520f7457692822190ac2a8f32 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:32.626623  2045 leader_election.cc:290] T b06ca2d520f7457692822190ac2a8f32 P cfdfd9c3b64347f997e5d181c39fddcd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efd77f14978b4b49880b1a39abc66987 (127.23.140.65:41453), 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67:33709)
I20260709 13:14:32.627218  2039 tablet_bootstrap.cc:492] T fe7a5d3b676046eba775b5d39c4c1cd9 P 4cfc2f643a0a46888b750e0ab7b7fde6: Bootstrap starting.
I20260709 13:14:32.628654  2038 ts_tablet_manager.cc:1434] T 3454c9475988492d863379ed4177d7c3 P cfdfd9c3b64347f997e5d181c39fddcd: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:14:32.629820  2038 tablet_bootstrap.cc:492] T 849c6495f30e45caa73c1f4be5c2d65c P cfdfd9c3b64347f997e5d181c39fddcd: Bootstrap starting.
I20260709 13:14:32.636579  2038 tablet_bootstrap.cc:654] T 849c6495f30e45caa73c1f4be5c2d65c P cfdfd9c3b64347f997e5d181c39fddcd: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:32.638041  1848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16576d7015c475fb71585c29048e5a9" candidate_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efd77f14978b4b49880b1a39abc66987" is_pre_election: true
W20260709 13:14:32.640228  1961 leader_election.cc:343] T b16576d7015c475fb71585c29048e5a9 P 4cfc2f643a0a46888b750e0ab7b7fde6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer efd77f14978b4b49880b1a39abc66987 (127.23.140.65:41453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:32.640837  1961 leader_election.cc:304] T b16576d7015c475fb71585c29048e5a9 P 4cfc2f643a0a46888b750e0ab7b7fde6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cfc2f643a0a46888b750e0ab7b7fde6; no voters: cfdfd9c3b64347f997e5d181c39fddcd, efd77f14978b4b49880b1a39abc66987
I20260709 13:14:32.641877  2044 raft_consensus.cc:2749] T b16576d7015c475fb71585c29048e5a9 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:32.657019  1997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b06ca2d520f7457692822190ac2a8f32" candidate_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" is_pre_election: true
I20260709 13:14:32.657783  2039 tablet_bootstrap.cc:654] T fe7a5d3b676046eba775b5d39c4c1cd9 P 4cfc2f643a0a46888b750e0ab7b7fde6: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:32.657778  1997 raft_consensus.cc:2468] T b06ca2d520f7457692822190ac2a8f32 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfdfd9c3b64347f997e5d181c39fddcd in term 0.
I20260709 13:14:32.659737  1886 leader_election.cc:304] T b06ca2d520f7457692822190ac2a8f32 P cfdfd9c3b64347f997e5d181c39fddcd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cfc2f643a0a46888b750e0ab7b7fde6, cfdfd9c3b64347f997e5d181c39fddcd; no voters: 
I20260709 13:14:32.660612  2045 raft_consensus.cc:2804] T b06ca2d520f7457692822190ac2a8f32 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:32.661463  2045 raft_consensus.cc:493] T b06ca2d520f7457692822190ac2a8f32 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:32.661871  2045 raft_consensus.cc:3060] T b06ca2d520f7457692822190ac2a8f32 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:32.662077  1848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b06ca2d520f7457692822190ac2a8f32" candidate_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efd77f14978b4b49880b1a39abc66987" is_pre_election: true
I20260709 13:14:32.662967  1848 raft_consensus.cc:2468] T b06ca2d520f7457692822190ac2a8f32 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfdfd9c3b64347f997e5d181c39fddcd in term 0.
I20260709 13:14:32.668402  2037 tablet_bootstrap.cc:492] T 2f141c8bf4624551b8906e0469e6c4d8 P efd77f14978b4b49880b1a39abc66987: No bootstrap required, opened a new log
I20260709 13:14:32.668535  2039 tablet_bootstrap.cc:492] T fe7a5d3b676046eba775b5d39c4c1cd9 P 4cfc2f643a0a46888b750e0ab7b7fde6: No bootstrap required, opened a new log
I20260709 13:14:32.668751  2062 raft_consensus.cc:493] T 6b8eac6adeda4c8a9e8e4142a9b86feb P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:32.669026  2037 ts_tablet_manager.cc:1403] T 2f141c8bf4624551b8906e0469e6c4d8 P efd77f14978b4b49880b1a39abc66987: Time spent bootstrapping tablet: real 0.074s	user 0.033s	sys 0.025s
I20260709 13:14:32.669284  2062 raft_consensus.cc:515] T 6b8eac6adeda4c8a9e8e4142a9b86feb P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } }
I20260709 13:14:32.669685  2038 tablet_bootstrap.cc:492] T 849c6495f30e45caa73c1f4be5c2d65c P cfdfd9c3b64347f997e5d181c39fddcd: No bootstrap required, opened a new log
I20260709 13:14:32.670356  2038 ts_tablet_manager.cc:1403] T 849c6495f30e45caa73c1f4be5c2d65c P cfdfd9c3b64347f997e5d181c39fddcd: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.017s
I20260709 13:14:32.670667  2045 raft_consensus.cc:515] T b06ca2d520f7457692822190ac2a8f32 P cfdfd9c3b64347f997e5d181c39fddcd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:32.672250  1997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8eac6adeda4c8a9e8e4142a9b86feb" candidate_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" is_pre_election: true
I20260709 13:14:32.672185  2037 raft_consensus.cc:359] T 2f141c8bf4624551b8906e0469e6c4d8 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:32.672861  2045 leader_election.cc:290] T b06ca2d520f7457692822190ac2a8f32 P cfdfd9c3b64347f997e5d181c39fddcd [CANDIDATE]: Term 1 election: Requested vote from peers efd77f14978b4b49880b1a39abc66987 (127.23.140.65:41453), 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67:33709)
I20260709 13:14:32.669026  2039 ts_tablet_manager.cc:1403] T fe7a5d3b676046eba775b5d39c4c1cd9 P 4cfc2f643a0a46888b750e0ab7b7fde6: Time spent bootstrapping tablet: real 0.042s	user 0.011s	sys 0.001s
I20260709 13:14:32.673058  1997 raft_consensus.cc:2468] T 6b8eac6adeda4c8a9e8e4142a9b86feb P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfdfd9c3b64347f997e5d181c39fddcd in term 0.
I20260709 13:14:32.673151  2037 raft_consensus.cc:385] T 2f141c8bf4624551b8906e0469e6c4d8 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:32.674168  2037 raft_consensus.cc:740] T 2f141c8bf4624551b8906e0469e6c4d8 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efd77f14978b4b49880b1a39abc66987, State: Initialized, Role: FOLLOWER
I20260709 13:14:32.674696  1848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b06ca2d520f7457692822190ac2a8f32" candidate_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efd77f14978b4b49880b1a39abc66987"
I20260709 13:14:32.675294  1848 raft_consensus.cc:3060] T b06ca2d520f7457692822190ac2a8f32 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:32.675087  2037 consensus_queue.cc:260] T 2f141c8bf4624551b8906e0469e6c4d8 P efd77f14978b4b49880b1a39abc66987 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:32.675496  2038 raft_consensus.cc:359] T 849c6495f30e45caa73c1f4be5c2d65c P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:32.676316  2038 raft_consensus.cc:385] T 849c6495f30e45caa73c1f4be5c2d65c P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:32.676622  2038 raft_consensus.cc:740] T 849c6495f30e45caa73c1f4be5c2d65c P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfdfd9c3b64347f997e5d181c39fddcd, State: Initialized, Role: FOLLOWER
I20260709 13:14:32.677824  2037 ts_tablet_manager.cc:1434] T 2f141c8bf4624551b8906e0469e6c4d8 P efd77f14978b4b49880b1a39abc66987: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:14:32.677466  2038 consensus_queue.cc:260] T 849c6495f30e45caa73c1f4be5c2d65c P cfdfd9c3b64347f997e5d181c39fddcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:32.679055  2037 tablet_bootstrap.cc:492] T b16576d7015c475fb71585c29048e5a9 P efd77f14978b4b49880b1a39abc66987: Bootstrap starting.
I20260709 13:14:32.679894  2038 ts_tablet_manager.cc:1434] T 849c6495f30e45caa73c1f4be5c2d65c P cfdfd9c3b64347f997e5d181c39fddcd: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:14:32.682920  2038 tablet_bootstrap.cc:492] T afd1f7dbbeee4d218895cf5a8e54efd3 P cfdfd9c3b64347f997e5d181c39fddcd: Bootstrap starting.
I20260709 13:14:32.682981  1886 leader_election.cc:304] T 6b8eac6adeda4c8a9e8e4142a9b86feb P cfdfd9c3b64347f997e5d181c39fddcd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cfc2f643a0a46888b750e0ab7b7fde6, cfdfd9c3b64347f997e5d181c39fddcd; no voters: 
I20260709 13:14:32.684458  1997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b06ca2d520f7457692822190ac2a8f32" candidate_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6"
I20260709 13:14:32.685045  1997 raft_consensus.cc:3060] T b06ca2d520f7457692822190ac2a8f32 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:32.687103  2037 tablet_bootstrap.cc:654] T b16576d7015c475fb71585c29048e5a9 P efd77f14978b4b49880b1a39abc66987: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:32.689708  2038 tablet_bootstrap.cc:654] T afd1f7dbbeee4d218895cf5a8e54efd3 P cfdfd9c3b64347f997e5d181c39fddcd: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:32.689931  2045 raft_consensus.cc:2804] T 6b8eac6adeda4c8a9e8e4142a9b86feb P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:32.690346  2045 raft_consensus.cc:493] T 6b8eac6adeda4c8a9e8e4142a9b86feb P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:32.690694  2045 raft_consensus.cc:3060] T 6b8eac6adeda4c8a9e8e4142a9b86feb P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:32.702092  2039 raft_consensus.cc:359] T fe7a5d3b676046eba775b5d39c4c1cd9 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:32.707430  2039 raft_consensus.cc:385] T fe7a5d3b676046eba775b5d39c4c1cd9 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:32.707919  2039 raft_consensus.cc:740] T fe7a5d3b676046eba775b5d39c4c1cd9 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cfc2f643a0a46888b750e0ab7b7fde6, State: Initialized, Role: FOLLOWER
I20260709 13:14:32.708029  1847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8eac6adeda4c8a9e8e4142a9b86feb" candidate_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efd77f14978b4b49880b1a39abc66987" is_pre_election: true
I20260709 13:14:32.709079  1847 raft_consensus.cc:2468] T 6b8eac6adeda4c8a9e8e4142a9b86feb P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfdfd9c3b64347f997e5d181c39fddcd in term 0.
I20260709 13:14:32.709203  2039 consensus_queue.cc:260] T fe7a5d3b676046eba775b5d39c4c1cd9 P 4cfc2f643a0a46888b750e0ab7b7fde6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:32.710961  2062 leader_election.cc:290] T 6b8eac6adeda4c8a9e8e4142a9b86feb P cfdfd9c3b64347f997e5d181c39fddcd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67:33709), efd77f14978b4b49880b1a39abc66987 (127.23.140.65:41453)
I20260709 13:14:32.702205  1997 raft_consensus.cc:2468] T b06ca2d520f7457692822190ac2a8f32 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfdfd9c3b64347f997e5d181c39fddcd in term 1.
I20260709 13:14:32.713258  1886 leader_election.cc:304] T b06ca2d520f7457692822190ac2a8f32 P cfdfd9c3b64347f997e5d181c39fddcd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cfc2f643a0a46888b750e0ab7b7fde6, cfdfd9c3b64347f997e5d181c39fddcd; no voters: 
I20260709 13:14:32.714433  2062 raft_consensus.cc:2804] T b06ca2d520f7457692822190ac2a8f32 P cfdfd9c3b64347f997e5d181c39fddcd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:32.705077  1848 raft_consensus.cc:2468] T b06ca2d520f7457692822190ac2a8f32 P efd77f14978b4b49880b1a39abc66987 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfdfd9c3b64347f997e5d181c39fddcd in term 1.
I20260709 13:14:32.720460  2043 raft_consensus.cc:493] T afd1f7dbbeee4d218895cf5a8e54efd3 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:32.721138  2043 raft_consensus.cc:515] T afd1f7dbbeee4d218895cf5a8e54efd3 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:32.721352  2045 raft_consensus.cc:515] T 6b8eac6adeda4c8a9e8e4142a9b86feb P cfdfd9c3b64347f997e5d181c39fddcd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } }
I20260709 13:14:32.724654  2062 raft_consensus.cc:697] T b06ca2d520f7457692822190ac2a8f32 P cfdfd9c3b64347f997e5d181c39fddcd [term 1 LEADER]: Becoming Leader. State: Replica: cfdfd9c3b64347f997e5d181c39fddcd, State: Running, Role: LEADER
I20260709 13:14:32.726048  2062 consensus_queue.cc:237] T b06ca2d520f7457692822190ac2a8f32 P cfdfd9c3b64347f997e5d181c39fddcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:32.731832  2043 leader_election.cc:290] T afd1f7dbbeee4d218895cf5a8e54efd3 P efd77f14978b4b49880b1a39abc66987 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66:43351), 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67:33709)
I20260709 13:14:32.732827  1997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8eac6adeda4c8a9e8e4142a9b86feb" candidate_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6"
I20260709 13:14:32.733605  1997 raft_consensus.cc:3060] T 6b8eac6adeda4c8a9e8e4142a9b86feb P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:32.742401  2044 raft_consensus.cc:493] T aaaceebb1e1c4a61968762f9b4b32dea P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:32.743115  2044 raft_consensus.cc:515] T aaaceebb1e1c4a61968762f9b4b32dea P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:32.743415  1997 raft_consensus.cc:2468] T 6b8eac6adeda4c8a9e8e4142a9b86feb P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfdfd9c3b64347f997e5d181c39fddcd in term 1.
I20260709 13:14:32.745157  1886 leader_election.cc:304] T 6b8eac6adeda4c8a9e8e4142a9b86feb P cfdfd9c3b64347f997e5d181c39fddcd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cfc2f643a0a46888b750e0ab7b7fde6, cfdfd9c3b64347f997e5d181c39fddcd; no voters: 
I20260709 13:14:32.746380  2065 raft_consensus.cc:2804] T 6b8eac6adeda4c8a9e8e4142a9b86feb P cfdfd9c3b64347f997e5d181c39fddcd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:32.747618  2044 leader_election.cc:290] T aaaceebb1e1c4a61968762f9b4b32dea P 4cfc2f643a0a46888b750e0ab7b7fde6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efd77f14978b4b49880b1a39abc66987 (127.23.140.65:41453), cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66:43351)
I20260709 13:14:32.747846  1923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaceebb1e1c4a61968762f9b4b32dea" candidate_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" is_pre_election: true
W20260709 13:14:32.749451  1963 leader_election.cc:343] T aaaceebb1e1c4a61968762f9b4b32dea P 4cfc2f643a0a46888b750e0ab7b7fde6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66:43351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:32.756042  2039 ts_tablet_manager.cc:1434] T fe7a5d3b676046eba775b5d39c4c1cd9 P 4cfc2f643a0a46888b750e0ab7b7fde6: Time spent starting tablet: real 0.082s	user 0.008s	sys 0.000s
I20260709 13:14:32.757707  2045 leader_election.cc:290] T 6b8eac6adeda4c8a9e8e4142a9b86feb P cfdfd9c3b64347f997e5d181c39fddcd [CANDIDATE]: Term 1 election: Requested vote from peers 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67:33709), efd77f14978b4b49880b1a39abc66987 (127.23.140.65:41453)
I20260709 13:14:32.758991  1848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8eac6adeda4c8a9e8e4142a9b86feb" candidate_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efd77f14978b4b49880b1a39abc66987"
I20260709 13:14:32.759672  1848 raft_consensus.cc:3060] T 6b8eac6adeda4c8a9e8e4142a9b86feb P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:32.761587  1794 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:32.759363  1743 catalog_manager.cc:5697] T b06ca2d520f7457692822190ac2a8f32 P cfdfd9c3b64347f997e5d181c39fddcd reported cstate change: term changed from 0 to 1, leader changed from <none> to cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66). New cstate: current_term: 1 leader_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:32.769256  2065 raft_consensus.cc:697] T 6b8eac6adeda4c8a9e8e4142a9b86feb P cfdfd9c3b64347f997e5d181c39fddcd [term 1 LEADER]: Becoming Leader. State: Replica: cfdfd9c3b64347f997e5d181c39fddcd, State: Running, Role: LEADER
I20260709 13:14:32.769603  1848 raft_consensus.cc:2468] T 6b8eac6adeda4c8a9e8e4142a9b86feb P efd77f14978b4b49880b1a39abc66987 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfdfd9c3b64347f997e5d181c39fddcd in term 1.
I20260709 13:14:32.770547  2065 consensus_queue.cc:237] T 6b8eac6adeda4c8a9e8e4142a9b86feb P cfdfd9c3b64347f997e5d181c39fddcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } }
I20260709 13:14:32.776997  1848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaceebb1e1c4a61968762f9b4b32dea" candidate_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efd77f14978b4b49880b1a39abc66987" is_pre_election: true
W20260709 13:14:32.778606  1961 leader_election.cc:343] T aaaceebb1e1c4a61968762f9b4b32dea P 4cfc2f643a0a46888b750e0ab7b7fde6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer efd77f14978b4b49880b1a39abc66987 (127.23.140.65:41453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:32.779040  1961 leader_election.cc:304] T aaaceebb1e1c4a61968762f9b4b32dea P 4cfc2f643a0a46888b750e0ab7b7fde6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cfc2f643a0a46888b750e0ab7b7fde6; no voters: cfdfd9c3b64347f997e5d181c39fddcd, efd77f14978b4b49880b1a39abc66987
I20260709 13:14:32.780261  2044 raft_consensus.cc:2749] T aaaceebb1e1c4a61968762f9b4b32dea P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:32.781711  2039 tablet_bootstrap.cc:492] T 849c6495f30e45caa73c1f4be5c2d65c P 4cfc2f643a0a46888b750e0ab7b7fde6: Bootstrap starting.
I20260709 13:14:32.796768  2037 tablet_bootstrap.cc:492] T b16576d7015c475fb71585c29048e5a9 P efd77f14978b4b49880b1a39abc66987: No bootstrap required, opened a new log
I20260709 13:14:32.797410  2037 ts_tablet_manager.cc:1403] T b16576d7015c475fb71585c29048e5a9 P efd77f14978b4b49880b1a39abc66987: Time spent bootstrapping tablet: real 0.119s	user 0.051s	sys 0.058s
I20260709 13:14:32.798224  2038 tablet_bootstrap.cc:492] T afd1f7dbbeee4d218895cf5a8e54efd3 P cfdfd9c3b64347f997e5d181c39fddcd: No bootstrap required, opened a new log
I20260709 13:14:32.798967  2038 ts_tablet_manager.cc:1403] T afd1f7dbbeee4d218895cf5a8e54efd3 P cfdfd9c3b64347f997e5d181c39fddcd: Time spent bootstrapping tablet: real 0.116s	user 0.035s	sys 0.062s
I20260709 13:14:32.800676  2037 raft_consensus.cc:359] T b16576d7015c475fb71585c29048e5a9 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:32.802717  2037 raft_consensus.cc:385] T b16576d7015c475fb71585c29048e5a9 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:32.803119  2037 raft_consensus.cc:740] T b16576d7015c475fb71585c29048e5a9 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efd77f14978b4b49880b1a39abc66987, State: Initialized, Role: FOLLOWER
I20260709 13:14:32.802882  2038 raft_consensus.cc:359] T afd1f7dbbeee4d218895cf5a8e54efd3 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:32.803751  2038 raft_consensus.cc:385] T afd1f7dbbeee4d218895cf5a8e54efd3 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:32.804064  2038 raft_consensus.cc:740] T afd1f7dbbeee4d218895cf5a8e54efd3 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfdfd9c3b64347f997e5d181c39fddcd, State: Initialized, Role: FOLLOWER
I20260709 13:14:32.804260  2037 consensus_queue.cc:260] T b16576d7015c475fb71585c29048e5a9 P efd77f14978b4b49880b1a39abc66987 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:32.804947  2038 consensus_queue.cc:260] T afd1f7dbbeee4d218895cf5a8e54efd3 P cfdfd9c3b64347f997e5d181c39fddcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:32.808014  1923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd1f7dbbeee4d218895cf5a8e54efd3" candidate_uuid: "efd77f14978b4b49880b1a39abc66987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" is_pre_election: true
I20260709 13:14:32.808677  1923 raft_consensus.cc:2468] T afd1f7dbbeee4d218895cf5a8e54efd3 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efd77f14978b4b49880b1a39abc66987 in term 0.
I20260709 13:14:32.809702  2038 ts_tablet_manager.cc:1434] T afd1f7dbbeee4d218895cf5a8e54efd3 P cfdfd9c3b64347f997e5d181c39fddcd: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 13:14:32.809919  2037 ts_tablet_manager.cc:1434] T b16576d7015c475fb71585c29048e5a9 P efd77f14978b4b49880b1a39abc66987: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:14:32.810211  1814 leader_election.cc:304] T afd1f7dbbeee4d218895cf5a8e54efd3 P efd77f14978b4b49880b1a39abc66987 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cfdfd9c3b64347f997e5d181c39fddcd, efd77f14978b4b49880b1a39abc66987; no voters: 
I20260709 13:14:32.810837  2038 tablet_bootstrap.cc:492] T aaaceebb1e1c4a61968762f9b4b32dea P cfdfd9c3b64347f997e5d181c39fddcd: Bootstrap starting.
I20260709 13:14:32.812191  2043 raft_consensus.cc:2804] T afd1f7dbbeee4d218895cf5a8e54efd3 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:32.812608  2043 raft_consensus.cc:493] T afd1f7dbbeee4d218895cf5a8e54efd3 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:32.812956  2043 raft_consensus.cc:3060] T afd1f7dbbeee4d218895cf5a8e54efd3 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:32.811249  2037 tablet_bootstrap.cc:492] T aaaceebb1e1c4a61968762f9b4b32dea P efd77f14978b4b49880b1a39abc66987: Bootstrap starting.
I20260709 13:14:32.817921  2038 tablet_bootstrap.cc:654] T aaaceebb1e1c4a61968762f9b4b32dea P cfdfd9c3b64347f997e5d181c39fddcd: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:32.820425  2039 tablet_bootstrap.cc:654] T 849c6495f30e45caa73c1f4be5c2d65c P 4cfc2f643a0a46888b750e0ab7b7fde6: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:32.821054  2037 tablet_bootstrap.cc:654] T aaaceebb1e1c4a61968762f9b4b32dea P efd77f14978b4b49880b1a39abc66987: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:32.822319  1997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd1f7dbbeee4d218895cf5a8e54efd3" candidate_uuid: "efd77f14978b4b49880b1a39abc66987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" is_pre_election: true
I20260709 13:14:32.824198  2065 raft_consensus.cc:493] T 2f141c8bf4624551b8906e0469e6c4d8 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:32.824469  1811 leader_election.cc:343] T afd1f7dbbeee4d218895cf5a8e54efd3 P efd77f14978b4b49880b1a39abc66987 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:32.824723  2065 raft_consensus.cc:515] T 2f141c8bf4624551b8906e0469e6c4d8 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:32.826972  2065 leader_election.cc:290] T 2f141c8bf4624551b8906e0469e6c4d8 P cfdfd9c3b64347f997e5d181c39fddcd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efd77f14978b4b49880b1a39abc66987 (127.23.140.65:41453), 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67:33709)
I20260709 13:14:32.829059  1848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f141c8bf4624551b8906e0469e6c4d8" candidate_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efd77f14978b4b49880b1a39abc66987" is_pre_election: true
I20260709 13:14:32.830027  1848 raft_consensus.cc:2468] T 2f141c8bf4624551b8906e0469e6c4d8 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfdfd9c3b64347f997e5d181c39fddcd in term 0.
I20260709 13:14:32.831724  1887 leader_election.cc:304] T 2f141c8bf4624551b8906e0469e6c4d8 P cfdfd9c3b64347f997e5d181c39fddcd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cfdfd9c3b64347f997e5d181c39fddcd, efd77f14978b4b49880b1a39abc66987; no voters: 
I20260709 13:14:32.832719  2039 tablet_bootstrap.cc:492] T 849c6495f30e45caa73c1f4be5c2d65c P 4cfc2f643a0a46888b750e0ab7b7fde6: No bootstrap required, opened a new log
I20260709 13:14:32.832914  2065 raft_consensus.cc:2804] T 2f141c8bf4624551b8906e0469e6c4d8 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:32.833413  2039 ts_tablet_manager.cc:1403] T 849c6495f30e45caa73c1f4be5c2d65c P 4cfc2f643a0a46888b750e0ab7b7fde6: Time spent bootstrapping tablet: real 0.052s	user 0.013s	sys 0.000s
I20260709 13:14:32.833539  2065 raft_consensus.cc:493] T 2f141c8bf4624551b8906e0469e6c4d8 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:32.834208  2065 raft_consensus.cc:3060] T 2f141c8bf4624551b8906e0469e6c4d8 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:32.839262  1997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f141c8bf4624551b8906e0469e6c4d8" candidate_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" is_pre_election: true
W20260709 13:14:32.840656  1886 leader_election.cc:343] T 2f141c8bf4624551b8906e0469e6c4d8 P cfdfd9c3b64347f997e5d181c39fddcd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:32.840957  2043 raft_consensus.cc:515] T afd1f7dbbeee4d218895cf5a8e54efd3 P efd77f14978b4b49880b1a39abc66987 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:32.843007  2043 leader_election.cc:290] T afd1f7dbbeee4d218895cf5a8e54efd3 P efd77f14978b4b49880b1a39abc66987 [CANDIDATE]: Term 1 election: Requested vote from peers cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66:43351), 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67:33709)
I20260709 13:14:32.843073  2038 tablet_bootstrap.cc:492] T aaaceebb1e1c4a61968762f9b4b32dea P cfdfd9c3b64347f997e5d181c39fddcd: No bootstrap required, opened a new log
I20260709 13:14:32.843809  2038 ts_tablet_manager.cc:1403] T aaaceebb1e1c4a61968762f9b4b32dea P cfdfd9c3b64347f997e5d181c39fddcd: Time spent bootstrapping tablet: real 0.033s	user 0.023s	sys 0.003s
I20260709 13:14:32.837474  2039 raft_consensus.cc:359] T 849c6495f30e45caa73c1f4be5c2d65c P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:32.844856  2039 raft_consensus.cc:385] T 849c6495f30e45caa73c1f4be5c2d65c P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:32.845227  2039 raft_consensus.cc:740] T 849c6495f30e45caa73c1f4be5c2d65c P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cfc2f643a0a46888b750e0ab7b7fde6, State: Initialized, Role: FOLLOWER
I20260709 13:14:32.846426  2038 raft_consensus.cc:359] T aaaceebb1e1c4a61968762f9b4b32dea P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:32.847098  2039 consensus_queue.cc:260] T 849c6495f30e45caa73c1f4be5c2d65c P 4cfc2f643a0a46888b750e0ab7b7fde6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:32.847946  1997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd1f7dbbeee4d218895cf5a8e54efd3" candidate_uuid: "efd77f14978b4b49880b1a39abc66987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6"
I20260709 13:14:32.848054  1743 catalog_manager.cc:5697] T 6b8eac6adeda4c8a9e8e4142a9b86feb P cfdfd9c3b64347f997e5d181c39fddcd reported cstate change: term changed from 0 to 1, leader changed from <none> to cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66). New cstate: current_term: 1 leader_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:32.849241  1811 leader_election.cc:343] T afd1f7dbbeee4d218895cf5a8e54efd3 P efd77f14978b4b49880b1a39abc66987 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:32.850320  2037 tablet_bootstrap.cc:492] T aaaceebb1e1c4a61968762f9b4b32dea P efd77f14978b4b49880b1a39abc66987: No bootstrap required, opened a new log
I20260709 13:14:32.851025  2037 ts_tablet_manager.cc:1403] T aaaceebb1e1c4a61968762f9b4b32dea P efd77f14978b4b49880b1a39abc66987: Time spent bootstrapping tablet: real 0.040s	user 0.014s	sys 0.016s
I20260709 13:14:32.847151  2038 raft_consensus.cc:385] T aaaceebb1e1c4a61968762f9b4b32dea P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:32.852404  2039 ts_tablet_manager.cc:1434] T 849c6495f30e45caa73c1f4be5c2d65c P 4cfc2f643a0a46888b750e0ab7b7fde6: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.002s
I20260709 13:14:32.852700  2038 raft_consensus.cc:740] T aaaceebb1e1c4a61968762f9b4b32dea P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfdfd9c3b64347f997e5d181c39fddcd, State: Initialized, Role: FOLLOWER
I20260709 13:14:32.853533  2039 tablet_bootstrap.cc:492] T afd1f7dbbeee4d218895cf5a8e54efd3 P 4cfc2f643a0a46888b750e0ab7b7fde6: Bootstrap starting.
I20260709 13:14:32.850256  1923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd1f7dbbeee4d218895cf5a8e54efd3" candidate_uuid: "efd77f14978b4b49880b1a39abc66987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfdfd9c3b64347f997e5d181c39fddcd"
I20260709 13:14:32.854089  2065 raft_consensus.cc:515] T 2f141c8bf4624551b8906e0469e6c4d8 P cfdfd9c3b64347f997e5d181c39fddcd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:32.854601  2037 raft_consensus.cc:359] T aaaceebb1e1c4a61968762f9b4b32dea P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:32.855482  2037 raft_consensus.cc:385] T aaaceebb1e1c4a61968762f9b4b32dea P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:32.855515  2044 raft_consensus.cc:493] T 849c6495f30e45caa73c1f4be5c2d65c P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:32.855983  2037 raft_consensus.cc:740] T aaaceebb1e1c4a61968762f9b4b32dea P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efd77f14978b4b49880b1a39abc66987, State: Initialized, Role: FOLLOWER
I20260709 13:14:32.856094  2044 raft_consensus.cc:515] T 849c6495f30e45caa73c1f4be5c2d65c P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:32.856835  2065 leader_election.cc:290] T 2f141c8bf4624551b8906e0469e6c4d8 P cfdfd9c3b64347f997e5d181c39fddcd [CANDIDATE]: Term 1 election: Requested vote from peers efd77f14978b4b49880b1a39abc66987 (127.23.140.65:41453), 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67:33709)
I20260709 13:14:32.857072  2037 consensus_queue.cc:260] T aaaceebb1e1c4a61968762f9b4b32dea P efd77f14978b4b49880b1a39abc66987 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:32.855604  2038 consensus_queue.cc:260] T aaaceebb1e1c4a61968762f9b4b32dea P cfdfd9c3b64347f997e5d181c39fddcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:32.858560  2044 leader_election.cc:290] T 849c6495f30e45caa73c1f4be5c2d65c P 4cfc2f643a0a46888b750e0ab7b7fde6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efd77f14978b4b49880b1a39abc66987 (127.23.140.65:41453), cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66:43351)
I20260709 13:14:32.859196  1847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849c6495f30e45caa73c1f4be5c2d65c" candidate_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efd77f14978b4b49880b1a39abc66987" is_pre_election: true
W20260709 13:14:32.860692  1961 leader_election.cc:343] T 849c6495f30e45caa73c1f4be5c2d65c P 4cfc2f643a0a46888b750e0ab7b7fde6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer efd77f14978b4b49880b1a39abc66987 (127.23.140.65:41453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:32.862521  2037 ts_tablet_manager.cc:1434] T aaaceebb1e1c4a61968762f9b4b32dea P efd77f14978b4b49880b1a39abc66987: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 13:14:32.862901  2038 ts_tablet_manager.cc:1434] T aaaceebb1e1c4a61968762f9b4b32dea P cfdfd9c3b64347f997e5d181c39fddcd: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:14:32.863696  2037 tablet_bootstrap.cc:492] T 849c6495f30e45caa73c1f4be5c2d65c P efd77f14978b4b49880b1a39abc66987: Bootstrap starting.
I20260709 13:14:32.863835  2038 tablet_bootstrap.cc:492] T b16576d7015c475fb71585c29048e5a9 P cfdfd9c3b64347f997e5d181c39fddcd: Bootstrap starting.
I20260709 13:14:32.864411  2039 tablet_bootstrap.cc:654] T afd1f7dbbeee4d218895cf5a8e54efd3 P 4cfc2f643a0a46888b750e0ab7b7fde6: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:32.866127  1997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f141c8bf4624551b8906e0469e6c4d8" candidate_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6"
I20260709 13:14:32.868067  1922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849c6495f30e45caa73c1f4be5c2d65c" candidate_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" is_pre_election: true
I20260709 13:14:32.868726  1922 raft_consensus.cc:2468] T 849c6495f30e45caa73c1f4be5c2d65c P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cfc2f643a0a46888b750e0ab7b7fde6 in term 0.
W20260709 13:14:32.869589  1886 leader_election.cc:343] T 2f141c8bf4624551b8906e0469e6c4d8 P cfdfd9c3b64347f997e5d181c39fddcd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:32.870208  2038 tablet_bootstrap.cc:654] T b16576d7015c475fb71585c29048e5a9 P cfdfd9c3b64347f997e5d181c39fddcd: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:32.870728  1963 leader_election.cc:304] T 849c6495f30e45caa73c1f4be5c2d65c P 4cfc2f643a0a46888b750e0ab7b7fde6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cfc2f643a0a46888b750e0ab7b7fde6, cfdfd9c3b64347f997e5d181c39fddcd; no voters: efd77f14978b4b49880b1a39abc66987
I20260709 13:14:32.871989  2044 raft_consensus.cc:2804] T 849c6495f30e45caa73c1f4be5c2d65c P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:32.872334  2044 raft_consensus.cc:493] T 849c6495f30e45caa73c1f4be5c2d65c P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:32.872738  2044 raft_consensus.cc:3060] T 849c6495f30e45caa73c1f4be5c2d65c P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:32.872802  2037 tablet_bootstrap.cc:654] T 849c6495f30e45caa73c1f4be5c2d65c P efd77f14978b4b49880b1a39abc66987: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:32.878238  1848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f141c8bf4624551b8906e0469e6c4d8" candidate_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efd77f14978b4b49880b1a39abc66987"
I20260709 13:14:32.879067  1848 raft_consensus.cc:3060] T 2f141c8bf4624551b8906e0469e6c4d8 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:32.886255  2037 tablet_bootstrap.cc:492] T 849c6495f30e45caa73c1f4be5c2d65c P efd77f14978b4b49880b1a39abc66987: No bootstrap required, opened a new log
I20260709 13:14:32.886962  2037 ts_tablet_manager.cc:1403] T 849c6495f30e45caa73c1f4be5c2d65c P efd77f14978b4b49880b1a39abc66987: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.008s
I20260709 13:14:32.890147  2037 raft_consensus.cc:359] T 849c6495f30e45caa73c1f4be5c2d65c P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:32.892431  2037 raft_consensus.cc:385] T 849c6495f30e45caa73c1f4be5c2d65c P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:32.892313  2044 raft_consensus.cc:515] T 849c6495f30e45caa73c1f4be5c2d65c P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:32.893143  2037 raft_consensus.cc:740] T 849c6495f30e45caa73c1f4be5c2d65c P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efd77f14978b4b49880b1a39abc66987, State: Initialized, Role: FOLLOWER
I20260709 13:14:32.891827  2080 raft_consensus.cc:493] T fe7a5d3b676046eba775b5d39c4c1cd9 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:32.854130  1923 raft_consensus.cc:3060] T afd1f7dbbeee4d218895cf5a8e54efd3 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:32.894145  2080 raft_consensus.cc:515] T fe7a5d3b676046eba775b5d39c4c1cd9 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:32.898083  1847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7a5d3b676046eba775b5d39c4c1cd9" candidate_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efd77f14978b4b49880b1a39abc66987" is_pre_election: true
W20260709 13:14:32.900033  1961 leader_election.cc:343] T fe7a5d3b676046eba775b5d39c4c1cd9 P 4cfc2f643a0a46888b750e0ab7b7fde6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer efd77f14978b4b49880b1a39abc66987 (127.23.140.65:41453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:32.902491  2080 leader_election.cc:290] T fe7a5d3b676046eba775b5d39c4c1cd9 P 4cfc2f643a0a46888b750e0ab7b7fde6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efd77f14978b4b49880b1a39abc66987 (127.23.140.65:41453), cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66:43351)
I20260709 13:14:32.901528  2037 consensus_queue.cc:260] T 849c6495f30e45caa73c1f4be5c2d65c P efd77f14978b4b49880b1a39abc66987 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:32.903870  1848 raft_consensus.cc:2468] T 2f141c8bf4624551b8906e0469e6c4d8 P efd77f14978b4b49880b1a39abc66987 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfdfd9c3b64347f997e5d181c39fddcd in term 1.
I20260709 13:14:32.906052  2044 leader_election.cc:290] T 849c6495f30e45caa73c1f4be5c2d65c P 4cfc2f643a0a46888b750e0ab7b7fde6 [CANDIDATE]: Term 1 election: Requested vote from peers efd77f14978b4b49880b1a39abc66987 (127.23.140.65:41453), cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66:43351)
I20260709 13:14:32.907590  2037 ts_tablet_manager.cc:1434] T 849c6495f30e45caa73c1f4be5c2d65c P efd77f14978b4b49880b1a39abc66987: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.002s
I20260709 13:14:32.909209  2037 tablet_bootstrap.cc:492] T fe7a5d3b676046eba775b5d39c4c1cd9 P efd77f14978b4b49880b1a39abc66987: Bootstrap starting.
I20260709 13:14:32.914497  1921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849c6495f30e45caa73c1f4be5c2d65c" candidate_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfdfd9c3b64347f997e5d181c39fddcd"
I20260709 13:14:32.915226  1921 raft_consensus.cc:3060] T 849c6495f30e45caa73c1f4be5c2d65c P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:32.916324  2037 tablet_bootstrap.cc:654] T fe7a5d3b676046eba775b5d39c4c1cd9 P efd77f14978b4b49880b1a39abc66987: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:32.916386  2039 tablet_bootstrap.cc:492] T afd1f7dbbeee4d218895cf5a8e54efd3 P 4cfc2f643a0a46888b750e0ab7b7fde6: No bootstrap required, opened a new log
I20260709 13:14:32.917176  2039 ts_tablet_manager.cc:1403] T afd1f7dbbeee4d218895cf5a8e54efd3 P 4cfc2f643a0a46888b750e0ab7b7fde6: Time spent bootstrapping tablet: real 0.064s	user 0.019s	sys 0.032s
I20260709 13:14:32.917649  1887 leader_election.cc:304] T 2f141c8bf4624551b8906e0469e6c4d8 P cfdfd9c3b64347f997e5d181c39fddcd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cfdfd9c3b64347f997e5d181c39fddcd, efd77f14978b4b49880b1a39abc66987; no voters: 4cfc2f643a0a46888b750e0ab7b7fde6
I20260709 13:14:32.918529  2065 raft_consensus.cc:2804] T 2f141c8bf4624551b8906e0469e6c4d8 P cfdfd9c3b64347f997e5d181c39fddcd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:32.919023  2065 raft_consensus.cc:697] T 2f141c8bf4624551b8906e0469e6c4d8 P cfdfd9c3b64347f997e5d181c39fddcd [term 1 LEADER]: Becoming Leader. State: Replica: cfdfd9c3b64347f997e5d181c39fddcd, State: Running, Role: LEADER
I20260709 13:14:32.920199  2039 raft_consensus.cc:359] T afd1f7dbbeee4d218895cf5a8e54efd3 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:32.920063  2065 consensus_queue.cc:237] T 2f141c8bf4624551b8906e0469e6c4d8 P cfdfd9c3b64347f997e5d181c39fddcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:32.920977  2039 raft_consensus.cc:385] T afd1f7dbbeee4d218895cf5a8e54efd3 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:32.921350  2039 raft_consensus.cc:740] T afd1f7dbbeee4d218895cf5a8e54efd3 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cfc2f643a0a46888b750e0ab7b7fde6, State: Initialized, Role: FOLLOWER
I20260709 13:14:32.922318  2069 raft_consensus.cc:493] T fe7a5d3b676046eba775b5d39c4c1cd9 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:32.922132  2039 consensus_queue.cc:260] T afd1f7dbbeee4d218895cf5a8e54efd3 P 4cfc2f643a0a46888b750e0ab7b7fde6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:32.916558  2038 tablet_bootstrap.cc:492] T b16576d7015c475fb71585c29048e5a9 P cfdfd9c3b64347f997e5d181c39fddcd: No bootstrap required, opened a new log
I20260709 13:14:32.922801  2069 raft_consensus.cc:515] T fe7a5d3b676046eba775b5d39c4c1cd9 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:32.923308  2038 ts_tablet_manager.cc:1403] T b16576d7015c475fb71585c29048e5a9 P cfdfd9c3b64347f997e5d181c39fddcd: Time spent bootstrapping tablet: real 0.060s	user 0.018s	sys 0.021s
I20260709 13:14:32.925014  2069 leader_election.cc:290] T fe7a5d3b676046eba775b5d39c4c1cd9 P cfdfd9c3b64347f997e5d181c39fddcd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efd77f14978b4b49880b1a39abc66987 (127.23.140.65:41453), 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67:33709)
I20260709 13:14:32.917230  1922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7a5d3b676046eba775b5d39c4c1cd9" candidate_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" is_pre_election: true
I20260709 13:14:32.926011  1922 raft_consensus.cc:2468] T fe7a5d3b676046eba775b5d39c4c1cd9 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cfc2f643a0a46888b750e0ab7b7fde6 in term 0.
I20260709 13:14:32.926079  2038 raft_consensus.cc:359] T b16576d7015c475fb71585c29048e5a9 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:32.926906  2038 raft_consensus.cc:385] T b16576d7015c475fb71585c29048e5a9 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:32.927181  2038 raft_consensus.cc:740] T b16576d7015c475fb71585c29048e5a9 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfdfd9c3b64347f997e5d181c39fddcd, State: Initialized, Role: FOLLOWER
I20260709 13:14:32.927803  2038 consensus_queue.cc:260] T b16576d7015c475fb71585c29048e5a9 P cfdfd9c3b64347f997e5d181c39fddcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:32.929328  1847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7a5d3b676046eba775b5d39c4c1cd9" candidate_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efd77f14978b4b49880b1a39abc66987" is_pre_election: true
I20260709 13:14:32.929718  2038 ts_tablet_manager.cc:1434] T b16576d7015c475fb71585c29048e5a9 P cfdfd9c3b64347f997e5d181c39fddcd: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:14:32.930825  1963 leader_election.cc:304] T fe7a5d3b676046eba775b5d39c4c1cd9 P 4cfc2f643a0a46888b750e0ab7b7fde6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cfc2f643a0a46888b750e0ab7b7fde6, cfdfd9c3b64347f997e5d181c39fddcd; no voters: efd77f14978b4b49880b1a39abc66987
I20260709 13:14:32.931912  2039 ts_tablet_manager.cc:1434] T afd1f7dbbeee4d218895cf5a8e54efd3 P 4cfc2f643a0a46888b750e0ab7b7fde6: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.003s
I20260709 13:14:32.932485  1997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7a5d3b676046eba775b5d39c4c1cd9" candidate_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" is_pre_election: true
I20260709 13:14:32.932956  2039 tablet_bootstrap.cc:492] T 2f141c8bf4624551b8906e0469e6c4d8 P 4cfc2f643a0a46888b750e0ab7b7fde6: Bootstrap starting.
I20260709 13:14:32.933102  1997 raft_consensus.cc:2468] T fe7a5d3b676046eba775b5d39c4c1cd9 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfdfd9c3b64347f997e5d181c39fddcd in term 0.
I20260709 13:14:32.935124  1886 leader_election.cc:304] T fe7a5d3b676046eba775b5d39c4c1cd9 P cfdfd9c3b64347f997e5d181c39fddcd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cfc2f643a0a46888b750e0ab7b7fde6, cfdfd9c3b64347f997e5d181c39fddcd; no voters: 
I20260709 13:14:32.936229  2045 raft_consensus.cc:2804] T fe7a5d3b676046eba775b5d39c4c1cd9 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:32.936635  2045 raft_consensus.cc:493] T fe7a5d3b676046eba775b5d39c4c1cd9 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:32.937017  2045 raft_consensus.cc:3060] T fe7a5d3b676046eba775b5d39c4c1cd9 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:32.939802  2039 tablet_bootstrap.cc:654] T 2f141c8bf4624551b8906e0469e6c4d8 P 4cfc2f643a0a46888b750e0ab7b7fde6: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:32.914546  1848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849c6495f30e45caa73c1f4be5c2d65c" candidate_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efd77f14978b4b49880b1a39abc66987"
I20260709 13:14:32.942615  1848 raft_consensus.cc:3060] T 849c6495f30e45caa73c1f4be5c2d65c P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:32.946009  2044 raft_consensus.cc:2804] T fe7a5d3b676046eba775b5d39c4c1cd9 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:32.946599  2044 raft_consensus.cc:493] T fe7a5d3b676046eba775b5d39c4c1cd9 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:32.947034  2044 raft_consensus.cc:3060] T fe7a5d3b676046eba775b5d39c4c1cd9 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:32.954159  1887 leader_election.cc:343] T fe7a5d3b676046eba775b5d39c4c1cd9 P cfdfd9c3b64347f997e5d181c39fddcd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer efd77f14978b4b49880b1a39abc66987 (127.23.140.65:41453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:32.959257  1923 raft_consensus.cc:2468] T afd1f7dbbeee4d218895cf5a8e54efd3 P cfdfd9c3b64347f997e5d181c39fddcd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efd77f14978b4b49880b1a39abc66987 in term 1.
I20260709 13:14:32.961090  1814 leader_election.cc:304] T afd1f7dbbeee4d218895cf5a8e54efd3 P efd77f14978b4b49880b1a39abc66987 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cfdfd9c3b64347f997e5d181c39fddcd, efd77f14978b4b49880b1a39abc66987; no voters: 4cfc2f643a0a46888b750e0ab7b7fde6
I20260709 13:14:32.962914  2043 raft_consensus.cc:2804] T afd1f7dbbeee4d218895cf5a8e54efd3 P efd77f14978b4b49880b1a39abc66987 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:32.967976  1742 catalog_manager.cc:5697] T 2f141c8bf4624551b8906e0469e6c4d8 P cfdfd9c3b64347f997e5d181c39fddcd reported cstate change: term changed from 0 to 1, leader changed from <none> to cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66). New cstate: current_term: 1 leader_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:32.972812  2045 raft_consensus.cc:515] T fe7a5d3b676046eba775b5d39c4c1cd9 P cfdfd9c3b64347f997e5d181c39fddcd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:32.975303  2045 leader_election.cc:290] T fe7a5d3b676046eba775b5d39c4c1cd9 P cfdfd9c3b64347f997e5d181c39fddcd [CANDIDATE]: Term 1 election: Requested vote from peers efd77f14978b4b49880b1a39abc66987 (127.23.140.65:41453), 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67:33709)
I20260709 13:14:32.982192  2039 tablet_bootstrap.cc:492] T 2f141c8bf4624551b8906e0469e6c4d8 P 4cfc2f643a0a46888b750e0ab7b7fde6: No bootstrap required, opened a new log
I20260709 13:14:32.977190  1921 raft_consensus.cc:2468] T 849c6495f30e45caa73c1f4be5c2d65c P cfdfd9c3b64347f997e5d181c39fddcd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cfc2f643a0a46888b750e0ab7b7fde6 in term 1.
I20260709 13:14:32.977694  2043 raft_consensus.cc:697] T afd1f7dbbeee4d218895cf5a8e54efd3 P efd77f14978b4b49880b1a39abc66987 [term 1 LEADER]: Becoming Leader. State: Replica: efd77f14978b4b49880b1a39abc66987, State: Running, Role: LEADER
I20260709 13:14:32.982712  2039 ts_tablet_manager.cc:1403] T 2f141c8bf4624551b8906e0469e6c4d8 P 4cfc2f643a0a46888b750e0ab7b7fde6: Time spent bootstrapping tablet: real 0.050s	user 0.033s	sys 0.016s
I20260709 13:14:32.978801  1848 raft_consensus.cc:2468] T 849c6495f30e45caa73c1f4be5c2d65c P efd77f14978b4b49880b1a39abc66987 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cfc2f643a0a46888b750e0ab7b7fde6 in term 1.
I20260709 13:14:32.983213  2043 consensus_queue.cc:237] T afd1f7dbbeee4d218895cf5a8e54efd3 P efd77f14978b4b49880b1a39abc66987 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:32.980151  1847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7a5d3b676046eba775b5d39c4c1cd9" candidate_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efd77f14978b4b49880b1a39abc66987"
I20260709 13:14:32.985399  1961 leader_election.cc:304] T 849c6495f30e45caa73c1f4be5c2d65c P 4cfc2f643a0a46888b750e0ab7b7fde6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cfc2f643a0a46888b750e0ab7b7fde6, efd77f14978b4b49880b1a39abc66987; no voters: 
I20260709 13:14:32.985972  2039 raft_consensus.cc:359] T 2f141c8bf4624551b8906e0469e6c4d8 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:32.986285  2080 raft_consensus.cc:2804] T 849c6495f30e45caa73c1f4be5c2d65c P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:32.986716  2039 raft_consensus.cc:385] T 2f141c8bf4624551b8906e0469e6c4d8 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:32.987061  2039 raft_consensus.cc:740] T 2f141c8bf4624551b8906e0469e6c4d8 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cfc2f643a0a46888b750e0ab7b7fde6, State: Initialized, Role: FOLLOWER
W20260709 13:14:32.987165  1887 leader_election.cc:343] T fe7a5d3b676046eba775b5d39c4c1cd9 P cfdfd9c3b64347f997e5d181c39fddcd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer efd77f14978b4b49880b1a39abc66987 (127.23.140.65:41453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:32.979190  1997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7a5d3b676046eba775b5d39c4c1cd9" candidate_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6"
I20260709 13:14:32.987762  2039 consensus_queue.cc:260] T 2f141c8bf4624551b8906e0469e6c4d8 P 4cfc2f643a0a46888b750e0ab7b7fde6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:32.990768  2045 raft_consensus.cc:493] T b16576d7015c475fb71585c29048e5a9 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:32.991466  2045 raft_consensus.cc:515] T b16576d7015c475fb71585c29048e5a9 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:32.992297  2037 tablet_bootstrap.cc:492] T fe7a5d3b676046eba775b5d39c4c1cd9 P efd77f14978b4b49880b1a39abc66987: No bootstrap required, opened a new log
I20260709 13:14:32.993036  2037 ts_tablet_manager.cc:1403] T fe7a5d3b676046eba775b5d39c4c1cd9 P efd77f14978b4b49880b1a39abc66987: Time spent bootstrapping tablet: real 0.084s	user 0.024s	sys 0.035s
I20260709 13:14:32.993646  2044 raft_consensus.cc:515] T fe7a5d3b676046eba775b5d39c4c1cd9 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:33.000275  1997 raft_consensus.cc:2393] T fe7a5d3b676046eba775b5d39c4c1cd9 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cfdfd9c3b64347f997e5d181c39fddcd in current term 1: Already voted for candidate 4cfc2f643a0a46888b750e0ab7b7fde6 in this term.
I20260709 13:14:33.000947  1996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16576d7015c475fb71585c29048e5a9" candidate_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" is_pre_election: true
I20260709 13:14:33.001933  1996 raft_consensus.cc:2468] T b16576d7015c475fb71585c29048e5a9 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfdfd9c3b64347f997e5d181c39fddcd in term 0.
I20260709 13:14:33.002470  2084 raft_consensus.cc:493] T 3454c9475988492d863379ed4177d7c3 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.002955  2084 raft_consensus.cc:515] T 3454c9475988492d863379ed4177d7c3 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:33.003537  2037 raft_consensus.cc:359] T fe7a5d3b676046eba775b5d39c4c1cd9 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:33.004282  2037 raft_consensus.cc:385] T fe7a5d3b676046eba775b5d39c4c1cd9 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:33.004578  2037 raft_consensus.cc:740] T fe7a5d3b676046eba775b5d39c4c1cd9 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efd77f14978b4b49880b1a39abc66987, State: Initialized, Role: FOLLOWER
I20260709 13:14:33.004458  1886 leader_election.cc:304] T b16576d7015c475fb71585c29048e5a9 P cfdfd9c3b64347f997e5d181c39fddcd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cfc2f643a0a46888b750e0ab7b7fde6, cfdfd9c3b64347f997e5d181c39fddcd; no voters: 
I20260709 13:14:33.005038  2084 leader_election.cc:290] T 3454c9475988492d863379ed4177d7c3 P efd77f14978b4b49880b1a39abc66987 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66:43351), 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67:33709)
I20260709 13:14:33.005523  2037 consensus_queue.cc:260] T fe7a5d3b676046eba775b5d39c4c1cd9 P efd77f14978b4b49880b1a39abc66987 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:33.005851  2065 raft_consensus.cc:2804] T b16576d7015c475fb71585c29048e5a9 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:33.006439  2065 raft_consensus.cc:493] T b16576d7015c475fb71585c29048e5a9 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:33.006904  2065 raft_consensus.cc:3060] T b16576d7015c475fb71585c29048e5a9 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:33.007520  1921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3454c9475988492d863379ed4177d7c3" candidate_uuid: "efd77f14978b4b49880b1a39abc66987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" is_pre_election: true
I20260709 13:14:33.008213  1921 raft_consensus.cc:2468] T 3454c9475988492d863379ed4177d7c3 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efd77f14978b4b49880b1a39abc66987 in term 0.
I20260709 13:14:33.009306  1814 leader_election.cc:304] T 3454c9475988492d863379ed4177d7c3 P efd77f14978b4b49880b1a39abc66987 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cfdfd9c3b64347f997e5d181c39fddcd, efd77f14978b4b49880b1a39abc66987; no voters: 
I20260709 13:14:32.997403  1847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16576d7015c475fb71585c29048e5a9" candidate_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efd77f14978b4b49880b1a39abc66987" is_pre_election: true
I20260709 13:14:33.010217  1996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3454c9475988492d863379ed4177d7c3" candidate_uuid: "efd77f14978b4b49880b1a39abc66987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" is_pre_election: true
I20260709 13:14:33.011067  2084 raft_consensus.cc:2804] T 3454c9475988492d863379ed4177d7c3 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:33.011554  2084 raft_consensus.cc:493] T 3454c9475988492d863379ed4177d7c3 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:33.010351  1847 raft_consensus.cc:2468] T b16576d7015c475fb71585c29048e5a9 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfdfd9c3b64347f997e5d181c39fddcd in term 0.
I20260709 13:14:33.011966  2084 raft_consensus.cc:3060] T 3454c9475988492d863379ed4177d7c3 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:33.013725  1848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7a5d3b676046eba775b5d39c4c1cd9" candidate_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efd77f14978b4b49880b1a39abc66987"
I20260709 13:14:33.014566  1848 raft_consensus.cc:3060] T fe7a5d3b676046eba775b5d39c4c1cd9 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:33.016626  1811 leader_election.cc:343] T 3454c9475988492d863379ed4177d7c3 P efd77f14978b4b49880b1a39abc66987 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:33.016695  1921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7a5d3b676046eba775b5d39c4c1cd9" candidate_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfdfd9c3b64347f997e5d181c39fddcd"
I20260709 13:14:33.017952  1921 raft_consensus.cc:2393] T fe7a5d3b676046eba775b5d39c4c1cd9 P cfdfd9c3b64347f997e5d181c39fddcd [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cfc2f643a0a46888b750e0ab7b7fde6 in current term 1: Already voted for candidate cfdfd9c3b64347f997e5d181c39fddcd in this term.
I20260709 13:14:33.007714  2037 ts_tablet_manager.cc:1434] T fe7a5d3b676046eba775b5d39c4c1cd9 P efd77f14978b4b49880b1a39abc66987: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:14:33.011933  1886 leader_election.cc:304] T fe7a5d3b676046eba775b5d39c4c1cd9 P cfdfd9c3b64347f997e5d181c39fddcd [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfdfd9c3b64347f997e5d181c39fddcd; no voters: 4cfc2f643a0a46888b750e0ab7b7fde6, efd77f14978b4b49880b1a39abc66987
I20260709 13:14:33.022668  2069 raft_consensus.cc:2749] T fe7a5d3b676046eba775b5d39c4c1cd9 P cfdfd9c3b64347f997e5d181c39fddcd [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:14:33.031659  2084 raft_consensus.cc:515] T 3454c9475988492d863379ed4177d7c3 P efd77f14978b4b49880b1a39abc66987 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:33.033039  2080 raft_consensus.cc:697] T 849c6495f30e45caa73c1f4be5c2d65c P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 1 LEADER]: Becoming Leader. State: Replica: 4cfc2f643a0a46888b750e0ab7b7fde6, State: Running, Role: LEADER
I20260709 13:14:33.034076  2080 consensus_queue.cc:237] T 849c6495f30e45caa73c1f4be5c2d65c P 4cfc2f643a0a46888b750e0ab7b7fde6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:33.036712  1996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3454c9475988492d863379ed4177d7c3" candidate_uuid: "efd77f14978b4b49880b1a39abc66987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6"
W20260709 13:14:33.038111  1811 leader_election.cc:343] T 3454c9475988492d863379ed4177d7c3 P efd77f14978b4b49880b1a39abc66987 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:33.038654  2084 leader_election.cc:290] T 3454c9475988492d863379ed4177d7c3 P efd77f14978b4b49880b1a39abc66987 [CANDIDATE]: Term 1 election: Requested vote from peers cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66:43351), 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67:33709)
I20260709 13:14:33.039196  1848 raft_consensus.cc:2468] T fe7a5d3b676046eba775b5d39c4c1cd9 P efd77f14978b4b49880b1a39abc66987 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cfc2f643a0a46888b750e0ab7b7fde6 in term 1.
I20260709 13:14:33.040844  1961 leader_election.cc:304] T fe7a5d3b676046eba775b5d39c4c1cd9 P 4cfc2f643a0a46888b750e0ab7b7fde6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cfc2f643a0a46888b750e0ab7b7fde6, efd77f14978b4b49880b1a39abc66987; no voters: cfdfd9c3b64347f997e5d181c39fddcd
I20260709 13:14:33.034729  1921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3454c9475988492d863379ed4177d7c3" candidate_uuid: "efd77f14978b4b49880b1a39abc66987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfdfd9c3b64347f997e5d181c39fddcd"
I20260709 13:14:33.041864  1921 raft_consensus.cc:3060] T 3454c9475988492d863379ed4177d7c3 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:33.045112  2080 raft_consensus.cc:2804] T fe7a5d3b676046eba775b5d39c4c1cd9 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:33.046065  2080 raft_consensus.cc:697] T fe7a5d3b676046eba775b5d39c4c1cd9 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 1 LEADER]: Becoming Leader. State: Replica: 4cfc2f643a0a46888b750e0ab7b7fde6, State: Running, Role: LEADER
I20260709 13:14:33.046957  2080 consensus_queue.cc:237] T fe7a5d3b676046eba775b5d39c4c1cd9 P 4cfc2f643a0a46888b750e0ab7b7fde6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:33.001009  2044 leader_election.cc:290] T fe7a5d3b676046eba775b5d39c4c1cd9 P 4cfc2f643a0a46888b750e0ab7b7fde6 [CANDIDATE]: Term 1 election: Requested vote from peers efd77f14978b4b49880b1a39abc66987 (127.23.140.65:41453), cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66:43351)
I20260709 13:14:33.035295  2088 raft_consensus.cc:493] T afd1f7dbbeee4d218895cf5a8e54efd3 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.048815  2088 raft_consensus.cc:515] T afd1f7dbbeee4d218895cf5a8e54efd3 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:33.051020  2088 leader_election.cc:290] T afd1f7dbbeee4d218895cf5a8e54efd3 P 4cfc2f643a0a46888b750e0ab7b7fde6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efd77f14978b4b49880b1a39abc66987 (127.23.140.65:41453), cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66:43351)
I20260709 13:14:33.034190  2065 raft_consensus.cc:515] T b16576d7015c475fb71585c29048e5a9 P cfdfd9c3b64347f997e5d181c39fddcd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:33.052826  1847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd1f7dbbeee4d218895cf5a8e54efd3" candidate_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efd77f14978b4b49880b1a39abc66987" is_pre_election: true
I20260709 13:14:33.053499  2065 leader_election.cc:290] T b16576d7015c475fb71585c29048e5a9 P cfdfd9c3b64347f997e5d181c39fddcd [CANDIDATE]: Term 1 election: Requested vote from peers efd77f14978b4b49880b1a39abc66987 (127.23.140.65:41453), 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67:33709)
I20260709 13:14:33.053786  1923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd1f7dbbeee4d218895cf5a8e54efd3" candidate_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" is_pre_election: true
I20260709 13:14:33.051997  1743 catalog_manager.cc:5697] T afd1f7dbbeee4d218895cf5a8e54efd3 P efd77f14978b4b49880b1a39abc66987 reported cstate change: term changed from 0 to 1, leader changed from <none> to efd77f14978b4b49880b1a39abc66987 (127.23.140.65). New cstate: current_term: 1 leader_uuid: "efd77f14978b4b49880b1a39abc66987" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:33.054600  1846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16576d7015c475fb71585c29048e5a9" candidate_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efd77f14978b4b49880b1a39abc66987"
I20260709 13:14:33.056557  1846 raft_consensus.cc:3060] T b16576d7015c475fb71585c29048e5a9 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:33.058413  2039 ts_tablet_manager.cc:1434] T 2f141c8bf4624551b8906e0469e6c4d8 P 4cfc2f643a0a46888b750e0ab7b7fde6: Time spent starting tablet: real 0.075s	user 0.040s	sys 0.030s
I20260709 13:14:33.059434  2039 tablet_bootstrap.cc:492] T 3454c9475988492d863379ed4177d7c3 P 4cfc2f643a0a46888b750e0ab7b7fde6: Bootstrap starting.
I20260709 13:14:33.061919  1996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16576d7015c475fb71585c29048e5a9" candidate_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6"
I20260709 13:14:33.062577  1996 raft_consensus.cc:3060] T b16576d7015c475fb71585c29048e5a9 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:33.065050  2039 tablet_bootstrap.cc:654] T 3454c9475988492d863379ed4177d7c3 P 4cfc2f643a0a46888b750e0ab7b7fde6: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:33.070253  1996 raft_consensus.cc:2468] T b16576d7015c475fb71585c29048e5a9 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfdfd9c3b64347f997e5d181c39fddcd in term 1.
I20260709 13:14:33.071496  1886 leader_election.cc:304] T b16576d7015c475fb71585c29048e5a9 P cfdfd9c3b64347f997e5d181c39fddcd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cfc2f643a0a46888b750e0ab7b7fde6, cfdfd9c3b64347f997e5d181c39fddcd; no voters: 
I20260709 13:14:33.072242  2039 tablet_bootstrap.cc:492] T 3454c9475988492d863379ed4177d7c3 P 4cfc2f643a0a46888b750e0ab7b7fde6: No bootstrap required, opened a new log
I20260709 13:14:33.072285  2065 raft_consensus.cc:2804] T b16576d7015c475fb71585c29048e5a9 P cfdfd9c3b64347f997e5d181c39fddcd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:33.072889  2039 ts_tablet_manager.cc:1403] T 3454c9475988492d863379ed4177d7c3 P 4cfc2f643a0a46888b750e0ab7b7fde6: Time spent bootstrapping tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:14:33.072944  2065 raft_consensus.cc:697] T b16576d7015c475fb71585c29048e5a9 P cfdfd9c3b64347f997e5d181c39fddcd [term 1 LEADER]: Becoming Leader. State: Replica: cfdfd9c3b64347f997e5d181c39fddcd, State: Running, Role: LEADER
I20260709 13:14:33.072120  1745 catalog_manager.cc:5697] T 849c6495f30e45caa73c1f4be5c2d65c P 4cfc2f643a0a46888b750e0ab7b7fde6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67). New cstate: current_term: 1 leader_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:33.073983  2065 consensus_queue.cc:237] T b16576d7015c475fb71585c29048e5a9 P cfdfd9c3b64347f997e5d181c39fddcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:33.074863  1846 raft_consensus.cc:2468] T b16576d7015c475fb71585c29048e5a9 P efd77f14978b4b49880b1a39abc66987 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfdfd9c3b64347f997e5d181c39fddcd in term 1.
I20260709 13:14:33.075820  2039 raft_consensus.cc:359] T 3454c9475988492d863379ed4177d7c3 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:33.076467  1921 raft_consensus.cc:2468] T 3454c9475988492d863379ed4177d7c3 P cfdfd9c3b64347f997e5d181c39fddcd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efd77f14978b4b49880b1a39abc66987 in term 1.
I20260709 13:14:33.055068  2045 leader_election.cc:290] T b16576d7015c475fb71585c29048e5a9 P cfdfd9c3b64347f997e5d181c39fddcd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efd77f14978b4b49880b1a39abc66987 (127.23.140.65:41453), 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67:33709)
I20260709 13:14:33.077526  1814 leader_election.cc:304] T 3454c9475988492d863379ed4177d7c3 P efd77f14978b4b49880b1a39abc66987 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cfdfd9c3b64347f997e5d181c39fddcd, efd77f14978b4b49880b1a39abc66987; no voters: 4cfc2f643a0a46888b750e0ab7b7fde6
I20260709 13:14:33.076503  2039 raft_consensus.cc:385] T 3454c9475988492d863379ed4177d7c3 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:33.078640  2039 raft_consensus.cc:740] T 3454c9475988492d863379ed4177d7c3 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cfc2f643a0a46888b750e0ab7b7fde6, State: Initialized, Role: FOLLOWER
I20260709 13:14:33.078889  2043 raft_consensus.cc:2804] T 3454c9475988492d863379ed4177d7c3 P efd77f14978b4b49880b1a39abc66987 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:33.079310  2039 consensus_queue.cc:260] T 3454c9475988492d863379ed4177d7c3 P 4cfc2f643a0a46888b750e0ab7b7fde6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:33.079596  2043 raft_consensus.cc:697] T 3454c9475988492d863379ed4177d7c3 P efd77f14978b4b49880b1a39abc66987 [term 1 LEADER]: Becoming Leader. State: Replica: efd77f14978b4b49880b1a39abc66987, State: Running, Role: LEADER
I20260709 13:14:33.081467  2039 ts_tablet_manager.cc:1434] T 3454c9475988492d863379ed4177d7c3 P 4cfc2f643a0a46888b750e0ab7b7fde6: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:14:33.080839  2043 consensus_queue.cc:237] T 3454c9475988492d863379ed4177d7c3 P efd77f14978b4b49880b1a39abc66987 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:33.054620  1923 raft_consensus.cc:2393] T afd1f7dbbeee4d218895cf5a8e54efd3 P cfdfd9c3b64347f997e5d181c39fddcd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cfc2f643a0a46888b750e0ab7b7fde6 in current term 1: Already voted for candidate efd77f14978b4b49880b1a39abc66987 in this term.
I20260709 13:14:33.084720  1963 leader_election.cc:304] T afd1f7dbbeee4d218895cf5a8e54efd3 P 4cfc2f643a0a46888b750e0ab7b7fde6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cfc2f643a0a46888b750e0ab7b7fde6; no voters: cfdfd9c3b64347f997e5d181c39fddcd, efd77f14978b4b49880b1a39abc66987
I20260709 13:14:33.086933  2080 raft_consensus.cc:3060] T afd1f7dbbeee4d218895cf5a8e54efd3 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:33.096185  1743 catalog_manager.cc:5697] T fe7a5d3b676046eba775b5d39c4c1cd9 P 4cfc2f643a0a46888b750e0ab7b7fde6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67). New cstate: current_term: 1 leader_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:33.097711  2080 raft_consensus.cc:2749] T afd1f7dbbeee4d218895cf5a8e54efd3 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:33.104597  1745 catalog_manager.cc:5697] T b16576d7015c475fb71585c29048e5a9 P cfdfd9c3b64347f997e5d181c39fddcd reported cstate change: term changed from 0 to 1, leader changed from <none> to cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66). New cstate: current_term: 1 leader_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:33.108039  1742 catalog_manager.cc:5697] T 3454c9475988492d863379ed4177d7c3 P efd77f14978b4b49880b1a39abc66987 reported cstate change: term changed from 0 to 1, leader changed from <none> to efd77f14978b4b49880b1a39abc66987 (127.23.140.65). New cstate: current_term: 1 leader_uuid: "efd77f14978b4b49880b1a39abc66987" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:33.136410  2065 consensus_queue.cc:1048] T b06ca2d520f7457692822190ac2a8f32 P cfdfd9c3b64347f997e5d181c39fddcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:33.138149  2043 raft_consensus.cc:493] T aaaceebb1e1c4a61968762f9b4b32dea P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.138659  2043 raft_consensus.cc:515] T aaaceebb1e1c4a61968762f9b4b32dea P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:33.141429  1923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaceebb1e1c4a61968762f9b4b32dea" candidate_uuid: "efd77f14978b4b49880b1a39abc66987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" is_pre_election: true
I20260709 13:14:33.142097  1923 raft_consensus.cc:2468] T aaaceebb1e1c4a61968762f9b4b32dea P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efd77f14978b4b49880b1a39abc66987 in term 0.
I20260709 13:14:33.143296  1814 leader_election.cc:304] T aaaceebb1e1c4a61968762f9b4b32dea P efd77f14978b4b49880b1a39abc66987 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cfdfd9c3b64347f997e5d181c39fddcd, efd77f14978b4b49880b1a39abc66987; no voters: 
I20260709 13:14:33.144389  2084 raft_consensus.cc:2804] T aaaceebb1e1c4a61968762f9b4b32dea P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:33.144779  2084 raft_consensus.cc:493] T aaaceebb1e1c4a61968762f9b4b32dea P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:33.145152  2084 raft_consensus.cc:3060] T aaaceebb1e1c4a61968762f9b4b32dea P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:33.146025  1997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaceebb1e1c4a61968762f9b4b32dea" candidate_uuid: "efd77f14978b4b49880b1a39abc66987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" is_pre_election: true
I20260709 13:14:33.146765  1997 raft_consensus.cc:2468] T aaaceebb1e1c4a61968762f9b4b32dea P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efd77f14978b4b49880b1a39abc66987 in term 0.
I20260709 13:14:33.148806  2043 leader_election.cc:290] T aaaceebb1e1c4a61968762f9b4b32dea P efd77f14978b4b49880b1a39abc66987 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66:43351), 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67:33709)
I20260709 13:14:33.155994  2084 raft_consensus.cc:515] T aaaceebb1e1c4a61968762f9b4b32dea P efd77f14978b4b49880b1a39abc66987 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:33.157826  2065 consensus_queue.cc:1048] T b06ca2d520f7457692822190ac2a8f32 P cfdfd9c3b64347f997e5d181c39fddcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:33.159221  1923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaceebb1e1c4a61968762f9b4b32dea" candidate_uuid: "efd77f14978b4b49880b1a39abc66987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfdfd9c3b64347f997e5d181c39fddcd"
I20260709 13:14:33.159862  1923 raft_consensus.cc:3060] T aaaceebb1e1c4a61968762f9b4b32dea P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:33.167471  2084 leader_election.cc:290] T aaaceebb1e1c4a61968762f9b4b32dea P efd77f14978b4b49880b1a39abc66987 [CANDIDATE]: Term 1 election: Requested vote from peers cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66:43351), 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67:33709)
I20260709 13:14:33.167768  1996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaceebb1e1c4a61968762f9b4b32dea" candidate_uuid: "efd77f14978b4b49880b1a39abc66987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6"
I20260709 13:14:33.168270  1923 raft_consensus.cc:2468] T aaaceebb1e1c4a61968762f9b4b32dea P cfdfd9c3b64347f997e5d181c39fddcd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efd77f14978b4b49880b1a39abc66987 in term 1.
I20260709 13:14:33.168485  1996 raft_consensus.cc:3060] T aaaceebb1e1c4a61968762f9b4b32dea P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:33.169472  1814 leader_election.cc:304] T aaaceebb1e1c4a61968762f9b4b32dea P efd77f14978b4b49880b1a39abc66987 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cfdfd9c3b64347f997e5d181c39fddcd, efd77f14978b4b49880b1a39abc66987; no voters: 
I20260709 13:14:33.170303  2084 raft_consensus.cc:2804] T aaaceebb1e1c4a61968762f9b4b32dea P efd77f14978b4b49880b1a39abc66987 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:33.170776  2084 raft_consensus.cc:697] T aaaceebb1e1c4a61968762f9b4b32dea P efd77f14978b4b49880b1a39abc66987 [term 1 LEADER]: Becoming Leader. State: Replica: efd77f14978b4b49880b1a39abc66987, State: Running, Role: LEADER
I20260709 13:14:33.171600  2084 consensus_queue.cc:237] T aaaceebb1e1c4a61968762f9b4b32dea P efd77f14978b4b49880b1a39abc66987 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:33.174340  1996 raft_consensus.cc:2468] T aaaceebb1e1c4a61968762f9b4b32dea P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efd77f14978b4b49880b1a39abc66987 in term 1.
I20260709 13:14:33.179698  1745 catalog_manager.cc:5697] T aaaceebb1e1c4a61968762f9b4b32dea P efd77f14978b4b49880b1a39abc66987 reported cstate change: term changed from 0 to 1, leader changed from <none> to efd77f14978b4b49880b1a39abc66987 (127.23.140.65). New cstate: current_term: 1 leader_uuid: "efd77f14978b4b49880b1a39abc66987" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:33.201436  2045 consensus_queue.cc:1048] T 6b8eac6adeda4c8a9e8e4142a9b86feb P cfdfd9c3b64347f997e5d181c39fddcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:33.212056  2062 consensus_queue.cc:1048] T 6b8eac6adeda4c8a9e8e4142a9b86feb P cfdfd9c3b64347f997e5d181c39fddcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:33.352252  1996 raft_consensus.cc:3060] T 2f141c8bf4624551b8906e0469e6c4d8 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:33.359055  2062 consensus_queue.cc:1048] T 2f141c8bf4624551b8906e0469e6c4d8 P cfdfd9c3b64347f997e5d181c39fddcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:33.359272  2080 raft_consensus.cc:493] T 2f141c8bf4624551b8906e0469e6c4d8 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.359884  2080 raft_consensus.cc:515] T 2f141c8bf4624551b8906e0469e6c4d8 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:33.362468  2080 leader_election.cc:290] T 2f141c8bf4624551b8906e0469e6c4d8 P 4cfc2f643a0a46888b750e0ab7b7fde6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efd77f14978b4b49880b1a39abc66987 (127.23.140.65:41453), cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66:43351)
I20260709 13:14:33.363097  1846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f141c8bf4624551b8906e0469e6c4d8" candidate_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efd77f14978b4b49880b1a39abc66987" is_pre_election: true
I20260709 13:14:33.363606  1923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f141c8bf4624551b8906e0469e6c4d8" candidate_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" is_pre_election: true
I20260709 13:14:33.364046  1846 raft_consensus.cc:2468] T 2f141c8bf4624551b8906e0469e6c4d8 P efd77f14978b4b49880b1a39abc66987 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cfc2f643a0a46888b750e0ab7b7fde6 in term 1.
I20260709 13:14:33.365465  1961 leader_election.cc:304] T 2f141c8bf4624551b8906e0469e6c4d8 P 4cfc2f643a0a46888b750e0ab7b7fde6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cfc2f643a0a46888b750e0ab7b7fde6, efd77f14978b4b49880b1a39abc66987; no voters: cfdfd9c3b64347f997e5d181c39fddcd
I20260709 13:14:33.366382  2080 raft_consensus.cc:2804] T 2f141c8bf4624551b8906e0469e6c4d8 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:33.366758  2080 raft_consensus.cc:493] T 2f141c8bf4624551b8906e0469e6c4d8 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cfdfd9c3b64347f997e5d181c39fddcd)
I20260709 13:14:33.367127  2080 raft_consensus.cc:3060] T 2f141c8bf4624551b8906e0469e6c4d8 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:33.371696  2065 consensus_queue.cc:1048] T 2f141c8bf4624551b8906e0469e6c4d8 P cfdfd9c3b64347f997e5d181c39fddcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:33.374406  2080 raft_consensus.cc:515] T 2f141c8bf4624551b8906e0469e6c4d8 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:33.376150  1996 raft_consensus.cc:1240] T 2f141c8bf4624551b8906e0469e6c4d8 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 2 FOLLOWER]: Rejecting Update request from peer cfdfd9c3b64347f997e5d181c39fddcd for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:33.379985  2065 consensus_queue.cc:1059] T 2f141c8bf4624551b8906e0469e6c4d8 P cfdfd9c3b64347f997e5d181c39fddcd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:33.380836  2069 raft_consensus.cc:3055] T 2f141c8bf4624551b8906e0469e6c4d8 P cfdfd9c3b64347f997e5d181c39fddcd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:33.381242  2069 raft_consensus.cc:740] T 2f141c8bf4624551b8906e0469e6c4d8 P cfdfd9c3b64347f997e5d181c39fddcd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cfdfd9c3b64347f997e5d181c39fddcd, State: Running, Role: LEADER
I20260709 13:14:33.382447  1846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f141c8bf4624551b8906e0469e6c4d8" candidate_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efd77f14978b4b49880b1a39abc66987"
I20260709 13:14:33.382143  2069 consensus_queue.cc:260] T 2f141c8bf4624551b8906e0469e6c4d8 P cfdfd9c3b64347f997e5d181c39fddcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:33.383474  1923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f141c8bf4624551b8906e0469e6c4d8" candidate_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cfdfd9c3b64347f997e5d181c39fddcd"
I20260709 13:14:33.383644  2069 raft_consensus.cc:3060] T 2f141c8bf4624551b8906e0469e6c4d8 P cfdfd9c3b64347f997e5d181c39fddcd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:33.384171  2080 leader_election.cc:290] T 2f141c8bf4624551b8906e0469e6c4d8 P 4cfc2f643a0a46888b750e0ab7b7fde6 [CANDIDATE]: Term 2 election: Requested vote from peers efd77f14978b4b49880b1a39abc66987 (127.23.140.65:41453), cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66:43351)
I20260709 13:14:33.399824  1921 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b8eac6adeda4c8a9e8e4142a9b86feb"
dest_uuid: "cfdfd9c3b64347f997e5d181c39fddcd"
mode: GRACEFUL
new_leader_uuid: "efd77f14978b4b49880b1a39abc66987"
 from {username='slave'} at 127.0.0.1:35672
I20260709 13:14:33.400537  1921 raft_consensus.cc:606] T 6b8eac6adeda4c8a9e8e4142a9b86feb P cfdfd9c3b64347f997e5d181c39fddcd [term 1 LEADER]: Received request to transfer leadership to TS efd77f14978b4b49880b1a39abc66987
I20260709 13:14:33.400454  1923 raft_consensus.cc:2468] T 2f141c8bf4624551b8906e0469e6c4d8 P cfdfd9c3b64347f997e5d181c39fddcd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cfc2f643a0a46888b750e0ab7b7fde6 in term 2.
I20260709 13:14:33.402607  1963 leader_election.cc:304] T 2f141c8bf4624551b8906e0469e6c4d8 P 4cfc2f643a0a46888b750e0ab7b7fde6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cfc2f643a0a46888b750e0ab7b7fde6, cfdfd9c3b64347f997e5d181c39fddcd; no voters: efd77f14978b4b49880b1a39abc66987
I20260709 13:14:33.403393  2080 raft_consensus.cc:2804] T 2f141c8bf4624551b8906e0469e6c4d8 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:33.403919  2080 raft_consensus.cc:697] T 2f141c8bf4624551b8906e0469e6c4d8 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 2 LEADER]: Becoming Leader. State: Replica: 4cfc2f643a0a46888b750e0ab7b7fde6, State: Running, Role: LEADER
I20260709 13:14:33.404821  2080 consensus_queue.cc:237] T 2f141c8bf4624551b8906e0469e6c4d8 P 4cfc2f643a0a46888b750e0ab7b7fde6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:33.406939  1923 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b06ca2d520f7457692822190ac2a8f32"
dest_uuid: "cfdfd9c3b64347f997e5d181c39fddcd"
mode: GRACEFUL
new_leader_uuid: "efd77f14978b4b49880b1a39abc66987"
 from {username='slave'} at 127.0.0.1:35672
I20260709 13:14:33.407574  1923 raft_consensus.cc:606] T b06ca2d520f7457692822190ac2a8f32 P cfdfd9c3b64347f997e5d181c39fddcd [term 1 LEADER]: Received request to transfer leadership to TS efd77f14978b4b49880b1a39abc66987
I20260709 13:14:33.412657  1742 catalog_manager.cc:5697] T 2f141c8bf4624551b8906e0469e6c4d8 P 4cfc2f643a0a46888b750e0ab7b7fde6 reported cstate change: term changed from 1 to 2, leader changed from cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66) to 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67). New cstate: current_term: 2 leader_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:33.416296  1923 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b16576d7015c475fb71585c29048e5a9"
dest_uuid: "cfdfd9c3b64347f997e5d181c39fddcd"
mode: GRACEFUL
new_leader_uuid: "efd77f14978b4b49880b1a39abc66987"
 from {username='slave'} at 127.0.0.1:35672
I20260709 13:14:33.416975  1923 raft_consensus.cc:606] T b16576d7015c475fb71585c29048e5a9 P cfdfd9c3b64347f997e5d181c39fddcd [term 1 LEADER]: Received request to transfer leadership to TS efd77f14978b4b49880b1a39abc66987
I20260709 13:14:33.430287  1996 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe7a5d3b676046eba775b5d39c4c1cd9"
dest_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6"
mode: GRACEFUL
new_leader_uuid: "cfdfd9c3b64347f997e5d181c39fddcd"
 from {username='slave'} at 127.0.0.1:33682
I20260709 13:14:33.430881  1996 raft_consensus.cc:606] T fe7a5d3b676046eba775b5d39c4c1cd9 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 1 LEADER]: Received request to transfer leadership to TS cfdfd9c3b64347f997e5d181c39fddcd
I20260709 13:14:33.436059  1996 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f141c8bf4624551b8906e0469e6c4d8"
dest_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6"
mode: GRACEFUL
new_leader_uuid: "cfdfd9c3b64347f997e5d181c39fddcd"
 from {username='slave'} at 127.0.0.1:33682
I20260709 13:14:33.436540  1996 raft_consensus.cc:606] T 2f141c8bf4624551b8906e0469e6c4d8 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 2 LEADER]: Received request to transfer leadership to TS cfdfd9c3b64347f997e5d181c39fddcd
I20260709 13:14:33.449095  1846 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aaaceebb1e1c4a61968762f9b4b32dea"
dest_uuid: "efd77f14978b4b49880b1a39abc66987"
mode: GRACEFUL
new_leader_uuid: "cfdfd9c3b64347f997e5d181c39fddcd"
 from {username='slave'} at 127.0.0.1:34260
I20260709 13:14:33.449615  1846 raft_consensus.cc:606] T aaaceebb1e1c4a61968762f9b4b32dea P efd77f14978b4b49880b1a39abc66987 [term 1 LEADER]: Received request to transfer leadership to TS cfdfd9c3b64347f997e5d181c39fddcd
I20260709 13:14:33.454881  1846 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "afd1f7dbbeee4d218895cf5a8e54efd3"
dest_uuid: "efd77f14978b4b49880b1a39abc66987"
mode: GRACEFUL
new_leader_uuid: "cfdfd9c3b64347f997e5d181c39fddcd"
 from {username='slave'} at 127.0.0.1:34260
I20260709 13:14:33.455376  1846 raft_consensus.cc:606] T afd1f7dbbeee4d218895cf5a8e54efd3 P efd77f14978b4b49880b1a39abc66987 [term 1 LEADER]: Received request to transfer leadership to TS cfdfd9c3b64347f997e5d181c39fddcd
I20260709 13:14:33.458516  2080 consensus_queue.cc:1048] T fe7a5d3b676046eba775b5d39c4c1cd9 P 4cfc2f643a0a46888b750e0ab7b7fde6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:33.469930  2044 consensus_queue.cc:1048] T fe7a5d3b676046eba775b5d39c4c1cd9 P 4cfc2f643a0a46888b750e0ab7b7fde6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:33.477245  2087 raft_consensus.cc:993] T fe7a5d3b676046eba775b5d39c4c1cd9 P 4cfc2f643a0a46888b750e0ab7b7fde6: : Instructing follower cfdfd9c3b64347f997e5d181c39fddcd to start an election
I20260709 13:14:33.477684  2044 raft_consensus.cc:1081] T fe7a5d3b676046eba775b5d39c4c1cd9 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 1 LEADER]: Signalling peer cfdfd9c3b64347f997e5d181c39fddcd to start an election
I20260709 13:14:33.479290  1923 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fe7a5d3b676046eba775b5d39c4c1cd9"
dest_uuid: "cfdfd9c3b64347f997e5d181c39fddcd"
 from {username='slave'} at 127.0.0.1:35664
I20260709 13:14:33.479785  1923 raft_consensus.cc:493] T fe7a5d3b676046eba775b5d39c4c1cd9 P cfdfd9c3b64347f997e5d181c39fddcd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:33.480103  1923 raft_consensus.cc:3060] T fe7a5d3b676046eba775b5d39c4c1cd9 P cfdfd9c3b64347f997e5d181c39fddcd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:33.482296  2084 consensus_queue.cc:1048] T afd1f7dbbeee4d218895cf5a8e54efd3 P efd77f14978b4b49880b1a39abc66987 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:33.486163  1923 raft_consensus.cc:515] T fe7a5d3b676046eba775b5d39c4c1cd9 P cfdfd9c3b64347f997e5d181c39fddcd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:33.488476  1923 leader_election.cc:290] T fe7a5d3b676046eba775b5d39c4c1cd9 P cfdfd9c3b64347f997e5d181c39fddcd [CANDIDATE]: Term 2 election: Requested vote from peers efd77f14978b4b49880b1a39abc66987 (127.23.140.65:41453), 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67:33709)
I20260709 13:14:33.489254  2043 raft_consensus.cc:993] T afd1f7dbbeee4d218895cf5a8e54efd3 P efd77f14978b4b49880b1a39abc66987: : Instructing follower cfdfd9c3b64347f997e5d181c39fddcd to start an election
I20260709 13:14:33.489148  1846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7a5d3b676046eba775b5d39c4c1cd9" candidate_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "efd77f14978b4b49880b1a39abc66987"
I20260709 13:14:33.489956  1846 raft_consensus.cc:3060] T fe7a5d3b676046eba775b5d39c4c1cd9 P efd77f14978b4b49880b1a39abc66987 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:33.490783  1996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7a5d3b676046eba775b5d39c4c1cd9" candidate_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6"
I20260709 13:14:33.491400  1996 raft_consensus.cc:3055] T fe7a5d3b676046eba775b5d39c4c1cd9 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:33.491708  1996 raft_consensus.cc:740] T fe7a5d3b676046eba775b5d39c4c1cd9 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4cfc2f643a0a46888b750e0ab7b7fde6, State: Running, Role: LEADER
I20260709 13:14:33.492518  1996 consensus_queue.cc:260] T fe7a5d3b676046eba775b5d39c4c1cd9 P 4cfc2f643a0a46888b750e0ab7b7fde6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:33.490043  2084 raft_consensus.cc:1081] T afd1f7dbbeee4d218895cf5a8e54efd3 P efd77f14978b4b49880b1a39abc66987 [term 1 LEADER]: Signalling peer cfdfd9c3b64347f997e5d181c39fddcd to start an election
I20260709 13:14:33.493661  1996 raft_consensus.cc:3060] T fe7a5d3b676046eba775b5d39c4c1cd9 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:33.495635  1921 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "afd1f7dbbeee4d218895cf5a8e54efd3"
dest_uuid: "cfdfd9c3b64347f997e5d181c39fddcd"
 from {username='slave'} at 127.0.0.1:35666
I20260709 13:14:33.496188  1921 raft_consensus.cc:493] T afd1f7dbbeee4d218895cf5a8e54efd3 P cfdfd9c3b64347f997e5d181c39fddcd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:33.496521  1921 raft_consensus.cc:3060] T afd1f7dbbeee4d218895cf5a8e54efd3 P cfdfd9c3b64347f997e5d181c39fddcd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:33.500422  1846 raft_consensus.cc:2468] T fe7a5d3b676046eba775b5d39c4c1cd9 P efd77f14978b4b49880b1a39abc66987 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfdfd9c3b64347f997e5d181c39fddcd in term 2.
I20260709 13:14:33.501835  1887 leader_election.cc:304] T fe7a5d3b676046eba775b5d39c4c1cd9 P cfdfd9c3b64347f997e5d181c39fddcd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cfdfd9c3b64347f997e5d181c39fddcd, efd77f14978b4b49880b1a39abc66987; no voters: 
I20260709 13:14:33.502779  2069 raft_consensus.cc:2804] T fe7a5d3b676046eba775b5d39c4c1cd9 P cfdfd9c3b64347f997e5d181c39fddcd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:33.503386  2069 raft_consensus.cc:697] T fe7a5d3b676046eba775b5d39c4c1cd9 P cfdfd9c3b64347f997e5d181c39fddcd [term 2 LEADER]: Becoming Leader. State: Replica: cfdfd9c3b64347f997e5d181c39fddcd, State: Running, Role: LEADER
I20260709 13:14:33.503639  1921 raft_consensus.cc:515] T afd1f7dbbeee4d218895cf5a8e54efd3 P cfdfd9c3b64347f997e5d181c39fddcd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:33.504813  2084 consensus_queue.cc:1048] T afd1f7dbbeee4d218895cf5a8e54efd3 P efd77f14978b4b49880b1a39abc66987 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:33.504519  2069 consensus_queue.cc:237] T fe7a5d3b676046eba775b5d39c4c1cd9 P cfdfd9c3b64347f997e5d181c39fddcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:33.506336  1921 leader_election.cc:290] T afd1f7dbbeee4d218895cf5a8e54efd3 P cfdfd9c3b64347f997e5d181c39fddcd [CANDIDATE]: Term 2 election: Requested vote from peers efd77f14978b4b49880b1a39abc66987 (127.23.140.65:41453), 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67:33709)
I20260709 13:14:33.507618  1995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd1f7dbbeee4d218895cf5a8e54efd3" candidate_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6"
I20260709 13:14:33.508219  1995 raft_consensus.cc:3060] T afd1f7dbbeee4d218895cf5a8e54efd3 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:33.510073  1848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd1f7dbbeee4d218895cf5a8e54efd3" candidate_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "efd77f14978b4b49880b1a39abc66987"
I20260709 13:14:33.510576  1848 raft_consensus.cc:3055] T afd1f7dbbeee4d218895cf5a8e54efd3 P efd77f14978b4b49880b1a39abc66987 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:33.510861  1848 raft_consensus.cc:740] T afd1f7dbbeee4d218895cf5a8e54efd3 P efd77f14978b4b49880b1a39abc66987 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: efd77f14978b4b49880b1a39abc66987, State: Running, Role: LEADER
I20260709 13:14:33.511520  1848 consensus_queue.cc:260] T afd1f7dbbeee4d218895cf5a8e54efd3 P efd77f14978b4b49880b1a39abc66987 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:33.512519  1848 raft_consensus.cc:3060] T afd1f7dbbeee4d218895cf5a8e54efd3 P efd77f14978b4b49880b1a39abc66987 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:33.513088  1996 raft_consensus.cc:2468] T fe7a5d3b676046eba775b5d39c4c1cd9 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfdfd9c3b64347f997e5d181c39fddcd in term 2.
I20260709 13:14:33.518558  1848 raft_consensus.cc:2468] T afd1f7dbbeee4d218895cf5a8e54efd3 P efd77f14978b4b49880b1a39abc66987 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfdfd9c3b64347f997e5d181c39fddcd in term 2.
I20260709 13:14:33.519593  1887 leader_election.cc:304] T afd1f7dbbeee4d218895cf5a8e54efd3 P cfdfd9c3b64347f997e5d181c39fddcd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cfdfd9c3b64347f997e5d181c39fddcd, efd77f14978b4b49880b1a39abc66987; no voters: 
I20260709 13:14:33.520293  2069 raft_consensus.cc:2804] T afd1f7dbbeee4d218895cf5a8e54efd3 P cfdfd9c3b64347f997e5d181c39fddcd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:33.520720  2069 raft_consensus.cc:697] T afd1f7dbbeee4d218895cf5a8e54efd3 P cfdfd9c3b64347f997e5d181c39fddcd [term 2 LEADER]: Becoming Leader. State: Replica: cfdfd9c3b64347f997e5d181c39fddcd, State: Running, Role: LEADER
I20260709 13:14:33.521879  1995 raft_consensus.cc:2468] T afd1f7dbbeee4d218895cf5a8e54efd3 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfdfd9c3b64347f997e5d181c39fddcd in term 2.
I20260709 13:14:33.521631  2069 consensus_queue.cc:237] T afd1f7dbbeee4d218895cf5a8e54efd3 P cfdfd9c3b64347f997e5d181c39fddcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:33.522593  1997 raft_consensus.cc:1240] T afd1f7dbbeee4d218895cf5a8e54efd3 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 2 FOLLOWER]: Rejecting Update request from peer efd77f14978b4b49880b1a39abc66987 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:14:33.525296  1742 catalog_manager.cc:5697] T fe7a5d3b676046eba775b5d39c4c1cd9 P cfdfd9c3b64347f997e5d181c39fddcd reported cstate change: term changed from 1 to 2, leader changed from 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67) to cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66). New cstate: current_term: 2 leader_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:33.534334  1997 raft_consensus.cc:3060] T 3454c9475988492d863379ed4177d7c3 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:33.538062  1742 catalog_manager.cc:5697] T afd1f7dbbeee4d218895cf5a8e54efd3 P cfdfd9c3b64347f997e5d181c39fddcd reported cstate change: term changed from 1 to 2, leader changed from efd77f14978b4b49880b1a39abc66987 (127.23.140.65) to cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66). New cstate: current_term: 2 leader_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:33.542380  2043 consensus_queue.cc:1048] T 3454c9475988492d863379ed4177d7c3 P efd77f14978b4b49880b1a39abc66987 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:33.553937  2111 consensus_queue.cc:1048] T 3454c9475988492d863379ed4177d7c3 P efd77f14978b4b49880b1a39abc66987 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:33.572702  2069 consensus_queue.cc:1048] T b16576d7015c475fb71585c29048e5a9 P cfdfd9c3b64347f997e5d181c39fddcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:33.582242  2062 consensus_queue.cc:1048] T b16576d7015c475fb71585c29048e5a9 P cfdfd9c3b64347f997e5d181c39fddcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:33.586921  2111 consensus_queue.cc:1048] T aaaceebb1e1c4a61968762f9b4b32dea P efd77f14978b4b49880b1a39abc66987 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:33.593822  2069 raft_consensus.cc:993] T b16576d7015c475fb71585c29048e5a9 P cfdfd9c3b64347f997e5d181c39fddcd: : Instructing follower efd77f14978b4b49880b1a39abc66987 to start an election
I20260709 13:14:33.594247  2069 raft_consensus.cc:1081] T b16576d7015c475fb71585c29048e5a9 P cfdfd9c3b64347f997e5d181c39fddcd [term 1 LEADER]: Signalling peer efd77f14978b4b49880b1a39abc66987 to start an election
I20260709 13:14:33.596045  1848 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b16576d7015c475fb71585c29048e5a9"
dest_uuid: "efd77f14978b4b49880b1a39abc66987"
 from {username='slave'} at 127.0.0.1:34254
I20260709 13:14:33.596606  1848 raft_consensus.cc:493] T b16576d7015c475fb71585c29048e5a9 P efd77f14978b4b49880b1a39abc66987 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:33.596930  1848 raft_consensus.cc:3060] T b16576d7015c475fb71585c29048e5a9 P efd77f14978b4b49880b1a39abc66987 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:33.603608  2111 consensus_queue.cc:1048] T aaaceebb1e1c4a61968762f9b4b32dea P efd77f14978b4b49880b1a39abc66987 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:33.605865  1848 raft_consensus.cc:515] T b16576d7015c475fb71585c29048e5a9 P efd77f14978b4b49880b1a39abc66987 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:33.608377  1848 leader_election.cc:290] T b16576d7015c475fb71585c29048e5a9 P efd77f14978b4b49880b1a39abc66987 [CANDIDATE]: Term 2 election: Requested vote from peers cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66:43351), 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67:33709)
I20260709 13:14:33.608639  1923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16576d7015c475fb71585c29048e5a9" candidate_uuid: "efd77f14978b4b49880b1a39abc66987" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cfdfd9c3b64347f997e5d181c39fddcd"
I20260709 13:14:33.609234  1923 raft_consensus.cc:3055] T b16576d7015c475fb71585c29048e5a9 P cfdfd9c3b64347f997e5d181c39fddcd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:33.609371  1995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16576d7015c475fb71585c29048e5a9" candidate_uuid: "efd77f14978b4b49880b1a39abc66987" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6"
I20260709 13:14:33.609555  1923 raft_consensus.cc:740] T b16576d7015c475fb71585c29048e5a9 P cfdfd9c3b64347f997e5d181c39fddcd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cfdfd9c3b64347f997e5d181c39fddcd, State: Running, Role: LEADER
I20260709 13:14:33.610113  1995 raft_consensus.cc:3060] T b16576d7015c475fb71585c29048e5a9 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:33.610857  1923 consensus_queue.cc:260] T b16576d7015c475fb71585c29048e5a9 P cfdfd9c3b64347f997e5d181c39fddcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:33.612206  1923 raft_consensus.cc:3060] T b16576d7015c475fb71585c29048e5a9 P cfdfd9c3b64347f997e5d181c39fddcd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:33.618249  1995 raft_consensus.cc:2468] T b16576d7015c475fb71585c29048e5a9 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efd77f14978b4b49880b1a39abc66987 in term 2.
I20260709 13:14:33.618243  1923 raft_consensus.cc:2468] T b16576d7015c475fb71585c29048e5a9 P cfdfd9c3b64347f997e5d181c39fddcd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efd77f14978b4b49880b1a39abc66987 in term 2.
I20260709 13:14:33.619660  1811 leader_election.cc:304] T b16576d7015c475fb71585c29048e5a9 P efd77f14978b4b49880b1a39abc66987 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cfc2f643a0a46888b750e0ab7b7fde6, efd77f14978b4b49880b1a39abc66987; no voters: 
I20260709 13:14:33.620819  2111 raft_consensus.cc:2804] T b16576d7015c475fb71585c29048e5a9 P efd77f14978b4b49880b1a39abc66987 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:33.621291  2111 raft_consensus.cc:697] T b16576d7015c475fb71585c29048e5a9 P efd77f14978b4b49880b1a39abc66987 [term 2 LEADER]: Becoming Leader. State: Replica: efd77f14978b4b49880b1a39abc66987, State: Running, Role: LEADER
I20260709 13:14:33.622239  2111 consensus_queue.cc:237] T b16576d7015c475fb71585c29048e5a9 P efd77f14978b4b49880b1a39abc66987 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:33.623282  2084 raft_consensus.cc:993] T aaaceebb1e1c4a61968762f9b4b32dea P efd77f14978b4b49880b1a39abc66987: : Instructing follower cfdfd9c3b64347f997e5d181c39fddcd to start an election
I20260709 13:14:33.623777  2084 raft_consensus.cc:1081] T aaaceebb1e1c4a61968762f9b4b32dea P efd77f14978b4b49880b1a39abc66987 [term 1 LEADER]: Signalling peer cfdfd9c3b64347f997e5d181c39fddcd to start an election
I20260709 13:14:33.625487  1921 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aaaceebb1e1c4a61968762f9b4b32dea"
dest_uuid: "cfdfd9c3b64347f997e5d181c39fddcd"
 from {username='slave'} at 127.0.0.1:35666
I20260709 13:14:33.626133  1921 raft_consensus.cc:493] T aaaceebb1e1c4a61968762f9b4b32dea P cfdfd9c3b64347f997e5d181c39fddcd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:33.626539  1921 raft_consensus.cc:3060] T aaaceebb1e1c4a61968762f9b4b32dea P cfdfd9c3b64347f997e5d181c39fddcd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:33.629653  1742 catalog_manager.cc:5697] T b16576d7015c475fb71585c29048e5a9 P efd77f14978b4b49880b1a39abc66987 reported cstate change: term changed from 1 to 2, leader changed from cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66) to efd77f14978b4b49880b1a39abc66987 (127.23.140.65). New cstate: current_term: 2 leader_uuid: "efd77f14978b4b49880b1a39abc66987" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:33.631804  1921 raft_consensus.cc:515] T aaaceebb1e1c4a61968762f9b4b32dea P cfdfd9c3b64347f997e5d181c39fddcd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:33.634558  1921 leader_election.cc:290] T aaaceebb1e1c4a61968762f9b4b32dea P cfdfd9c3b64347f997e5d181c39fddcd [CANDIDATE]: Term 2 election: Requested vote from peers efd77f14978b4b49880b1a39abc66987 (127.23.140.65:41453), 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67:33709)
I20260709 13:14:33.634964  1848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaceebb1e1c4a61968762f9b4b32dea" candidate_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "efd77f14978b4b49880b1a39abc66987"
I20260709 13:14:33.635752  1848 raft_consensus.cc:3055] T aaaceebb1e1c4a61968762f9b4b32dea P efd77f14978b4b49880b1a39abc66987 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:33.636068  1848 raft_consensus.cc:740] T aaaceebb1e1c4a61968762f9b4b32dea P efd77f14978b4b49880b1a39abc66987 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: efd77f14978b4b49880b1a39abc66987, State: Running, Role: LEADER
I20260709 13:14:33.636673  1995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaceebb1e1c4a61968762f9b4b32dea" candidate_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6"
I20260709 13:14:33.637280  1995 raft_consensus.cc:3060] T aaaceebb1e1c4a61968762f9b4b32dea P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:33.636848  1848 consensus_queue.cc:260] T aaaceebb1e1c4a61968762f9b4b32dea P efd77f14978b4b49880b1a39abc66987 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:33.638128  1848 raft_consensus.cc:3060] T aaaceebb1e1c4a61968762f9b4b32dea P efd77f14978b4b49880b1a39abc66987 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:33.643551  1995 raft_consensus.cc:2468] T aaaceebb1e1c4a61968762f9b4b32dea P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfdfd9c3b64347f997e5d181c39fddcd in term 2.
I20260709 13:14:33.643867  1848 raft_consensus.cc:2468] T aaaceebb1e1c4a61968762f9b4b32dea P efd77f14978b4b49880b1a39abc66987 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfdfd9c3b64347f997e5d181c39fddcd in term 2.
I20260709 13:14:33.644693  1886 leader_election.cc:304] T aaaceebb1e1c4a61968762f9b4b32dea P cfdfd9c3b64347f997e5d181c39fddcd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cfc2f643a0a46888b750e0ab7b7fde6, cfdfd9c3b64347f997e5d181c39fddcd; no voters: 
I20260709 13:14:33.645720  2065 raft_consensus.cc:2804] T aaaceebb1e1c4a61968762f9b4b32dea P cfdfd9c3b64347f997e5d181c39fddcd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:33.646283  2065 raft_consensus.cc:697] T aaaceebb1e1c4a61968762f9b4b32dea P cfdfd9c3b64347f997e5d181c39fddcd [term 2 LEADER]: Becoming Leader. State: Replica: cfdfd9c3b64347f997e5d181c39fddcd, State: Running, Role: LEADER
I20260709 13:14:33.647267  2065 consensus_queue.cc:237] T aaaceebb1e1c4a61968762f9b4b32dea P cfdfd9c3b64347f997e5d181c39fddcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:33.649829  2118 raft_consensus.cc:993] T 6b8eac6adeda4c8a9e8e4142a9b86feb P cfdfd9c3b64347f997e5d181c39fddcd: : Instructing follower efd77f14978b4b49880b1a39abc66987 to start an election
I20260709 13:14:33.650226  2062 raft_consensus.cc:1081] T 6b8eac6adeda4c8a9e8e4142a9b86feb P cfdfd9c3b64347f997e5d181c39fddcd [term 1 LEADER]: Signalling peer efd77f14978b4b49880b1a39abc66987 to start an election
I20260709 13:14:33.650311  2044 consensus_queue.cc:1048] T 849c6495f30e45caa73c1f4be5c2d65c P 4cfc2f643a0a46888b750e0ab7b7fde6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:33.653249  1848 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6b8eac6adeda4c8a9e8e4142a9b86feb"
dest_uuid: "efd77f14978b4b49880b1a39abc66987"
 from {username='slave'} at 127.0.0.1:34254
I20260709 13:14:33.654438  1848 raft_consensus.cc:493] T 6b8eac6adeda4c8a9e8e4142a9b86feb P efd77f14978b4b49880b1a39abc66987 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:33.655879  1848 raft_consensus.cc:3060] T 6b8eac6adeda4c8a9e8e4142a9b86feb P efd77f14978b4b49880b1a39abc66987 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:33.657490  2044 consensus_queue.cc:1048] T 849c6495f30e45caa73c1f4be5c2d65c P 4cfc2f643a0a46888b750e0ab7b7fde6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:33.657210  1742 catalog_manager.cc:5697] T aaaceebb1e1c4a61968762f9b4b32dea P cfdfd9c3b64347f997e5d181c39fddcd reported cstate change: term changed from 1 to 2, leader changed from efd77f14978b4b49880b1a39abc66987 (127.23.140.65) to cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66). New cstate: current_term: 2 leader_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:33.671105  1848 raft_consensus.cc:515] T 6b8eac6adeda4c8a9e8e4142a9b86feb P efd77f14978b4b49880b1a39abc66987 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } }
I20260709 13:14:33.674235  1848 leader_election.cc:290] T 6b8eac6adeda4c8a9e8e4142a9b86feb P efd77f14978b4b49880b1a39abc66987 [CANDIDATE]: Term 2 election: Requested vote from peers 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67:33709), cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66:43351)
I20260709 13:14:33.674291  1995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8eac6adeda4c8a9e8e4142a9b86feb" candidate_uuid: "efd77f14978b4b49880b1a39abc66987" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6"
I20260709 13:14:33.674625  1921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8eac6adeda4c8a9e8e4142a9b86feb" candidate_uuid: "efd77f14978b4b49880b1a39abc66987" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cfdfd9c3b64347f997e5d181c39fddcd"
I20260709 13:14:33.675201  1995 raft_consensus.cc:3060] T 6b8eac6adeda4c8a9e8e4142a9b86feb P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:33.675205  1921 raft_consensus.cc:3055] T 6b8eac6adeda4c8a9e8e4142a9b86feb P cfdfd9c3b64347f997e5d181c39fddcd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:33.676015  1921 raft_consensus.cc:740] T 6b8eac6adeda4c8a9e8e4142a9b86feb P cfdfd9c3b64347f997e5d181c39fddcd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cfdfd9c3b64347f997e5d181c39fddcd, State: Running, Role: LEADER
I20260709 13:14:33.677444  1921 consensus_queue.cc:260] T 6b8eac6adeda4c8a9e8e4142a9b86feb P cfdfd9c3b64347f997e5d181c39fddcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } }
I20260709 13:14:33.678704  1921 raft_consensus.cc:3060] T 6b8eac6adeda4c8a9e8e4142a9b86feb P cfdfd9c3b64347f997e5d181c39fddcd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:33.683259  1995 raft_consensus.cc:2468] T 6b8eac6adeda4c8a9e8e4142a9b86feb P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efd77f14978b4b49880b1a39abc66987 in term 2.
I20260709 13:14:33.684377  1811 leader_election.cc:304] T 6b8eac6adeda4c8a9e8e4142a9b86feb P efd77f14978b4b49880b1a39abc66987 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cfc2f643a0a46888b750e0ab7b7fde6, efd77f14978b4b49880b1a39abc66987; no voters: 
I20260709 13:14:33.685094  2111 raft_consensus.cc:2804] T 6b8eac6adeda4c8a9e8e4142a9b86feb P efd77f14978b4b49880b1a39abc66987 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:33.685673  2111 raft_consensus.cc:697] T 6b8eac6adeda4c8a9e8e4142a9b86feb P efd77f14978b4b49880b1a39abc66987 [term 2 LEADER]: Becoming Leader. State: Replica: efd77f14978b4b49880b1a39abc66987, State: Running, Role: LEADER
I20260709 13:14:33.685917  1921 raft_consensus.cc:2468] T 6b8eac6adeda4c8a9e8e4142a9b86feb P cfdfd9c3b64347f997e5d181c39fddcd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efd77f14978b4b49880b1a39abc66987 in term 2.
I20260709 13:14:33.686528  2111 consensus_queue.cc:237] T 6b8eac6adeda4c8a9e8e4142a9b86feb P efd77f14978b4b49880b1a39abc66987 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } }
I20260709 13:14:33.692925  1742 catalog_manager.cc:5697] T 6b8eac6adeda4c8a9e8e4142a9b86feb P efd77f14978b4b49880b1a39abc66987 reported cstate change: term changed from 1 to 2, leader changed from cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66) to efd77f14978b4b49880b1a39abc66987 (127.23.140.65). New cstate: current_term: 2 leader_uuid: "efd77f14978b4b49880b1a39abc66987" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:33.765362  2062 raft_consensus.cc:993] T b06ca2d520f7457692822190ac2a8f32 P cfdfd9c3b64347f997e5d181c39fddcd: : Instructing follower efd77f14978b4b49880b1a39abc66987 to start an election
I20260709 13:14:33.765861  2118 raft_consensus.cc:1081] T b06ca2d520f7457692822190ac2a8f32 P cfdfd9c3b64347f997e5d181c39fddcd [term 1 LEADER]: Signalling peer efd77f14978b4b49880b1a39abc66987 to start an election
I20260709 13:14:33.767490  1848 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b06ca2d520f7457692822190ac2a8f32"
dest_uuid: "efd77f14978b4b49880b1a39abc66987"
 from {username='slave'} at 127.0.0.1:34254
I20260709 13:14:33.768056  1848 raft_consensus.cc:493] T b06ca2d520f7457692822190ac2a8f32 P efd77f14978b4b49880b1a39abc66987 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:33.768426  1848 raft_consensus.cc:3060] T b06ca2d520f7457692822190ac2a8f32 P efd77f14978b4b49880b1a39abc66987 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:33.776018  1848 raft_consensus.cc:515] T b06ca2d520f7457692822190ac2a8f32 P efd77f14978b4b49880b1a39abc66987 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:33.778637  1848 leader_election.cc:290] T b06ca2d520f7457692822190ac2a8f32 P efd77f14978b4b49880b1a39abc66987 [CANDIDATE]: Term 2 election: Requested vote from peers cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66:43351), 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67:33709)
I20260709 13:14:33.779246  1995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b06ca2d520f7457692822190ac2a8f32" candidate_uuid: "efd77f14978b4b49880b1a39abc66987" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6"
I20260709 13:14:33.779239  1921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b06ca2d520f7457692822190ac2a8f32" candidate_uuid: "efd77f14978b4b49880b1a39abc66987" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cfdfd9c3b64347f997e5d181c39fddcd"
I20260709 13:14:33.780193  1995 raft_consensus.cc:3060] T b06ca2d520f7457692822190ac2a8f32 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:33.780265  1921 raft_consensus.cc:3055] T b06ca2d520f7457692822190ac2a8f32 P cfdfd9c3b64347f997e5d181c39fddcd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:33.780717  1921 raft_consensus.cc:740] T b06ca2d520f7457692822190ac2a8f32 P cfdfd9c3b64347f997e5d181c39fddcd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cfdfd9c3b64347f997e5d181c39fddcd, State: Running, Role: LEADER
I20260709 13:14:33.781332  1921 consensus_queue.cc:260] T b06ca2d520f7457692822190ac2a8f32 P cfdfd9c3b64347f997e5d181c39fddcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:33.782317  1921 raft_consensus.cc:3060] T b06ca2d520f7457692822190ac2a8f32 P cfdfd9c3b64347f997e5d181c39fddcd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:33.785290  1995 raft_consensus.cc:2468] T b06ca2d520f7457692822190ac2a8f32 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efd77f14978b4b49880b1a39abc66987 in term 2.
I20260709 13:14:33.786563  1811 leader_election.cc:304] T b06ca2d520f7457692822190ac2a8f32 P efd77f14978b4b49880b1a39abc66987 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cfc2f643a0a46888b750e0ab7b7fde6, efd77f14978b4b49880b1a39abc66987; no voters: 
I20260709 13:14:33.787412  2111 raft_consensus.cc:2804] T b06ca2d520f7457692822190ac2a8f32 P efd77f14978b4b49880b1a39abc66987 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:33.787863  1921 raft_consensus.cc:2468] T b06ca2d520f7457692822190ac2a8f32 P cfdfd9c3b64347f997e5d181c39fddcd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efd77f14978b4b49880b1a39abc66987 in term 2.
I20260709 13:14:33.787887  2111 raft_consensus.cc:697] T b06ca2d520f7457692822190ac2a8f32 P efd77f14978b4b49880b1a39abc66987 [term 2 LEADER]: Becoming Leader. State: Replica: efd77f14978b4b49880b1a39abc66987, State: Running, Role: LEADER
I20260709 13:14:33.788882  2111 consensus_queue.cc:237] T b06ca2d520f7457692822190ac2a8f32 P efd77f14978b4b49880b1a39abc66987 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:33.795053  1742 catalog_manager.cc:5697] T b06ca2d520f7457692822190ac2a8f32 P efd77f14978b4b49880b1a39abc66987 reported cstate change: term changed from 1 to 2, leader changed from cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66) to efd77f14978b4b49880b1a39abc66987 (127.23.140.65). New cstate: current_term: 2 leader_uuid: "efd77f14978b4b49880b1a39abc66987" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:33.812368  1921 raft_consensus.cc:1275] T 2f141c8bf4624551b8906e0469e6c4d8 P cfdfd9c3b64347f997e5d181c39fddcd [term 2 FOLLOWER]: Refusing update from remote peer 4cfc2f643a0a46888b750e0ab7b7fde6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:33.813573  2044 consensus_queue.cc:1048] T 2f141c8bf4624551b8906e0469e6c4d8 P 4cfc2f643a0a46888b750e0ab7b7fde6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:33.818365  2080 raft_consensus.cc:993] T 2f141c8bf4624551b8906e0469e6c4d8 P 4cfc2f643a0a46888b750e0ab7b7fde6: : Instructing follower cfdfd9c3b64347f997e5d181c39fddcd to start an election
I20260709 13:14:33.818960  2087 raft_consensus.cc:1081] T 2f141c8bf4624551b8906e0469e6c4d8 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 2 LEADER]: Signalling peer cfdfd9c3b64347f997e5d181c39fddcd to start an election
I20260709 13:14:33.821867  1923 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f141c8bf4624551b8906e0469e6c4d8"
dest_uuid: "cfdfd9c3b64347f997e5d181c39fddcd"
 from {username='slave'} at 127.0.0.1:35664
I20260709 13:14:33.822402  1923 raft_consensus.cc:493] T 2f141c8bf4624551b8906e0469e6c4d8 P cfdfd9c3b64347f997e5d181c39fddcd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:33.822547  1848 raft_consensus.cc:3060] T 2f141c8bf4624551b8906e0469e6c4d8 P efd77f14978b4b49880b1a39abc66987 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:33.822808  1923 raft_consensus.cc:3060] T 2f141c8bf4624551b8906e0469e6c4d8 P cfdfd9c3b64347f997e5d181c39fddcd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:33.829789  1848 raft_consensus.cc:1275] T 2f141c8bf4624551b8906e0469e6c4d8 P efd77f14978b4b49880b1a39abc66987 [term 2 FOLLOWER]: Refusing update from remote peer 4cfc2f643a0a46888b750e0ab7b7fde6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:33.829541  1923 raft_consensus.cc:515] T 2f141c8bf4624551b8906e0469e6c4d8 P cfdfd9c3b64347f997e5d181c39fddcd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:33.831251  2044 consensus_queue.cc:1048] T 2f141c8bf4624551b8906e0469e6c4d8 P 4cfc2f643a0a46888b750e0ab7b7fde6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:33.832417  1848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f141c8bf4624551b8906e0469e6c4d8" candidate_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "efd77f14978b4b49880b1a39abc66987"
I20260709 13:14:33.833099  1848 raft_consensus.cc:3060] T 2f141c8bf4624551b8906e0469e6c4d8 P efd77f14978b4b49880b1a39abc66987 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:33.832939  1995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f141c8bf4624551b8906e0469e6c4d8" candidate_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6"
I20260709 13:14:33.833698  1995 raft_consensus.cc:3055] T 2f141c8bf4624551b8906e0469e6c4d8 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:33.834057  1995 raft_consensus.cc:740] T 2f141c8bf4624551b8906e0469e6c4d8 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4cfc2f643a0a46888b750e0ab7b7fde6, State: Running, Role: LEADER
I20260709 13:14:33.834197  1923 leader_election.cc:290] T 2f141c8bf4624551b8906e0469e6c4d8 P cfdfd9c3b64347f997e5d181c39fddcd [CANDIDATE]: Term 3 election: Requested vote from peers efd77f14978b4b49880b1a39abc66987 (127.23.140.65:41453), 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67:33709)
I20260709 13:14:33.834873  1995 consensus_queue.cc:260] T 2f141c8bf4624551b8906e0469e6c4d8 P 4cfc2f643a0a46888b750e0ab7b7fde6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:33.835813  1995 raft_consensus.cc:3060] T 2f141c8bf4624551b8906e0469e6c4d8 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:33.840243  1848 raft_consensus.cc:2468] T 2f141c8bf4624551b8906e0469e6c4d8 P efd77f14978b4b49880b1a39abc66987 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfdfd9c3b64347f997e5d181c39fddcd in term 3.
I20260709 13:14:33.841039  1846 raft_consensus.cc:1240] T 2f141c8bf4624551b8906e0469e6c4d8 P efd77f14978b4b49880b1a39abc66987 [term 3 FOLLOWER]: Rejecting Update request from peer 4cfc2f643a0a46888b750e0ab7b7fde6 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:14:33.841516  1887 leader_election.cc:304] T 2f141c8bf4624551b8906e0469e6c4d8 P cfdfd9c3b64347f997e5d181c39fddcd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cfdfd9c3b64347f997e5d181c39fddcd, efd77f14978b4b49880b1a39abc66987; no voters: 
I20260709 13:14:33.842375  2118 raft_consensus.cc:2804] T 2f141c8bf4624551b8906e0469e6c4d8 P cfdfd9c3b64347f997e5d181c39fddcd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:33.842779  1995 raft_consensus.cc:2468] T 2f141c8bf4624551b8906e0469e6c4d8 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfdfd9c3b64347f997e5d181c39fddcd in term 3.
I20260709 13:14:33.842868  2118 raft_consensus.cc:697] T 2f141c8bf4624551b8906e0469e6c4d8 P cfdfd9c3b64347f997e5d181c39fddcd [term 3 LEADER]: Becoming Leader. State: Replica: cfdfd9c3b64347f997e5d181c39fddcd, State: Running, Role: LEADER
I20260709 13:14:33.843694  2118 consensus_queue.cc:237] T 2f141c8bf4624551b8906e0469e6c4d8 P cfdfd9c3b64347f997e5d181c39fddcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:33.849582  1742 catalog_manager.cc:5697] T 2f141c8bf4624551b8906e0469e6c4d8 P cfdfd9c3b64347f997e5d181c39fddcd reported cstate change: term changed from 2 to 3, leader changed from 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67) to cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66). New cstate: current_term: 3 leader_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:33.902161  1846 raft_consensus.cc:1275] T fe7a5d3b676046eba775b5d39c4c1cd9 P efd77f14978b4b49880b1a39abc66987 [term 2 FOLLOWER]: Refusing update from remote peer cfdfd9c3b64347f997e5d181c39fddcd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:33.903384  2118 consensus_queue.cc:1048] T fe7a5d3b676046eba775b5d39c4c1cd9 P cfdfd9c3b64347f997e5d181c39fddcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:33.910702  1995 raft_consensus.cc:1275] T fe7a5d3b676046eba775b5d39c4c1cd9 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 2 FOLLOWER]: Refusing update from remote peer cfdfd9c3b64347f997e5d181c39fddcd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:33.912962  2118 consensus_queue.cc:1048] T fe7a5d3b676046eba775b5d39c4c1cd9 P cfdfd9c3b64347f997e5d181c39fddcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:33.939586  1846 raft_consensus.cc:1275] T afd1f7dbbeee4d218895cf5a8e54efd3 P efd77f14978b4b49880b1a39abc66987 [term 2 FOLLOWER]: Refusing update from remote peer cfdfd9c3b64347f997e5d181c39fddcd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:33.940871  2118 consensus_queue.cc:1048] T afd1f7dbbeee4d218895cf5a8e54efd3 P cfdfd9c3b64347f997e5d181c39fddcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:33.947817  1995 raft_consensus.cc:1275] T afd1f7dbbeee4d218895cf5a8e54efd3 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 2 FOLLOWER]: Refusing update from remote peer cfdfd9c3b64347f997e5d181c39fddcd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:33.949219  2069 consensus_queue.cc:1048] T afd1f7dbbeee4d218895cf5a8e54efd3 P cfdfd9c3b64347f997e5d181c39fddcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:34.002592  1995 raft_consensus.cc:1275] T b16576d7015c475fb71585c29048e5a9 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 2 FOLLOWER]: Refusing update from remote peer efd77f14978b4b49880b1a39abc66987: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:34.003348  1923 raft_consensus.cc:1275] T b16576d7015c475fb71585c29048e5a9 P cfdfd9c3b64347f997e5d181c39fddcd [term 2 FOLLOWER]: Refusing update from remote peer efd77f14978b4b49880b1a39abc66987: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:34.003835  2111 consensus_queue.cc:1048] T b16576d7015c475fb71585c29048e5a9 P efd77f14978b4b49880b1a39abc66987 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:34.004863  2043 consensus_queue.cc:1048] T b16576d7015c475fb71585c29048e5a9 P efd77f14978b4b49880b1a39abc66987 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:34.101874  1995 raft_consensus.cc:1275] T aaaceebb1e1c4a61968762f9b4b32dea P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 2 FOLLOWER]: Refusing update from remote peer cfdfd9c3b64347f997e5d181c39fddcd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:34.103229  2069 consensus_queue.cc:1048] T aaaceebb1e1c4a61968762f9b4b32dea P cfdfd9c3b64347f997e5d181c39fddcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:34.110364  1846 raft_consensus.cc:1275] T aaaceebb1e1c4a61968762f9b4b32dea P efd77f14978b4b49880b1a39abc66987 [term 2 FOLLOWER]: Refusing update from remote peer cfdfd9c3b64347f997e5d181c39fddcd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:34.111706  2065 consensus_queue.cc:1048] T aaaceebb1e1c4a61968762f9b4b32dea P cfdfd9c3b64347f997e5d181c39fddcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:34.185591  1923 raft_consensus.cc:1275] T 6b8eac6adeda4c8a9e8e4142a9b86feb P cfdfd9c3b64347f997e5d181c39fddcd [term 2 FOLLOWER]: Refusing update from remote peer efd77f14978b4b49880b1a39abc66987: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:34.187000  2122 consensus_queue.cc:1048] T 6b8eac6adeda4c8a9e8e4142a9b86feb P efd77f14978b4b49880b1a39abc66987 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:34.196085  1995 raft_consensus.cc:1275] T 6b8eac6adeda4c8a9e8e4142a9b86feb P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 2 FOLLOWER]: Refusing update from remote peer efd77f14978b4b49880b1a39abc66987: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:34.197930  2122 consensus_queue.cc:1048] T 6b8eac6adeda4c8a9e8e4142a9b86feb P efd77f14978b4b49880b1a39abc66987 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:34.238227  1846 raft_consensus.cc:1275] T 2f141c8bf4624551b8906e0469e6c4d8 P efd77f14978b4b49880b1a39abc66987 [term 3 FOLLOWER]: Refusing update from remote peer cfdfd9c3b64347f997e5d181c39fddcd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:34.239737  2118 consensus_queue.cc:1048] T 2f141c8bf4624551b8906e0469e6c4d8 P cfdfd9c3b64347f997e5d181c39fddcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:34.247603  1995 raft_consensus.cc:1275] T 2f141c8bf4624551b8906e0469e6c4d8 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 3 FOLLOWER]: Refusing update from remote peer cfdfd9c3b64347f997e5d181c39fddcd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:34.249894  2062 consensus_queue.cc:1048] T 2f141c8bf4624551b8906e0469e6c4d8 P cfdfd9c3b64347f997e5d181c39fddcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:34.366235  1995 raft_consensus.cc:1275] T b06ca2d520f7457692822190ac2a8f32 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 2 FOLLOWER]: Refusing update from remote peer efd77f14978b4b49880b1a39abc66987: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:34.367496  2122 consensus_queue.cc:1048] T b06ca2d520f7457692822190ac2a8f32 P efd77f14978b4b49880b1a39abc66987 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:34.375865  1923 raft_consensus.cc:1275] T b06ca2d520f7457692822190ac2a8f32 P cfdfd9c3b64347f997e5d181c39fddcd [term 2 FOLLOWER]: Refusing update from remote peer efd77f14978b4b49880b1a39abc66987: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:34.377887  2111 consensus_queue.cc:1048] T b06ca2d520f7457692822190ac2a8f32 P efd77f14978b4b49880b1a39abc66987 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:36.496655  1742 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36558:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:14:36.499459  1742 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:14:36.553351  1834 tablet_service.cc:1511] Processing CreateTablet for tablet 086f00b382884297b8409ffe816158fc (DEFAULT_TABLE table=soft_deleted_table [id=390984e758c8422bacf50813861d2b7f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:14:36.554625  1910 tablet_service.cc:1511] Processing CreateTablet for tablet 086f00b382884297b8409ffe816158fc (DEFAULT_TABLE table=soft_deleted_table [id=390984e758c8422bacf50813861d2b7f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:14:36.555579  1834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 086f00b382884297b8409ffe816158fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:36.556607  1910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 086f00b382884297b8409ffe816158fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:36.556228  1983 tablet_service.cc:1511] Processing CreateTablet for tablet 086f00b382884297b8409ffe816158fc (DEFAULT_TABLE table=soft_deleted_table [id=390984e758c8422bacf50813861d2b7f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:14:36.558049  1983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 086f00b382884297b8409ffe816158fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:36.558969  1832 tablet_service.cc:1511] Processing CreateTablet for tablet 7efaa7b0e2a6420282d24eed82603436 (DEFAULT_TABLE table=soft_deleted_table [id=390984e758c8422bacf50813861d2b7f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:14:36.560398  1832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7efaa7b0e2a6420282d24eed82603436. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:36.563310  1979 tablet_service.cc:1511] Processing CreateTablet for tablet 7efaa7b0e2a6420282d24eed82603436 (DEFAULT_TABLE table=soft_deleted_table [id=390984e758c8422bacf50813861d2b7f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:14:36.564288  1907 tablet_service.cc:1511] Processing CreateTablet for tablet 7efaa7b0e2a6420282d24eed82603436 (DEFAULT_TABLE table=soft_deleted_table [id=390984e758c8422bacf50813861d2b7f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:14:36.564810  1979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7efaa7b0e2a6420282d24eed82603436. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:36.565261  1905 tablet_service.cc:1511] Processing CreateTablet for tablet 6476c353b8b04452a9edbbff28e6c212 (DEFAULT_TABLE table=soft_deleted_table [id=390984e758c8422bacf50813861d2b7f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:14:36.565899  1907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7efaa7b0e2a6420282d24eed82603436. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:36.566664  1905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6476c353b8b04452a9edbbff28e6c212. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:36.576453  1830 tablet_service.cc:1511] Processing CreateTablet for tablet 6476c353b8b04452a9edbbff28e6c212 (DEFAULT_TABLE table=soft_deleted_table [id=390984e758c8422bacf50813861d2b7f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:14:36.577200  1985 tablet_service.cc:1511] Processing CreateTablet for tablet 6476c353b8b04452a9edbbff28e6c212 (DEFAULT_TABLE table=soft_deleted_table [id=390984e758c8422bacf50813861d2b7f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:14:36.578019  1830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6476c353b8b04452a9edbbff28e6c212. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:36.578637  1985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6476c353b8b04452a9edbbff28e6c212. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:36.589605  1833 tablet_service.cc:1511] Processing CreateTablet for tablet 8dc82a3179da4d49b0000f0755cb7577 (DEFAULT_TABLE table=soft_deleted_table [id=390984e758c8422bacf50813861d2b7f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:14:36.591158  1833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dc82a3179da4d49b0000f0755cb7577. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:36.592314  1982 tablet_service.cc:1511] Processing CreateTablet for tablet 8dc82a3179da4d49b0000f0755cb7577 (DEFAULT_TABLE table=soft_deleted_table [id=390984e758c8422bacf50813861d2b7f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:14:36.593843  1982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dc82a3179da4d49b0000f0755cb7577. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:36.594028  1906 tablet_service.cc:1511] Processing CreateTablet for tablet 8dc82a3179da4d49b0000f0755cb7577 (DEFAULT_TABLE table=soft_deleted_table [id=390984e758c8422bacf50813861d2b7f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:14:36.595392  1906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dc82a3179da4d49b0000f0755cb7577. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:36.599098  1835 tablet_service.cc:1511] Processing CreateTablet for tablet bd3d2c56c68f4dde862e62fa03ea3390 (DEFAULT_TABLE table=soft_deleted_table [id=390984e758c8422bacf50813861d2b7f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:14:36.600615  1835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd3d2c56c68f4dde862e62fa03ea3390. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:36.608428  1911 tablet_service.cc:1511] Processing CreateTablet for tablet bd3d2c56c68f4dde862e62fa03ea3390 (DEFAULT_TABLE table=soft_deleted_table [id=390984e758c8422bacf50813861d2b7f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:14:36.609964  1911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd3d2c56c68f4dde862e62fa03ea3390. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:36.615049  1913 tablet_service.cc:1511] Processing CreateTablet for tablet fc2475f8deda4598a7b0273059a49b4f (DEFAULT_TABLE table=soft_deleted_table [id=390984e758c8422bacf50813861d2b7f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:14:36.616521  1913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc2475f8deda4598a7b0273059a49b4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:36.619777  1980 tablet_service.cc:1511] Processing CreateTablet for tablet bd3d2c56c68f4dde862e62fa03ea3390 (DEFAULT_TABLE table=soft_deleted_table [id=390984e758c8422bacf50813861d2b7f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:14:36.621150  1980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd3d2c56c68f4dde862e62fa03ea3390. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:36.623564  1837 tablet_service.cc:1511] Processing CreateTablet for tablet fc2475f8deda4598a7b0273059a49b4f (DEFAULT_TABLE table=soft_deleted_table [id=390984e758c8422bacf50813861d2b7f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:14:36.624608  1908 tablet_service.cc:1511] Processing CreateTablet for tablet c152640dda8d4cce94303c088f3e4314 (DEFAULT_TABLE table=soft_deleted_table [id=390984e758c8422bacf50813861d2b7f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:14:36.625092  1837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc2475f8deda4598a7b0273059a49b4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:36.628373  1908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c152640dda8d4cce94303c088f3e4314. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:36.629236  1838 tablet_service.cc:1511] Processing CreateTablet for tablet c152640dda8d4cce94303c088f3e4314 (DEFAULT_TABLE table=soft_deleted_table [id=390984e758c8422bacf50813861d2b7f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:14:36.634615  1838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c152640dda8d4cce94303c088f3e4314. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:36.635473  1987 tablet_service.cc:1511] Processing CreateTablet for tablet fc2475f8deda4598a7b0273059a49b4f (DEFAULT_TABLE table=soft_deleted_table [id=390984e758c8422bacf50813861d2b7f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:14:36.636893  1987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc2475f8deda4598a7b0273059a49b4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:36.644141  1981 tablet_service.cc:1511] Processing CreateTablet for tablet c152640dda8d4cce94303c088f3e4314 (DEFAULT_TABLE table=soft_deleted_table [id=390984e758c8422bacf50813861d2b7f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:14:36.645654  1981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c152640dda8d4cce94303c088f3e4314. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:36.646565  1909 tablet_service.cc:1511] Processing CreateTablet for tablet fdadc5e784044a589388e57980a8e0dc (DEFAULT_TABLE table=soft_deleted_table [id=390984e758c8422bacf50813861d2b7f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:14:36.647997  1909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdadc5e784044a589388e57980a8e0dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:36.648882  1986 tablet_service.cc:1511] Processing CreateTablet for tablet fdadc5e784044a589388e57980a8e0dc (DEFAULT_TABLE table=soft_deleted_table [id=390984e758c8422bacf50813861d2b7f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:14:36.650355  1986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdadc5e784044a589388e57980a8e0dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:36.657627  1832 tablet_service.cc:1511] Processing CreateTablet for tablet fdadc5e784044a589388e57980a8e0dc (DEFAULT_TABLE table=soft_deleted_table [id=390984e758c8422bacf50813861d2b7f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:14:36.669446  1832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdadc5e784044a589388e57980a8e0dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:36.700395  2139 tablet_bootstrap.cc:492] T 6476c353b8b04452a9edbbff28e6c212 P efd77f14978b4b49880b1a39abc66987: Bootstrap starting.
I20260709 13:14:36.701346  1838 tablet_service.cc:1511] Processing CreateTablet for tablet 0d114296a5964005a874e6e09d94538b (DEFAULT_TABLE table=soft_deleted_table [id=390984e758c8422bacf50813861d2b7f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:14:36.714206  1838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d114296a5964005a874e6e09d94538b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:36.703912  2138 tablet_bootstrap.cc:492] T 086f00b382884297b8409ffe816158fc P 4cfc2f643a0a46888b750e0ab7b7fde6: Bootstrap starting.
I20260709 13:14:36.705992  1907 tablet_service.cc:1511] Processing CreateTablet for tablet 0d114296a5964005a874e6e09d94538b (DEFAULT_TABLE table=soft_deleted_table [id=390984e758c8422bacf50813861d2b7f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:14:36.732419  1985 tablet_service.cc:1511] Processing CreateTablet for tablet 0d114296a5964005a874e6e09d94538b (DEFAULT_TABLE table=soft_deleted_table [id=390984e758c8422bacf50813861d2b7f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:14:36.733901  1907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d114296a5964005a874e6e09d94538b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:36.737133  2138 tablet_bootstrap.cc:654] T 086f00b382884297b8409ffe816158fc P 4cfc2f643a0a46888b750e0ab7b7fde6: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:36.740844  2139 tablet_bootstrap.cc:654] T 6476c353b8b04452a9edbbff28e6c212 P efd77f14978b4b49880b1a39abc66987: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:36.747108  1985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d114296a5964005a874e6e09d94538b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:36.759485  2140 tablet_bootstrap.cc:492] T 6476c353b8b04452a9edbbff28e6c212 P cfdfd9c3b64347f997e5d181c39fddcd: Bootstrap starting.
I20260709 13:14:36.779663  2139 tablet_bootstrap.cc:492] T 6476c353b8b04452a9edbbff28e6c212 P efd77f14978b4b49880b1a39abc66987: No bootstrap required, opened a new log
I20260709 13:14:36.780198  2138 tablet_bootstrap.cc:492] T 086f00b382884297b8409ffe816158fc P 4cfc2f643a0a46888b750e0ab7b7fde6: No bootstrap required, opened a new log
I20260709 13:14:36.780397  2139 ts_tablet_manager.cc:1403] T 6476c353b8b04452a9edbbff28e6c212 P efd77f14978b4b49880b1a39abc66987: Time spent bootstrapping tablet: real 0.080s	user 0.012s	sys 0.012s
I20260709 13:14:36.780858  2140 tablet_bootstrap.cc:654] T 6476c353b8b04452a9edbbff28e6c212 P cfdfd9c3b64347f997e5d181c39fddcd: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:36.780875  2138 ts_tablet_manager.cc:1403] T 086f00b382884297b8409ffe816158fc P 4cfc2f643a0a46888b750e0ab7b7fde6: Time spent bootstrapping tablet: real 0.077s	user 0.004s	sys 0.023s
I20260709 13:14:36.783900  2139 raft_consensus.cc:359] T 6476c353b8b04452a9edbbff28e6c212 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:36.788043  2139 raft_consensus.cc:385] T 6476c353b8b04452a9edbbff28e6c212 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:36.784440  2138 raft_consensus.cc:359] T 086f00b382884297b8409ffe816158fc P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:36.788568  2139 raft_consensus.cc:740] T 6476c353b8b04452a9edbbff28e6c212 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efd77f14978b4b49880b1a39abc66987, State: Initialized, Role: FOLLOWER
I20260709 13:14:36.788892  2138 raft_consensus.cc:385] T 086f00b382884297b8409ffe816158fc P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:36.789354  2138 raft_consensus.cc:740] T 086f00b382884297b8409ffe816158fc P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cfc2f643a0a46888b750e0ab7b7fde6, State: Initialized, Role: FOLLOWER
I20260709 13:14:36.789570  2139 consensus_queue.cc:260] T 6476c353b8b04452a9edbbff28e6c212 P efd77f14978b4b49880b1a39abc66987 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:36.792143  2139 ts_tablet_manager.cc:1434] T 6476c353b8b04452a9edbbff28e6c212 P efd77f14978b4b49880b1a39abc66987: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 13:14:36.790514  2138 consensus_queue.cc:260] T 086f00b382884297b8409ffe816158fc P 4cfc2f643a0a46888b750e0ab7b7fde6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:36.793275  2139 tablet_bootstrap.cc:492] T 7efaa7b0e2a6420282d24eed82603436 P efd77f14978b4b49880b1a39abc66987: Bootstrap starting.
I20260709 13:14:36.799875  2139 tablet_bootstrap.cc:654] T 7efaa7b0e2a6420282d24eed82603436 P efd77f14978b4b49880b1a39abc66987: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:36.801494  2140 tablet_bootstrap.cc:492] T 6476c353b8b04452a9edbbff28e6c212 P cfdfd9c3b64347f997e5d181c39fddcd: No bootstrap required, opened a new log
I20260709 13:14:36.802105  2140 ts_tablet_manager.cc:1403] T 6476c353b8b04452a9edbbff28e6c212 P cfdfd9c3b64347f997e5d181c39fddcd: Time spent bootstrapping tablet: real 0.043s	user 0.004s	sys 0.016s
I20260709 13:14:36.802858  2138 ts_tablet_manager.cc:1434] T 086f00b382884297b8409ffe816158fc P 4cfc2f643a0a46888b750e0ab7b7fde6: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.005s
I20260709 13:14:36.806154  2140 raft_consensus.cc:359] T 6476c353b8b04452a9edbbff28e6c212 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:36.807271  2140 raft_consensus.cc:385] T 6476c353b8b04452a9edbbff28e6c212 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:36.807667  2140 raft_consensus.cc:740] T 6476c353b8b04452a9edbbff28e6c212 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfdfd9c3b64347f997e5d181c39fddcd, State: Initialized, Role: FOLLOWER
I20260709 13:14:36.808655  2140 consensus_queue.cc:260] T 6476c353b8b04452a9edbbff28e6c212 P cfdfd9c3b64347f997e5d181c39fddcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:36.809691  2138 tablet_bootstrap.cc:492] T 6476c353b8b04452a9edbbff28e6c212 P 4cfc2f643a0a46888b750e0ab7b7fde6: Bootstrap starting.
I20260709 13:14:36.811462  2140 ts_tablet_manager.cc:1434] T 6476c353b8b04452a9edbbff28e6c212 P cfdfd9c3b64347f997e5d181c39fddcd: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:14:36.812057  2139 tablet_bootstrap.cc:492] T 7efaa7b0e2a6420282d24eed82603436 P efd77f14978b4b49880b1a39abc66987: No bootstrap required, opened a new log
I20260709 13:14:36.812623  2140 tablet_bootstrap.cc:492] T 7efaa7b0e2a6420282d24eed82603436 P cfdfd9c3b64347f997e5d181c39fddcd: Bootstrap starting.
I20260709 13:14:36.812613  2139 ts_tablet_manager.cc:1403] T 7efaa7b0e2a6420282d24eed82603436 P efd77f14978b4b49880b1a39abc66987: Time spent bootstrapping tablet: real 0.020s	user 0.005s	sys 0.013s
I20260709 13:14:36.816179  2139 raft_consensus.cc:359] T 7efaa7b0e2a6420282d24eed82603436 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:36.817122  2139 raft_consensus.cc:385] T 7efaa7b0e2a6420282d24eed82603436 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:36.817480  2139 raft_consensus.cc:740] T 7efaa7b0e2a6420282d24eed82603436 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efd77f14978b4b49880b1a39abc66987, State: Initialized, Role: FOLLOWER
W20260709 13:14:36.818217  1794 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:36.818414  2139 consensus_queue.cc:260] T 7efaa7b0e2a6420282d24eed82603436 P efd77f14978b4b49880b1a39abc66987 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:36.820222  2140 tablet_bootstrap.cc:654] T 7efaa7b0e2a6420282d24eed82603436 P cfdfd9c3b64347f997e5d181c39fddcd: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:36.821449  2139 ts_tablet_manager.cc:1434] T 7efaa7b0e2a6420282d24eed82603436 P efd77f14978b4b49880b1a39abc66987: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:14:36.821458  2138 tablet_bootstrap.cc:654] T 6476c353b8b04452a9edbbff28e6c212 P 4cfc2f643a0a46888b750e0ab7b7fde6: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:36.823101  1949 tablet.cc:2406] T 6476c353b8b04452a9edbbff28e6c212 P cfdfd9c3b64347f997e5d181c39fddcd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:14:36.822746  2139 tablet_bootstrap.cc:492] T 8dc82a3179da4d49b0000f0755cb7577 P efd77f14978b4b49880b1a39abc66987: Bootstrap starting.
I20260709 13:14:36.830292  2138 tablet_bootstrap.cc:492] T 6476c353b8b04452a9edbbff28e6c212 P 4cfc2f643a0a46888b750e0ab7b7fde6: No bootstrap required, opened a new log
I20260709 13:14:36.830883  2138 ts_tablet_manager.cc:1403] T 6476c353b8b04452a9edbbff28e6c212 P 4cfc2f643a0a46888b750e0ab7b7fde6: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.004s
I20260709 13:14:36.834033  2138 raft_consensus.cc:359] T 6476c353b8b04452a9edbbff28e6c212 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:36.834789  2138 raft_consensus.cc:385] T 6476c353b8b04452a9edbbff28e6c212 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:36.835111  2138 raft_consensus.cc:740] T 6476c353b8b04452a9edbbff28e6c212 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cfc2f643a0a46888b750e0ab7b7fde6, State: Initialized, Role: FOLLOWER
I20260709 13:14:36.835924  2138 consensus_queue.cc:260] T 6476c353b8b04452a9edbbff28e6c212 P 4cfc2f643a0a46888b750e0ab7b7fde6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:36.836364  2139 tablet_bootstrap.cc:654] T 8dc82a3179da4d49b0000f0755cb7577 P efd77f14978b4b49880b1a39abc66987: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:36.836619  2140 tablet_bootstrap.cc:492] T 7efaa7b0e2a6420282d24eed82603436 P cfdfd9c3b64347f997e5d181c39fddcd: No bootstrap required, opened a new log
I20260709 13:14:36.837181  2140 ts_tablet_manager.cc:1403] T 7efaa7b0e2a6420282d24eed82603436 P cfdfd9c3b64347f997e5d181c39fddcd: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.008s
I20260709 13:14:36.840783  2140 raft_consensus.cc:359] T 7efaa7b0e2a6420282d24eed82603436 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:36.841816  2140 raft_consensus.cc:385] T 7efaa7b0e2a6420282d24eed82603436 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:36.842267  2140 raft_consensus.cc:740] T 7efaa7b0e2a6420282d24eed82603436 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfdfd9c3b64347f997e5d181c39fddcd, State: Initialized, Role: FOLLOWER
I20260709 13:14:36.842435  2138 ts_tablet_manager.cc:1434] T 6476c353b8b04452a9edbbff28e6c212 P 4cfc2f643a0a46888b750e0ab7b7fde6: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:14:36.844041  2138 tablet_bootstrap.cc:492] T fc2475f8deda4598a7b0273059a49b4f P 4cfc2f643a0a46888b750e0ab7b7fde6: Bootstrap starting.
I20260709 13:14:36.843539  2140 consensus_queue.cc:260] T 7efaa7b0e2a6420282d24eed82603436 P cfdfd9c3b64347f997e5d181c39fddcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:36.846907  2140 ts_tablet_manager.cc:1434] T 7efaa7b0e2a6420282d24eed82603436 P cfdfd9c3b64347f997e5d181c39fddcd: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 13:14:36.847914  2140 tablet_bootstrap.cc:492] T 086f00b382884297b8409ffe816158fc P cfdfd9c3b64347f997e5d181c39fddcd: Bootstrap starting.
I20260709 13:14:36.848580  2139 tablet_bootstrap.cc:492] T 8dc82a3179da4d49b0000f0755cb7577 P efd77f14978b4b49880b1a39abc66987: No bootstrap required, opened a new log
I20260709 13:14:36.849232  2139 ts_tablet_manager.cc:1403] T 8dc82a3179da4d49b0000f0755cb7577 P efd77f14978b4b49880b1a39abc66987: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.010s
I20260709 13:14:36.853305  2138 tablet_bootstrap.cc:654] T fc2475f8deda4598a7b0273059a49b4f P 4cfc2f643a0a46888b750e0ab7b7fde6: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:36.853127  2139 raft_consensus.cc:359] T 8dc82a3179da4d49b0000f0755cb7577 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:36.854000  2139 raft_consensus.cc:385] T 8dc82a3179da4d49b0000f0755cb7577 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:36.854378  2139 raft_consensus.cc:740] T 8dc82a3179da4d49b0000f0755cb7577 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efd77f14978b4b49880b1a39abc66987, State: Initialized, Role: FOLLOWER
I20260709 13:14:36.854676  2140 tablet_bootstrap.cc:654] T 086f00b382884297b8409ffe816158fc P cfdfd9c3b64347f997e5d181c39fddcd: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:36.855345  2139 consensus_queue.cc:260] T 8dc82a3179da4d49b0000f0755cb7577 P efd77f14978b4b49880b1a39abc66987 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:36.858529  2139 ts_tablet_manager.cc:1434] T 8dc82a3179da4d49b0000f0755cb7577 P efd77f14978b4b49880b1a39abc66987: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:14:36.859905  2139 tablet_bootstrap.cc:492] T 086f00b382884297b8409ffe816158fc P efd77f14978b4b49880b1a39abc66987: Bootstrap starting.
I20260709 13:14:36.861642  2062 raft_consensus.cc:493] T 7efaa7b0e2a6420282d24eed82603436 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:36.862206  2062 raft_consensus.cc:515] T 7efaa7b0e2a6420282d24eed82603436 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:36.864472  2062 leader_election.cc:290] T 7efaa7b0e2a6420282d24eed82603436 P cfdfd9c3b64347f997e5d181c39fddcd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efd77f14978b4b49880b1a39abc66987 (127.23.140.65:41453), 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67:33709)
I20260709 13:14:36.866314  1846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7efaa7b0e2a6420282d24eed82603436" candidate_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efd77f14978b4b49880b1a39abc66987" is_pre_election: true
I20260709 13:14:36.867069  1846 raft_consensus.cc:2468] T 7efaa7b0e2a6420282d24eed82603436 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfdfd9c3b64347f997e5d181c39fddcd in term 0.
I20260709 13:14:36.868541  1887 leader_election.cc:304] T 7efaa7b0e2a6420282d24eed82603436 P cfdfd9c3b64347f997e5d181c39fddcd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cfdfd9c3b64347f997e5d181c39fddcd, efd77f14978b4b49880b1a39abc66987; no voters: 
I20260709 13:14:36.869030  2139 tablet_bootstrap.cc:654] T 086f00b382884297b8409ffe816158fc P efd77f14978b4b49880b1a39abc66987: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:36.870554  1997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7efaa7b0e2a6420282d24eed82603436" candidate_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" is_pre_election: true
W20260709 13:14:36.872376  1886 leader_election.cc:343] T 7efaa7b0e2a6420282d24eed82603436 P cfdfd9c3b64347f997e5d181c39fddcd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:36.873409  2062 raft_consensus.cc:2804] T 7efaa7b0e2a6420282d24eed82603436 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:36.873888  2062 raft_consensus.cc:493] T 7efaa7b0e2a6420282d24eed82603436 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:36.874280  2062 raft_consensus.cc:3060] T 7efaa7b0e2a6420282d24eed82603436 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:36.879048  2140 tablet_bootstrap.cc:492] T 086f00b382884297b8409ffe816158fc P cfdfd9c3b64347f997e5d181c39fddcd: No bootstrap required, opened a new log
I20260709 13:14:36.879877  2140 ts_tablet_manager.cc:1403] T 086f00b382884297b8409ffe816158fc P cfdfd9c3b64347f997e5d181c39fddcd: Time spent bootstrapping tablet: real 0.032s	user 0.006s	sys 0.025s
I20260709 13:14:36.881955  2062 raft_consensus.cc:515] T 7efaa7b0e2a6420282d24eed82603436 P cfdfd9c3b64347f997e5d181c39fddcd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:36.883080  2139 tablet_bootstrap.cc:492] T 086f00b382884297b8409ffe816158fc P efd77f14978b4b49880b1a39abc66987: No bootstrap required, opened a new log
I20260709 13:14:36.883659  2139 ts_tablet_manager.cc:1403] T 086f00b382884297b8409ffe816158fc P efd77f14978b4b49880b1a39abc66987: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.007s
I20260709 13:14:36.883354  2140 raft_consensus.cc:359] T 086f00b382884297b8409ffe816158fc P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:36.884182  2140 raft_consensus.cc:385] T 086f00b382884297b8409ffe816158fc P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:36.884516  2140 raft_consensus.cc:740] T 086f00b382884297b8409ffe816158fc P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfdfd9c3b64347f997e5d181c39fddcd, State: Initialized, Role: FOLLOWER
I20260709 13:14:36.884851  1997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7efaa7b0e2a6420282d24eed82603436" candidate_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6"
I20260709 13:14:36.885419  2140 consensus_queue.cc:260] T 086f00b382884297b8409ffe816158fc P cfdfd9c3b64347f997e5d181c39fddcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:36.886145  1846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7efaa7b0e2a6420282d24eed82603436" candidate_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efd77f14978b4b49880b1a39abc66987"
W20260709 13:14:36.886253  1886 leader_election.cc:343] T 7efaa7b0e2a6420282d24eed82603436 P cfdfd9c3b64347f997e5d181c39fddcd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:36.886858  1846 raft_consensus.cc:3060] T 7efaa7b0e2a6420282d24eed82603436 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:36.888334  2139 raft_consensus.cc:359] T 086f00b382884297b8409ffe816158fc P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:36.888926  2140 ts_tablet_manager.cc:1434] T 086f00b382884297b8409ffe816158fc P cfdfd9c3b64347f997e5d181c39fddcd: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:14:36.889097  2139 raft_consensus.cc:385] T 086f00b382884297b8409ffe816158fc P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:36.889432  2139 raft_consensus.cc:740] T 086f00b382884297b8409ffe816158fc P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efd77f14978b4b49880b1a39abc66987, State: Initialized, Role: FOLLOWER
I20260709 13:14:36.889998  2140 tablet_bootstrap.cc:492] T fdadc5e784044a589388e57980a8e0dc P cfdfd9c3b64347f997e5d181c39fddcd: Bootstrap starting.
I20260709 13:14:36.890208  2133 raft_consensus.cc:493] T 8dc82a3179da4d49b0000f0755cb7577 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:36.890578  2139 consensus_queue.cc:260] T 086f00b382884297b8409ffe816158fc P efd77f14978b4b49880b1a39abc66987 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:36.890715  2133 raft_consensus.cc:515] T 8dc82a3179da4d49b0000f0755cb7577 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:36.893193  2133 leader_election.cc:290] T 8dc82a3179da4d49b0000f0755cb7577 P efd77f14978b4b49880b1a39abc66987 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66:43351), 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67:33709)
I20260709 13:14:36.894953  1923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc82a3179da4d49b0000f0755cb7577" candidate_uuid: "efd77f14978b4b49880b1a39abc66987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" is_pre_election: true
W20260709 13:14:36.896708  1814 leader_election.cc:343] T 8dc82a3179da4d49b0000f0755cb7577 P efd77f14978b4b49880b1a39abc66987 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66:43351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:36.897513  2140 tablet_bootstrap.cc:654] T fdadc5e784044a589388e57980a8e0dc P cfdfd9c3b64347f997e5d181c39fddcd: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:36.897576  1997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc82a3179da4d49b0000f0755cb7577" candidate_uuid: "efd77f14978b4b49880b1a39abc66987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" is_pre_election: true
I20260709 13:14:36.897984  1846 raft_consensus.cc:2468] T 7efaa7b0e2a6420282d24eed82603436 P efd77f14978b4b49880b1a39abc66987 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfdfd9c3b64347f997e5d181c39fddcd in term 1.
I20260709 13:14:36.899439  1887 leader_election.cc:304] T 7efaa7b0e2a6420282d24eed82603436 P cfdfd9c3b64347f997e5d181c39fddcd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cfdfd9c3b64347f997e5d181c39fddcd, efd77f14978b4b49880b1a39abc66987; no voters: 4cfc2f643a0a46888b750e0ab7b7fde6
W20260709 13:14:36.899529  1811 leader_election.cc:343] T 8dc82a3179da4d49b0000f0755cb7577 P efd77f14978b4b49880b1a39abc66987 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:36.900048  1811 leader_election.cc:304] T 8dc82a3179da4d49b0000f0755cb7577 P efd77f14978b4b49880b1a39abc66987 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efd77f14978b4b49880b1a39abc66987; no voters: 4cfc2f643a0a46888b750e0ab7b7fde6, cfdfd9c3b64347f997e5d181c39fddcd
I20260709 13:14:36.904178  2133 raft_consensus.cc:2749] T 8dc82a3179da4d49b0000f0755cb7577 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:36.897563  2139 ts_tablet_manager.cc:1434] T 086f00b382884297b8409ffe816158fc P efd77f14978b4b49880b1a39abc66987: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:14:36.906874  2139 tablet_bootstrap.cc:492] T c152640dda8d4cce94303c088f3e4314 P efd77f14978b4b49880b1a39abc66987: Bootstrap starting.
I20260709 13:14:36.911742  2152 raft_consensus.cc:2804] T 7efaa7b0e2a6420282d24eed82603436 P cfdfd9c3b64347f997e5d181c39fddcd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:36.913817  2062 leader_election.cc:290] T 7efaa7b0e2a6420282d24eed82603436 P cfdfd9c3b64347f997e5d181c39fddcd [CANDIDATE]: Term 1 election: Requested vote from peers efd77f14978b4b49880b1a39abc66987 (127.23.140.65:41453), 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67:33709)
I20260709 13:14:36.916782  2138 tablet_bootstrap.cc:492] T fc2475f8deda4598a7b0273059a49b4f P 4cfc2f643a0a46888b750e0ab7b7fde6: No bootstrap required, opened a new log
I20260709 13:14:36.917356  2138 ts_tablet_manager.cc:1403] T fc2475f8deda4598a7b0273059a49b4f P 4cfc2f643a0a46888b750e0ab7b7fde6: Time spent bootstrapping tablet: real 0.074s	user 0.012s	sys 0.007s
I20260709 13:14:36.919809  2138 raft_consensus.cc:359] T fc2475f8deda4598a7b0273059a49b4f P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:36.920346  2138 raft_consensus.cc:385] T fc2475f8deda4598a7b0273059a49b4f P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:36.920673  2138 raft_consensus.cc:740] T fc2475f8deda4598a7b0273059a49b4f P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cfc2f643a0a46888b750e0ab7b7fde6, State: Initialized, Role: FOLLOWER
I20260709 13:14:36.921577  2152 raft_consensus.cc:697] T 7efaa7b0e2a6420282d24eed82603436 P cfdfd9c3b64347f997e5d181c39fddcd [term 1 LEADER]: Becoming Leader. State: Replica: cfdfd9c3b64347f997e5d181c39fddcd, State: Running, Role: LEADER
I20260709 13:14:36.921597  2138 consensus_queue.cc:260] T fc2475f8deda4598a7b0273059a49b4f P 4cfc2f643a0a46888b750e0ab7b7fde6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:36.922749  2152 consensus_queue.cc:237] T 7efaa7b0e2a6420282d24eed82603436 P cfdfd9c3b64347f997e5d181c39fddcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:36.928145  2140 tablet_bootstrap.cc:492] T fdadc5e784044a589388e57980a8e0dc P cfdfd9c3b64347f997e5d181c39fddcd: No bootstrap required, opened a new log
I20260709 13:14:36.928771  2140 ts_tablet_manager.cc:1403] T fdadc5e784044a589388e57980a8e0dc P cfdfd9c3b64347f997e5d181c39fddcd: Time spent bootstrapping tablet: real 0.039s	user 0.021s	sys 0.017s
I20260709 13:14:36.930038  2139 tablet_bootstrap.cc:654] T c152640dda8d4cce94303c088f3e4314 P efd77f14978b4b49880b1a39abc66987: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:36.931854  2140 raft_consensus.cc:359] T fdadc5e784044a589388e57980a8e0dc P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:36.932672  2140 raft_consensus.cc:385] T fdadc5e784044a589388e57980a8e0dc P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:36.933095  2140 raft_consensus.cc:740] T fdadc5e784044a589388e57980a8e0dc P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfdfd9c3b64347f997e5d181c39fddcd, State: Initialized, Role: FOLLOWER
I20260709 13:14:36.934281  2140 consensus_queue.cc:260] T fdadc5e784044a589388e57980a8e0dc P cfdfd9c3b64347f997e5d181c39fddcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:36.936352  2138 ts_tablet_manager.cc:1434] T fc2475f8deda4598a7b0273059a49b4f P 4cfc2f643a0a46888b750e0ab7b7fde6: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:14:36.937942  2140 ts_tablet_manager.cc:1434] T fdadc5e784044a589388e57980a8e0dc P cfdfd9c3b64347f997e5d181c39fddcd: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:14:36.940260  2138 tablet_bootstrap.cc:492] T 7efaa7b0e2a6420282d24eed82603436 P 4cfc2f643a0a46888b750e0ab7b7fde6: Bootstrap starting.
I20260709 13:14:36.940876  2140 tablet_bootstrap.cc:492] T fc2475f8deda4598a7b0273059a49b4f P cfdfd9c3b64347f997e5d181c39fddcd: Bootstrap starting.
I20260709 13:14:36.945336  1745 catalog_manager.cc:5697] T 7efaa7b0e2a6420282d24eed82603436 P cfdfd9c3b64347f997e5d181c39fddcd reported cstate change: term changed from 0 to 1, leader changed from <none> to cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66). New cstate: current_term: 1 leader_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:36.948035  2139 tablet_bootstrap.cc:492] T c152640dda8d4cce94303c088f3e4314 P efd77f14978b4b49880b1a39abc66987: No bootstrap required, opened a new log
I20260709 13:14:36.948697  2140 tablet_bootstrap.cc:654] T fc2475f8deda4598a7b0273059a49b4f P cfdfd9c3b64347f997e5d181c39fddcd: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:36.948697  2139 ts_tablet_manager.cc:1403] T c152640dda8d4cce94303c088f3e4314 P efd77f14978b4b49880b1a39abc66987: Time spent bootstrapping tablet: real 0.042s	user 0.011s	sys 0.007s
I20260709 13:14:36.947959  2138 tablet_bootstrap.cc:654] T 7efaa7b0e2a6420282d24eed82603436 P 4cfc2f643a0a46888b750e0ab7b7fde6: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:36.954877  2139 raft_consensus.cc:359] T c152640dda8d4cce94303c088f3e4314 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:36.955718  2139 raft_consensus.cc:385] T c152640dda8d4cce94303c088f3e4314 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:36.956051  2139 raft_consensus.cc:740] T c152640dda8d4cce94303c088f3e4314 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efd77f14978b4b49880b1a39abc66987, State: Initialized, Role: FOLLOWER
I20260709 13:14:36.957018  2140 tablet_bootstrap.cc:492] T fc2475f8deda4598a7b0273059a49b4f P cfdfd9c3b64347f997e5d181c39fddcd: No bootstrap required, opened a new log
I20260709 13:14:36.956811  2139 consensus_queue.cc:260] T c152640dda8d4cce94303c088f3e4314 P efd77f14978b4b49880b1a39abc66987 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:36.960043  2139 ts_tablet_manager.cc:1434] T c152640dda8d4cce94303c088f3e4314 P efd77f14978b4b49880b1a39abc66987: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:14:36.961169  2139 tablet_bootstrap.cc:492] T fc2475f8deda4598a7b0273059a49b4f P efd77f14978b4b49880b1a39abc66987: Bootstrap starting.
I20260709 13:14:36.957728  2140 ts_tablet_manager.cc:1403] T fc2475f8deda4598a7b0273059a49b4f P cfdfd9c3b64347f997e5d181c39fddcd: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.001s
I20260709 13:14:36.964707  2140 raft_consensus.cc:359] T fc2475f8deda4598a7b0273059a49b4f P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:36.965549  2140 raft_consensus.cc:385] T fc2475f8deda4598a7b0273059a49b4f P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:36.965940  2140 raft_consensus.cc:740] T fc2475f8deda4598a7b0273059a49b4f P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfdfd9c3b64347f997e5d181c39fddcd, State: Initialized, Role: FOLLOWER
I20260709 13:14:36.966674  2140 consensus_queue.cc:260] T fc2475f8deda4598a7b0273059a49b4f P cfdfd9c3b64347f997e5d181c39fddcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:36.968577  2139 tablet_bootstrap.cc:654] T fc2475f8deda4598a7b0273059a49b4f P efd77f14978b4b49880b1a39abc66987: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:36.969321  2140 ts_tablet_manager.cc:1434] T fc2475f8deda4598a7b0273059a49b4f P cfdfd9c3b64347f997e5d181c39fddcd: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.005s
I20260709 13:14:36.970423  2140 tablet_bootstrap.cc:492] T bd3d2c56c68f4dde862e62fa03ea3390 P cfdfd9c3b64347f997e5d181c39fddcd: Bootstrap starting.
I20260709 13:14:36.977058  2140 tablet_bootstrap.cc:654] T bd3d2c56c68f4dde862e62fa03ea3390 P cfdfd9c3b64347f997e5d181c39fddcd: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:36.980805  2138 tablet_bootstrap.cc:492] T 7efaa7b0e2a6420282d24eed82603436 P 4cfc2f643a0a46888b750e0ab7b7fde6: No bootstrap required, opened a new log
I20260709 13:14:36.981630  2138 ts_tablet_manager.cc:1403] T 7efaa7b0e2a6420282d24eed82603436 P 4cfc2f643a0a46888b750e0ab7b7fde6: Time spent bootstrapping tablet: real 0.042s	user 0.002s	sys 0.013s
I20260709 13:14:36.986100  2138 raft_consensus.cc:359] T 7efaa7b0e2a6420282d24eed82603436 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:36.987313  2138 raft_consensus.cc:385] T 7efaa7b0e2a6420282d24eed82603436 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:36.995833  2138 raft_consensus.cc:740] T 7efaa7b0e2a6420282d24eed82603436 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cfc2f643a0a46888b750e0ab7b7fde6, State: Initialized, Role: FOLLOWER
I20260709 13:14:36.997511  2138 consensus_queue.cc:260] T 7efaa7b0e2a6420282d24eed82603436 P 4cfc2f643a0a46888b750e0ab7b7fde6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:36.998821  2133 raft_consensus.cc:493] T c152640dda8d4cce94303c088f3e4314 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:36.999830  2139 tablet_bootstrap.cc:492] T fc2475f8deda4598a7b0273059a49b4f P efd77f14978b4b49880b1a39abc66987: No bootstrap required, opened a new log
I20260709 13:14:37.001085  2140 tablet_bootstrap.cc:492] T bd3d2c56c68f4dde862e62fa03ea3390 P cfdfd9c3b64347f997e5d181c39fddcd: No bootstrap required, opened a new log
I20260709 13:14:37.002296  2139 ts_tablet_manager.cc:1403] T fc2475f8deda4598a7b0273059a49b4f P efd77f14978b4b49880b1a39abc66987: Time spent bootstrapping tablet: real 0.041s	user 0.026s	sys 0.011s
I20260709 13:14:37.002506  2140 ts_tablet_manager.cc:1403] T bd3d2c56c68f4dde862e62fa03ea3390 P cfdfd9c3b64347f997e5d181c39fddcd: Time spent bootstrapping tablet: real 0.032s	user 0.017s	sys 0.013s
I20260709 13:14:37.001561  2138 ts_tablet_manager.cc:1434] T 7efaa7b0e2a6420282d24eed82603436 P 4cfc2f643a0a46888b750e0ab7b7fde6: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.002s
I20260709 13:14:37.001737  2133 raft_consensus.cc:515] T c152640dda8d4cce94303c088f3e4314 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:37.005578  2140 raft_consensus.cc:359] T bd3d2c56c68f4dde862e62fa03ea3390 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:37.006315  2140 raft_consensus.cc:385] T bd3d2c56c68f4dde862e62fa03ea3390 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:37.006608  2140 raft_consensus.cc:740] T bd3d2c56c68f4dde862e62fa03ea3390 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfdfd9c3b64347f997e5d181c39fddcd, State: Initialized, Role: FOLLOWER
I20260709 13:14:37.007616  2133 leader_election.cc:290] T c152640dda8d4cce94303c088f3e4314 P efd77f14978b4b49880b1a39abc66987 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66:43351), 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67:33709)
I20260709 13:14:37.007354  2140 consensus_queue.cc:260] T bd3d2c56c68f4dde862e62fa03ea3390 P cfdfd9c3b64347f997e5d181c39fddcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:37.008471  1923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c152640dda8d4cce94303c088f3e4314" candidate_uuid: "efd77f14978b4b49880b1a39abc66987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" is_pre_election: true
I20260709 13:14:37.008432  2139 raft_consensus.cc:359] T fc2475f8deda4598a7b0273059a49b4f P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:37.009406  2139 raft_consensus.cc:385] T fc2475f8deda4598a7b0273059a49b4f P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:37.009727  2139 raft_consensus.cc:740] T fc2475f8deda4598a7b0273059a49b4f P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efd77f14978b4b49880b1a39abc66987, State: Initialized, Role: FOLLOWER
I20260709 13:14:37.010076  2140 ts_tablet_manager.cc:1434] T bd3d2c56c68f4dde862e62fa03ea3390 P cfdfd9c3b64347f997e5d181c39fddcd: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:14:37.011139  2140 tablet_bootstrap.cc:492] T 8dc82a3179da4d49b0000f0755cb7577 P cfdfd9c3b64347f997e5d181c39fddcd: Bootstrap starting.
I20260709 13:14:37.011440  2138 tablet_bootstrap.cc:492] T fdadc5e784044a589388e57980a8e0dc P 4cfc2f643a0a46888b750e0ab7b7fde6: Bootstrap starting.
I20260709 13:14:37.011509  1997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c152640dda8d4cce94303c088f3e4314" candidate_uuid: "efd77f14978b4b49880b1a39abc66987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" is_pre_election: true
W20260709 13:14:37.010443  1814 leader_election.cc:343] T c152640dda8d4cce94303c088f3e4314 P efd77f14978b4b49880b1a39abc66987 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66:43351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:37.015906  2152 raft_consensus.cc:493] T fdadc5e784044a589388e57980a8e0dc P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:37.016521  1811 leader_election.cc:343] T c152640dda8d4cce94303c088f3e4314 P efd77f14978b4b49880b1a39abc66987 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:37.016494  2152 raft_consensus.cc:515] T fdadc5e784044a589388e57980a8e0dc P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:37.018410  2140 tablet_bootstrap.cc:654] T 8dc82a3179da4d49b0000f0755cb7577 P cfdfd9c3b64347f997e5d181c39fddcd: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:37.018985  2152 leader_election.cc:290] T fdadc5e784044a589388e57980a8e0dc P cfdfd9c3b64347f997e5d181c39fddcd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efd77f14978b4b49880b1a39abc66987 (127.23.140.65:41453), 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67:33709)
I20260709 13:14:37.019793  2138 tablet_bootstrap.cc:654] T fdadc5e784044a589388e57980a8e0dc P 4cfc2f643a0a46888b750e0ab7b7fde6: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:37.020028  1846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdadc5e784044a589388e57980a8e0dc" candidate_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efd77f14978b4b49880b1a39abc66987" is_pre_election: true
I20260709 13:14:37.010546  2139 consensus_queue.cc:260] T fc2475f8deda4598a7b0273059a49b4f P efd77f14978b4b49880b1a39abc66987 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
W20260709 13:14:37.022455  1887 leader_election.cc:343] T fdadc5e784044a589388e57980a8e0dc P cfdfd9c3b64347f997e5d181c39fddcd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer efd77f14978b4b49880b1a39abc66987 (127.23.140.65:41453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:37.023078  2139 ts_tablet_manager.cc:1434] T fc2475f8deda4598a7b0273059a49b4f P efd77f14978b4b49880b1a39abc66987: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.005s
I20260709 13:14:37.023680  1997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdadc5e784044a589388e57980a8e0dc" candidate_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" is_pre_election: true
W20260709 13:14:37.025593  1886 leader_election.cc:343] T fdadc5e784044a589388e57980a8e0dc P cfdfd9c3b64347f997e5d181c39fddcd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:37.026185  1886 leader_election.cc:304] T fdadc5e784044a589388e57980a8e0dc P cfdfd9c3b64347f997e5d181c39fddcd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfdfd9c3b64347f997e5d181c39fddcd; no voters: 4cfc2f643a0a46888b750e0ab7b7fde6, efd77f14978b4b49880b1a39abc66987
I20260709 13:14:37.028627  2154 raft_consensus.cc:2749] T fdadc5e784044a589388e57980a8e0dc P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:37.024080  2139 tablet_bootstrap.cc:492] T fdadc5e784044a589388e57980a8e0dc P efd77f14978b4b49880b1a39abc66987: Bootstrap starting.
I20260709 13:14:37.037873  2154 raft_consensus.cc:493] T 086f00b382884297b8409ffe816158fc P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.038529  2154 raft_consensus.cc:515] T 086f00b382884297b8409ffe816158fc P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:37.039011  1811 leader_election.cc:304] T c152640dda8d4cce94303c088f3e4314 P efd77f14978b4b49880b1a39abc66987 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efd77f14978b4b49880b1a39abc66987; no voters: 4cfc2f643a0a46888b750e0ab7b7fde6, cfdfd9c3b64347f997e5d181c39fddcd
I20260709 13:14:37.043951  1997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "086f00b382884297b8409ffe816158fc" candidate_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" is_pre_election: true
I20260709 13:14:37.044663  2133 raft_consensus.cc:2749] T c152640dda8d4cce94303c088f3e4314 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:37.044806  1997 raft_consensus.cc:2468] T 086f00b382884297b8409ffe816158fc P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfdfd9c3b64347f997e5d181c39fddcd in term 0.
I20260709 13:14:37.048815  1886 leader_election.cc:304] T 086f00b382884297b8409ffe816158fc P cfdfd9c3b64347f997e5d181c39fddcd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cfc2f643a0a46888b750e0ab7b7fde6, cfdfd9c3b64347f997e5d181c39fddcd; no voters: 
I20260709 13:14:37.049901  2152 raft_consensus.cc:2804] T 086f00b382884297b8409ffe816158fc P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:37.050161  2139 tablet_bootstrap.cc:654] T fdadc5e784044a589388e57980a8e0dc P efd77f14978b4b49880b1a39abc66987: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:37.050352  2152 raft_consensus.cc:493] T 086f00b382884297b8409ffe816158fc P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:37.050822  2152 raft_consensus.cc:3060] T 086f00b382884297b8409ffe816158fc P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:37.041853  1846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "086f00b382884297b8409ffe816158fc" candidate_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efd77f14978b4b49880b1a39abc66987" is_pre_election: true
I20260709 13:14:37.057009  2140 tablet_bootstrap.cc:492] T 8dc82a3179da4d49b0000f0755cb7577 P cfdfd9c3b64347f997e5d181c39fddcd: No bootstrap required, opened a new log
I20260709 13:14:37.056854  1846 raft_consensus.cc:2468] T 086f00b382884297b8409ffe816158fc P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfdfd9c3b64347f997e5d181c39fddcd in term 0.
I20260709 13:14:37.042546  2154 leader_election.cc:290] T 086f00b382884297b8409ffe816158fc P cfdfd9c3b64347f997e5d181c39fddcd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efd77f14978b4b49880b1a39abc66987 (127.23.140.65:41453), 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67:33709)
I20260709 13:14:37.058413  2140 ts_tablet_manager.cc:1403] T 8dc82a3179da4d49b0000f0755cb7577 P cfdfd9c3b64347f997e5d181c39fddcd: Time spent bootstrapping tablet: real 0.047s	user 0.017s	sys 0.023s
I20260709 13:14:37.061793  2140 raft_consensus.cc:359] T 8dc82a3179da4d49b0000f0755cb7577 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:37.062541  2140 raft_consensus.cc:385] T 8dc82a3179da4d49b0000f0755cb7577 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:37.062855  2140 raft_consensus.cc:740] T 8dc82a3179da4d49b0000f0755cb7577 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfdfd9c3b64347f997e5d181c39fddcd, State: Initialized, Role: FOLLOWER
I20260709 13:14:37.063575  2140 consensus_queue.cc:260] T 8dc82a3179da4d49b0000f0755cb7577 P cfdfd9c3b64347f997e5d181c39fddcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:37.065940  2140 ts_tablet_manager.cc:1434] T 8dc82a3179da4d49b0000f0755cb7577 P cfdfd9c3b64347f997e5d181c39fddcd: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:14:37.067058  2140 tablet_bootstrap.cc:492] T c152640dda8d4cce94303c088f3e4314 P cfdfd9c3b64347f997e5d181c39fddcd: Bootstrap starting.
I20260709 13:14:37.072564  2138 tablet_bootstrap.cc:492] T fdadc5e784044a589388e57980a8e0dc P 4cfc2f643a0a46888b750e0ab7b7fde6: No bootstrap required, opened a new log
I20260709 13:14:37.072973  2139 tablet_bootstrap.cc:492] T fdadc5e784044a589388e57980a8e0dc P efd77f14978b4b49880b1a39abc66987: No bootstrap required, opened a new log
I20260709 13:14:37.073671  2139 ts_tablet_manager.cc:1403] T fdadc5e784044a589388e57980a8e0dc P efd77f14978b4b49880b1a39abc66987: Time spent bootstrapping tablet: real 0.050s	user 0.012s	sys 0.017s
I20260709 13:14:37.076365  2138 ts_tablet_manager.cc:1403] T fdadc5e784044a589388e57980a8e0dc P 4cfc2f643a0a46888b750e0ab7b7fde6: Time spent bootstrapping tablet: real 0.071s	user 0.018s	sys 0.011s
I20260709 13:14:37.076959  2140 tablet_bootstrap.cc:654] T c152640dda8d4cce94303c088f3e4314 P cfdfd9c3b64347f997e5d181c39fddcd: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:37.077301  2139 raft_consensus.cc:359] T fdadc5e784044a589388e57980a8e0dc P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:37.078418  2139 raft_consensus.cc:385] T fdadc5e784044a589388e57980a8e0dc P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:37.078878  2139 raft_consensus.cc:740] T fdadc5e784044a589388e57980a8e0dc P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efd77f14978b4b49880b1a39abc66987, State: Initialized, Role: FOLLOWER
I20260709 13:14:37.079690  2139 consensus_queue.cc:260] T fdadc5e784044a589388e57980a8e0dc P efd77f14978b4b49880b1a39abc66987 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:37.082197  2139 ts_tablet_manager.cc:1434] T fdadc5e784044a589388e57980a8e0dc P efd77f14978b4b49880b1a39abc66987: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:14:37.083272  2139 tablet_bootstrap.cc:492] T 0d114296a5964005a874e6e09d94538b P efd77f14978b4b49880b1a39abc66987: Bootstrap starting.
I20260709 13:14:37.075976  2152 raft_consensus.cc:515] T 086f00b382884297b8409ffe816158fc P cfdfd9c3b64347f997e5d181c39fddcd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:37.090039  2139 tablet_bootstrap.cc:654] T 0d114296a5964005a874e6e09d94538b P efd77f14978b4b49880b1a39abc66987: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:37.090608  1846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "086f00b382884297b8409ffe816158fc" candidate_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efd77f14978b4b49880b1a39abc66987"
I20260709 13:14:37.090864  2133 raft_consensus.cc:493] T 6476c353b8b04452a9edbbff28e6c212 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.091289  1846 raft_consensus.cc:3060] T 086f00b382884297b8409ffe816158fc P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:37.091390  2133 raft_consensus.cc:515] T 6476c353b8b04452a9edbbff28e6c212 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:37.093863  2133 leader_election.cc:290] T 6476c353b8b04452a9edbbff28e6c212 P efd77f14978b4b49880b1a39abc66987 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66:43351), 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67:33709)
I20260709 13:14:37.080016  2138 raft_consensus.cc:359] T fdadc5e784044a589388e57980a8e0dc P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:37.094455  1923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6476c353b8b04452a9edbbff28e6c212" candidate_uuid: "efd77f14978b4b49880b1a39abc66987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" is_pre_election: true
I20260709 13:14:37.095254  1923 raft_consensus.cc:2468] T 6476c353b8b04452a9edbbff28e6c212 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efd77f14978b4b49880b1a39abc66987 in term 0.
I20260709 13:14:37.096426  1997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "086f00b382884297b8409ffe816158fc" candidate_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6"
I20260709 13:14:37.096853  1814 leader_election.cc:304] T 6476c353b8b04452a9edbbff28e6c212 P efd77f14978b4b49880b1a39abc66987 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cfdfd9c3b64347f997e5d181c39fddcd, efd77f14978b4b49880b1a39abc66987; no voters: 
I20260709 13:14:37.097045  1997 raft_consensus.cc:3060] T 086f00b382884297b8409ffe816158fc P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:37.097796  2125 raft_consensus.cc:493] T fc2475f8deda4598a7b0273059a49b4f P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.097882  2133 raft_consensus.cc:2804] T 6476c353b8b04452a9edbbff28e6c212 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:37.098503  2133 raft_consensus.cc:493] T 6476c353b8b04452a9edbbff28e6c212 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:37.098315  2125 raft_consensus.cc:515] T fc2475f8deda4598a7b0273059a49b4f P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:37.098994  2133 raft_consensus.cc:3060] T 6476c353b8b04452a9edbbff28e6c212 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:37.100637  2125 leader_election.cc:290] T fc2475f8deda4598a7b0273059a49b4f P efd77f14978b4b49880b1a39abc66987 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66:43351), 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67:33709)
I20260709 13:14:37.102589  1995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6476c353b8b04452a9edbbff28e6c212" candidate_uuid: "efd77f14978b4b49880b1a39abc66987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" is_pre_election: true
I20260709 13:14:37.103340  1995 raft_consensus.cc:2468] T 6476c353b8b04452a9edbbff28e6c212 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efd77f14978b4b49880b1a39abc66987 in term 0.
I20260709 13:14:37.103551  1996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2475f8deda4598a7b0273059a49b4f" candidate_uuid: "efd77f14978b4b49880b1a39abc66987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" is_pre_election: true
I20260709 13:14:37.104254  1996 raft_consensus.cc:2468] T fc2475f8deda4598a7b0273059a49b4f P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efd77f14978b4b49880b1a39abc66987 in term 0.
I20260709 13:14:37.105768  1997 raft_consensus.cc:2468] T 086f00b382884297b8409ffe816158fc P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfdfd9c3b64347f997e5d181c39fddcd in term 1.
I20260709 13:14:37.106588  1811 leader_election.cc:304] T fc2475f8deda4598a7b0273059a49b4f P efd77f14978b4b49880b1a39abc66987 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cfc2f643a0a46888b750e0ab7b7fde6, efd77f14978b4b49880b1a39abc66987; no voters: 
I20260709 13:14:37.106813  2152 leader_election.cc:290] T 086f00b382884297b8409ffe816158fc P cfdfd9c3b64347f997e5d181c39fddcd [CANDIDATE]: Term 1 election: Requested vote from peers efd77f14978b4b49880b1a39abc66987 (127.23.140.65:41453), 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67:33709)
I20260709 13:14:37.094542  2138 raft_consensus.cc:385] T fdadc5e784044a589388e57980a8e0dc P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:37.108570  2138 raft_consensus.cc:740] T fdadc5e784044a589388e57980a8e0dc P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cfc2f643a0a46888b750e0ab7b7fde6, State: Initialized, Role: FOLLOWER
I20260709 13:14:37.108949  2133 raft_consensus.cc:515] T 6476c353b8b04452a9edbbff28e6c212 P efd77f14978b4b49880b1a39abc66987 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:37.108605  2125 raft_consensus.cc:2804] T fc2475f8deda4598a7b0273059a49b4f P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:37.109277  1923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2475f8deda4598a7b0273059a49b4f" candidate_uuid: "efd77f14978b4b49880b1a39abc66987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" is_pre_election: true
I20260709 13:14:37.109823  2139 tablet_bootstrap.cc:492] T 0d114296a5964005a874e6e09d94538b P efd77f14978b4b49880b1a39abc66987: No bootstrap required, opened a new log
I20260709 13:14:37.109704  2138 consensus_queue.cc:260] T fdadc5e784044a589388e57980a8e0dc P 4cfc2f643a0a46888b750e0ab7b7fde6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:37.107661  1886 leader_election.cc:304] T 086f00b382884297b8409ffe816158fc P cfdfd9c3b64347f997e5d181c39fddcd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cfc2f643a0a46888b750e0ab7b7fde6, cfdfd9c3b64347f997e5d181c39fddcd; no voters: 
I20260709 13:14:37.109934  2125 raft_consensus.cc:493] T fc2475f8deda4598a7b0273059a49b4f P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:37.110289  1923 raft_consensus.cc:2468] T fc2475f8deda4598a7b0273059a49b4f P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efd77f14978b4b49880b1a39abc66987 in term 0.
I20260709 13:14:37.111119  2125 raft_consensus.cc:3060] T fc2475f8deda4598a7b0273059a49b4f P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:37.110446  2139 ts_tablet_manager.cc:1403] T 0d114296a5964005a874e6e09d94538b P efd77f14978b4b49880b1a39abc66987: Time spent bootstrapping tablet: real 0.027s	user 0.008s	sys 0.004s
I20260709 13:14:37.112388  2138 ts_tablet_manager.cc:1434] T fdadc5e784044a589388e57980a8e0dc P 4cfc2f643a0a46888b750e0ab7b7fde6: Time spent starting tablet: real 0.036s	user 0.004s	sys 0.003s
I20260709 13:14:37.114023  2138 tablet_bootstrap.cc:492] T 8dc82a3179da4d49b0000f0755cb7577 P 4cfc2f643a0a46888b750e0ab7b7fde6: Bootstrap starting.
I20260709 13:14:37.114486  2139 raft_consensus.cc:359] T 0d114296a5964005a874e6e09d94538b P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:37.112884  2152 raft_consensus.cc:2804] T 086f00b382884297b8409ffe816158fc P cfdfd9c3b64347f997e5d181c39fddcd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:37.115250  2139 raft_consensus.cc:385] T 0d114296a5964005a874e6e09d94538b P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:37.115576  2139 raft_consensus.cc:740] T 0d114296a5964005a874e6e09d94538b P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efd77f14978b4b49880b1a39abc66987, State: Initialized, Role: FOLLOWER
I20260709 13:14:37.116178  2152 raft_consensus.cc:697] T 086f00b382884297b8409ffe816158fc P cfdfd9c3b64347f997e5d181c39fddcd [term 1 LEADER]: Becoming Leader. State: Replica: cfdfd9c3b64347f997e5d181c39fddcd, State: Running, Role: LEADER
I20260709 13:14:37.116358  2139 consensus_queue.cc:260] T 0d114296a5964005a874e6e09d94538b P efd77f14978b4b49880b1a39abc66987 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:37.117177  2152 consensus_queue.cc:237] T 086f00b382884297b8409ffe816158fc P cfdfd9c3b64347f997e5d181c39fddcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:37.118935  2125 raft_consensus.cc:515] T fc2475f8deda4598a7b0273059a49b4f P efd77f14978b4b49880b1a39abc66987 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:37.119496  1923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6476c353b8b04452a9edbbff28e6c212" candidate_uuid: "efd77f14978b4b49880b1a39abc66987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfdfd9c3b64347f997e5d181c39fddcd"
I20260709 13:14:37.120138  1923 raft_consensus.cc:3060] T 6476c353b8b04452a9edbbff28e6c212 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:37.121100  2125 leader_election.cc:290] T fc2475f8deda4598a7b0273059a49b4f P efd77f14978b4b49880b1a39abc66987 [CANDIDATE]: Term 1 election: Requested vote from peers cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66:43351), 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67:33709)
I20260709 13:14:37.121680  2140 tablet_bootstrap.cc:492] T c152640dda8d4cce94303c088f3e4314 P cfdfd9c3b64347f997e5d181c39fddcd: No bootstrap required, opened a new log
I20260709 13:14:37.122208  2140 ts_tablet_manager.cc:1403] T c152640dda8d4cce94303c088f3e4314 P cfdfd9c3b64347f997e5d181c39fddcd: Time spent bootstrapping tablet: real 0.055s	user 0.021s	sys 0.005s
I20260709 13:14:37.123555  1846 raft_consensus.cc:2468] T 086f00b382884297b8409ffe816158fc P efd77f14978b4b49880b1a39abc66987 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfdfd9c3b64347f997e5d181c39fddcd in term 1.
I20260709 13:14:37.124658  1921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2475f8deda4598a7b0273059a49b4f" candidate_uuid: "efd77f14978b4b49880b1a39abc66987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfdfd9c3b64347f997e5d181c39fddcd"
I20260709 13:14:37.125350  1921 raft_consensus.cc:3060] T fc2475f8deda4598a7b0273059a49b4f P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:37.127190  1997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2475f8deda4598a7b0273059a49b4f" candidate_uuid: "efd77f14978b4b49880b1a39abc66987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6"
I20260709 13:14:37.127883  1997 raft_consensus.cc:3060] T fc2475f8deda4598a7b0273059a49b4f P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:37.129949  2133 leader_election.cc:290] T 6476c353b8b04452a9edbbff28e6c212 P efd77f14978b4b49880b1a39abc66987 [CANDIDATE]: Term 1 election: Requested vote from peers cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66:43351), 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67:33709)
I20260709 13:14:37.130236  1996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6476c353b8b04452a9edbbff28e6c212" candidate_uuid: "efd77f14978b4b49880b1a39abc66987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6"
I20260709 13:14:37.130954  1996 raft_consensus.cc:3060] T 6476c353b8b04452a9edbbff28e6c212 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:37.133615  1921 raft_consensus.cc:2468] T fc2475f8deda4598a7b0273059a49b4f P cfdfd9c3b64347f997e5d181c39fddcd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efd77f14978b4b49880b1a39abc66987 in term 1.
I20260709 13:14:37.125092  2140 raft_consensus.cc:359] T c152640dda8d4cce94303c088f3e4314 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:37.134946  2140 raft_consensus.cc:385] T c152640dda8d4cce94303c088f3e4314 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:37.135242  2140 raft_consensus.cc:740] T c152640dda8d4cce94303c088f3e4314 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfdfd9c3b64347f997e5d181c39fddcd, State: Initialized, Role: FOLLOWER
I20260709 13:14:37.135479  1814 leader_election.cc:304] T fc2475f8deda4598a7b0273059a49b4f P efd77f14978b4b49880b1a39abc66987 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cfdfd9c3b64347f997e5d181c39fddcd, efd77f14978b4b49880b1a39abc66987; no voters: 
I20260709 13:14:37.136188  2138 tablet_bootstrap.cc:654] T 8dc82a3179da4d49b0000f0755cb7577 P 4cfc2f643a0a46888b750e0ab7b7fde6: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:37.136054  2140 consensus_queue.cc:260] T c152640dda8d4cce94303c088f3e4314 P cfdfd9c3b64347f997e5d181c39fddcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:37.138590  2140 ts_tablet_manager.cc:1434] T c152640dda8d4cce94303c088f3e4314 P cfdfd9c3b64347f997e5d181c39fddcd: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.002s
I20260709 13:14:37.138478  1745 catalog_manager.cc:5697] T 086f00b382884297b8409ffe816158fc P cfdfd9c3b64347f997e5d181c39fddcd reported cstate change: term changed from 0 to 1, leader changed from <none> to cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66). New cstate: current_term: 1 leader_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:37.139549  2140 tablet_bootstrap.cc:492] T 0d114296a5964005a874e6e09d94538b P cfdfd9c3b64347f997e5d181c39fddcd: Bootstrap starting.
I20260709 13:14:37.140050  2166 raft_consensus.cc:2804] T fc2475f8deda4598a7b0273059a49b4f P efd77f14978b4b49880b1a39abc66987 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:37.140586  2166 raft_consensus.cc:697] T fc2475f8deda4598a7b0273059a49b4f P efd77f14978b4b49880b1a39abc66987 [term 1 LEADER]: Becoming Leader. State: Replica: efd77f14978b4b49880b1a39abc66987, State: Running, Role: LEADER
I20260709 13:14:37.141386  2166 consensus_queue.cc:237] T fc2475f8deda4598a7b0273059a49b4f P efd77f14978b4b49880b1a39abc66987 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:37.142701  1923 raft_consensus.cc:2468] T 6476c353b8b04452a9edbbff28e6c212 P cfdfd9c3b64347f997e5d181c39fddcd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efd77f14978b4b49880b1a39abc66987 in term 1.
I20260709 13:14:37.146170  2140 tablet_bootstrap.cc:654] T 0d114296a5964005a874e6e09d94538b P cfdfd9c3b64347f997e5d181c39fddcd: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:37.146490  1814 leader_election.cc:304] T 6476c353b8b04452a9edbbff28e6c212 P efd77f14978b4b49880b1a39abc66987 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cfdfd9c3b64347f997e5d181c39fddcd, efd77f14978b4b49880b1a39abc66987; no voters: 
I20260709 13:14:37.140112  1996 raft_consensus.cc:2468] T 6476c353b8b04452a9edbbff28e6c212 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efd77f14978b4b49880b1a39abc66987 in term 1.
I20260709 13:14:37.150033  2133 raft_consensus.cc:2804] T 6476c353b8b04452a9edbbff28e6c212 P efd77f14978b4b49880b1a39abc66987 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:37.150616  2133 raft_consensus.cc:697] T 6476c353b8b04452a9edbbff28e6c212 P efd77f14978b4b49880b1a39abc66987 [term 1 LEADER]: Becoming Leader. State: Replica: efd77f14978b4b49880b1a39abc66987, State: Running, Role: LEADER
I20260709 13:14:37.151477  2133 consensus_queue.cc:237] T 6476c353b8b04452a9edbbff28e6c212 P efd77f14978b4b49880b1a39abc66987 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:37.152706  2139 ts_tablet_manager.cc:1434] T 0d114296a5964005a874e6e09d94538b P efd77f14978b4b49880b1a39abc66987: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.002s
I20260709 13:14:37.155208  2139 tablet_bootstrap.cc:492] T bd3d2c56c68f4dde862e62fa03ea3390 P efd77f14978b4b49880b1a39abc66987: Bootstrap starting.
I20260709 13:14:37.159029  1997 raft_consensus.cc:2468] T fc2475f8deda4598a7b0273059a49b4f P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efd77f14978b4b49880b1a39abc66987 in term 1.
I20260709 13:14:37.160830  2125 raft_consensus.cc:493] T fdadc5e784044a589388e57980a8e0dc P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.161540  2125 raft_consensus.cc:515] T fdadc5e784044a589388e57980a8e0dc P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:37.164294  2125 leader_election.cc:290] T fdadc5e784044a589388e57980a8e0dc P efd77f14978b4b49880b1a39abc66987 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66:43351), 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67:33709)
I20260709 13:14:37.164839  2139 tablet_bootstrap.cc:654] T bd3d2c56c68f4dde862e62fa03ea3390 P efd77f14978b4b49880b1a39abc66987: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:37.165618  1997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdadc5e784044a589388e57980a8e0dc" candidate_uuid: "efd77f14978b4b49880b1a39abc66987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" is_pre_election: true
I20260709 13:14:37.169495  1997 raft_consensus.cc:2468] T fdadc5e784044a589388e57980a8e0dc P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efd77f14978b4b49880b1a39abc66987 in term 0.
I20260709 13:14:37.168555  2138 tablet_bootstrap.cc:492] T 8dc82a3179da4d49b0000f0755cb7577 P 4cfc2f643a0a46888b750e0ab7b7fde6: No bootstrap required, opened a new log
I20260709 13:14:37.172039  1923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdadc5e784044a589388e57980a8e0dc" candidate_uuid: "efd77f14978b4b49880b1a39abc66987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" is_pre_election: true
I20260709 13:14:37.172350  2138 ts_tablet_manager.cc:1403] T 8dc82a3179da4d49b0000f0755cb7577 P 4cfc2f643a0a46888b750e0ab7b7fde6: Time spent bootstrapping tablet: real 0.059s	user 0.009s	sys 0.011s
I20260709 13:14:37.172781  1923 raft_consensus.cc:2468] T fdadc5e784044a589388e57980a8e0dc P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efd77f14978b4b49880b1a39abc66987 in term 0.
I20260709 13:14:37.174383  1814 leader_election.cc:304] T fdadc5e784044a589388e57980a8e0dc P efd77f14978b4b49880b1a39abc66987 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cfdfd9c3b64347f997e5d181c39fddcd, efd77f14978b4b49880b1a39abc66987; no voters: 
I20260709 13:14:37.175305  2170 raft_consensus.cc:2804] T fdadc5e784044a589388e57980a8e0dc P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:37.174763  1743 catalog_manager.cc:5697] T fc2475f8deda4598a7b0273059a49b4f P efd77f14978b4b49880b1a39abc66987 reported cstate change: term changed from 0 to 1, leader changed from <none> to efd77f14978b4b49880b1a39abc66987 (127.23.140.65). New cstate: current_term: 1 leader_uuid: "efd77f14978b4b49880b1a39abc66987" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:37.175666  2170 raft_consensus.cc:493] T fdadc5e784044a589388e57980a8e0dc P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:37.176379  2170 raft_consensus.cc:3060] T fdadc5e784044a589388e57980a8e0dc P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:37.175642  2138 raft_consensus.cc:359] T 8dc82a3179da4d49b0000f0755cb7577 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:37.176992  2138 raft_consensus.cc:385] T 8dc82a3179da4d49b0000f0755cb7577 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:37.177332  2138 raft_consensus.cc:740] T 8dc82a3179da4d49b0000f0755cb7577 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cfc2f643a0a46888b750e0ab7b7fde6, State: Initialized, Role: FOLLOWER
I20260709 13:14:37.178285  2138 consensus_queue.cc:260] T 8dc82a3179da4d49b0000f0755cb7577 P 4cfc2f643a0a46888b750e0ab7b7fde6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:37.181465  2138 ts_tablet_manager.cc:1434] T 8dc82a3179da4d49b0000f0755cb7577 P 4cfc2f643a0a46888b750e0ab7b7fde6: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:14:37.182869  2138 tablet_bootstrap.cc:492] T c152640dda8d4cce94303c088f3e4314 P 4cfc2f643a0a46888b750e0ab7b7fde6: Bootstrap starting.
I20260709 13:14:37.184568  2170 raft_consensus.cc:515] T fdadc5e784044a589388e57980a8e0dc P efd77f14978b4b49880b1a39abc66987 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:37.187888  2170 leader_election.cc:290] T fdadc5e784044a589388e57980a8e0dc P efd77f14978b4b49880b1a39abc66987 [CANDIDATE]: Term 1 election: Requested vote from peers cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66:43351), 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67:33709)
I20260709 13:14:37.189385  1923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdadc5e784044a589388e57980a8e0dc" candidate_uuid: "efd77f14978b4b49880b1a39abc66987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfdfd9c3b64347f997e5d181c39fddcd"
I20260709 13:14:37.190398  1923 raft_consensus.cc:3060] T fdadc5e784044a589388e57980a8e0dc P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:37.191171  2138 tablet_bootstrap.cc:654] T c152640dda8d4cce94303c088f3e4314 P 4cfc2f643a0a46888b750e0ab7b7fde6: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:37.193450  1996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdadc5e784044a589388e57980a8e0dc" candidate_uuid: "efd77f14978b4b49880b1a39abc66987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6"
I20260709 13:14:37.202286  1996 raft_consensus.cc:3060] T fdadc5e784044a589388e57980a8e0dc P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:37.202445  2140 tablet_bootstrap.cc:492] T 0d114296a5964005a874e6e09d94538b P cfdfd9c3b64347f997e5d181c39fddcd: No bootstrap required, opened a new log
I20260709 13:14:37.203050  2140 ts_tablet_manager.cc:1403] T 0d114296a5964005a874e6e09d94538b P cfdfd9c3b64347f997e5d181c39fddcd: Time spent bootstrapping tablet: real 0.064s	user 0.009s	sys 0.008s
I20260709 13:14:37.205875  2140 raft_consensus.cc:359] T 0d114296a5964005a874e6e09d94538b P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:37.206569  2140 raft_consensus.cc:385] T 0d114296a5964005a874e6e09d94538b P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:37.206883  2140 raft_consensus.cc:740] T 0d114296a5964005a874e6e09d94538b P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfdfd9c3b64347f997e5d181c39fddcd, State: Initialized, Role: FOLLOWER
I20260709 13:14:37.209090  2140 consensus_queue.cc:260] T 0d114296a5964005a874e6e09d94538b P cfdfd9c3b64347f997e5d181c39fddcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:37.214031  2140 ts_tablet_manager.cc:1434] T 0d114296a5964005a874e6e09d94538b P cfdfd9c3b64347f997e5d181c39fddcd: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 13:14:37.217196  1742 catalog_manager.cc:5697] T 6476c353b8b04452a9edbbff28e6c212 P efd77f14978b4b49880b1a39abc66987 reported cstate change: term changed from 0 to 1, leader changed from <none> to efd77f14978b4b49880b1a39abc66987 (127.23.140.65). New cstate: current_term: 1 leader_uuid: "efd77f14978b4b49880b1a39abc66987" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:37.219142  1923 raft_consensus.cc:2468] T fdadc5e784044a589388e57980a8e0dc P cfdfd9c3b64347f997e5d181c39fddcd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efd77f14978b4b49880b1a39abc66987 in term 1.
I20260709 13:14:37.222163  1814 leader_election.cc:304] T fdadc5e784044a589388e57980a8e0dc P efd77f14978b4b49880b1a39abc66987 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cfdfd9c3b64347f997e5d181c39fddcd, efd77f14978b4b49880b1a39abc66987; no voters: 
I20260709 13:14:37.224435  2170 raft_consensus.cc:2804] T fdadc5e784044a589388e57980a8e0dc P efd77f14978b4b49880b1a39abc66987 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:37.225109  2170 raft_consensus.cc:697] T fdadc5e784044a589388e57980a8e0dc P efd77f14978b4b49880b1a39abc66987 [term 1 LEADER]: Becoming Leader. State: Replica: efd77f14978b4b49880b1a39abc66987, State: Running, Role: LEADER
I20260709 13:14:37.226362  2139 tablet_bootstrap.cc:492] T bd3d2c56c68f4dde862e62fa03ea3390 P efd77f14978b4b49880b1a39abc66987: No bootstrap required, opened a new log
I20260709 13:14:37.226915  2139 ts_tablet_manager.cc:1403] T bd3d2c56c68f4dde862e62fa03ea3390 P efd77f14978b4b49880b1a39abc66987: Time spent bootstrapping tablet: real 0.072s	user 0.010s	sys 0.013s
I20260709 13:14:37.226471  2170 consensus_queue.cc:237] T fdadc5e784044a589388e57980a8e0dc P efd77f14978b4b49880b1a39abc66987 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:37.229871  2139 raft_consensus.cc:359] T bd3d2c56c68f4dde862e62fa03ea3390 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:37.230544  2139 raft_consensus.cc:385] T bd3d2c56c68f4dde862e62fa03ea3390 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:37.230810  2139 raft_consensus.cc:740] T bd3d2c56c68f4dde862e62fa03ea3390 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efd77f14978b4b49880b1a39abc66987, State: Initialized, Role: FOLLOWER
I20260709 13:14:37.231528  2139 consensus_queue.cc:260] T bd3d2c56c68f4dde862e62fa03ea3390 P efd77f14978b4b49880b1a39abc66987 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:37.234052  2139 ts_tablet_manager.cc:1434] T bd3d2c56c68f4dde862e62fa03ea3390 P efd77f14978b4b49880b1a39abc66987: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:14:37.234910  1996 raft_consensus.cc:2468] T fdadc5e784044a589388e57980a8e0dc P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efd77f14978b4b49880b1a39abc66987 in term 1.
I20260709 13:14:37.239073  2138 tablet_bootstrap.cc:492] T c152640dda8d4cce94303c088f3e4314 P 4cfc2f643a0a46888b750e0ab7b7fde6: No bootstrap required, opened a new log
I20260709 13:14:37.239663  2138 ts_tablet_manager.cc:1403] T c152640dda8d4cce94303c088f3e4314 P 4cfc2f643a0a46888b750e0ab7b7fde6: Time spent bootstrapping tablet: real 0.057s	user 0.024s	sys 0.025s
I20260709 13:14:37.241905  1745 catalog_manager.cc:5697] T fdadc5e784044a589388e57980a8e0dc P efd77f14978b4b49880b1a39abc66987 reported cstate change: term changed from 0 to 1, leader changed from <none> to efd77f14978b4b49880b1a39abc66987 (127.23.140.65). New cstate: current_term: 1 leader_uuid: "efd77f14978b4b49880b1a39abc66987" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:37.242542  2138 raft_consensus.cc:359] T c152640dda8d4cce94303c088f3e4314 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:37.243182  2138 raft_consensus.cc:385] T c152640dda8d4cce94303c088f3e4314 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:37.243422  2138 raft_consensus.cc:740] T c152640dda8d4cce94303c088f3e4314 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cfc2f643a0a46888b750e0ab7b7fde6, State: Initialized, Role: FOLLOWER
I20260709 13:14:37.244077  2138 consensus_queue.cc:260] T c152640dda8d4cce94303c088f3e4314 P 4cfc2f643a0a46888b750e0ab7b7fde6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:37.246047  2138 ts_tablet_manager.cc:1434] T c152640dda8d4cce94303c088f3e4314 P 4cfc2f643a0a46888b750e0ab7b7fde6: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.002s
I20260709 13:14:37.247227  2138 tablet_bootstrap.cc:492] T bd3d2c56c68f4dde862e62fa03ea3390 P 4cfc2f643a0a46888b750e0ab7b7fde6: Bootstrap starting.
I20260709 13:14:37.253674  2138 tablet_bootstrap.cc:654] T bd3d2c56c68f4dde862e62fa03ea3390 P 4cfc2f643a0a46888b750e0ab7b7fde6: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:37.258965  2138 tablet_bootstrap.cc:492] T bd3d2c56c68f4dde862e62fa03ea3390 P 4cfc2f643a0a46888b750e0ab7b7fde6: No bootstrap required, opened a new log
I20260709 13:14:37.259310  2138 ts_tablet_manager.cc:1403] T bd3d2c56c68f4dde862e62fa03ea3390 P 4cfc2f643a0a46888b750e0ab7b7fde6: Time spent bootstrapping tablet: real 0.012s	user 0.008s	sys 0.003s
I20260709 13:14:37.261368  2138 raft_consensus.cc:359] T bd3d2c56c68f4dde862e62fa03ea3390 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:37.261870  2138 raft_consensus.cc:385] T bd3d2c56c68f4dde862e62fa03ea3390 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:37.262053  2138 raft_consensus.cc:740] T bd3d2c56c68f4dde862e62fa03ea3390 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cfc2f643a0a46888b750e0ab7b7fde6, State: Initialized, Role: FOLLOWER
I20260709 13:14:37.262521  2138 consensus_queue.cc:260] T bd3d2c56c68f4dde862e62fa03ea3390 P 4cfc2f643a0a46888b750e0ab7b7fde6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:37.268846  2138 ts_tablet_manager.cc:1434] T bd3d2c56c68f4dde862e62fa03ea3390 P 4cfc2f643a0a46888b750e0ab7b7fde6: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 13:14:37.269620  2138 tablet_bootstrap.cc:492] T 0d114296a5964005a874e6e09d94538b P 4cfc2f643a0a46888b750e0ab7b7fde6: Bootstrap starting.
I20260709 13:14:37.274689  2138 tablet_bootstrap.cc:654] T 0d114296a5964005a874e6e09d94538b P 4cfc2f643a0a46888b750e0ab7b7fde6: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:37.277100  2152 raft_consensus.cc:493] T 8dc82a3179da4d49b0000f0755cb7577 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.277591  2152 raft_consensus.cc:515] T 8dc82a3179da4d49b0000f0755cb7577 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:37.279384  2138 tablet_bootstrap.cc:492] T 0d114296a5964005a874e6e09d94538b P 4cfc2f643a0a46888b750e0ab7b7fde6: No bootstrap required, opened a new log
I20260709 13:14:37.279634  2152 leader_election.cc:290] T 8dc82a3179da4d49b0000f0755cb7577 P cfdfd9c3b64347f997e5d181c39fddcd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efd77f14978b4b49880b1a39abc66987 (127.23.140.65:41453), 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67:33709)
I20260709 13:14:37.279935  2138 ts_tablet_manager.cc:1403] T 0d114296a5964005a874e6e09d94538b P 4cfc2f643a0a46888b750e0ab7b7fde6: Time spent bootstrapping tablet: real 0.010s	user 0.010s	sys 0.000s
I20260709 13:14:37.280279  1846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc82a3179da4d49b0000f0755cb7577" candidate_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efd77f14978b4b49880b1a39abc66987" is_pre_election: true
I20260709 13:14:37.280660  1996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc82a3179da4d49b0000f0755cb7577" candidate_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" is_pre_election: true
I20260709 13:14:37.280973  1846 raft_consensus.cc:2468] T 8dc82a3179da4d49b0000f0755cb7577 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfdfd9c3b64347f997e5d181c39fddcd in term 0.
I20260709 13:14:37.281282  1996 raft_consensus.cc:2468] T 8dc82a3179da4d49b0000f0755cb7577 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfdfd9c3b64347f997e5d181c39fddcd in term 0.
I20260709 13:14:37.282086  1887 leader_election.cc:304] T 8dc82a3179da4d49b0000f0755cb7577 P cfdfd9c3b64347f997e5d181c39fddcd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cfdfd9c3b64347f997e5d181c39fddcd, efd77f14978b4b49880b1a39abc66987; no voters: 
I20260709 13:14:37.282667  2138 raft_consensus.cc:359] T 0d114296a5964005a874e6e09d94538b P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:37.282819  2152 raft_consensus.cc:2804] T 8dc82a3179da4d49b0000f0755cb7577 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:37.283265  2138 raft_consensus.cc:385] T 0d114296a5964005a874e6e09d94538b P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:37.283403  2152 raft_consensus.cc:493] T 8dc82a3179da4d49b0000f0755cb7577 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:37.283567  2138 raft_consensus.cc:740] T 0d114296a5964005a874e6e09d94538b P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cfc2f643a0a46888b750e0ab7b7fde6, State: Initialized, Role: FOLLOWER
I20260709 13:14:37.283833  2152 raft_consensus.cc:3060] T 8dc82a3179da4d49b0000f0755cb7577 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:37.284264  2138 consensus_queue.cc:260] T 0d114296a5964005a874e6e09d94538b P 4cfc2f643a0a46888b750e0ab7b7fde6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:37.286120  2138 ts_tablet_manager.cc:1434] T 0d114296a5964005a874e6e09d94538b P 4cfc2f643a0a46888b750e0ab7b7fde6: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:14:37.290423  2152 raft_consensus.cc:515] T 8dc82a3179da4d49b0000f0755cb7577 P cfdfd9c3b64347f997e5d181c39fddcd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:37.293931  1996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc82a3179da4d49b0000f0755cb7577" candidate_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6"
I20260709 13:14:37.294199  2152 leader_election.cc:290] T 8dc82a3179da4d49b0000f0755cb7577 P cfdfd9c3b64347f997e5d181c39fddcd [CANDIDATE]: Term 1 election: Requested vote from peers efd77f14978b4b49880b1a39abc66987 (127.23.140.65:41453), 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67:33709)
I20260709 13:14:37.294100  1846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc82a3179da4d49b0000f0755cb7577" candidate_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efd77f14978b4b49880b1a39abc66987"
I20260709 13:14:37.294544  1996 raft_consensus.cc:3060] T 8dc82a3179da4d49b0000f0755cb7577 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:37.294874  1846 raft_consensus.cc:3060] T 8dc82a3179da4d49b0000f0755cb7577 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:37.302207  1846 raft_consensus.cc:2468] T 8dc82a3179da4d49b0000f0755cb7577 P efd77f14978b4b49880b1a39abc66987 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfdfd9c3b64347f997e5d181c39fddcd in term 1.
I20260709 13:14:37.301811  1996 raft_consensus.cc:2468] T 8dc82a3179da4d49b0000f0755cb7577 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfdfd9c3b64347f997e5d181c39fddcd in term 1.
I20260709 13:14:37.303375  1886 leader_election.cc:304] T 8dc82a3179da4d49b0000f0755cb7577 P cfdfd9c3b64347f997e5d181c39fddcd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cfc2f643a0a46888b750e0ab7b7fde6, cfdfd9c3b64347f997e5d181c39fddcd; no voters: 
I20260709 13:14:37.304060  2152 raft_consensus.cc:2804] T 8dc82a3179da4d49b0000f0755cb7577 P cfdfd9c3b64347f997e5d181c39fddcd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:37.304561  2152 raft_consensus.cc:697] T 8dc82a3179da4d49b0000f0755cb7577 P cfdfd9c3b64347f997e5d181c39fddcd [term 1 LEADER]: Becoming Leader. State: Replica: cfdfd9c3b64347f997e5d181c39fddcd, State: Running, Role: LEADER
I20260709 13:14:37.305270  2152 consensus_queue.cc:237] T 8dc82a3179da4d49b0000f0755cb7577 P cfdfd9c3b64347f997e5d181c39fddcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:37.312222  1745 catalog_manager.cc:5697] T 8dc82a3179da4d49b0000f0755cb7577 P cfdfd9c3b64347f997e5d181c39fddcd reported cstate change: term changed from 0 to 1, leader changed from <none> to cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66). New cstate: current_term: 1 leader_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:37.346798  2178 raft_consensus.cc:493] T 7efaa7b0e2a6420282d24eed82603436 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.347417  2178 raft_consensus.cc:515] T 7efaa7b0e2a6420282d24eed82603436 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:37.349334  2178 leader_election.cc:290] T 7efaa7b0e2a6420282d24eed82603436 P 4cfc2f643a0a46888b750e0ab7b7fde6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efd77f14978b4b49880b1a39abc66987 (127.23.140.65:41453), cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66:43351)
I20260709 13:14:37.350390  1923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7efaa7b0e2a6420282d24eed82603436" candidate_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" is_pre_election: true
I20260709 13:14:37.350390  1846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7efaa7b0e2a6420282d24eed82603436" candidate_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efd77f14978b4b49880b1a39abc66987" is_pre_election: true
I20260709 13:14:37.351585  1846 raft_consensus.cc:2393] T 7efaa7b0e2a6420282d24eed82603436 P efd77f14978b4b49880b1a39abc66987 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cfc2f643a0a46888b750e0ab7b7fde6 in current term 1: Already voted for candidate cfdfd9c3b64347f997e5d181c39fddcd in this term.
I20260709 13:14:37.352818  1961 leader_election.cc:304] T 7efaa7b0e2a6420282d24eed82603436 P 4cfc2f643a0a46888b750e0ab7b7fde6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cfc2f643a0a46888b750e0ab7b7fde6; no voters: cfdfd9c3b64347f997e5d181c39fddcd, efd77f14978b4b49880b1a39abc66987
I20260709 13:14:37.353559  2178 raft_consensus.cc:3060] T 7efaa7b0e2a6420282d24eed82603436 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:37.359669  2178 raft_consensus.cc:2749] T 7efaa7b0e2a6420282d24eed82603436 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:37.368893  2170 raft_consensus.cc:493] T bd3d2c56c68f4dde862e62fa03ea3390 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.369441  2170 raft_consensus.cc:515] T bd3d2c56c68f4dde862e62fa03ea3390 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:37.371392  2170 leader_election.cc:290] T bd3d2c56c68f4dde862e62fa03ea3390 P efd77f14978b4b49880b1a39abc66987 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66:43351), 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67:33709)
I20260709 13:14:37.372102  1923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3d2c56c68f4dde862e62fa03ea3390" candidate_uuid: "efd77f14978b4b49880b1a39abc66987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" is_pre_election: true
I20260709 13:14:37.372457  1997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3d2c56c68f4dde862e62fa03ea3390" candidate_uuid: "efd77f14978b4b49880b1a39abc66987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" is_pre_election: true
I20260709 13:14:37.372916  1923 raft_consensus.cc:2468] T bd3d2c56c68f4dde862e62fa03ea3390 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efd77f14978b4b49880b1a39abc66987 in term 0.
I20260709 13:14:37.373180  1997 raft_consensus.cc:2468] T bd3d2c56c68f4dde862e62fa03ea3390 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efd77f14978b4b49880b1a39abc66987 in term 0.
I20260709 13:14:37.374068  1814 leader_election.cc:304] T bd3d2c56c68f4dde862e62fa03ea3390 P efd77f14978b4b49880b1a39abc66987 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cfdfd9c3b64347f997e5d181c39fddcd, efd77f14978b4b49880b1a39abc66987; no voters: 
I20260709 13:14:37.374862  2133 raft_consensus.cc:2804] T bd3d2c56c68f4dde862e62fa03ea3390 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:37.375161  2133 raft_consensus.cc:493] T bd3d2c56c68f4dde862e62fa03ea3390 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:37.375445  2133 raft_consensus.cc:3060] T bd3d2c56c68f4dde862e62fa03ea3390 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:37.381021  2133 raft_consensus.cc:515] T bd3d2c56c68f4dde862e62fa03ea3390 P efd77f14978b4b49880b1a39abc66987 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:37.382673  2133 leader_election.cc:290] T bd3d2c56c68f4dde862e62fa03ea3390 P efd77f14978b4b49880b1a39abc66987 [CANDIDATE]: Term 1 election: Requested vote from peers cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66:43351), 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67:33709)
I20260709 13:14:37.383600  1923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3d2c56c68f4dde862e62fa03ea3390" candidate_uuid: "efd77f14978b4b49880b1a39abc66987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfdfd9c3b64347f997e5d181c39fddcd"
I20260709 13:14:37.383703  1997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3d2c56c68f4dde862e62fa03ea3390" candidate_uuid: "efd77f14978b4b49880b1a39abc66987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6"
I20260709 13:14:37.384178  1923 raft_consensus.cc:3060] T bd3d2c56c68f4dde862e62fa03ea3390 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:37.384334  1997 raft_consensus.cc:3060] T bd3d2c56c68f4dde862e62fa03ea3390 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:37.390945  1923 raft_consensus.cc:2468] T bd3d2c56c68f4dde862e62fa03ea3390 P cfdfd9c3b64347f997e5d181c39fddcd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efd77f14978b4b49880b1a39abc66987 in term 1.
I20260709 13:14:37.391300  1997 raft_consensus.cc:2468] T bd3d2c56c68f4dde862e62fa03ea3390 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efd77f14978b4b49880b1a39abc66987 in term 1.
I20260709 13:14:37.392274  1814 leader_election.cc:304] T bd3d2c56c68f4dde862e62fa03ea3390 P efd77f14978b4b49880b1a39abc66987 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cfdfd9c3b64347f997e5d181c39fddcd, efd77f14978b4b49880b1a39abc66987; no voters: 
I20260709 13:14:37.393059  2133 raft_consensus.cc:2804] T bd3d2c56c68f4dde862e62fa03ea3390 P efd77f14978b4b49880b1a39abc66987 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:37.393533  2133 raft_consensus.cc:697] T bd3d2c56c68f4dde862e62fa03ea3390 P efd77f14978b4b49880b1a39abc66987 [term 1 LEADER]: Becoming Leader. State: Replica: efd77f14978b4b49880b1a39abc66987, State: Running, Role: LEADER
I20260709 13:14:37.394301  2133 consensus_queue.cc:237] T bd3d2c56c68f4dde862e62fa03ea3390 P efd77f14978b4b49880b1a39abc66987 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:37.401214  1745 catalog_manager.cc:5697] T bd3d2c56c68f4dde862e62fa03ea3390 P efd77f14978b4b49880b1a39abc66987 reported cstate change: term changed from 0 to 1, leader changed from <none> to efd77f14978b4b49880b1a39abc66987 (127.23.140.65). New cstate: current_term: 1 leader_uuid: "efd77f14978b4b49880b1a39abc66987" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:37.426119  2178 raft_consensus.cc:493] T 0d114296a5964005a874e6e09d94538b P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.426736  2178 raft_consensus.cc:515] T 0d114296a5964005a874e6e09d94538b P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:37.428345  2178 leader_election.cc:290] T 0d114296a5964005a874e6e09d94538b P 4cfc2f643a0a46888b750e0ab7b7fde6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efd77f14978b4b49880b1a39abc66987 (127.23.140.65:41453), cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66:43351)
I20260709 13:14:37.429025  1846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d114296a5964005a874e6e09d94538b" candidate_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efd77f14978b4b49880b1a39abc66987" is_pre_election: true
I20260709 13:14:37.429267  1923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d114296a5964005a874e6e09d94538b" candidate_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" is_pre_election: true
I20260709 13:14:37.429622  1846 raft_consensus.cc:2468] T 0d114296a5964005a874e6e09d94538b P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cfc2f643a0a46888b750e0ab7b7fde6 in term 0.
I20260709 13:14:37.429937  1923 raft_consensus.cc:2468] T 0d114296a5964005a874e6e09d94538b P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cfc2f643a0a46888b750e0ab7b7fde6 in term 0.
I20260709 13:14:37.430712  1961 leader_election.cc:304] T 0d114296a5964005a874e6e09d94538b P 4cfc2f643a0a46888b750e0ab7b7fde6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cfc2f643a0a46888b750e0ab7b7fde6, efd77f14978b4b49880b1a39abc66987; no voters: 
I20260709 13:14:37.431418  2178 raft_consensus.cc:2804] T 0d114296a5964005a874e6e09d94538b P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:37.431784  2178 raft_consensus.cc:493] T 0d114296a5964005a874e6e09d94538b P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:37.432065  2178 raft_consensus.cc:3060] T 0d114296a5964005a874e6e09d94538b P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:37.436764  2178 raft_consensus.cc:515] T 0d114296a5964005a874e6e09d94538b P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:37.438335  2178 leader_election.cc:290] T 0d114296a5964005a874e6e09d94538b P 4cfc2f643a0a46888b750e0ab7b7fde6 [CANDIDATE]: Term 1 election: Requested vote from peers efd77f14978b4b49880b1a39abc66987 (127.23.140.65:41453), cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66:43351)
I20260709 13:14:37.439134  1846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d114296a5964005a874e6e09d94538b" candidate_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efd77f14978b4b49880b1a39abc66987"
I20260709 13:14:37.439280  1923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d114296a5964005a874e6e09d94538b" candidate_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfdfd9c3b64347f997e5d181c39fddcd"
I20260709 13:14:37.439824  1846 raft_consensus.cc:3060] T 0d114296a5964005a874e6e09d94538b P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:37.439844  1923 raft_consensus.cc:3060] T 0d114296a5964005a874e6e09d94538b P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:37.446249  1923 raft_consensus.cc:2468] T 0d114296a5964005a874e6e09d94538b P cfdfd9c3b64347f997e5d181c39fddcd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cfc2f643a0a46888b750e0ab7b7fde6 in term 1.
I20260709 13:14:37.446254  1846 raft_consensus.cc:2468] T 0d114296a5964005a874e6e09d94538b P efd77f14978b4b49880b1a39abc66987 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cfc2f643a0a46888b750e0ab7b7fde6 in term 1.
I20260709 13:14:37.447486  1963 leader_election.cc:304] T 0d114296a5964005a874e6e09d94538b P 4cfc2f643a0a46888b750e0ab7b7fde6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cfc2f643a0a46888b750e0ab7b7fde6, cfdfd9c3b64347f997e5d181c39fddcd; no voters: 
I20260709 13:14:37.448243  2178 raft_consensus.cc:2804] T 0d114296a5964005a874e6e09d94538b P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:37.448691  2178 raft_consensus.cc:697] T 0d114296a5964005a874e6e09d94538b P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 1 LEADER]: Becoming Leader. State: Replica: 4cfc2f643a0a46888b750e0ab7b7fde6, State: Running, Role: LEADER
I20260709 13:14:37.449487  2178 consensus_queue.cc:237] T 0d114296a5964005a874e6e09d94538b P 4cfc2f643a0a46888b750e0ab7b7fde6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:37.456666  1745 catalog_manager.cc:5697] T 0d114296a5964005a874e6e09d94538b P 4cfc2f643a0a46888b750e0ab7b7fde6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67). New cstate: current_term: 1 leader_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:37.517776  2152 consensus_queue.cc:1048] T 086f00b382884297b8409ffe816158fc P cfdfd9c3b64347f997e5d181c39fddcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:37.527923  2154 consensus_queue.cc:1048] T 7efaa7b0e2a6420282d24eed82603436 P cfdfd9c3b64347f997e5d181c39fddcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:37.531404  2154 consensus_queue.cc:1048] T 086f00b382884297b8409ffe816158fc P cfdfd9c3b64347f997e5d181c39fddcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:37.545513  2062 consensus_queue.cc:1048] T 7efaa7b0e2a6420282d24eed82603436 P cfdfd9c3b64347f997e5d181c39fddcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:37.549283  2133 consensus_queue.cc:1048] T 6476c353b8b04452a9edbbff28e6c212 P efd77f14978b4b49880b1a39abc66987 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:37.549366  2166 consensus_queue.cc:1048] T fc2475f8deda4598a7b0273059a49b4f P efd77f14978b4b49880b1a39abc66987 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:37.549636  2062 raft_consensus.cc:493] T c152640dda8d4cce94303c088f3e4314 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.550527  2062 raft_consensus.cc:515] T c152640dda8d4cce94303c088f3e4314 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:37.554589  1847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c152640dda8d4cce94303c088f3e4314" candidate_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efd77f14978b4b49880b1a39abc66987" is_pre_election: true
I20260709 13:14:37.555485  1847 raft_consensus.cc:2468] T c152640dda8d4cce94303c088f3e4314 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfdfd9c3b64347f997e5d181c39fddcd in term 0.
I20260709 13:14:37.557292  1887 leader_election.cc:304] T c152640dda8d4cce94303c088f3e4314 P cfdfd9c3b64347f997e5d181c39fddcd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cfdfd9c3b64347f997e5d181c39fddcd, efd77f14978b4b49880b1a39abc66987; no voters: 
I20260709 13:14:37.558687  2154 raft_consensus.cc:2804] T c152640dda8d4cce94303c088f3e4314 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:37.559243  2154 raft_consensus.cc:493] T c152640dda8d4cce94303c088f3e4314 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:37.561024  2154 raft_consensus.cc:3060] T c152640dda8d4cce94303c088f3e4314 P cfdfd9c3b64347f997e5d181c39fddcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:37.562209  1996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c152640dda8d4cce94303c088f3e4314" candidate_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" is_pre_election: true
I20260709 13:14:37.567194  1996 raft_consensus.cc:2468] T c152640dda8d4cce94303c088f3e4314 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfdfd9c3b64347f997e5d181c39fddcd in term 0.
I20260709 13:14:37.560345  2062 leader_election.cc:290] T c152640dda8d4cce94303c088f3e4314 P cfdfd9c3b64347f997e5d181c39fddcd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efd77f14978b4b49880b1a39abc66987 (127.23.140.65:41453), 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67:33709)
I20260709 13:14:37.580470  2166 consensus_queue.cc:1048] T fc2475f8deda4598a7b0273059a49b4f P efd77f14978b4b49880b1a39abc66987 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:37.588128  2133 consensus_queue.cc:1048] T 6476c353b8b04452a9edbbff28e6c212 P efd77f14978b4b49880b1a39abc66987 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:37.591635  2154 raft_consensus.cc:515] T c152640dda8d4cce94303c088f3e4314 P cfdfd9c3b64347f997e5d181c39fddcd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:37.594854  1848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c152640dda8d4cce94303c088f3e4314" candidate_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efd77f14978b4b49880b1a39abc66987"
I20260709 13:14:37.595467  1848 raft_consensus.cc:3060] T c152640dda8d4cce94303c088f3e4314 P efd77f14978b4b49880b1a39abc66987 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:37.604525  1848 raft_consensus.cc:2468] T c152640dda8d4cce94303c088f3e4314 P efd77f14978b4b49880b1a39abc66987 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfdfd9c3b64347f997e5d181c39fddcd in term 1.
I20260709 13:14:37.605624  1997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c152640dda8d4cce94303c088f3e4314" candidate_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6"
I20260709 13:14:37.605926  1887 leader_election.cc:304] T c152640dda8d4cce94303c088f3e4314 P cfdfd9c3b64347f997e5d181c39fddcd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cfdfd9c3b64347f997e5d181c39fddcd, efd77f14978b4b49880b1a39abc66987; no voters: 
I20260709 13:14:37.606381  1997 raft_consensus.cc:3060] T c152640dda8d4cce94303c088f3e4314 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:37.606835  2062 raft_consensus.cc:2804] T c152640dda8d4cce94303c088f3e4314 P cfdfd9c3b64347f997e5d181c39fddcd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:37.607313  2062 raft_consensus.cc:697] T c152640dda8d4cce94303c088f3e4314 P cfdfd9c3b64347f997e5d181c39fddcd [term 1 LEADER]: Becoming Leader. State: Replica: cfdfd9c3b64347f997e5d181c39fddcd, State: Running, Role: LEADER
I20260709 13:14:37.604352  2154 leader_election.cc:290] T c152640dda8d4cce94303c088f3e4314 P cfdfd9c3b64347f997e5d181c39fddcd [CANDIDATE]: Term 1 election: Requested vote from peers efd77f14978b4b49880b1a39abc66987 (127.23.140.65:41453), 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67:33709)
I20260709 13:14:37.609964  2062 consensus_queue.cc:237] T c152640dda8d4cce94303c088f3e4314 P cfdfd9c3b64347f997e5d181c39fddcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:37.613929  1997 raft_consensus.cc:2468] T c152640dda8d4cce94303c088f3e4314 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfdfd9c3b64347f997e5d181c39fddcd in term 1.
I20260709 13:14:37.619715  1742 catalog_manager.cc:5697] T c152640dda8d4cce94303c088f3e4314 P cfdfd9c3b64347f997e5d181c39fddcd reported cstate change: term changed from 0 to 1, leader changed from <none> to cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66). New cstate: current_term: 1 leader_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:37.676720  2133 consensus_queue.cc:1048] T fdadc5e784044a589388e57980a8e0dc P efd77f14978b4b49880b1a39abc66987 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:37.687808  1923 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "086f00b382884297b8409ffe816158fc"
dest_uuid: "cfdfd9c3b64347f997e5d181c39fddcd"
mode: GRACEFUL
new_leader_uuid: "efd77f14978b4b49880b1a39abc66987"
 from {username='slave'} at 127.0.0.1:35672
I20260709 13:14:37.688541  1923 raft_consensus.cc:606] T 086f00b382884297b8409ffe816158fc P cfdfd9c3b64347f997e5d181c39fddcd [term 1 LEADER]: Received request to transfer leadership to TS efd77f14978b4b49880b1a39abc66987
I20260709 13:14:37.687254  2133 consensus_queue.cc:1048] T fdadc5e784044a589388e57980a8e0dc P efd77f14978b4b49880b1a39abc66987 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:37.695207  1921 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7efaa7b0e2a6420282d24eed82603436"
dest_uuid: "cfdfd9c3b64347f997e5d181c39fddcd"
mode: GRACEFUL
new_leader_uuid: "efd77f14978b4b49880b1a39abc66987"
 from {username='slave'} at 127.0.0.1:35672
I20260709 13:14:37.695799  1921 raft_consensus.cc:606] T 7efaa7b0e2a6420282d24eed82603436 P cfdfd9c3b64347f997e5d181c39fddcd [term 1 LEADER]: Received request to transfer leadership to TS efd77f14978b4b49880b1a39abc66987
I20260709 13:14:37.704697  1923 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8dc82a3179da4d49b0000f0755cb7577"
dest_uuid: "cfdfd9c3b64347f997e5d181c39fddcd"
mode: GRACEFUL
new_leader_uuid: "efd77f14978b4b49880b1a39abc66987"
 from {username='slave'} at 127.0.0.1:35672
I20260709 13:14:37.705246  1923 raft_consensus.cc:606] T 8dc82a3179da4d49b0000f0755cb7577 P cfdfd9c3b64347f997e5d181c39fddcd [term 1 LEADER]: Received request to transfer leadership to TS efd77f14978b4b49880b1a39abc66987
I20260709 13:14:37.710819  1848 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd3d2c56c68f4dde862e62fa03ea3390"
dest_uuid: "efd77f14978b4b49880b1a39abc66987"
mode: GRACEFUL
new_leader_uuid: "cfdfd9c3b64347f997e5d181c39fddcd"
 from {username='slave'} at 127.0.0.1:34260
I20260709 13:14:37.711328  1848 raft_consensus.cc:606] T bd3d2c56c68f4dde862e62fa03ea3390 P efd77f14978b4b49880b1a39abc66987 [term 1 LEADER]: Received request to transfer leadership to TS cfdfd9c3b64347f997e5d181c39fddcd
I20260709 13:14:37.716020  1848 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc2475f8deda4598a7b0273059a49b4f"
dest_uuid: "efd77f14978b4b49880b1a39abc66987"
mode: GRACEFUL
new_leader_uuid: "cfdfd9c3b64347f997e5d181c39fddcd"
 from {username='slave'} at 127.0.0.1:34260
I20260709 13:14:37.716516  1848 raft_consensus.cc:606] T fc2475f8deda4598a7b0273059a49b4f P efd77f14978b4b49880b1a39abc66987 [term 1 LEADER]: Received request to transfer leadership to TS cfdfd9c3b64347f997e5d181c39fddcd
I20260709 13:14:37.723560  1848 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fdadc5e784044a589388e57980a8e0dc"
dest_uuid: "efd77f14978b4b49880b1a39abc66987"
mode: GRACEFUL
new_leader_uuid: "cfdfd9c3b64347f997e5d181c39fddcd"
 from {username='slave'} at 127.0.0.1:34260
I20260709 13:14:37.724059  1848 raft_consensus.cc:606] T fdadc5e784044a589388e57980a8e0dc P efd77f14978b4b49880b1a39abc66987 [term 1 LEADER]: Received request to transfer leadership to TS cfdfd9c3b64347f997e5d181c39fddcd
I20260709 13:14:37.783212  2166 consensus_queue.cc:1048] T bd3d2c56c68f4dde862e62fa03ea3390 P efd77f14978b4b49880b1a39abc66987 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:37.793385  2133 consensus_queue.cc:1048] T bd3d2c56c68f4dde862e62fa03ea3390 P efd77f14978b4b49880b1a39abc66987 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:37.802382  2170 raft_consensus.cc:993] T bd3d2c56c68f4dde862e62fa03ea3390 P efd77f14978b4b49880b1a39abc66987: : Instructing follower cfdfd9c3b64347f997e5d181c39fddcd to start an election
I20260709 13:14:37.803210  2170 raft_consensus.cc:1081] T bd3d2c56c68f4dde862e62fa03ea3390 P efd77f14978b4b49880b1a39abc66987 [term 1 LEADER]: Signalling peer cfdfd9c3b64347f997e5d181c39fddcd to start an election
I20260709 13:14:37.804869  1923 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bd3d2c56c68f4dde862e62fa03ea3390"
dest_uuid: "cfdfd9c3b64347f997e5d181c39fddcd"
 from {username='slave'} at 127.0.0.1:35666
I20260709 13:14:37.805364  1923 raft_consensus.cc:493] T bd3d2c56c68f4dde862e62fa03ea3390 P cfdfd9c3b64347f997e5d181c39fddcd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:37.805660  1923 raft_consensus.cc:3060] T bd3d2c56c68f4dde862e62fa03ea3390 P cfdfd9c3b64347f997e5d181c39fddcd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:37.810671  1923 raft_consensus.cc:515] T bd3d2c56c68f4dde862e62fa03ea3390 P cfdfd9c3b64347f997e5d181c39fddcd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:37.811861  2062 consensus_queue.cc:1048] T 8dc82a3179da4d49b0000f0755cb7577 P cfdfd9c3b64347f997e5d181c39fddcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:37.812330  1923 leader_election.cc:290] T bd3d2c56c68f4dde862e62fa03ea3390 P cfdfd9c3b64347f997e5d181c39fddcd [CANDIDATE]: Term 2 election: Requested vote from peers efd77f14978b4b49880b1a39abc66987 (127.23.140.65:41453), 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67:33709)
I20260709 13:14:37.813086  1848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3d2c56c68f4dde862e62fa03ea3390" candidate_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "efd77f14978b4b49880b1a39abc66987"
I20260709 13:14:37.813793  1848 raft_consensus.cc:3055] T bd3d2c56c68f4dde862e62fa03ea3390 P efd77f14978b4b49880b1a39abc66987 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:37.814107  1848 raft_consensus.cc:740] T bd3d2c56c68f4dde862e62fa03ea3390 P efd77f14978b4b49880b1a39abc66987 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: efd77f14978b4b49880b1a39abc66987, State: Running, Role: LEADER
I20260709 13:14:37.814479  1996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3d2c56c68f4dde862e62fa03ea3390" candidate_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6"
I20260709 13:14:37.815073  1996 raft_consensus.cc:3060] T bd3d2c56c68f4dde862e62fa03ea3390 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:37.814918  1848 consensus_queue.cc:260] T bd3d2c56c68f4dde862e62fa03ea3390 P efd77f14978b4b49880b1a39abc66987 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:37.816344  1848 raft_consensus.cc:3060] T bd3d2c56c68f4dde862e62fa03ea3390 P efd77f14978b4b49880b1a39abc66987 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:37.823312  2152 raft_consensus.cc:993] T 8dc82a3179da4d49b0000f0755cb7577 P cfdfd9c3b64347f997e5d181c39fddcd: : Instructing follower efd77f14978b4b49880b1a39abc66987 to start an election
I20260709 13:14:37.823861  2152 raft_consensus.cc:1081] T 8dc82a3179da4d49b0000f0755cb7577 P cfdfd9c3b64347f997e5d181c39fddcd [term 1 LEADER]: Signalling peer efd77f14978b4b49880b1a39abc66987 to start an election
I20260709 13:14:37.826988  1996 raft_consensus.cc:2468] T bd3d2c56c68f4dde862e62fa03ea3390 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfdfd9c3b64347f997e5d181c39fddcd in term 2.
I20260709 13:14:37.830307  1886 leader_election.cc:304] T bd3d2c56c68f4dde862e62fa03ea3390 P cfdfd9c3b64347f997e5d181c39fddcd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cfc2f643a0a46888b750e0ab7b7fde6, cfdfd9c3b64347f997e5d181c39fddcd; no voters: 
I20260709 13:14:37.830906  1846 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8dc82a3179da4d49b0000f0755cb7577"
dest_uuid: "efd77f14978b4b49880b1a39abc66987"
 from {username='slave'} at 127.0.0.1:34254
I20260709 13:14:37.831527  1846 raft_consensus.cc:493] T 8dc82a3179da4d49b0000f0755cb7577 P efd77f14978b4b49880b1a39abc66987 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:37.831662  2152 raft_consensus.cc:2804] T bd3d2c56c68f4dde862e62fa03ea3390 P cfdfd9c3b64347f997e5d181c39fddcd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:37.831888  1846 raft_consensus.cc:3060] T 8dc82a3179da4d49b0000f0755cb7577 P efd77f14978b4b49880b1a39abc66987 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:37.832254  2152 raft_consensus.cc:697] T bd3d2c56c68f4dde862e62fa03ea3390 P cfdfd9c3b64347f997e5d181c39fddcd [term 2 LEADER]: Becoming Leader. State: Replica: cfdfd9c3b64347f997e5d181c39fddcd, State: Running, Role: LEADER
I20260709 13:14:37.832753  1848 raft_consensus.cc:2468] T bd3d2c56c68f4dde862e62fa03ea3390 P efd77f14978b4b49880b1a39abc66987 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfdfd9c3b64347f997e5d181c39fddcd in term 2.
I20260709 13:14:37.833146  2152 consensus_queue.cc:237] T bd3d2c56c68f4dde862e62fa03ea3390 P cfdfd9c3b64347f997e5d181c39fddcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:37.835543  2154 consensus_queue.cc:1048] T 8dc82a3179da4d49b0000f0755cb7577 P cfdfd9c3b64347f997e5d181c39fddcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:37.839447  1846 raft_consensus.cc:515] T 8dc82a3179da4d49b0000f0755cb7577 P efd77f14978b4b49880b1a39abc66987 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:37.842506  1923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc82a3179da4d49b0000f0755cb7577" candidate_uuid: "efd77f14978b4b49880b1a39abc66987" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cfdfd9c3b64347f997e5d181c39fddcd"
I20260709 13:14:37.843204  1923 raft_consensus.cc:3055] T 8dc82a3179da4d49b0000f0755cb7577 P cfdfd9c3b64347f997e5d181c39fddcd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:37.843564  1923 raft_consensus.cc:740] T 8dc82a3179da4d49b0000f0755cb7577 P cfdfd9c3b64347f997e5d181c39fddcd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cfdfd9c3b64347f997e5d181c39fddcd, State: Running, Role: LEADER
I20260709 13:14:37.844521  1923 consensus_queue.cc:260] T 8dc82a3179da4d49b0000f0755cb7577 P cfdfd9c3b64347f997e5d181c39fddcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:37.845674  1923 raft_consensus.cc:3060] T 8dc82a3179da4d49b0000f0755cb7577 P cfdfd9c3b64347f997e5d181c39fddcd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:37.857926  1742 catalog_manager.cc:5697] T bd3d2c56c68f4dde862e62fa03ea3390 P cfdfd9c3b64347f997e5d181c39fddcd reported cstate change: term changed from 1 to 2, leader changed from efd77f14978b4b49880b1a39abc66987 (127.23.140.65) to cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66). New cstate: current_term: 2 leader_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:37.865221  1846 leader_election.cc:290] T 8dc82a3179da4d49b0000f0755cb7577 P efd77f14978b4b49880b1a39abc66987 [CANDIDATE]: Term 2 election: Requested vote from peers cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66:43351), 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67:33709)
I20260709 13:14:37.867311  1923 raft_consensus.cc:2468] T 8dc82a3179da4d49b0000f0755cb7577 P cfdfd9c3b64347f997e5d181c39fddcd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efd77f14978b4b49880b1a39abc66987 in term 2.
I20260709 13:14:37.868199  2178 consensus_queue.cc:1048] T 0d114296a5964005a874e6e09d94538b P 4cfc2f643a0a46888b750e0ab7b7fde6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:37.868602  1814 leader_election.cc:304] T 8dc82a3179da4d49b0000f0755cb7577 P efd77f14978b4b49880b1a39abc66987 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cfdfd9c3b64347f997e5d181c39fddcd, efd77f14978b4b49880b1a39abc66987; no voters: 
I20260709 13:14:37.869629  2133 raft_consensus.cc:2804] T 8dc82a3179da4d49b0000f0755cb7577 P efd77f14978b4b49880b1a39abc66987 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:37.870126  2133 raft_consensus.cc:697] T 8dc82a3179da4d49b0000f0755cb7577 P efd77f14978b4b49880b1a39abc66987 [term 2 LEADER]: Becoming Leader. State: Replica: efd77f14978b4b49880b1a39abc66987, State: Running, Role: LEADER
I20260709 13:14:37.870612  1996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc82a3179da4d49b0000f0755cb7577" candidate_uuid: "efd77f14978b4b49880b1a39abc66987" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6"
I20260709 13:14:37.871204  1996 raft_consensus.cc:3060] T 8dc82a3179da4d49b0000f0755cb7577 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:37.870930  2133 consensus_queue.cc:237] T 8dc82a3179da4d49b0000f0755cb7577 P efd77f14978b4b49880b1a39abc66987 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:37.879142  1996 raft_consensus.cc:2468] T 8dc82a3179da4d49b0000f0755cb7577 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efd77f14978b4b49880b1a39abc66987 in term 2.
I20260709 13:14:37.880932  1742 catalog_manager.cc:5697] T 8dc82a3179da4d49b0000f0755cb7577 P efd77f14978b4b49880b1a39abc66987 reported cstate change: term changed from 1 to 2, leader changed from cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66) to efd77f14978b4b49880b1a39abc66987 (127.23.140.65). New cstate: current_term: 2 leader_uuid: "efd77f14978b4b49880b1a39abc66987" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:37.892958  2178 consensus_queue.cc:1048] T 0d114296a5964005a874e6e09d94538b P 4cfc2f643a0a46888b750e0ab7b7fde6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:37.959379  2152 raft_consensus.cc:993] T 086f00b382884297b8409ffe816158fc P cfdfd9c3b64347f997e5d181c39fddcd: : Instructing follower efd77f14978b4b49880b1a39abc66987 to start an election
I20260709 13:14:37.959916  2152 raft_consensus.cc:1081] T 086f00b382884297b8409ffe816158fc P cfdfd9c3b64347f997e5d181c39fddcd [term 1 LEADER]: Signalling peer efd77f14978b4b49880b1a39abc66987 to start an election
I20260709 13:14:37.961385  1846 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "086f00b382884297b8409ffe816158fc"
dest_uuid: "efd77f14978b4b49880b1a39abc66987"
 from {username='slave'} at 127.0.0.1:34254
I20260709 13:14:37.961856  1846 raft_consensus.cc:493] T 086f00b382884297b8409ffe816158fc P efd77f14978b4b49880b1a39abc66987 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:37.962122  1846 raft_consensus.cc:3060] T 086f00b382884297b8409ffe816158fc P efd77f14978b4b49880b1a39abc66987 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:37.966795  1846 raft_consensus.cc:515] T 086f00b382884297b8409ffe816158fc P efd77f14978b4b49880b1a39abc66987 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:37.968178  1846 leader_election.cc:290] T 086f00b382884297b8409ffe816158fc P efd77f14978b4b49880b1a39abc66987 [CANDIDATE]: Term 2 election: Requested vote from peers cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66:43351), 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67:33709)
I20260709 13:14:37.969041  1923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "086f00b382884297b8409ffe816158fc" candidate_uuid: "efd77f14978b4b49880b1a39abc66987" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cfdfd9c3b64347f997e5d181c39fddcd"
I20260709 13:14:37.969246  1996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "086f00b382884297b8409ffe816158fc" candidate_uuid: "efd77f14978b4b49880b1a39abc66987" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6"
I20260709 13:14:37.969705  1923 raft_consensus.cc:3055] T 086f00b382884297b8409ffe816158fc P cfdfd9c3b64347f997e5d181c39fddcd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:37.969784  1996 raft_consensus.cc:3060] T 086f00b382884297b8409ffe816158fc P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:37.970115  1923 raft_consensus.cc:740] T 086f00b382884297b8409ffe816158fc P cfdfd9c3b64347f997e5d181c39fddcd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cfdfd9c3b64347f997e5d181c39fddcd, State: Running, Role: LEADER
I20260709 13:14:37.970893  1923 consensus_queue.cc:260] T 086f00b382884297b8409ffe816158fc P cfdfd9c3b64347f997e5d181c39fddcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:37.972011  1923 raft_consensus.cc:3060] T 086f00b382884297b8409ffe816158fc P cfdfd9c3b64347f997e5d181c39fddcd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:37.976760  1996 raft_consensus.cc:2468] T 086f00b382884297b8409ffe816158fc P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efd77f14978b4b49880b1a39abc66987 in term 2.
I20260709 13:14:37.978157  1811 leader_election.cc:304] T 086f00b382884297b8409ffe816158fc P efd77f14978b4b49880b1a39abc66987 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cfc2f643a0a46888b750e0ab7b7fde6, efd77f14978b4b49880b1a39abc66987; no voters: 
I20260709 13:14:37.978622  1923 raft_consensus.cc:2468] T 086f00b382884297b8409ffe816158fc P cfdfd9c3b64347f997e5d181c39fddcd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efd77f14978b4b49880b1a39abc66987 in term 2.
I20260709 13:14:37.979035  2133 raft_consensus.cc:2804] T 086f00b382884297b8409ffe816158fc P efd77f14978b4b49880b1a39abc66987 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:37.979585  2133 raft_consensus.cc:697] T 086f00b382884297b8409ffe816158fc P efd77f14978b4b49880b1a39abc66987 [term 2 LEADER]: Becoming Leader. State: Replica: efd77f14978b4b49880b1a39abc66987, State: Running, Role: LEADER
I20260709 13:14:37.980412  2133 consensus_queue.cc:237] T 086f00b382884297b8409ffe816158fc P efd77f14978b4b49880b1a39abc66987 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:37.986995  1745 catalog_manager.cc:5697] T 086f00b382884297b8409ffe816158fc P efd77f14978b4b49880b1a39abc66987 reported cstate change: term changed from 1 to 2, leader changed from cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66) to efd77f14978b4b49880b1a39abc66987 (127.23.140.65). New cstate: current_term: 2 leader_uuid: "efd77f14978b4b49880b1a39abc66987" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:38.065097  2154 raft_consensus.cc:993] T 7efaa7b0e2a6420282d24eed82603436 P cfdfd9c3b64347f997e5d181c39fddcd: : Instructing follower efd77f14978b4b49880b1a39abc66987 to start an election
I20260709 13:14:38.065565  2152 raft_consensus.cc:1081] T 7efaa7b0e2a6420282d24eed82603436 P cfdfd9c3b64347f997e5d181c39fddcd [term 1 LEADER]: Signalling peer efd77f14978b4b49880b1a39abc66987 to start an election
I20260709 13:14:38.067104  1846 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7efaa7b0e2a6420282d24eed82603436"
dest_uuid: "efd77f14978b4b49880b1a39abc66987"
 from {username='slave'} at 127.0.0.1:34254
I20260709 13:14:38.067533  1846 raft_consensus.cc:493] T 7efaa7b0e2a6420282d24eed82603436 P efd77f14978b4b49880b1a39abc66987 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:38.067795  1846 raft_consensus.cc:3060] T 7efaa7b0e2a6420282d24eed82603436 P efd77f14978b4b49880b1a39abc66987 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:38.072357  1846 raft_consensus.cc:515] T 7efaa7b0e2a6420282d24eed82603436 P efd77f14978b4b49880b1a39abc66987 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:38.073725  1846 leader_election.cc:290] T 7efaa7b0e2a6420282d24eed82603436 P efd77f14978b4b49880b1a39abc66987 [CANDIDATE]: Term 2 election: Requested vote from peers cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66:43351), 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67:33709)
I20260709 13:14:38.074491  1923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7efaa7b0e2a6420282d24eed82603436" candidate_uuid: "efd77f14978b4b49880b1a39abc66987" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cfdfd9c3b64347f997e5d181c39fddcd"
I20260709 13:14:38.074761  1996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7efaa7b0e2a6420282d24eed82603436" candidate_uuid: "efd77f14978b4b49880b1a39abc66987" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6"
I20260709 13:14:38.075088  1923 raft_consensus.cc:3055] T 7efaa7b0e2a6420282d24eed82603436 P cfdfd9c3b64347f997e5d181c39fddcd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:38.075317  1996 raft_consensus.cc:3060] T 7efaa7b0e2a6420282d24eed82603436 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:38.075469  1923 raft_consensus.cc:740] T 7efaa7b0e2a6420282d24eed82603436 P cfdfd9c3b64347f997e5d181c39fddcd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cfdfd9c3b64347f997e5d181c39fddcd, State: Running, Role: LEADER
I20260709 13:14:38.076236  1923 consensus_queue.cc:260] T 7efaa7b0e2a6420282d24eed82603436 P cfdfd9c3b64347f997e5d181c39fddcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:38.077570  1923 raft_consensus.cc:3060] T 7efaa7b0e2a6420282d24eed82603436 P cfdfd9c3b64347f997e5d181c39fddcd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:38.083052  1996 raft_consensus.cc:2468] T 7efaa7b0e2a6420282d24eed82603436 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efd77f14978b4b49880b1a39abc66987 in term 2.
I20260709 13:14:38.084209  1811 leader_election.cc:304] T 7efaa7b0e2a6420282d24eed82603436 P efd77f14978b4b49880b1a39abc66987 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cfc2f643a0a46888b750e0ab7b7fde6, efd77f14978b4b49880b1a39abc66987; no voters: 
I20260709 13:14:38.084741  1923 raft_consensus.cc:2468] T 7efaa7b0e2a6420282d24eed82603436 P cfdfd9c3b64347f997e5d181c39fddcd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efd77f14978b4b49880b1a39abc66987 in term 2.
I20260709 13:14:38.085129  2133 raft_consensus.cc:2804] T 7efaa7b0e2a6420282d24eed82603436 P efd77f14978b4b49880b1a39abc66987 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:38.085737  2133 raft_consensus.cc:697] T 7efaa7b0e2a6420282d24eed82603436 P efd77f14978b4b49880b1a39abc66987 [term 2 LEADER]: Becoming Leader. State: Replica: efd77f14978b4b49880b1a39abc66987, State: Running, Role: LEADER
I20260709 13:14:38.086431  2133 consensus_queue.cc:237] T 7efaa7b0e2a6420282d24eed82603436 P efd77f14978b4b49880b1a39abc66987 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:38.092315  1745 catalog_manager.cc:5697] T 7efaa7b0e2a6420282d24eed82603436 P efd77f14978b4b49880b1a39abc66987 reported cstate change: term changed from 1 to 2, leader changed from cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66) to efd77f14978b4b49880b1a39abc66987 (127.23.140.65). New cstate: current_term: 2 leader_uuid: "efd77f14978b4b49880b1a39abc66987" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:38.143302  2152 consensus_queue.cc:1048] T c152640dda8d4cce94303c088f3e4314 P cfdfd9c3b64347f997e5d181c39fddcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:38.151011  2133 raft_consensus.cc:993] T fc2475f8deda4598a7b0273059a49b4f P efd77f14978b4b49880b1a39abc66987: : Instructing follower cfdfd9c3b64347f997e5d181c39fddcd to start an election
I20260709 13:14:38.152976  2170 raft_consensus.cc:1081] T fc2475f8deda4598a7b0273059a49b4f P efd77f14978b4b49880b1a39abc66987 [term 1 LEADER]: Signalling peer cfdfd9c3b64347f997e5d181c39fddcd to start an election
I20260709 13:14:38.154790  1923 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fc2475f8deda4598a7b0273059a49b4f"
dest_uuid: "cfdfd9c3b64347f997e5d181c39fddcd"
 from {username='slave'} at 127.0.0.1:35666
I20260709 13:14:38.155321  1923 raft_consensus.cc:493] T fc2475f8deda4598a7b0273059a49b4f P cfdfd9c3b64347f997e5d181c39fddcd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:38.155939  1923 raft_consensus.cc:3060] T fc2475f8deda4598a7b0273059a49b4f P cfdfd9c3b64347f997e5d181c39fddcd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:38.159364  2154 consensus_queue.cc:1048] T c152640dda8d4cce94303c088f3e4314 P cfdfd9c3b64347f997e5d181c39fddcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:38.163331  1923 raft_consensus.cc:515] T fc2475f8deda4598a7b0273059a49b4f P cfdfd9c3b64347f997e5d181c39fddcd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:38.165760  1923 leader_election.cc:290] T fc2475f8deda4598a7b0273059a49b4f P cfdfd9c3b64347f997e5d181c39fddcd [CANDIDATE]: Term 2 election: Requested vote from peers efd77f14978b4b49880b1a39abc66987 (127.23.140.65:41453), 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67:33709)
I20260709 13:14:38.166868  1997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2475f8deda4598a7b0273059a49b4f" candidate_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6"
I20260709 13:14:38.167162  1846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2475f8deda4598a7b0273059a49b4f" candidate_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "efd77f14978b4b49880b1a39abc66987"
I20260709 13:14:38.167559  1997 raft_consensus.cc:3060] T fc2475f8deda4598a7b0273059a49b4f P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:38.167730  1846 raft_consensus.cc:3055] T fc2475f8deda4598a7b0273059a49b4f P efd77f14978b4b49880b1a39abc66987 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:38.168128  1846 raft_consensus.cc:740] T fc2475f8deda4598a7b0273059a49b4f P efd77f14978b4b49880b1a39abc66987 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: efd77f14978b4b49880b1a39abc66987, State: Running, Role: LEADER
I20260709 13:14:38.168764  1846 consensus_queue.cc:260] T fc2475f8deda4598a7b0273059a49b4f P efd77f14978b4b49880b1a39abc66987 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:38.169921  1846 raft_consensus.cc:3060] T fc2475f8deda4598a7b0273059a49b4f P efd77f14978b4b49880b1a39abc66987 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:38.174479  1997 raft_consensus.cc:2468] T fc2475f8deda4598a7b0273059a49b4f P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfdfd9c3b64347f997e5d181c39fddcd in term 2.
I20260709 13:14:38.175380  1886 leader_election.cc:304] T fc2475f8deda4598a7b0273059a49b4f P cfdfd9c3b64347f997e5d181c39fddcd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cfc2f643a0a46888b750e0ab7b7fde6, cfdfd9c3b64347f997e5d181c39fddcd; no voters: 
I20260709 13:14:38.176193  2154 raft_consensus.cc:2804] T fc2475f8deda4598a7b0273059a49b4f P cfdfd9c3b64347f997e5d181c39fddcd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:38.176220  1846 raft_consensus.cc:2468] T fc2475f8deda4598a7b0273059a49b4f P efd77f14978b4b49880b1a39abc66987 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfdfd9c3b64347f997e5d181c39fddcd in term 2.
I20260709 13:14:38.176762  2154 raft_consensus.cc:697] T fc2475f8deda4598a7b0273059a49b4f P cfdfd9c3b64347f997e5d181c39fddcd [term 2 LEADER]: Becoming Leader. State: Replica: cfdfd9c3b64347f997e5d181c39fddcd, State: Running, Role: LEADER
I20260709 13:14:38.177593  2154 consensus_queue.cc:237] T fc2475f8deda4598a7b0273059a49b4f P cfdfd9c3b64347f997e5d181c39fddcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:38.184206  1742 catalog_manager.cc:5697] T fc2475f8deda4598a7b0273059a49b4f P cfdfd9c3b64347f997e5d181c39fddcd reported cstate change: term changed from 1 to 2, leader changed from efd77f14978b4b49880b1a39abc66987 (127.23.140.65) to cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66). New cstate: current_term: 2 leader_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:38.245548  2166 raft_consensus.cc:993] T fdadc5e784044a589388e57980a8e0dc P efd77f14978b4b49880b1a39abc66987: : Instructing follower cfdfd9c3b64347f997e5d181c39fddcd to start an election
I20260709 13:14:38.246192  2166 raft_consensus.cc:1081] T fdadc5e784044a589388e57980a8e0dc P efd77f14978b4b49880b1a39abc66987 [term 1 LEADER]: Signalling peer cfdfd9c3b64347f997e5d181c39fddcd to start an election
I20260709 13:14:38.247677  1923 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fdadc5e784044a589388e57980a8e0dc"
dest_uuid: "cfdfd9c3b64347f997e5d181c39fddcd"
 from {username='slave'} at 127.0.0.1:35666
I20260709 13:14:38.248195  1923 raft_consensus.cc:493] T fdadc5e784044a589388e57980a8e0dc P cfdfd9c3b64347f997e5d181c39fddcd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:38.248529  1923 raft_consensus.cc:3060] T fdadc5e784044a589388e57980a8e0dc P cfdfd9c3b64347f997e5d181c39fddcd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:38.253587  1923 raft_consensus.cc:515] T fdadc5e784044a589388e57980a8e0dc P cfdfd9c3b64347f997e5d181c39fddcd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:38.255089  1923 leader_election.cc:290] T fdadc5e784044a589388e57980a8e0dc P cfdfd9c3b64347f997e5d181c39fddcd [CANDIDATE]: Term 2 election: Requested vote from peers efd77f14978b4b49880b1a39abc66987 (127.23.140.65:41453), 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67:33709)
I20260709 13:14:38.255961  1846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdadc5e784044a589388e57980a8e0dc" candidate_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "efd77f14978b4b49880b1a39abc66987"
I20260709 13:14:38.256080  1997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdadc5e784044a589388e57980a8e0dc" candidate_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6"
I20260709 13:14:38.256661  1846 raft_consensus.cc:3055] T fdadc5e784044a589388e57980a8e0dc P efd77f14978b4b49880b1a39abc66987 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:38.256778  1997 raft_consensus.cc:3060] T fdadc5e784044a589388e57980a8e0dc P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:38.257006  1846 raft_consensus.cc:740] T fdadc5e784044a589388e57980a8e0dc P efd77f14978b4b49880b1a39abc66987 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: efd77f14978b4b49880b1a39abc66987, State: Running, Role: LEADER
I20260709 13:14:38.257866  1846 consensus_queue.cc:260] T fdadc5e784044a589388e57980a8e0dc P efd77f14978b4b49880b1a39abc66987 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:38.258790  1846 raft_consensus.cc:3060] T fdadc5e784044a589388e57980a8e0dc P efd77f14978b4b49880b1a39abc66987 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:38.263980  1997 raft_consensus.cc:2468] T fdadc5e784044a589388e57980a8e0dc P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfdfd9c3b64347f997e5d181c39fddcd in term 2.
I20260709 13:14:38.264564  1846 raft_consensus.cc:2468] T fdadc5e784044a589388e57980a8e0dc P efd77f14978b4b49880b1a39abc66987 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfdfd9c3b64347f997e5d181c39fddcd in term 2.
I20260709 13:14:38.265266  1886 leader_election.cc:304] T fdadc5e784044a589388e57980a8e0dc P cfdfd9c3b64347f997e5d181c39fddcd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cfc2f643a0a46888b750e0ab7b7fde6, cfdfd9c3b64347f997e5d181c39fddcd; no voters: 
I20260709 13:14:38.266139  2154 raft_consensus.cc:2804] T fdadc5e784044a589388e57980a8e0dc P cfdfd9c3b64347f997e5d181c39fddcd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:38.266636  2154 raft_consensus.cc:697] T fdadc5e784044a589388e57980a8e0dc P cfdfd9c3b64347f997e5d181c39fddcd [term 2 LEADER]: Becoming Leader. State: Replica: cfdfd9c3b64347f997e5d181c39fddcd, State: Running, Role: LEADER
I20260709 13:14:38.267499  2154 consensus_queue.cc:237] T fdadc5e784044a589388e57980a8e0dc P cfdfd9c3b64347f997e5d181c39fddcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:38.273527  1742 catalog_manager.cc:5697] T fdadc5e784044a589388e57980a8e0dc P cfdfd9c3b64347f997e5d181c39fddcd reported cstate change: term changed from 1 to 2, leader changed from efd77f14978b4b49880b1a39abc66987 (127.23.140.65) to cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66). New cstate: current_term: 2 leader_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:38.345829  1997 raft_consensus.cc:1275] T bd3d2c56c68f4dde862e62fa03ea3390 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 2 FOLLOWER]: Refusing update from remote peer cfdfd9c3b64347f997e5d181c39fddcd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:38.347075  2154 consensus_queue.cc:1048] T bd3d2c56c68f4dde862e62fa03ea3390 P cfdfd9c3b64347f997e5d181c39fddcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:38.356426  1846 raft_consensus.cc:1275] T bd3d2c56c68f4dde862e62fa03ea3390 P efd77f14978b4b49880b1a39abc66987 [term 2 FOLLOWER]: Refusing update from remote peer cfdfd9c3b64347f997e5d181c39fddcd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:38.358294  2152 consensus_queue.cc:1048] T bd3d2c56c68f4dde862e62fa03ea3390 P cfdfd9c3b64347f997e5d181c39fddcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:38.361999  1923 raft_consensus.cc:1275] T 086f00b382884297b8409ffe816158fc P cfdfd9c3b64347f997e5d181c39fddcd [term 2 FOLLOWER]: Refusing update from remote peer efd77f14978b4b49880b1a39abc66987: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:38.363152  2166 consensus_queue.cc:1048] T 086f00b382884297b8409ffe816158fc P efd77f14978b4b49880b1a39abc66987 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:38.374920  1997 raft_consensus.cc:1275] T 086f00b382884297b8409ffe816158fc P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 2 FOLLOWER]: Refusing update from remote peer efd77f14978b4b49880b1a39abc66987: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:38.376641  2133 consensus_queue.cc:1048] T 086f00b382884297b8409ffe816158fc P efd77f14978b4b49880b1a39abc66987 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:38.464530  1997 raft_consensus.cc:1275] T 8dc82a3179da4d49b0000f0755cb7577 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 2 FOLLOWER]: Refusing update from remote peer efd77f14978b4b49880b1a39abc66987: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:38.465777  2133 consensus_queue.cc:1048] T 8dc82a3179da4d49b0000f0755cb7577 P efd77f14978b4b49880b1a39abc66987 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:38.472860  1923 raft_consensus.cc:1275] T 8dc82a3179da4d49b0000f0755cb7577 P cfdfd9c3b64347f997e5d181c39fddcd [term 2 FOLLOWER]: Refusing update from remote peer efd77f14978b4b49880b1a39abc66987: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:38.474232  2170 consensus_queue.cc:1048] T 8dc82a3179da4d49b0000f0755cb7577 P efd77f14978b4b49880b1a39abc66987 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:38.498065  1997 raft_consensus.cc:1275] T 7efaa7b0e2a6420282d24eed82603436 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 2 FOLLOWER]: Refusing update from remote peer efd77f14978b4b49880b1a39abc66987: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:38.499275  2170 consensus_queue.cc:1048] T 7efaa7b0e2a6420282d24eed82603436 P efd77f14978b4b49880b1a39abc66987 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:38.506520  1923 raft_consensus.cc:1275] T 7efaa7b0e2a6420282d24eed82603436 P cfdfd9c3b64347f997e5d181c39fddcd [term 2 FOLLOWER]: Refusing update from remote peer efd77f14978b4b49880b1a39abc66987: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:38.507858  2133 consensus_queue.cc:1048] T 7efaa7b0e2a6420282d24eed82603436 P efd77f14978b4b49880b1a39abc66987 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:38.580358  1996 raft_consensus.cc:1275] T fc2475f8deda4598a7b0273059a49b4f P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 2 FOLLOWER]: Refusing update from remote peer cfdfd9c3b64347f997e5d181c39fddcd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:38.581743  2152 consensus_queue.cc:1048] T fc2475f8deda4598a7b0273059a49b4f P cfdfd9c3b64347f997e5d181c39fddcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:38.589789  1848 raft_consensus.cc:1275] T fc2475f8deda4598a7b0273059a49b4f P efd77f14978b4b49880b1a39abc66987 [term 2 FOLLOWER]: Refusing update from remote peer cfdfd9c3b64347f997e5d181c39fddcd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:38.591217  2152 consensus_queue.cc:1048] T fc2475f8deda4598a7b0273059a49b4f P cfdfd9c3b64347f997e5d181c39fddcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:38.811746  1848 raft_consensus.cc:1275] T fdadc5e784044a589388e57980a8e0dc P efd77f14978b4b49880b1a39abc66987 [term 2 FOLLOWER]: Refusing update from remote peer cfdfd9c3b64347f997e5d181c39fddcd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:38.813009  2152 consensus_queue.cc:1048] T fdadc5e784044a589388e57980a8e0dc P cfdfd9c3b64347f997e5d181c39fddcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:38.822690  1996 raft_consensus.cc:1275] T fdadc5e784044a589388e57980a8e0dc P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 2 FOLLOWER]: Refusing update from remote peer cfdfd9c3b64347f997e5d181c39fddcd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:38.824842  2152 consensus_queue.cc:1048] T fdadc5e784044a589388e57980a8e0dc P cfdfd9c3b64347f997e5d181c39fddcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:14:39.844898  1813 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.000s	sys 0.023s
W20260709 13:14:39.845223  1813 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.000s	sys 0.023s
W20260709 13:14:40.063771  1777 debug-util.cc:398] Leaking SignalData structure 0x7b0800364aa0 after lost signal to thread 24116
W20260709 13:14:40.064816  1777 debug-util.cc:398] Leaking SignalData structure 0x7b08000f52c0 after lost signal to thread 1780
W20260709 13:14:40.065882  1777 debug-util.cc:398] Leaking SignalData structure 0x7b080008b2e0 after lost signal to thread 1872
W20260709 13:14:40.066807  1777 debug-util.cc:398] Leaking SignalData structure 0x7b0800129580 after lost signal to thread 1947
W20260709 13:14:40.067720  1777 debug-util.cc:398] Leaking SignalData structure 0x7b08000d4dc0 after lost signal to thread 2021
I20260709 13:14:40.748689  1745 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36558:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:14:40.774323  1745 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:36558:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:14:40.917640 24113 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:41.008507  2245 tablet.cc:1724] T 6476c353b8b04452a9edbbff28e6c212 P 4cfc2f643a0a46888b750e0ab7b7fde6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:41.096426  2251 tablet.cc:1724] T 6476c353b8b04452a9edbbff28e6c212 P efd77f14978b4b49880b1a39abc66987: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:41.171509  2258 tablet.cc:1724] T 7efaa7b0e2a6420282d24eed82603436 P efd77f14978b4b49880b1a39abc66987: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:41.186245  2264 tablet.cc:1724] T 8dc82a3179da4d49b0000f0755cb7577 P efd77f14978b4b49880b1a39abc66987: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:14:41.280984  1887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.65:41453, user_credentials={real_user=slave}} blocked reactor thread for 45698.4us
I20260709 13:14:41.312332  2275 tablet.cc:1724] T bd3d2c56c68f4dde862e62fa03ea3390 P 4cfc2f643a0a46888b750e0ab7b7fde6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:41.314497  2245 tablet.cc:1724] T 0d114296a5964005a874e6e09d94538b P 4cfc2f643a0a46888b750e0ab7b7fde6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:41.211766  2262 tablet.cc:1724] T 7efaa7b0e2a6420282d24eed82603436 P 4cfc2f643a0a46888b750e0ab7b7fde6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:14:41.386504  1886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.140.67:33709, user_credentials={real_user=slave}} blocked reactor thread for 98845.2us
I20260709 13:14:41.402222  2251 tablet.cc:1724] T 0d114296a5964005a874e6e09d94538b P efd77f14978b4b49880b1a39abc66987: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:41.404088  2277 tablet.cc:1724] T bd3d2c56c68f4dde862e62fa03ea3390 P cfdfd9c3b64347f997e5d181c39fddcd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:41.310593  2270 tablet.cc:1724] T 8dc82a3179da4d49b0000f0755cb7577 P 4cfc2f643a0a46888b750e0ab7b7fde6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:14:41.434629  2271 log.cc:927] Time spent T c152640dda8d4cce94303c088f3e4314 P efd77f14978b4b49880b1a39abc66987: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:14:41.440052  2258 tablet.cc:1724] T 086f00b382884297b8409ffe816158fc P efd77f14978b4b49880b1a39abc66987: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:41.441599  2280 tablet.cc:1724] T 6476c353b8b04452a9edbbff28e6c212 P cfdfd9c3b64347f997e5d181c39fddcd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:14:41.444967  2265 log.cc:927] Time spent T 7efaa7b0e2a6420282d24eed82603436 P cfdfd9c3b64347f997e5d181c39fddcd: Append to log took a long time: real 0.151s	user 0.002s	sys 0.000s
I20260709 13:14:41.457458  2282 tablet.cc:1724] T 8dc82a3179da4d49b0000f0755cb7577 P cfdfd9c3b64347f997e5d181c39fddcd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:41.477885  2279 tablet.cc:1724] T c152640dda8d4cce94303c088f3e4314 P cfdfd9c3b64347f997e5d181c39fddcd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:41.496470  1921 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aaaceebb1e1c4a61968762f9b4b32dea"
dest_uuid: "cfdfd9c3b64347f997e5d181c39fddcd"
mode: GRACEFUL
new_leader_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6"
 from {username='slave'} at 127.0.0.1:35904
I20260709 13:14:41.497277  1921 raft_consensus.cc:606] T aaaceebb1e1c4a61968762f9b4b32dea P cfdfd9c3b64347f997e5d181c39fddcd [term 2 LEADER]: Received request to transfer leadership to TS 4cfc2f643a0a46888b750e0ab7b7fde6
I20260709 13:14:41.513442  2284 tablet.cc:1724] T bd3d2c56c68f4dde862e62fa03ea3390 P efd77f14978b4b49880b1a39abc66987: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:41.514245  2280 tablet.cc:1724] T 086f00b382884297b8409ffe816158fc P cfdfd9c3b64347f997e5d181c39fddcd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:41.522192  2258 tablet.cc:1724] T fc2475f8deda4598a7b0273059a49b4f P efd77f14978b4b49880b1a39abc66987: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:41.522506  2282 tablet.cc:1724] T 0d114296a5964005a874e6e09d94538b P cfdfd9c3b64347f997e5d181c39fddcd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:41.513482  2251 tablet.cc:1724] T c152640dda8d4cce94303c088f3e4314 P efd77f14978b4b49880b1a39abc66987: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:41.538408  2244 raft_consensus.cc:993] T aaaceebb1e1c4a61968762f9b4b32dea P cfdfd9c3b64347f997e5d181c39fddcd: : Instructing follower 4cfc2f643a0a46888b750e0ab7b7fde6 to start an election
I20260709 13:14:41.539172  2216 raft_consensus.cc:1081] T aaaceebb1e1c4a61968762f9b4b32dea P cfdfd9c3b64347f997e5d181c39fddcd [term 2 LEADER]: Signalling peer 4cfc2f643a0a46888b750e0ab7b7fde6 to start an election
I20260709 13:14:41.537539  2245 tablet.cc:1724] T c152640dda8d4cce94303c088f3e4314 P 4cfc2f643a0a46888b750e0ab7b7fde6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:41.539496  2262 tablet.cc:1724] T fc2475f8deda4598a7b0273059a49b4f P 4cfc2f643a0a46888b750e0ab7b7fde6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:41.541352  2264 tablet.cc:1724] T fdadc5e784044a589388e57980a8e0dc P efd77f14978b4b49880b1a39abc66987: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:41.542788  1994 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aaaceebb1e1c4a61968762f9b4b32dea"
dest_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6"
 from {username='slave'} at 127.0.0.1:33672
I20260709 13:14:41.543469  1994 raft_consensus.cc:493] T aaaceebb1e1c4a61968762f9b4b32dea P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:41.543886  1994 raft_consensus.cc:3060] T aaaceebb1e1c4a61968762f9b4b32dea P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:41.547791  2270 tablet.cc:1724] T 086f00b382884297b8409ffe816158fc P 4cfc2f643a0a46888b750e0ab7b7fde6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:41.562953  1846 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b16576d7015c475fb71585c29048e5a9"
dest_uuid: "efd77f14978b4b49880b1a39abc66987"
mode: GRACEFUL
new_leader_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6"
 from {username='slave'} at 127.0.0.1:39416
I20260709 13:14:41.563807  1846 raft_consensus.cc:606] T b16576d7015c475fb71585c29048e5a9 P efd77f14978b4b49880b1a39abc66987 [term 2 LEADER]: Received request to transfer leadership to TS 4cfc2f643a0a46888b750e0ab7b7fde6
I20260709 13:14:41.566221 24113 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:14:41.566847 24113 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:41.569343  2275 tablet.cc:1724] T fdadc5e784044a589388e57980a8e0dc P 4cfc2f643a0a46888b750e0ab7b7fde6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:41.569376  1994 raft_consensus.cc:515] T aaaceebb1e1c4a61968762f9b4b32dea P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:41.574185  2277 tablet.cc:1724] T 7efaa7b0e2a6420282d24eed82603436 P cfdfd9c3b64347f997e5d181c39fddcd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:41.575839  1846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaceebb1e1c4a61968762f9b4b32dea" candidate_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "efd77f14978b4b49880b1a39abc66987"
I20260709 13:14:41.576434  1846 raft_consensus.cc:3060] T aaaceebb1e1c4a61968762f9b4b32dea P efd77f14978b4b49880b1a39abc66987 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:41.577979  2280 tablet.cc:1724] T fc2475f8deda4598a7b0273059a49b4f P cfdfd9c3b64347f997e5d181c39fddcd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:41.580444  1921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaceebb1e1c4a61968762f9b4b32dea" candidate_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cfdfd9c3b64347f997e5d181c39fddcd"
I20260709 13:14:41.581637  1921 raft_consensus.cc:3055] T aaaceebb1e1c4a61968762f9b4b32dea P cfdfd9c3b64347f997e5d181c39fddcd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:41.581997  1921 raft_consensus.cc:740] T aaaceebb1e1c4a61968762f9b4b32dea P cfdfd9c3b64347f997e5d181c39fddcd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cfdfd9c3b64347f997e5d181c39fddcd, State: Running, Role: LEADER
I20260709 13:14:41.582825  1921 consensus_queue.cc:260] T aaaceebb1e1c4a61968762f9b4b32dea P cfdfd9c3b64347f997e5d181c39fddcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:41.583828  1846 raft_consensus.cc:2468] T aaaceebb1e1c4a61968762f9b4b32dea P efd77f14978b4b49880b1a39abc66987 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cfc2f643a0a46888b750e0ab7b7fde6 in term 3.
I20260709 13:14:41.583938  1921 raft_consensus.cc:3060] T aaaceebb1e1c4a61968762f9b4b32dea P cfdfd9c3b64347f997e5d181c39fddcd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:41.585127  1961 leader_election.cc:304] T aaaceebb1e1c4a61968762f9b4b32dea P 4cfc2f643a0a46888b750e0ab7b7fde6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cfc2f643a0a46888b750e0ab7b7fde6, efd77f14978b4b49880b1a39abc66987; no voters: 
I20260709 13:14:41.586126  2286 raft_consensus.cc:2804] T aaaceebb1e1c4a61968762f9b4b32dea P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:41.586582  2286 raft_consensus.cc:697] T aaaceebb1e1c4a61968762f9b4b32dea P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 3 LEADER]: Becoming Leader. State: Replica: 4cfc2f643a0a46888b750e0ab7b7fde6, State: Running, Role: LEADER
I20260709 13:14:41.587354  2286 consensus_queue.cc:237] T aaaceebb1e1c4a61968762f9b4b32dea P 4cfc2f643a0a46888b750e0ab7b7fde6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:41.591971  1921 raft_consensus.cc:2468] T aaaceebb1e1c4a61968762f9b4b32dea P cfdfd9c3b64347f997e5d181c39fddcd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cfc2f643a0a46888b750e0ab7b7fde6 in term 3.
I20260709 13:14:41.579444  1994 leader_election.cc:290] T aaaceebb1e1c4a61968762f9b4b32dea P 4cfc2f643a0a46888b750e0ab7b7fde6 [CANDIDATE]: Term 3 election: Requested vote from peers efd77f14978b4b49880b1a39abc66987 (127.23.140.65:41453), cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66:43351)
I20260709 13:14:41.599428  2279 tablet.cc:1724] T fdadc5e784044a589388e57980a8e0dc P cfdfd9c3b64347f997e5d181c39fddcd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:41.631345  1743 catalog_manager.cc:5697] T aaaceebb1e1c4a61968762f9b4b32dea P 4cfc2f643a0a46888b750e0ab7b7fde6 reported cstate change: term changed from 2 to 3, leader changed from cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66) to 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67). New cstate: current_term: 3 leader_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:41.647818  1742 catalog_manager.cc:6242] T 00000000000000000000000000000000 P def666c72a25488f80473d75cdada3a6: soft_deleted_table [id=390984e758c8422bacf50813861d2b7f] alter complete (version 1)
I20260709 13:14:41.814669  2257 raft_consensus.cc:993] T b16576d7015c475fb71585c29048e5a9 P efd77f14978b4b49880b1a39abc66987: : Instructing follower 4cfc2f643a0a46888b750e0ab7b7fde6 to start an election
I20260709 13:14:41.815300  2252 raft_consensus.cc:1081] T b16576d7015c475fb71585c29048e5a9 P efd77f14978b4b49880b1a39abc66987 [term 2 LEADER]: Signalling peer 4cfc2f643a0a46888b750e0ab7b7fde6 to start an election
I20260709 13:14:41.816702  1994 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b16576d7015c475fb71585c29048e5a9"
dest_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6"
 from {username='slave'} at 127.0.0.1:33680
I20260709 13:14:41.817358  1994 raft_consensus.cc:493] T b16576d7015c475fb71585c29048e5a9 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:41.817665  1994 raft_consensus.cc:3060] T b16576d7015c475fb71585c29048e5a9 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:41.822525  1994 raft_consensus.cc:515] T b16576d7015c475fb71585c29048e5a9 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:41.824239  1994 leader_election.cc:290] T b16576d7015c475fb71585c29048e5a9 P 4cfc2f643a0a46888b750e0ab7b7fde6 [CANDIDATE]: Term 3 election: Requested vote from peers efd77f14978b4b49880b1a39abc66987 (127.23.140.65:41453), cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66:43351)
I20260709 13:14:41.824941  1846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16576d7015c475fb71585c29048e5a9" candidate_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "efd77f14978b4b49880b1a39abc66987"
I20260709 13:14:41.825441  1921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16576d7015c475fb71585c29048e5a9" candidate_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cfdfd9c3b64347f997e5d181c39fddcd"
I20260709 13:14:41.825640  1846 raft_consensus.cc:3055] T b16576d7015c475fb71585c29048e5a9 P efd77f14978b4b49880b1a39abc66987 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:41.826155  1921 raft_consensus.cc:3060] T b16576d7015c475fb71585c29048e5a9 P cfdfd9c3b64347f997e5d181c39fddcd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:41.826152  1846 raft_consensus.cc:740] T b16576d7015c475fb71585c29048e5a9 P efd77f14978b4b49880b1a39abc66987 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: efd77f14978b4b49880b1a39abc66987, State: Running, Role: LEADER
I20260709 13:14:41.827190  1846 consensus_queue.cc:260] T b16576d7015c475fb71585c29048e5a9 P efd77f14978b4b49880b1a39abc66987 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:41.828501  1846 raft_consensus.cc:3060] T b16576d7015c475fb71585c29048e5a9 P efd77f14978b4b49880b1a39abc66987 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:41.833729  1921 raft_consensus.cc:2468] T b16576d7015c475fb71585c29048e5a9 P cfdfd9c3b64347f997e5d181c39fddcd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cfc2f643a0a46888b750e0ab7b7fde6 in term 3.
I20260709 13:14:41.835213  1963 leader_election.cc:304] T b16576d7015c475fb71585c29048e5a9 P 4cfc2f643a0a46888b750e0ab7b7fde6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cfc2f643a0a46888b750e0ab7b7fde6, cfdfd9c3b64347f997e5d181c39fddcd; no voters: 
I20260709 13:14:41.835268  1846 raft_consensus.cc:2468] T b16576d7015c475fb71585c29048e5a9 P efd77f14978b4b49880b1a39abc66987 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cfc2f643a0a46888b750e0ab7b7fde6 in term 3.
I20260709 13:14:41.836228  2286 raft_consensus.cc:2804] T b16576d7015c475fb71585c29048e5a9 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:41.836740  2286 raft_consensus.cc:697] T b16576d7015c475fb71585c29048e5a9 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 3 LEADER]: Becoming Leader. State: Replica: 4cfc2f643a0a46888b750e0ab7b7fde6, State: Running, Role: LEADER
I20260709 13:14:41.837628  2286 consensus_queue.cc:237] T b16576d7015c475fb71585c29048e5a9 P 4cfc2f643a0a46888b750e0ab7b7fde6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } }
I20260709 13:14:41.847515  1742 catalog_manager.cc:5697] T b16576d7015c475fb71585c29048e5a9 P 4cfc2f643a0a46888b750e0ab7b7fde6 reported cstate change: term changed from 2 to 3, leader changed from efd77f14978b4b49880b1a39abc66987 (127.23.140.65) to 4cfc2f643a0a46888b750e0ab7b7fde6 (127.23.140.67). New cstate: current_term: 3 leader_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cfc2f643a0a46888b750e0ab7b7fde6" member_type: VOTER last_known_addr { host: "127.23.140.67" port: 33709 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:41.992280  1921 raft_consensus.cc:1275] T aaaceebb1e1c4a61968762f9b4b32dea P cfdfd9c3b64347f997e5d181c39fddcd [term 3 FOLLOWER]: Refusing update from remote peer 4cfc2f643a0a46888b750e0ab7b7fde6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:41.993526  2286 consensus_queue.cc:1048] T aaaceebb1e1c4a61968762f9b4b32dea P 4cfc2f643a0a46888b750e0ab7b7fde6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:42.002980  1846 raft_consensus.cc:1275] T aaaceebb1e1c4a61968762f9b4b32dea P efd77f14978b4b49880b1a39abc66987 [term 3 FOLLOWER]: Refusing update from remote peer 4cfc2f643a0a46888b750e0ab7b7fde6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:42.005623  2286 consensus_queue.cc:1048] T aaaceebb1e1c4a61968762f9b4b32dea P 4cfc2f643a0a46888b750e0ab7b7fde6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:42.449853  1846 raft_consensus.cc:1275] T b16576d7015c475fb71585c29048e5a9 P efd77f14978b4b49880b1a39abc66987 [term 3 FOLLOWER]: Refusing update from remote peer 4cfc2f643a0a46888b750e0ab7b7fde6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:42.451282  2286 consensus_queue.cc:1048] T b16576d7015c475fb71585c29048e5a9 P 4cfc2f643a0a46888b750e0ab7b7fde6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efd77f14978b4b49880b1a39abc66987" member_type: VOTER last_known_addr { host: "127.23.140.65" port: 41453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:42.462477  1921 raft_consensus.cc:1275] T b16576d7015c475fb71585c29048e5a9 P cfdfd9c3b64347f997e5d181c39fddcd [term 3 FOLLOWER]: Refusing update from remote peer 4cfc2f643a0a46888b750e0ab7b7fde6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:42.463955  2261 consensus_queue.cc:1048] T b16576d7015c475fb71585c29048e5a9 P 4cfc2f643a0a46888b750e0ab7b7fde6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfdfd9c3b64347f997e5d181c39fddcd" member_type: VOTER last_known_addr { host: "127.23.140.66" port: 43351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:42.628733 24113 tablet_server.cc:179] TabletServer@127.23.140.65:0 shutting down...
W20260709 13:14:42.672760  1887 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 9 similar messages]
I20260709 13:14:42.678972 24113 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:14:42.679813  1887 consensus_peers.cc:597] T fdadc5e784044a589388e57980a8e0dc P cfdfd9c3b64347f997e5d181c39fddcd -> Peer efd77f14978b4b49880b1a39abc66987 (127.23.140.65:41453): Couldn't send request to peer efd77f14978b4b49880b1a39abc66987. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:42.680016 24113 tablet_replica.cc:333] T bd3d2c56c68f4dde862e62fa03ea3390 P efd77f14978b4b49880b1a39abc66987: stopping tablet replica
I20260709 13:14:42.681034 24113 raft_consensus.cc:2243] T bd3d2c56c68f4dde862e62fa03ea3390 P efd77f14978b4b49880b1a39abc66987 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.681670 24113 raft_consensus.cc:2272] T bd3d2c56c68f4dde862e62fa03ea3390 P efd77f14978b4b49880b1a39abc66987 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.684355 24113 tablet_replica.cc:333] T fdadc5e784044a589388e57980a8e0dc P efd77f14978b4b49880b1a39abc66987: stopping tablet replica
I20260709 13:14:42.685221 24113 raft_consensus.cc:2243] T fdadc5e784044a589388e57980a8e0dc P efd77f14978b4b49880b1a39abc66987 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.685803 24113 raft_consensus.cc:2272] T fdadc5e784044a589388e57980a8e0dc P efd77f14978b4b49880b1a39abc66987 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.688308 24113 tablet_replica.cc:333] T fc2475f8deda4598a7b0273059a49b4f P efd77f14978b4b49880b1a39abc66987: stopping tablet replica
I20260709 13:14:42.689110 24113 raft_consensus.cc:2243] T fc2475f8deda4598a7b0273059a49b4f P efd77f14978b4b49880b1a39abc66987 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.689678 24113 raft_consensus.cc:2272] T fc2475f8deda4598a7b0273059a49b4f P efd77f14978b4b49880b1a39abc66987 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.692212 24113 tablet_replica.cc:333] T c152640dda8d4cce94303c088f3e4314 P efd77f14978b4b49880b1a39abc66987: stopping tablet replica
I20260709 13:14:42.693030 24113 raft_consensus.cc:2243] T c152640dda8d4cce94303c088f3e4314 P efd77f14978b4b49880b1a39abc66987 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.693555 24113 raft_consensus.cc:2272] T c152640dda8d4cce94303c088f3e4314 P efd77f14978b4b49880b1a39abc66987 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.696035 24113 tablet_replica.cc:333] T 086f00b382884297b8409ffe816158fc P efd77f14978b4b49880b1a39abc66987: stopping tablet replica
I20260709 13:14:42.696794 24113 raft_consensus.cc:2243] T 086f00b382884297b8409ffe816158fc P efd77f14978b4b49880b1a39abc66987 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:42.697818 24113 raft_consensus.cc:2272] T 086f00b382884297b8409ffe816158fc P efd77f14978b4b49880b1a39abc66987 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.700316 24113 tablet_replica.cc:333] T 8dc82a3179da4d49b0000f0755cb7577 P efd77f14978b4b49880b1a39abc66987: stopping tablet replica
I20260709 13:14:42.701121 24113 raft_consensus.cc:2243] T 8dc82a3179da4d49b0000f0755cb7577 P efd77f14978b4b49880b1a39abc66987 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:42.702145 24113 raft_consensus.cc:2272] T 8dc82a3179da4d49b0000f0755cb7577 P efd77f14978b4b49880b1a39abc66987 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.704708 24113 tablet_replica.cc:333] T fe7a5d3b676046eba775b5d39c4c1cd9 P efd77f14978b4b49880b1a39abc66987: stopping tablet replica
I20260709 13:14:42.705499 24113 raft_consensus.cc:2243] T fe7a5d3b676046eba775b5d39c4c1cd9 P efd77f14978b4b49880b1a39abc66987 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.706073 24113 raft_consensus.cc:2272] T fe7a5d3b676046eba775b5d39c4c1cd9 P efd77f14978b4b49880b1a39abc66987 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.708918 24113 tablet_replica.cc:333] T 849c6495f30e45caa73c1f4be5c2d65c P efd77f14978b4b49880b1a39abc66987: stopping tablet replica
I20260709 13:14:42.709685 24113 raft_consensus.cc:2243] T 849c6495f30e45caa73c1f4be5c2d65c P efd77f14978b4b49880b1a39abc66987 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.710237 24113 raft_consensus.cc:2272] T 849c6495f30e45caa73c1f4be5c2d65c P efd77f14978b4b49880b1a39abc66987 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.713647 24113 tablet_replica.cc:333] T 6476c353b8b04452a9edbbff28e6c212 P efd77f14978b4b49880b1a39abc66987: stopping tablet replica
I20260709 13:14:42.714490 24113 raft_consensus.cc:2243] T 6476c353b8b04452a9edbbff28e6c212 P efd77f14978b4b49880b1a39abc66987 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:42.715519 24113 raft_consensus.cc:2272] T 6476c353b8b04452a9edbbff28e6c212 P efd77f14978b4b49880b1a39abc66987 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.718040 24113 tablet_replica.cc:333] T 7efaa7b0e2a6420282d24eed82603436 P efd77f14978b4b49880b1a39abc66987: stopping tablet replica
I20260709 13:14:42.718833 24113 raft_consensus.cc:2243] T 7efaa7b0e2a6420282d24eed82603436 P efd77f14978b4b49880b1a39abc66987 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:42.719872 24113 raft_consensus.cc:2272] T 7efaa7b0e2a6420282d24eed82603436 P efd77f14978b4b49880b1a39abc66987 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.722366 24113 tablet_replica.cc:333] T aaaceebb1e1c4a61968762f9b4b32dea P efd77f14978b4b49880b1a39abc66987: stopping tablet replica
I20260709 13:14:42.723088 24113 raft_consensus.cc:2243] T aaaceebb1e1c4a61968762f9b4b32dea P efd77f14978b4b49880b1a39abc66987 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.723618 24113 raft_consensus.cc:2272] T aaaceebb1e1c4a61968762f9b4b32dea P efd77f14978b4b49880b1a39abc66987 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.726729 24113 tablet_replica.cc:333] T b16576d7015c475fb71585c29048e5a9 P efd77f14978b4b49880b1a39abc66987: stopping tablet replica
I20260709 13:14:42.727535 24113 raft_consensus.cc:2243] T b16576d7015c475fb71585c29048e5a9 P efd77f14978b4b49880b1a39abc66987 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.728055 24113 raft_consensus.cc:2272] T b16576d7015c475fb71585c29048e5a9 P efd77f14978b4b49880b1a39abc66987 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.731221 24113 tablet_replica.cc:333] T 6b8eac6adeda4c8a9e8e4142a9b86feb P efd77f14978b4b49880b1a39abc66987: stopping tablet replica
I20260709 13:14:42.732038 24113 raft_consensus.cc:2243] T 6b8eac6adeda4c8a9e8e4142a9b86feb P efd77f14978b4b49880b1a39abc66987 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:42.733094 24113 raft_consensus.cc:2272] T 6b8eac6adeda4c8a9e8e4142a9b86feb P efd77f14978b4b49880b1a39abc66987 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.736030 24113 tablet_replica.cc:333] T 0d114296a5964005a874e6e09d94538b P efd77f14978b4b49880b1a39abc66987: stopping tablet replica
I20260709 13:14:42.736732 24113 raft_consensus.cc:2243] T 0d114296a5964005a874e6e09d94538b P efd77f14978b4b49880b1a39abc66987 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.737247 24113 raft_consensus.cc:2272] T 0d114296a5964005a874e6e09d94538b P efd77f14978b4b49880b1a39abc66987 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.739698 24113 tablet_replica.cc:333] T 2f141c8bf4624551b8906e0469e6c4d8 P efd77f14978b4b49880b1a39abc66987: stopping tablet replica
I20260709 13:14:42.740414 24113 raft_consensus.cc:2243] T 2f141c8bf4624551b8906e0469e6c4d8 P efd77f14978b4b49880b1a39abc66987 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.740978 24113 raft_consensus.cc:2272] T 2f141c8bf4624551b8906e0469e6c4d8 P efd77f14978b4b49880b1a39abc66987 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.743710 24113 tablet_replica.cc:333] T b06ca2d520f7457692822190ac2a8f32 P efd77f14978b4b49880b1a39abc66987: stopping tablet replica
I20260709 13:14:42.744424 24113 raft_consensus.cc:2243] T b06ca2d520f7457692822190ac2a8f32 P efd77f14978b4b49880b1a39abc66987 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:42.745538 24113 raft_consensus.cc:2272] T b06ca2d520f7457692822190ac2a8f32 P efd77f14978b4b49880b1a39abc66987 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.748510 24113 tablet_replica.cc:333] T 3454c9475988492d863379ed4177d7c3 P efd77f14978b4b49880b1a39abc66987: stopping tablet replica
I20260709 13:14:42.749233 24113 raft_consensus.cc:2243] T 3454c9475988492d863379ed4177d7c3 P efd77f14978b4b49880b1a39abc66987 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:42.750114 24113 raft_consensus.cc:2272] T 3454c9475988492d863379ed4177d7c3 P efd77f14978b4b49880b1a39abc66987 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.753118 24113 tablet_replica.cc:333] T afd1f7dbbeee4d218895cf5a8e54efd3 P efd77f14978b4b49880b1a39abc66987: stopping tablet replica
I20260709 13:14:42.753772 24113 raft_consensus.cc:2243] T afd1f7dbbeee4d218895cf5a8e54efd3 P efd77f14978b4b49880b1a39abc66987 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.754385 24113 raft_consensus.cc:2272] T afd1f7dbbeee4d218895cf5a8e54efd3 P efd77f14978b4b49880b1a39abc66987 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.794044 24113 tablet_server.cc:196] TabletServer@127.23.140.65:0 shutdown complete.
W20260709 13:14:42.799240  1961 consensus_peers.cc:597] T 849c6495f30e45caa73c1f4be5c2d65c P 4cfc2f643a0a46888b750e0ab7b7fde6 -> Peer efd77f14978b4b49880b1a39abc66987 (127.23.140.65:41453): Couldn't send request to peer efd77f14978b4b49880b1a39abc66987. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:41453: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:42.829035 24113 tablet_server.cc:179] TabletServer@127.23.140.66:0 shutting down...
W20260709 13:14:42.833150  1961 consensus_peers.cc:597] T 0d114296a5964005a874e6e09d94538b P 4cfc2f643a0a46888b750e0ab7b7fde6 -> Peer efd77f14978b4b49880b1a39abc66987 (127.23.140.65:41453): Couldn't send request to peer efd77f14978b4b49880b1a39abc66987. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:41453: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:42.867007 24113 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:42.867832 24113 tablet_replica.cc:333] T c152640dda8d4cce94303c088f3e4314 P cfdfd9c3b64347f997e5d181c39fddcd: stopping tablet replica
I20260709 13:14:42.868782 24113 raft_consensus.cc:2243] T c152640dda8d4cce94303c088f3e4314 P cfdfd9c3b64347f997e5d181c39fddcd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:42.869827 24113 raft_consensus.cc:2272] T c152640dda8d4cce94303c088f3e4314 P cfdfd9c3b64347f997e5d181c39fddcd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.871702 24113 tablet_replica.cc:333] T 8dc82a3179da4d49b0000f0755cb7577 P cfdfd9c3b64347f997e5d181c39fddcd: stopping tablet replica
I20260709 13:14:42.872329 24113 raft_consensus.cc:2243] T 8dc82a3179da4d49b0000f0755cb7577 P cfdfd9c3b64347f997e5d181c39fddcd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.872877 24113 raft_consensus.cc:2272] T 8dc82a3179da4d49b0000f0755cb7577 P cfdfd9c3b64347f997e5d181c39fddcd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.874778 24113 tablet_replica.cc:333] T bd3d2c56c68f4dde862e62fa03ea3390 P cfdfd9c3b64347f997e5d181c39fddcd: stopping tablet replica
I20260709 13:14:42.875319 24113 raft_consensus.cc:2243] T bd3d2c56c68f4dde862e62fa03ea3390 P cfdfd9c3b64347f997e5d181c39fddcd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:42.876219 24113 raft_consensus.cc:2272] T bd3d2c56c68f4dde862e62fa03ea3390 P cfdfd9c3b64347f997e5d181c39fddcd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.878229 24113 tablet_replica.cc:333] T fc2475f8deda4598a7b0273059a49b4f P cfdfd9c3b64347f997e5d181c39fddcd: stopping tablet replica
I20260709 13:14:42.878737 24113 raft_consensus.cc:2243] T fc2475f8deda4598a7b0273059a49b4f P cfdfd9c3b64347f997e5d181c39fddcd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:42.879482 24113 raft_consensus.cc:2272] T fc2475f8deda4598a7b0273059a49b4f P cfdfd9c3b64347f997e5d181c39fddcd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.881090 24113 tablet_replica.cc:333] T fdadc5e784044a589388e57980a8e0dc P cfdfd9c3b64347f997e5d181c39fddcd: stopping tablet replica
I20260709 13:14:42.881610 24113 raft_consensus.cc:2243] T fdadc5e784044a589388e57980a8e0dc P cfdfd9c3b64347f997e5d181c39fddcd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:42.882352 24113 raft_consensus.cc:2272] T fdadc5e784044a589388e57980a8e0dc P cfdfd9c3b64347f997e5d181c39fddcd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.884011 24113 tablet_replica.cc:333] T 086f00b382884297b8409ffe816158fc P cfdfd9c3b64347f997e5d181c39fddcd: stopping tablet replica
I20260709 13:14:42.884560 24113 raft_consensus.cc:2243] T 086f00b382884297b8409ffe816158fc P cfdfd9c3b64347f997e5d181c39fddcd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.885040 24113 raft_consensus.cc:2272] T 086f00b382884297b8409ffe816158fc P cfdfd9c3b64347f997e5d181c39fddcd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.887027 24113 tablet_replica.cc:333] T fe7a5d3b676046eba775b5d39c4c1cd9 P cfdfd9c3b64347f997e5d181c39fddcd: stopping tablet replica
I20260709 13:14:42.887629 24113 raft_consensus.cc:2243] T fe7a5d3b676046eba775b5d39c4c1cd9 P cfdfd9c3b64347f997e5d181c39fddcd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:42.888538 24113 raft_consensus.cc:2272] T fe7a5d3b676046eba775b5d39c4c1cd9 P cfdfd9c3b64347f997e5d181c39fddcd [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:42.890225  1961 consensus_peers.cc:597] T b16576d7015c475fb71585c29048e5a9 P 4cfc2f643a0a46888b750e0ab7b7fde6 -> Peer efd77f14978b4b49880b1a39abc66987 (127.23.140.65:41453): Couldn't send request to peer efd77f14978b4b49880b1a39abc66987. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:41453: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:42.891072 24113 tablet_replica.cc:333] T 849c6495f30e45caa73c1f4be5c2d65c P cfdfd9c3b64347f997e5d181c39fddcd: stopping tablet replica
I20260709 13:14:42.891685 24113 raft_consensus.cc:2243] T 849c6495f30e45caa73c1f4be5c2d65c P cfdfd9c3b64347f997e5d181c39fddcd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.892100 24113 raft_consensus.cc:2272] T 849c6495f30e45caa73c1f4be5c2d65c P cfdfd9c3b64347f997e5d181c39fddcd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.894407 24113 tablet_replica.cc:333] T 6476c353b8b04452a9edbbff28e6c212 P cfdfd9c3b64347f997e5d181c39fddcd: stopping tablet replica
I20260709 13:14:42.894937 24113 raft_consensus.cc:2243] T 6476c353b8b04452a9edbbff28e6c212 P cfdfd9c3b64347f997e5d181c39fddcd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.895350 24113 raft_consensus.cc:2272] T 6476c353b8b04452a9edbbff28e6c212 P cfdfd9c3b64347f997e5d181c39fddcd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.897209 24113 tablet_replica.cc:333] T afd1f7dbbeee4d218895cf5a8e54efd3 P cfdfd9c3b64347f997e5d181c39fddcd: stopping tablet replica
I20260709 13:14:42.897718 24113 raft_consensus.cc:2243] T afd1f7dbbeee4d218895cf5a8e54efd3 P cfdfd9c3b64347f997e5d181c39fddcd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:42.899107 24113 raft_consensus.cc:2272] T afd1f7dbbeee4d218895cf5a8e54efd3 P cfdfd9c3b64347f997e5d181c39fddcd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.902400 24113 tablet_replica.cc:333] T 7efaa7b0e2a6420282d24eed82603436 P cfdfd9c3b64347f997e5d181c39fddcd: stopping tablet replica
I20260709 13:14:42.903016 24113 raft_consensus.cc:2243] T 7efaa7b0e2a6420282d24eed82603436 P cfdfd9c3b64347f997e5d181c39fddcd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.903450 24113 raft_consensus.cc:2272] T 7efaa7b0e2a6420282d24eed82603436 P cfdfd9c3b64347f997e5d181c39fddcd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.905435 24113 tablet_replica.cc:333] T 0d114296a5964005a874e6e09d94538b P cfdfd9c3b64347f997e5d181c39fddcd: stopping tablet replica
I20260709 13:14:42.906002 24113 raft_consensus.cc:2243] T 0d114296a5964005a874e6e09d94538b P cfdfd9c3b64347f997e5d181c39fddcd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.906512 24113 raft_consensus.cc:2272] T 0d114296a5964005a874e6e09d94538b P cfdfd9c3b64347f997e5d181c39fddcd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.908155 24113 tablet_replica.cc:333] T 2f141c8bf4624551b8906e0469e6c4d8 P cfdfd9c3b64347f997e5d181c39fddcd: stopping tablet replica
I20260709 13:14:42.908655 24113 raft_consensus.cc:2243] T 2f141c8bf4624551b8906e0469e6c4d8 P cfdfd9c3b64347f997e5d181c39fddcd [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:42.909394 24113 raft_consensus.cc:2272] T 2f141c8bf4624551b8906e0469e6c4d8 P cfdfd9c3b64347f997e5d181c39fddcd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.911677 24113 tablet_replica.cc:333] T 6b8eac6adeda4c8a9e8e4142a9b86feb P cfdfd9c3b64347f997e5d181c39fddcd: stopping tablet replica
I20260709 13:14:42.912197 24113 raft_consensus.cc:2243] T 6b8eac6adeda4c8a9e8e4142a9b86feb P cfdfd9c3b64347f997e5d181c39fddcd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.912602 24113 raft_consensus.cc:2272] T 6b8eac6adeda4c8a9e8e4142a9b86feb P cfdfd9c3b64347f997e5d181c39fddcd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.914644 24113 tablet_replica.cc:333] T 3454c9475988492d863379ed4177d7c3 P cfdfd9c3b64347f997e5d181c39fddcd: stopping tablet replica
I20260709 13:14:42.915182 24113 raft_consensus.cc:2243] T 3454c9475988492d863379ed4177d7c3 P cfdfd9c3b64347f997e5d181c39fddcd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.915639 24113 raft_consensus.cc:2272] T 3454c9475988492d863379ed4177d7c3 P cfdfd9c3b64347f997e5d181c39fddcd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.917656 24113 tablet_replica.cc:333] T b06ca2d520f7457692822190ac2a8f32 P cfdfd9c3b64347f997e5d181c39fddcd: stopping tablet replica
I20260709 13:14:42.918165 24113 raft_consensus.cc:2243] T b06ca2d520f7457692822190ac2a8f32 P cfdfd9c3b64347f997e5d181c39fddcd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.918606 24113 raft_consensus.cc:2272] T b06ca2d520f7457692822190ac2a8f32 P cfdfd9c3b64347f997e5d181c39fddcd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.920493 24113 tablet_replica.cc:333] T b16576d7015c475fb71585c29048e5a9 P cfdfd9c3b64347f997e5d181c39fddcd: stopping tablet replica
I20260709 13:14:42.921109 24113 raft_consensus.cc:2243] T b16576d7015c475fb71585c29048e5a9 P cfdfd9c3b64347f997e5d181c39fddcd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.921590 24113 raft_consensus.cc:2272] T b16576d7015c475fb71585c29048e5a9 P cfdfd9c3b64347f997e5d181c39fddcd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.924829 24113 tablet_replica.cc:333] T aaaceebb1e1c4a61968762f9b4b32dea P cfdfd9c3b64347f997e5d181c39fddcd: stopping tablet replica
W20260709 13:14:42.925117  1963 consensus_peers.cc:597] T 849c6495f30e45caa73c1f4be5c2d65c P 4cfc2f643a0a46888b750e0ab7b7fde6 -> Peer cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66:43351): Couldn't send request to peer cfdfd9c3b64347f997e5d181c39fddcd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:42.925516 24113 raft_consensus.cc:2243] T aaaceebb1e1c4a61968762f9b4b32dea P cfdfd9c3b64347f997e5d181c39fddcd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:42.926080 24113 raft_consensus.cc:2272] T aaaceebb1e1c4a61968762f9b4b32dea P cfdfd9c3b64347f997e5d181c39fddcd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:42.967682 24113 tablet_server.cc:196] TabletServer@127.23.140.66:0 shutdown complete.
W20260709 13:14:42.975726  1961 consensus_peers.cc:597] T aaaceebb1e1c4a61968762f9b4b32dea P 4cfc2f643a0a46888b750e0ab7b7fde6 -> Peer efd77f14978b4b49880b1a39abc66987 (127.23.140.65:41453): Couldn't send request to peer efd77f14978b4b49880b1a39abc66987. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.65:41453: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:43.001848 24113 tablet_server.cc:179] TabletServer@127.23.140.67:0 shutting down...
I20260709 13:14:43.039387 24113 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:43.040199 24113 tablet_replica.cc:333] T bd3d2c56c68f4dde862e62fa03ea3390 P 4cfc2f643a0a46888b750e0ab7b7fde6: stopping tablet replica
I20260709 13:14:43.041067 24113 raft_consensus.cc:2243] T bd3d2c56c68f4dde862e62fa03ea3390 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.041684 24113 raft_consensus.cc:2272] T bd3d2c56c68f4dde862e62fa03ea3390 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.044283 24113 tablet_replica.cc:333] T c152640dda8d4cce94303c088f3e4314 P 4cfc2f643a0a46888b750e0ab7b7fde6: stopping tablet replica
I20260709 13:14:43.045061 24113 raft_consensus.cc:2243] T c152640dda8d4cce94303c088f3e4314 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.045634 24113 raft_consensus.cc:2272] T c152640dda8d4cce94303c088f3e4314 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.048192 24113 tablet_replica.cc:333] T 8dc82a3179da4d49b0000f0755cb7577 P 4cfc2f643a0a46888b750e0ab7b7fde6: stopping tablet replica
I20260709 13:14:43.048990 24113 raft_consensus.cc:2243] T 8dc82a3179da4d49b0000f0755cb7577 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.049536 24113 raft_consensus.cc:2272] T 8dc82a3179da4d49b0000f0755cb7577 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.052237 24113 tablet_replica.cc:333] T fdadc5e784044a589388e57980a8e0dc P 4cfc2f643a0a46888b750e0ab7b7fde6: stopping tablet replica
I20260709 13:14:43.053165 24113 raft_consensus.cc:2243] T fdadc5e784044a589388e57980a8e0dc P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.053835 24113 raft_consensus.cc:2272] T fdadc5e784044a589388e57980a8e0dc P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.057189 24113 tablet_replica.cc:333] T 7efaa7b0e2a6420282d24eed82603436 P 4cfc2f643a0a46888b750e0ab7b7fde6: stopping tablet replica
I20260709 13:14:43.058066 24113 raft_consensus.cc:2243] T 7efaa7b0e2a6420282d24eed82603436 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.058681 24113 raft_consensus.cc:2272] T 7efaa7b0e2a6420282d24eed82603436 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.061185 24113 tablet_replica.cc:333] T fc2475f8deda4598a7b0273059a49b4f P 4cfc2f643a0a46888b750e0ab7b7fde6: stopping tablet replica
I20260709 13:14:43.062027 24113 raft_consensus.cc:2243] T fc2475f8deda4598a7b0273059a49b4f P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.062631 24113 raft_consensus.cc:2272] T fc2475f8deda4598a7b0273059a49b4f P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.065294 24113 tablet_replica.cc:333] T fe7a5d3b676046eba775b5d39c4c1cd9 P 4cfc2f643a0a46888b750e0ab7b7fde6: stopping tablet replica
I20260709 13:14:43.066197 24113 raft_consensus.cc:2243] T fe7a5d3b676046eba775b5d39c4c1cd9 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.066905 24113 raft_consensus.cc:2272] T fe7a5d3b676046eba775b5d39c4c1cd9 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.069941 24113 tablet_replica.cc:333] T 849c6495f30e45caa73c1f4be5c2d65c P 4cfc2f643a0a46888b750e0ab7b7fde6: stopping tablet replica
I20260709 13:14:43.070739 24113 raft_consensus.cc:2243] T 849c6495f30e45caa73c1f4be5c2d65c P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:43.071842 24113 raft_consensus.cc:2272] T 849c6495f30e45caa73c1f4be5c2d65c P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:43.074363  1963 consensus_peers.cc:597] T b16576d7015c475fb71585c29048e5a9 P 4cfc2f643a0a46888b750e0ab7b7fde6 -> Peer cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66:43351): Couldn't send request to peer cfdfd9c3b64347f997e5d181c39fddcd. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.66:43351: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:43.074966 24113 tablet_replica.cc:333] T 6476c353b8b04452a9edbbff28e6c212 P 4cfc2f643a0a46888b750e0ab7b7fde6: stopping tablet replica
W20260709 13:14:43.075232  1963 consensus_peers.cc:597] T aaaceebb1e1c4a61968762f9b4b32dea P 4cfc2f643a0a46888b750e0ab7b7fde6 -> Peer cfdfd9c3b64347f997e5d181c39fddcd (127.23.140.66:43351): Couldn't send request to peer cfdfd9c3b64347f997e5d181c39fddcd. Status: Network error: Client connection negotiation failed: client connection to 127.23.140.66:43351: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:43.075908 24113 raft_consensus.cc:2243] T 6476c353b8b04452a9edbbff28e6c212 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.076701 24113 raft_consensus.cc:2272] T 6476c353b8b04452a9edbbff28e6c212 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.079375 24113 tablet_replica.cc:333] T afd1f7dbbeee4d218895cf5a8e54efd3 P 4cfc2f643a0a46888b750e0ab7b7fde6: stopping tablet replica
I20260709 13:14:43.080276 24113 raft_consensus.cc:2243] T afd1f7dbbeee4d218895cf5a8e54efd3 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.080874 24113 raft_consensus.cc:2272] T afd1f7dbbeee4d218895cf5a8e54efd3 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.083731 24113 tablet_replica.cc:333] T 086f00b382884297b8409ffe816158fc P 4cfc2f643a0a46888b750e0ab7b7fde6: stopping tablet replica
I20260709 13:14:43.084443 24113 raft_consensus.cc:2243] T 086f00b382884297b8409ffe816158fc P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.084975 24113 raft_consensus.cc:2272] T 086f00b382884297b8409ffe816158fc P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.087410 24113 tablet_replica.cc:333] T b16576d7015c475fb71585c29048e5a9 P 4cfc2f643a0a46888b750e0ab7b7fde6: stopping tablet replica
I20260709 13:14:43.088155 24113 raft_consensus.cc:2243] T b16576d7015c475fb71585c29048e5a9 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:43.089233 24113 raft_consensus.cc:2272] T b16576d7015c475fb71585c29048e5a9 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.092301 24113 tablet_replica.cc:333] T aaaceebb1e1c4a61968762f9b4b32dea P 4cfc2f643a0a46888b750e0ab7b7fde6: stopping tablet replica
I20260709 13:14:43.093134 24113 raft_consensus.cc:2243] T aaaceebb1e1c4a61968762f9b4b32dea P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:43.094360 24113 raft_consensus.cc:2272] T aaaceebb1e1c4a61968762f9b4b32dea P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.097218 24113 tablet_replica.cc:333] T 0d114296a5964005a874e6e09d94538b P 4cfc2f643a0a46888b750e0ab7b7fde6: stopping tablet replica
I20260709 13:14:43.097981 24113 raft_consensus.cc:2243] T 0d114296a5964005a874e6e09d94538b P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:43.098953 24113 raft_consensus.cc:2272] T 0d114296a5964005a874e6e09d94538b P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.101505 24113 tablet_replica.cc:333] T 2f141c8bf4624551b8906e0469e6c4d8 P 4cfc2f643a0a46888b750e0ab7b7fde6: stopping tablet replica
I20260709 13:14:43.102258 24113 raft_consensus.cc:2243] T 2f141c8bf4624551b8906e0469e6c4d8 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.102880 24113 raft_consensus.cc:2272] T 2f141c8bf4624551b8906e0469e6c4d8 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.105654 24113 tablet_replica.cc:333] T 6b8eac6adeda4c8a9e8e4142a9b86feb P 4cfc2f643a0a46888b750e0ab7b7fde6: stopping tablet replica
I20260709 13:14:43.106364 24113 raft_consensus.cc:2243] T 6b8eac6adeda4c8a9e8e4142a9b86feb P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.106896 24113 raft_consensus.cc:2272] T 6b8eac6adeda4c8a9e8e4142a9b86feb P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.109711 24113 tablet_replica.cc:333] T 3454c9475988492d863379ed4177d7c3 P 4cfc2f643a0a46888b750e0ab7b7fde6: stopping tablet replica
I20260709 13:14:43.110477 24113 raft_consensus.cc:2243] T 3454c9475988492d863379ed4177d7c3 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.111028 24113 raft_consensus.cc:2272] T 3454c9475988492d863379ed4177d7c3 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.113819 24113 tablet_replica.cc:333] T b06ca2d520f7457692822190ac2a8f32 P 4cfc2f643a0a46888b750e0ab7b7fde6: stopping tablet replica
I20260709 13:14:43.114482 24113 raft_consensus.cc:2243] T b06ca2d520f7457692822190ac2a8f32 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.115041 24113 raft_consensus.cc:2272] T b06ca2d520f7457692822190ac2a8f32 P 4cfc2f643a0a46888b750e0ab7b7fde6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.162544 24113 tablet_server.cc:196] TabletServer@127.23.140.67:0 shutdown complete.
I20260709 13:14:43.193126 24113 master.cc:562] Master@127.23.140.126:41811 shutting down...
I20260709 13:14:43.219329 24113 raft_consensus.cc:2243] T 00000000000000000000000000000000 P def666c72a25488f80473d75cdada3a6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:43.219869 24113 raft_consensus.cc:2272] T 00000000000000000000000000000000 P def666c72a25488f80473d75cdada3a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.220242 24113 tablet_replica.cc:333] T 00000000000000000000000000000000 P def666c72a25488f80473d75cdada3a6: stopping tablet replica
I20260709 13:14:43.957218 24113 master.cc:584] Master@127.23.140.126:41811 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (12378 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (24626 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (285160 ms total)
[  PASSED  ] 8 tests.
I20260709 13:14:44.011911 24113 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 417 messages since previous log ~15 seconds ago
I20260709 13:14:44.012156 24113 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 417 messages since previous log ~15 seconds ago
I20260709 13:14:44.012344 24113 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 412 messages since previous log ~15 seconds ago
I20260709 13:14:44.012542 24113 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~33 seconds ago
I20260709 13:14:44.012758 24113 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~33 seconds ago
I20260709 13:14:44.012975 24113 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 5 messages since previous log ~124 seconds ago
I20260709 13:14:44.013257 24113 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 8 messages since previous log ~1 seconds ago
I20260709 13:14:44.013513 24113 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 26 messages since previous log ~7 seconds ago
